AI/ML
NCCL: Scaling Deep Learning Training with NCCL
brew install libomp brew install openmpi g++ -fopenmp -I /opt/homebrew/opt/openmpi/include -L /opt/homebrew/opt/openmpi/lib -lmpi z.cpp OMP_NUM_THREADS=3 mpirun -np 4 ./a.out