What is the primary purpose of NVIDIA's NCCL (NCCL Collective Communications Library) in distributed AI training?
-
A
GPU memory management across nodes
-
B
Optimized collective communication primitives leveraging NVLink, InfiniBand, and RoCE
-
C
CPU-to-GPU data transfer scheduling
-
D
Container network namespace management