NCA Data Center GPU Solutions 2

Question 1

Which NVIDIA interconnect technology enables high-bandwidth GPU-to-GPU communication within a single server node?

Accepted Answer

NVLink

Answer

NVLink is NVIDIA's proprietary high-speed interconnect that allows GPUs within the same node to share memory and data at much higher bandwidth than PCIe.

Question 2

What is the primary role of NVIDIA's NVSwitch in large-scale GPU deployments?

Accepted Answer

Acts as a high-bandwidth switch enabling all-to-all NVLink connectivity among multiple GPUs

Answer

NVSwitch is a high-speed switch chip that connects multiple GPUs via NVLink, enabling full all-to-all bandwidth across all GPUs in a node like the DGX H100.

Question 3

A data center operator needs to maximize GPU utilization for multiple tenants running different workloads simultaneously. Which NVIDIA technology is most appropriate?

Accepted Answer

Multi-Instance GPU (MIG)

Answer

MIG partitions a single GPU into multiple isolated instances, each with dedicated compute, memory, and bandwidth, enabling safe multi-tenant workloads.

Question 4

Which NVIDIA data center GPU architecture introduced the Transformer Engine for accelerating large language model training?

Accepted Answer

Hopper (H100)

Answer

The Hopper architecture (H100) introduced the Transformer Engine, which dynamically applies FP8 and FP16 precision to accelerate transformer-based model training.

Question 5

In an NVIDIA DGX H100 system, how many H100 GPUs are interconnected via NVLink?

Accepted Answer

8

Answer

The DGX H100 contains 8 H100 SXM5 GPUs fully interconnected via NVLink 4.0 and NVSwitch for a combined 640 GB of HBM3 memory.

(NCA) NVIDIA-Certified Associate Practice Test

(NCA) NVIDIA-Certified Associate Practice Test

NCA Data Center GPU Solutions 2