NCA AI & Deep Learning Frameworks 5

Question 1

What is the attention mechanism in transformer models computing with its Query, Key, and Value matrices?

Accepted Answer

Computing weighted sums of value vectors, where weights derive from query-key dot product similarities

Answer

Self-attention computes dot products between queries and keys to produce attention weights, then uses those weights to aggregate value vectors into context-aware representations.

Question 2

Which NVIDIA software stack component provides a container runtime that allows Docker containers to access GPUs?

Accepted Answer

NVIDIA Container Toolkit (nvidia-docker)

Answer

The NVIDIA Container Toolkit (formerly nvidia-docker2) enables Docker containers to access GPU resources through a container runtime hook.

Question 3

What distinguishes pipeline parallelism from tensor parallelism in distributed training?

Accepted Answer

Pipeline parallelism splits layers sequentially across GPUs, while tensor parallelism partitions individual layer computations

Answer

Pipeline parallelism assigns different layers to different GPUs (inter-layer), while tensor parallelism splits individual layer weight matrices across GPUs (intra-layer).

Question 4

In PyTorch, what is `torch.compile()` (introduced in PyTorch 2.0) designed to do?

Accepted Answer

JIT-compile PyTorch models using TorchInductor to generate optimized code for CPUs and GPUs

Answer

`torch.compile()` uses TorchDynamo and TorchInductor to JIT-compile PyTorch models, often achieving 2x or more speedup through kernel fusion and optimized code generation.

Question 5

What is the purpose of batch normalization in deep neural networks?

Accepted Answer

Normalizing layer inputs across the batch dimension to stabilize training and accelerate convergence

Answer

Batch normalization normalizes activations to have zero mean and unit variance within each mini-batch, reducing internal covariate shift and enabling higher learning rates.

(NCA) NVIDIA-Certified Associate Practice Test

(NCA) NVIDIA-Certified Associate Practice Test

NCA AI & Deep Learning Frameworks 5