NCA Edge AI & Embedded Systems 4

Question 1

In a multi-camera edge inference system using DeepStream, what is the role of a 'nvstreammux' element?

Accepted Answer

It batches frames from multiple input sources into a single buffer for efficient GPU inference

Answer

nvstreammux batches frames from multiple sources into a single NvBufSurface buffer, enabling the GPU to process multiple streams in one inference call.

Question 2

What does the 'DLA' (Deep Learning Accelerator) on Jetson AGX Orin provide compared to using the GPU alone?

Accepted Answer

A dedicated, power-efficient fixed-function accelerator for inference that offloads the GPU for concurrent workloads

Answer

The DLA is a lower-power fixed-function accelerator optimized for inference, freeing the GPU to handle layers unsupported by DLA or additional concurrent tasks.

Question 3

A retail edge AI system must detect shoplifting events locally and store video clips without sending PII to the cloud. Which architectural pattern best satisfies this requirement?

Accepted Answer

On-device inference with local encrypted storage and metadata-only cloud sync

Answer

Running inference locally and storing only encrypted clips with anonymized metadata keeps PII on-device, satisfying privacy regulations while still enabling analytics.

Question 4

Which format does NVIDIA recommend as the intermediate representation when exporting a PyTorch model for TensorRT optimization on edge devices?

Accepted Answer

ONNX

Answer

ONNX (Open Neural Network Exchange) is the standard intermediate format for converting PyTorch or TensorFlow models before importing into TensorRT.

Question 5

What is the significance of 'latency vs. throughput' trade-off when tuning a TensorRT deployment on Jetson for a real-time robotics application?

Accepted Answer

A large batch size increases throughput but also increases per-frame latency, which may violate real-time control loop requirements

Answer

Larger batches amortize GPU overhead and improve throughput, but each frame must wait for the batch to fill, increasing latency beyond what a real-time control loop can tolerate.

(NCA) NVIDIA-Certified Associate Practice Test

(NCA) NVIDIA-Certified Associate Practice Test

NCA Edge AI & Embedded Systems 4