Object Detection Models Flashcards

An engineer is developing a system for real-time object detection on a mobile device with limited computational power. The highest priority is inference speed, even if it means a slight trade-off in accuracy, especially for very small objects. Which object detection model architecture is most suitable for this scenario?

Answer: A one-stage detector like YOLO or SSD, because it performs localization and classification in a single pass, optimizing for speed.

One-stage detectors like YOLO (You Only Look Once) and SSD (Single Shot MultiBox Detector) are designed for speed and efficiency. They treat object detection as a single regression problem, directly predicting bounding boxes and class probabilities from the entire image in one pass. This contrasts with two-stage detectors like Faster R-CNN, which first generate region proposals and then classify those regions, leading to higher accuracy but slower inference times. For real-time applications on resource-constrained devices, the speed of one-stage detectors is a significant advantage.

In object detection, what is the primary purpose of the Non-Maximum Suppression (NMS) algorithm?

Answer: To select the single best bounding box for an object from multiple overlapping predictions.

Non-Maximum Suppression (NMS) is a crucial post-processing step in object detection. Models often output multiple, highly overlapping bounding boxes for the same object. NMS cleans up these redundant detections by iteratively selecting the box with the highest confidence score and suppressing (removing) other nearby boxes that have a high Intersection over Union (IoU) with the selected box. This ensures that each detected object is represented by only one bounding box in the final output.

What was the key innovation in the Faster R-CNN architecture that distinguished it from its predecessor, Fast R-CNN?

Answer: The introduction of a Region Proposal Network (RPN) to generate object proposals within the main network.

The main bottleneck in Fast R-CNN was its reliance on an external, CPU-based algorithm like Selective Search to generate region proposals. The groundbreaking innovation of Faster R-CNN was the introduction of the Region Proposal Network (RPN), a fully convolutional network that is integrated into the main detection pipeline. The RPN shares convolutional features with the detection network, allowing it to generate high-quality region proposals almost for free, which made the entire object detection process significantly faster and trainable end-to-end.

Which of the following best describes the role of anchor boxes in models like Faster R-CNN and SSD?

Answer: They are a set of predefined reference boxes of various sizes and aspect ratios used as a starting point for predicting bounding box offsets.

Anchor boxes (also called default or prior boxes) are a set of predefined boxes with different scales and aspect ratios. Instead of predicting the absolute coordinates of a bounding box from scratch, the model predicts offsets (adjustments in position and size) relative to these anchor boxes. This approach simplifies the learning problem by turning it into a regression task of refining these initial 'guesses', making it easier for the network to detect objects of various shapes and sizes.

A data scientist is evaluating their object detection model's performance. They are using Intersection over Union (IoU) to determine if a predicted bounding box is a true positive. What does an IoU score of 0.8 signify?

Answer: There is a high degree of overlap, with the area of intersection being 80% of the area of the union between the predicted and ground-truth boxes.

Intersection over Union (IoU) is a metric used to evaluate the accuracy of a predicted bounding box by measuring how much it overlaps with the ground-truth box. It is calculated as the area of the intersection of the two boxes divided by the area of their union. An IoU score of 0.8 indicates a very good localization, as it means the shared area (intersection) is 80% of the total area covered by both boxes combined (union), signifying a strong overlap.

Which of the following is a defining characteristic of one-stage object detectors like SSD (Single Shot MultiBox Detector)?

Answer: They make predictions on a dense grid of locations across feature maps of multiple scales.

A key feature of one-stage detectors like SSD is that they bypass the explicit region proposal step found in two-stage detectors. Instead, they apply a set of convolutional filters to feature maps at different scales in the network. At each location on these feature maps (a dense grid), the model predicts bounding box offsets and class probabilities simultaneously. Using multiple feature maps allows the model to detect objects of various sizes in a single forward pass.