Convolutional Layer Operations Flashcards

A convolutional layer in a CNN has an input of size 64x64x16. It uses 32 filters, each of size 3x3, a stride of 1, and 'same' padding. What is the dimensionality of the output feature map?

Answer: 64x64x32

The output dimensions are calculated as follows: Output Width = (Input Width - Filter Width + 2 * Padding) / Stride + 1. With 'same' padding, the output height and width are preserved to be the same as the input (64x64). The depth of the output is determined by the number of filters used, which is 32. Therefore, the output volume is 64x64x32.

Which of the following best describes the primary purpose of a 1x1 convolution operation in a CNN architecture?

Answer: To act as a channel-wise, fully connected layer for dimensionality reduction or expansion.

A 1x1 convolution operates across all channels at a single pixel location. This allows it to learn combinations of features across channels, effectively acting like a fully connected layer for the channel dimension. It is widely used for dimensionality reduction (by using fewer filters than input channels) or expansion, which helps in building more efficient architectures like Inception networks.

In a convolutional layer, what is the effect of increasing the stride value from 1 to 2?

Answer: It reduces the spatial dimensions of the output feature map.

The stride defines the step size the filter takes as it moves across the input image. A larger stride means the filter skips more pixels, resulting in a smaller output feature map. This operation is a form of down-sampling and reduces the computational load and number of parameters in subsequent layers.

A data scientist is designing a CNN to classify high-resolution medical images where preserving spatial information in the early layers is critical. Which hyperparameter setting for the initial convolutional layers would be most appropriate?

Answer: Small filter size (e.g., 3x3), stride of 1, and 'same' padding.

To preserve spatial information, it is best to avoid aggressive down-sampling in the early layers. A small filter size (3x3) captures local features, a stride of 1 ensures the filter moves pixel-by-pixel without skipping information, and 'same' padding ensures that the output feature map has the same spatial dimensions as the input, preventing information loss at the borders.

What is the key difference between a standard convolution operation and a transposed convolution (often called deconvolution)?

Answer: Transposed convolution is a mathematical operation that performs learnable up-sampling, increasing the spatial resolution of the feature map.

While a standard convolution typically reduces spatial dimensions, a transposed convolution works to increase them. It is not the mathematical inverse of convolution but is mechanically the backward pass of a standard convolution, allowing the network to learn how to up-sample feature maps, which is crucial in tasks like semantic segmentation and image generation.

The process in a convolutional layer where a filter slides over the input data, computes element-wise products, and sums them up to create a single value in the output is known as what?

Answer: Convolution

This describes the fundamental convolution operation. The filter (or kernel) moves across the input, and at each position, the dot product between the filter's weights and the corresponding input values is calculated. This result forms one element of the output feature map.