Neural Network Deep Learning Architectures

Question 1

What distinguishes a deep neural network from a shallow neural network?

Accepted Answer

It has multiple hidden layers

Answer

A deep neural network contains multiple hidden layers that allow it to learn hierarchical representations of data.

Question 2

Which architecture is specifically designed for processing sequential data with long-range dependencies?

Accepted Answer

Transformer

Answer

The Transformer architecture uses self-attention mechanisms to handle long-range dependencies in sequential data without recurrence.

Question 3

What is the primary role of the encoder in an autoencoder network?

Accepted Answer

To compress input into a latent representation

Answer

The encoder compresses the input data into a lower-dimensional latent space representation.

Question 4

In a Generative Adversarial Network (GAN), what is the role of the discriminator?

Accepted Answer

To distinguish real samples from generated ones

Answer

The discriminator learns to classify whether a given sample is real (from the training set) or fake (generated by the generator).

Question 5

Which component of a Variational Autoencoder (VAE) enables backpropagation through the sampling step?

Accepted Answer

The reparameterization trick

Answer

The reparameterization trick expresses the random sample as a deterministic function of the latent mean and variance, enabling gradients to flow through.

Neural Network Practice Test

Neural Network Practice Test

Neural Network Deep Learning Architectures