Deep Learning Neural Network Fundamentals 2

Question 1

What is backpropagation in the context of neural network training?

Accepted Answer

Algorithm to compute gradients via the chain rule

Answer

Backpropagation applies the chain rule of calculus to efficiently compute gradients of the loss with respect to every weight in the network.

Question 2

Which loss function is most commonly used for multi-class classification problems?

Accepted Answer

Categorical Cross-Entropy

Answer

Categorical Cross-Entropy measures the dissimilarity between predicted probability distributions and one-hot encoded true class labels.

Question 3

What is the universal approximation theorem?

Accepted Answer

A single hidden layer with enough neurons can approximate any continuous function

Answer

The universal approximation theorem states that a feedforward network with one hidden layer and sufficient neurons can approximate any continuous function on a compact subset.

Question 4

What does the learning rate hyperparameter control during gradient descent?

Accepted Answer

The size of the step taken in the direction of the negative gradient

Answer

The learning rate determines how large a step is taken when updating weights along the gradient direction, balancing convergence speed and stability.

Question 5

What is a perceptron in neural network terminology?

Accepted Answer

A single artificial neuron that computes a weighted sum and applies a threshold

Answer

A perceptron is the simplest neural network unit, computing a weighted sum of inputs and producing a binary output via a step activation function.

Deep Learning Practice Test

Deep Learning Practice Test

Deep Learning Neural Network Fundamentals 2