Machine Learning Neural Networks 3

Question 1

What is the primary purpose of the softmax function in the output layer of a classifier?

Accepted Answer

To convert raw logits into a probability distribution summing to 1

Answer

Softmax exponentiates each logit and divides by the sum, converting raw scores into probabilities that sum to 1 across all classes.

Question 2

What distinguishes a generative adversarial network (GAN) from a standard neural network?

Accepted Answer

GANs consist of two networks — a generator and discriminator — trained adversarially

Answer

A GAN pits a generator that creates fake data against a discriminator that tries to distinguish real from fake, training both simultaneously.

Question 3

In neural networks, what is a hyperparameter?

Accepted Answer

A configuration setting chosen before training begins

Answer

Hyperparameters like learning rate, batch size, and number of layers are set before training and are not updated by the optimizer.

Question 4

What does the term 'epoch' refer to in neural network training?

Accepted Answer

One complete pass through the entire training dataset

Answer

An epoch is one full cycle where the model has seen every training example exactly once.

Question 5

Which optimizer adapts the learning rate for each parameter individually using estimates of first and second moments of gradients?

Accepted Answer

Adam

Answer

Adam (Adaptive Moment Estimation) maintains per-parameter adaptive learning rates using exponentially decaying averages of past gradients and squared gradients.

Machine Learning Practice Test

Machine Learning Practice Test

Machine Learning Neural Networks 3