TensorFlow Model Training and Optimization

Question 1

Which optimizer uses adaptive learning rates based on first and second moment estimates?

Accepted Answer

Adam

Answer

SGD

Answer

RMSprop

Answer

Adagrad

Question 2

What does the learning rate hyperparameter control in gradient descent?

Accepted Answer

The step size taken toward the minimum of the loss function

Answer

The number of training epochs

Answer

The batch size

Answer

The number of layers

Question 3

What is gradient clipping used for in TensorFlow training?

Accepted Answer

Preventing exploding gradients by capping gradient magnitude

Answer

Speeding up backpropagation

Answer

Removing small gradients

Answer

Scheduling learning rate decay

Question 4

Which TensorFlow callback reduces the learning rate when a metric plateaus?

Accepted Answer

ReduceLROnPlateau

Answer

LearningRateScheduler

Answer

EarlyStopping

Answer

TensorBoard

Question 5

What is the vanishing gradient problem in deep neural networks?

Accepted Answer

Gradients become extremely small during backpropagation, preventing weight updates in early layers

Answer

Gradients disappear when GPU memory is full

Answer

Loss function outputs zero

Answer

Model weights become NaN

Question 6

Which technique trains a model in multiple steps with increasing dataset sizes?

Accepted Answer

Curriculum learning

Answer

Transfer learning

Answer

Knowledge distillation

Answer

Federated learning