AML AML Model Deployment & MLOps 2

Question 1

What is a feature store in an MLOps architecture?

Accepted Answer

A centralized repository for storing, sharing, and serving precomputed features for ML models

Answer

Feature stores provide consistent, reusable features across training and serving pipelines, eliminating training-serving skew.

Question 2

What is the purpose of model versioning in MLOps?

Accepted Answer

To track distinct model iterations with metadata to enable rollback and comparison

Answer

Model versioning logs each trained model artifact with its configuration, metrics, and data lineage to support governance and rollback.

Question 3

Which metric category is most critical when monitoring a deployed classification model in production?

Accepted Answer

Prediction confidence distribution and accuracy on live data

Answer

Monitoring live prediction confidence and accuracy reveals model drift and performance degradation before it significantly impacts business outcomes.

Question 4

What is shadow deployment in machine learning operations?

Accepted Answer

Running a new model in parallel with the production model without using its predictions for actual decisions

Answer

Shadow deployment routes live traffic to both the current and new model, logging new model outputs for evaluation without affecting end users.

Question 5

What is the primary purpose of model explainability tools like SHAP in production ML systems?

Accepted Answer

To explain individual predictions and ensure model transparency for stakeholders and auditors

Answer

SHAP attributes each feature's contribution to individual predictions, supporting transparency and regulatory compliance in production.

(AML) Advanced Machine Learning Certification Practice Test