CAIC Software Development Lifecycle 3

Question 1

Which type of technical debt is UNIQUE to AI systems compared to traditional software?

Accepted Answer

Dependency on stale training data

Answer

AI systems accumulate data debt when training datasets become stale, causing model performance to degrade as the real world changes.

Question 2

During sprint retrospective, a team notes that model retraining takes too long. The BEST solution within an Agile SDLC is:

Accepted Answer

Add automated retraining pipelines as backlog items

Answer

Creating backlog items for pipeline automation is the Agile approach to addressing process inefficiencies iteratively.

Question 3

A feature store is BEST described as:

Accepted Answer

A centralized system for managing and sharing ML features across teams

Answer

A feature store centralizes the computation, storage, and serving of ML features, ensuring consistency between training and inference.

Question 4

In an AI project, a 'shadow mode' deployment is used to:

Accepted Answer

Run a new model in parallel with the old one without affecting users

Answer

Shadow mode runs the new model alongside the production model, capturing its outputs for evaluation without impacting user experience.

Question 5

Which gate is MOST appropriate to include in an AI CI/CD pipeline to prevent data quality regressions?

Accepted Answer

Automated data validation and schema checks

Answer

Automated data validation checks enforce schema, null rates, and distribution bounds so pipeline failures catch data quality issues immediately.

(CAIC) Certified AI Consultant Practice Test