DOL Metrics and KPIs 2

Question 1

A DevOps team tracks 'Mean Time to Detect' (MTTD). What does this metric primarily measure?

Accepted Answer

Average time from incident occurrence to alert firing

Answer

MTTD measures the average elapsed time between when an incident begins and when the team receives an alert or discovers the problem.

Question 2

Which metric best reflects the effectiveness of a team's testing and code review process upstream of production?

Accepted Answer

Change failure rate

Answer

Change failure rate directly measures the percentage of deployments causing production failures, revealing how well pre-production quality gates work.

Question 3

A leader wants to reduce alert fatigue. Which KPI should they focus on to measure progress?

Accepted Answer

Alert-to-incident ratio

Answer

Alert-to-incident ratio measures what fraction of alerts correspond to real incidents, so improving it means fewer false positives and less fatigue.

Question 4

What is the primary risk of optimizing a single metric like deployment frequency in isolation?

Accepted Answer

Teams may sacrifice quality or stability to boost the number

Answer

Goodhart's Law warns that when a measure becomes a target, teams game it — shipping trivial changes just to inflate deployment count while ignoring quality.

Question 5

Which approach best ensures SLO (Service Level Objective) thresholds remain meaningful over time?

Accepted Answer

Review and adjust SLOs each quarter based on user feedback and error budget consumption

Answer

SLOs should be living targets reviewed regularly against actual error budget burn and evolving user expectations to stay actionable.

(DOL) DevOps Leader Practice Test

(DOL) DevOps Leader Practice Test

DOL Metrics and KPIs 2