Toil Reduction & Elimination Flashcards

An SRE team spends 30% of their time manually restarting crashed microservices. Which automation approach BEST eliminates this toil?

Answer: Implement liveness probes and automatic pod restarts in Kubernetes

Liveness probes with automatic restarts fully automate the detection and remediation, eliminating the manual toil entirely.

What distinguishes 'overhead' from 'toil' in the SRE framework?

Answer: Overhead has lasting value but no direct production impact, while toil is repetitive manual work scaling with service growth

Overhead refers to administrative work (meetings, HR tasks) that has organizational value but doesn't scale with service load, unlike toil which grows proportionally.

A team's on-call rotation handles 50 alerts per week, 80% of which are auto-resolved before engineers investigate. What should be the FIRST step?

Answer: Silence the alerts that always auto-resolve and add automation to handle them

Alerts that consistently auto-resolve without human action are pure toil — they should be automated end-to-end or suppressed with automated remediation.

Which metric BEST measures the impact of a toil-reduction initiative over time?

Answer: Percentage of engineering time spent on toil before and after automation

Tracking the percentage of engineering time consumed by toil directly measures whether the initiative is freeing engineers for higher-value work.

A runbook step says 'run this SQL query monthly to archive old records.' How should an SRE classify and address this?

Answer: Classify as toil and automate with a scheduled cron job or database maintenance policy

Repetitive manual tasks with predictable triggers are classic toil regardless of frequency and should be automated away.

When evaluating whether to automate a toil task, which factor most strongly justifies NOT automating it immediately?

Answer: The automation effort exceeds the cumulative toil cost over the next two years

Cost-benefit analysis is essential — if automation takes longer to build than the toil it would save, it may not be worth prioritizing over other investments.

An SRE team automates certificate renewal but still manually verifies the renewal succeeded each month. What toil remains?

Answer: The manual verification step is residual toil that should be replaced with automated monitoring and alerting

Any repetitive manual check that doesn't require human judgment is toil — automated monitoring with alerting on failure should replace the manual verification.