CPL Performance Measurement & Continuous Improvement 3 — Questions and Answers
Question 1: A CPL is designing a feedback loop for a youth development program. Which element is ESSENTIAL to close the feedback loop effectively?
- Collecting data at program end only
- Sharing findings with funders exclusively
- Acting on data and communicating changes back to stakeholders (Correct answer)
- Limiting feedback to quantitative measures
Correct answer: Acting on data and communicating changes back to stakeholders
A closed feedback loop requires not only collecting and analyzing data but also acting on findings and communicating those actions to the people who provided the feedback.
Question 2: Which type of evaluation examines whether a program is being implemented as planned?
- Summative evaluation
- Impact evaluation
- Process evaluation (Correct answer)
- Economic evaluation
Correct answer: Process evaluation
A process evaluation (also called implementation evaluation) assesses whether program activities are being delivered as designed.
Question 3: A program serves 200 eligible participants out of 1,000 in the community. What is the program's reach rate?
- 10%
- 20% (Correct answer)
- 50%
- 80%
Correct answer: 20%
Reach rate = participants served ÷ total eligible population = 200 ÷ 1,000 = 20%.
Question 4: The '5 Whys' technique is BEST used to:
- Prioritize multiple improvement opportunities
- Drill down to the root cause of a single problem (Correct answer)
- Map the steps in a complex process
- Set performance benchmarks against peer organizations
Correct answer: Drill down to the root cause of a single problem
The 5 Whys technique iteratively asks 'why' to peel back layers of symptoms and reach the underlying root cause of a problem.
Question 5: A program leader wants to compare their program's outcomes against similar programs nationally. This practice is called:
- Trend analysis
- Benchmarking (Correct answer)
- Gap analysis
- Needs assessment
Correct answer: Benchmarking
Benchmarking involves comparing a program's performance metrics against those of similar programs or industry standards to identify gaps and best practices.
Question 6: Which data collection method is MOST appropriate for capturing nuanced participant experiences that surveys may miss?
- Administrative records review
- In-depth qualitative interviews (Correct answer)
- Pre/post standardized tests
- Attendance tracking
Correct answer: In-depth qualitative interviews
In-depth qualitative interviews allow participants to share detailed experiences, motivations, and perspectives that structured surveys cannot capture.
Question 7: A program's theory of change assumes that providing job skills training will reduce unemployment. This assumption is BEST tested through:
- A fidelity checklist
- A randomized controlled trial or quasi-experimental design (Correct answer)
- Staff satisfaction surveys
- A logic model revision
Correct answer: A randomized controlled trial or quasi-experimental design
Testing causal assumptions in a theory of change requires an experimental or quasi-experimental design to determine whether the intervention, not other factors, caused the change.
CPL Performance Measurement & Continuous Improvement 3
A CPL is designing a feedback loop for a youth development program.
Which element is ESSENTIAL to close the feedback loop effectively?