CVA Program Evaluation & Continuous Improvement 2 — Questions and Answers
Question 1: Which evaluation design compares program outcomes to a group that did not receive the intervention?
- Pre-post design
- Control group design (Correct answer)
- Time series design
- Case study design
Correct answer: Control group design
A control group design measures outcomes in both a program group and a non-program group to isolate the program's effect.
Question 2: What does 'attribution' mean in the context of program evaluation?
- Crediting volunteers for their contributions
- Linking observed outcomes to the program rather than other factors (Correct answer)
- Assigning evaluation tasks to staff members
- Documenting data sources in a report
Correct answer: Linking observed outcomes to the program rather than other factors
Attribution refers to determining the degree to which a program caused the observed outcomes versus external factors.
Question 3: A volunteer manager notices satisfaction scores dropped after a policy change. Which continuous improvement step should come next?
- Immediately reverse the policy
- Conduct root cause analysis to understand why scores dropped (Correct answer)
- Ignore the data and wait for scores to recover
- Recruit new volunteers to replace dissatisfied ones
Correct answer: Conduct root cause analysis to understand why scores dropped
Root cause analysis helps identify the underlying reasons for a performance decline before deciding on corrective action.
Question 4: Which metric best measures volunteer program efficiency?
- Total number of volunteers recruited
- Program outcomes achieved per dollar or hour invested (Correct answer)
- Average volunteer age
- Number of training sessions held
Correct answer: Program outcomes achieved per dollar or hour invested
Efficiency measures relate outputs or outcomes to the resources consumed, such as cost per beneficiary served.
Question 5: In the PDCA (Plan-Do-Check-Act) cycle, what is the primary purpose of the 'Check' phase?
- Designing the improvement initiative
- Implementing the planned changes at full scale
- Comparing results against expected outcomes to evaluate success (Correct answer)
- Standardizing successful changes organization-wide
Correct answer: Comparing results against expected outcomes to evaluate success
The Check phase involves measuring and analyzing results to determine whether the implemented changes achieved the intended goals.
Question 6: Which data collection method is most appropriate for capturing volunteer experiences in depth?
- Standardized multiple-choice survey
- In-depth interview (Correct answer)
- Attendance log
- Financial audit
Correct answer: In-depth interview
In-depth interviews allow volunteers to share nuanced experiences and perspectives that closed-ended surveys may miss.
Question 7: A program logic model's 'inputs' typically include which of the following?
- Behavior changes in participants
- Volunteer hours, funding, and staff expertise (Correct answer)
- Long-term community impact
- Program activities delivered
Correct answer: Volunteer hours, funding, and staff expertise
Inputs are the resources invested in a program, such as human capital, funding, materials, and partnerships.
CVA Program Evaluation & Continuous Improvement 2
Which evaluation design compares program outcomes to a group that did not receive the intervention?