Evaluation Methods & Reporting Flashcards
7 cards from real CPE practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Evaluation Methods & Reporting flashcards as text
Which design provides the strongest evidence of causal attribution in program evaluation?
Answer: Randomized controlled trial
Randomized controlled trials (RCTs) use random assignment to create equivalent groups, providing the strongest control for selection bias and confounding variables.
Regression discontinuity design (RDD) is appropriate when:
Answer: Program participants are assigned based on a continuous cutoff score
RDD exploits a cutoff score (e.g., income threshold, test score) used for program assignment to estimate causal effects at the threshold.
Social Return on Investment (SROI) differs from traditional cost-benefit analysis primarily because SROI:
Answer: Monetizes social, environmental, and economic value using stakeholder-defined proxies
SROI assigns monetary values to social and environmental outcomes using stakeholder-defined proxies, broadening the scope beyond traditional economic metrics.
An evaluator conducting focus groups notices one dominant participant repeatedly silencing others. The BEST immediate response is to:
Answer: Use structured turn-taking techniques to ensure all voices are heard
Using facilitation techniques like structured turn-taking or direct invitation addresses dominance dynamics while preserving the group discussion.
The AEA Program Evaluation Standards include which of the following categories?
Answer: Utility, feasibility, propriety, accuracy, and evaluation accountability
The Joint Committee's Program Evaluation Standards include five categories: utility, feasibility, propriety, accuracy, and evaluation accountability.
When an evaluator discovers mid-study that the program significantly changed its intervention model, the MOST appropriate action is to:
Answer: Document the change, revise the evaluation questions, and renegotiate the evaluation plan with stakeholders
Mid-program changes require the evaluator to adapt the evaluation plan and renegotiate with stakeholders to ensure the evaluation remains relevant and valid.
Which technique is used to synthesize findings across multiple evaluations of similar programs to draw broader conclusions?
Answer: Meta-analysis or systematic review
Meta-analysis statistically pools effect sizes across multiple studies, and systematic reviews synthesize evidence, both producing generalizable conclusions about program effectiveness.