Evaluation Methods & Reporting Flashcards
7 cards from real CPE practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Evaluation Methods & Reporting flashcards as text
An evaluator calculates a Cronbach's alpha of 0.58 for a program satisfaction survey. This result indicates:
Answer: Questionable reliability suggesting items should be revised
Cronbach's alpha below 0.70 is generally considered questionable reliability, indicating the survey items may not consistently measure the same construct.
Dose-response analysis in program evaluation examines:
Answer: The relationship between the amount of program exposure and outcome magnitude
Dose-response analysis explores whether greater program participation (dose) is associated with stronger outcomes (response), supporting causal inference.
Which evaluation approach is BEST suited for assessing a mature, well-defined program with stable implementation across multiple sites?
Answer: Summative outcome evaluation
Summative outcome evaluation is appropriate for mature, stable programs where the goal is to judge overall effectiveness and generalizability of results.
The concept of 'evaluation capacity building' refers to:
Answer: Developing organizations' skills and systems to conduct ongoing self-evaluation
Evaluation capacity building aims to strengthen organizations' internal ability to conduct, use, and champion evaluation as a regular practice.
A researcher finds a statistically significant difference between groups (p=0.03) but Cohen's d is 0.08. The evaluator should conclude that:
Answer: The finding is statistically significant but has negligible practical effect size
A Cohen's d of 0.08 represents a trivial effect size; statistical significance with large samples does not guarantee practical or program relevance.
In participatory evaluation, stakeholders are involved in which phases?
Answer: Multiple phases including design, data collection, and interpretation
Participatory evaluation engages stakeholders throughout the entire evaluation process to increase relevance, ownership, and utilization of findings.
Which technique helps evaluators identify the most critical program components by systematically eliminating one element at a time to observe its effect?
Answer: Component analysis (dismantling design)
Component analysis (or dismantling design) isolates active ingredients by sequentially removing program elements to determine each component's contribution to outcomes.