Assessment & Evaluation Methods Flashcards
7 cards from real CGA practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Assessment & Evaluation Methods flashcards as text
Which Institutional Review Board (IRB) category applies to evaluation research involving surveys with no more than minimal risk to adult participants?
Answer: Exempt review
Survey research with adult participants and minimal risk typically qualifies for exempt review status under 45 CFR 46.104.
A grant administrator reviews an evaluation report showing high internal validity but low external validity. This means the study:
Answer: Produced accurate results within the study but findings may not generalize broadly
High internal validity means the study accurately measured cause-and-effect, while low external validity means results may not transfer to other populations or settings.
Which type of evaluation question is best answered by a cost-benefit analysis?
Answer: Do the program's monetary benefits outweigh its costs?
Cost-benefit analysis converts all program costs and outcomes into monetary values to determine whether benefits exceed costs and by how much.
In the context of grant evaluation, 'fidelity monitoring' primarily assesses:
Answer: The degree to which the program was delivered as designed
Fidelity monitoring evaluates how closely program staff implemented the intervention according to its documented model and intended design.
A grantee uses a validated pre/post knowledge assessment with a control group. The evaluator calculates Cohen's d = 0.65. How is this effect size interpreted?
Answer: Medium effect
By Cohen's convention, d = 0.2 is small, d = 0.5 is medium, and d = 0.8 is large; a value of 0.65 falls in the medium-to-large range, typically classified as medium.
Which sampling strategy ensures that key subgroups (e.g., rural vs. urban participants) are proportionally represented in an evaluation sample?
Answer: Stratified random sampling
Stratified random sampling divides the population into subgroups (strata) and randomly samples within each, ensuring proportional representation.
A federal program officer asks the grantee to include a 'counterfactual' in its evaluation design. What is the counterfactual?
Answer: An estimate of what would have happened without the program
The counterfactual represents what outcomes would have occurred in the absence of the intervention, and is essential for attributing observed changes to the program.