CRP Assessment & Evaluation Techniques 2 — Questions and Answers
Question 1: Which evaluation design is most appropriate when random assignment to treatment and control groups is not feasible?
- Randomized controlled trial
- Quasi-experimental design (Correct answer)
- Cross-sectional survey
- Delphi method
Correct answer: Quasi-experimental design
Quasi-experimental designs are used when randomization is not possible but researchers still want to assess causal relationships.
Question 2: A formative evaluation is best described as an assessment conducted:
- After a program has concluded to measure outcomes
- During program implementation to guide improvements (Correct answer)
- Before a program starts to assess needs
- Once every five years for accountability purposes
Correct answer: During program implementation to guide improvements
Formative evaluations occur during program implementation and are used to refine and improve ongoing activities.
Question 3: In survey research, 'response bias' most commonly refers to:
- Low survey completion rates among target populations
- Systematic error introduced by respondents' tendency to answer in a particular way (Correct answer)
- Errors caused by poorly randomized sampling frames
- Inconsistencies between interviewer administrations
Correct answer: Systematic error introduced by respondents' tendency to answer in a particular way
Response bias is a systematic tendency for respondents to answer inaccurately, such as through social desirability bias.
Question 4: Which statistical measure is used to assess the internal consistency of a multi-item scale?
- Pearson's r
- Cronbach's alpha (Correct answer)
- Cohen's kappa
- Intraclass correlation
Correct answer: Cronbach's alpha
Cronbach's alpha measures how closely related a set of items are as a group, indicating the internal consistency of a scale.
Question 5: The primary purpose of a logic model in program evaluation is to:
- Calculate the statistical significance of outcomes
- Visually map the theory of change linking inputs to outcomes (Correct answer)
- Determine the appropriate sample size for evaluation
- Establish the cost-benefit ratio of a program
Correct answer: Visually map the theory of change linking inputs to outcomes
A logic model depicts the assumed causal chain from resources and activities through outputs to short- and long-term outcomes.
Question 6: Which approach to data collection is most suitable for capturing in-depth insights about participants' lived experiences?
- Structured telephone survey
- Administrative records review
- In-depth qualitative interviews (Correct answer)
- Experimental pre-post testing
Correct answer: In-depth qualitative interviews
In-depth qualitative interviews allow participants to describe experiences in their own words, yielding rich contextual data.
Question 7: When evaluators examine whether a program was delivered as planned, they are conducting what type of evaluation?
- Impact evaluation
- Cost-effectiveness evaluation
- Process/implementation evaluation (Correct answer)
- Outcome evaluation
Correct answer: Process/implementation evaluation
A process or implementation evaluation assesses the fidelity and quality of program delivery relative to its design.
CRP Assessment & Evaluation Techniques 2
Which evaluation design is most appropriate when random assignment to treatment and control groups is not feasible?