AAS Program Evaluation & Outcomes 2 — Questions and Answers
Question 1: Which evaluation design is MOST appropriate when random assignment to a suicide prevention program is ethically or logistically impossible?
- Randomized controlled trial
- Quasi-experimental design (Correct answer)
- Case study analysis
- Narrative review
Correct answer: Quasi-experimental design
Quasi-experimental designs allow causal inference without randomization by using comparison groups or pre-post measurements.
Question 2: A logic model for a suicide prevention program typically begins with which component?
- Outcomes
- Activities
- Inputs (Correct answer)
- Impact
Correct answer: Inputs
Logic models start with inputs (resources, staff, funding) that drive activities, outputs, outcomes, and impact.
Question 3: When evaluating a crisis hotline program, 'average speed of answer' is best classified as which type of measure?
- Outcome measure
- Impact measure
- Process/fidelity measure (Correct answer)
- Cost-effectiveness measure
Correct answer: Process/fidelity measure
Average speed of answer reflects how well the program delivers its service (process fidelity), not whether callers improve.
Question 4: Which statistical method is most commonly used to control for baseline differences between groups in a suicide prevention program evaluation?
- Chi-square test
- Analysis of covariance (ANCOVA) (Correct answer)
- Pearson correlation
- Mann-Whitney U test
Correct answer: Analysis of covariance (ANCOVA)
ANCOVA adjusts outcome comparisons for baseline covariates, reducing confounding in non-randomized evaluations.
Question 5: A gatekeeper training program reports that 90% of trainees passed a knowledge test immediately after training. This finding alone is insufficient evidence of program effectiveness because it lacks:
- A large enough sample size
- Longitudinal follow-up data
- A control or comparison group (Correct answer)
- Demographic diversity of trainees
Correct answer: A control or comparison group
Without a comparison group, it is impossible to attribute knowledge gains to the training rather than other factors.
Question 6: In program evaluation, 'reach' refers to:
- The depth of intervention content covered
- The proportion of the target population that participates in the program (Correct answer)
- The geographic distance between service sites
- The fidelity with which facilitators deliver content
Correct answer: The proportion of the target population that participates in the program
Reach measures how many individuals from the intended target population actually receive the program.
Question 7: Which of the following is the BEST indicator that a suicide prevention program has achieved population-level impact?
- High participant satisfaction scores
- A statistically significant decrease in suicide rates in the served community (Correct answer)
- Increased knowledge scores among program completers
- Improved staff confidence in suicide assessment
Correct answer: A statistically significant decrease in suicide rates in the served community
Population-level impact is demonstrated by measurable changes in community-wide suicide rates, not just individual-level outcomes.
AAS Program Evaluation & Outcomes 2
Which evaluation design is MOST appropriate when random assignment to a suicide prevention program is ethically or logistically impossible?