CNC Program Design & Evaluation 2 — Questions and Answers
Question 1: Which evaluation design is most appropriate when random assignment to control and treatment groups is not feasible?
- Randomized controlled trial
- Quasi-experimental design (Correct answer)
- Pre-experimental one-shot case study
- Cross-sectional survey
Correct answer: Quasi-experimental design
Quasi-experimental designs use comparison groups or pre-post measures when true random assignment is ethically or logistically impossible.
Question 2: A nonprofit's theory of change differs from a logic model primarily in that it:
- Lists activities and outputs instead of outcomes
- Explains the underlying assumptions about why change will occur (Correct answer)
- Focuses only on short-term results
- Is a financial planning document
Correct answer: Explains the underlying assumptions about why change will occur
A theory of change articulates the causal pathways and assumptions linking activities to long-term outcomes, going beyond the visual mapping of a logic model.
Question 3: Developmental evaluation is best suited for:
- Programs with stable, proven models ready for scale
- Innovative programs operating in complex, dynamic environments (Correct answer)
- Post-program retrospective accountability reviews
- Comparative effectiveness studies across sites
Correct answer: Innovative programs operating in complex, dynamic environments
Developmental evaluation supports real-time learning and adaptation in programs that are still evolving or operating in uncertain contexts.
Question 4: When conducting a needs assessment, the term 'felt need' refers to:
- A statistically documented gap in services
- What community members themselves express as lacking (Correct answer)
- A need identified by professional experts
- A comparative gap relative to another community
Correct answer: What community members themselves express as lacking
Felt need is the subjective experience of a problem as perceived and voiced by community members themselves.
Question 5: Which data collection method is most effective for capturing nuanced community perspectives on program relevance?
- Administrative records review
- Standardized pre/post tests
- Focus groups with community members (Correct answer)
- County-level census data analysis
Correct answer: Focus groups with community members
Focus groups generate rich qualitative data about perceptions, values, and context that quantitative methods cannot easily capture.
Question 6: In program design, 'dosage' refers to:
- The budget allocation per participant
- The amount, frequency, and duration of program exposure (Correct answer)
- The ratio of staff to clients
- The number of program outcomes measured
Correct answer: The amount, frequency, and duration of program exposure
Dosage describes how much of a program intervention participants receive, which is a key factor in achieving intended outcomes.
Question 7: A summative evaluation is primarily used to:
- Improve a program while it is still running
- Judge a program's overall effectiveness or value at its conclusion (Correct answer)
- Identify early implementation problems
- Engage stakeholders in co-designing program activities
Correct answer: Judge a program's overall effectiveness or value at its conclusion
Summative evaluation assesses whether a program achieved its goals, typically at the end of a funding cycle or program period.
CNC Program Design & Evaluation 2
Which evaluation design is most appropriate when random assignment to control and treatment groups is not feasible?