Evaluation Research & Impact Assessment Flashcards

In a logic model, which component represents the direct products of program activities, such as number of workshops delivered?

Answer: Outputs

Outputs are the direct, measurable products of program activities, distinct from longer-term outcomes.

A program evaluator finds that participants improved post-test scores but a comparison group improved equally without the program. This suggests:

Answer: No program effect attributable to the intervention

When a comparison group shows identical gains, the improvement cannot be attributed to the program itself.

Which cost analysis method compares program costs against outcomes measured in natural units rather than monetary values?

Answer: Cost-effectiveness analysis

Cost-effectiveness analysis expresses outcomes in natural units (e.g., crimes prevented) rather than converting them to dollars.

Developmental evaluation is best suited for:

Answer: Innovative programs in dynamic, complex environments

Developmental evaluation supports innovation and adaptation in complex, emergent program contexts.

A key limitation of using administrative data in program evaluation is:

Answer: It was collected for purposes other than evaluation, potentially limiting construct validity

Administrative data is collected for operational purposes, so it may not measure the constructs evaluators actually need.

The counterfactual in impact evaluation refers to:

Answer: What would have happened to participants had they not received the program

The counterfactual represents the hypothetical scenario of what outcomes would have occurred without the intervention.

Which evaluation approach emphasizes negotiating with multiple stakeholders who hold different, potentially conflicting values about a program?

Answer: Fourth-generation evaluation

Fourth-generation evaluation (Guba & Lincoln) centers on stakeholder constructions and negotiation of meaning.