CPE Evaluation Methods & Reporting 3

Question 1

An evaluator calculates a Cronbach's alpha of 0.58 for a program satisfaction survey. This result indicates:

Accepted Answer

Questionable reliability suggesting items should be revised

Answer

Cronbach's alpha below 0.70 is generally considered questionable reliability, indicating the survey items may not consistently measure the same construct.

Question 2

Dose-response analysis in program evaluation examines:

Accepted Answer

The relationship between the amount of program exposure and outcome magnitude

Answer

Dose-response analysis explores whether greater program participation (dose) is associated with stronger outcomes (response), supporting causal inference.

Question 3

Which evaluation approach is BEST suited for assessing a mature, well-defined program with stable implementation across multiple sites?

Accepted Answer

Summative outcome evaluation

Answer

Summative outcome evaluation is appropriate for mature, stable programs where the goal is to judge overall effectiveness and generalizability of results.

Question 4

The concept of 'evaluation capacity building' refers to:

Accepted Answer

Developing organizations' skills and systems to conduct ongoing self-evaluation

Answer

Evaluation capacity building aims to strengthen organizations' internal ability to conduct, use, and champion evaluation as a regular practice.

Question 5

A researcher finds a statistically significant difference between groups (p=0.03) but Cohen's d is 0.08. The evaluator should conclude that:

Accepted Answer

The finding is statistically significant but has negligible practical effect size

Answer

A Cohen's d of 0.08 represents a trivial effect size; statistical significance with large samples does not guarantee practical or program relevance.

(CPE) Certified Program Evaluator Practice Test

(CPE) Certified Program Evaluator Practice Test

CPE Evaluation Methods & Reporting 3