CPE Performance Measurement & Indicators 3

Question 1

What is the 'attribution problem' in performance measurement?

Accepted Answer

The problem of determining whether observed outcomes are caused by the program versus external factors

Answer

The difficulty of assigning credit for outcomes to specific program staff members

Answer

The challenge of attributing costs accurately to individual program activities

Answer

The issue of data ownership when multiple agencies co-deliver a program

Question 2

In performance measurement, what does 'data disaggregation' refer to?

Accepted Answer

Breaking down aggregate data by subgroups such as race, gender, or age to examine disparities

Answer

Removing statistical outliers from a dataset before conducting analysis

Answer

Converting qualitative data into quantitative indicators for reporting purposes

Answer

Separating program administrative data from independent evaluation data

Question 3

Which of the following best describes 'stretch targets' in performance measurement?

Accepted Answer

Ambitious goals set beyond expected performance to encourage innovation and improvement

Answer

Minimum performance thresholds programs must meet to avoid closure or sanctions

Answer

Targets set by external funders that programs must meet to receive continued funding

Answer

Historical performance averages used as reference points for current performance

Question 4

What is a 'theory of action' as it relates to performance measurement?

Accepted Answer

An explanation of how specific program activities are expected to produce desired outcomes

Answer

A statistical model predicting which indicators will show the most improvement

Answer

A legal framework governing the conduct of certified program evaluators

Answer

A method for calculating financial return on investment for a program

Question 5

When performance data shows a program is not meeting its targets, evaluators should first:

Accepted Answer

Investigate potential causes including data quality, implementation fidelity, and contextual factors

Answer

Immediately recommend program termination to funders and policymakers

Answer

Increase the number of indicators to better capture program performance

Answer

Reduce targets to more achievable levels without further investigation

Question 6

Which of the following represents a concern about 'indicator creep' in performance measurement systems?

Accepted Answer

The accumulation of too many indicators, making systems burdensome and unfocused

Answer

Indicators becoming outdated as program goals evolve over time

Answer

Evaluators using indicators that are biased toward reporting positive outcomes

Answer

The tendency for indicators to capture only short-term rather than long-term results

Question 7

What is the main advantage of using administrative data for performance measurement?

Accepted Answer

It is typically collected as part of routine program operations, making it cost-effective to use

Answer

Administrative data is always more accurate than data collected through primary research

Answer

Administrative data captures stakeholder perspectives more comprehensively than surveys

Answer

It allows for random assignment to treatment and control conditions for experimental design