SPP Performance Measurement & Evaluation 4 — Questions and Answers
Question 1: Which principle of effective KPI design ensures that a metric motivates the right behaviors rather than 'gaming' the system?
- Specificity — the metric must measure one precise thing
- Alignment — the metric must connect directly to a strategic objective
- Gaming resistance — the metric should be difficult to inflate without real improvement (Correct answer)
- Timeliness — the metric must be reported in real time
Correct answer: Gaming resistance — the metric should be difficult to inflate without real improvement
Gaming resistance ensures that improving the metric score genuinely reflects improved performance, not just clever manipulation of measurement methods.
Question 2: A strategic plan evaluation finds that an initiative delivered outputs as planned but produced no measurable outcomes. The MOST likely explanation is:
- The evaluation was conducted too early to detect outcomes
- The initiative had sufficient funding and should continue unchanged
- The outputs were not causally linked to the intended outcomes (Correct answer)
- The data collection instruments were too expensive
Correct answer: The outputs were not causally linked to the intended outcomes
When outputs are delivered but outcomes are absent, the underlying theory of change—the assumed causal path from activities to results—was likely flawed or missing key linkages.
Question 3: In strategic planning, 'variance analysis' refers to:
- Measuring statistical spread within a survey data set
- Comparing actual performance against planned targets and explaining differences (Correct answer)
- Calculating the coefficient of variation across business units
- Auditing financial statements for accounting errors
Correct answer: Comparing actual performance against planned targets and explaining differences
Variance analysis involves comparing actual results to planned targets, then diagnosing the causes of any gap to inform corrective strategy adjustments.
Question 4: Which of the following BEST describes the concept of 'cascading' objectives in a performance management system?
- Reducing the number of objectives at each organizational level
- Translating high-level strategic objectives into aligned unit and individual goals (Correct answer)
- Reporting executive metrics without modification to frontline staff
- Eliminating divisional scorecards in favor of a single corporate dashboard
Correct answer: Translating high-level strategic objectives into aligned unit and individual goals
Cascading ensures that enterprise-level strategic objectives are translated into meaningful, aligned goals at business unit, department, and individual levels, creating line-of-sight to strategy.
Question 5: An organization wants to measure 'organizational learning' as a strategic outcome. Which metric would be MOST appropriate?
- Total training budget as a percentage of revenue
- Rate at which after-action review insights are incorporated into updated processes (Correct answer)
- Number of employees enrolled in optional training courses
- Employee tenure length across the organization
Correct answer: Rate at which after-action review insights are incorporated into updated processes
Measuring how frequently after-action insights are converted into process changes captures actual organizational learning behavior, not just investment in or exposure to training.
Question 6: A performance review reveals that a strategic objective has consistently underperformed for three consecutive quarters. The appropriate strategic response is to:
- Lower the target to match actual performance to show success
- Conduct a strategic pivot analysis to determine whether to adjust strategy, resources, or the objective itself (Correct answer)
- Maintain the objective unchanged to signal long-term commitment
- Replace the KPI with one that shows better results
Correct answer: Conduct a strategic pivot analysis to determine whether to adjust strategy, resources, or the objective itself
Persistent underperformance warrants a structured strategic pivot analysis examining root causes and evaluating whether to adjust the strategy, reallocate resources, or reconsider the objective.
Question 7: What does the term 'efficiency' measure in the context of strategic performance evaluation?
- The degree to which objectives align with the organizational mission
- The ratio of outputs produced relative to inputs consumed (Correct answer)
- The extent to which targeted outcomes are achieved
- The speed at which performance data is reported to leadership
Correct answer: The ratio of outputs produced relative to inputs consumed
Efficiency measures how productively inputs (resources, time, cost) are converted into outputs, distinct from effectiveness which measures whether the right outcomes were achieved.
SPP Performance Measurement & Evaluation 4
Which principle of effective KPI design ensures that a metric motivates the right behaviors rather than 'gaming' the system?