CSC Assessment & Evaluation Techniques 3 — Questions and Answers
Question 1: During a client engagement, a senior consultant applies Kirkpatrick's Four-Level Model. Which level assesses whether training resulted in measurable on-the-job behavior change?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior (Correct answer)
- Level 4 – Results
Correct answer: Level 3 – Behavior
Kirkpatrick's Level 3 evaluates the degree to which participants apply what they learned when back in their work environment.
Question 2: A consultant is asked to evaluate vendor proposals using a weighted scoring model. What is the primary advantage of this approach over a simple ranking?
- It eliminates the need for subject matter expert input
- It accounts for the relative importance of different evaluation criteria (Correct answer)
- It produces a single objective score with no subjectivity
- It reduces the total number of criteria that must be evaluated
Correct answer: It accounts for the relative importance of different evaluation criteria
Weighted scoring assigns different importance levels to criteria, ensuring that critical factors influence the final decision more than minor ones.
Question 3: Which assessment technique involves systematically comparing an organization's performance metrics against industry leaders to identify improvement opportunities?
- SWOT analysis
- Benchmarking (Correct answer)
- Delphi method
- Nominal group technique
Correct answer: Benchmarking
Benchmarking measures an organization's practices and outcomes against best-in-class peers to identify performance gaps.
Question 4: A consultant discovers that a client's key performance indicators are consistently met but business outcomes are not improving. This situation most likely indicates which evaluation issue?
- Insufficient data collection frequency
- KPIs are not aligned to strategic business outcomes (Correct answer)
- The evaluation framework uses too many lagging indicators
- Stakeholders are manipulating data inputs
Correct answer: KPIs are not aligned to strategic business outcomes
When KPIs are met yet outcomes don't improve, the metrics typically measure the wrong things and are not causally linked to business goals.
Question 5: In a formative evaluation, a consultant reviews a program while it is still in progress. What is the primary purpose of formative evaluation?
- To determine the overall return on investment after completion
- To guide real-time improvements before the program concludes (Correct answer)
- To certify that the program met all contractual deliverables
- To document lessons learned for future projects
Correct answer: To guide real-time improvements before the program concludes
Formative evaluation provides ongoing feedback during program execution so adjustments can be made before problems become irreversible.
Question 6: A senior consultant applies a cost-benefit analysis (CBA) to an operational improvement initiative. Which ratio is the primary output metric of a CBA?
- Internal rate of return (IRR)
- Benefit-to-cost ratio (BCR) (Correct answer)
- Earned value (EV)
- Economic value added (EVA)
Correct answer: Benefit-to-cost ratio (BCR)
The benefit-to-cost ratio divides total quantified benefits by total costs; a BCR above 1.0 indicates the initiative is economically justified.
Question 7: When an assessment must be completed quickly with limited data access, which evaluation approach does a senior consultant most appropriately use?
- Longitudinal cohort study
- Rapid appraisal / rapid assessment technique (Correct answer)
- Randomized controlled trial
- Ethnographic field study
Correct answer: Rapid appraisal / rapid assessment technique
Rapid appraisal techniques use structured interviews, document reviews, and small focus groups to develop actionable findings under time and data constraints.
CSC Assessment & Evaluation Techniques 3
During a client engagement, a senior consultant applies Kirkpatrick's Four-Level Model.
Which level assesses whether training resulted in measurable on-the-job behavior change?