Evaluating Learning Impact Flashcards
6 cards from real CPTD practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 6 Evaluating Learning Impact flashcards as text
A talent development professional has been asked to measure the business impact of a recently concluded sales training program. Which of the following evaluation methods would be MOST appropriate for this request?
Answer: Analyzing sales performance data, such as revenue and market share, for the trained team.
Analyzing sales performance data directly addresses the business impact (Kirkpatrick's Level 4), which is concerned with the final results and outcomes for the organization. The other options measure learning (Level 2), reaction (Level 1), and behavior (Level 3), respectively.
A global organization wants to understand why a leadership development program is highly successful in some regions but shows limited impact in others. They want to identify the critical factors that enable or hinder the program's success. Which evaluation model is best suited for this purpose?
Answer: Brinkerhoff's Success Case Method
Brinkerhoff's Success Case Method (SCM) is specifically designed to identify the extremes—the most and least successful cases—to understand the factors contributing to success and the barriers causing failure. This qualitative approach is ideal for uncovering the 'why' behind different outcomes.
When applying the Phillips ROI Model, what is a key differentiator that distinguishes it from the Kirkpatrick Model?
Answer: It converts the business impact data into monetary values to calculate a return on investment.
The Phillips ROI Model builds upon Kirkpatrick's four levels by adding a fifth level: Return on Investment (ROI). This level involves a cost-benefit analysis to compare the monetary benefits of the training program to its costs, which is a unique feature of this model.
A talent development team is designing an evaluation strategy for a new compliance training program. To ensure they are measuring what matters most to the business, according to the 'New World' Kirkpatrick Model, what should be their FIRST step?
Answer: Define the desired business results and outcomes with key stakeholders.
The 'New World' approach to the Kirkpatrick Model advocates for a 'begin with the end in mind' strategy. This means starting at Level 4 (Results) by defining the desired business outcomes first, and then working backward to determine the necessary behaviors (Level 3), learning (Level 2), and reactions (Level 1) needed to achieve those results.
In the context of evaluating learning impact, what is the primary purpose of using learning analytics?
Answer: To collect, analyze, and report data about learners and their contexts to optimize learning and its impact.
Learning analytics involves the measurement, collection, analysis, and reporting of data about learners to understand and optimize learning and the environments in which it occurs. This data-driven approach provides insights into learner behavior, engagement, and performance, which helps in evaluating and improving the effectiveness of training programs.
A hospital implemented a new patient safety protocol training for its nursing staff. Six months later, the talent development department wants to evaluate the impact at Kirkpatrick's Level 3. Which of the following metrics would be the most relevant to collect?
Answer: Observations of nurses consistently using the new hand-washing protocol.
Kirkpatrick's Level 3 focuses on behavior: the degree to which participants apply what they learned during training when they are back on the job. Observing nurses using the new protocol is a direct measure of on-the-job behavior change. Test scores are Level 2, satisfaction is Level 1, and infection rates are a Level 4 (Results) metric.