Evaluation & Measurement of Performance Outcomes Flashcards
7 cards from real CPT practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Evaluation & Measurement of Performance Outcomes flashcards as text
A company implements a new onboarding process and wants to assess whether new hires are applying learned skills 90 days on the job. This corresponds to which Kirkpatrick level?
Answer: Level 3 – Behavior
Level 3 (Behavior) evaluates whether participants transfer and apply learned skills in the workplace after training.
Which type of validity confirms that a performance assessment tool actually measures the construct it claims to measure?
Answer: Construct validity
Construct validity ensures the assessment instrument measures the theoretical construct it is intended to measure.
A performance analyst collects data showing that call center error rates dropped 20% after an intervention. However, a new quality management system was also introduced simultaneously. This situation illustrates which evaluation challenge?
Answer: Confounding variables
Confounding variables (the new quality system) make it difficult to attribute the error rate improvement solely to the intervention.
When converting soft data (e.g., improved teamwork) to monetary value, which approach is considered most credible by CPT practitioners?
Answer: Linking the soft measure to a hard data item with a known value
Converting soft data by linking it to a hard measure with a known monetary value provides the most defensible and credible conversion.
In performance evaluation, what does 'reliability' of a measurement instrument refer to?
Answer: The consistency of results across repeated administrations
Reliability refers to the consistency and repeatability of a measurement tool's results under the same conditions.
Which data source would BEST provide evidence of behavior change (Level 3) after a conflict resolution training program?
Answer: Manager observation checklists completed 60 days post-training
Manager observation checklists collected after training directly capture whether participants are applying conflict resolution behaviors on the job.
A performance improvement team reports that productivity increased by 15% following an intervention. Stakeholders ask how much of that gain is attributable to the program. The team should apply which analytical step?
Answer: Trend line analysis or isolation techniques to estimate program contribution
Isolation techniques such as trend line analysis, control groups, or expert estimation help attribute specific portions of an improvement to the intervention.