CT Evaluation Methods 3 — Questions and Answers
Question 1: What is 'formative evaluation' in a training context?
- Assessment conducted after training is complete
- Evaluation conducted during training development or delivery to improve it (Correct answer)
- A yearly performance review tied to training
- An evaluation focused solely on ROI
Correct answer: Evaluation conducted during training development or delivery to improve it
Formative evaluation happens during the design or delivery process to identify improvements before the final product is released.
Question 2: A trainer uses observation checklists during a hands-on lab exercise. This is an example of which type of assessment?
- Summative written assessment
- Performance-based assessment (Correct answer)
- Normative assessment
- Self-directed assessment
Correct answer: Performance-based assessment
Performance-based assessments evaluate learners by observing them execute tasks in realistic or simulated conditions.
Question 3: Which evaluation approach compares each learner's performance against a fixed standard rather than against other learners?
- Norm-referenced evaluation
- Criterion-referenced evaluation (Correct answer)
- Peer-referenced evaluation
- Summative evaluation
Correct answer: Criterion-referenced evaluation
Criterion-referenced evaluation measures mastery against a predetermined performance standard, not relative to peers.
Question 4: Why is it important to establish evaluation criteria BEFORE training is delivered?
- To allow trainers to adjust the criteria based on results
- To ensure objectives are measurable and data collection is planned in advance (Correct answer)
- To reduce the number of questions needed in post-tests
- To satisfy administrative requirements only
Correct answer: To ensure objectives are measurable and data collection is planned in advance
Pre-established criteria align evaluation with learning objectives and ensure the right data is collected at the right time.
Question 5: A manager completes a 360-degree feedback form about a recently trained employee. This data is MOST useful for which evaluation level?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior (Correct answer)
- Level 4 – Results
Correct answer: Level 3 – Behavior
360-degree feedback from managers, peers, and subordinates measures observable behavioral changes following training, aligning with Level 3.
Question 6: Which of the following is a key limitation of self-assessment as an evaluation method?
- It is too expensive to administer
- It cannot be completed anonymously
- Learners may over- or under-estimate their own competence (Correct answer)
- It requires specialized software to score
Correct answer: Learners may over- or under-estimate their own competence
Self-assessment is subject to social desirability bias and the Dunning-Kruger effect, where learners misjudge their own skill level.
Question 7: When a trainer collects evaluation data at multiple points throughout a training program, this strategy is called:
- Summative data collection
- Single-point benchmarking
- Longitudinal evaluation (Correct answer)
- Incidental sampling
Correct answer: Longitudinal evaluation
Longitudinal evaluation involves gathering data at several time intervals to track changes in knowledge, behavior, or performance over time.
CT Evaluation Methods 3
What is 'formative evaluation' in a training context?