TS Assessment & Evaluation Strategies 3 — Questions and Answers
Question 1: A trainer uses a checklist to evaluate whether each learner completes every step of a procedure correctly. This tool BEST supports which type of evaluation?
- Affective domain assessment
- Psychomotor skill evaluation (Correct answer)
- Attitudinal measurement
- Cognitive knowledge recall
Correct answer: Psychomotor skill evaluation
Checklists are ideal for evaluating psychomotor skills because they capture whether discrete observable steps are performed correctly.
Question 2: Which of the following is a primary advantage of using electronic performance support systems (EPSS) as a post-training evaluation aid?
- They replace the need for any formal training program
- They provide real-time job aids that help measure on-the-job skill transfer (Correct answer)
- They eliminate the need for supervisor feedback
- They only work for technical skills, not soft skills
Correct answer: They provide real-time job aids that help measure on-the-job skill transfer
EPSS tools can track task completion and usage patterns, offering data points that help evaluate skill transfer to the job environment.
Question 3: When developing a rubric for a written assignment in a training program, which element is MOST critical to include?
- A single overall score without sub-criteria
- Clearly defined performance levels with descriptive criteria for each (Correct answer)
- Only the highest and lowest performance anchors
- A ranking of learners from best to worst
Correct answer: Clearly defined performance levels with descriptive criteria for each
Effective rubrics require well-defined performance levels with specific descriptors so both learners and raters understand expectations at each level.
Question 4: A trainer notices that a particular test question has a difficulty index of 0.95. What does this indicate?
- The question is very difficult and most learners answered it incorrectly
- The question is very easy and almost all learners answered it correctly (Correct answer)
- The question has high discriminating power
- The question is unreliable and should be removed
Correct answer: The question is very easy and almost all learners answered it correctly
A difficulty index (p-value) near 1.0 means nearly all respondents answered the item correctly, indicating a very easy question.
Question 5: Which evaluation design provides the STRONGEST evidence that training caused observed performance improvements?
- Post-test only with no control group
- Pre-test and post-test with a randomly assigned control group (Correct answer)
- Supervisor ratings collected six months after training
- Reaction surveys completed at course end
Correct answer: Pre-test and post-test with a randomly assigned control group
A randomized control group design isolates training as the variable responsible for performance changes, ruling out confounds.
Question 6: A trainer specialist is evaluating a compliance training program. Which metric would BEST demonstrate program effectiveness from a business impact perspective?
- Average learner satisfaction rating
- Reduction in compliance violations or audit findings post-training (Correct answer)
- Number of modules completed per learner
- Time spent on each training module
Correct answer: Reduction in compliance violations or audit findings post-training
For compliance training, a reduction in violations directly links training to a measurable business outcome aligned with the program's purpose.
Question 7: Which term describes the degree to which an assessment consistently produces the same results across different administrations or raters?
- Validity
- Reliability (Correct answer)
- Authenticity
- Alignment
Correct answer: Reliability
Reliability refers to the consistency of assessment results over time, across raters, or across test forms.
TS Assessment & Evaluation Strategies 3
A trainer uses a checklist to evaluate whether each learner completes every step of a procedure correctly.
This tool BEST supports which type of evaluation?