CIT Assessment & Evaluation Techniques 5 — Questions and Answers
Question 1: Which assessment strategy is MOST effective for verifying mastery before allowing a learner to advance to more complex skills?
- Criterion-referenced competency check (Correct answer)
- Norm-referenced ranking test
- Peer evaluation survey
- End-of-course satisfaction rating
Correct answer: Criterion-referenced competency check
Criterion-referenced checks measure performance against a defined standard, confirming mastery before progression.
Question 2: When analyzing evaluation data, a trainer finds that female participants consistently score lower on one test item. This is an example of potential:
- Standard error of measurement
- Item bias or differential item functioning (Correct answer)
- Poor face validity
- Low inter-rater reliability
Correct answer: Item bias or differential item functioning
Differential item functioning (DIF) occurs when an item favors one group over another for reasons unrelated to the construct being measured.
Question 3: A certified trainer is asked to justify the training budget to senior leadership. Which Kirkpatrick-Phillips level provides the MOST compelling business case?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior
- Level 4/5 – Results/ROI (Correct answer)
Correct answer: Level 4/5 – Results/ROI
ROI and business results data translate training investment into financial language that senior leadership values most.
Question 4: Which technique helps isolate the effect of training from other factors that may have caused performance improvement?
- Test-retest reliability measurement
- Control group comparison or trend analysis (Correct answer)
- Increasing the number of survey respondents
- Using longer explanations in test items
Correct answer: Control group comparison or trend analysis
Control groups and trend analysis allow evaluators to attribute performance change specifically to training rather than external variables.
Question 5: A trainer observes a learner's task performance using a structured checklist. The checklist is best described as a(n):
- Anecdotal note
- Observational assessment tool (Correct answer)
- Affective survey
- Aptitude test
Correct answer: Observational assessment tool
Structured observational checklists provide a systematic way to record specific behaviors or steps during performance.
Question 6: Cronbach's alpha is used to measure which psychometric property of an assessment?
- Content validity
- Criterion-related validity
- Internal consistency reliability (Correct answer)
- Parallel-forms equivalence
Correct answer: Internal consistency reliability
Cronbach's alpha measures how consistently items within a test measure the same underlying construct.
Question 7: After a soft-skills training program, a manager reports observing no behavior change in employees six weeks later. The FIRST action a trainer should take is to:
- Redesign the entire training program
- Administer a new post-test to confirm learning occurred
- Conduct a transfer climate analysis with the manager (Correct answer)
- Replace the training with self-paced e-learning
Correct answer: Conduct a transfer climate analysis with the manager
Transfer climate factors — such as supervisor support and opportunity to practice — must be investigated before assuming the training itself failed.
CIT Assessment & Evaluation Techniques 5
Which assessment strategy is MOST effective for verifying mastery before allowing a learner to advance to more complex skills?