CT Assessment Methods 5 — Questions and Answers
Question 1: Which of the following BEST describes the purpose of a needs assessment in the training context?
- To evaluate learner satisfaction after training
- To identify performance gaps and root causes before designing training (Correct answer)
- To measure ROI at the end of a program
- To rank employees for performance reviews
Correct answer: To identify performance gaps and root causes before designing training
A needs assessment identifies the gap between current and desired performance and determines whether training is the right solution.
Question 2: When a test consistently produces similar scores across multiple administrations under the same conditions, it demonstrates:
- Content validity
- Construct validity
- Reliability (Correct answer)
- Transfer validity
Correct answer: Reliability
Reliability refers to the consistency of assessment results over time and across similar testing conditions.
Question 3: Which scenario is an example of assessing Kirkpatrick Level 4 (Results)?
- Asking learners to rate the trainer's presentation skills
- Measuring a 15% reduction in defects after quality training (Correct answer)
- Observing whether employees use new software on the job
- Scoring a post-training knowledge test
Correct answer: Measuring a 15% reduction in defects after quality training
Level 4 evaluates organizational outcomes such as productivity, quality, or cost savings that result from training.
Question 4: A trainer asks learners to teach a concept back to a partner immediately after instruction. This technique primarily serves as:
- A summative grading event
- A formative check for understanding (Correct answer)
- An inter-rater reliability measure
- A needs assessment tool
Correct answer: A formative check for understanding
Teach-back activities reveal gaps in understanding in real time, functioning as a formative assessment during instruction.
Question 5: Which type of question stem is considered BEST practice in multiple-choice assessment design?
- Incomplete sentence requiring learner to guess the missing word
- Negative phrasing such as 'Which is NOT correct?'
- A clear, complete question that could stand alone without the options (Correct answer)
- A question with two correct answers for advanced learners
Correct answer: A clear, complete question that could stand alone without the options
A well-formed stem is a complete question that clearly communicates what is being asked without relying on the options.
Question 6: Portfolio assessment is MOST valuable when a trainer wants to evaluate:
- Speed of task completion
- Accumulated evidence of learning and growth over time (Correct answer)
- Single-event knowledge recall
- Peer ranking within a cohort
Correct answer: Accumulated evidence of learning and growth over time
Portfolios document a learner's progress and achievement through collected artifacts across an extended period.
Question 7: Which action should a trainer take if analysis reveals that most learners consistently miss the same assessment item?
- Increase the passing score to challenge learners
- Review the item for flaws or misalignment with instruction (Correct answer)
- Remove the item from all future assessments immediately
- Disqualify learners who missed the item
Correct answer: Review the item for flaws or misalignment with instruction
When many learners miss the same item, item analysis should determine if the question is flawed, ambiguous, or misaligned with what was taught.
Which of the following BEST describes the purpose of a needs assessment in the training context?