CTA Assessment & Evaluation Methods 3 — Questions and Answers
Question 1: A training needs analysis reveals a performance gap. Which finding would indicate a training solution is most appropriate?
- Employees lack the tools needed to do the job
- Employees lack the knowledge or skill to perform correctly (Correct answer)
- Employees are not motivated by current incentives
- Employees have too many competing job priorities
Correct answer: Employees lack the knowledge or skill to perform correctly
Training addresses gaps caused by missing knowledge or skills; other gaps require non-training interventions.
Question 2: In evaluation design, a control group is used to:
- Ensure all participants receive the same training
- Provide a comparison baseline unaffected by training (Correct answer)
- Monitor trainer performance during sessions
- Reduce the cost of evaluation data collection
Correct answer: Provide a comparison baseline unaffected by training
A control group does not receive training, allowing evaluators to isolate the training's effect from other variables.
Question 3: Which evaluation method involves observing employees performing tasks on the job after training?
- Written knowledge test
- Behavioral observation checklist (Correct answer)
- Reaction survey
- Role-play simulation
Correct answer: Behavioral observation checklist
Behavioral observation checklists are used by supervisors or evaluators to assess on-the-job skill transfer.
Question 4: Norm-referenced scoring compares a learner's performance to:
- A predetermined passing standard
- Their own previous test scores
- The performance of other learners in the group (Correct answer)
- Industry-wide certification benchmarks
Correct answer: The performance of other learners in the group
Norm-referenced scoring ranks learners relative to each other rather than against a fixed standard.
Question 5: A trainer collects qualitative feedback through open-ended survey questions after a course. The PRIMARY advantage of this approach is:
- Easy statistical analysis
- Rich, contextual insight into learner experiences (Correct answer)
- Faster data collection than rating scales
- Consistent scoring across all respondents
Correct answer: Rich, contextual insight into learner experiences
Open-ended questions capture nuanced learner perspectives and unexpected insights that closed items cannot reveal.
Question 6: Phillips' ROI model extends Kirkpatrick's four levels by adding a fifth level that calculates:
- Learner satisfaction index
- Job competency ratings
- Return on investment as a percentage (Correct answer)
- Net promoter score for training
Correct answer: Return on investment as a percentage
Phillips' Level 5 converts training benefits to monetary value and compares them to program costs to produce an ROI percentage.
Question 7: Which question type on an assessment is MOST prone to guessing, reducing its reliability?
- Short-answer
- Essay
- True/false (Correct answer)
- Matching
Correct answer: True/false
True/false items have a 50% chance of being answered correctly by random guessing, which reduces reliability.
CTA Assessment & Evaluation Methods 3
A training needs analysis reveals a performance gap.
Which finding would indicate a training solution is most appropriate?