CIT Assessment & Evaluation Techniques 3 — Questions and Answers
Question 1: Which evaluation method involves collecting data from subordinates, peers, and supervisors about a learner's on-the-job performance?
- Pre-test/post-test comparison
- 360-degree feedback (Correct answer)
- Criterion-referenced test
- Anecdotal record
Correct answer: 360-degree feedback
360-degree feedback gathers multi-source input from all directions in the learner's work environment.
Question 2: Content validity in a training assessment is best established by:
- Correlating scores with job performance data
- Having subject matter experts review items against job tasks (Correct answer)
- Administering the test to two groups and comparing results
- Calculating internal consistency with Cronbach's alpha
Correct answer: Having subject matter experts review items against job tasks
SME review confirms that assessment items accurately represent the knowledge and skills required on the job.
Question 3: A trainer uses a pre-training survey to identify gaps between current and desired performance. This is an example of:
- Summative evaluation
- Needs assessment (Correct answer)
- Criterion-referenced scoring
- Reaction-level evaluation
Correct answer: Needs assessment
Needs assessment identifies the gap between current performance and the desired standard before training design begins.
Question 4: Which of the following BEST describes a norm-referenced assessment?
- Scores are compared against a predetermined passing standard
- Scores are compared against other learners in the group (Correct answer)
- Scores are based on self-reported learning goals
- Scores reflect business impact metrics
Correct answer: Scores are compared against other learners in the group
Norm-referenced tests rank learners relative to each other rather than against a fixed performance standard.
Question 5: Which Kirkpatrick level is MOST difficult to measure and requires the longest follow-up period?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior
- Level 4 – Results (Correct answer)
Correct answer: Level 4 – Results
Level 4 (Results) links training to organizational outcomes like revenue or quality, requiring extended time and robust data.
Question 6: Formative assessment differs from summative assessment primarily in that formative assessment:
- Occurs at the end of a course to assign grades
- Is used to guide and improve instruction while it is happening (Correct answer)
- Measures return on investment after training
- Compares learner scores to national norms
Correct answer: Is used to guide and improve instruction while it is happening
Formative assessment provides ongoing feedback during instruction so trainers can adjust methods in real time.
Question 7: A trainer shortens a 50-question test to 20 questions by removing items and retests the same group. If scores remain highly consistent, this demonstrates:
- Construct validity
- Inter-rater reliability
- Parallel-forms reliability (Correct answer)
- Content equivalence
Correct answer: Parallel-forms reliability
Parallel-forms reliability shows that two versions of a test measuring the same construct yield consistent results.
CIT Assessment & Evaluation Techniques 3
Which evaluation method involves collecting data from subordinates, peers, and supervisors about a learner's on-the-job performance?