CIT Assessment & Evaluation Techniques — Questions and Answers
Question 1: A test that measures what it is intended to measure is said to have high:
- Reliability
- Validity (Correct answer)
- Objectivity
- Practicality
Correct answer: Validity
Validity refers to the extent to which a test accurately measures what it is intended to measure. If a test is designed to assess a specific skill or knowledge area, it is considered valid if it truly reflects proficiency in that area. A valid test ensures that the inferences drawn from its results are appropriate and meaningful.
Question 2: Which assessment type occurs DURING instruction to inform immediate adjustments?
- Diagnostic
- Summative
- Formative (Correct answer)
- Criterion‑referenced
Correct answer: Formative
Formative assessment occurs during the instructional process to monitor student learning and provide ongoing feedback. Its primary purpose is to inform both teaching and learning, allowing instructors to make immediate adjustments to their methods and learners to improve their understanding. This type of assessment is crucial for guiding instruction and supporting continuous improvement.
Question 3: A rubric with specific performance criteria primarily improves assessment:
- Subjectivity
- Reliability (Correct answer)
- Guessing
- Difficulty
Correct answer: Reliability
A rubric with specific performance criteria significantly improves assessment reliability. By providing clear, consistent standards for evaluating learner work, rubrics reduce subjectivity and ensure that different assessors, or the same assessor at different times, would arrive at similar judgments. This consistency makes the grading process more objective and dependable.
Question 4: Norm‑referenced grading compares a learner’s performance to:
- A fixed standard
- Stated objectives
- Other learners (Correct answer)
- Job competencies
Correct answer: Other learners
Norm-referenced grading compares a learner’s performance to the performance of a larger group of other learners, often resulting in a ranking or percentile score. This contrasts with criterion-referenced grading, which evaluates a learner's performance against a fixed set of standards or learning objectives, regardless of how others performed. Norm-referenced grading is useful for competitive selection or broad comparisons.
Question 5: The KR‑20 and Cronbach’s alpha statistics are used to estimate test:
- Difficulty
- Reliability (Correct answer)
- Validity
- Bias
Correct answer: Reliability
KR-20 (Kuder-Richardson Formula 20) and Cronbach’s alpha are statistical measures used to estimate the internal consistency reliability of a test. They assess how consistently all items in a test measure the same underlying construct or skill. A higher value for these statistics indicates greater internal consistency and thus higher reliability of the test, meaning it produces consistent results.
Question 6: An item analysis shows a discrimination index of −0.25 for a question. The item should be:
- Retained with no change
- Revised or removed (Correct answer)
- Given more weight
- Used for extra credit
Correct answer: Revised or removed
The discrimination index measures how well an item differentiates between high-performing and low-performing learners. A negative discrimination index (like -0.25) means that low-performing learners answered the item correctly more often than high-performing learners. This indicates a flawed item that is either confusing, misleading, or incorrectly keyed, and therefore should be revised or removed from the test to ensure fairness and accuracy.
Question 7: Which feedback approach is MOST effective for encouraging learner improvement?
- General praise only
- Specific, actionable feedback (Correct answer)
- Public comparison with peers
- Delayed scores after a month
Correct answer: Specific, actionable feedback
Specific, actionable feedback is the most effective approach for encouraging learner improvement. It focuses on particular behaviors or outcomes and provides clear guidance on what the learner can do to improve. Unlike general praise or delayed scores, this type of feedback empowers learners to understand their strengths and weaknesses and provides a concrete roadmap for future development.
Question 8: A performance‑based assessment might require learners to:
- Answer true/false questions
- Complete a multiple‑choice exam
- Develop an e‑learning module (Correct answer)
- Match terms and definitions
Correct answer: Develop an e‑learning module
A performance-based assessment requires learners to demonstrate their skills and knowledge by performing a task or creating a product that simulates real-world application. Developing an e-learning module is a hands-on task that requires applying various skills such as instructional design, content creation, and technical proficiency. This makes it a prime example of a performance-based assessment, unlike traditional selected-response formats.
Question 9: Kirkpatrick Level 4 evaluation focuses on:
- Learner satisfaction
- Knowledge gained
- Behavior change
- Organizational results (Correct answer)
Correct answer: Organizational results
Kirkpatrick's Four Levels of Evaluation measure the effectiveness of training programs. Level 4, the highest level, focuses on Organizational Results. This level assesses the ultimate impact of the training on the organization's bottom line, such as increased productivity, improved quality, reduced costs, or enhanced customer satisfaction, demonstrating the tangible business value of the training.
CIT Assessment & Evaluation Techniques
A test that measures what it is intended to measure is said to have high: