GAT Assessment and Evaluation 3 — Questions and Answers
Question 1: A test question that nearly all students answer correctly contributes little to assessment because it has:
- High difficulty index
- Low discrimination index (Correct answer)
- High reliability coefficient
- Low construct validity
Correct answer: Low discrimination index
A low discrimination index means the item fails to differentiate between higher and lower performing students, reducing its measurement value.
Question 2: Which type of validity evidence is gathered by examining whether test content adequately represents the domain being measured?
- Concurrent validity
- Predictive validity
- Content validity (Correct answer)
- Construct validity
Correct answer: Content validity
Content validity evaluates whether the test items comprehensively and accurately represent the full scope of the subject matter or skill being assessed.
Question 3: Interrater reliability is MOST important to establish when:
- Using machine-scored multiple choice tests
- Multiple graders evaluate open-ended or performance tasks (Correct answer)
- Administering the same test to students twice
- Splitting a test into two halves for scoring
Correct answer: Multiple graders evaluate open-ended or performance tasks
Interrater reliability ensures that different scorers apply the same standards consistently when evaluating subjective responses or performances.
Question 4: A student scores at the 72nd percentile on a national math test. This means the student:
- Answered 72% of questions correctly
- Scored higher than 72% of the norm group (Correct answer)
- Is in the top 28% of the class
- Achieved a score of 72 out of 100
Correct answer: Scored higher than 72% of the norm group
A percentile rank of 72 means the student performed better than 72% of students in the comparison group.
Question 5: Summative assessment differs from formative assessment primarily in that summative assessment:
- Occurs during the learning process to guide instruction
- Is used only in higher education settings
- Evaluates learning at the conclusion of an instructional period (Correct answer)
- Always uses standardized, norm-referenced tests
Correct answer: Evaluates learning at the conclusion of an instructional period
Summative assessment evaluates student learning at the end of an instructional unit, course, or program to determine final achievement.
Question 6: Test-retest reliability is best described as:
- Consistency of scores when the same test is given to the same group on two occasions (Correct answer)
- Agreement between two different versions of the same test
- Correlation between a test and an external criterion measure
- Consistency of scores across different sections of the same test
Correct answer: Consistency of scores when the same test is given to the same group on two occasions
Test-retest reliability measures score stability by administering the same test twice to the same group and correlating the two sets of scores.
Question 7: Which assessment accommodates students with disabilities by changing HOW they demonstrate knowledge without altering what is being assessed?
- Modification
- Accommodation (Correct answer)
- Differentiation
- Scaffolding
Correct answer: Accommodation
Accommodations change the format, setting, or timing of assessments while keeping the same standards and expectations for what students must demonstrate.
A test question that nearly all students answer correctly contributes little to assessment because it has: