TJHSST Assessment and Evaluation Methods 3 — Questions and Answers
Question 1: In item analysis, a discrimination index close to 0.00 for a test question suggests that the item:
- Is perfectly aligned with the learning objective
- Does not differentiate between high and low scorers (Correct answer)
- Should be kept without revision
- Has high inter-rater reliability
Correct answer: Does not differentiate between high and low scorers
A discrimination index near zero means high scorers and low scorers performed similarly on the item, indicating it fails to distinguish ability levels.
Question 2: Which assessment format is MOST susceptible to construct-irrelevant variance caused by writing ability?
- True/False items
- Matching exercises
- Extended-response essay questions (Correct answer)
- Multiple-choice questions
Correct answer: Extended-response essay questions
Essay questions require writing skill, so poor writers may score lower not because of content knowledge deficits but due to writing ability, introducing construct-irrelevant variance.
Question 3: Authentic assessment differs from traditional testing primarily because it:
- Uses only multiple-choice items for objectivity
- Requires students to apply knowledge to real-world tasks (Correct answer)
- Is scored by external standardized agencies
- Focuses exclusively on rote memorization
Correct answer: Requires students to apply knowledge to real-world tasks
Authentic assessment asks students to demonstrate competency through realistic, meaningful tasks that mirror real-world applications.
Question 4: A school uses MAP Growth assessments that adjust question difficulty based on student responses. This is known as:
- Criterion-referenced testing
- Adaptive testing (Correct answer)
- Holistic assessment
- Ipsative assessment
Correct answer: Adaptive testing
Adaptive testing dynamically adjusts item difficulty based on previous responses to efficiently estimate a student's ability level.
Question 5: The standard error of measurement (SEM) is primarily used to:
- Calculate a student's grade point average
- Express the range within which a student's true score likely falls (Correct answer)
- Determine whether a test has content validity
- Identify biased test items
Correct answer: Express the range within which a student's true score likely falls
SEM quantifies measurement error and is used to build a confidence interval around an observed score to estimate the true score range.
Question 6: Which of the following is an example of inter-rater reliability?
- A student takes the same test twice and scores similarly both times
- Two teachers independently grade the same essay and compare scores (Correct answer)
- A test covers all chapters of the textbook equally
- Students rank items in order from most to least important
Correct answer: Two teachers independently grade the same essay and compare scores
Inter-rater reliability measures the degree of agreement between two or more scorers evaluating the same student work.
Question 7: On a well-constructed norm-referenced test, the expected distribution of scores typically resembles:
- A J-shaped curve skewed toward the high end
- A flat uniform distribution
- A bell-shaped normal distribution (Correct answer)
- A bimodal distribution with two peaks
Correct answer: A bell-shaped normal distribution
Norm-referenced tests are deliberately constructed so that scores spread across the range and approximate a normal (bell-curve) distribution.
TJHSST Assessment and Evaluation Methods 3
In item analysis, a discrimination index close to 0.00 for a test question suggests that the item: