DRC DRC Item Development 2 — Questions and Answers
Question 1: What is the purpose of an 'item writer training' session in DRC's development process?
- Teaching students how to write their own test questions
- Ensuring item authors understand DRC's guidelines, formats, and content standards before writing (Correct answer)
- Training proctors on how to read items aloud
- Preparing DRC staff to enter items into the database
Correct answer: Ensuring item authors understand DRC's guidelines, formats, and content standards before writing
Item writer training equips content experts with DRC's specific item development guidelines so they produce items that are consistent, valid, and aligned to standards.
Question 2: What does 'stimulus material' refer to in a DRC reading or science item cluster?
- Any motivational material provided to students before testing
- A shared text, graph, chart, or scenario that multiple items are based upon (Correct answer)
- Chemical materials used in lab simulation items
- Background music used to stimulate student thinking
Correct answer: A shared text, graph, chart, or scenario that multiple items are based upon
Stimulus materials are the shared content—such as a reading passage, data table, or diagram—that provides context for a set of related items.
Question 3: What is 'item difficulty calibration' in the context of DRC's IRT-based item bank?
- Adjusting the reading level of item wording
- Using Item Response Theory to estimate an item's difficulty parameter from student response data (Correct answer)
- Setting physical difficulty levels for test delivery
- Calibrating how quickly items load on digital devices
Correct answer: Using Item Response Theory to estimate an item's difficulty parameter from student response data
Item difficulty calibration applies IRT models to field test data, producing a numerical difficulty parameter that describes how likely students at various ability levels are to answer the item correctly.
Question 4: What is the role of a 'content review committee' in DRC's item development workflow?
- A committee that reviews DRC's financial content for investors
- Educators and content specialists who review items for accuracy, clarity, and standards alignment (Correct answer)
- A committee that selects which items to retire from the bank
- A group of students who preview and review items before administration
Correct answer: Educators and content specialists who review items for accuracy, clarity, and standards alignment
A content review committee is composed of subject-matter experts who evaluate draft items to ensure they are accurate, clearly written, and properly aligned to the target standards.
Question 5: What does 'item revision' involve in DRC's quality control process?
- Revising a student's score after rescoring
- Modifying item wording, answer choices, or scoring criteria based on review committee feedback (Correct answer)
- Replacing entire test forms with new versions
- Revising the item numbering system
Correct answer: Modifying item wording, answer choices, or scoring criteria based on review committee feedback
Item revision involves making targeted edits to an item's text, options, or rubric in response to feedback from content, bias, or editorial reviews to improve quality.
Question 6: What is a 'passage selection' criterion in DRC reading assessment item development?
- Choosing passages based on student popularity votes
- Selecting texts based on grade-appropriate readability, content quality, and testing suitability (Correct answer)
- Selecting passages that were used on prior assessments
- Choosing passages from a single approved publisher only
Correct answer: Selecting texts based on grade-appropriate readability, content quality, and testing suitability
Passage selection criteria ensure that reading texts are at the appropriate complexity level, are engaging, are free of bias, and provide sufficient context for multiple valid items.
What is the purpose of an 'item writer training' session in DRC's development process?