CBT Item Authoring and Banking 5 — Questions and Answers
Question 1: A 'distractor analysis' report shows that one distractor in a four-option item attracted 0% of responses. What action is MOST appropriate?
- Increase the item's point value to compensate
- Revise or replace the non-functioning distractor to make it more plausible (Correct answer)
- Remove the distractor and convert the item to three options
- Retire the item immediately without revision
Correct answer: Revise or replace the non-functioning distractor to make it more plausible
Non-functioning distractors reduce item quality by effectively making the item a three-option question, so revision is preferred over retirement when the stem is sound.
Question 2: Which of the following scenarios is an example of 'item dependency' that should be avoided in item banking?
- Two items that test the same content domain
- An item whose correct answer is given away by the stem or options of another item on the same form (Correct answer)
- Two items with the same cognitive level classification
- Items authored by the same subject matter expert
Correct answer: An item whose correct answer is given away by the stem or options of another item on the same form
Item dependency occurs when one item reveals the answer to another, violating the assumption of item independence and compromising test validity.
Question 3: In the context of item banking for high-stakes CBT exams, 'item security' refers MOST directly to:
- Password-protecting the item bank software
- Protecting item content from unauthorized access or pre-exam disclosure (Correct answer)
- Encrypting item difficulty parameters in the database
- Limiting the number of items an author can contribute
Correct answer: Protecting item content from unauthorized access or pre-exam disclosure
Item security encompasses all practices that prevent premature exposure of live items, including access controls, NDA agreements, and exposure management.
Question 4: Which of the following BEST describes 'content balancing' during automated test assembly from an item bank?
- Ensuring each test form uses exactly the same items as the previous form
- Selecting items so each form matches the blueprint's specified proportion of content domains and cognitive levels (Correct answer)
- Weighting difficult items more heavily to reward advanced candidates
- Randomly selecting items from the bank without any constraints
Correct answer: Selecting items so each form matches the blueprint's specified proportion of content domains and cognitive levels
Content balancing ensures every assembled form is parallel in terms of blueprint coverage, supporting score comparability across forms.
Question 5: A test development team implements version control for items in the bank. What is the PRIMARY benefit of this practice?
- It speeds up item authoring by pre-populating metadata
- It preserves a history of changes so teams can revert to a prior version if a revision introduces errors (Correct answer)
- It automatically classifies items by cognitive level
- It prevents two authors from writing items on the same topic
Correct answer: It preserves a history of changes so teams can revert to a prior version if a revision introduces errors
Version control provides an audit trail of edits, allowing recovery of previous item text or metadata if a revision degrades item quality.
Question 6: Which guideline is MOST important when writing stems for technology-enhanced items (e.g., drag-and-drop, hot spot) in a CBT environment?
- Keep the interaction as complex as possible to differentiate item types
- Ensure the task instructions clearly explain the interaction mechanics so candidates are not penalized for unfamiliarity with the format (Correct answer)
- Avoid any graphics or visual elements to reduce rendering issues
- Use technology-enhanced formats only for recall-level items
Correct answer: Ensure the task instructions clearly explain the interaction mechanics so candidates are not penalized for unfamiliarity with the format
Clear interaction instructions prevent format unfamiliarity from introducing construct-irrelevant difficulty, ensuring the item measures the intended skill.
Question 7: When retiring an item from an active item bank, which action MOST supports long-term bank health?
- Permanently deleting the item and all associated metadata
- Changing the item status to 'Retired' and preserving statistical history for future validity research (Correct answer)
- Rewriting the item immediately to create a replacement
- Transferring the item to a different exam program's bank
Correct answer: Changing the item status to 'Retired' and preserving statistical history for future validity research
Retiring rather than deleting an item maintains its historical statistics, which can inform future item writing and validity studies.
CBT Item Authoring and Banking 5
A 'distractor analysis' report shows that one distractor in a four-option item attracted 0% of responses.
What action is MOST appropriate?