CBT Test Assembly and Delivery 2 — Questions and Answers
Question 1: Which technique is used to prevent item exposure bias by selecting different items for each examinee while maintaining equivalent difficulty?
- Stratified random sampling
- Item rotation with enemy groups (Correct answer)
- Adaptive branching
- Fixed-form assembly
Correct answer: Item rotation with enemy groups
Item rotation using enemy groups ensures mutually exclusive items are not administered together, controlling exposure while maintaining test equivalence.
Question 2: In a CBT environment, what is the primary purpose of a 'shadow exam' or 'master form'?
- To serve as the backup paper version
- To define the blueprint constraints all assembled tests must satisfy (Correct answer)
- To train new test administrators
- To store retired item banks
Correct answer: To define the blueprint constraints all assembled tests must satisfy
The master form or shadow exam defines the content and statistical specifications that every operational test form must mirror.
Question 3: What does 'testlet' delivery refer to in CBT?
- Delivering tests in small groups of examinees
- Presenting items in pre-assembled clusters rather than individually (Correct answer)
- Splitting a long test into multiple sessions
- Using mini-tutorials before each section
Correct answer: Presenting items in pre-assembled clusters rather than individually
Test lets are small, pre-assembled groups of items delivered together, commonly used in adaptive or modular CBT designs.
Question 4: Which scheduling approach minimizes appointment conflicts for large-scale CBT programs delivered at testing centers?
- Open enrollment with rolling window (Correct answer)
- Single national test date
- Cohort-based fixed-date scheduling
- Seasonal blackout periods only
Correct answer: Open enrollment with rolling window
Open enrollment with a rolling testing window allows examinees to schedule at their convenience, reducing bottlenecks and no-shows.
Question 5: When assembling a CBT form, 'content balancing' primarily ensures that:
- All items have the same word count
- The proportion of items per content domain matches blueprint specifications (Correct answer)
- Difficult items are evenly distributed across sessions
- Each examinee receives the same items
Correct answer: The proportion of items per content domain matches blueprint specifications
Content balancing guarantees that each assembled form reflects the domain weights specified in the test blueprint.
Question 6: A testing program discovers that item X and item Y share the same answer. What is the standard remediation during assembly?
- Delete both items from the bank
- Flag them as enemy items so they are never co-administered (Correct answer)
- Randomize their answer positions
- Increase their difficulty parameters
Correct answer: Flag them as enemy items so they are never co-administered
Enemy item flagging prevents items that share answers or content clues from appearing on the same form, protecting test security.
Question 7: In automated test assembly (ATA), the objective function is typically set to:
- Maximize the number of items administered
- Optimize measurement precision at target ability levels subject to blueprint constraints (Correct answer)
- Minimize test duration regardless of accuracy
- Maximize item bank utilization across all forms
Correct answer: Optimize measurement precision at target ability levels subject to blueprint constraints
ATA uses mathematical programming to maximize measurement precision (e.g., information) at specified ability points while satisfying all content and statistical constraints.
CBT Test Assembly and Delivery 2
Which technique is used to prevent item exposure bias by selecting different items for each examinee while maintaining equivalent difficulty?