Test Assembly and Delivery Flashcards

Which technique is used to prevent item exposure bias by selecting different items for each examinee while maintaining equivalent difficulty?

Answer: Item rotation with enemy groups

Item rotation using enemy groups ensures mutually exclusive items are not administered together, controlling exposure while maintaining test equivalence.

In a CBT environment, what is the primary purpose of a 'shadow exam' or 'master form'?

Answer: To define the blueprint constraints all assembled tests must satisfy

The master form or shadow exam defines the content and statistical specifications that every operational test form must mirror.

What does 'testlet' delivery refer to in CBT?

Answer: Presenting items in pre-assembled clusters rather than individually

Test lets are small, pre-assembled groups of items delivered together, commonly used in adaptive or modular CBT designs.

Which scheduling approach minimizes appointment conflicts for large-scale CBT programs delivered at testing centers?

Answer: Open enrollment with rolling window

Open enrollment with a rolling testing window allows examinees to schedule at their convenience, reducing bottlenecks and no-shows.

When assembling a CBT form, 'content balancing' primarily ensures that:

Answer: The proportion of items per content domain matches blueprint specifications

Content balancing guarantees that each assembled form reflects the domain weights specified in the test blueprint.

A testing program discovers that item X and item Y share the same answer. What is the standard remediation during assembly?

Answer: Flag them as enemy items so they are never co-administered

Enemy item flagging prevents items that share answers or content clues from appearing on the same form, protecting test security.

In automated test assembly (ATA), the objective function is typically set to:

Answer: Optimize measurement precision at target ability levels subject to blueprint constraints

ATA uses mathematical programming to maximize measurement precision (e.g., information) at specified ability points while satisfying all content and statistical constraints.