CBT - Computer Based Testing Test Assembly and Delivery Questions and Answers

Question 1

A certification body is implementing Linear-On-the-Fly Testing (LOFT) for its high-stakes exam. Which of the following is the primary advantage of this test assembly model over traditional fixed-form exams?

Accepted Answer

It generates a unique, psychometrically equivalent test form for each candidate in real-time.

Answer

Linear-On-the-Fly Testing (LOFT) assembles a unique, full-length test for each candidate just before the exam begins. The algorithm pulls items from a large bank based on a blueprint to ensure each test form is equivalent in content and statistical difficulty, which greatly enhances security by minimizing item overlap between candidates.

Question 2

During the delivery of a remotely proctored CBT exam, the proctoring software flags a candidate for frequently looking away from the screen. The software uses AI to analyze webcam footage, gaze direction, and background noise. This type of security measure is primarily designed to prevent which threat?

Accepted Answer

Use of unauthorized physical materials or assistance from another person.

Answer

AI-powered proctoring systems that monitor a candidate's physical behavior, such as eye movements and background activity, are specifically designed to detect cheating attempts involving unauthorized aids like notes, textbooks, or receiving help from someone else in the room.

Question 3

Which of the following is a critical prerequisite for successfully implementing a Linear-On-the-Fly Testing (LOFT) model?

Accepted Answer

A large and well-calibrated item bank with detailed metadata.

Answer

The LOFT model relies on an extensive, robust item bank where each item is calibrated and tagged with metadata (e.g., content area, difficulty, cognitive level). This allows the assembly algorithm to construct unique forms that are statistically equivalent and conform to the test blueprint. Without a large pool, item exposure would be too high, defeating the security purpose of the model.

Question 4

A test development organization uses an automated test assembly (ATA) algorithm to build multiple parallel forms of a certification exam. A key feature of this algorithm is its ability to recognize and avoid pairing certain items together on the same form because they contain overlapping content or one gives away the answer to another. These items are best known as:

Accepted Answer

Enemy Items

Answer

Enemy items (or item enemies) are pairs or sets of items that should not appear on the same test form due to content overlap, where one item may provide clues or the direct answer to another. Automated test assembly algorithms are programmed with rules to prevent these pairings, ensuring test fairness and validity.

Question 5

In a Computerized Adaptive Test (CAT), an item exposure control strategy is implemented where items are grouped into strata based on their discrimination parameter ('a' value). The algorithm selects items from lower-discrimination strata early in the test and from higher-discrimination strata as the ability estimate becomes more precise. What is this strategy called?

Accepted Answer

a-Stratification

Answer

The a-Stratification method is an item exposure control strategy used in CAT. It involves dividing the item bank into several levels (strata) based on the items' 'a' (discrimination) parameter. The test then pulls items from different strata at different stages of the exam to balance measurement precision with item exposure control, preventing the most discriminating (and often most exposed) items from being used too frequently.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Test Assembly and Delivery Questions and Answers