CBT Test Design and Blueprinting 5

Question 1

Which stakeholder group is most critical to consult during the job task analysis phase of test design?

Accepted Answer

Subject matter experts currently performing the job

Answer

Subject matter experts (SMEs) who actively perform the job provide the most accurate and current information about the tasks and KSAs that should be assessed.

Question 2

A CBT blueprint that specifies a minimum of 5 items per domain ensures:

Accepted Answer

That each domain contributes enough items for stable domain-level score reporting

Answer

Setting a minimum item count per domain ensures there are enough items to provide reliable subscores or domain-level diagnostic feedback.

Question 3

What is 'blueprint fidelity' in the context of computerized test delivery?

Accepted Answer

The degree to which the delivered test matches the content and statistical specifications of the blueprint

Answer

Blueprint fidelity refers to how closely the actual delivered test conforms to all of the specifications (domain weights, cognitive levels, formats) laid out in the blueprint.

Question 4

Why might a test design team include 'unscored tutorial items' at the start of a CBT?

Accepted Answer

To familiarize candidates with item formats before scored questions begin

Answer

Tutorial items give candidates practice with the interface and item formats so that unfamiliarity with the technology does not disadvantage them on scored items.

Question 5

A blueprint specifying that no two consecutive items share the same content subdomain is an example of:

Accepted Answer

Item sequencing constraint

Answer

Item sequencing constraints in a blueprint control the order in which items from different content areas appear, often to prevent clustering and reduce context effects.

CBT - Computer Based Testing Practice Test

CBT - Computer Based Testing Practice Test

CBT Test Design and Blueprinting 5