Test Design and Blueprinting Flashcards

What is the primary purpose of a test blueprint in CBT development?

Answer: To map content domains to item counts and cognitive levels

A test blueprint specifies which content domains are covered, how many items come from each, and what cognitive levels are assessed.

Which term describes the process of identifying the knowledge, skills, and abilities a test should measure?

Answer: Job task analysis

A job task analysis (JTA) identifies the KSAs required for a role and forms the foundation for test content specifications.

In a test blueprint, 'cognitive level' most commonly refers to which taxonomy?

Answer: Bloom's taxonomy

Bloom's taxonomy (remember, understand, apply, analyze, evaluate, create) is the most widely used framework for categorizing cognitive levels in test blueprints.

A test that samples items randomly from all blueprint domains without regard to proportion is violating which principle?

Answer: Content validity

Content validity requires that item proportions match the blueprint's domain weights, ensuring the test represents the full content area.

When a CBT blueprint specifies 'operational' vs. 'pretest' items, what distinguishes pretest items?

Answer: They are unscored and used to gather statistics for future use

Pretest (pilot) items are embedded in the test but do not count toward the candidate's score; they are being evaluated for future operational use.

Which blueprint characteristic ensures that a CBT can produce multiple equivalent forms?

Answer: Parallel form specifications

Parallel form specifications define the statistical and content constraints that each form must meet so that different versions of the test are interchangeable.

A 'testlet' in CBT design refers to:

Answer: A set of items sharing a common stimulus such as a scenario or passage

A testlet is a cluster of items linked to one stimulus (e.g., a case study), which can introduce local item dependence that must be accounted for in scoring.