CBT Item Authoring and Banking 4 — Questions and Answers
Question 1: A candidate review panel (CRP) in the item development process is PRIMARILY responsible for:
- Setting the passing score for the exam
- Reviewing items for fairness, sensitivity, and absence of bias before banking (Correct answer)
- Calculating item difficulty from pilot data
- Approving the final test form for publication
Correct answer: Reviewing items for fairness, sensitivity, and absence of bias before banking
A CRP evaluates items for differential item functioning risks, stereotyping, and offensive content from the perspective of diverse candidate groups.
Question 2: Which IRT model parameter describes how well an item distinguishes between high- and low-ability candidates?
- Guessing parameter (c)
- Discrimination parameter (a) (Correct answer)
- Difficulty parameter (b)
- Information parameter (I)
Correct answer: Discrimination parameter (a)
The 'a' parameter in IRT models represents item discrimination — the steepness of the item characteristic curve at the item's difficulty level.
Question 3: An item bank field called 'item status' would MOST commonly include which set of values?
- Easy, Medium, Hard, Very Hard
- Draft, Review, Approved, Active, Retired (Correct answer)
- Dichotomous, Polytomous, Constructed-Response
- Content, Cognitive, Behavioral, Affective
Correct answer: Draft, Review, Approved, Active, Retired
Item status tracks an item's workflow stage from initial authoring through retirement, enabling version control and quality assurance.
Question 4: Which practice MOST effectively controls for 'testwise' cues in a selected-response item?
- Making the correct answer the longest option consistently
- Randomizing option order and ensuring all options are similar in length and grammatical form (Correct answer)
- Placing the correct answer in position B or C only
- Writing only three options instead of four to simplify the item
Correct answer: Randomizing option order and ensuring all options are similar in length and grammatical form
Uniform option length and randomized placement prevent candidates from using surface cues to identify the correct answer without knowing the content.
Question 5: What is the primary purpose of a 'pilot' or 'field test' section embedded in a live exam?
- To provide additional content to candidates who finish early
- To gather psychometric statistics on new items without affecting candidates' scores (Correct answer)
- To replace scored items if technical issues occur
- To test the exam delivery platform under real conditions
Correct answer: To gather psychometric statistics on new items without affecting candidates' scores
Embedded pilot items allow item banks to be populated with empirical difficulty and discrimination data before items are used for scoring.
Question 6: When developing a case study or 'testlet' item set, which authoring principle is MOST important?
- Each item in the set must require information from all preceding items to answer
- Items within the set must be independent of each other's answers while sharing the common stimulus (Correct answer)
- The stimulus should be written after the items to ensure alignment
- Testlets must contain at least ten items to justify the shared stimulus length
Correct answer: Items within the set must be independent of each other's answers while sharing the common stimulus
Item independence within a testlet prevents correct answers from depending on previous item responses, preserving valid scoring.
Question 7: Which metadata element in an item bank is MOST useful for conducting a content gap analysis before a new form is assembled?
- Item author ID
- Mapping of each item to blueprint content area and cognitive level (Correct answer)
- Date the item was last modified
- Item's average response time from previous administrations
Correct answer: Mapping of each item to blueprint content area and cognitive level
Content area and cognitive level tags allow test developers to identify blueprint cells with too few available items before assembly begins.
CBT Item Authoring and Banking 4
A candidate review panel (CRP) in the item development process is PRIMARILY responsible for: