CBT - Computer Based Testing Scoring Models and Reporting Questions and Answers

Question 1

A certification body administers multiple forms of a CBT exam throughout the year.
To ensure that a score of 450 on Form A represents the same level of proficiency as a score of 450 on the more difficult Form B, which of the following psychometric procedures is essential?

Accepted Answer

Equating

Answer

Standard setting

Answer

Item analysis

Answer

Score validation

Question 2

A candidate's score report for a certification exam indicates their scaled score is 750, with a passing score of 700. The report also shows a Standard Error of Measurement (SEM) of 25. What does the SEM indicate?

Accepted Answer

The range within which the candidate's 'true score' likely falls.

Answer

The candidate's score is 25 points above the average score of all test-takers.

Answer

The percentage of questions the candidate answered correctly.

Answer

The percentile rank of the candidate compared to a reference group.

Question 3

Which of the following BEST describes the primary advantage of using scaled scores instead of raw scores for reporting results of a high-stakes CBT program with multiple test forms?

Accepted Answer

They allow for fair comparison of candidate performance across different, potentially unequally difficult, test forms.

Answer

Scaled scores are easier for candidates to understand than raw percentages.

Answer

They directly represent the number of questions answered correctly, providing transparent feedback.

Answer

Scaled scores are required for conducting item-level discrimination analysis.

Question 4

A panel of Subject Matter Experts (SMEs) is convened to determine the passing score for a new certification exam. Each SME independently reviews every test item and estimates the probability that a 'minimally competent candidate' would answer it correctly. The average of these probabilities across all items and all SMEs is then calculated to set the initial pass mark. This process is an application of the:

Accepted Answer

Angoff method

Answer

Hofstee method

Answer

Contrasting groups method

Answer

Bookmark method

Question 5

When designing a score report for candidates who did not pass a CBT exam, which component is MOST valuable for guiding their future study efforts?

Accepted Answer

Diagnostic feedback showing performance by major content domains or sections.

Answer

The candidate's overall scaled score and the required passing score.

Answer

A list of the specific questions the candidate answered incorrectly.

Answer

The candidate's percentile rank compared to all other test-takers.

Question 6

A testing organization needs to provide its board of directors with a high-level overview of exam performance trends from the past year, including pass rates by demographic group and geographic region. To do this, individual candidate score data must be compiled and summarized. This process is known as:

Accepted Answer

Data aggregation

Answer

Score scaling

Answer

Standard setting

Answer

Psychometric modeling

A certification body administers multiple forms of a CBT exam throughout the year.To ensure that a score of 450 on Form A represents the same level of proficiency as a score of 450 on the more difficult Form B, which of the following psychometric procedures is essential?

A certification body administers multiple forms of a CBT exam throughout the year.
To ensure that a score of 450 on Form A represents the same level of proficiency as a score of 450 on the more difficult Form B, which of the following psychometric procedures is essential?