CODESP Test Validation and Reliability 2

Question 1

Which type of validity evidence examines whether test scores correlate with an external criterion measured at the same time?

Accepted Answer

Concurrent validity

Answer

Predictive validity

Answer

Content validity

Answer

Construct validity

Question 2

A reliability coefficient of 0.50 for a selection test would generally be considered:

Accepted Answer

Too low for most selection purposes

Answer

Excellent and exceeds standards

Answer

Acceptable for high-stakes decisions

Answer

Appropriate only for cognitive tests

Question 3

What does the standard error of measurement (SEM) primarily tell us?

Accepted Answer

The expected variation in an individual's scores across repeated administrations

Answer

The average score on the test

Answer

The correlation between two test forms

Answer

The difference between observed and true scores for a group

Question 4

When a test is used to predict future job performance measured six months after hiring, this is an example of:

Accepted Answer

Predictive validity

Answer

Concurrent validity

Answer

Content validity

Answer

Face validity

Question 5

Which reliability method requires only a single test administration?

Accepted Answer

Internal consistency reliability

Answer

Test-retest reliability

Answer

Parallel forms reliability

Answer

Inter-rater reliability

Question 6

Differential item functioning (DIF) analysis is used to identify items that:

Accepted Answer

Perform differently for subgroups after matching on ability

Answer

Are too difficult for all test takers

Answer

Have low point-biserial correlations

Answer

Are outside the content domain

Question 7

In classical test theory, a person's observed score is defined as:

Accepted Answer

True score plus measurement error

Answer

True score minus measurement error

Answer

True score divided by reliability

Answer

Error score minus true score