CODESP Test Validation and Reliability 5

Question 1

According to the Society for Industrial-Organizational Psychology (SIOP) Principles, which of the following is the LEAST acceptable justification for using a test with adverse impact?

Accepted Answer

A belief that the test 'looks' job-related to applicants

Answer

Evidence of strong criterion-related validity

Answer

Evidence of strong content validity for critical job tasks

Answer

Validity generalization evidence from similar jobs

Question 2

Coefficient alpha will be artificially INFLATED when:

Accepted Answer

Items have very high inter-correlations due to item overlap or redundancy

Answer

Items are negatively correlated with each other

Answer

The test contains many items measuring distinct facets of a construct

Answer

The test is administered under speeded conditions

Question 3

A test manual reports a test-retest reliability of 0.85 with a 6-month interval. Compared to a 2-week interval, the 6-month coefficient is MOST likely:

Accepted Answer

Lower, because real changes in the construct may occur over time

Answer

Higher, because more practice effects accumulate

Answer

The same, because reliability is a fixed property of a test

Answer

Higher, because memory of previous answers fades

Question 4

Which approach to establishing validity is MOST appropriate for a newly developed test when no local criterion data are yet available?

Accepted Answer

Validity generalization / transportability argument

Answer

Concurrent validity study

Answer

Predictive validity study with incumbents

Answer

Differential item functioning analysis

Question 5

The four-fifths (4/5) rule in the Uniform Guidelines is used to evaluate:

Accepted Answer

Whether adverse impact exists in selection rates between groups

Answer

Whether a test has acceptable reliability

Answer

Whether content validity evidence meets minimum standards

Answer

Whether a criterion measure is job-relevant

Question 6

A personnel psychologist corrects an observed validity coefficient for criterion unreliability. The corrected coefficient will be:

Accepted Answer

Higher than the observed coefficient

Answer

Lower than the observed coefficient

Answer

The same as the observed coefficient

Answer

Meaningless without range restriction correction

Question 7

Which of the following BEST describes the concept of test bias in the context of employment testing?

Accepted Answer

Systematic over- or under-prediction of criterion scores for a subgroup

Answer

Any test that results in different pass rates across demographic groups

Answer

A test that applicants perceive as unfair or irrelevant

Answer

A test with low content validity for a specific subgroup