PeopleAnswers Science and Validation 2 — Questions and Answers
Question 1: Which type of validity evidence examines whether a test measures what it claims to measure by analyzing its internal structure?
- Construct validity (Correct answer)
- Criterion validity
- Face validity
- Incremental validity
Correct answer: Construct validity
Construct validity assesses whether a test truly measures the theoretical construct it purports to measure through internal structural analysis.
Question 2: In PeopleAnswers assessments, what does a low standard error of measurement (SEM) indicate?
- High precision of individual scores (Correct answer)
- Low test-retest reliability
- Poor criterion validity
- Insufficient sample size
Correct answer: High precision of individual scores
A low SEM indicates that observed scores are close to a candidate's true score, reflecting high measurement precision.
Question 3: What statistical method is commonly used to identify clusters of related items on a behavioral assessment?
- Factor analysis (Correct answer)
- Linear regression
- Chi-square testing
- ANOVA
Correct answer: Factor analysis
Factor analysis groups correlated items together, revealing the underlying dimensions or traits an assessment measures.
Question 4: Which validity type is demonstrated when assessment scores correlate with future job performance ratings?
- Predictive criterion validity (Correct answer)
- Content validity
- Concurrent validity
- Construct validity
Correct answer: Predictive criterion validity
Predictive criterion validity is established when scores collected before hiring correlate with performance outcomes measured later.
Question 5: A validity coefficient of 0.35 between an assessment and job performance is generally considered:
- Practically significant in personnel selection (Correct answer)
- Too weak to be useful
- Perfect for hiring decisions
- Negative and harmful
Correct answer: Practically significant in personnel selection
In personnel selection, validity coefficients of 0.30–0.40 are considered practically significant due to the base rates and selection ratios involved.
Question 6: What is the purpose of a transportation validity study in pre-employment assessments?
- Applying validity evidence from one setting to a similar job or organization (Correct answer)
- Testing candidates who drive vehicles
- Moving test data between software systems
- Validating logistics industry assessments only
Correct answer: Applying validity evidence from one setting to a similar job or organization
Transportation (or validity generalization) allows organizations to apply existing validity evidence to similar jobs without conducting a local study.
Question 7: Which method of demonstrating validity involves subject matter experts rating whether test content mirrors job requirements?
- Content validity (Correct answer)
- Predictive validity
- Convergent validity
- Incremental validity
Correct answer: Content validity
Content validity is established through systematic evaluation by SMEs confirming that assessment content adequately represents the job domain.
PeopleAnswers Science and Validation 2
Which type of validity evidence examines whether a test measures what it claims to measure by analyzing its internal structure?