PeopleAnswers Science and Validation 5 — Questions and Answers
Question 1: What is the Uniform Guidelines on Employee Selection Procedures (UGESP) primarily designed to ensure?
- That selection procedures are job-related and do not cause unlawful discrimination (Correct answer)
- That all candidates receive the same score on standardized tests
- That employers use only cognitive ability tests for hiring
- That salary decisions are based on assessment results
Correct answer: That selection procedures are job-related and do not cause unlawful discrimination
UGESP provides federal guidelines ensuring that selection procedures are valid, job-related, and do not result in unlawful adverse impact against protected groups.
Question 2: In psychometrics, what does 'differential item functioning' (DIF) analysis detect?
- Items that are harder for one demographic group than another after controlling for ability (Correct answer)
- Questions with incorrect answer keys
- Items that have too narrow a range of difficulty
- Test questions answered faster by some groups
Correct answer: Items that are harder for one demographic group than another after controlling for ability
DIF analysis identifies items where candidates of equal ability but different demographic groups perform differently, potentially flagging biased items.
Question 3: The concept of 'bandwidth-fidelity tradeoff' in personality assessment refers to:
- Balancing broad trait measurement against specific behavioral prediction (Correct answer)
- The speed vs. accuracy tradeoff during testing
- The number of items needed for high reliability
- Choosing between paper and digital test formats
Correct answer: Balancing broad trait measurement against specific behavioral prediction
Broad (bandwidth) traits like Big Five factors predict many outcomes, while narrow (fidelity) traits predict specific behaviors more accurately — each has tradeoffs.
Question 4: Which statistical technique is used to determine how much of the variance in job performance is explained by an assessment score?
- Coefficient of determination (R²) (Correct answer)
- Cronbach's alpha
- Standard deviation
- Z-score conversion
Correct answer: Coefficient of determination (R²)
R² (the square of the validity coefficient) represents the proportion of criterion variance explained by the predictor, showing practical impact.
Question 5: A 'transportability review' in pre-employment assessment validation is used to:
- Justify using validity evidence from one organization in a similar context elsewhere (Correct answer)
- Transfer candidate scores between ATS platforms
- Move assessment data from paper to digital format
- Evaluate whether remote testing produces valid scores
Correct answer: Justify using validity evidence from one organization in a similar context elsewhere
A transportability review examines whether existing validity evidence from comparable jobs or organizations can be applied to a new context without a full local study.
Question 6: What distinguishes a 'criterion-referenced' interpretation of assessment scores from a 'norm-referenced' interpretation?
- Criterion-referenced compares scores to a performance standard, not to other people (Correct answer)
- Criterion-referenced ranks candidates against each other
- Criterion-referenced requires a larger norm group
- Criterion-referenced is used only for cognitive ability tests
Correct answer: Criterion-referenced compares scores to a performance standard, not to other people
Criterion-referenced scoring evaluates whether an individual meets a defined performance standard, while norm-referenced compares individuals to each other.
Question 7: In the context of PeopleAnswers behavioral assessments, why is it important to use a job-specific benchmark rather than a generic norm group?
- Job-specific benchmarks increase predictive accuracy for that particular role (Correct answer)
- Generic norms are illegal under employment law
- Job-specific benchmarks always produce higher scores
- Generic norms are only available for cognitive tests
Correct answer: Job-specific benchmarks increase predictive accuracy for that particular role
Job-specific benchmarks are built from data on high performers in a particular role, making score interpretation more relevant and predictive than generic population norms.
PeopleAnswers Science and Validation 5
What is the Uniform Guidelines on Employee Selection Procedures (UGESP) primarily designed to ensure?