PeopleAnswers Science and Validation 4 — Questions and Answers
Question 1: Which of the following best describes 'faking' on a personality-based pre-employment assessment?
- Intentionally responding to appear more desirable to employers (Correct answer)
- Guessing on difficult cognitive items
- Answering honestly but inconsistently
- Skipping items to finish faster
Correct answer: Intentionally responding to appear more desirable to employers
Faking (impression management) occurs when candidates deliberately distort responses to present a socially desirable profile rather than an accurate self-description.
Question 2: What is the primary advantage of using a forced-choice item format in behavioral assessments?
- It reduces social desirability responding and faking (Correct answer)
- It increases the number of questions candidates can answer
- It eliminates the need for norm groups
- It speeds up the scoring process
Correct answer: It reduces social desirability responding and faking
Forced-choice formats require candidates to choose between equally desirable options, making it harder to identify and select the 'best-looking' answer.
Question 3: In validity generalization research, meta-analysis is used to:
- Combine validity coefficients across many studies to estimate true validity (Correct answer)
- Average candidate scores across job families
- Generate new test items from existing data
- Calculate the cost-per-hire of assessment programs
Correct answer: Combine validity coefficients across many studies to estimate true validity
Meta-analysis aggregates validity coefficients from multiple studies, correcting for sampling error and artifacts to reveal the underlying true validity of a construct.
Question 4: Which concept explains why the observed correlation between an assessment and job performance is typically lower than the true relationship?
- Range restriction (Correct answer)
- Construct inflation
- Score compression
- Validity drift
Correct answer: Range restriction
Range restriction occurs because organizations only hire a subset of applicants, truncating the score distribution and artificially lowering observed validity coefficients.
Question 5: A concurrent validity study differs from a predictive validity study primarily because:
- Criterion data are collected at the same time as assessment data, using current employees (Correct answer)
- It focuses on measuring multiple criteria simultaneously
- It uses a smaller sample size than predictive studies
- The assessment is given after job performance is already known
Correct answer: Criterion data are collected at the same time as assessment data, using current employees
In a concurrent study, current employees complete the assessment and performance data are collected at the same time, avoiding the lengthy wait of a predictive design.
Question 6: What is the primary purpose of a job analysis in the context of assessment validation?
- To identify the KSAOs required for successful job performance (Correct answer)
- To determine the salary range for the position
- To count the number of tasks performed daily
- To evaluate current employee performance ratings
Correct answer: To identify the KSAOs required for successful job performance
Job analysis identifies the knowledge, skills, abilities, and other characteristics (KSAOs) needed to perform a job, forming the foundation for valid assessment design.
Question 7: Which of the following is an example of convergent validity evidence?
- A new conscientiousness scale correlates highly with an established conscientiousness measure (Correct answer)
- An assessment score fails to correlate with an unrelated trait like height
- Test scores predict performance better than chance
- Reliability estimates exceed 0.80 across multiple samples
Correct answer: A new conscientiousness scale correlates highly with an established conscientiousness measure
Convergent validity is supported when a new measure correlates strongly with established measures of the same construct, confirming they assess the same thing.
PeopleAnswers Science and Validation 4
Which of the following best describes 'faking' on a personality-based pre-employment assessment?