KSA Interview Techniques & Performance Measurement 4 — Questions and Answers
Question 1: A KSA assessor reviewing an oral board interview notices that the first candidate's excellent answers made subsequent candidates appear weaker by comparison. This is called:
- Primacy effect
- Contrast effect (Correct answer)
- Anchoring bias
- Attribution error
Correct answer: Contrast effect
The contrast effect occurs when a candidate's rating is influenced by the performance of candidates evaluated immediately before them, rather than against an objective standard.
Question 2: Which scoring approach requires that a candidate must meet a minimum threshold on every KSA before overall scores are totaled?
- Compensatory model
- Multiple cutoff model (Correct answer)
- Banding method
- Rank-order method
Correct answer: Multiple cutoff model
The multiple cutoff model requires candidates to meet a minimum score on each individual KSA, so high performance in one area cannot compensate for failing another.
Question 3: According to the Uniform Guidelines on Employee Selection Procedures, a selection procedure must be validated when it has:
- Been in use for over five years
- An adverse impact on a protected group (Correct answer)
- A reliability coefficient below 0.70
- More than 100 candidates per position
Correct answer: An adverse impact on a protected group
The Uniform Guidelines require validation evidence for selection procedures that produce adverse impact against a protected group under Title VII.
Question 4: A KSA assessor uses a structured interview guide with a scoring rubric. Which quality of the assessment does this practice most directly improve?
- Construct validity
- Standardization and reliability (Correct answer)
- Criterion-related validity
- Content adequacy
Correct answer: Standardization and reliability
Standardized questions and scoring rubrics reduce variability between interviewers and administrations, directly improving inter-rater reliability and overall assessment consistency.
Question 5: When a performance rating scale produces a distribution where almost all employees are rated in the middle of the scale, the rater error involved is called:
- Leniency error
- Severity error
- Central tendency error (Correct answer)
- Halo effect
Correct answer: Central tendency error
Central tendency error occurs when raters avoid extreme ratings and cluster all evaluations near the midpoint, reducing the scale's ability to differentiate performance levels.
Question 6: An assessor is developing a job-related interview for a federal position. The first step in this process should be:
- Writing behavioral interview questions
- Conducting a thorough job analysis (Correct answer)
- Selecting panel members
- Establishing passing scores
Correct answer: Conducting a thorough job analysis
Job analysis is the foundation of any valid assessment; it identifies the KSAs required for the position, which then guide question development and scoring.
Question 7: A KSA assessor calculates a Cronbach's alpha of 0.45 for an interview scoring rubric. This result indicates:
- Strong internal consistency
- Poor internal consistency requiring revision (Correct answer)
- Excellent predictive validity
- Acceptable inter-rater agreement
Correct answer: Poor internal consistency requiring revision
Cronbach's alpha values below 0.70 indicate poor internal consistency, suggesting the rubric items are not reliably measuring the same underlying construct.
KSA Interview Techniques & Performance Measurement 4
A KSA assessor reviewing an oral board interview notices that the first candidate's excellent answers made subsequent candidates appear weaker by comparison.
This is called: