CODESP Applicant Screening and Evaluation 4 — Questions and Answers
Question 1: Which component of a structured oral board interview ensures that raters evaluate candidates on the same dimensions?
- Open-ended follow-up questions
- Standardized scoring rubrics (anchor benchmarks) (Correct answer)
- Candidate self-assessments
- Random question assignment
Correct answer: Standardized scoring rubrics (anchor benchmarks)
Standardized scoring rubrics with behavioral anchors define what constitutes different performance levels on each dimension, ensuring raters apply consistent standards across all candidates.
Question 2: Which type of job analysis method involves employees recording their tasks and activities in real time throughout their workday?
- Critical incident technique
- Position Analysis Questionnaire (PAQ)
- Diary/log method (Correct answer)
- Task inventory survey
Correct answer: Diary/log method
The diary or work log method requires employees to record their activities as they occur, capturing real-time data about tasks, frequency, and time spent.
Question 3: When screening resumes for a civil service position, which practice BEST protects against disparate treatment of applicants?
- Accepting only in-person applications
- Using standardized, job-related minimum qualification criteria applied consistently (Correct answer)
- Allowing hiring managers to select resumes based on professional judgment alone
- Requiring applicants to include a photograph for identification
Correct answer: Using standardized, job-related minimum qualification criteria applied consistently
Applying the same standardized, job-related screening criteria to all resumes eliminates inconsistency and reduces the opportunity for intentional or unintentional discriminatory decision-making.
Question 4: A personality assessment used for applicant screening must primarily demonstrate which characteristic to be legally defensible?
- High face validity so applicants perceive it as fair
- A demonstrated statistical link to job-relevant criterion measures (Correct answer)
- Administration time under 30 minutes
- Norm groups drawn from the general population
Correct answer: A demonstrated statistical link to job-relevant criterion measures
For a personality assessment to withstand legal scrutiny under the Uniform Guidelines, it must demonstrate a validated, statistically significant relationship to job performance or other job-relevant criteria.
Question 5: Which selection approach requires candidates to demonstrate their ability to perform actual job tasks under standardized conditions?
- Biographical data inventory
- Work sample test (Correct answer)
- Situational judgment test
- Reference check
Correct answer: Work sample test
Work sample tests present candidates with realistic simulations of actual job tasks and evaluate how well they perform those tasks under controlled conditions.
Question 6: In the context of CODESP exam preparation, 'differential prediction' refers to a situation where:
- Two raters score the same candidate differently
- A selection test predicts performance differently for different demographic groups (Correct answer)
- An applicant's score changes significantly across test administrations
- Multiple tests predict the same criterion simultaneously
Correct answer: A selection test predicts performance differently for different demographic groups
Differential prediction (or test bias) occurs when the statistical relationship between test scores and job performance differs systematically across subgroups such as race or gender.
Question 7: Which strategy is MOST effective for improving inter-rater reliability when multiple evaluators score written examination responses?
- Allowing each rater to develop their own scoring criteria
- Conducting calibration sessions using sample responses before official scoring (Correct answer)
- Having raters score independently without any guidance
- Reducing the number of rating dimensions to one
Correct answer: Conducting calibration sessions using sample responses before official scoring
Calibration sessions where raters score practice responses together and discuss scoring criteria before the actual examination reduce variability and align rater standards.
CODESP Applicant Screening and Evaluation 4
Which component of a structured oral board interview ensures that raters evaluate candidates on the same dimensions?