CODESP Making Final Selection Decisions 5 — Questions and Answers
Question 1: A public sector employer uses an open-competitive eligible list ranked by total exam score. Which action would most likely violate merit principles if taken during final selection from that list?
- Certifying the top ten candidates on the list for the hiring manager's review
- Skipping a higher-ranked candidate in favor of a lower-ranked candidate without documented, job-related justification (Correct answer)
- Using veteran's preference as a tiebreaker among candidates with identical scores
- Allowing candidates to decline appointment and remain on the list for future vacancies
Correct answer: Skipping a higher-ranked candidate in favor of a lower-ranked candidate without documented, job-related justification
Bypassing a higher-ranked eligible candidate without legitimate, documented job-related reasons violates the rank-order merit principle central to civil service selection.
Question 2: What is the primary goal of 'validity generalization' evidence in supporting a final selection decision when a local validation study has not been conducted?
- To demonstrate that the test has been approved by the federal government for use in all jurisdictions
- To show that a body of prior research supports the validity of the predictor for similar jobs across multiple settings (Correct answer)
- To confirm that the test vendor has published peer-reviewed articles about the assessment
- To prove that no adverse impact occurred in any prior administration of the test
Correct answer: To show that a body of prior research supports the validity of the predictor for similar jobs across multiple settings
Validity generalization uses meta-analytic evidence to argue that a predictor's validity, demonstrated across many studies, is likely to generalize to the current job and setting.
Question 3: During a final review of selection documentation, a CODESP practitioner discovers that the cut score was established before the validity study was completed. This sequencing represents which type of problem?
- A concurrent validity design flaw
- A criterion contamination issue
- A procedural validity threat because the cut score was not empirically grounded in job performance data (Correct answer)
- A test security violation because results were used before the study ended
Correct answer: A procedural validity threat because the cut score was not empirically grounded in job performance data
Setting a cut score prior to completing the validity study means the score threshold lacks empirical support from performance data, undermining its defensibility.
Question 4: Which condition makes a 'whole-person' evaluation approach most appropriate as the final integration step in selection?
- When a large applicant pool makes individual review impractical
- When quantitative scores alone do not fully capture complex competencies critical to senior or unique roles (Correct answer)
- When the employer wants to reduce the cost of the selection process
- When all candidates have already passed a multiple hurdle battery with very high scores
Correct answer: When quantitative scores alone do not fully capture complex competencies critical to senior or unique roles
Whole-person evaluation is most defensible for senior or specialized roles where integrating qualitative evidence (e.g., portfolio review, executive interview) alongside scores provides a more complete picture.
Question 5: Under the Americans with Disabilities Act (ADA), if a candidate requests reasonable accommodation during final selection assessments, the employer must:
- Delay the entire selection process until legal counsel reviews the request
- Provide an accommodation that allows the candidate to demonstrate their KSAOs unless doing so creates undue hardship (Correct answer)
- Administer the standard assessment without modification to ensure score comparability
- Remove the candidate from the eligible list and re-evaluate after separate accommodated testing
Correct answer: Provide an accommodation that allows the candidate to demonstrate their KSAOs unless doing so creates undue hardship
The ADA requires employers to provide reasonable accommodations in testing so that candidates with disabilities can demonstrate their actual knowledge, skills, and abilities.
Question 6: A selection system produces a composite score from a written exam (weight=0.60) and a structured oral interview (weight=0.40). If a candidate scores 80 on the exam and 70 on the interview, what is their weighted composite score?
- 75.0
- 76.0 (Correct answer)
- 77.0
- 78.0
Correct answer: 76.0
The composite is (80 × 0.60) + (70 × 0.40) = 48 + 28 = 76.0.
Question 7: Which of the following best describes the 'expectancy chart' as a tool used in communicating final selection decision validity to stakeholders?
- A chart showing the probability of adverse impact at different cut scores
- A chart showing the probability that candidates in various score ranges will be successful on the job (Correct answer)
- A chart comparing the cost of different assessment methods for a given validity level
- A chart tracking the number of candidates at each stage of a multiple hurdle process
Correct answer: A chart showing the probability that candidates in various score ranges will be successful on the job
An expectancy chart displays, for each score interval, the likelihood that candidates in that range will achieve satisfactory job performance, making validity evidence intuitive for decision-makers.
CODESP Making Final Selection Decisions 5
A public sector employer uses an open-competitive eligible list ranked by total exam score.
Which action would most likely violate merit principles if taken during final selection from that list?