Making Final Selection Decisions Flashcards

When using a compensatory selection model, a very high score on one predictor can offset a low score on another predictor. What is a key disadvantage of this approach?

Answer: It may allow candidates with a critical weakness to be hired if strengths compensate

In compensatory models, a critical deficiency in one area (e.g., safety knowledge) can be offset by high scores elsewhere, which may be unacceptable for certain job requirements.

A multiple hurdle selection procedure requires candidates to pass each stage sequentially. This approach is most appropriate when:

Answer: Early predictors are highly valid and later stages are costly to administer

Multiple hurdles are most efficient when earlier, cheaper tests effectively screen out unqualified candidates before expensive later assessments are administered.

In a banding approach to final selection decisions, candidates within a defined score range are treated as equally qualified. What statistical concept underlies the width of a band?

Answer: Standard error of measurement (SEM)

Band width is typically calculated using the standard error of measurement, reflecting the uncertainty inherent in any test score.

When making final selection decisions under a top-down rank-ordering approach, which of the following is the primary criterion for selection?

Answer: The applicant's composite predictor score from highest to lowest

Top-down rank ordering selects candidates strictly in descending order of their composite or overall test score.

An organization discovers that its final selection cut score results in significant adverse impact against a protected group. Under the Uniform Guidelines on Employee Selection Procedures, the employer should:

Answer: Evaluate whether a lower cut score or alternative procedure could reduce impact while maintaining validity

The Uniform Guidelines require employers to explore alternative procedures or cut scores that achieve business objectives with less adverse impact.

Which of the following best describes a 'passing score' in selection, as distinguished from a cut score?

Answer: A passing score reflects minimum competency, while a cut score may reflect a higher performance standard

While often used interchangeably, a passing score typically refers to minimum competency for job performance, whereas a cut score is the specific operationalized threshold used in a selection decision.

When integrating structured interview scores with written test scores in a final composite, which weighting approach is most defensible from a validity standpoint?

Answer: Weighting predictors in proportion to their criterion-related validity coefficients

Weighting predictors by their validity coefficients maximizes the predictive power of the composite score for job performance.

An agency is considering using a 'rule of three' in final selection, meaning only the top three ranked candidates are referred to the hiring manager. What is the primary criticism of this practice?

Answer: It may be unnecessarily restrictive and ignore score differences that fall within measurement error

The rule of three can be arbitrary because rank differences near the cutoff may not be meaningfully different given measurement error.

In the context of final selection decisions, what is the purpose of a 'structured credential review' as a final step before making an offer?

Answer: To verify that the selected candidate meets all stated minimum qualifications and certifications

A structured credential review ensures that the top-scoring candidate actually possesses the required licenses, education, or certifications listed in the job announcement.

Which of the following scenarios best illustrates the concept of 'incremental validity' in building a final selection battery?

Answer: Adding a personality inventory that predicts job performance above and beyond what a cognitive ability test already predicts

Incremental validity refers to the additional predictive power a new measure provides over and above existing predictors in the battery.

When setting a cut score using the Angoff method, what is each panel member asked to do?

Answer: Estimate the probability that a minimally competent candidate would answer each item correctly

In the Angoff method, subject matter experts estimate, for each item, the proportion of minimally competent candidates who would answer it correctly, and these estimates are averaged to set the cut score.

A final selection decision that results in adverse impact is legally defensible if the employer can demonstrate:

Answer: That the selection procedure is job-related and consistent with business necessity

Under Title VII and the Uniform Guidelines, adverse impact can be justified by demonstrating that the procedure is job-related and consistent with business necessity.

In a concurrent validity study used to support a cut score, which limitation must selection professionals be most cautious about?

Answer: The study uses current employees rather than applicants, which may underestimate predictor range

Concurrent studies use incumbent employees who represent a restricted range of ability, which can attenuate validity coefficients and make cut score generalization to applicants problematic.

When a selection battery uses a multiple cutoff approach with fixed minimum scores on each predictor, what assumption about the predictors underlies this design?

Answer: Each predictor measures a competency that cannot be compensated for by high performance on another

Multiple cutoffs assume that minimum proficiency on each measured dimension is required, meaning deficiency in one area cannot be compensated by strength in another.

Which factor most directly limits the ability of a selection procedure to predict job performance, regardless of how carefully it was developed?

Answer: Criterion unreliability due to poor performance appraisal systems

If the criterion (job performance measure) is unreliable, the observed validity coefficient will be attenuated because valid variance in the predictor cannot correlate with noise in the criterion.

After making a conditional job offer, an employer learns that a candidate failed a required background check due to a past conviction. Under best practice guidelines, the employer should:

Answer: Conduct an individualized assessment of the conviction's relevance to the specific job duties

Best practices and EEOC guidance recommend individualized assessment of convictions, considering factors like the nature of the crime, time elapsed, and relevance to job duties.

Which of the following describes a 'combined' or 'mixed' selection model that uses both hurdles and compensatory components?

Answer: Candidates must pass a minimum score on a critical predictor before a compensatory composite is used to rank survivors

A mixed model requires a minimum threshold on a critical predictor (hurdle) and then uses a compensatory composite to rank those who passed, combining the advantages of both approaches.

When multiple qualified candidates remain tied in rank after all scored assessments, which of the following is an acceptable tiebreaker in civil service selection?

Answer: Using a supplemental, job-related ranked factor such as veteran's preference or seniority

Many civil service jurisdictions allow job-related or legally sanctioned tiebreakers like veteran's preference, while arbitrary factors unrelated to job performance are not defensible.

A selection professional is asked to determine whether the same cut score should apply to two different regional offices filling the same job title. Which evidence would best support using a single cut score across both sites?

Answer: The job analysis confirms highly similar task and competency requirements at both locations

A common cut score is most defensible when job analysis data confirm that the KSAOs and job tasks are substantially similar across both settings.

In selection contexts, what is 'selection ratio' and how does it affect the usefulness of a valid predictor?

Answer: It is the proportion of applicants hired; lower ratios allow valid predictors to produce greater gains in workforce quality

When fewer candidates are hired relative to applicants (low selection ratio), a valid predictor yields greater utility because selectors can be more stringent in choosing top scorers.