CCS Career Assessment & Psychometrics 2 — Questions and Answers
Question 1: Which psychometric concept refers to the consistency of a test across different raters or scorers?
- Content validity
- Inter-rater reliability (Correct answer)
- Construct validity
- Test-retest reliability
Correct answer: Inter-rater reliability
Inter-rater reliability measures the degree to which different evaluators give consistent scores for the same assessment.
Question 2: The Strong Interest Inventory is based primarily on which theoretical framework?
- Trait-factor theory
- Holland's RIASEC typology (Correct answer)
- Myers-Briggs personality types
- Super's life-span theory
Correct answer: Holland's RIASEC typology
The Strong Interest Inventory uses Holland's six RIASEC occupational themes to match individual interests to career environments.
Question 3: A career assessment tool has a high ceiling effect. What does this mean for clients at the high end of the ability range?
- Their scores are inflated beyond true ability
- The test cannot differentiate among high performers (Correct answer)
- They score lower than expected on retesting
- The test is biased against high performers
Correct answer: The test cannot differentiate among high performers
A ceiling effect occurs when top scorers cluster at the maximum, making it impossible to distinguish among highly skilled individuals.
Question 4: In the context of career assessments, what does 'norm group' refer to?
- The ethical standards governing test administration
- A reference sample used to interpret an individual's scores (Correct answer)
- The minimum acceptable score for a career field
- The group of experts who developed the assessment
Correct answer: A reference sample used to interpret an individual's scores
A norm group is the standardization sample whose scores provide the benchmark for interpreting any individual's results.
Question 5: Which of the following best describes a 'forced-choice' format in career personality assessments?
- Respondents rate each item on a Likert scale
- Respondents must choose between equally desirable options (Correct answer)
- Respondents answer true or false to each statement
- Respondents rank all items from most to least preferred
Correct answer: Respondents must choose between equally desirable options
Forced-choice formats require selecting between items balanced for social desirability, reducing response bias.
Question 6: Which career assessment would be MOST appropriate for identifying a client's transferable skills from non-work experiences?
- A standardized aptitude battery
- A structured skills inventory or card sort (Correct answer)
- A vocational interest inventory
- A clinical personality assessment
Correct answer: A structured skills inventory or card sort
Skills inventories and card sorts allow clients to identify and articulate competencies gained across all life domains, not just paid work.
Question 7: What is the primary risk when a career counselor uses an assessment normed exclusively on a college-educated White population with a diverse working-class client?
- The assessment will have poor internal consistency
- Scores may be invalid due to norm group mismatch (Correct answer)
- The assessment will exceed the client's reading level
- The test-retest interval will be too long
Correct answer: Scores may be invalid due to norm group mismatch
Using norms from a non-representative sample can produce misleading scores and unfair interpretations for clients outside that group.
Which psychometric concept refers to the consistency of a test across different raters or scorers?