Harrison Assessment Tests SmartQuestionnaire Design 5 — Questions and Answers
Question 1: When adapting the SmartQuestionnaire for a senior leadership role, which design adjustment is most critical?
- Increasing the number of questions to at least 150 items
- Recalibrating the job success analysis to reflect leadership-specific traits such as strategic thinking and people development (Correct answer)
- Removing all task preference items and focusing solely on values
- Using a different questionnaire platform designed exclusively for executives
Correct answer: Recalibrating the job success analysis to reflect leadership-specific traits such as strategic thinking and people development
The job success analysis must reflect the specific behavioral demands of leadership, which differ substantially from individual contributor roles.
Question 2: How does the SmartQuestionnaire's design reduce the risk of adverse impact on protected groups under Title VII?
- By capping scores for majority group members to equalize outcomes
- By basing items on work-task enjoyment with demonstrable job-relatedness, avoiding personality constructs with documented adverse impact (Correct answer)
- By using separate questionnaire versions for different demographic groups
- By prohibiting the use of assessment scores as the sole selection criterion
Correct answer: By basing items on work-task enjoyment with demonstrable job-relatedness, avoiding personality constructs with documented adverse impact
Grounding items in job-relevant task enjoyment rather than broad personality dimensions reduces the construct-level bias that has historically caused adverse impact in personality testing.
Question 3: What is the function of 'trait ranges' rather than single trait scores in Harrison's SmartQuestionnaire reporting?
- Ranges indicate the margin of error in the questionnaire's reliability
- Ranges show the zone within which a candidate's behavior naturally fluctuates, indicating behavioral flexibility (Correct answer)
- Ranges are only used for candidates who score in the middle percentiles
- Ranges replace individual scores when sample sizes are too small for norming
Correct answer: Ranges show the zone within which a candidate's behavior naturally fluctuates, indicating behavioral flexibility
Reporting a range rather than a point score communicates that behavior exists on a continuum and that candidates can flex within that zone depending on context.
Question 4: In SmartQuestionnaire design, how are 'retention predictors' incorporated to help organizations reduce turnover?
- A separate retention questionnaire is administered six months after hiring
- Certain trait-job alignment patterns identified at assessment correlate with early exit risk and are flagged in the report (Correct answer)
- Retention predictors are calculated solely from compensation data linked to the assessment platform
- Managers manually tag which traits they believe cause turnover after reviewing results
Correct answer: Certain trait-job alignment patterns identified at assessment correlate with early exit risk and are flagged in the report
Harrison's research has identified specific misalignment patterns between individual preferences and job demands that statistically predict voluntary turnover.
Question 5: How does the SmartQuestionnaire handle candidates who attempt to game the assessment by selecting answers they believe the employer wants?
- A validity scale directly identifies lying and voids the assessment
- The consistency index compares logically related items; large inconsistencies flag a potentially managed response (Correct answer)
- Candidates are disqualified automatically if their suitability score is too high
- The system requires candidates to retake the assessment under supervised conditions
Correct answer: The consistency index compares logically related items; large inconsistencies flag a potentially managed response
The consistency index detects when responses to related items contradict each other in ways that suggest deliberate management rather than authentic self-report.
Question 6: Which SmartQuestionnaire principle explains why a high score on 'assertiveness' is not universally positive across all job profiles?
- High assertiveness always indicates aggression, which is penalized across all roles
- Trait value is always relative to job requirements; assertiveness helps in some roles and hinders performance in others (Correct answer)
- Harrison considers assertiveness a cognitive trait rather than a behavioral one
- Assertiveness scores are only reported for sales and management roles
Correct answer: Trait value is always relative to job requirements; assertiveness helps in some roles and hinders performance in others
No trait is inherently positive or negative in Harrison's framework; each trait's value is determined by whether it aligns with what the specific job requires.
Question 7: What does the SmartQuestionnaire's 'development report' output provide that the standard selection report does not?
- A list of courses and certifications the candidate should complete before being hired
- Coaching insights and actionable growth areas tailored to the individual's trait profile for use after hiring (Correct answer)
- A comparison of the candidate's scores against a high-performer benchmark group
- A summary of the candidate's interview performance rated by the hiring manager
Correct answer: Coaching insights and actionable growth areas tailored to the individual's trait profile for use after hiring
The development report reframes assessment results into growth opportunities, giving managers and coaches specific trait-based areas to focus on with the individual once onboarded.
Harrison Assessment Tests SmartQuestionnaire Design 5
When adapting the SmartQuestionnaire for a senior leadership role, which design adjustment is most critical?