ECRE Technical Skills Evaluation 2 — Questions and Answers
Question 1: When evaluating a software engineer's technical skills, which assessment method best measures real-world job performance?
- Work-sample tests using realistic job tasks (Correct answer)
- IQ-style abstract reasoning puzzles
- Unstructured technical interviews with no rubric
- Personality questionnaires focused on openness
Correct answer: Work-sample tests using realistic job tasks
Work-sample tests have the highest predictive validity for job performance because they simulate actual job duties.
Question 2: A recruiter notices that a candidate's GitHub profile shows frequent commits but mostly to forked repositories with no original contributions. What is the most appropriate conclusion?
- The candidate may be a good contributor but hasn't led original projects (Correct answer)
- The candidate has no technical ability
- The candidate is hiding their real work
- GitHub activity is irrelevant to technical evaluation
Correct answer: The candidate may be a good contributor but hasn't led original projects
Forked repository contributions still demonstrate active engagement, but lack of original projects suggests limited independent initiative at that stage.
Question 3: Which cognitive bias is most likely to inflate a technical interviewer's rating of a candidate who graduated from the same university as the interviewer?
- Affinity bias (Correct answer)
- Halo effect
- Anchoring bias
- Recency bias
Correct answer: Affinity bias
Affinity bias occurs when interviewers favor candidates who share similar backgrounds, experiences, or affiliations.
Question 4: A take-home coding assignment returned by a candidate is unusually polished compared to their on-site performance. What should the recruiter do first?
- Ask the candidate to walk through their solution in a follow-up technical screen (Correct answer)
- Immediately disqualify the candidate for suspected cheating
- Accept the assignment without further verification
- Request a second take-home assignment on a different topic
Correct answer: Ask the candidate to walk through their solution in a follow-up technical screen
A follow-up walkthrough allows the candidate to demonstrate genuine understanding before any conclusions about integrity are drawn.
Question 5: Which tool is MOST commonly used by technical recruiters to screen for SQL proficiency in data analyst candidates?
- HackerRank or similar coding challenge platforms (Correct answer)
- LinkedIn Skills Assessments only
- Reference checks with former managers
- Behavioral interview questions about past projects
Correct answer: HackerRank or similar coding challenge platforms
Platforms like HackerRank provide standardized, auto-graded SQL challenges that objectively measure proficiency.
Question 6: When benchmarking a candidate's technical score against the talent pool, what statistical measure is most informative?
- Percentile rank within a normed reference group (Correct answer)
- Raw score alone
- Number of questions attempted
- Time taken to complete the assessment
Correct answer: Percentile rank within a normed reference group
Percentile rank contextualizes a raw score relative to a comparable population, making it far more meaningful for decision-making.
Question 7: A hiring manager insists on a minimum of 5 years of experience with a technology that has only existed for 3 years. How should an ECRE-certified recruiter respond?
- Advise the hiring manager that the requirement is impossible and suggest a realistic alternative (Correct answer)
- Post the job description as given without comment
- Quietly reduce the requirement without informing the hiring manager
- Reject all applicants since no one can meet the requirement
Correct answer: Advise the hiring manager that the requirement is impossible and suggest a realistic alternative
An ECRE recruiter must consult and educate hiring managers on market realities, acting as a strategic talent advisor.
ECRE Technical Skills Evaluation 2
When evaluating a software engineer's technical skills, which assessment method best measures real-world job performance?