User Testing Exam User Testing Participant Recruitment and Screening 2 — Questions and Answers
Question 1: What is the risk of recruiting participants who are too familiar with the product being tested?
- They take longer to complete tasks
- They may not represent novice users and may overlook problems new users encounter (Correct answer)
- They are more likely to drop out mid-session
- They tend to give shorter verbal responses during think-aloud
Correct answer: They may not represent novice users and may overlook problems new users encounter
Highly experienced users may have learned workarounds for usability flaws that would confuse or block new users, leading to under-reporting of real issues.
Question 2: Which US federal regulation is most relevant when recruiting participants for studies involving health-related products?
- HIPAA (Correct answer)
- COPPA
- GDPR
- WCAG
Correct answer: HIPAA
HIPAA governs the privacy of health information and must be considered when recruiting or handling data from participants discussing or using health-related products.
Question 3: Why is it important to include participants from diverse demographic backgrounds?
- To fulfill legal quotas required by US testing standards
- To ensure findings represent a broader range of user experiences and avoid bias (Correct answer)
- To reduce the need for a pilot test
- To decrease the cost of participant compensation
Correct answer: To ensure findings represent a broader range of user experiences and avoid bias
Diverse recruitment uncovers usability issues that may only surface for specific demographic groups, making the product more inclusive.
Question 4: What is an 'over-recruited' participant in a usability study?
- A participant who completes more tasks than scheduled
- An extra participant scheduled beyond the target number as a backup for no-shows (Correct answer)
- A participant who recruits other candidates on behalf of the research team
- A participant who has taken part in more than three previous studies
Correct answer: An extra participant scheduled beyond the target number as a backup for no-shows
Over-recruiting means scheduling more participants than needed so that the study can still reach its target sample size if some cancel or no-show.
Question 5: What is a 'professional participant' and why should they be screened out?
- A UX professional who designs interfaces; screened out to avoid expert bias
- Someone who participates in many paid studies; screened out because they learn to 'perform' rather than behave naturally (Correct answer)
- A full-time employee of the research company; screened out for conflict of interest
- A participant with professional certification; screened out because they are over-qualified
Correct answer: Someone who participates in many paid studies; screened out because they learn to 'perform' rather than behave naturally
Professional participants grow familiar with research methods and may game sessions, perform artificially, or provide atypically polished feedback.
Question 6: When should you update your recruitment screener?
- Only before the very first study ever conducted
- Whenever the target user profile or study objectives change significantly (Correct answer)
- After every individual session is completed
- Only if participation rates fall below 10%
Correct answer: Whenever the target user profile or study objectives change significantly
Screeners should be revised when product goals, user personas, or study questions shift, ensuring the right participants continue to be recruited.
User Testing Exam User Testing Participant Recruitment and Screening 2
What is the risk of recruiting participants who are too familiar with the product being tested?