User Testing Exam Participant Recruitment and Screening 2 — Questions and Answers
Question 1: What is 'snowball sampling' in user research?
- Existing participants refer new participants who share similar characteristics (Correct answer)
- Recruiting participants by randomly sampling from social media
- Enlisting a large number of participants at one time
- Gradually increasing sample size until saturation is reached
Correct answer: Existing participants refer new participants who share similar characteristics
Snowball sampling leverages existing participants to refer others from their network, useful for reaching niche or hard-to-find populations.
Question 2: What does 'theoretical saturation' mean in qualitative user research?
- The point at which additional participants yield no new significant insights (Correct answer)
- The maximum number of participants allowed in a study
- When the research budget has been fully spent
- When all planned participant slots have been filled
Correct answer: The point at which additional participants yield no new significant insights
Theoretical saturation occurs when recruiting more participants no longer reveals new themes or insights, indicating sufficient data has been collected.
Question 3: Why is a no-show rate important to account for in participant scheduling?
- Because some recruited participants will cancel or not attend, requiring overbooking to meet target sample size (Correct answer)
- Because it determines how many incentives to order
- Because moderators need breaks between back-to-back sessions
- Because participants may arrive at incorrect locations
Correct answer: Because some recruited participants will cancel or not attend, requiring overbooking to meet target sample size
Accounting for the no-show rate (typically 10–20%) by over-recruiting ensures you still reach your target sample size despite cancellations.
Question 4: What is the main advantage of recruiting from a professional panel or research recruitment agency in the US?
- Faster access to pre-screened participants matching specific demographic criteria (Correct answer)
- Lower incentive costs compared to self-recruited participants
- Guarantees participants with UX knowledge
- Ensures participants have tested similar products before
Correct answer: Faster access to pre-screened participants matching specific demographic criteria
Professional panels and agencies maintain large databases of pre-screened participants and can quickly match candidates to specific study criteria.
Question 5: When recruiting for a mobile app usability test, what device-related screening criterion is most important?
- Participants must own and regularly use the type of mobile device the app targets (Correct answer)
- Participants must have the latest smartphone model
- Participants must have a data plan with unlimited storage
- Participants must have previously downloaded competitor apps
Correct answer: Participants must own and regularly use the type of mobile device the app targets
Ensuring participants own and regularly use the target device type guarantees realistic usage context and relevant mental models.
Question 6: What is the purpose of a confirmation email sent to recruited participants before a usability session?
- To remind participants of the date, time, location, and what to bring, reducing no-shows (Correct answer)
- To send the informed consent form for legal compliance
- To share the tasks participants will be asked to complete
- To provide participants with a preview of the product being tested
Correct answer: To remind participants of the date, time, location, and what to bring, reducing no-shows
Confirmation emails reduce no-show rates by reminding participants of logistics and reinforcing their commitment to attend.
What is 'snowball sampling' in user research?