User Testing Exam User Testing Facilitation and Moderation 1 — Questions and Answers
Question 1: What is the primary role of a usability test moderator during a session?
- To facilitate the session, put participants at ease, and observe behavior without influencing it (Correct answer)
- To help participants complete tasks successfully
- To evaluate the interface alongside the participant
- To document all usability findings in real time
Correct answer: To facilitate the session, put participants at ease, and observe behavior without influencing it
The moderator creates a comfortable environment and guides the session structure while remaining neutral so that observations reflect genuine user behavior.
Question 2: What is 'prompting without leading' in usability test moderation?
- Asking open-ended questions to encourage verbalization without directing participants toward a specific answer or action (Correct answer)
- Providing step-by-step hints when participants are stuck
- Asking yes/no questions to confirm what participants are thinking
- Redirecting participants who go off-task back to the scenario
Correct answer: Asking open-ended questions to encourage verbalization without directing participants toward a specific answer or action
Non-leading prompts (e.g., 'What are you thinking?') keep participants verbalizing without biasing their actions or answers.
Question 3: Why should a moderator avoid nodding or saying 'good job' when a participant completes a task?
- Positive reinforcement signals success and can discourage participants from reporting confusion or frustration they still feel (Correct answer)
- It is unprofessional and wastes session time
- It tells the participant what the next task will be
- It prevents participants from completing subsequent tasks independently
Correct answer: Positive reinforcement signals success and can discourage participants from reporting confusion or frustration they still feel
Affirmative reactions bias participants into thinking they performed correctly, potentially masking ongoing confusion and suppressing candid feedback.
Question 4: What is the 'observer effect' (Hawthorne effect) in usability testing?
- Participants change their behavior because they know they are being observed (Correct answer)
- Observers influence test results by sharing their opinions during the session
- The presence of recording equipment causes technical issues
- Researchers unconsciously favor results that confirm their hypotheses
Correct answer: Participants change their behavior because they know they are being observed
The Hawthorne effect occurs when participants perform differently under observation than they would in natural settings, potentially skewing test results.
Question 5: What should a moderator do when a participant appears visibly frustrated during a task?
- Acknowledge their feeling neutrally ('I can see this is challenging') and ask them to continue thinking aloud without offering help (Correct answer)
- Immediately provide a hint to reduce their frustration
- End the task and move on to avoid distressing the participant
- Intervene and complete the task for the participant to maintain goodwill
Correct answer: Acknowledge their feeling neutrally ('I can see this is challenging') and ask them to continue thinking aloud without offering help
Neutral acknowledgment validates the participant's experience without biasing their behavior or contaminating the observation data by providing assistance.
Question 6: What does a moderator's session introduction typically include?
- A description of the session purpose, think-aloud instructions, consent process, and reassurance that the product is being tested, not the participant (Correct answer)
- A preview of all the tasks the participant will be asked to complete
- A demonstration of how to use the product before testing begins
- A detailed explanation of the research hypotheses being investigated
Correct answer: A description of the session purpose, think-aloud instructions, consent process, and reassurance that the product is being tested, not the participant
The introduction sets expectations, explains the think-aloud protocol, obtains consent, and crucially reassures participants that there are no wrong answers — the design is being evaluated, not them.
User Testing Exam User Testing Facilitation and Moderation 1
What is the primary role of a usability test moderator during a session?