User Testing Exam User Testing Planning and Methodology 1 — Questions and Answers
Question 1: What is the primary goal of a usability test plan?
- To document the test objectives, scope, and procedures (Correct answer)
- To list all software bugs found
- To outline the marketing strategy
- To define the product roadmap
Correct answer: To document the test objectives, scope, and procedures
A usability test plan documents the objectives, scope, methodology, and procedures to guide the testing process.
Question 2: Which research method involves observing users in their natural environment without a lab setting?
- Field study (Correct answer)
- Lab usability test
- Heuristic evaluation
- Card sorting
Correct answer: Field study
Field studies observe users in their natural environment, capturing real-world context and behavior.
Question 3: What does 'think-aloud protocol' mean in user testing?
- Participants verbalize their thoughts as they complete tasks (Correct answer)
- Researchers describe what the participant is doing
- Users write down their thoughts after the session
- A moderator explains each step to the participant
Correct answer: Participants verbalize their thoughts as they complete tasks
The think-aloud protocol asks participants to verbalize their thoughts in real time, providing insight into their mental model.
Question 4: What is a pilot test in user research?
- A small trial run to validate the study design before the main test (Correct answer)
- The first live product release to users
- A survey sent to beta users
- An A/B test of two interface variants
Correct answer: A small trial run to validate the study design before the main test
A pilot test is a preliminary trial run that helps identify flaws in the study design, tasks, or materials before the main study.
Question 5: Moderated usability testing differs from unmoderated testing mainly because:
- A facilitator interacts with participants in real time during moderated testing (Correct answer)
- Moderated tests are always conducted remotely
- Unmoderated tests use more participants
- Moderated tests never record sessions
Correct answer: A facilitator interacts with participants in real time during moderated testing
Moderated testing involves a live facilitator who can probe, clarify, and adjust the session in real time, unlike unmoderated testing.
Question 6: Which of the following best describes a within-subjects study design?
- Each participant is exposed to all conditions or versions being tested (Correct answer)
- Different participants are assigned to each condition
- Only one condition is tested across all participants
- Participants self-select the condition they prefer
Correct answer: Each participant is exposed to all conditions or versions being tested
In a within-subjects design, each participant experiences all test conditions, allowing direct comparison while controlling for individual differences.
What is the primary goal of a usability test plan?