User Testing Exam Task Design and Scenario Creation 2 — Questions and Answers
Question 1: What is a 'warm-up task' in usability testing?
- An easy, low-stakes task at the start of a session to help participants feel comfortable (Correct answer)
- A task that focuses on the most critical feature being tested
- A task used to calibrate recording software before the session
- A practice run with a different product to familiarize participants with the process
Correct answer: An easy, low-stakes task at the start of a session to help participants feel comfortable
Warm-up tasks ease participants into the session by starting with simple, familiar interactions before moving to the core tasks.
Question 2: Why should task scenarios avoid referencing competitor products by name?
- It can bias participants' expectations and trigger brand-based reactions rather than usability-based ones (Correct answer)
- It creates legal liability for the research team
- Competitors may hear about the study and respond negatively
- Participants are unfamiliar with competitor product names
Correct answer: It can bias participants' expectations and trigger brand-based reactions rather than usability-based ones
Mentioning competitors introduces brand bias that can distort participants' natural behavior and skew their evaluations of the product being tested.
Question 3: What does 'task completion rate' measure in a usability test?
- The percentage of participants who successfully complete a given task (Correct answer)
- The average time participants spend on a task
- The number of errors participants make per task
- The satisfaction rating participants give after a task
Correct answer: The percentage of participants who successfully complete a given task
Task completion rate is the proportion of participants who achieve the task's defined goal, serving as a primary effectiveness metric.
Question 4: What is a 'task failure' in usability testing?
- When a participant is unable to achieve the task goal within the allotted time or gives up (Correct answer)
- When recording equipment fails during a session
- When a participant skips a task voluntarily
- When the product crashes during task performance
Correct answer: When a participant is unable to achieve the task goal within the allotted time or gives up
A task failure is recorded when a participant cannot accomplish the defined goal, whether by giving up, exceeding the time limit, or reaching an incorrect end state.
Question 5: Which of the following helps ensure task scenarios have ecological validity?
- Grounding scenarios in research about real user goals and actual usage contexts (Correct answer)
- Writing scenarios based on the product team's internal feature list
- Using technical language familiar to the development team
- Designing tasks that can be completed in under 30 seconds
Correct answer: Grounding scenarios in research about real user goals and actual usage contexts
Basing scenarios on real user research ensures tasks reflect genuine goals and contexts rather than artificial or assumed behaviors.
Question 6: What is meant by 'stopping rules' in task administration during usability tests?
- Predefined criteria (time limit or observable struggle) that determine when the moderator ends a participant's attempt on a task (Correct answer)
- Rules that prevent moderators from speaking during tasks
- Guidelines for when to pause recording during a session
- Criteria for excluding a participant's data from analysis
Correct answer: Predefined criteria (time limit or observable struggle) that determine when the moderator ends a participant's attempt on a task
Stopping rules ensure consistent, standardized decisions about when to end a task attempt, protecting participants from excessive frustration while maintaining data comparability.
User Testing Exam Task Design and Scenario Creation 2
What is a 'warm-up task' in usability testing?