User Testing Exam User Testing Task Design and Scenarios 1 — Questions and Answers
Question 1: What is a 'scenario-based task' in usability testing?
- A task that lists step-by-step instructions for the participant to follow
- A realistic narrative context that motivates the participant to complete a task naturally (Correct answer)
- A technical performance benchmark measured by automated scripts
- A checklist of features the moderator evaluates after the session
Correct answer: A realistic narrative context that motivates the participant to complete a task naturally
Scenario-based tasks embed the task in a realistic story, helping participants behave more naturally rather than mechanically following steps.
Question 2: Why should usability test tasks avoid using the exact labels found in the product's interface?
- To prevent participants from getting bored with familiar terminology
- To avoid priming participants and test whether the UI labels are discoverable (Correct answer)
- To comply with copyright restrictions on interface copy
- To reduce the reading level required for task comprehension
Correct answer: To avoid priming participants and test whether the UI labels are discoverable
Using interface labels in tasks primes participants to look for those exact words, inflating success rates and masking findability problems.
Question 3: What makes a usability task 'observable'?
- It can be completed without the participant speaking
- The moderator can clearly determine whether the participant succeeded or failed (Correct answer)
- It involves at least three distinct user interface screens
- It is designed to take more than 5 minutes to complete
Correct answer: The moderator can clearly determine whether the participant succeeded or failed
Observable tasks have defined success criteria so the moderator can objectively assess completion without ambiguity.
Question 4: Which of the following is an example of a well-written usability task?
- Click the 'Checkout' button to buy the product
- You want to purchase the blue jacket you found earlier. Please go ahead. (Correct answer)
- Navigate to the shopping cart and complete the purchase flow
- Test the checkout feature and tell us if it works correctly
Correct answer: You want to purchase the blue jacket you found earlier. Please go ahead.
A good task presents a realistic goal without specifying the navigation path, allowing the researcher to observe how users find and complete the action.
Question 5: What is a 'task completion rate' metric?
- The percentage of assigned tasks that a moderator completes in a session
- The proportion of participants who successfully complete a task without assistance (Correct answer)
- The average time taken to complete all tasks in a session
- The number of tasks completed per minute during a session
Correct answer: The proportion of participants who successfully complete a task without assistance
Task completion rate measures how many participants (out of the total) successfully finish a task, a key effectiveness metric in usability testing.
Question 6: What is 'task priming' and why is it a problem?
- Pre-training participants on the product before the session to speed it up
- Inadvertently revealing the expected action or path through task wording, biasing navigation (Correct answer)
- Providing too many tasks so participants feel overwhelmed
- Using images instead of text to describe tasks
Correct answer: Inadvertently revealing the expected action or path through task wording, biasing navigation
Task priming gives participants implicit hints about where to look or what to do, making success rates artificially high and hiding real usability issues.
User Testing Exam User Testing Task Design and Scenarios 1
What is a 'scenario-based task' in usability testing?