User Testing Exam User Testing Task Design and Scenarios 2 — Questions and Answers
Question 1: What is the purpose of a 'warm-up task' at the beginning of a usability session?
- To collect the most important data while participants are freshest
- To help participants feel comfortable with the think-aloud process before critical tasks begin (Correct answer)
- To screen out participants who are unable to complete basic interactions
- To measure the baseline completion rate before introducing new features
Correct answer: To help participants feel comfortable with the think-aloud process before critical tasks begin
A warm-up task eases participants into the session and acclimates them to the think-aloud protocol without risking contamination of key test tasks.
Question 2: When task ordering could influence performance, which design strategy should be used?
- Always present tasks in alphabetical order
- Counterbalance or randomize task order across participants (Correct answer)
- Present the most difficult tasks first to reduce fatigue effects
- Allow participants to self-select their preferred task order
Correct answer: Counterbalance or randomize task order across participants
Counterbalancing controls for order effects (practice, fatigue, carryover) by ensuring each task appears in different positions across participants.
Question 3: What does 'time on task' measure in a usability test?
- The total time a participant spends in the test session
- The elapsed time from when a participant starts a task to when they complete or abandon it (Correct answer)
- The time the moderator spends preparing each task instruction
- The time between consecutive tasks during a session
Correct answer: The elapsed time from when a participant starts a task to when they complete or abandon it
Time on task is an efficiency metric measuring how long a participant takes to complete a specific task, shorter times generally indicating better usability.
Question 4: Which task type is BEST for evaluating the information architecture of a website?
- Exploratory task
- Tree test task (Correct answer)
- Aesthetic preference task
- Cognitive walkthrough task
Correct answer: Tree test task
Tree tests present participants with a text-only hierarchy and ask them to find specific items, isolating IA problems from visual design influences.
Question 5: What is a 'critical task' in a usability test?
- Any task that takes longer than 5 minutes to complete
- A task central to the core user journey whose failure has significant business or safety impact (Correct answer)
- A task that is too difficult for participants to complete unassisted
- The final task in a session that collects overall satisfaction ratings
Correct answer: A task central to the core user journey whose failure has significant business or safety impact
Critical tasks represent core user goals where failure would most harm users or business outcomes, making them highest priority for usability improvement.
Question 6: Why should tasks be written in second-person ('you') rather than third-person?
- Second-person tasks are shorter and faster to read
- Second-person phrasing helps participants mentally step into the scenario and engage more authentically (Correct answer)
- Third-person tasks are grammatically incorrect in research contexts
- Second-person tasks are easier to translate for international studies
Correct answer: Second-person phrasing helps participants mentally step into the scenario and engage more authentically
Using 'you' puts participants directly in the scenario, encouraging them to approach the task as they would in real life rather than as an outside observer.
User Testing Exam User Testing Task Design and Scenarios 2
What is the purpose of a 'warm-up task' at the beginning of a usability session?