User Testing Exam Usability Metrics and Analysis 2 — Questions and Answers
Question 1: What is 'affinity diagramming' used for in usability analysis?
- Grouping qualitative observations and insights into thematic clusters to identify patterns (Correct answer)
- Creating visual flow diagrams of user navigation paths
- Mapping quantitative metrics onto a priority matrix
- Organizing participant demographic data by session date
Correct answer: Grouping qualitative observations and insights into thematic clusters to identify patterns
Affinity diagramming organizes raw qualitative observations into themes by clustering related notes, helping researchers identify recurring patterns across participants.
Question 2: What is the purpose of a 'rainbow spreadsheet' in usability analysis?
- A structured matrix mapping usability issues to individual participants to reveal which problems are widespread (Correct answer)
- A color-coded schedule for conducting multiple test sessions
- A tool for visualizing A/B test results across color schemes
- A satisfaction rating sheet filled in by participants after each task
Correct answer: A structured matrix mapping usability issues to individual participants to reveal which problems are widespread
A rainbow spreadsheet (or issues matrix) color-codes which participants experienced each usability issue, making frequency and severity patterns immediately visible.
Question 3: What does 'severity rating' mean when prioritizing usability issues?
- A score combining the frequency and impact of a usability problem to determine how urgently it needs to be fixed (Correct answer)
- The technical difficulty of implementing a fix for the issue
- How upset participants became when they encountered the problem
- The number of sessions in which the issue was observed
Correct answer: A score combining the frequency and impact of a usability problem to determine how urgently it needs to be fixed
Severity ratings help teams prioritize fixes by weighting both how often an issue occurs and how much it impacts the user's ability to complete their goal.
Question 4: What is a 'funnel analysis' in usability and analytics?
- Tracking the drop-off rate of users at each step of a multi-step process to identify where users abandon the flow (Correct answer)
- A method for filtering participant data by age group
- A visualization of which features users access first
- A technique for analyzing eye-tracking heat maps
Correct answer: Tracking the drop-off rate of users at each step of a multi-step process to identify where users abandon the flow
Funnel analysis reveals where users abandon a multi-step flow (e.g., checkout), pinpointing the highest-friction steps that need usability attention.
Question 5: What is 'learnability' as a usability metric?
- How quickly new users can achieve proficiency with the product on first or repeated use (Correct answer)
- The ease with which users remember how to use the product after a gap
- The number of training sessions required before users can use the product
- How well the product teaches users about its features through onboarding
Correct answer: How quickly new users can achieve proficiency with the product on first or repeated use
Learnability measures how rapidly performance improves as users gain experience with the product, often tracked via task time or error rate across multiple sessions.
Question 6: What is 'memorability' in the context of usability?
- The ability of infrequent users to re-establish proficiency after not using the product for a period (Correct answer)
- How well users remember the brand after using the product
- The degree to which product features stick in long-term memory
- How easy the product's design patterns are to remember during a single session
Correct answer: The ability of infrequent users to re-establish proficiency after not using the product for a period
Memorability measures whether users can re-engage with the product effectively after time away without needing to re-learn how it works.
User Testing Exam Usability Metrics and Analysis 2
What is 'affinity diagramming' used for in usability analysis?