User Testing Exam User Testing Analysis and Synthesis 1 — Questions and Answers
Question 1: What is 'affinity diagramming' used for in usability research analysis?
- Creating visual wireframes from participant feedback
- Grouping qualitative observations into themes to identify patterns across sessions (Correct answer)
- Calculating statistical significance of quantitative usability metrics
- Scheduling follow-up interviews after initial data collection
Correct answer: Grouping qualitative observations into themes to identify patterns across sessions
Affinity diagramming organizes raw observations, quotes, and notes into thematic clusters, revealing patterns and priorities across multiple sessions.
Question 2: What does 'coding' mean in the context of qualitative usability data analysis?
- Writing scripts to automate the analysis of session recordings
- Assigning labels or categories to segments of data to identify themes (Correct answer)
- Encrypting participant data to protect confidentiality
- Translating verbal think-aloud data into numerical metrics
Correct answer: Assigning labels or categories to segments of data to identify themes
Qualitative coding involves annotating data segments with descriptive labels that allow researchers to systematically identify and compare themes.
Question 3: What is a 'usability issue severity rating' used for?
- Ranking participants by how many errors they made
- Prioritizing which usability problems to fix first based on frequency and impact (Correct answer)
- Grading the visual design quality of the interface
- Scoring moderator performance across sessions
Correct answer: Prioritizing which usability problems to fix first based on frequency and impact
Severity ratings (often 0–4) combine frequency and impact to help teams prioritize which issues require immediate attention versus minor fixes.
Question 4: When analyzing usability data, what does 'triangulation' mean?
- Using three participants per session to reduce observer bias
- Validating findings by cross-referencing multiple data sources or methods (Correct answer)
- Drawing triangle-shaped diagrams to map user flows
- Recruiting participants from three geographic regions simultaneously
Correct answer: Validating findings by cross-referencing multiple data sources or methods
Triangulation strengthens confidence in findings by checking whether multiple independent methods (e.g., observation, survey, analytics) point to the same conclusions.
Question 5: What is the purpose of a 'rainbow spreadsheet' in usability analysis?
- A color-coded calendar for scheduling participant sessions
- A structured grid that tracks which usability issues each participant encountered, enabling pattern detection (Correct answer)
- A visual map of the participant journey through the product interface
- A spreadsheet that assigns color-coded severity levels to each task
Correct answer: A structured grid that tracks which usability issues each participant encountered, enabling pattern detection
A rainbow spreadsheet maps participants (columns) against observed issues (rows), using color to show who encountered each problem and how frequently.
Question 6: In usability analysis, what is 'observer bias'?
- Participants behaving differently because they know they are being watched
- A researcher's preconceptions influencing how they interpret observations (Correct answer)
- Technical errors in eye-tracking data caused by equipment limitations
- A statistical error caused by having too few observers per session
Correct answer: A researcher's preconceptions influencing how they interpret observations
Observer bias occurs when a researcher's prior expectations or preferences unconsciously shape how they perceive and interpret participant behavior.
User Testing Exam User Testing Analysis and Synthesis 1
What is 'affinity diagramming' used for in usability research analysis?