User Experience Design Research & Evidence-Based Practice 2 — Questions and Answers
Question 1: A UX team wants to understand why users abandon a checkout flow. Which method provides the richest behavioral and attitudinal data simultaneously?
- A/B testing the button colors
- Moderated usability sessions with think-aloud protocol (Correct answer)
- Reviewing Google Analytics funnel reports
- Sending a post-purchase satisfaction survey
Correct answer: Moderated usability sessions with think-aloud protocol
Moderated usability sessions with think-aloud capture both observable actions and users' real-time reasoning.
Question 2: Which sampling strategy is most appropriate when a researcher needs to ensure representation from all key user segments in a usability study?
- Convenience sampling
- Snowball sampling
- Stratified purposive sampling (Correct answer)
- Random probability sampling
Correct answer: Stratified purposive sampling
Stratified purposive sampling deliberately recruits participants from each defined segment to ensure adequate representation.
Question 3: During a card sorting session, participants place 'Settings' in the 'Profile' category rather than 'Account.' What does this finding most directly inform?
- Visual hierarchy of the UI
- Information architecture and navigation labels (Correct answer)
- Color palette decisions
- Interaction animation timing
Correct answer: Information architecture and navigation labels
Card sorting reveals users' mental models for grouping content, directly guiding information architecture decisions.
Question 4: A researcher conducts 5 usability tests and finds the same critical error in all sessions. What should they do?
- Continue testing until reaching 15 participants before reporting
- Report and address the critical finding immediately (Correct answer)
- Discount it as a coincidence
- Run a survey to confirm with 200 users first
Correct answer: Report and address the critical finding immediately
A critical usability error appearing consistently across all sessions is sufficient evidence to report and prioritize a fix.
Question 5: What is the primary purpose of a research debrief at the end of a usability study session?
- To collect the participant's consent
- To ask follow-up questions and reveal the study's true purpose if it was concealed (Correct answer)
- To run additional tasks the facilitator forgot
- To collect demographic data for screener calibration
Correct answer: To ask follow-up questions and reveal the study's true purpose if it was concealed
A debrief closes the session ethically by allowing participants to ask questions and, if deception was used, explaining the true purpose.
Question 6: A designer uses heuristic evaluation while a separate team runs a usability test. How do these methods best complement each other?
- Heuristics replace the need for user testing entirely
- Heuristics catch expert-visible violations early; usability tests reveal real user behavior problems (Correct answer)
- Usability tests should always precede heuristic evaluations
- Both methods produce identical findings so only one is needed
Correct answer: Heuristics catch expert-visible violations early; usability tests reveal real user behavior problems
Heuristic evaluations leverage expert knowledge to catch issues quickly, while usability tests expose problems that only emerge with real users.
Question 7: What does 'ecological validity' mean in the context of UX research?
- Testing with environmentally conscious users
- The degree to which study conditions reflect real-world usage contexts (Correct answer)
- Using sustainable research materials
- Ensuring the sample size is statistically valid
Correct answer: The degree to which study conditions reflect real-world usage contexts
Ecological validity measures how closely a study's setting and tasks mirror the real environment where the product is actually used.
User Experience Design Research & Evidence-Based Practice 2
A UX team wants to understand why users abandon a checkout flow.
Which method provides the richest behavioral and attitudinal data simultaneously?