Mobile App Design Research & Evidence-Based Practice 5 — Questions and Answers
Question 1: Which qualitative data analysis technique involves physically or digitally grouping individual research observations into emergent themes without predefined categories?
- Affinity diagramming (Correct answer)
- Thematic coding with a predetermined codebook
- Factor analysis
- Regression modeling
Correct answer: Affinity diagramming
Affinity diagramming is a bottom-up technique where individual observations are grouped into clusters that reveal emergent themes rather than fitting data to existing categories.
Question 2: What is the primary ethical obligation a UX researcher must fulfill before a participant engages in any mobile usability study?
- Obtaining informed consent that clearly explains the study purpose, data use, and right to withdraw (Correct answer)
- Providing financial compensation exceeding minimum wage
- Ensuring the participant owns a smartphone
- Recording the session without participant awareness to capture natural behavior
Correct answer: Obtaining informed consent that clearly explains the study purpose, data use, and right to withdraw
Informed consent is the foundational ethical requirement — participants must understand what they're agreeing to, how data will be used, and that they can stop at any time.
Question 3: In mobile analytics, what does a high 'bounce rate' on an app's onboarding screen specifically suggest?
- Users are leaving the onboarding flow immediately without progressing, indicating a friction point at entry (Correct answer)
- Users find the onboarding so intuitive they skip it
- The app crashes on launch for most users
- Users return to the app repeatedly after initial use
Correct answer: Users are leaving the onboarding flow immediately without progressing, indicating a friction point at entry
A high bounce rate on onboarding indicates that a significant proportion of new users disengage at the very first step, pointing to a critical early-experience failure.
Question 4: A researcher conducts tree testing on a mobile app's information architecture. What does a high 'directness' score indicate?
- Participants navigated to the correct answer without backtracking, suggesting intuitive category labels (Correct answer)
- The app loads content quickly without network delays
- Users found the visual design straightforward
- The information architecture has too few categories
Correct answer: Participants navigated to the correct answer without backtracking, suggesting intuitive category labels
Directness in tree testing measures the percentage of participants who reached the correct location on the first try without backtracking, indicating label clarity and logical structure.
Question 5: When reporting usability test findings, which practice best ensures that severity ratings reflect genuine impact rather than researcher opinion?
- Using a defined severity scale combining frequency of occurrence and impact on task completion (Correct answer)
- Letting the lead designer assign severity after reviewing recordings
- Listing all issues as equal priority to avoid bias
- Only reporting issues observed in more than 80% of participants
Correct answer: Using a defined severity scale combining frequency of occurrence and impact on task completion
A structured severity scale that combines how often an issue occurs with how severely it impairs task completion creates consistent, defensible prioritization independent of individual researcher judgment.
Question 6: Which principle from behavioral economics most directly explains why mobile users make different choices in a lab usability test than they do in their daily commute?
- Context dependency — decisions and behaviors are heavily influenced by the surrounding environment and situation (Correct answer)
- Loss aversion — users fear making mistakes more in public spaces
- Anchoring — lab prices anchor user expectations differently
- The endowment effect — users value lab devices more than their own
Correct answer: Context dependency — decisions and behaviors are heavily influenced by the surrounding environment and situation
Context dependency explains that cognitive load, environmental distractions, emotional state, and situational pressures in real settings produce substantially different behaviors than controlled lab conditions.
Question 7: A mobile app design team wants to prioritize which of 30 identified usability issues to fix first in a sprint. Which research-based framework is most useful for this triage decision?
- Impact-effort matrix combining user impact severity with development effort required (Correct answer)
- Alphabetical ordering of issue names for systematic review
- Fixing issues in the order they were discovered during testing
- Deferring all decisions to the engineering lead
Correct answer: Impact-effort matrix combining user impact severity with development effort required
An impact-effort matrix allows teams to quickly identify high-impact, low-effort fixes (quick wins) and deprioritize low-impact, high-effort issues, maximizing value per sprint.
Which qualitative data analysis technique involves physically or digitally grouping individual research observations into emergent themes without predefined categories?