Mobile App Design Research & Evidence-Based Practice 4 — Questions and Answers
Question 1: When designing a mobile app research study, what does 'ecological validity' refer to?
- The degree to which study conditions reflect real-world contexts in which users interact with the app (Correct answer)
- The environmental sustainability of research materials used
- The accuracy of data collected from app analytics systems
- The number of participants needed for statistically valid results
Correct answer: The degree to which study conditions reflect real-world contexts in which users interact with the app
Ecological validity measures how closely the study environment and tasks mirror the authentic conditions under which users actually engage with the app.
Question 2: In mobile app research, what is the primary purpose of using a 'retrospective think-aloud' protocol rather than a concurrent think-aloud?
- It prevents verbalization from interfering with natural task performance on mobile (Correct answer)
- It collects data faster than concurrent methods
- It eliminates the need for screen recording
- It is required for studies with more than 10 participants
Correct answer: It prevents verbalization from interfering with natural task performance on mobile
Retrospective think-aloud, conducted after task completion using screen recordings, avoids disrupting natural mobile interaction patterns that concurrent verbalization can alter.
Question 3: Which sampling strategy would be most appropriate for a mobile app serving a niche professional audience of 500 known users?
- Census or near-census sampling with targeted outreach to the known user list (Correct answer)
- Random digit dialing to find potential users
- Snowball sampling from social media platforms
- Convenience sampling from a university campus
Correct answer: Census or near-census sampling with targeted outreach to the known user list
When the user population is small and fully identifiable, directly recruiting from the known list maximizes representativeness and avoids the biases of indirect sampling methods.
Question 4: A mobile app team uses the HEART framework to measure UX quality. Which dimension does 'Task Success Rate' fall under?
- Task success (Correct answer)
- Engagement
- Happiness
- Retention
Correct answer: Task success
Task success is one of the five HEART dimensions (Happiness, Engagement, Adoption, Retention, Task success) and directly measures whether users can accomplish their goals.
Question 5: When evaluating quantitative usability benchmarks for a mobile app, what does a 95% confidence interval represent?
- The range within which the true population value is expected to fall 95% of the time if the study were repeated (Correct answer)
- That 95% of users will complete the task successfully
- The app will perform correctly 95% of the time
- The researcher is 95% confident the design is usable
Correct answer: The range within which the true population value is expected to fall 95% of the time if the study were repeated
A 95% confidence interval means that if the same study were repeated many times, 95% of the resulting intervals would contain the true population parameter.
Question 6: Which research artifact is specifically designed to synthesize patterns from user research into a document that represents a fictional but realistic user for design decision-making?
- Persona (Correct answer)
- Affinity diagram
- User journey map
- Research report
Correct answer: Persona
A persona is a research-grounded fictional character that synthesizes behavioral patterns, goals, and pain points to guide design decisions toward real user needs.
Question 7: A mobile app researcher wants to measure the learnability of a new gesture-based navigation system. Which study design is most appropriate?
- Longitudinal study tracking performance across multiple sessions over time (Correct answer)
- Single-session cross-sectional survey
- Expert heuristic evaluation in one sitting
- Focus group discussing gesture preferences
Correct answer: Longitudinal study tracking performance across multiple sessions over time
Learnability requires measuring performance change over time, which necessitates a longitudinal design with multiple sessions to track improvement curves.
Mobile App Design Research & Evidence-Based Practice 4
When designing a mobile app research study, what does 'ecological validity' refer to?