Icon Design Research & Evidence-Based Practice 2 — Questions and Answers
Question 1: Which research method involves observing users in their natural work environment to understand how they interact with icons organically?
- Contextual inquiry (Correct answer)
- Card sorting
- Heuristic evaluation
- A/B testing
Correct answer: Contextual inquiry
Contextual inquiry places researchers in users' real environments to observe authentic behavior and icon usage patterns.
Question 2: A designer wants to measure how quickly users identify the correct icon in a toolbar. Which metric best captures this?
- Net Promoter Score
- Time-on-task (Correct answer)
- Bounce rate
- Conversion rate
Correct answer: Time-on-task
Time-on-task directly measures how long it takes users to locate and identify an icon, reflecting icon clarity.
Question 3: During icon usability testing, a participant correctly identifies an icon's meaning but says they found it 'confusing at first.' How should this finding be classified?
- Critical error
- Non-critical usability issue (Correct answer)
- Catastrophic failure
- Out-of-scope feedback
Correct answer: Non-critical usability issue
A non-critical usability issue describes a problem that causes hesitation or confusion but does not prevent task completion.
Question 4: What does a low icon recognition rate (below 70%) in benchmark testing typically indicate?
- The icon set needs more color variation
- The metaphor is unclear and redesign is warranted (Correct answer)
- Users need more training
- File format should be changed
Correct answer: The metaphor is unclear and redesign is warranted
Recognition rates below 70% signal that the chosen visual metaphor fails to communicate meaning adequately and the icon design should be reconsidered.
Question 5: Which statistical approach is most appropriate when comparing recognition accuracy across two different icon styles with the same user group?
- Chi-square test
- Paired t-test (Correct answer)
- Regression analysis
- Cluster analysis
Correct answer: Paired t-test
A paired t-test compares means from the same participants under two conditions, controlling for individual differences.
Question 6: A team conducts a five-second test on a new icon. What is the primary goal of this method?
- Measure download speed
- Assess immediate visual impression and recall (Correct answer)
- Evaluate color accessibility
- Test hover state behavior
Correct answer: Assess immediate visual impression and recall
The five-second test evaluates whether users can grasp an icon's meaning from a brief glance, mimicking real-world scanning behavior.
Question 7: When reviewing prior icon research literature, a designer finds conflicting findings on label placement. What is the best evidence-based response?
- Default to personal preference
- Run a targeted study replicating the conflict in the specific product context (Correct answer)
- Ignore the older study automatically
- Use whichever finding supports the existing design
Correct answer: Run a targeted study replicating the conflict in the specific product context
Conducting a contextual study resolves conflicting literature by generating evidence specific to the actual product and users.
Icon Design Research & Evidence-Based Practice 2
Which research method involves observing users in their natural work environment to understand how they interact with icons organically?