Icon Design Research & Evidence-Based Practice 5 — Questions and Answers
Question 1: Which icon research method asks participants to freely describe what an icon means without any predefined answer choices?
- Forced-choice recognition test
- Free association / open labeling (Correct answer)
- Semantic differential scale
- Likert-scale survey
Correct answer: Free association / open labeling
Open labeling (free association) captures unbiased, unprompted interpretations and reveals the full range of meanings users ascribe to an icon.
Question 2: When documenting icon research findings for handoff to a development team, which artifact is most evidence-driven and actionable?
- A mood board of competitor icons
- A findings report linking specific icon problems to observed error rates and recommended fixes (Correct answer)
- A style guide with aesthetic preferences
- A list of icon names without context
Correct answer: A findings report linking specific icon problems to observed error rates and recommended fixes
A findings report that ties observed data (error rates, task failures) to specific icons and actionable redesign recommendations provides developers with clear, justified guidance.
Question 3: A designer discovers that novice users interpret a 'home' icon as 'settings' while experts interpret it correctly. What type of bias must the study control for?
- Recency bias
- Expertise bias (expert blind spot) (Correct answer)
- Acquiescence bias
- Anchoring bias
Correct answer: Expertise bias (expert blind spot)
Expertise bias occurs when icon comprehension diverges between novice and expert users due to differing mental models and accumulated conventions.
Question 4: Which icon quality attribute does research on 'semantic distance' primarily measure?
- Icon file size efficiency
- How directly the icon's visual form maps to its intended meaning (Correct answer)
- The spacing between icons in a toolbar
- Color contrast ratio
Correct answer: How directly the icon's visual form maps to its intended meaning
Semantic distance quantifies how much cognitive effort is needed to bridge the gap between an icon's visual representation and its intended function.
Question 5: A usability team uses the System Usability Scale (SUS) after icon set testing. What aspect of usability does SUS primarily measure?
- Single icon recognition accuracy
- Overall perceived ease of use and learnability (Correct answer)
- Color harmony of the icon set
- Icon loading performance
Correct answer: Overall perceived ease of use and learnability
SUS is a validated 10-item questionnaire that measures overall subjective usability including ease of use and learnability across the interface.
Question 6: When synthesizing icon research from multiple studies, a designer finds effect sizes rather than just p-values. Why are effect sizes more informative for design decisions?
- Effect sizes are easier to calculate
- Effect sizes quantify the practical magnitude of a difference, not just statistical significance (Correct answer)
- Effect sizes replace the need for sample sizes
- Effect sizes indicate color accuracy
Correct answer: Effect sizes quantify the practical magnitude of a difference, not just statistical significance
Effect sizes (e.g., Cohen's d) communicate how large an observed difference is in practical terms, helping designers assess whether statistically significant changes are meaningfully impactful.
Question 7: A designer cites a 2009 study to justify using a floppy disk icon for 'save.' What evidence-based critique applies most directly?
- The study sample was too large
- The cultural and generational relevance of the metaphor may have eroded since the study was conducted (Correct answer)
- The study should have used more colors
- The icon file format has changed
Correct answer: The cultural and generational relevance of the metaphor may have eroded since the study was conducted
Icon metaphors tied to obsolete physical objects lose recognition among younger users over time, making older research unreliable for contemporary audiences.
Icon Design Research & Evidence-Based Practice 5
Which icon research method asks participants to freely describe what an icon means without any predefined answer choices?