CIA CIA Card Sorting and Tree Testing Methods 2 — Questions and Answers
Question 1: What is a 'first-click test' and how does it relate to information architecture?
- A security test checking the first login attempt
- A test measuring where users first click when trying to complete a task (Correct answer)
- A test of homepage load time
- A method for testing color contrast accessibility
Correct answer: A test measuring where users first click when trying to complete a task
First-click testing shows where users initially click to start a task, helping IAs understand whether navigation labels and placement are intuitive.
Question 2: In card sorting, what does 'agreement score' measure?
- How much the team agrees with the IA design
- The percentage of participants who placed a card in the same category (Correct answer)
- Whether participants agreed the study was easy
- The overlap between two different card sort studies
Correct answer: The percentage of participants who placed a card in the same category
Agreement score indicates consensus among participants, with high scores showing strong agreement on where a content item belongs.
Question 3: A 'hybrid card sort' combines elements of open and closed sorting by:
- Using both digital and physical cards simultaneously
- Providing some predefined categories while allowing participants to create additional ones (Correct answer)
- Sorting cards both alphabetically and by theme
- Requiring two separate sorting sessions per participant
Correct answer: Providing some predefined categories while allowing participants to create additional ones
Hybrid card sorts offer a set of existing categories but also allow participants to create new categories if none fit, balancing validation with discovery.
Question 4: What is the recommended minimum number of participants for a statistically useful card sort?
- 5
- 15 (Correct answer)
- 50
- 100
Correct answer: 15
Most IA researchers recommend at least 15 participants for card sorting to identify reliable patterns and meaningful clusters.
Question 5: In tree testing, a 'directness' score refers to:
- The clarity of the navigation label wording
- Whether a user navigated straight to the answer without backtracking (Correct answer)
- The number of items at each level of the tree
- How directly the tree reflects the site's content hierarchy
Correct answer: Whether a user navigated straight to the answer without backtracking
Directness measures whether participants found the correct answer on their first navigation path without revisiting previous nodes.
Question 6: When should an IA prefer tree testing over card sorting?
- When starting a brand new site from scratch with no existing structure
- When evaluating a proposed or existing navigation structure for findability (Correct answer)
- When trying to understand user vocabulary and terminology
- When measuring emotional responses to information hierarchy
Correct answer: When evaluating a proposed or existing navigation structure for findability
Tree testing is ideal for validating a proposed navigation structure, while card sorting is better for discovering how users think about content groupings.
What is a 'first-click test' and how does it relate to information architecture?