ISTQB Certified Tester - Usability Testing (CT-UT) — Questions and Answers

Question 1: What is a 'heat map' in the context of usability analysis?

A diagram mapping navigation paths between pages
A severity matrix for usability issues organized by priority
A chart displaying task completion rates by temperature of the testing environment
A visual overlay showing where users most frequently look, click, or hover on a screen (Correct answer)

Correct answer: A visual overlay showing where users most frequently look, click, or hover on a screen

Heat maps aggregate click, hover, or gaze data across many users to visually highlight high- and low-attention areas on a page or screen.

Question 2: A usability lab with a one-way mirror separating observers from the participant is primarily used to:

Reduce ambient noise during sessions
Prevent participants from seeing testing equipment
Allow stakeholders to observe without influencing participant behavior (Correct answer)
Record sessions without participant consent

Correct answer: Allow stakeholders to observe without influencing participant behavior

The one-way mirror lets stakeholders and team members watch the session live without being visible to the participant, preventing observer influence on behavior.

Question 3: What is the recommended maximum number of tasks for a 60-minute usability session?

2–3
15–20
25–30
5–8 (Correct answer)

Correct answer: 5–8

Five to eight tasks typically fit within a 60-minute session while allowing sufficient think-aloud time and follow-up questions without fatiguing participants.

Question 4: What is 'purposive sampling' in usability testing recruitment?

Randomly selecting participants from the general population
Inviting participants who have previously tested similar products
Deliberately selecting participants who meet specific characteristics relevant to the study (Correct answer)
Sampling participants based solely on geographic location

Correct answer: Deliberately selecting participants who meet specific characteristics relevant to the study

Purposive sampling involves intentionally recruiting participants who possess the attributes that make their feedback most relevant to the research goals.

Question 5: When is remote unmoderated testing most appropriate to use?

When testing physical product prototypes
When exploring complex emotional responses to early-stage concepts
When you need rapid, quantitative data from a large and geographically diverse sample (Correct answer)
When participants have never used a computer before

Correct answer: When you need rapid, quantitative data from a large and geographically diverse sample

Remote unmoderated testing excels at gathering behavioral data from many participants quickly, making it ideal for benchmarking, measuring task completion rates, and reaching dispersed audiences.

Question 6: What incentive amount is generally considered appropriate for a one-hour usability session in the US?

$50–$150 (Correct answer)
$5–$10
$1–$3
$500–$1,000

Correct answer: $50–$150

US usability studies typically compensate participants $50–$150 per hour, varying by audience expertise and recruiting difficulty.

Question 7: What is a 'back-channel' in moderated usability testing?

A secondary recording system used as a backup
A communication channel (e.g., chat or earpiece) that allows observers to send questions to the moderator without disrupting the session (Correct answer)
An alternate login route used for remote session access
A private conversation between the participant and a note-taker

Correct answer: A communication channel (e.g., chat or earpiece) that allows observers to send questions to the moderator without disrupting the session

A back-channel allows observers to flag questions or points of interest to the moderator without interrupting the session flow or alerting the participant.

Question 8: What is 'learnability' as a usability metric?

How quickly new users can achieve proficiency with the product on first or repeated use (Correct answer)
The ease with which users remember how to use the product after a gap
How well the product teaches users about its features through onboarding
The number of training sessions required before users can use the product

Correct answer: How quickly new users can achieve proficiency with the product on first or repeated use

Learnability measures how rapidly performance improves as users gain experience with the product, often tracked via task time or error rate across multiple sessions.

Question 9: What is a 'lostness metric' in usability research?

The number of help requests a participant makes during a task
A measure of how much a participant's navigation deviates from the optimal path through a website (Correct answer)
A measure of how often participants get distracted by off-task content
A self-reported rating of how confused a participant felt

Correct answer: A measure of how much a participant's navigation deviates from the optimal path through a website

Lostness quantifies navigation disorientation by comparing the number of nodes visited and revisited against the optimal path length.

Question 10: Which of the following is a popular tool for creating and conducting usability tests?

UserTesting (Correct answer)
QuickBooks
Google Ads
Slack

Correct answer: UserTesting

UserTesting is a well-known and widely used platform specifically designed to facilitate the creation and execution of usability tests. It connects researchers with a global panel of participants, records their interactions, and provides tools for analysis, making it a popular choice for gathering user feedback on products and designs. The other options are not primarily usability testing platforms.

Question 11: What type of observation involves the researcher actively interacting with participants during the test?

Remote observation
Unstructured observation
Passive observation
Moderated observation (Correct answer)

Correct answer: Moderated observation

Moderated observation involves a researcher or facilitator actively present during the user test, guiding participants through tasks, asking follow-up questions, and interacting with them. This allows for real-time clarification and deeper qualitative insights into user behavior and thought processes. Passive or unstructured observations typically involve less direct interaction.

Question 12: What is the purpose of an accessibility audit before usability testing?

To certify that a product fully complies with all applicable laws
To replace usability testing for users with disabilities
To identify and document existing accessibility violations so they can be prioritized and fixed or noted as testing limitations (Correct answer)
To train the research team on how to recruit participants with disabilities

Correct answer: To identify and document existing accessibility violations so they can be prioritized and fixed or noted as testing limitations

An audit using automated tools and manual review establishes the baseline of known issues, helping teams decide what to fix before testing and what to document as study limitations.

Question 13: Which tool would you use to gather feedback directly from users after testing a product?

Google Analytics
Crazy Egg
SurveyMonkey (Correct answer)
Trello

Correct answer: SurveyMonkey

SurveyMonkey is a widely recognized and utilized tool specifically designed for creating, distributing, and analyzing surveys. After user testing, it would be an ideal platform to gather structured feedback, opinions, and satisfaction ratings from participants efficiently. The other options are for analytics, heatmaps, or project management, not direct survey collection.

Question 14: Which testing method is most appropriate when you need to study how users interact with a product in their natural, everyday environment?

Card sorting
In-person lab testing
Remote unmoderated testing
Contextual inquiry (Correct answer)

Correct answer: Contextual inquiry

Contextual inquiry places researchers in the user's real environment to observe natural usage patterns and uncover context-specific behaviors that lab settings cannot replicate.

Question 15: Which type of tool is best suited for conducting remote usability testing?

Heatmap generators
Video conferencing platforms (Correct answer)
Eye-tracking software
A/B testing platforms

Correct answer: Video conferencing platforms

Video conferencing platforms are essential for conducting remote usability testing as they enable facilitators to observe users' screens, hear their verbal feedback, and interact with them in real-time, regardless of geographical location. This simulates an in-person moderated test environment remotely, allowing for observation and communication. Other tools serve different, complementary purposes.

Question 16: What should a recruitment confirmation email include to ensure participants are prepared?

The names and photos of the moderator and observers
Detailed descriptions of the prototype or product being tested
The full list of usability problems expected to be found
Session date, time, location or link, what to bring, and what to expect (Correct answer)

Correct answer: Session date, time, location or link, what to bring, and what to expect

A comprehensive confirmation email reduces confusion, increases show rates, and sets appropriate expectations without biasing participants.

Question 17: What is a key characteristic of a good user testing participant?

They have extensive experience with usability testing
They represent the actual target audience for the product (Correct answer)
They are available at the lowest cost
They work in the UX or design field

Correct answer: They represent the actual target audience for the product

Valid usability findings depend on recruiting participants who reflect the real users of the product in demographics, behavior, and experience level.

Question 18: What is 'active listening' in the context of moderation?

Asking participants to repeat themselves to ensure accuracy
Giving full attention to participants, using neutral acknowledgment, and reflecting their statements back to encourage elaboration (Correct answer)
Taking detailed notes while participants speak without making eye contact
Nodding enthusiastically to show agreement with participant feedback

Correct answer: Giving full attention to participants, using neutral acknowledgment, and reflecting their statements back to encourage elaboration

Active listening in moderation means fully attending to participants and using neutral responses that encourage them to elaborate without steering their thoughts.

Question 19: How many screening questions is it generally best practice to limit a screener to?

1–2 questions to keep recruitment fast
As many as needed regardless of length
25–30 detailed questions to maximize screening accuracy
5–10 focused questions to avoid fatiguing candidates before the study even begins (Correct answer)

Correct answer: 5–10 focused questions to avoid fatiguing candidates before the study even begins

Keeping screeners to 5–10 targeted questions maintains candidate engagement and reduces dropout during the screening process.

Question 20: What is 'top task analysis' as an input to usability test design?

Ranking interface tasks by visual hierarchy on the screen
Evaluating tasks based on how much development effort they require
Analyzing the most error-prone tasks found in a previous study
Identifying the small set of tasks users perform most frequently that should be prioritized in testing (Correct answer)

Correct answer: Identifying the small set of tasks users perform most frequently that should be prioritized in testing

Top task analysis uses surveys or analytics to identify the ~20% of tasks users perform ~80% of the time, ensuring testing effort targets what matters most.

Question 21: What is the primary function of a prototyping tool in user testing?

To conduct A/B tests on live websites
To gather feedback from surveys
To analyze user behavior
To create interactive designs for testing (Correct answer)

Correct answer: To create interactive designs for testing

The primary function of a prototyping tool in user testing is to create interactive, clickable mockups or simulations of a product's interface. These prototypes allow users to interact with a design as if it were a real product, enabling designers to test usability and gather feedback on functionality and flow before significant development resources are invested.

Question 22: What is a 'customer journey map' and how does it relate to usability testing?

A map of geographic locations where users test the product
A visualization of user steps, emotions, and touchpoints that helps scope usability test tasks (Correct answer)
A technical diagram of server requests during a user session
A chart showing how many users visited each page before testing

Correct answer: A visualization of user steps, emotions, and touchpoints that helps scope usability test tasks

Journey maps outline user stages, goals, and pain points across a product experience, helping researchers identify which stages most need usability investigation.

Question 23: What is an incentive in the context of user research participant recruitment?

A reward given to the research team for finding participants quickly
A bonus paid to participants who complete all tasks successfully
A discount offered to participants on the product being tested
Compensation provided to participants for their time and effort (Correct answer)

Correct answer: Compensation provided to participants for their time and effort

Incentives are compensation — such as cash, gift cards, or vouchers — given to participants to thank them for their time and encourage participation.

Question 24: What is 'color contrast ratio' and why does it matter in usability testing?

A metric measuring how colorful a design is compared to competitors
The number of colors used in the interface design
The luminance difference between foreground text and background, affecting readability for low-vision users (Correct answer)
The variety of color themes available in user settings

Correct answer: The luminance difference between foreground text and background, affecting readability for low-vision users

WCAG requires minimum contrast ratios (4.5:1 for normal text) to ensure text is legible for users with low vision or color vision deficiencies.

Question 25: What is 'affinity diagramming' used for in usability research analysis?

Creating visual wireframes from participant feedback
Scheduling follow-up interviews after initial data collection
Grouping qualitative observations into themes to identify patterns across sessions (Correct answer)
Calculating statistical significance of quantitative usability metrics

Correct answer: Grouping qualitative observations into themes to identify patterns across sessions

Affinity diagramming organizes raw observations, quotes, and notes into thematic clusters, revealing patterns and priorities across multiple sessions.

Question 26: Which is a significant limitation of in-person laboratory usability testing?

It prevents researchers from asking follow-up questions
It cannot record participant audio
The artificial lab environment may cause participants to behave differently than they would at home or work (Correct answer)
It only supports testing with five or fewer participants

Correct answer: The artificial lab environment may cause participants to behave differently than they would at home or work

The formal lab context can introduce social desirability bias and performance anxiety, leading participants to behave more carefully than they would in their natural setting.

Question 27: What is the key purpose of an eye-tracking tool in user testing?

To track users' gaze patterns on a screen (Correct answer)
To analyze participant emotions
To measure task completion time
To identify usability errors

Correct answer: To track users' gaze patterns on a screen

The key purpose of an eye-tracking tool is to precisely measure and record where users are looking on a screen, how long they fixate on certain elements, and their overall gaze path. This provides valuable insights into visual attention, information hierarchy, and discoverability, helping to understand what draws a user's eye and what they might be missing.

Question 28: What is the purpose of 'triangulation' in usability research analysis?

Applying three different severity ratings to each usability issue
Comparing data from three separate usability tests
Recruiting three types of participants with different expertise levels
Using multiple data sources or methods to cross-validate findings and increase confidence in conclusions (Correct answer)

Correct answer: Using multiple data sources or methods to cross-validate findings and increase confidence in conclusions

Triangulation strengthens research validity by converging findings from multiple sources (e.g., observation, surveys, analytics) to confirm conclusions.

Question 29: Which research method involves observing users in their natural environment without a lab setting?

Card sorting
Lab usability test
Field study (Correct answer)
Heuristic evaluation

Correct answer: Field study

Field studies observe users in their natural environment, capturing real-world context and behavior.

Question 30: What is a 'cognitive walkthrough' and how does it differ from a usability test?

A cognitive walkthrough is an expert evaluation simulating a novice user's thought process step-by-step, without real users (Correct answer)
A cognitive walkthrough is a usability test where participants verbalize thoughts aloud
A cognitive walkthrough uses eye-tracking to map cognitive load across the interface
A cognitive walkthrough requires participants to complete tasks from memory without seeing the interface

Correct answer: A cognitive walkthrough is an expert evaluation simulating a novice user's thought process step-by-step, without real users

A cognitive walkthrough is an expert inspection method where evaluators step through tasks asking 'would a new user know what to do here?' — no real participants are involved.

Question 31: Which task type is BEST for evaluating the information architecture of a website?

Aesthetic preference task
Tree test task (Correct answer)
Cognitive walkthrough task
Exploratory task

Correct answer: Tree test task

Tree tests present participants with a text-only hierarchy and ask them to find specific items, isolating IA problems from visual design influences.

ISTQB Certified Tester - Usability Testing (CT-UT)

The ISTQB CT-UT certification validates expertise in planning, conducting, and analyzing usability tests, covering usability principles, test design, participant management, metrics analysis, and accessibility evaluation for software testing professionals.

Questions

35 min

Time Limit

65%

To Pass

Checking for saved progress...

Exam Rules

You can skip questions and return to them later
Flag questions for review before submitting
No feedback shown until you submit the entire exam
Unanswered questions count as wrong — answer everything
10 pretest questions are mixed in and don't affect your score
Timer auto-submits when time runs out
Your progress is auto-saved every 30 seconds