UX Survey Design and Quantitative Research 2 — Questions and Answers
Question 1: What is the key difference between ordinal and interval data scales?
- Ordinal data has categories; interval data has a true zero
- Ordinal data has ranked categories without equal intervals; interval data has equal intervals between values (Correct answer)
- Ordinal data is numerical; interval data is categorical
- Ordinal data is collected via surveys; interval data via observation
Correct answer: Ordinal data has ranked categories without equal intervals; interval data has equal intervals between values
Ordinal data ranks categories but doesn't guarantee equal spacing between them, while interval scales have consistent, equal intervals between values, enabling more powerful statistical analysis.
Question 2: What does a p-value below 0.05 indicate in quantitative UX research?
- The effect size is large enough to be practically meaningful
- The sample size is adequate for the study
- The result is statistically significant at the 95% confidence level (Correct answer)
- The survey had high response quality and low dropout
Correct answer: The result is statistically significant at the 95% confidence level
A p-value below 0.05 means there is less than a 5% probability the result occurred by chance, meeting the conventional threshold for statistical significance.
Question 3: What is the Net Promoter Score (NPS) primarily used to measure?
- Task completion rate in usability tests
- Customer loyalty and likelihood to recommend (Correct answer)
- Time-on-task efficiency during product use
- Error frequency during product interactions
Correct answer: Customer loyalty and likelihood to recommend
NPS measures customer loyalty by asking how likely respondents are to recommend a product or service on a 0-10 scale, categorizing them as Promoters, Passives, or Detractors.
Question 4: What is a double-barreled question in survey design?
- A question with exactly two answer options
- A question that asks about two different things simultaneously (Correct answer)
- A question that is repeated twice for validation purposes
- A question that always follows another related question
Correct answer: A question that asks about two different things simultaneously
A double-barreled question asks about two distinct issues at once, making it impossible to determine which part of the question the respondent is answering.
Question 5: What is the primary purpose of using a screener survey before a UX study?
- To train participants on how to use the product
- To filter and recruit participants who meet specific study criteria (Correct answer)
- To collect baseline satisfaction data before testing begins
- To measure participants' prior experience with completing surveys
Correct answer: To filter and recruit participants who meet specific study criteria
Screener surveys ensure that only qualified participants who match the target user profile are recruited, improving the validity and relevance of study findings.
Question 6: Which statistical measure is most appropriate for understanding central tendency in ordinal survey data?
- Mean
- Standard deviation
- Median (Correct answer)
- Variance
Correct answer: Median
The median is most appropriate for ordinal data because it doesn't assume equal intervals between values, unlike the mean which requires interval or ratio-level data.
Question 7: What does 'sample representativeness' mean in quantitative UX research?
- The sample is large enough to achieve statistical validity
- The sample accurately reflects the key characteristics of the target user population (Correct answer)
- All participants completed the survey correctly and without errors
- The sample was randomly selected from an online panel
Correct answer: The sample accurately reflects the key characteristics of the target user population
A representative sample mirrors the key characteristics of the target population, ensuring that findings can be meaningfully generalized beyond the study participants.
UX Survey Design and Quantitative Research 2
What is the key difference between ordinal and interval data scales?