RCA Quality Assurance Programs 2 — Questions and Answers
Question 1: In Relativity, what is the primary purpose of running a QC sample on a review batch?
- To test reviewer speed
- To statistically validate coding accuracy before batch completion (Correct answer)
- To generate privilege logs automatically
- To populate the review queue faster
Correct answer: To statistically validate coding accuracy before batch completion
QC sampling validates that reviewers are coding documents accurately at a statistically defensible rate before a batch is finalized.
Question 2: Which Relativity feature lets administrators define coding decisions that automatically flag documents for secondary review?
- Review Center batch sets
- Quality Review rules in Review Center (Correct answer)
- Analytics clustering
- Document exclusion filters
Correct answer: Quality Review rules in Review Center
Quality Review rules in Review Center allow admins to specify conditions (e.g., certain field values) that automatically route documents to a QC queue.
Question 3: When configuring a QC sample size, which statistical concept determines how many documents must be reviewed to achieve a desired confidence level?
- Standard deviation
- Confidence interval and margin of error (Correct answer)
- Mean absolute error
- Recall rate
Correct answer: Confidence interval and margin of error
Confidence interval and margin of error together determine the sample size needed to draw statistically valid conclusions about the full population.
Question 4: What does a 'second pass' QC workflow in Relativity typically involve?
- Re-ingesting documents from the source
- Having a senior reviewer recode a random sample of completed documents (Correct answer)
- Running an Analytics job on all review decisions
- Rebuilding the review batch set from scratch
Correct answer: Having a senior reviewer recode a random sample of completed documents
A second pass QC workflow has a senior or QC reviewer recode a random sample to compare decisions against the primary reviewer's coding.
Question 5: In Relativity's Review Center, which metric is most useful for identifying reviewers with abnormally high error rates during QC?
- Documents reviewed per hour
- QC error rate by reviewer (Correct answer)
- Batch set completion percentage
- Number of hot documents flagged
Correct answer: QC error rate by reviewer
The QC error rate by reviewer directly shows which reviewers are making coding mistakes at a rate that warrants intervention or retraining.
Question 6: When a QC reviewer disagrees with a primary reviewer's coding in Relativity, what is the standard next step under most QA protocols?
- The primary reviewer's decision always stands
- The document is escalated to a senior attorney or adjudicator for a final decision (Correct answer)
- The document is automatically marked as non-responsive
- The batch is deleted and restarted
Correct answer: The document is escalated to a senior attorney or adjudicator for a final decision
Disputed documents are typically escalated to a senior reviewer or legal team lead who makes the final adjudication.
Question 7: Which Relativity report would an administrator use to track how many documents were overturned during the QC process?
- Billing Statistics report
- QC Overturn report or custom saved search on QC fields (Correct answer)
- User Activity report
- Custodian statistics dashboard
Correct answer: QC Overturn report or custom saved search on QC fields
A QC Overturn report or saved search filtering on QC decision fields shows which documents had their original coding changed during quality control.
RCA Quality Assurance Programs 2
In Relativity, what is the primary purpose of running a QC sample on a review batch?