RCA Quality Assurance Programs 3 — Questions and Answers
Question 1: In a Relativity QA program, what is the significance of establishing a 'gold standard' document set?
- It speeds up Analytics indexing
- It provides a benchmark of correctly coded documents to calibrate reviewer accuracy (Correct answer)
- It automatically generates privilege logs
- It defines the production output format
Correct answer: It provides a benchmark of correctly coded documents to calibrate reviewer accuracy
A gold standard set contains definitively coded documents used to measure and calibrate how accurately reviewers are coding relative to the established standard.
Question 2: Which Relativity Analytics feature can supplement a manual QA program by identifying conceptually similar documents that were coded differently?
- Email threading
- Conceptual analytics / clustering (Correct answer)
- Structured analytics set deduplication
- OCR processing
Correct answer: Conceptual analytics / clustering
Conceptual clustering groups documents by topic, making it easy to spot inconsistent coding across conceptually similar documents.
Question 3: What is 'elusion testing' in the context of a Relativity QA or TAR workflow?
- Testing whether custodians are hiding documents
- Sampling documents predicted non-responsive to verify none were incorrectly excluded (Correct answer)
- Running a second pass on all responsive documents
- Testing the speed of the review platform
Correct answer: Sampling documents predicted non-responsive to verify none were incorrectly excluded
Elusion testing samples documents predicted or coded as non-responsive to verify that the recall rate is acceptable and no responsive documents were missed.
Question 4: When setting up a QC workflow for privilege review in Relativity, which field type is most critical to include in the layout?
- Date Sent
- Privilege basis field (e.g., Attorney-Client, Work Product) (Correct answer)
- File size
- Custodian email domain
Correct answer: Privilege basis field (e.g., Attorney-Client, Work Product)
The privilege basis field captures the legal basis for withholding a document, which is essential for generating accurate privilege logs and defending QC decisions.
Question 5: In Relativity, what is the recommended practice when a QC sample reveals an error rate above the acceptable threshold?
- Close the batch and produce anyway
- Stop the batch, remediate affected documents, retrain reviewers, and re-sample (Correct answer)
- Increase the production volume to offset errors
- Archive the batch and start a new one
Correct answer: Stop the batch, remediate affected documents, retrain reviewers, and re-sample
An error rate above threshold requires stopping the batch, fixing miscoded documents, retraining reviewers, and running a new QC sample to confirm the issue is resolved.
Question 6: Which Relativity workspace object is typically used to track QC decisions separately from primary review decisions?
- A separate matter workspace
- Additional single-choice or fixed-length text fields designated for QC coding (Correct answer)
- A new custodian record
- A separate Analytics index
Correct answer: Additional single-choice or fixed-length text fields designated for QC coding
QC decisions are typically stored in dedicated fields (e.g., QC Responsiveness, QC Privilege) so they can be compared to primary coding without overwriting original decisions.
Question 7: What is the primary difference between 'pre-production QC' and 'post-production QC' in an eDiscovery workflow?
- Pre-production QC happens after documents are handed to opposing counsel
- Pre-production QC catches errors before delivery; post-production QC audits what was already produced (Correct answer)
- Post-production QC is faster because it uses automation
- There is no meaningful difference between the two
Correct answer: Pre-production QC catches errors before delivery; post-production QC audits what was already produced
Pre-production QC is a quality gate before delivery, while post-production QC reviews what has already been sent, making it harder to correct errors without formal disclosures.
RCA Quality Assurance Programs 3
In a Relativity QA program, what is the significance of establishing a 'gold standard' document set?