CCIL Laboratory Proficiency Testing and Correlation Programs — Questions and Answers
Question 1: What is the primary purpose of participating in an inter-laboratory proficiency testing (PT) program?
- To compare equipment purchase costs between laboratories
- To evaluate a laboratory's performance by comparing its test results against those of other participating laboratories using the same reference material (Correct answer)
- To certify that a laboratory's technicians have passed written examinations
- To determine the chemical composition of reference materials
Correct answer: To evaluate a laboratory's performance by comparing its test results against those of other participating laboratories using the same reference material
Proficiency testing programs provide an objective, external measure of a laboratory's measurement performance. Each participant tests an identical or homogeneous material and submits results; the program coordinator statistically compares all results to identify laboratories with systematic bias or poor precision. ISO/IEC 17025 requires accredited laboratories to participate in PT programs relevant to their scope.
Question 2: In a proficiency testing program, what does a Z-score of +3.2 indicate about a laboratory's result?
- The result is within acceptable performance limits
- The result is 3.2 standard deviations above the assigned reference value, flagging a potential systematic positive bias (Correct answer)
- The result is 3.2 percent higher than the laboratory's own historical average
- The laboratory completed 3.2 replicate measurements
Correct answer: The result is 3.2 standard deviations above the assigned reference value, flagging a potential systematic positive bias
A Z-score = (x - X) / σ, where x is the laboratory's result, X is the assigned reference value, and σ is the standard deviation of the PT scheme. |Z| ≤ 2 is satisfactory, 2 < |Z| ≤ 3 is a warning (questionable performance), and |Z| > 3 is an action signal indicating statistically significant deviation requiring investigation and corrective action.
Question 3: When a laboratory receives an unsatisfactory Z-score result from a proficiency test, what is the required first step under ISO/IEC 17025?
- Immediately withdraw from the PT program and stop testing
- Conduct a root cause investigation and document corrective actions to address the identified deficiency (Correct answer)
- Average the unsatisfactory result with the previous satisfactory result
- Request that the PT provider discard the result as an outlier
Correct answer: Conduct a root cause investigation and document corrective actions to address the identified deficiency
ISO/IEC 17025 (clause 7.7 and 8.7) requires that when nonconforming work or unsatisfactory PT results are identified, the laboratory must conduct a root cause analysis to determine why the deviation occurred (e.g., equipment fault, technician error, sample handling issue) and implement corrective actions to prevent recurrence. The investigation and actions must be documented.
Question 4: What is the En (Normalized Error) ratio used for in proficiency testing?
- To normalize results across different units of measurement
- To assess laboratory performance when both the laboratory's uncertainty and the reference value uncertainty are known (Correct answer)
- To calculate the number of repeat tests required for a statistically valid result
- To convert between Celsius and Fahrenheit in temperature-dependent tests
Correct answer: To assess laboratory performance when both the laboratory's uncertainty and the reference value uncertainty are known
The En ratio = (x - X) / √(U²lab + U²ref), where U values are the expanded uncertainties of the laboratory result and the reference value. |En| ≤ 1.0 indicates satisfactory performance. The En ratio is preferred over Z-scores when measurement uncertainty values are available, as it accounts for the uncertainty of both the participant's result and the reference value.
Question 5: In CCIL's correlation testing program for asphalt or concrete laboratories, what is the primary distinction from typical PT programs?
- Correlation testing uses computer simulations instead of physical samples
- Participants test the same physical materials using standardized procedures, focusing on technician proficiency and equipment performance within the CCIL network (Correct answer)
- Correlation testing evaluates only new laboratories, not established ones
- Results from CCIL correlation tests are not used for accreditation decisions
Correct answer: Participants test the same physical materials using standardized procedures, focusing on technician proficiency and equipment performance within the CCIL network
CCIL's correlation (round-robin) testing programs circulate common physical samples (e.g., aggregate, asphalt mixtures, concrete) among member laboratories. The goal is to identify sources of between-laboratory variability, verify that technicians are following standardized CSA/ASTM/AASHTO procedures correctly, and ensure that equipment is properly calibrated and maintained — directly supporting CCIL's inspection and accreditation process.
Question 6: What is 'between-laboratory reproducibility' in the context of proficiency testing, and why does it matter for CCIL-certified labs?
- The ability of one technician to reproduce results using different equipment in the same lab
- The variation in test results for the same material obtained by different laboratories, used to set acceptance limits for PT programs (Correct answer)
- The reproducibility of calibration records across inspection cycles
- The degree to which a lab's results match its own historical average over time
Correct answer: The variation in test results for the same material obtained by different laboratories, used to set acceptance limits for PT programs
Between-laboratory reproducibility (R) is the maximum acceptable difference between results obtained by two different properly equipped laboratories following a standard test method on the same material. PT program acceptance limits (and Z-score σ values) are often set based on published reproducibility values from standard test methods (e.g., ASTM precision statements). CCIL-certified labs are expected to perform within these published method precision limits.
What is the primary purpose of participating in an inter-laboratory proficiency testing (PT) program?