The use of QCMD proficiency testing panels in clinical virology.

Transcription

1 The use of QCMD proficiency testing panels in clinical virology. Prof.dr. Bert Niesters Department of Medical Microbiology Division of Clinical Virology UMC Groningen

2 Disease Disease Management Viral Load

3 Under requirements of ISO ISO (Medical laboratories Particular requirements for quality and competence) 5.6.4: The laboratory shall participate in inter-laboratory comparisons. The laboratory shall monitor the results. Inter-laboratory comparison programs shall be in substantial agreement with ISO/IEC Guide 43-1.

4 QA & QC within the Clinical Diagnostic Laboratory New method Establish Performance Assay Verification Assay Validation Verify method Method Equivalence Characterised Quality reagents Certification Accreditation Validate/verify Performance Quality Improvements Quality Management System Assay Implementation Implement method Method Maintenance Perform Clinical tests Internal QC Report Results EQA (PT) Internal QA

5 What do I need for my laboratory Get birds eye view about my own performance With statistical analysis of results Composition determined by scientific experts working in my field Have a challenging component Include different serotypes / genotypes Have information of performance of related technologies Short reporting time 4-6 weeks Access to scientific experts Opportunity for lab pairing and mentoring

6 Feedback to me as laboratory director

7 EQA Individual report Aim is to provide personalised feedback to each participant My results and scores Ability to gauge my performance in relation to the rest of the participants in the final report

8 QCMD EQA scoring system qualitative Sam ple status Participant's result Negative Not determ ined Positive Frequently detected Detected Infrequently detected Negative The scores awarded for qualitative data are based on the sample status where 0 is 'highly satisfactory' and 3 is 'highly unsatisfactory'. Colour has been included as an extra visual aid.

9 QCMD EQA scoring system quantitative Based on distance from the consensus (log 10 mean) Two consensuses overall and by technology type 0 points = up to one sd 1 point = one to two sd 2 points = two to three sd points = three or more sd

10 Qualitative data scoring Core sample Core sample Core sample Core sample Detected Core sample Core sample Detected Core sample Negative

11 Qualitative data scoring

12 Quantitative data scoring

13 Quantitative data scoring

14

15 What are blood borne pathogens? The potential standards hit list Classical targets: HIV-1*** Hepatitis B virus** Hepatitis C virus*** Cytomegalovirus* Epstein-Barr virus B19 virus* Clinical relevant targets: BK (JC) virus HSV type 1 HHV type 6 Adenovirus Hepatitis A virus* Hepatitis E virus, genotype 3 Genotyping panels for different targets (HIV-1, HBV, HCV to start with) *WHO standards available

16 Units used for reporting HCV, HIV-1 and HBV viral load results in EQA distributions % Geq/ml Meg/ml 90% 80% pg/ml IU/ml Geq/ml 70% 60% 50% IU/ml HCV HIV HBV 40% Copies/ml Copies/ml 30% 20% 10% Copies/ml 0%

17 Units used for reporting HCV, HIV-1 and HBV viral load results in EQA distributions 2002 & % Geq/ml Meg/ml 90% 80% pg/ml IU/ml Geq/ml 70% 60% 50% IU/ml HCV HIV HBV 40% Copies/ml Copies/ml 30% 20% 10% Copies/ml 0%

18 1.00 Maximum & Minimum SD ranges reported within the BBV EQA programmes since HBV HCV HIV

19 Need for Reference Materials: Precision of Molecular Assays Virus International Standard SD range of geometric mean (log10) % of commercial assays HIV Y > 95% HCV Y > 95% HBV Y ~ 50% BKV N ~ 30% HSV N < 15% EV N >1.0 < 10%

20 Percentage positive results Strain variation y = 38.19x R² = y = 39.48x R² = Type A/G Type C Linear (Type A/G) Linear (Type C) Log10 Copies/ml

21 Technology Consensus (Log10 Copies/ml) Technology variation Results of the 2009 HSV EQA (HSV-1) Real time Commercial PCR y = x R² = Real time In-house PCR y = x R² = Consensus (log10 Copies/ml)

22 Technology Consensus (log10 Copies/ml) Technology variation Results of the 2009 HHV6 EQA (HHV6-B) y = 0.994x R² = Real time Commercial PCR Real time In-house PCR y = x R² = Consensus (log10 Copies/ml) The lines predicting the Technology Consensus values have significantly different intercepts (difference = 0.436, 95% CI to 0.568; p = ).

23 Quantitative accuracy/variation There is no such thing as a true gold standard in molecular diagnostics WHO supporting use of standardised international units (e.g for HIV-1) Still there is a (too) large variation on reported quantitative results

24 Quality Assurance in the clinical laboratory Internal Quality Assessment (IQA) Internal Quality Control (IQC) External Quality Assessment (EQA) Accreditation Quality Management system (QMS) Staff training (CPD) Certification Equipment & Process Monitoring Internal & External Audit Foundations in clinical chemistry: Belk and Sunderman 1950s

25 Quality assurance in molecular diagnostics: Conclusions Rapidly moving field, new technologies, new assays, high expectations In some cases the technology still has to prove itself in the clinical setting External and internal quality assessment improves molecular diagnostic methods. What is appropriate for one lab may not be for another. Education and training in quality tools is essential, but out of the scope of EQA.

26 How can Proficiency Testing EQA support laboratory quality? Monitor the performance of laboratory testing process. Allow comparison to other laboratories. Assist in identification of potential testing problems. Performance of multiple labs, helps identify quality issues that were not noticed in individual labs. Complements the clinical laboratory s Quality Assurance System (regulatory requirements). Cover clinically relevant targets and developing targets (including genetic variations). Educate participants in quality assurance issues.

27