DEFINITIVE GLOBAL ANNUAL REPORT Molecular Biology Microbiology 2015

Transcription

1 EXPERTISE, SERVICE PROVISION AND CUSTOMER RELATIONS QUALITY OF MEDICAL LABORATORIES CLINICAL BIOLOGY COMMISSION COMMITTEE OF EXPERTS EXTERNAL QUALITY ASSESSMENT IN CLINICAL BIOLOGY DEFINITIVE GLOBAL ANNUAL REPORT Molecular Biology Microbiology 2015 IPH/Molecular Biology/Microbiology/8 Expertise, service provision and customer relations Quality of medical laboratories J. Wytsmanstreet, Brussels Belgium

2 ISSN: COMMITTEE OF EXPERTS IPH (secretariat) TEL: FAX: Survey coordinator: Bernard China Substitute survey coordinator: Kris Vernelen Experts: TEL: TEL: Name Institution Dr. Hans de Beenhouwer O.L.V. Ziekenhuis, Aalst Dr. Nicolas Hougardy Clinique Sud Luxembourg, Arlon Dr. Greet Ieven UZA, Antwerpen Dr. Koen Magerman Virga Jesse Ziekenhuis, Hasselt Dr. Marjan Van Esbroeck ITM, Antwerpen Dr. Marijke Reynders AZ sint Jan, Brugge Dr. Ina Benoy Labo Lokeren Committee of experts: 24/06/2016 Authorisation to release report: By Bernard China, Survey coordinator, 28/06/ /36 FORM 43/125/E V6

3 TABLE OF CONTENTS INTRODUCTION... 5 I. THE BACTERIA CHLAMYDIA TRACHOMATIS AND NEISSERIA GONORRHEAE THE SAMPLES CHLAMYDIA TRACHOMATIS Proficiency per sample Summary of the results scoring of the laboratories Comparison of the used methods DETECTION OF NEISSERIA GONORRHOEAE Proficiency per sample Summary of the results Scoring of the laboratories Proficiency per method MYCOBACTERIUM TUBERCULOSIS The samples Proficiency per sample Scores of the laboratories Proficiency per method II. THE VIRUSES VARICELLA-ZOSTER VIRUS The samples Proficiency per sample Scores of the laboratories Proficiency per method ENTEROVIRUSES The samples Proficiency per sample Scores of the laboratories Proficiency per method HERPES SIMPLEX VIRUS The samples Proficiency per sample FORM 43/125/E V6 3/36

4 3.3. Scores of the laboratories Proficiency per method HEPATITIS B VIRUS The samples Proficiency per sample : qualitative results Score per laboratory Methods Quantitative results HEPATITIS C VIRUS The samples Proficiency per sample Score per laboratory Methods Quantitative results HCV GENOTYPING The samples Proficiency per sample Methods HIGH RISK PAPILLOMAVIRUS The samples Results per sample Scores of the labs Proficiency per method III. PARASITES TOXOPLASMA GONDII IN AMNIOTIC FLUID The samples Proficiency per sample Score per laboratory Proficiency per method CONCLUSIONS FORM 43/125/E V6 4/36

5 INTRODUCTION In 2015, in the molecular microbiology domain the same surveys as previous years were organized. The survey corresponded to the parameters of article 24 (N. gonorrhoeae, qualitative HCV, M. tuberculosis, Chlamydia trachomatis) and 24 bis (quantitative HCV, HCV genotyping, HBV, enterovirus, HSV, VZV, Toxoplasma gondii) of the INAMI/RIZIV nomenclature. In 2015, the samples for the Chlamydia trachomatis, Neisseiria gonorrhoeae and Toxoplasma gondii were produced by the IPH. The other samples were provided by QCMD ( performing also the data collection and the data treatment. For each parameter a panel of samples was sent. The panels include negative, strong positive or frequently detected, positive or detected, weak positive or infrequently detected samples (table Int. 1). Table Int.1. Sample type and associated score Sample type Scoring Negative Strong positive/frequently detected (>95%) Positive/detected (65<X<95%) Weak positive/ infrequently detected (<65%) 0 if success, 3 if failing 0 if success, 3 if failing 0 if success, 2 if failing 0 if success, 1 if failing Each result is associated with a score. In case of correct answer, the score was 0. In case of wrong answer the score depended of the sample type. For a negative sample or for a strong positive sample, a score of 3 was attributed to a wrong result. For a positive sample a score of 2 was attributed to a wrong result. Finally for a weak positive sample a score of 1 was attributed to a wrong result. Therefore, the lower the score of a lab the better it is. Moreover, QCMD attributed a score of 3 for a non-determined result. This appears to us questionable since very often the laboratory has not the opportunity to repeat the assay in case of a technical problem. Therefore, the IPH decided to attribute no penalty for a not determined result. In 2015, 6 surveys were organized: Survey Datum parameters /02/2015 Neisseria gonorrhoeae and Chlamydia trachomatis /03/2015 Toxoplasma gondii /06/2015 Mycobacterium tuberculosis /06/2015 VZV-HSV-EV /07/2015 HCV-HBV-HCV genotyping /09/2015 High risk HPV FORM 43/125/E V6 5/36

6 I. THE BACTERIA 1. CHLAMYDIA TRACHOMATIS AND NEISSERIA GONORRHEAE 1.1. THE SAMPLES In 2015, a panel was constituted by IPH for the detection of C. trachomatis and N. gonorroheae in urine and swabs. C. trachomatis LG2 was produced by St Pierre Hospital Brussels and validated by the national reference centre (ITM, Antwerpen). N. Gonorrheae was produced by IPH and validated by the reference centre (ITM, Antwerpen). Table I.1. The samples sample Matrix* C. trachomatis N. gonorrheae BMM urine Negative Negative BMM urine Negative Frequently detected BMM urine Frequently detected Frequently detected BMM Urine Frequently detected Negative BMM Urine Frequently detected Frequently detected BMM Swabs Frequently detected Negative BMM Swabs Frequently detected Frequently detected BMM Swabs Frequently detected Frequently detected BMM Swabs Detected Frequently detected BMM Swabs Negative Negative *: For urine the bacteria were diluted in filtrated human urine (singe donor) and for swabs,the bacteria were diluted in m4rt transport medium. The number of participants was 59 among them 41 were accredited. FORM 43/125/E V6 6/36

7 1.2. CHLAMYDIA TRACHOMATIS PROFICIENCY PER SAMPLE The results of the proficiency per sample for the detection of C. trachomatis are shown on table I.2. Table I.2. Proficiency per sample sample Matrix Status Negative Positive ND comment BMM urine Negative ND BMM urine Negative false positive BMM urine Frequently detected OK BMM Urine Frequently detected false negative BMM Urine Frequently detected false negative BMM swabs Frequently detected OK BMM swabs Frequently detected OK BMM swabs Frequently detected OK BMM swabs Detected false negative 2 ND BMM swabs Negative ND The results are summarized in table I SUMMARY OF THE RESULTS Table I.3. Summary of the results. Result N (%) Total number 590 (100%) Correct answer 562 (95.3%) Wrong answer 28 (4.7%) False negative 17 (60.7%) False positive 5 (17.9%) Not determined 6 (21.4%) 59 series of results and 10 samples per series representing 590 encoded results. The number of correct answers was 562 out of 590 (95.3%). 17 false negative results were encoded especially for sample (15/17) which was a very low contaminated sample (<10 copies/ml). 5 false positive results and 6 not determined samples were encoded. FORM 43/125/E V6 7/36

8 SCORING OF THE LABORATORIES The minimum score was 0 in case of 100% of good results and the maximum score was 29 in case of 100% of wrong answers. 40 laboratories (67.8%) have a score of laboratories (22.0%) have a score of 2. 4 laboratories (6.8%) have a score of 3 1 laboratory (1.7%) has a score of 5 1 laboratory (1.7%) has a score of COMPARISON OF THE USED METHODS Table I.4. Proficiency comparison of the methods used for the detection of C. trachomatis in urine Method N total Good Results % FP FN ND Ranking 131.Bio-Rad Dx CT/NG/MG assay CT/NG Presto Artus CT/NG Abbott RealTime CT Abbott RealTime CT/NG Roche cobas 4800 CT/NG Test GenXpert CT/NG Artus C. trachomatis Plus PCR Kit Home made Realtime Diagenode CT/NG Real time PCR COBAS TaqMan CT Test v Rohe Amplicor CT/NG BD Probetec ET CT/GC/AC Amplified DNA Assay Total FN : false negative, FP : false positive FORM 43/125/E V6 8/36

9 Table I.5. proficiency per sample, per method and per laboratory Method Negative Negative FD FD FD FD FD FD D Negative ND ND 0 0 ND ND ND ND 0 FD: freqeduently detected, D: detect, ND: not determined FORM 43/125/E V6 9/36

10 1.3. DETECTION OF NEISSERIA GONORRHOEAE 57 Belgian laboratories encoded results PROFICIENCY PER SAMPLE Table I.6. Proficiency per sample. Sample Status Positive Negative ND Comment BMM Negative wrong result BMM Frequently Detected wrong result BMM Frequently Detected wrong result BMM Negative wrong results BMM Frequently Detected wrong results BMM Negative OK BMM Frequently Detected wrong result BMM Frequently Detected wrong result BMM Frequently Detected wrong results BMM Negative wrong results SUMMARY OF THE RESULTS. 57 laboratories and 10 samples representing 570 results. Table I.7. Summary of the results Results N (%) Correct answer 555 (97.4%) Wrong answer 15 ( 2.6%) False negative 4 (26.7%) False positive 3 (20.0%) Not determined 8 (53.3%) The number of correct results was 555 out of 570 (97.4%). 4 false negative results were encoded representing 1% of the expected positive results. 3 false positive results were encoded SCORING OF THE LABORATORIES The minimum score was 0 and the maximum score was laboratories (91.2%) obtained a ideal score of 0 4 laboratories (7.0%) obtained a score of 3 1 laboratory (1.8%) obtained a score of 9. FORM 43/125/E V6 10/36

11 Table I.8. proficiency per method Method N total Good Results % FP FN ND Ranking 203. Roche Amplicor CT/NG CT/NG Presto Roche cobas 4800 CT/NG Test BD Probetec ET CT/GC/AC Amplified DNA Assay Artus CT/NG Diagenode NG Real time PCR Home made Realtime Abbott RealTime CT/NG Bio-Rad Dx CT/NG/MG assay Xpert CT/NG TIB MolBiol N. gonorrhoeae Total N: number of participants, FP: false positive, FN: false negative, ND: not determined. FORM 43/125/E V6 11/36

12 PROFICIENCY PER METHOD Table I.9. Proficiency per method, per sample and per laboratory Method Neg FD FD Neg FD Neg FD FD FD Neg Score 102 ND ND ND 0 0 ND ND ND ND ND FORM 43/125/E V6 12/36

13 2. MYCOBACTERIUM TUBERCULOSIS The sample series included 5 samples, 3 cerebrospinal fluid samples and 2 sputum samples. 24 laboratories have encoded results THE SAMPLES Table I.10. Characteristics of the samples. Sample Matrix content Status MTB15-01 Synthetic CSF M. tuberculosis complex Frequently Detected MTB15-02 Synthetic CSF M. tuberculosis complex Detected MTB15-03 Synthetic sputum M. tuberculosis complex Frequently Detected MTB15-04 Synthetic sputum M. Xenopi Negative MTB15-05 Synthetic CSF No Mycobacterium Negative 2.2. PROFICIENCY PER SAMPLE Table I.11. Proficiency per sample. Sample Status Positive Negative ND Comment MTB15-01 Frequently Detected OK MTB15-02 Detected wrong results MTB15-03 Frequently Detected OK MTB15-04 Negative wrong results MTB15-05 Negative OK 24 participants and 5 samples representing 120 results. 115 correct results were encoded (95.8%). FORM 43/125/E V6 13/36

14 2.3. SCORES OF THE LABORATORIES. The minimum score was 0 and the maximum score was Belgian laboratories obtained the ideal score of 0 and 2 laboratories obtained a score of PROFICIENCY PER METHOD Table I.12. proficiency per method, per sample and per laboratory. METHOD N MTB15-01 MTB15-02 MTB15-03 MTB15-04 MTB15-05 FD Detected FD Negative Negative BD Molecular Diagnostics 1 Cepheid Xpert kit ND 0 Conventional In-House PCR 1 PathoFinder Real Time PCR 1 Real-time In-House PCR 4 Roche Cobas Taqman ND ND 0 TIB-MolBiol LightMix FORM 43/125/E V6 14/36

15 II. THE VIRUSES 1. VARICELLA-ZOSTER VIRUS 18 Belgian laboratories encoded results THE SAMPLES Table II.1. Characteristic of the samples. Sample Matrix content Status VZV Transport Medium VZV strain 9/84 Frequently detected VZV Transport Medium VZV strain 9/84 Frequently detected VZV Transport Medium VZV strain Ellen Detected VZV Transport Medium VZV strain OKA Frequently detected VZV Transport Medium VZV negative Negative 1.2. PROFICIENCY PER SAMPLE Table II.2. Proficiency per sample Sample Status Positive Negative Comment VZV Frequently detected VZV Frequently detected VZV Detected wrong result VZV Frequently detected VZV Negative participants and 5 samples representing 90 results. The number of correct answers was 89 out of 90 (98.9%). 1 false negative result representing 1.4% of the expected positive results SCORES OF THE LABORATORIES The score can ranged from 0 to laboratories (94.4%) obtained the ideal score of 0. 1 laboratory (5.6%) obtained a score of 2 FORM 43/125/E V6 15/36

16 1.4. PROFICIENCY PER METHOD Table II.3a. Proficiency per method. N N results Good Results % FN FP Ranking Qiagen Artus VZV RG PCR Biomérieux HSV1 HSV2 VZV R-gene kit Diagenode VZVirus Real-Time PCR Realtime in house % 1 0 N : number of laboratories Table II.3b. Proficiency per method, per sample and per laboratory Method N VZV15-01 VZV15-02 BVZV15-03 VZV15-04 VZV15-05 FD FD Detected FD Negative biomerieux R-gene Quant Kit 7 Diagenode Real Time kit 1 Qiagen Artus Real Time 2 Real-time In-House PCR FORM 43/125/E V6 16/36

17 2.ENTEROVIRUSES 25 Belgian laboratories encoded results THE SAMPLES Table II.4. Characteristics of the samples. Sample Matrix Content Status EV15-01 Transport Medium Coxsackievirus B3 Frequently detected EV15-02 Transport Medium Coxsackievirus B4 Frequently detected EV15-03 Transport Medium Enterovirus 68 Frequently detected EV15-04 Transport Medium Enterovirus 71 Frequently detected EV15-05 Transport Medium EV negative Negative 2.2. PROFICIENCY PER SAMPLE Table II.5. Proficiency per sample. Sample Status Negative Positive Comment EV15-01 Frequently detected 0 25 OK EV15-02 Frequently detected 0 25 OK EV15-03 Frequently detected 0 25 OK EV15-04 Frequently detected 0 25 OK EV15-05 Negative 25 0 OK 25 participants and 5 samples representing 125 results. The number of correct answers was 125 out of 125 (100 %). The cumulative score can range from 0 to 15. All the laboratories obtained an ideal score of SCORES OF THE LABORATORIES FORM 43/125/E V6 17/36

18 2.4. PROFICIENCY PER METHOD The proficiency per method is listed in tables II.8 Table II.6. Proficiency per method KitType N N results N Good results % FN FP ranking Cepheid Xpert EV Biomerieux Enterovirus R-gene Realtime in house Total N: number of participants ; 3 : false positive ; 1 : false negative. FORM 43/125/E V6 18/36

19 3. HERPES SIMPLEX VIRUS 22 Belgian laboratories encoded results THE SAMPLES Table II.7. Characteristics of the samples. Sample Matrix Content Status HSV15-1 Transport Medium HSV1 HSV15-2 Transport Medium HSV1 HSV15-3 Transport Medium HSV2 HSV15-4 Transport Medium HSV2 HSV15-5 Transport Medium HSV negative Frequently detected Frequently Detected Detected Frequently Detected Negative 3.2. PROFICIENCY PER SAMPLE Table II.8. Proficiency per sample. Sample Status Negative Positive Comment HSV15-1 Frequently detected 0 22 OK HSV15-2 Frequently Detected 0 22 OK HSV15-3 Detected wrong result HSV15-4 Frequently Detected HSV15-5 Negative participants and 5 samples representing 110 results. The number of correct answers was 109 out of 110 (99.1%). 1 false negative result representing 1.1% of the expected positive results was encoded SCORES OF THE LABORATORIES The cumulative score can range from 0 to laboratories (95.4%) obtained an ideal score of 0 1 laboratory ( 4.6%) obtained a score of 2 FORM 43/125/E V6 19/36

20 3.4. PROFICIENCY PER METHOD The proficiency of the methods IS illustrated in tables II.9a and II.9b. Table II.9a. proficiency per method. KitType N N results N good results % FN FP Ranking Qiagen HSV-1/2 PCR Kit (RG) Realtime In house Abbott HSV 1/2 PCR Kit Biomérieux HSV1 HSV2 VZV R-gene kit Total % 1 0 N : number of participant Table II.9b. Proficiency per method, per sample and per participant Method N HSV15-01 HSV15-02 HSV15-03 HSV15-04 HSV15-05 FD FD Detected FD Negative Abbott Realtime 1 biomerieux R-gene Quant Kit Qiagen Artus Real Time 3 Real-time In-House PCR 12 FORM 43/125/E V6 20/36

21 4. HEPATITIS B VIRUS 20 laboratories encoded results. Table II.10. Characteristics of the samples THE SAMPLES Samples Matrix Content status HBV15-01 Plasma HBV type A Frequently Detected HBV15-02 Plasma HBV type A Frequently Detected HBV15-03 Plasma HBV type D Frequently detected HBV15-04 Plasma No HBV Negative 4.2. PROFICIENCY PER SAMPLE : QUALITATIVE RESULTS Table II.11. Proficiency per sample Sample Status Negative Positive Comment HBV15-01 Frequently Detected 0 20 Ok HBV15-02 Frequently Detected 0 20 Ok HBV15-03 Frequently detected 0 20 Ok HBV15-04 Negative 20 0 Ok 20 participants and 4 samples representing 80 results. All the encoded results were qualitatively correct SCORE PER LABORATORY The cumulative score could range from 0 to laboratories (100%) obtained an ideal score of 0. Table II.12. Used methods 4.4. METHODS KitType N Abbott RealTime HBV test 8 Altona-RealStar HBV PCR Kit Qiagen artus HBV PCR Kit (RG) 3 Roche COBAS TaqMan HBV Test 5 RealTime in house PCR 2 Conventional in House PCR 1 FORM 43/125/E V6 21/36

22 4.5. QUANTITATIVE RESULTS results distributions The laboratories have also encoded quantitative results (Log 10 IU /ml) (Figure II.1) Figure II.1. boxplot distribution of the quantitative results (Log10 IU/mL) per sample Z Scores The target value was the median of the values. A z-score was calculated according to the statistical method used in IPH ( ). Z= Median-Value /SD SD=(P75-P25)/1,349 A Z score>3 is considered as a wrong result. Table II.13. Repartition of z score per sample. Sample Z <1 1<Z<2 2<Z<3 Z>3 Comment HBV OK HBV OK HBV wrong result Z scores per method FORM 43/125/E V6 22/36

23 Table II.14. Z scores per sample and per participant Kit HBV15-01 HBV15-02 HBV15-03 HBV15-04 Target value Log10 IU/mL) No target SD ND Method Z score Z score Z score Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Abbott Realtime NEGATIVE Altona Diagnostics RealStar NEGATIVE Conventional In House PCR NEGATIVE Qiagen Artus Real Time NEGATIVE Qiagen Artus Real Time NEGATIVE Qiagen Artus Real Time NEGATIVE Real-time In-House PCR NEGATIVE Real-time In-House PCR NEGATIVE Roche Cobas Taqman NEGATIVE Roche Cobas Taqman NEGATIVE Roche Cobas Taqman NEGATIVE Roche Cobas Taqman NEGATIVE Roche Cobas Taqman NEGATIVE Table II. 15. Proficiency per method Method N Spl Good % Z<1 1<Z<2 2<Z<3 Z>3 ranking RocheCOBAS TaqMan HBV Test RealTime in House PCR Conventional in house PCR Qiagen artus HBV PCR Kit (RG) Altona-RealStar HBV PCR Kit Abbott RealTime HBV test total FORM 43/125/E V6 23/36

24 27 Belgian laboratories encoded results. 5. HEPATITIS C VIRUS 5.1. THE SAMPLES Table II.16. Characterization of the samples. Samples Matrix Content Status HCV15-01 Plasma HCV type 1b Frequently detected HCV15-02 Plasma HCV type 1b Frequently detected HCV15-03 Plasma HCV type 3a Frequently detected HCV15-04 Plasma No HCV Negative 5.2. PROFICIENCY PER SAMPLE Table II.17. Proficiency per sample. Sample Status Negative Positive Comment HCV15-01 Frequently detected 0 27 Ok HCV15-02 Frequently detected 0 27 Ok HCV15-03 Frequently detected 0 27 Ok HCV15-04 Negative 27 0 Ok 27 participants and 4 samples representing 108 results. All the laboratories encoded correct answers. 27 laboratories obtained an ideal score of SCORE PER LABORATORY Table II. 18. Used methods 5.4. METHODS Method N Abbott real time PCR 12 Altona diagnostics RealStar 1 In house PCR 2 Qiagen Artus RT 2 Roche Cobas Taqman 10 Total 27 FORM 43/125/E V6 24/36

25 5.5. QUANTITATIVE RESULTS 24 laboratories encoded quantitative results Distribution of the results. Log10 IU/ml Figure II.2. boxplots distribution of the results (Log10 IU/mL) per sample Z scores The target value was the median of the values. A z-score was calculated according to the statistical method used in IPH ( ). Z= Median-Value /SD SD=(P75-P25)/1,349 A Z score>3 is considered as a wrong result FORM 43/125/E V6 25/36

26 Table II.19. Distribution of the Z scores per sample Sample N Z <1 1<Z<2 2<Z<3 Z>3 Comment HCV Ok HCV Ok HCV Ok Total Ok % Z scores per method Table II.20. Z scores per method BE-IPH_HCV15-01 BE-IPH_HCV15-02 BE-IPH_HCV15-03 Status Frequently detected Frequently detected Frequently detected Target value (Log10 IU/mL) SD Method N Zscore Zsocre Z score Abbott Realtime Altona Diagnostics RealStar Qiagen Artus Real Time In-House PCR Roche Cobas Taqman FORM 43/125/E V6 26/36

27 6. HCV GENOTYPING 15 Laboratories encoded results THE SAMPLES Table II.21. Characteristic of the samples. Samples Matrix Content HCV15-01 Plasma HCV type 1a HCV15-02 Plasma HCV type 1b HCV15-03 Plasma HCV type 1b HCV15-04 Plasma HCV type 3a HCV15-05 Plasma HCV type 4a HCV15-06 Plasma HCV type 5a HCV15-07 Plasma HCV type 5a HCV15-08 Plasma No HCV FORM 43/125/E V6 27/36

28 6.2. PROFICIENCY PER SAMPLE Table II.22. Proficiency per sample. Samples Expected result Introduced Results Comment HCV15-01 HCV type 1a 15 type 1a Good answer HCV15-02 HCV type 1b 12 type 1b Good answer 3 type 1 wrong answer HCV15-03 HCV type 1b 12 type 1b 3 type 1 HCV15-04 HCV type 3a 9 type 3a 5 type 3 1 type 4a HCV15-05 HCV type 4a 2 type 4a 13 type 4 Good answer wrong answer Good answer Good answer Wrong answer Good answer Good answer HCV15-06 HCV type 5a 10 type 5a 5 type 5 Good answer Good answer HCV15-07 HCV type 5a 9 type 5a 5 type 5 1 type 6 Good answer Good answer Wrong answer HCV15-08 No HCV 15 not detected Good answer 15 laboratories and 8 samples representing 120 results. The number of correct answers was 112 out of 120 (93.3%). The fact to fail in the detection of genotype 1a or 1b has been considered by the experts as wrong. FORM 43/125/E V6 28/36

29 6.3. METHODS Table II.23. Proficiency per method per sample and per participant. Method N GT15-01 GT15-02 GT15-03 GT15-04 GT15-05 GT15-06 GT15-07 GT a 1b 1b 3a 4a 5a 5a Negative 1a Negative 1a Negative Abbott Realtime 5 1a 1b 1b Negative 1a Negative 1a 1b 1b Negative In-House PCR 2 1a 1b 1b 4a 4a 5a 5a Negative 1a 1b 1b 3a 4a 5a 5a Negative 1a 1b 1b 3a 4 5a 5a Negative 1a 1b 1b 3a 4 5a 5a Negative 1a 1b 1b 3a 4 5a 5a Negative Siemens Versant 8 1a 1b 1b 3a 4 5a 5a Negative 1a 1b 1b 3a 4 5a 5a Negative 1a 1b 1b 3a 4 5a 6 Negative 1a 1b 1b 3a 4 5a 5a Negative 1a 1b 1b 3a 4 5a 5a Negative FORM 43/125/E V6 29/36

30 7. HIGH RISK PAPILLOMAVIRUS 40 Belgian laboratories encoded results 7.1. THE SAMPLES Table II.24. Characteristics of the samples Sample Matrix Content Status HPV15-01 PreservCyt+ Caski Cells HPV16 Frequently detected HPV15-02 PreservCyt+ Caski Cells HPV16 Frequently detected HPV15-03 PreservCyt+ Hela Cells HPV18 Frequently detected HPV15-04 PreservCyt+ Hela Cells HPV18 Frequently detected HPV15-05 PreservCyt+ CC10b Cells HPV45 Detected HPV15-06 PreservCyt+ Caski/Hela Cells HPV16/18 Frequently detected HPV15-07 PreservCyt+ SiHa Cells HPV16 Infrequently detected HPV15-08 PreservCyt No HPV Negative HPV15-09 PreservCyt+ BSM Cells HPV45/56 Detected HPV15-10 PreservCyt+ Caski/CC10b Cells HPV16/45 Frequently detected FORM 43/125/E V6 30/36

31 7.2. RESULTS PER SAMPLE Table II. 25. Proficiency per sample Sample Status Positive Negative ND comment HPV15-01 Frequently detected wrong result HPV15-02 Frequently detected wrong result HPV15-03 Frequently detected wrong result HPV15-04 Frequently detected wrong result HPV15-05 Detected wrong results HPV15-06 Frequently detected wrong result HPV15-07 Infrequently detected wrong results HPV15-08 Negative wrong results HPV15-09 Detected wrong results HPV15-10 Frequently detected wrong results Table II. 26. Summary of the results Characteristics N % Total results Correct answers Wrong answers False negative Not determined SCORES OF THE LABS The score can range from 0 to laboratory encoded only not determined results and was not evaluated. 12 laboratories obtained the ideal score of 0 14 laboratories obtained the score of 1 7 laboratories obtained the score of 2 3 laboratories obtained the score of 3 3 laboratories obtained the score of 5 FORM 43/125/E V6 31/36

32 7.4. PROFICIENCY PER METHOD Table II. 27. Proficiency per method and per sample Method N Abbott Realtime 15 Cepheid Xpert kit Greiner bio-one 1 1 Hologic Aptima 2 Hologic Cervista NucliSENS EasyQ 1 1 Qiagen Digene HC 5 Real-time In-House PCR 5 Roche Cobas 7 Roche Linear Assay Sacace Real TM 1 1 HPV15-01 HPV15-02 HPV15-03 HPV15-04 HPV15-05 HPV15-06 HPV15-07 HPV15-08 HPV15-09 HPV15-10 FD FD FD FD Detected FD IFD Negative detected FD Score ND ND ND ND ND ND ND ND ND ND ND ND ND FORM 43/125/E V6 32/36

33 Table II.28 Proficiency per method Method N N answers N good answers % FP FN ND Ranking Roche Linear Assay Roche Cobas Abbott Realtime Greiner bio-one Hologic Aptima NucliSENS EasyQ Sacace Real TM Cepheid Xpert kit Hologic Cervista Real-time In-House PCR Qiagen Digene HC Total FORM 43/125/E V6 33/36

34 III. PARASITES The panel included 4 samples for the detection of T. gondii in amniotic fluid and 4 samples for the detection of T. gondii in plasma. 14 participants have encoded results. 1. TOXOPLASMA GONDII IN AMNIOTIC FLUID THE SAMPLES Table III.1. Characteristic of the samples. Sample Matrix Content Status BMM2015/11 Plasma Toxoplasma gondii Infrequently detected BMM2015/12 Plasma Toxoplasma gondii Frequently Detected BMM2015/13 Plasma No T. gondii Negative BMM2015/14 plasma Toxoplasma gondii Frequently detected BMM2015/15 Buffer Toxoplasma gondii Negative BMM2015/16 Buffer Toxoplasma gondii Frequently Detected BMM2015/17 Buffer No T. gondii Negative BMM2015/18 Buffer Toxoplasma gondii Frequently detected 1.2. PROFICIENCY PER SAMPLE Table III.2. Proficiency per sample Sample Status Positive Negative ND Comment BMM2015/11 Infrequently detected wrong results BMM2015/12 Frequently Detected Ok BMM2015/13 Negative wrong result BMM2015/14 Frequently detected wrong result BMM2015/15 Frequently detected Ok BMM2015/16 Frequently Detected Ok BMM2015/17 Negative Ok BMM2015/18 Frequently detected wrong result 14 laboratories and 8 samples, representing 112 results. The number of correct results was 98 out of 112 (87.5%). 12 false negative results were encoded representing 14.3% of the expected positive samples. Most of these false negative results come from the sample 2015/11 which is a very low concentrated sample (<10 tachyzoites per ml). Finally, 2 not determined results were encoded due to inhibition of the PCR reaction. FORM 43/125/E V6 34/36

35 The score can ranged from 0 to laboratories obtained an ideal score of 0. 8 laboratories obtained a score of 1. 2 laboratories obtained a score of SCORE PER LABORATORY 1.4. PROFICIENCY PER METHOD 13 laboratories used an in house real time method and 1 laboratory used a commercial kit based on LAMP technique (Diasorin). Table III.3. Proficiency per method, per sample and per participant Method 2015/ / / / / / / /18 score IFD FD Negative FD FD FD Negative FD Diasorin Iam Toxo Realtime In house ND 0 ND IFD: Infrequently detected, FD: frequently detected. FORM 43/125/E V6 35/36

36 CONCLUSIONS The different surveys were classified in function of their percentage of correct answers (table IV.1). Table IV.I. Classification of the surveys in function of their proficiency. Survey N Res Good Results % Wrong results FP FN ND SP SE # HBV % % 100.0% 1 HCV % % 100.0% 1 EV % % 100.0% 1 HSV % % 98.9% 2 VZV % % 98.6% 3 NG % % 98.8% 4 MTB % % 97.2% 5 CT % % 95.9% 6 HCV GT % 8 0 NA 8 100% NA 7 HPV % % 90.6% 8 TG % % 85.7% 9 Total % % 96.1% CT: Chlamydia trachomatis; MTB Mycobacterium tuberculosis; NG: Neisseria gonorrhoeae; TG: Toxoplasma gondii ; N : number of participants; Res; umber of encoded results, FP: false positive; FN: false negative; ND: not determined; SE: sensitivity; SP: specificity; #: ranking. The results indicated that the percentage of correct results ranged from 87.5% (TG) to 100% (HBV, HCV, EV). The general percentage of correct answers was 95.1%. The specificity ranged from 97.2 to 100%. The sensitivity ranged from 85.7 to 100%. The comparison of the surveys is presented in an indicative way. Indeed, the composition of the different panels can be different from survey to survey. END Scientific Institute of Public Health, Brussels This report may not be reproduced, published or distributed without the consent of the WIV-ISP. FORM 43/125/E V6 36/36