Karen R Steingart, MD, MPH New Diagnostics Working Group Lille, 26 October, 2011 karenst@uw.edu
I have no financial disclosures to declare I have published previous systematic reviews on serological tests I serve as Coordinator of the Evidence Synthesis & Policy subgroup of Stop TB Partnership s New Diagnostics Working Group
Background The evidence is reviewed - Updated systematic review and metaanalysis - WHO/TDR evaluation of rapid tests - Economic and epidemiological impact of serologic testing for active TB in India WHO policy statement on serological tests Response to the new policy
Antigen any molecule that can bind specifically to an antibody (the name comes from the ability to generate antibody) Antibody - a protein that binds specifically to a particular substance, its antigen; all antibody molecules belong to a family of proteins called immunoglobulins Serological tests for TB - tests (such as ELISA, immunochromatographic tests) on a sample of blood serum that detect the humoral immune (antibody) responses to M. tuberculosis antigens Do not confuse serological tests with IGRAs that measure the T-cell-based interferon-gamma response to M. tuberculosis antigens Janeway, Immunobiology, 6 th edition
Serological tests could be developed into point-ofcare tests Serological tests provide rapid results - ELISA, within hours - immunochromatographic assay, within minutes For children, a blood test may be more practical than sputum microscopy For patients suspected of extrapulmonary TB, a blood test, if accurate, could replace more invasive tests
Sensitivity = 98% Specificity = 100% Sensitivity = 93% Specificity = 100% 6
7
Deeply troubling Serological tests are being used widely in a majority of high TB burden countries Our survey also confirms the previous observation that companies in western countries (e.g. France, UK, USA, Germany, Australia) are exporting inaccurate and unreliable TB diagnostics to poor countries, while not approving the same tests for domestic use. Grenier, Eur Respir J, 2011, in press
Commissioned an updated systematic review and a decision-analysis model Convened an Expert Group to assess the evidence base Used the GRADE approach to rate the quality of evidence and determine the strength of recommendations www.gradeworkinggroup.org
Objective: To obtain summary estimates of the diagnostic accuracy of commercial serological tests for the diagnosis of pulmonary and extrapulmonary TB Participants: adults and children, all coutries Reference standards - Pulmonary TB: Culture, solid or liquid - Extrapulmonary TB: Smear, culture, histopathology
Two independent reviewers Updated literature search from previous systematic reviews, all languages QUADAS to appraise methodological quality Prespecified subgroups by test, smear, HIV Meta-analysis by hierarchical SROC random effects model The GRADE approach to determine quality of the body of evidence
PRISMA Diagram - 4256 citations - 160 full-text papers - PTB: 31 papers original review (20) update (11) - EPTB: 12 papers original review (9) update (3)
Pulmonary TB: 67 studies (5147 participants); 48% studies from low and middle-income countries anda-tb (IgG, IgA, and IgM) was the test most frequently evaluated (16 studies, 24%) Extrapulmonary TB: 25 studies (1809 participants); 40% from low and middle-income countries anda-tb (IgG, IgA, and IgM) was the test most frequently evaluated (17 studies, 68%)
Pulmonary TB Sensitivity range: 0 to 100% Specificity range: 31 to 100%
Extrapulmonary TB Sensitivity range: 0 to 100% Specificity range: 59 to 100%
andatb IgG, smear + ICT TB-EIA andatb IgG, Extrapulmonary TB
Methodological quality summary with QUADAS, anda-tb IgG, smear-negative patients Steingart et al. PLoS Med 2011
Summary HSROC plots for anda-tb IgG: (A) smearpositive and (B) smear-negative pulmonary TB patients Smear Positive Sensitivity = 76% (63,87) Specificity = 92% (74,98) Smear Negative Sensitivity = 59% (10,96) Specificity = 91% (79,96) Steingart et al. PLoS Med 2011
HROC plots by assay technique (A) ELISA and (B) Rapid tests ELISA Sensitivity = 60% ( 6, 65) Specificity = 98% (96,99) Rapid tests Sensitivity = 53% (42, 64) Specificity = 98% (76, 99) Steingart et al. PLoS Med 2011
Test Sensitivity % (95% CI) Specificity (95% CI) SDHO (Saint-Sauveur des Monts, Canada) 16 (5, 34) 90 (74, 98) Smear microscopy 68 (49, 83) 100 (89,100) 55 HIV-infected individuals suspected of having pulmonary TB, inpatient and outpatient 31 culture-confirmed TB cases Median age 31 Central African Republic Kassa-Kelembho et al. Clin Vaccine Immunol. 2006 June; 13(6): 702 3
1. Study limitations (QUADAS criteria) 2. Inconsistency (unexplained heterogeneity) 3. Indirectness 4. Imprecision (width of confidence intervals) 5. Publication bias
Steingart et al. PLoS Med 2011
Objective: To compare performance and reproducibility of rapid MTBspecific antibody detection tests using archived serum samples from the WHO/TDR TB Specimen Bank Reference standard: culture and clinical follow-up
Rapid test - result < 15 minutes Simple - 1 or 2 steps, minimal training and no equipment Easy to interpret - card or strip format with visual readout Archived specimens from Uganda, The Gambia, Canada, Tanzania, Brazil, and Spain ROC plots
All samples, n = 355 HIV negative samples, n = 198 HIV positive samples, n = 157 Sensitivity = 1 to 60% Specificity =53 to 99%
Objective: to estimate costs and effectiveness of sputum microscopy (US$3.62 for two smears), microscopy plus automated liquid culture (MGIT, US$20/test), and serological testing (anda-tb ELISA, US$20/test)
- 1.5 million TB suspects - 1/7 with TB - 53% TB patients are highly infectious - 5% HIV prevalence - 10% with access to ART - Accuracy estimates from the updated systematic review Simplified version of study decision tree Dowdy D et al. PLoS Med 2011 29
Compared with no testing - Sputum smear: additional 44,000 TB cases, 36,000 false positives (FPs) - Serology as replacement test: additional 58,000 TB cases,157,000 FPs - Smear estimated to avert 102,000 more DALY*s, 32,000 more secondary cases than serology, at ~ 1/4 the incremental cost *DALY, disability-adjusted life year Dowdy et al. PLoS Med 2011
GRADE determinants of strength of recommendation Factor Balance between desirable and undesirable effects Quality of evidence Values and preferences Costs (resource allocation) Guyatt GH et al. BMJ 2008
Commercial serological tests provide inconsistent and imprecise findings resulting in highly variable values for sensitivity and specificity high proportions of false-positive and false-negative results adversely impact patient safety. Overall data quality was graded as very low and it is strongly recommended that these tests not be used for the diagnosis of pulmonary and extrapulmonary TB. Targeted further research to identify new/alternative point-of-care tests for TB diagnosis and/or serological tests with improved accuracy is strongly encouraged. World Health Organization (2011) Policy Statement: Commercial serodiagnostic tests for diagnosis of tuberculosis. WHO, Geneva, Switzerland. WHO/HTM/TB/2011.5. Available: http://whqlibdoc.who.int/publications/2011/9789241502054_eng.pdf
Responses from governments of high-burden countries have been overwhelmingly positive, Karin Weyer, WHO Stop TB Department. Morris K, The Lancet Infect Dis 2011 The (Indian) Union Health Ministry has asked all state tuberculosis (TB) officers to endorse the recommendations of the World Health Organization (WHO), urging countries to ban unapproved blood tests to diagnose the disease http://www.indianexpress.com/news/tb-battle-states-told-to-follow-whoguideli/820721/ These tests were discouraged from use almost 20 years ago globally but 10 out of 18 types of strips are still in use in the private sector in Kenya today, Ms Lucy Chesire, one of the two Kenyan TB experts involved in a WHO study of the problem http://www.nation.co.ke/news/tb+tests+done+at+private+clinics+not+ac curate/-/1056/1207098/-/item/0/-/nxponp/-/index.html
1. Dinnes J et al. A systematic review of rapid diagnostic tests for the detection of tuberculosis infection. Health Technol Assess, 2007. 11(3): p. 1-196. 2. Dowdy DW et al. Serological Testing Versus Other Strategies for Diagnosis of Active Tuberculosis in India: A Cost-Effectiveness Analysis. PLoS Med, 2011. 8(8): e1001074. doi:10.1371/journal.pmed.1001074 3.Schünemann HJ et al. Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. BMJ, 2008. 336(7653): p. 1106-10. 4. Special Programme for Research and Training in Tropical Diseases. Laboratory-based evaluation of 19 commercially available rapid diagnostic tests for tuberculosis. 2008. Geneva: World Health Organization. 5. Steingart KR et al., Performance of purified antigens for serodiagnosis of pulmonary tuberculosis: a meta-analysis. Clin Vaccine Immunol, 2009. 16(2): p. 260-76. 6. Steingart KR et al., Commercial serological antibody detection tests for the diagnosis of pulmonary tuberculosis: a systematic review. PLoS Med, 2007. 4(6): p. e202. 7. Steingart KR et al. A systematic review of commercial serological antibody detection tests for the diagnosis of extrapulmonary tuberculosis. Thorax, 2007. 62(10): p. 911-8. 8. Steingart KR et al. Extrapulmonary Tuberculosis: An Updated Systematic Review and Meta-Analysis. PLoS Med 8(8): e1001062. doi:10.1371/journal.pmed.1001062
Jane Cunningham (WHO Special Programme for Research and Training in Tropical Diseases), Chris Gilpin (WHO Stop TB Department), Krystal Kobasic (University of California, San Francisco), Megan Henry (Sacramento, California), Christian Lienhardt (Stop TB Partnership Research Movement), Anna Meddaugh (Portland, Oregon), Dick Menzies (McGill University), Alan Mishchenko (University of California, Berkeley), Carl-Michael Nathanson (WHO Special Programme for Research and Training in Tropical Diseases), Marek Perkowski (Portland State University), John Phillips (Fishbon Memorial Library, University of California, San Francisco), Irina Rudoy (University of California, San Francisco), Holger Schünemann (McMaster University), Karin Weldingh (Novo Nordisk), Karin Weyer (WHO Stop TB Department), Gloria Won (Fishbon Memorial Library, University of California, San Francisco), and George Yen (University of California, San Francisco). In addition, we are grateful to Mien Pathey and Jia Si Duan for administrative support and the members of the WHO Expert Group Meeting on Serodiagnostics, July 2010. Funders: USAID through grant administered by UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases TDR); WHO Stop TB Department; Bill & Melinda Gates Foundation; New Diagnostics Working Group of the Stop TB Partnership