Summarising and validating test accuracy results across multiple studies for use in clinical practice
|
|
- Alison Evans
- 6 years ago
- Views:
Transcription
1 Summarising and validating test accuracy results across multiple studies for use in clinical practice Richard D. Riley Professor of Biostatistics Research Institute for Primary Care & Health Sciences Thank you: Brian Willis, Thomas Debray, Kym Snell, Joie Ensor, Jon Deeks, Carl Moons, Julian Higgins, and others 1
2 Objectives Consider whether meta-analysis results are actually helpful (applicable) to clinical practice Consider methods to examine test performance in multiple settings, that go beyond average results Focus on probabilistic inferences and validation 2
3 Meta-analysis & heterogeneity Meta-analysis should be producing clinically useful results 3
4 Meta-analysis & heterogeneity Meta-analysis should be producing clinically useful results Usually there will be heterogeneity in a meta-analysis of test accuracy studies. e.g. differences across studies in: - thresholds reported (we just heard about this!) - methods of measurement - reference standard - population characteristics (case-mix variation) - prevalence of disease 4
5 Meta-analysis & heterogeneity Meta-analysis should be producing clinically useful results Usually there will be heterogeneity in a meta-analysis of test accuracy studies. e.g. differences across studies in: - thresholds reported (we just heard about this!) - methods of measurement - reference standard - population characteristics (case-mix variation) - prevalence of disease Causes the TRUE sensitivity and TRUE specificity to vary from setting to setting 5
6 Meta-analysis & heterogeneity Yet this does not stop us (me) from doing meta-analysis Just use a random effects model!!! - accounts for unexplained between-study heterogeneity 6
7 Meta-analysis & heterogeneity Yet this does not stop us (me) from doing meta-analysis Just use a random effects model!!! - accounts for unexplained between-study heterogeneity Gives a pooled result for sensitivity and specificity And most importantly (?) - another publication for the CV But can the clinician actually use that pooled result? Is the summary sensitivity and specificity applicable to their population? 7
8 Meta-analysis & heterogeneity Yet this does not stop us (me) from doing meta-analysis Just use a random effects model!!! - accounts for unexplained between-study heterogeneity Gives a pooled result for sensitivity and specificity And most importantly (?) - another publication for the CV But can the clinician actually use that pooled result? Is the summary sensitivity and specificity applicable to their population? Time for us to do better but can we? 8
9 9
10 10
11 11
12 Going beyond the average? PART 1: Probabilistic inferences for performance in clinical settings 12
13 Example 1: Accuracy of ear temperature for fever? 11 studies identified that - All used > 38 degrees to define test positive - All used rectal temperature as reference standard - All used the FirstTemp ear thermometer - All used an electronic rectal thermometer Bivariate meta-analysis used to combined 2 by 2 tables Produces summary sensitivity and specificity
14 Summary sensitivity = 65% (51% to 77%) Summary specificity = 98% (96% to 99%) Sensitivity Specificity Study estimate 95% confidence region Summary point
15 Summary sensitivity = 65% (51% to 77%) Summary specificity = 98% (96% to 99%) But these relate to the average performance across all populations - could sensitivity and specificity be different in particular settings? Sensitivity Specificity Study estimate 95% confidence region.4.2 Summary point 0
16 Prediction regions (intervals) indicate the potential true test performance in a single setting Can be derived after a meta-analysis In a Bayesian framework they allow predictive inferences & distributions:
17 Prediction regions (intervals) indicate the potential true test performance in a single setting Can be derived after a meta-analysis In a Bayesian framework they allow predictive inferences & distributions:
18 Prediction regions (intervals) indicate the potential true test performance in a single setting Can be derived after a meta-analysis In a Bayesian framework they allow predictive inferences & distributions: What is probability sensitivity and specificity are > 80% in a single setting? Sensitivity Specificity Study estimate 95% confidence region Summary point 95% prediction region
19 Prediction regions (intervals) indicate the potential true test performance in a single setting Can be derived after a meta-analysis In a Bayesian framework they allow predictive inferences & distributions: What is probability sensitivity and specificity are > 80% in a single setting? Sensitivity Probability sensitivity and specificity will fall in this region (values > 80%) in a single setting = Specificity Study estimate 95% confidence region Summary point 95% prediction region
20 Example 2: Accuracy of PTH for hypocalcaemia? 5 studies identified that studied parathyroid (PTH) - Patients all had a thyroidectomy - % change in PTH from before to after surgery - Change > 65% indicates test positive - Reference standard measured 48 hours later Accurate PTH test may help to send people home earlier Bivariate meta-analysis used to combined 2 by 2 tables Produces summary sensitivity and specificity
21 Sensitivity Specificity
22 Sensitivity Specificity Sensitivity Probability sensitivity and specificity will fall in this region (values > 80%) in a single setting = Specificity.2 0 Study estimate Summary point
23 Going beyond the average? PART 2: Tailoring PPV and NPV to clinical settings (with validation) 23
24 PPV and NPV PPV: probability of disease given positive test result NPV: probability of non-disease given negative test result Clinicians are usually more interested in PPV and NPV They need to combine sensitivity and specificity with prevalence to obtain them (e.g. using Bayesian theorem, or an equation) But what values of sensitivity, specificity and prevalence do they take from a meta-analysis? Are the derived PPV and NPV reliable? 24
25 OPTION A: Deriving PPV and NPV Take the pooled sensitivity, specificity and prevalence from meta-analysis of existing studies (though makes no use of local data) 25
26 OPTION A: Deriving PPV and NPV Take the pooled sensitivity, specificity and prevalence from meta-analysis of existing studies (though makes no use of local data) Applying Bayes Theorem we obtain predictions using: 26
27 Deriving PPV and NPV OPTION B: Take pooled sensitivity & specificity from meta-analysis Combine with known prevalence in local setting 27
28 Deriving PPV and NPV OPTION B: Take pooled sensitivity & specificity from meta-analysis Combine with known prevalence in local setting Applying Bayes Theorem we obtain predictions using 28
29 Deriving PPV and NPV OPTION C: Develop a meta-regression with study-level covariates Then predict PPV and NPV using the fitted model 29
30 OPTION C: Deriving PPV and NPV Develop a meta-regression with study-level covariates Then predict PPV and NPV using the fitted model e.g. fit bivariate meta-analysis of PPV and NPV from existing studies, with prevalence as a covariate (Leeflang et al.) Obtain predictions using 30
31 Are predicted PPV and NPV reliable? As for any risk prediction equation, we must check performance Here good calibration is essential Does predicted PPV & NPV agree with observed PPV & NPV? 31
32 Are predicted PPV and NPV reliable? As for any risk prediction equation, we must check performance Here good calibration is essential Does predicted PPV & NPV agree with observed PPV & NPV? PROBLEM: It is well-known that developed models are over-fitted (over-optimistic) in the data they were developed in (see work by Harrell, Steyerberg, etc) PROPOSAL: Use internal-external cross-validation (Royston et al., Debray et al.)
33 Internal-external cross-validation (IECV): example with 3 studies Each cycle produces estimates of predictive performance (calibration statistics such as O:E) Can then use meta-analysis to summarise across all cycles
34 Internal-external cross-validation (IECV) Helps answer the question: If I use meta-analysis to develop a prediction equation (model) for deriving PPV and NPV in a new population, - is it likely to perform well? - if not, will a different strategy work better? 34
35 Revisit PTH example - can we use options A or B to produce reliable PPV and NPV for particular clinical settings? (i) apply internal-external cross-validation (ii) then summarise performance 35
36 OPTION A: Predict PPV and NPV from meta-analysis estimates 36
37 OPTION B: Tailor PPV and NPV using local prevalence 37
38 OPTION B: Tailor PPV and NPV using local prevalence But large uncertainty due to small number of studies: Probability of only 40% that true O/E is between 0.9 and
39 NPV is most important for the PTH test We want to know for sure that a patient does not have hypocalcaemia, so we can send them home Q: What is the potential true NPV given a predicted NPV from option B Internal-external cross-validation followed by Bayesian metaanalysis of calibration performance tells us: For a predicted NPV of 0.95, there is a 95% probability the true NPV is between 0.78 and acceptable error? 39
40 Risk prediction models Our examples focused on test research But principles apply to risk prediction research in general e.g. multivariable models for diagnosis or prognosis Allow the inclusion of patient-level (& study-level) covariates Aim the same: we should want reliable model predictions in all clinical settings, not just on average 40
41 Time to go beyond the average performance and validate (improve) predictions in each setting, subgroup, and population of interest 41
42 External validation of a prognostic model in breast cancer patients - does it calibrate well upon validation? OPTION 1: No recalibration OPTION 2: Recalibration of the baseline hazard Country used for external validation Country used for external validation 42
43 Summary A challenge for us all: - Are our meta-analysis results useful? - Should we move away from summary results? - Focus rather on probabilistic statements? - Leave out studies to validate test performance? Much related work: - in particular tailored meta-analysis of Willis and Hyde - overfitting & recalibration of prediction models (Steyerberg et al.) - IPD meta-analysis of risk prediction studies (Debray et al.) Other clinical measures highly relevant (e.g. net-benefit: Vickers et al)
44 Some references Willis BH, Hyde CJ. Estimating a test's accuracy using tailored meta-analysis- How setting-specific data may aid study selection. J Clin Epidemiol 2014;67(5): Riley RD, Ahmed I, Debray TP, et al. Summarising and validating test accuracy results across multiple studies for use in clinical practice. Stat Med 2015;34(13): Leeflang MM, Bossuyt PM, Irwig L. Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis. J Clin Epidemiol 2009;62(1):5-12. Leeflang MM, Deeks JJ, Rutjes AW, et al. Bivariate meta-analysis of predictive values of diagnostic tests can be an alternative to bivariate meta-analysis of sensitivity and specificity. J Clin Epidemiol 2012;65(10): Leeflang MM, Rutjes AW, Reitsma JB, et al. Variation of a test's sensitivity and specificity with disease prevalence. CMAJ : 2013;185(11):E Debray TP, Moons KG, Ahmed I, et al. A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Stat Med 2013;32(18): KEELE COURSE: Statistical methods for IPD meta-analysis, 6-7 th December 2016
Individual Participant Data (IPD) Meta-analysis of prediction modelling studies
Individual Participant Data (IPD) Meta-analysis of prediction modelling studies Thomas Debray, PhD Julius Center for Health Sciences and Primary Care Utrecht, The Netherlands March 7, 2016 Prediction
More informationMeta-analysis of diagnostic test accuracy studies with multiple & missing thresholds
Meta-analysis of diagnostic test accuracy studies with multiple & missing thresholds Richard D. Riley School of Health and Population Sciences, & School of Mathematics, University of Birmingham Collaborators:
More informationSystematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies
Systematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group Conflict
More informationIntroduction to diagnostic accuracy meta-analysis. Yemisi Takwoingi October 2015
Introduction to diagnostic accuracy meta-analysis Yemisi Takwoingi October 2015 Learning objectives To appreciate the concept underlying DTA meta-analytic approaches To know the Moses-Littenberg SROC method
More informationEVIDENCE-BASED GUIDELINE DEVELOPMENT FOR DIAGNOSTIC QUESTIONS
EVIDENCE-BASED GUIDELINE DEVELOPMENT FOR DIAGNOSTIC QUESTIONS Emily Vella, Xiaomei Yao Cancer Care Ontario's Program in Evidence-Based Care, Department of Oncology, McMaster University, Ontario, Canada
More informationSystematic reviews of prognostic studies: a meta-analytical approach
Systematic reviews of prognostic studies: a meta-analytical approach Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group (Co-convenors: Doug Altman, Katrina Williams, Jill
More informationSupplementary Online Content
Supplementary Online Content Wu HY, Peng YS, Chiang CK, et al. Diagnostic performance of random urine samples using albumin concentration vs ratio of albumin to creatinine for microalbuminuria screening
More informationThe spectrum effect in tests for risk prediction, screening, and diagnosis
open access The spectrum effect in tests for risk prediction, screening, and diagnosis Juliet A Usher-Smith, Stephen J Sharp, Simon J Griffin, The Primary Care Unit, University of Cambridge, Strangeways
More informationSystematic Reviews of Studies Quantifying the Accuracy of Diagnostic Tests and Markers
Papers in Press. Published September 18, 2012 as doi:10.1373/clinchem.2012.182568 The latest version is at http://hwmaint.clinchem.org/cgi/doi/10.1373/clinchem.2012.182568 Clinical Chemistry 58:11 000
More informationIntroduction to Meta-analysis of Accuracy Data
Introduction to Meta-analysis of Accuracy Data Hans Reitsma MD, PhD Dept. of Clinical Epidemiology, Biostatistics & Bioinformatics Academic Medical Center - Amsterdam Continental European Support Unit
More informationQuantifying the Added Value of a Diagnostic Test or Marker
Clinical Chemistry 58:10 1408 1417 (2012) Review Quantifying the Added Value of a Diagnostic Test or Marker Karel G.M. Moons, 1* Joris A.H. de Groot, 1 Kristian Linnet, 2 Johannes B. Reitsma, 1 and Patrick
More informationExternal validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges
open access External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges Richard D Riley, Joie Ensor, Kym I E Snell, 2 Thomas
More informationMeta-analysis of external validation studies
Meta-analysis of external validation studies Thomas Debray, PhD Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, The Netherlands Cochrane Netherlands, Utrecht, The
More informationBuilding Reality Checks into the Translational Pathway for Diagnostic and Prognostic Models
Authors Lendrem DW 1,2, Lendrem BC 1,3,4, Pratt AG 1,2,3, Tarn JR 1, Skelton A1 1,5, James K 6,7, McMeekin P 8,9, Linsley M 10, Gillespie C 10, Cordell H 11, Ng WF 1,2,3, Isaacs JD 1,2,3 1 Institute of
More informationOverview of Multivariable Prediction Modelling. Methodological Conduct & Reporting: Introducing TRIPOD guidelines
Overview of Multivariable Prediction Modelling Methodological Conduct & Reporting: Introducing TRIPOD guidelines Gary Collins Centre for Statistics in Medicine www.csm-oxford.org.uk University of Oxford
More informationValue of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis
Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis BMJ 2010;340:c1269 doi:10.1136/bmj.c1269 Mr DC 62 year old man Borderline anaemia
More informationMethods for Evaluating Medical Tests and Biomarkers Birmingham, UK July 2016
Diagnostic and Prognostic Research 2017, 1(Suppl 1):7 DOI 10.1186/s41512-016-0001-y Diagnostic and Prognostic Research MEETING ABSTRACTS Methods for Evaluating Medical Tests and Biomarkers Birmingham,
More informationSYSTEMATIC REVIEWS OF TEST ACCURACY STUDIES
Biomarker & Test Evaluation Program SYSTEMATIC REVIEWS OF TEST ACCURACY STUDIES Patrick MM Bossuyt Structure 1. Clinical Scenarios 2. Test Accuracy Studies 3. Systematic Reviews 4. Meta-Analysis 5.
More informationAssessing variability in results in systematic reviews of diagnostic studies
Naaktgeboren et al. BMC Medical Research Methodology (2016) 16:6 DOI 10.1186/s12874-016-0108-4 RESEARCH ARTICLE Open Access Assessing variability in results in systematic reviews of diagnostic studies
More informationQuantifying the variability of optimal cutpoints and reference values for diagnostic measures
Quantifying the variability of optimal cutpoints and reference values for diagnostic measures Gerrit Hirschfeld, Boris Zernikow Aim: Empirical studies in medicine and most other fields of study - yield
More informationStatistical considerations in indirect comparisons and network meta-analysis
Statistical considerations in indirect comparisons and network meta-analysis Said Business School, Oxford, UK March 18-19, 2013 Cochrane Comparing Multiple Interventions Methods Group Oxford Training event,
More informationAssessment of performance and decision curve analysis
Assessment of performance and decision curve analysis Ewout Steyerberg, Andrew Vickers Dept of Public Health, Erasmus MC, Rotterdam, the Netherlands Dept of Epidemiology and Biostatistics, Memorial Sloan-Kettering
More informationChecklist for Diagnostic Test Accuracy Studies. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews
The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Diagnostic Test Accuracy Studies http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org
More informationClinical Epidemiology for the uninitiated
Clinical epidemiologist have one foot in clinical care and the other in clinical practice research. As clinical epidemiologists we apply a wide array of scientific principles, strategies and tactics to
More informationCochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy
Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Chapter 10 Analysing and Presenting Results Petra Macaskill, Constantine Gatsonis, Jonathan Deeks, Roger Harbord, Yemisi Takwoingi.
More informationSystematic Reviews and meta-analyses of Diagnostic Test Accuracy. Mariska Leeflang
Systematic Reviews and meta-analyses of Diagnostic Test Accuracy Mariska Leeflang m.m.leeflang@amc.uva.nl This presentation 1. Introduction: accuracy? 2. QUADAS-2 exercise 3. Meta-analysis of diagnostic
More informationStatistical methods for the meta-analysis of full ROC curves
Statistical methods for the meta-analysis of full ROC curves Oliver Kuss (joint work with Stefan Hirt and Annika Hoyer) German Diabetes Center, Leibniz Institute for Diabetes Research at Heinrich Heine
More informationAdvanced IPD meta-analysis methods for observational studies
Advanced IPD meta-analysis methods for observational studies Simon Thompson University of Cambridge, UK Part 4 IBC Victoria, July 2016 1 Outline of talk Usual measures of association (e.g. hazard ratios)
More informationheterogeneity in meta-analysis stats methodologists meeting 3 September 2015
heterogeneity in meta-analysis stats methodologists meeting 3 September 2015 basic framework k experiments (i=1 k) each gives an estimate x i of θ, with variance s i 2 best overall estimate is weighted
More informationSystematic review of prognostic models for recurrent venous thromboembolism (VTE) post-treatment of first unprovoked VTE
To cite: Ensor J, Riley RD, Moore D, et al. Systematic review of prognostic models for recurrent venous thromboembolism (VTE) post-treatment of first unprovoked VTE. BMJ Open 2016;6:e011190. doi:10.1136/bmjopen-2016-011190
More informationMeta-analysis of diagnostic research. Karen R Steingart, MD, MPH Chennai, 15 December Overview
Meta-analysis of diagnostic research Karen R Steingart, MD, MPH karenst@uw.edu Chennai, 15 December 2010 Overview Describe key steps in a systematic review/ meta-analysis of diagnostic test accuracy studies
More informationStatistical methods for the meta-analysis of full ROC curves
Statistical methods for the meta-analysis of full ROC curves Oliver Kuss (joint work with Stefan Hirt and Annika Hoyer) German Diabetes Center, Leibniz Institute for Diabetes Research at Heinrich Heine
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector
More informationMeta-analysis using individual participant data: one-stage and two-stage approaches, and why they may differ
Tutorial in Biostatistics Received: 11 March 2016, Accepted: 13 September 2016 Published online 16 October 2016 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/sim.7141 Meta-analysis using
More informationEmpirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests
Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Yemisi Takwoingi, Richard Riley and Jon Deeks Outline Rationale Methods Findings Summary Motivating
More informationMeta-analysis of diagnostic accuracy studies. Mariska Leeflang (with thanks to Yemisi Takwoingi, Jon Deeks and Hans Reitsma)
Meta-analysis of diagnostic accuracy studies Mariska Leeflang (with thanks to Yemisi Takwoingi, Jon Deeks and Hans Reitsma) 1 Diagnostic Test Accuracy Reviews 1. Framing the question 2. Identification
More informationCLINICAL REGISTRIES Use and Emerging Best Practices
CLINICAL REGISTRIES Use and Emerging Best Practices Tim Friede Department of Medical Statistics University Medical Center Göttingen DZHK (German Center for Cardiovascular Research) OUTLINE Background:
More informationSISCR Module 7 Part I: Introduction Basic Concepts for Binary Biomarkers (Classifiers) and Continuous Biomarkers
SISCR Module 7 Part I: Introduction Basic Concepts for Binary Biomarkers (Classifiers) and Continuous Biomarkers Kathleen Kerr, Ph.D. Associate Professor Department of Biostatistics University of Washington
More informationMultivariate meta-analysis using individual participant data
Original Article Received 19 February 2014, Revised 10 October 2014, Accepted 17 October 2014 Published online 21 November 2014 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/jrsm.1129 Multivariate
More informationEmpirical evidence that disease prevalence may affect the performance of diagnostic tests with an implicit threshold: a cross-sectional study
Open Access To cite: Willis BH. Empirical evidence that disease prevalence may affect the performance of diagnostic tests with an implicit threshold: a cross-sectional study. BMJ Open 2012;2: e000746.
More informationMultivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples
Multivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples Richard D Riley, 1 Dan Jackson, 2 Georgia Salanti, 3,4 Danielle L Burke, 1 Malcolm
More informationReporting and methods in systematic reviews of comparative accuracy
Reporting and methods in systematic reviews of comparative accuracy Yemisi Takwoingi, Richard Riley and Jon Deeks Public Health, Epidemiology and Biostatistics Which test is best? Example What is the evidence?
More informationAn Introduction to Systematic Reviews of Prognosis
An Introduction to Systematic Reviews of Prognosis Katrina Williams and Carl Moons for the Cochrane Prognosis Review Methods Group (Co-convenors: Doug Altman, Katrina Williams, Jill Hayden, Sue Woolfenden,
More informationSchool of Population and Public Health SPPH 503 Epidemiologic methods II January to April 2019
School of Population and Public Health SPPH 503 Epidemiologic methods II January to April 2019 Time: Tuesday, 1330 1630 Location: School of Population and Public Health, UBC Course description Students
More informationMODEL SELECTION STRATEGIES. Tony Panzarella
MODEL SELECTION STRATEGIES Tony Panzarella Lab Course March 20, 2014 2 Preamble Although focus will be on time-to-event data the same principles apply to other outcome data Lab Course March 20, 2014 3
More informationSystematic reviews of prediction modeling studies: planning, critical appraisal and data collection
Systematic reviews of prediction modeling studies: planning, critical appraisal and data collection Karel GM Moons, Lotty Hooft, Hans Reitsma, Thomas Debray Dutch Cochrane Center Julius Center for Health
More informationSensitivity, specicity, ROC
Sensitivity, specicity, ROC Thomas Alexander Gerds Department of Biostatistics, University of Copenhagen 1 / 53 Epilog: disease prevalence The prevalence is the proportion of cases in the population today.
More informationStatistical modelling for thoracic surgery using a nomogram based on logistic regression
Statistics Corner Statistical modelling for thoracic surgery using a nomogram based on logistic regression Run-Zhong Liu 1, Ze-Rui Zhao 2, Calvin S. H. Ng 2 1 Department of Medical Statistics and Epidemiology,
More informationReducing Decision Errors in the Paired Comparison of the Diagnostic Accuracy of Continuous Screening Tests
Reducing Decision Errors in the Paired Comparison of the Diagnostic Accuracy of Continuous Screening Tests Brandy M. Ringham, 1 Todd A. Alonzo, 2 John T. Brinton, 1 Aarti Munjal, 1 Keith E. Muller, 3 Deborah
More informationDownloaded from:
Hemingway, H; Croft, P; Perel, P; Hayden, JA; Abrams, K; Timmis, A; Briggs, A; Udumyan, R; Moons, KG; Steyerberg, EW; Roberts, I; Schroter, S; Altman, DG; Riley, RD; PROGRESS Group (2013) Prognosis research
More informationOptimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis
CMAJ Research Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis Laura Manea MSc, Simon Gilbody PhD, Dean McMillan PhD See related commentary
More informationMurphy S. Optimal dynamic treatment regimes. JRSS B 2003;65(2):
References Albain KS, Barlow WE, Shak S, et al. Prognostic and predictive value of the 21-gene recurrence score assay in postmenopausal women with node-positive, oestrogen-receptor-positive breast cancer
More informationVariable selection should be blinded to the outcome
Variable selection should be blinded to the outcome Tamás Ferenci Manuscript type: Letter to the Editor Title: Variable selection should be blinded to the outcome Author List: Tamás Ferenci * (Physiological
More informationModule Overview. What is a Marker? Part 1 Overview
SISCR Module 7 Part I: Introduction Basic Concepts for Binary Classification Tools and Continuous Biomarkers Kathleen Kerr, Ph.D. Associate Professor Department of Biostatistics University of Washington
More informationDevelopment of restricted mean survival time difference in network metaanalysis based on data from MACNPC update.
Development of restricted mean survival time difference in network metaanalysis based on data from MACNPC update. Claire Petit, Pierre Blanchard, Jean-Pierre Pignon, Béranger Lueza June 2017 CONTENTS Context...
More informationWhere a licence is displayed above, please note the terms and conditions of the licence govern your use of this document.
Multivariate meta-analysis using individual participant data Riley, Richard; Price, Malcolm; Jackson, D.; Wardle, M.; Gueyffier, F.; Wang, J.; Staessen, J. A.; White, I. R. DOI: 10.1002/jrsm.1129 License:
More informationDevelopment, validation and application of risk prediction models
Development, validation and application of risk prediction models G. Colditz, E. Liu, M. Olsen, & others (Ying Liu, TA) 3/28/2012 Risk Prediction Models 1 Goals Through examples, class discussion, and
More informationCopyright GRADE ING THE QUALITY OF EVIDENCE AND STRENGTH OF RECOMMENDATIONS NANCY SANTESSO, RD, PHD
GRADE ING THE QUALITY OF EVIDENCE AND STRENGTH OF RECOMMENDATIONS NANCY SANTESSO, RD, PHD ASSISTANT PROFESSOR DEPARTMENT OF CLINICAL EPIDEMIOLOGY AND BIOSTATISTICS, MCMASTER UNIVERSITY Nancy Santesso,
More informationSystematic review of interferon-gamma release assays in tuberculosis: focus on likelihood ratios
< Supplementary tables are published online only at http:// thx.bmj.com/content/vol65/ issue3. Tuberculosis and Chest Service, Department of Health, Hong Kong SAR, China Correspondence to Dr Kwok Chiu
More informationBayesian meta-analysis of Papanicolaou smear accuracy
Gynecologic Oncology 107 (2007) S133 S137 www.elsevier.com/locate/ygyno Bayesian meta-analysis of Papanicolaou smear accuracy Xiuyu Cong a, Dennis D. Cox b, Scott B. Cantor c, a Biometrics and Data Management,
More informationCritical reading of diagnostic imaging studies. Lecture Goals. Constantine Gatsonis, PhD. Brown University
Critical reading of diagnostic imaging studies Constantine Gatsonis Center for Statistical Sciences Brown University Annual Meeting Lecture Goals 1. Review diagnostic imaging evaluation goals and endpoints.
More informationIndividualized Treatment Effects Using a Non-parametric Bayesian Approach
Individualized Treatment Effects Using a Non-parametric Bayesian Approach Ravi Varadhan Nicholas C. Henderson Division of Biostatistics & Bioinformatics Department of Oncology Johns Hopkins University
More informationMost primary care patients with suspected
Excluding deep vein thrombosis safely in primary care Validation study of a simple diagnostic rule D. B. Toll, MSc, R. Oudega, MD, PhD, R. J. Bulten, MD, A.W. Hoes, MD, PhD, K. G. M. Moons, PhD Julius
More informationClinical course of untreated cerebral cavernous malformations: an individual patient data meta-analysis
Statistical Analysis Plan Clinical course of untreated cerebral cavernous malformations: an individual patient data meta-analysis Background The disease A cerebral cavernous malformation (CCM) is a small
More informationReceived: 14 April 2016, Accepted: 28 October 2016 Published online 1 December 2016 in Wiley Online Library
Research Article Received: 14 April 2016, Accepted: 28 October 2016 Published online 1 December 2016 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/sim.7171 One-stage individual participant
More informationLecture Outline Biost 517 Applied Biostatistics I
Lecture Outline Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 2: Statistical Classification of Scientific Questions Types of
More informationDiagnostic methods I: sensitivity, specificity, and other measures of accuracy
http://www.kidney-international.org & 2009 International Society of Nephrology abc of epidemiology Diagnostic methods I: sensitivity, specificity, and other measures of accuracy Karlijn J. van Stralen
More informationNet Reclassification Risk: a graph to clarify the potential prognostic utility of new markers
Net Reclassification Risk: a graph to clarify the potential prognostic utility of new markers Ewout Steyerberg Professor of Medical Decision Making Dept of Public Health, Erasmus MC Birmingham July, 2013
More informationSystematic Reviews. Madhukar Pai, MD, PhD Associate Professor Department of Epidemiology & Biostatistics McGill University, Montreal, Canada
Systematic Reviews Madhukar Pai, MD, PhD Associate Professor Department of Epidemiology & Biostatistics McGill University, Montreal, Canada Email: madhukar.pai@mcgill.ca Information explosion a key barrier
More informationHayden Smith, PhD, MPH /\ v._
Hayden Smith, PhD, MPH.. + /\ v._ Information and clinical examples provided in presentation are strictly for educational purposes, and should not be substituted for clinical guidelines or up-to-date medical
More informationSystematic reviews and meta-analyses of diagnostic test accuracy
REVIEW 10.1111/1469-0691.12474 Systematic reviews and meta-analyses of diagnostic test accuracy M. M. G. Leeflang Clinical Epidemiology and Biostatistics and Bioinformatics, Academic Medical Centre, University
More informationExplicit inclusion of treatment in prognostic modelling was recommended in observational and randomised settings
Accepted Manuscript Explicit inclusion of treatment in prognostic modelling was recommended in observational and randomised settings R.H.H. Groenwold, K.G.M. Moons, R. Pajouheshnia, D.G. Altman, G.S. Collins,
More informationQUANTIFYING THE IMPACT OF DIFFERENT APPROACHES FOR HANDLING CONTINUOUS PREDICTORS ON THE PERFORMANCE OF A PROGNOSTIC MODEL
QUANTIFYING THE IMPACT OF DIFFERENT APPROACHES FOR HANDLING CONTINUOUS PREDICTORS ON THE PERFORMANCE OF A PROGNOSTIC MODEL Gary Collins, Emmanuel Ogundimu, Jonathan Cook, Yannick Le Manach, Doug Altman
More informationBayesians methods in system identification: equivalences, differences, and misunderstandings
Bayesians methods in system identification: equivalences, differences, and misunderstandings Johan Schoukens and Carl Edward Rasmussen ERNSI 217 Workshop on System Identification Lyon, September 24-27,
More informationMeta-Analysis. Zifei Liu. Biological and Agricultural Engineering
Meta-Analysis Zifei Liu What is a meta-analysis; why perform a metaanalysis? How a meta-analysis work some basic concepts and principles Steps of Meta-analysis Cautions on meta-analysis 2 What is Meta-analysis
More informationPrognostic markers in cancer: the evolution of evidence from single studies to meta-analysis, and beyond
British Journal of Cancer (2009) 100, 1219 1229 All rights reserved 0007 0920/09 $32.00 www.bjcancer.com Review from single studies to meta-analysis, and beyond RD Riley*,1, W Sauerbrei 2 and DG Altman
More informationBayesian Inference. Thomas Nichols. With thanks Lee Harrison
Bayesian Inference Thomas Nichols With thanks Lee Harrison Attention to Motion Paradigm Results Attention No attention Büchel & Friston 1997, Cereb. Cortex Büchel et al. 1998, Brain - fixation only -
More informationSession 7: The Sliding Dichotomy 7.1 Background 7.2 Principles 7.3 Hypothetical example 7.4 Implementation 7.5 Example: CRASH Trial
Session 7: The Sliding Dichotomy 7.1 Background 7.2 Principles 7.3 Hypothetical example 7.4 Implementation 7.5 Example: CRASH Trial Session 7 1 7.1 The Sliding Dichotomy: Background The sliding dichotomy
More informationSeeing the Forest & Trees: novel analyses of complex interventions to guide health system decision making
Seeing the Forest & Trees: novel analyses of complex interventions to guide health system decision making Noah Ivers MD CCFP PhD Family Physician, Women s College Hospital Scientist, Women s College Research
More informationPerspectives on analysing subgroup effects of clinical trials and their meta analyses
Perspectives on analysing subgroup effects of clinical trials and their meta analyses Kit CB Roes 2011, London Perspective of treating physician Evidence based decision for the (next) patient to treat,
More informationKnowledge Discovery for Clinical Decision Support
Knowledge Discovery for Clinical Decision Support Pedro Pereira Rodrigues CINTESIS & LIAAD INESC TEC Faculty of Medicine University of Porto, Portugal @ECMLPKDD Nancy, France Pedro Pereira Rodrigues -
More informationTRIPODS Workshop: Models & Machine Learning for Causal I. & Decision Making
TRIPODS Workshop: Models & Machine Learning for Causal Inference & Decision Making in Medical Decision Making : and Predictive Accuracy text Stavroula Chrysanthopoulou, PhD Department of Biostatistics
More informationresearch methods & reporting
research methods & reporting Meta-analysis of individual participant data: rationale, conduct, and reporting Richard D Riley, 1 Paul C Lambert, 2 Ghada Abo-Zaid 3 1 Department of Public Health, Epidemiology
More informationWhat is indirect comparison?
...? series New title Statistics Supported by sanofi-aventis What is indirect comparison? Fujian Song BMed MMed PhD Reader in Research Synthesis, Faculty of Health, University of East Anglia Indirect comparison
More informationMeta-analysis of Diagnostic Test Accuracy Studies
GUIDELINE Meta-analysis of Diagnostic Test Accuracy Studies November 2014 Copyright EUnetHTA 2013. All Rights Reserved. No part of this document may be reproduced without an explicit acknowledgement of
More informationAn introduction to individual patient data (IPD) meta-analysis
An introduction to individual patient data (IPD) meta-analysis Dr Sarah Nevitt Department of Biostatistics University of Liverpool Email: sjn16@liverpool.ac.uk : @sjn_16 Outline of the webinar IPD meta-analysis
More informationBayesian Multiparameter Evidence Synthesis to Inform Decision Making: A Case Study in Metastatic Hormone-Refractory Prostate Cancer
Original Manuscript Bayesian Multiparameter Evidence Synthesis to Inform Decision Making: A Case Study in Metastatic Hormone-Refractory Prostate Cancer Medical Decision Making 1 15 Ó The Author(s) 2018
More informationQuantitative challenges of extrapolation
Quantitative challenges of extrapolation Michael Looby, Frank Bretz (Novartis) EMA workshop on extrapolation of efficacy and safety in medicine development across age groups May 17-18, 2016 Extrapolation
More informationFixed Effect Combining
Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse
More informationSensory Cue Integration
Sensory Cue Integration Summary by Byoung-Hee Kim Computer Science and Engineering (CSE) http://bi.snu.ac.kr/ Presentation Guideline Quiz on the gist of the chapter (5 min) Presenters: prepare one main
More informationDesign and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP I 5/2/2016
Design and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP233201500069I 5/2/2016 Overview The goal of the meta-analysis is to assess the effects
More informationMultivariate Mixed-Effects Meta-Analysis of Paired-Comparison Studies of Diagnostic Test Accuracy
Multivariate Mixed-Effects Meta-Analysis of Paired-Comparison Studies of Diagnostic Test Accuracy Ben A. Dwamena, MD The University of Michigan & VA Medical Centers, Ann Arbor SNASUG - July 24, 2008 Diagnostic
More informationObserved Differences in Diagnostic Test Accuracy between Patient Subgroups: Is It Real or Due to Reference Standard Misclassification?
Clinical Chemistry 53:10 1725 1729 (2007) Overview Observed Differences in Diagnostic Test Accuracy between Patient Subgroups: Is It Real or Due to Reference Standard Misclassification? Corné Biesheuvel,
More informationLecture Outline. Biost 590: Statistical Consulting. Stages of Scientific Studies. Scientific Method
Biost 590: Statistical Consulting Statistical Classification of Scientific Studies; Approach to Consulting Lecture Outline Statistical Classification of Scientific Studies Statistical Tasks Approach to
More informationChanging EDSS progression in placebo cohorts in relapsing MS:
Changing EDSS progression in placebo cohorts in relapsing MS: A systematic review and meta-regression Christian Röver 1, Richard Nicholas 2, Sebastian Straube 3, Tim Friede 1 1 Department of Medical Statistics,
More informationUK Liver Transplant Audit
November 2012 UK Liver Transplant Audit In patients who received a Liver Transplant between 1 st March 1994 and 31 st March 2012 ANNUAL REPORT Advisory Group for National Specialised Services Prepared
More informationGrading evidence for laboratory test studies beyond diagnostic accuracy: application to prognostic testing
Grading evidence for for laboratory test studies beyond diagnostic accuracy: application to to prognostic testing testing Andrew C. Don-Wauchope, Pasqualina L. Santaguida In this issue: Focusing on Guidelines
More informationSystematic reviews of diagnostic test accuracy studies
Systematic reviews of diagnostic test accuracy studies McGill Summer Institute, Montreal June 2017 Karen R Steingart, MD, MPH Cochrane Infectious Diseases Group Liverpool School of Tropical Medicine karen.steingart@gmail.com
More informationMeta-analysis of safety thoughts from CIOMS X
CIOMS Working Group X Meta-analysis of safety thoughts from CIOMS X Stephen.Evans@Lshtm.ac.uk Improving health worldwide www.lshtm.ac.uk Evans: ENCePP CIOMS Meta Analysis 1 Acknowledgements, conflicts,
More informationHow to Develop, Validate, and Compare Clinical Prediction Models Involving Radiological Parameters: Study Design and Statistical Methods
Review Article Experimental and Others http://dx.doi.org/10.3348/kjr.2016.17.3.339 pissn 1229-6929 eissn 2005-8330 Korean J Radiol 2016;17(3):339-350 How to Develop, Validate, and Compare Clinical Prediction
More information