Meta-analysis of diagnostic test accuracy studies with multiple & missing thresholds
|
|
- Morgan Singleton
- 5 years ago
- Views:
Transcription
1 Meta-analysis of diagnostic test accuracy studies with multiple & missing thresholds Richard D. Riley School of Health and Population Sciences, & School of Mathematics, University of Birmingham Collaborators: Apratim Guha, Atanu Biswas, Yemisi Takwoingi Joie Ensor, R. Katie Morris, Jonathan J. Deeks
2 Rationale
3 SENSITIVITY vs. SPECIFICITY pdf Test - Test + Group 1 Diseased Group 0 Healthy Group 0 (Healthy) Test + TP FP Test - FN TN TN TP Group 1 (Diseased) D T Diagnostic variable, D Threshold Sensitivity = number of true positives / total with disease Specificity = number of true negatives / total without disease 3 3
4 SENSITIVITY vs. SPECIFICITY pdf Test - Test + Group 1 Diseased Group 0 Healthy Group 0 (Healthy) Test + TP FP Test - FN TN TN TP Group 1 (Diseased) D T Diagnostic variable, D Threshold Each study may report more than one 2x2 table One for each different threshold value considered 4 4
5 TRACING OUT THE RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE 1 Lower threshold Sensitivity Higher threshold 0 (1-Specificity) 1 5 5
6 Clinical question Pre-eclampsia is a major cause of maternal and perinatal morbidity and mortality, and occurs in 2-8% of all pregnancies The diagnosis of pre-eclampsia is determined by the presence of elevated blood pressure combined with significant proteinuria Gold-standard for detection of significant proteinuria is the 24 hour urine collection... but this is time consuming and inconvenient Alternative, quicker and yet accurate diagnostic tests required
7 Data Systematic review identified 13 studies evaluating spot protein:creatinine ratio (PCR) for detecting significant proteinuria in pregnancy 23 different thresholds reported, with a minimum of one and a maximum of seven studies per threshold Threshold values ranged from 0.13 to Five studies provided 2x2 table for just one threshold The other eight studies reported results for each of multiple thresholds, up to a maximum of nine thresholds in any study
8 How to do meta-analysis?
9 But summary meta-analysis result is not for a particular threshold and can t identify threshold results from the SROC curve (1) Current standard approaches: Choose one threshold per study Standard approach for meta-analysis Still allows summary ROC curves to be produced
10 (1) Current standard approaches: Separate meta-analysis at each threshold Use ALL thresholds in each study Take each threshold separately Apply standard meta-analysis to each threshold, e.g. bivariate random effects meta-analysis model - models binomial nature of the data - obtain average sensitivity & specificity for each threshold - allows for between-study heterogeneity - accounts for any between-study correlation
11 Separate meta-analysis at each threshold sensitivity specificity.7.6.5
12 However... throwing away information? A separate meta-analysis for each threshold omits any studies that do not report the threshold of interest But such omitted studies may contain related information from other thresholds that are available. In particular... recall the ROC curve Test accuracy results from neighbouring thresholds are similar Results for a missing threshold are bounded between any pair of higher and lower thresholds that are available. Statistically like to utilise such related information (correlation)
13 (2) Sophisticated approaches: (i) Multinomial regression with random-effects Hamza et al. method
14 (2) Sophisticated approaches: (ii) Poisson survival model with random-effects Compared to Hamza: - the multinomial distribution of the counts is replaced by a Poisson distribution of the number of events, - the random normal distribution to describe betweenstudy variation is replaced by a multivariate gamma distribution.
15 (2) Sophisticated approaches: (iii) Many others. Tosteson AN, Begg CB: A general regression methodology for ROC curve estimation. Medical Decision Making 1988, 8: Kester ADM, Buntinx F: Meta-analysis of ROC curves. Medical Decision Making 2000, 20: Poon WY: A latent normal distribution model for analysing ordinal responses with applications in meta-analysis. Statistics in Medicine 2004, 23: Bipat S, Zwinderman AH, Bossuyt PMM, Stoker J: Multivariate Random-Effects Approach: For Meta-Analysis of Cancer Staging Studies. Acad Radiol 2007, 14: Dukic V, Gatsonis C: Meta-analysis of Diagnostic test accuracy assessment studies with varying number of thresholds. Biometrics 2003, 59: Typically not used / difficult to fit with missing data / don t utilise established multivariate methods / don t handle studies with 1 threshold
16 (3) A practical sensitivity analysis: imputation approach Aim: Evaluate impact of missing thresholds but enable established Cochrane methods We have missing data that is bounded Results for a missing threshold are bounded between any pair of higher and lower thresholds that are available Step 1: Impute missing threshold results On the logit-scale, assume: - a linear increase in specificity as the threshold increases - a linear decrease in sensitivity as the threshold increases Convert back to a 2x2 table for the missing threshold Step 2: Apply a standard meta-analysis at each threshold separately
17 Example: Al Ragib study logit-sensitivity logit-specificity.75.5 imputed observed
18 Example: Al Ragib study threshold threshold High Normal ID, t value, x Imputed? TP FP FN TN Total proteinuria proteinuria No Yes Yes Yes Yes No
19 Example: Al Ragib study threshold threshold High Normal ID, t value, x Imputed? TP FP FN TN Total proteinuria proteinuria No Yes Yes Yes Yes No Using this method, an additional 50 threshold results were imputed Vast more information available for meta-analysis at each threshold Key question: are the original conclusions (before imputation) robust?
20 Separate versus imputation approach Sensitivity Specificity no imputation with imputation
21 Imputation reveals weaker clinical conclusion The imputation approach generally Imputation: - reveals LOWER summary test accuracy - increased heterogeneity Original: Suggest PCR test is not suitable (on its own) for diagnosing proteinuria
22 Imputation approach: pros and cons Advantages Utilises more information from neighbouring thresholds Allows standard bivariate meta-analysis at each threshold Incorporates studies with just one threshold Reveals potential over-optimistic in published results (due to selective reporting of thresholds: see Rifai et al.) Disadvantages Single imputation used; multiple imputation now essential Uncertainty of the imputed value needs to be acknowledged (view as a sensitivity analysis, focus on impact on summary estimates)
23 (4) multivariate-normal approach Rather than imputation, consider modelling correlation Extend bivariate-normal model of Reitsma et al. (2002) Step 1: Obtain for each study logit-sensitivity and logit-specificity estimates at each threshold their variance-covariance matrix (variances and correlation) Step 2: Apply a multivariate-normal meta-analysis model Assume logit estimates follow an approx multivariate normal dist Jointly synthesises all threshold simultaneously Correlation borrows strength across thresholds
24 Univariate versus multivariate approach Sensitivity Specificity multivariate univariate
25 Multivariate-normal approach: pros & cons Advantages Can lead to improved precision of estimates Reduces selective reporting of thresholds Disadvantages Laborious to fit Between-study covariance matrix poorly estimated (correlations often +1 and -1) Uses approximate normal sampling distribution Requires continuity correction if there are zero cells
26 Final thing Ordering Sensitivity and specificity should be ordered across thresholds As threshold increases sensitivity decreases, specificity increases Sophisticated methods in part (2) ensure this but perhaps also causes convergence problems given missing data Simpler approaches do not ensure ordering across thresholds e.g. the summary sensitivity estimate increases from 0.82 to 0.94 when the threshold increases from 0.28 to 0.3 This is due to the imbalance in number of studies per threshold Order by meta-regression of meta-analysis results VS threshold
27 Constrain after multi-normal meta-analysis Sensitivity Specificity unconstrained summary results constrained summary results
28 Constrain after multi-normal meta-analysis Sensitivity For constrained results they are ordered; threshold value increases from 0.13 to Specificity unconstrained summary results constrained summary results
29 So main message is. For continuous tests, ideally want to produce meta-analysis results for each threshold & an interpretable SROC curve If possible, move away from ROC curves where particular thresholds are not identifiable Difficult given missing thresholds across studies This is a non trivial problem Therefore usually ignored encourage researchers to consider it
30 Conclusions: dealing with multiple thresholds Sophisticated methods available but may not be possible Propose multivariate-normal or imputation approaches Enable more familiar methods Assess if summary results are robust to the missing thresholds Potentially reduce selective reporting Currently extending to multiple imputation Future work: model parametric distribution of raw data
31 THANK YOU! Selected references Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005; 58: Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol 2006; 59: ; author reply Hamza TH, Arends LR, van Houwelingen HC, Stijnen T. Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds. BMC Medical Research Methodology 2009; 9: 73. Riley RD et al. Meta-analysis of diagnostic test studies with multiple and missing thresholds: multivariate-normal & imputation approaches (to be submitted) Rifai, N., Altman, D. G., Bossuyt, P. M. (2008). Reporting Bias in Diagnostic and Prognostic Studies: Time for Action. Clin. Chem. 54:
Introduction to diagnostic accuracy meta-analysis. Yemisi Takwoingi October 2015
Introduction to diagnostic accuracy meta-analysis Yemisi Takwoingi October 2015 Learning objectives To appreciate the concept underlying DTA meta-analytic approaches To know the Moses-Littenberg SROC method
More informationStatistical methods for the meta-analysis of full ROC curves
Statistical methods for the meta-analysis of full ROC curves Oliver Kuss (joint work with Stefan Hirt and Annika Hoyer) German Diabetes Center, Leibniz Institute for Diabetes Research at Heinrich Heine
More informationStatistical methods for the meta-analysis of full ROC curves
Statistical methods for the meta-analysis of full ROC curves Oliver Kuss (joint work with Stefan Hirt and Annika Hoyer) German Diabetes Center, Leibniz Institute for Diabetes Research at Heinrich Heine
More informationEmpirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests
Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Yemisi Takwoingi, Richard Riley and Jon Deeks Outline Rationale Methods Findings Summary Motivating
More informationSupplementary Online Content
Supplementary Online Content Wu HY, Peng YS, Chiang CK, et al. Diagnostic performance of random urine samples using albumin concentration vs ratio of albumin to creatinine for microalbuminuria screening
More informationSummarising and validating test accuracy results across multiple studies for use in clinical practice
Summarising and validating test accuracy results across multiple studies for use in clinical practice Richard D. Riley Professor of Biostatistics Research Institute for Primary Care & Health Sciences Thank
More informationSystematic Reviews and meta-analyses of Diagnostic Test Accuracy. Mariska Leeflang
Systematic Reviews and meta-analyses of Diagnostic Test Accuracy Mariska Leeflang m.m.leeflang@amc.uva.nl This presentation 1. Introduction: accuracy? 2. QUADAS-2 exercise 3. Meta-analysis of diagnostic
More informationIntroduction to Meta-analysis of Accuracy Data
Introduction to Meta-analysis of Accuracy Data Hans Reitsma MD, PhD Dept. of Clinical Epidemiology, Biostatistics & Bioinformatics Academic Medical Center - Amsterdam Continental European Support Unit
More informationMeta-analysis using RevMan. Yemisi Takwoingi October 2015
Yemisi Takwoingi October 2015 Contents 1 Introduction... 1 2 Dataset 1 PART I..2 3 Starting RevMan... 2 4 Data and analyses in RevMan... 2 5 RevMan calculator tool... 2 Table 1. Data for derivation of
More informationAn Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy
Number XX An Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy Prepared for: Agency for Healthcare Research and Quality U.S. Department of Health and Human Services 54 Gaither
More informationMultivariate Mixed-Effects Meta-Analysis of Paired-Comparison Studies of Diagnostic Test Accuracy
Multivariate Mixed-Effects Meta-Analysis of Paired-Comparison Studies of Diagnostic Test Accuracy Ben A. Dwamena, MD The University of Michigan & VA Medical Centers, Ann Arbor SNASUG - July 24, 2008 Diagnostic
More informationMeta-analyses evaluating diagnostic test accuracy
THE STATISTICIAN S PAGE Summary Receiver Operating Characteristic Curve Analysis Techniques in the Evaluation of Diagnostic Tests Catherine M. Jones, MBBS, BSc(Stat), and Thanos Athanasiou, MD, PhD, FETCS
More informationSYSTEMATIC REVIEWS OF TEST ACCURACY STUDIES
Biomarker & Test Evaluation Program SYSTEMATIC REVIEWS OF TEST ACCURACY STUDIES Patrick MM Bossuyt Structure 1. Clinical Scenarios 2. Test Accuracy Studies 3. Systematic Reviews 4. Meta-Analysis 5.
More informationMultivariate Mixed-Effects Meta-Analysis of Paired-Comparison Studies of Diagnostic Test Accuracy
Multivariate Mixed-Effects Meta-Analysis of Paired-Comparison Studies of Diagnostic Test Accuracy Ben A. Dwamena, MD The University of Michigan & VA Medical Centers, Ann Arbor SNASUG - July 24, 2008 B.A.
More informationCochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy
Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Chapter 10 Analysing and Presenting Results Petra Macaskill, Constantine Gatsonis, Jonathan Deeks, Roger Harbord, Yemisi Takwoingi.
More informationReporting and methods in systematic reviews of comparative accuracy
Reporting and methods in systematic reviews of comparative accuracy Yemisi Takwoingi, Richard Riley and Jon Deeks Public Health, Epidemiology and Biostatistics Which test is best? Example What is the evidence?
More informationMeta-analysis of diagnostic research. Karen R Steingart, MD, MPH Chennai, 15 December Overview
Meta-analysis of diagnostic research Karen R Steingart, MD, MPH karenst@uw.edu Chennai, 15 December 2010 Overview Describe key steps in a systematic review/ meta-analysis of diagnostic test accuracy studies
More informationMeta-analysis of diagnostic accuracy studies. Mariska Leeflang (with thanks to Yemisi Takwoingi, Jon Deeks and Hans Reitsma)
Meta-analysis of diagnostic accuracy studies Mariska Leeflang (with thanks to Yemisi Takwoingi, Jon Deeks and Hans Reitsma) 1 Diagnostic Test Accuracy Reviews 1. Framing the question 2. Identification
More informationBayesian meta-analysis of Papanicolaou smear accuracy
Gynecologic Oncology 107 (2007) S133 S137 www.elsevier.com/locate/ygyno Bayesian meta-analysis of Papanicolaou smear accuracy Xiuyu Cong a, Dennis D. Cox b, Scott B. Cantor c, a Biometrics and Data Management,
More informationAssessing variability in results in systematic reviews of diagnostic studies
Naaktgeboren et al. BMC Medical Research Methodology (2016) 16:6 DOI 10.1186/s12874-016-0108-4 RESEARCH ARTICLE Open Access Assessing variability in results in systematic reviews of diagnostic studies
More informationState of the Art in Clinical & Anatomic Pathology. Meta-analysis of Clinical Studies of Diagnostic Tests
State of the Art in Clinical & Anatomic Pathology Meta-analysis of Clinical Studies of Diagnostic Tests Developments in How the Receiver Operating Characteristic Works N Meta-analytic summaries are needed
More informationCopulaDTA: An R package for copula-based bivariate beta-binomial models for diagnostic test accuracy studies in Bayesian framework
CopulaDTA: An R package for copula-based bivariate beta-binomial models for diagnostic test accuracy studies in Bayesian framework Victoria Nyaga 1,2, Marc Arbyn 2, Marc Aerts 1. May 18, 2016 1. Universiteit
More informationBivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews
Journal of Clinical Epidemiology 58 (2005) 982 990 Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews Johannes B. Reitsma a, *, Afina S. Glas
More informationEVIDENCE-BASED GUIDELINE DEVELOPMENT FOR DIAGNOSTIC QUESTIONS
EVIDENCE-BASED GUIDELINE DEVELOPMENT FOR DIAGNOSTIC QUESTIONS Emily Vella, Xiaomei Yao Cancer Care Ontario's Program in Evidence-Based Care, Department of Oncology, McMaster University, Ontario, Canada
More informationReducing Decision Errors in the Paired Comparison of the Diagnostic Accuracy of Continuous Screening Tests
Reducing Decision Errors in the Paired Comparison of the Diagnostic Accuracy of Continuous Screening Tests Brandy M. Ringham, 1 Todd A. Alonzo, 2 John T. Brinton, 1 Aarti Munjal, 1 Keith E. Muller, 3 Deborah
More informationStructural Equation Modeling (SEM)
Structural Equation Modeling (SEM) Today s topics The Big Picture of SEM What to do (and what NOT to do) when SEM breaks for you Single indicator (ASU) models Parceling indicators Using single factor scores
More informationJamie Kirkham (University of Liverpool)
A random walk through outcomes based research for healthcare Jamie Kirkham (University of Liverpool) Acknowledgements: Doug Altman Mike Clarke Carrol Gamble Richard Riley Paula Williamson Why are outcomes
More informationCritical reading of diagnostic imaging studies. Lecture Goals. Constantine Gatsonis, PhD. Brown University
Critical reading of diagnostic imaging studies Constantine Gatsonis Center for Statistical Sciences Brown University Annual Meeting Lecture Goals 1. Review diagnostic imaging evaluation goals and endpoints.
More informationMethods Research Report. An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy
Methods Research Report An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy Methods Research Report An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy
More informationIndex. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI /
Index A Adjusted Heterogeneity without Overdispersion, 63 Agenda-driven bias, 40 Agenda-Driven Meta-Analyses, 306 307 Alternative Methods for diagnostic meta-analyses, 133 Antihypertensive effect of potassium,
More informationMeta-analysis using individual participant data: one-stage and two-stage approaches, and why they may differ
Tutorial in Biostatistics Received: 11 March 2016, Accepted: 13 September 2016 Published online 16 October 2016 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/sim.7141 Meta-analysis using
More informationPerformance of rapid influenza H1N1 diagnostic tests: a meta-analysis
DOI:10.1111/j.170-269.2011.00284.x www.influenzajournal.com Review Article Performance of rapid influenza H1N1 diagnostic tests: a meta-analysis Haitao Chu, a Eric T. Lofgren, b M. Elizabeth Halloran,
More informationMeta-analysis of Diagnostic Test Accuracy Studies
GUIDELINE Meta-analysis of Diagnostic Test Accuracy Studies November 2014 Copyright EUnetHTA 2013. All Rights Reserved. No part of this document may be reproduced without an explicit acknowledgement of
More informationMeta-Analysis Methods used in Radiology Journals
Meta-Analysis Methods used in Radiology Journals Trevor McGrath Medical Student University of Ottawa April 15, 2016 Disclosure Statement This project was funded by: University of Ottawa Department of Radiology
More informationAn empirical comparison of methods to meta-analyze individual patient data of diagnostic accuracy
An empirical comparison of methods to meta-analyze individual patient data of diagnostic accuracy Gabrielle Simoneau Master of Science Department of Epidemiology, Biostatistics and Occupational Health
More informationReview. Imagine the following table being obtained as a random. Decision Test Diseased Not Diseased Positive TP FP Negative FN TN
Outline 1. Review sensitivity and specificity 2. Define an ROC curve 3. Define AUC 4. Non-parametric tests for whether or not the test is informative 5. Introduce the binormal ROC model 6. Discuss non-parametric
More informationBayesian Meta-Analysis of the Accuracy of a Test for Tuberculous Pleuritis in the Absence of a Gold Standard Reference
Biometrics DOI: 10.1111/j.1541-040.01.01773.x Bayesian Meta-Analysis of the Accuracy of a Test for Tuberculous Pleuritis in the Absence of a Gold Standard Reference Nandini Dendukuri, 1, Ian Schiller,
More informationRecent developments for combining evidence within evidence streams: bias-adjusted meta-analysis
EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard
More informationSystematic Reviews of Studies Quantifying the Accuracy of Diagnostic Tests and Markers
Papers in Press. Published September 18, 2012 as doi:10.1373/clinchem.2012.182568 The latest version is at http://hwmaint.clinchem.org/cgi/doi/10.1373/clinchem.2012.182568 Clinical Chemistry 58:11 000
More informationAtherosclerosis 220 (2012) Contents lists available at ScienceDirect. Atherosclerosis
Atherosclerosis 220 (2012) 128 133 Contents lists available at ScienceDirect Atherosclerosis journal homepage: www.elsevier.com/locate/atherosclerosis Carotid plaque, compared with carotid intima-media
More informationModels for potentially biased evidence in meta-analysis using empirically based priors
Models for potentially biased evidence in meta-analysis using empirically based priors Nicky Welton Thanks to: Tony Ades, John Carlin, Doug Altman, Jonathan Sterne, Ross Harris RSS Avon Local Group Meeting,
More informationSelecting the Right Data Analysis Technique
Selecting the Right Data Analysis Technique Levels of Measurement Nominal Ordinal Interval Ratio Discrete Continuous Continuous Variable Borgatta and Bohrnstedt state that "the most of central constructs
More informationKnowledge Discovery and Data Mining. Testing. Performance Measures. Notes. Lecture 15 - ROC, AUC & Lift. Tom Kelsey. Notes
Knowledge Discovery and Data Mining Lecture 15 - ROC, AUC & Lift Tom Kelsey School of Computer Science University of St Andrews http://tom.home.cs.st-andrews.ac.uk twk@st-andrews.ac.uk Tom Kelsey ID5059-17-AUC
More informationScore Tests of Normality in Bivariate Probit Models
Score Tests of Normality in Bivariate Probit Models Anthony Murphy Nuffield College, Oxford OX1 1NF, UK Abstract: A relatively simple and convenient score test of normality in the bivariate probit model
More informationSystematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies
Systematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group Conflict
More informationYou must answer question 1.
Research Methods and Statistics Specialty Area Exam October 28, 2015 Part I: Statistics Committee: Richard Williams (Chair), Elizabeth McClintock, Sarah Mustillo You must answer question 1. 1. Suppose
More informationChoice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias
Technical appendix Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias Choice of axis in funnel plots Funnel plots were first used in educational research and psychology,
More informationLecture Outline. Biost 590: Statistical Consulting. Stages of Scientific Studies. Scientific Method
Biost 590: Statistical Consulting Statistical Classification of Scientific Studies; Approach to Consulting Lecture Outline Statistical Classification of Scientific Studies Statistical Tasks Approach to
More informationComparison of Different Methods of Detecting Publication Bias
Shaping the Future of Drug Development Comparison of Different Methods of Detecting Publication Bias PhUSE 2017, Edinburgh Janhavi Kale, Cytel Anwaya Nirpharake, Cytel Outline Systematic review and Meta-analysis
More informationMIDAS RETOUCH REGARDING DIAGNOSTIC ACCURACY META-ANALYSIS
MIDAS RETOUCH REGARDING DIAGNOSTIC ACCURACY META-ANALYSIS Ben A. Dwamena, MD University of Michigan Radiology and VA Nuclear Medicine, Ann Arbor 2014 Stata Conference, Boston, MA - July 31, 2014 Dwamena
More informationBias in regression coefficient estimates when assumptions for handling missing data are violated: a simulation study
STATISTICAL METHODS Epidemiology Biostatistics and Public Health - 2016, Volume 13, Number 1 Bias in regression coefficient estimates when assumptions for handling missing data are violated: a simulation
More informationApplying Bivariate Meta-analyses when Within-study Correlations are Unknown
Applying Bivariate Meta-analyses when Within-study Correlations are Unknown Thilan, A.W.L.P. *1, Jayasekara, L.A.L.W. 2 *1 Corresponding author, Department of Mathematics, Faculty of Science, University
More informationLec 02: Estimation & Hypothesis Testing in Animal Ecology
Lec 02: Estimation & Hypothesis Testing in Animal Ecology Parameter Estimation from Samples Samples We typically observe systems incompletely, i.e., we sample according to a designed protocol. We then
More informationAssessment of methodological quality and QUADAS-2
Assessment of methodological quality and QUADAS-2 Yemisi Takwoingi October 2015 Based on slides developed by Mariska Leeflang, Penny Whiting, Hans Reitsma and Sue Mallett Learning objectives To be familiar
More informationWeek 2 Video 3. Diagnostic Metrics
Week 2 Video 3 Diagnostic Metrics Different Methods, Different Measures Today we ll continue our focus on classifiers Later this week we ll discuss regressors And other methods will get worked in later
More informationPackage xmeta. August 16, 2017
Type Package Title A Toolbox for Multivariate Meta-Analysis Version 1.1-4 Date 2017-5-12 Package xmeta August 16, 2017 Imports aod, glmmml, numderiv, metafor, mvmeta, stats A toolbox for meta-analysis.
More informationCochrane Pregnancy and Childbirth Group Methodological Guidelines
Cochrane Pregnancy and Childbirth Group Methodological Guidelines [Prepared by Simon Gates: July 2009, updated July 2012] These guidelines are intended to aid quality and consistency across the reviews
More informationThe cross sectional study design. Population and pre-test. Probability (participants). Index test. Target condition. Reference Standard
The cross sectional study design. and pretest. Probability (participants). Index test. Target condition. Reference Standard Mirella Fraquelli U.O. Gastroenterologia 2 Fondazione IRCCS Cà Granda Ospedale
More informationIndividual Participant Data (IPD) Meta-analysis of prediction modelling studies
Individual Participant Data (IPD) Meta-analysis of prediction modelling studies Thomas Debray, PhD Julius Center for Health Sciences and Primary Care Utrecht, The Netherlands March 7, 2016 Prediction
More informationPredictive Models for Healthcare Analytics
Predictive Models for Healthcare Analytics A Case on Retrospective Clinical Study Mengling Mornin Feng mfeng@mit.edu mornin@gmail.com 1 Learning Objectives After the lecture, students should be able to:
More informationWeight Adjustment Methods using Multilevel Propensity Models and Random Forests
Weight Adjustment Methods using Multilevel Propensity Models and Random Forests Ronaldo Iachan 1, Maria Prosviryakova 1, Kurt Peters 2, Lauren Restivo 1 1 ICF International, 530 Gaither Road Suite 500,
More informationPRACTICAL STATISTICS FOR MEDICAL RESEARCH
PRACTICAL STATISTICS FOR MEDICAL RESEARCH Douglas G. Altman Head of Medical Statistical Laboratory Imperial Cancer Research Fund London CHAPMAN & HALL/CRC Boca Raton London New York Washington, D.C. Contents
More informationMultivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples
Multivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples Richard D Riley, 1 Dan Jackson, 2 Georgia Salanti, 3,4 Danielle L Burke, 1 Malcolm
More informationDiagnostic methods 2: receiver operating characteristic (ROC) curves
abc of epidemiology http://www.kidney-international.org & 29 International Society of Nephrology Diagnostic methods 2: receiver operating characteristic (ROC) curves Giovanni Tripepi 1, Kitty J. Jager
More informationMultivariate meta-analysis using individual participant data
Original Article Received 19 February 2014, Revised 10 October 2014, Accepted 17 October 2014 Published online 21 November 2014 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/jrsm.1129 Multivariate
More informationThe SAGE Encyclopedia of Educational Research, Measurement, and Evaluation Multivariate Analysis of Variance
The SAGE Encyclopedia of Educational Research, Measurement, Multivariate Analysis of Variance Contributors: David W. Stockburger Edited by: Bruce B. Frey Book Title: Chapter Title: "Multivariate Analysis
More informationSystematic reviews of prognostic studies: a meta-analytical approach
Systematic reviews of prognostic studies: a meta-analytical approach Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group (Co-convenors: Doug Altman, Katrina Williams, Jill
More informationClinical Epidemiology for the uninitiated
Clinical epidemiologist have one foot in clinical care and the other in clinical practice research. As clinical epidemiologists we apply a wide array of scientific principles, strategies and tactics to
More informationBiostatistics II
Biostatistics II 514-5509 Course Description: Modern multivariable statistical analysis based on the concept of generalized linear models. Includes linear, logistic, and Poisson regression, survival analysis,
More informationExplaining heterogeneity
Explaining heterogeneity Julian Higgins School of Social and Community Medicine, University of Bristol, UK Outline 1. Revision and remarks on fixed-effect and random-effects metaanalysis methods (and interpretation
More informationHayden Smith, PhD, MPH /\ v._
Hayden Smith, PhD, MPH.. + /\ v._ Information and clinical examples provided in presentation are strictly for educational purposes, and should not be substituted for clinical guidelines or up-to-date medical
More informationThe spectrum effect in tests for risk prediction, screening, and diagnosis
open access The spectrum effect in tests for risk prediction, screening, and diagnosis Juliet A Usher-Smith, Stephen J Sharp, Simon J Griffin, The Primary Care Unit, University of Cambridge, Strangeways
More informationCite this article as: BMJ, doi: /bmj (published 18 July 2006)
Systematic of diagnostic tests in cancer: review of methods and reporting Susan Mallett, Jonathan J Deeks, Steve Halligan, Sally Hopewell, Victoria Cornelius, Douglas G Altman Abstract Objectives To assess
More informationComparison of 18 FDG PET/PET-CT and bone scintigraphy for detecting bone metastases in patients with nasopharyngeal cancer: a meta-analysis
/, 2017, Vol. 8, (No. 35), pp: 59740-59747 Comparison of FDG PET/PET-CT and bone scintigraphy for detecting bone metastases in patients with nasopharyngeal cancer: a meta-analysis Chuanhui Xu 1,*, Ruiming
More informationAppendix 1. Sensitivity analysis for ACQ: missing value analysis by multiple imputation
Appendix 1 Sensitivity analysis for ACQ: missing value analysis by multiple imputation A sensitivity analysis was carried out on the primary outcome measure (ACQ) using multiple imputation (MI). MI is
More informationMETHODS FOR DETECTING CERVICAL CANCER
Chapter III METHODS FOR DETECTING CERVICAL CANCER 3.1 INTRODUCTION The successful detection of cervical cancer in a variety of tissues has been reported by many researchers and baseline figures for the
More informationCHAPTER VI RESEARCH METHODOLOGY
CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the
More informationAccuracy of enzyme-linked immunospot assay for diagnosis of pleural tuberculosis: a meta-analysis
Accuracy of enzyme-linked immunospot assay for diagnosis of pleural tuberculosis: a meta-analysis Z.Z. Li 1, W.Z. Qin 1, L. Li 1, Q. Wu 1 and Y.J. Wang 1,2 1 West China School of Medicine/West China Hospital,
More informationConfounding by indication developments in matching, and instrumental variable methods. Richard Grieve London School of Hygiene and Tropical Medicine
Confounding by indication developments in matching, and instrumental variable methods Richard Grieve London School of Hygiene and Tropical Medicine 1 Outline 1. Causal inference and confounding 2. Genetic
More informationinvestigate. educate. inform.
investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced
More informationFixed Effect Combining
Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse
More informationDiagnostic accuracy of interferon-gamma in pericardial effusions for tuberculous pericarditis: a meta-analysis
Original Article Diagnostic accuracy of interferon-gamma in pericardial effusions for tuberculous pericarditis: a meta-analysis Chao Liu 1 *, Yun-Liang Cui 2 *, Chun-Mei Ding 3, Yan-Hua Wu 3, Hui-Li Li
More informationMachine learning II. Juhan Ernits ITI8600
Machine learning II Juhan Ernits ITI8600 Hand written digit recognition 64 Example 2: Face recogition Classification, regression or unsupervised? How many classes? Example 2: Face recognition Classification,
More informationSociology 63993, Exam1 February 12, 2015 Richard Williams, University of Notre Dame,
Sociology 63993, Exam1 February 12, 2015 Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ I. True-False. (20 points) Indicate whether the following statements are true or false.
More informationMODEL SELECTION STRATEGIES. Tony Panzarella
MODEL SELECTION STRATEGIES Tony Panzarella Lab Course March 20, 2014 2 Preamble Although focus will be on time-to-event data the same principles apply to other outcome data Lab Course March 20, 2014 3
More informationEconomic Evaluations and Diagnostic Testing: Sanghera, Sabina; Orlando, Rosa; Roberts, Tracy
Economic Evaluations and Diagnostic Testing: Sanghera, Sabina; Orlando, Rosa; Roberts, Tracy DOI: 10.1017/S0266462312000682 License: None: All rights reserved Document Version Publisher's PDF, also known
More informationA NEW TRIAL DESIGN FULLY INTEGRATING BIOMARKER INFORMATION FOR THE EVALUATION OF TREATMENT-EFFECT MECHANISMS IN PERSONALISED MEDICINE
A NEW TRIAL DESIGN FULLY INTEGRATING BIOMARKER INFORMATION FOR THE EVALUATION OF TREATMENT-EFFECT MECHANISMS IN PERSONALISED MEDICINE Dr Richard Emsley Centre for Biostatistics, Institute of Population
More informationDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta GA, USA.
A More Intuitive Interpretation of the Area Under the ROC Curve A. Cecile J.W. Janssens, PhD Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta GA, USA. Corresponding
More informationThe Relative Performance of Full Information Maximum Likelihood Estimation for Missing Data in Structural Equation Models
University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Educational Psychology Papers and Publications Educational Psychology, Department of 7-1-2001 The Relative Performance of
More informationList of Figures. List of Tables. Preface to the Second Edition. Preface to the First Edition
List of Figures List of Tables Preface to the Second Edition Preface to the First Edition xv xxv xxix xxxi 1 What Is R? 1 1.1 Introduction to R................................ 1 1.2 Downloading and Installing
More informationRevised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials
Revised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials Edited by Julian PT Higgins on behalf of the RoB 2.0 working group on cross-over trials
More informationWhere a licence is displayed above, please note the terms and conditions of the licence govern your use of this document.
Multivariate meta-analysis using individual participant data Riley, Richard; Price, Malcolm; Jackson, D.; Wardle, M.; Gueyffier, F.; Wang, J.; Staessen, J. A.; White, I. R. DOI: 10.1002/jrsm.1129 License:
More informationBehavioral Data Mining. Lecture 4 Measurement
Behavioral Data Mining Lecture 4 Measurement Outline Hypothesis testing Parametric statistical tests Non-parametric tests Precision-Recall plots ROC plots Hardware update Icluster machines are ready for
More informationJournal of Biostatistics and Epidemiology
Journal of Biostatistics and Epidemiology J Biostat Epidemiol. 2018; 4(2): 15-25 Original Article Comparison of the accuracy of beta-binomial, multinomial, dirichlet-multinomial, and ordinal regression
More informationEvidence-Based Medicine: Diagnostic study
Evidence-Based Medicine: Diagnostic study What is Evidence-Based Medicine (EBM)? Expertise in integrating 1. Best research evidence 2. Clinical Circumstance 3. Patient values in clinical decisions Haynes,
More informationRAG Rating Indicator Values
Technical Guide RAG Rating Indicator Values Introduction This document sets out Public Health England s standard approach to the use of RAG ratings for indicator values in relation to comparator or benchmark
More informationDesign and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP I 5/2/2016
Design and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP233201500069I 5/2/2016 Overview The goal of the meta-analysis is to assess the effects
More informationChecklist for Diagnostic Test Accuracy Studies. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews
The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Diagnostic Test Accuracy Studies http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org
More informationBiometrical Journal 52 (2010) 61, zzz zzz / DOI: /bimj
Biometrical Journal 52 (2010) 61, zzz zzz / DOI: 10.1002/bimj.200100000 A comparison of bivariate, multivariate random-effects, and Poisson correlated gamma-frailty models to meta-analyze individual patient
More informationModule 14: Missing Data Concepts
Module 14: Missing Data Concepts Jonathan Bartlett & James Carpenter London School of Hygiene & Tropical Medicine Supported by ESRC grant RES 189-25-0103 and MRC grant G0900724 Pre-requisites Module 3
More information