Meta-analysis of external validation studies
|
|
- Lesley Boone
- 6 years ago
- Views:
Transcription
1 Meta-analysis of external validation studies Thomas Debray, PhD Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, The Netherlands Cochrane Netherlands, Utrecht, The Netherlands
2 Meta-analysis of external validation studies - Introduction Prediction ˆ Turn available information about individuals into a statement about the probability:... of having a particular disease diagnosis... of developing a particular event prognosis ˆ Use of multiple predictors Subject characteristics History and physical examination results Imaging results (Bio)markers ˆ Typical aims to inform patients and their families to guide treatment and other clinical decisions to create risk groups Vigo, July 10, 2017 TPA Debray 2/23
3 Meta-analysis of external validation studies - Introduction What is a good model? Accurate predictions CALIBRATION DISCRIMINATION IMPACT Improve patient outcomes Ability to distinguish between low and high risk patients Good and consistent performance across different settings and populations GENERALITY SUPPORT Influence decision making Vigo, July 10, 2017 TPA Debray 3/23
4 Meta-analysis of external validation studies - Introduction Numerous models for same target population + outcomes 1995 We believe that the main reasons why doctors reject published prognostic models are lack of clinical credibility and lack of evidence that a prognostic model can support decisions about patient care. Wyatt JC, Altman DG. Commentary: Prognostic models: clinically useful or quickly forgotten? BMJ. 1995;311(7019): Vigo, July 10, 2017 TPA Debray 4/23
5 Meta-analysis of external validation studies - Introduction Numerous models for same target population + outcomes Comparing risk prediction models should be routine when deriving a new model for the same purpose Collins GS, Moons KGM. Comparing risk prediction models. BMJ. 2012;344:e3186 e3186. Vigo, July 10, 2017 TPA Debray 5/23
6 Meta-analysis of external validation studies - Introduction Numerous models for same target population + outcomes There is an excess of models predicting incident CVD in the general population. The usefulness of most of the models remains unclear. Damen JAAG, Hooft L, et al. Prediction models for cardiovascular disease risk in the general population: systematic review. BMJ. 2016;353:i2416. Vigo, July 10, 2017 TPA Debray 6/23
7 Meta-analysis of external validation studies - Introduction Numerous models for same target population + outcomes Formal guidance for systematic review and meta-analysis Vigo, July 10, 2017 TPA Debray 7/23
8 Motivating example Previous guidance focused on meta-analysis of logistic regression models. Hence, focus of today is on survival models. Framingham Risk Score (Wilson et al. 1998) ˆ Model type: Cox regression ˆ Outcome: Fatal or non-fatal coronary heart disease (CHD) ˆ Timing: Initial CHD within 10 years ˆ Evidence: 24 validations in male populations Summarize estimates of model performance ˆ Concordance statistic (cstat) ˆ Ratio of observed versus expected events (OE) ˆ Calibration slope (slope) Vigo, July 10, 2017 TPA Debray 8/23
9 Statistical framework - data extraction Key problem: Poor and inconsistent reporting of prediction model performance. Standard error of the c-statistic [ ] c (1 c) 1 + n 1 c 2 c + m c 1+c SE(c) mn with c the reported c-statistic, n the number of observed events, m the total number of non-events and m = n = 1 2 (m + n) 1. Newcombe RG. Confidence intervals for an effect size measure based on the Mann-Whitney statistic. Part 2: asymptotic methods and evaluation. Stat Med. 2006;25(4): Vigo, July 10, 2017 TPA Debray 9/23
10 Estimated versus reported standard error of the c-statistic EuroSCORE II Framingham Reported standard error Estimated standard error Vigo, July 10, 2017 TPA Debray 10/23
11 Statistical framework - data extraction Ratio of observed versus expected events ˆ Reference value: 1 ˆ Observed survival probability (S KM,t ) ˆ Expected (predicted) event rate (P E,t ) (O:E) t = 1 S KM,t P E,t SE(O:E) t = 1 P E,t SE(S KM,t ) If unavailable, SE(S KM,t ) can be approximated as well: SE(S KM,t ) S KM,t (1 S KM,t ) N t Vigo, July 10, 2017 TPA Debray 11/23
12 Extraction of event rates: an example Vigo, July 10, 2017 TPA Debray 12/23
13 Statistical framework - data extraction Calibration slope ˆ Reference value: 1 ˆ The calibration slope β is calculated as follows using IPD: y k Bernoulli(p k ) logit(p k ) = α + β LP k ˆ When missing, we can derive β from reported event counts across j risk strata (e.g. as presented in calibration tables): O j Binom(N j, p O,j ) logit(p O,j ) = η + β logit(p E,j ) Vigo, July 10, 2017 TPA Debray 13/23
14 Extracted risk estimates for the Framingham Risk Score Observed risk Expected risk The diagonal line indicates perfect calibration. Risk estimates were reported for 5 years follow-up (dashed lines), 7.5 years follow-up (dotted lines) and 10 years follow-up (full lines).
15 Statistical framework - data extraction #validations analysed reported study authors approximated cstat SE.cstat OE slope For 10 studies, calibration performance was only available for < 10 years follow-up. Vigo, July 10, 2017 TPA Debray 15/23
16 Statistical framework - meta-analysis models Meta-analysis of the c-statistic ˆ Need to apply logit transformation logit(c i ) N ( µ discr, Var (logit(c i )) + τdiscr 2 ) ˆ Use delta method to derive Var (logit(c i )) from SE(c i ) ˆ For Bayesian models, we propose weakly informative priors: µ discr N (0, 10 6 ) τdiscr Unif(0, 2) τdiscr Student-t(0, 0.5 2, 3) T [0, 10] based on empirical data from 26 meta-analyses (with ˆτ discr ranging from 0 to 0.50). Vigo, July 10, 2017 TPA Debray 16/23
17 Statistical framework - meta-analysis models Meta-analysis of the c-statistic Estimation K Summary 95% CI 95% PI REML Bayesian (Unif) Bayesian (Student-t) For 3 studies, we did not have information on c i but could nevertheless approximate SE(c i ). Vigo, July 10, 2017 TPA Debray 17/23
18 Statistical framework - meta-analysis models Meta-analysis of the total O:E ratio We can use different models to account for sampling variability: Option 1 ln(o:e) i N ( µ cal.oe, Var (ln(o:e) i ) + τcal.oe 2 ) Option 2 O i Binom (N i, p O,i ) E i Binom (N i, p E,i ) ln (p O,i /p E,i ) N ( µ cal.oe, τcal.oe 2 ) Option 3 O i Poisson (E i exp(η i )) η i N ( µ cal.oe, τcal.oe 2 ) For all models, the interpretation of µ cal.oe and τ cal.oe is the same. Vigo, July 10, 2017 TPA Debray 18/23
19 Statistical framework - meta-analysis models Meta-analysis of the total O:E ratio (c ed) ˆ For Bayesian models, we propose weakly informative priors: µ cal.oe N (0, 10 6 ) τ cal.oe Unif(0, 2) τcal.oe Student-t(0, 1.5 2, 3) T [0, 10] based on empirical data from 16 meta-analyses (with ˆτ cal.oe ranging from 0 to 1.39). ˆ Possible to extrapolate event rates at time l to time t using: ( ) t ln(1 pl ) p t = 1 S KM,t = 1 exp l Straightforward to integrate in Bayesian estimation framework Vigo, July 10, 2017 TPA Debray 19/23
20 Statistical framework - meta-analysis models Meta-analysis of the total O:E ratio Estimation K Summary 95% CI 95% PI REML Bayesian 1 (Unif) Bayesian 1 (Student-t) ML Bayesian 3 (Unif) Bayesian 3 (Student-t) When applying extrapolation, we have 10 additional studies for meta-analysis (similar results). Vigo, July 10, 2017 TPA Debray 20/23
21 Statistical framework - meta-analysis models Meta-analysis of the calibration slope ˆ No transformations needed ˆ Rely on binomial approximation O ij Binom(N ij, p O,ij ) logit(p O,ij ) = α i + β i logit(p E,ij ) β i N (µ cal.slope, τ 2 cal.slope ) ˆ For Bayesian models, we propose weakly informative priors: µcal.slope N (0, 10 6 ) τcal.slope Unif(0, 2) τ cal.slope Student-t(0, 1.5 2, 3) T [0, 10] Vigo, July 10, 2017 TPA Debray 21/23
22 Statistical framework - meta-analysis models Meta-analysis of the calibration slope Estimation K Summary 95% CI 95% PI ML Bayesian Bayesian When applying extrapolation, we have 8 additional studies for meta-analysis (similar results but smaller intervals). Vigo, July 10, 2017 TPA Debray 22/23
23 Meta-analysis of external validation studies - Conclusion Final remarks ˆ Substantial efforts often needed to restore missing information ˆ Bayesian estimation methods recommended to fully propagate uncertainty arising from data restoration ˆ Development of R package metamisc to assist in data preparation and meta-analysis ˆ Presence of statistical heterogeneity most likely ˆ Straightforward extension to meta-regression and multivariate meta-analysis Vigo, July 10, 2017 TPA Debray 23/23
Systematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies
Systematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group Conflict
More informationSystematic reviews of prognostic studies: a meta-analytical approach
Systematic reviews of prognostic studies: a meta-analytical approach Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group (Co-convenors: Doug Altman, Katrina Williams, Jill
More informationIndividual Participant Data (IPD) Meta-analysis of prediction modelling studies
Individual Participant Data (IPD) Meta-analysis of prediction modelling studies Thomas Debray, PhD Julius Center for Health Sciences and Primary Care Utrecht, The Netherlands March 7, 2016 Prediction
More informationExternal validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges
open access External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges Richard D Riley, Joie Ensor, Kym I E Snell, 2 Thomas
More informationSystematic reviews of prediction modeling studies: planning, critical appraisal and data collection
Systematic reviews of prediction modeling studies: planning, critical appraisal and data collection Karel GM Moons, Lotty Hooft, Hans Reitsma, Thomas Debray Dutch Cochrane Center Julius Center for Health
More informationSummarising and validating test accuracy results across multiple studies for use in clinical practice
Summarising and validating test accuracy results across multiple studies for use in clinical practice Richard D. Riley Professor of Biostatistics Research Institute for Primary Care & Health Sciences Thank
More informationMeta-analysis of few small studies in small populations and rare diseases
Meta-analysis of few small studies in small populations and rare diseases Christian Röver 1, Beat Neuenschwander 2, Simon Wandel 2, Tim Friede 1 1 Department of Medical Statistics, University Medical Center
More informationMeta-analysis of two studies in the presence of heterogeneity with applications in rare diseases
Meta-analysis of two studies in the presence of heterogeneity with applications in rare diseases Christian Röver 1, Tim Friede 1, Simon Wandel 2 and Beat Neuenschwander 2 1 Department of Medical Statistics,
More informationMeta-analysis of clinical prediction models
Meta-analysis of clinical prediction models Thomas P. A. Debray Julius Center for Health Sciences and Primary Care Utrecht University Meta-analysis of clinical prediction models Julius Center for Health
More informationDevelopment, validation and application of risk prediction models
Development, validation and application of risk prediction models G. Colditz, E. Liu, M. Olsen, & others (Ying Liu, TA) 3/28/2012 Risk Prediction Models 1 Goals Through examples, class discussion, and
More informationFrom single studies to an EBM based assessment some central issues
From single studies to an EBM based assessment some central issues Doug Altman Centre for Statistics in Medicine, Oxford, UK Prognosis Prognosis commonly relates to the probability or risk of an individual
More informationMeta-analysis using individual participant data: one-stage and two-stage approaches, and why they may differ
Tutorial in Biostatistics Received: 11 March 2016, Accepted: 13 September 2016 Published online 16 October 2016 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/sim.7141 Meta-analysis using
More informationAdvanced IPD meta-analysis methods for observational studies
Advanced IPD meta-analysis methods for observational studies Simon Thompson University of Cambridge, UK Part 4 IBC Victoria, July 2016 1 Outline of talk Usual measures of association (e.g. hazard ratios)
More informationWeb Extra material. Comparison of non-laboratory-based risk scores for predicting the occurrence of type 2
Web Extra material Comparison of non-laboratory-based risk scores for predicting the occurrence of type 2 diabetes in the general population: the EPIC-InterAct Study Outline Supplementary Figures Legend...
More informationMethods for meta-analysis of individual participant data from Mendelian randomization studies with binary outcomes
Methods for meta-analysis of individual participant data from Mendelian randomization studies with binary outcomes Stephen Burgess Simon G. Thompson CRP CHD Genetics Collaboration May 24, 2012 Abstract
More informationBayesian meta-analysis of Papanicolaou smear accuracy
Gynecologic Oncology 107 (2007) S133 S137 www.elsevier.com/locate/ygyno Bayesian meta-analysis of Papanicolaou smear accuracy Xiuyu Cong a, Dennis D. Cox b, Scott B. Cantor c, a Biometrics and Data Management,
More informationDetecting small-study effects and funnel plot asymmetry in meta-analysis of survival data: A comparison of new and existing tests
Received: 24 January 2017 Revised: 17 August 2017 Accepted: 7 September 2017 DOI: 10.1002/jrsm.1266 RESEARCH ARTICLE Detecting small-study effects and funnel plot asymmetry in meta-analysis of survival
More informationMethods for evidence synthesis in the case of very few studies. Guido Skipka IQWiG, Cologne, Germany
Methods for evidence synthesis in the case of very few studies Guido Skipka IQWiG, Cologne, Germany 17 September 2018 Cochrane Colloquium 2018, Edinburgh, Statistical Methods Group meeting, G. Skipka 2
More informationModels for potentially biased evidence in meta-analysis using empirically based priors
Models for potentially biased evidence in meta-analysis using empirically based priors Nicky Welton Thanks to: Tony Ades, John Carlin, Doug Altman, Jonathan Sterne, Ross Harris RSS Avon Local Group Meeting,
More informationIt s hard to predict!
Statistical Methods for Prediction Steven Goodman, MD, PhD With thanks to: Ciprian M. Crainiceanu Associate Professor Department of Biostatistics JHSPH 1 It s hard to predict! People with no future: Marilyn
More informationMultivariate meta-analysis for non-linear and other multi-parameter associations
Research Article Received 9 August 2011, Accepted 11 May 2012 Published online 16 July 2012 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/sim.5471 Multivariate meta-analysis for non-linear
More informationStudy protocol v. 1.0 Systematic review of the Sequential Organ Failure Assessment score as a surrogate endpoint in randomized controlled trials
Study protocol v. 1.0 Systematic review of the Sequential Organ Failure Assessment score as a surrogate endpoint in randomized controlled trials Harm Jan de Grooth, Jean Jacques Parienti, [to be determined],
More informationIntroduction to Meta-analysis of Accuracy Data
Introduction to Meta-analysis of Accuracy Data Hans Reitsma MD, PhD Dept. of Clinical Epidemiology, Biostatistics & Bioinformatics Academic Medical Center - Amsterdam Continental European Support Unit
More informationTreatment effect estimates adjusted for small-study effects via a limit meta-analysis
Treatment effect estimates adjusted for small-study effects via a limit meta-analysis Gerta Rücker 1, James Carpenter 12, Guido Schwarzer 1 1 Institute of Medical Biometry and Medical Informatics, University
More informationAnalysis of left-censored multiplex immunoassay data: A unified approach
1 / 41 Analysis of left-censored multiplex immunoassay data: A unified approach Elizabeth G. Hill Medical University of South Carolina Elizabeth H. Slate Florida State University FSU Department of Statistics
More informationExplicit inclusion of treatment in prognostic modelling was recommended in observational and randomised settings
Accepted Manuscript Explicit inclusion of treatment in prognostic modelling was recommended in observational and randomised settings R.H.H. Groenwold, K.G.M. Moons, R. Pajouheshnia, D.G. Altman, G.S. Collins,
More informationMethods Research Report. An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy
Methods Research Report An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy Methods Research Report An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy
More informationAn Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy
Number XX An Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy Prepared for: Agency for Healthcare Research and Quality U.S. Department of Health and Human Services 54 Gaither
More informationUsing Statistical Principles to Implement FDA Guidance on Cardiovascular Risk Assessment for Diabetes Drugs
Using Statistical Principles to Implement FDA Guidance on Cardiovascular Risk Assessment for Diabetes Drugs David Manner, Brenda Crowe and Linda Shurzinske BASS XVI November 9-13, 2009 Acknowledgements
More informationEstimating interaction on an additive scale between continuous determinants in a logistic regression model
Int. J. Epidemiol. Advance Access published August 27, 2007 Published by Oxford University Press on behalf of the International Epidemiological Association ß The Author 2007; all rights reserved. International
More informationApplications of Bayesian methods in health technology assessment
Working Group "Bayes Methods" Göttingen, 06.12.2018 Applications of Bayesian methods in health technology assessment Ralf Bender Institute for Quality and Efficiency in Health Care (IQWiG), Germany Outline
More informationA Comparison of Methods of Estimating Subscale Scores for Mixed-Format Tests
A Comparison of Methods of Estimating Subscale Scores for Mixed-Format Tests David Shin Pearson Educational Measurement May 007 rr0701 Using assessment and research to promote learning Pearson Educational
More informationModelling Spatially Correlated Survival Data for Individuals with Multiple Cancers
Modelling Spatially Correlated Survival Data for Individuals with Multiple Cancers Dipak K. Dey, Ulysses Diva and Sudipto Banerjee Department of Statistics University of Connecticut, Storrs. March 16,
More informationSISCR Module 7 Part I: Introduction Basic Concepts for Binary Biomarkers (Classifiers) and Continuous Biomarkers
SISCR Module 7 Part I: Introduction Basic Concepts for Binary Biomarkers (Classifiers) and Continuous Biomarkers Kathleen Kerr, Ph.D. Associate Professor Department of Biostatistics University of Washington
More informationModule Overview. What is a Marker? Part 1 Overview
SISCR Module 7 Part I: Introduction Basic Concepts for Binary Classification Tools and Continuous Biomarkers Kathleen Kerr, Ph.D. Associate Professor Department of Biostatistics University of Washington
More informationMultivariate meta-analysis using individual participant data
Original Article Received 19 February 2014, Revised 10 October 2014, Accepted 17 October 2014 Published online 21 November 2014 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/jrsm.1129 Multivariate
More informationUsing mixture priors for robust inference: application in Bayesian dose escalation trials
Using mixture priors for robust inference: application in Bayesian dose escalation trials Astrid Jullion, Beat Neuenschwander, Daniel Lorand BAYES2014, London, 11 June 2014 Agenda Dose escalation in oncology
More informationBayesian random-effects meta-analysis made simple
Bayesian random-effects meta-analysis made simple Christian Röver 1, Beat Neuenschwander 2, Simon Wandel 2, Tim Friede 1 1 Department of Medical Statistics, University Medical Center Göttingen, Göttingen,
More informationAn Introduction to Bayesian Statistics
An Introduction to Bayesian Statistics Robert Weiss Department of Biostatistics UCLA Fielding School of Public Health robweiss@ucla.edu Sept 2015 Robert Weiss (UCLA) An Introduction to Bayesian Statistics
More informationStatistical Tolerance Regions: Theory, Applications and Computation
Statistical Tolerance Regions: Theory, Applications and Computation K. KRISHNAMOORTHY University of Louisiana at Lafayette THOMAS MATHEW University of Maryland Baltimore County Contents List of Tables
More informationSummary of main challenges and future directions
Summary of main challenges and future directions Martin Schumacher Institute of Medical Biometry and Medical Informatics, University Medical Center, Freiburg Workshop October 2008 - F1 Outline Some historical
More informationThe prevalence and history of knee osteoarthritis in general practice: a case control study
The Author (2005). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oupjournals.org doi:10.1093/fampra/cmh700 Family Practice Advance Access
More informationAJAE appendix for Defining Access to Health Care: Evidence on the Importance of. Quality and Distance in Rural Tanzania * Heather Klemick
AJAE appendix for Defining Access to Health Care: Evidence on the Importance of Quality and Distance in Rural Tanzania * Heather Klemick Kenneth L. Leonard Melkiory C. Masatu, M.D. October 3, 2008 Note:
More informationDesign and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP I 5/2/2016
Design and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP233201500069I 5/2/2016 Overview The goal of the meta-analysis is to assess the effects
More informationCHAMP: CHecklist for the Appraisal of Moderators and Predictors
CHAMP - Page 1 of 13 CHAMP: CHecklist for the Appraisal of Moderators and Predictors About the checklist In this document, a CHecklist for the Appraisal of Moderators and Predictors (CHAMP) is presented.
More informationAN INDEPENDENT VALIDATION OF QRISK ON THE THIN DATABASE
AN INDEPENDENT VALIDATION OF QRISK ON THE THIN DATABASE Dr Gary S. Collins Professor Douglas G. Altman Centre for Statistics in Medicine University of Oxford TABLE OF CONTENTS LIST OF TABLES... 3 LIST
More informationHierarchical Bayesian Modeling of Individual Differences in Texture Discrimination
Hierarchical Bayesian Modeling of Individual Differences in Texture Discrimination Timothy N. Rubin (trubin@uci.edu) Michael D. Lee (mdlee@uci.edu) Charles F. Chubb (cchubb@uci.edu) Department of Cognitive
More informationKernel Density Estimation for Random-effects Meta-analysis
International Journal of Mathematical Sciences in Medicine (013) 1 5 Kernel Density Estimation for Random-effects Meta-analysis Branko Miladinovic 1, Ambuj Kumar 1 and Benjamin Djulbegovic 1, 1 University
More informationPractical Bayesian Design and Analysis for Drug and Device Clinical Trials
Practical Bayesian Design and Analysis for Drug and Device Clinical Trials p. 1/2 Practical Bayesian Design and Analysis for Drug and Device Clinical Trials Brian P. Hobbs Plan B Advisor: Bradley P. Carlin
More informationReporting and Methods in Clinical Prediction Research: A Systematic Review
Reporting and Methods in Clinical Prediction Research: A Systematic Review Walter Bouwmeester 1., Nicolaas P. A. Zuithoff 1., Susan Mallett 2, Mirjam I. Geerlings 1, Yvonne Vergouwe 1,3, Ewout W. Steyerberg
More informationTemplate 1 for summarising studies addressing prognostic questions
Template 1 for summarising studies addressing prognostic questions Instructions to fill the table: When no element can be added under one or more heading, include the mention: O Not applicable when an
More informationMeta-analyses triggered by previous (false-)significant findings: problems and solutions
Schuit et al. Systematic Reviews (2015) 4:57 DOI 10.1186/s13643-015-0048-9 METHODOLOGY Open Access Meta-analyses triggered by previous (false-)significant findings: problems and solutions Ewoud Schuit
More informationPrediction models for cardiovascular disease risk in the general population: systematic review
open access Prediction models for cardiovascular disease risk in the general population: systematic review Johanna A A G Damen, 1, 2 Lotty Hooft, 1, 2 Ewoud Schuit, 1, 2, 3 Thomas P A Debray, 1, 2 Gary
More informationEstimating HIV incidence in the United States from HIV/AIDS surveillance data and biomarker HIV test results
STATISTICS IN MEDICINE Statist. Med. 2008; 27:4617 4633 Published online 4 August 2008 in Wiley InterScience (www.interscience.wiley.com).3144 Estimating HIV incidence in the United States from HIV/AIDS
More informationBeyond RevMan: Meta-Regression. Analysis in Context
Beyond RevMan: Meta-Regression Analysis in Context Robin Christensen, MSc, Biostatistician The Parker Institute: Musculoskeletal Statistics Unit Frederiksberg Hospital Copenhagen, Denmark Statistical Editor
More informationGenetic risk prediction for CHD: will we ever get there or are we already there?
Genetic risk prediction for CHD: will we ever get there or are we already there? Themistocles (Tim) Assimes, MD PhD Assistant Professor of Medicine Stanford University School of Medicine WHI Investigators
More informationSensitivity, specicity, ROC
Sensitivity, specicity, ROC Thomas Alexander Gerds Department of Biostatistics, University of Copenhagen 1 / 53 Epilog: disease prevalence The prevalence is the proportion of cases in the population today.
More informationToday: Binomial response variable with an explanatory variable on an ordinal (rank) scale.
Model Based Statistics in Biology. Part V. The Generalized Linear Model. Single Explanatory Variable on an Ordinal Scale ReCap. Part I (Chapters 1,2,3,4), Part II (Ch 5, 6, 7) ReCap Part III (Ch 9, 10,
More informationBayesian Dose Escalation Study Design with Consideration of Late Onset Toxicity. Li Liu, Glen Laird, Lei Gao Biostatistics Sanofi
Bayesian Dose Escalation Study Design with Consideration of Late Onset Toxicity Li Liu, Glen Laird, Lei Gao Biostatistics Sanofi 1 Outline Introduction Methods EWOC EWOC-PH Modifications to account for
More informationBayesian hierarchical modelling
Bayesian hierarchical modelling Matthew Schofield Department of Mathematics and Statistics, University of Otago Bayesian hierarchical modelling Slide 1 What is a statistical model? A statistical model:
More informationCombining Predictors for Classification Using the Area Under the ROC Curve
UW Biostatistics Working Paper Series 6-7-2004 Combining Predictors for Classification Using the Area Under the ROC Curve Margaret S. Pepe University of Washington, mspepe@u.washington.edu Tianxi Cai Harvard
More informationFixed Effect Combining
Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse
More informationOverview of Multivariable Prediction Modelling. Methodological Conduct & Reporting: Introducing TRIPOD guidelines
Overview of Multivariable Prediction Modelling Methodological Conduct & Reporting: Introducing TRIPOD guidelines Gary Collins Centre for Statistics in Medicine www.csm-oxford.org.uk University of Oxford
More informationSmall-area estimation of mental illness prevalence for schools
Small-area estimation of mental illness prevalence for schools Fan Li 1 Alan Zaslavsky 2 1 Department of Statistical Science Duke University 2 Department of Health Care Policy Harvard Medical School March
More informationWhat is probability. A way of quantifying uncertainty. Mathematical theory originally developed to model outcomes in games of chance.
Outline What is probability Another definition of probability Bayes Theorem Prior probability; posterior probability How Bayesian inference is different from what we usually do Example: one species or
More informationEmpirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests
Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Yemisi Takwoingi, Richard Riley and Jon Deeks Outline Rationale Methods Findings Summary Motivating
More informationDiscrimination and Reclassification in Statistics and Study Design AACC/ASN 30 th Beckman Conference
Discrimination and Reclassification in Statistics and Study Design AACC/ASN 30 th Beckman Conference Michael J. Pencina, PhD Duke Clinical Research Institute Duke University Department of Biostatistics
More informationReflection Questions for Math 58B
Reflection Questions for Math 58B Johanna Hardin Spring 2017 Chapter 1, Section 1 binomial probabilities 1. What is a p-value? 2. What is the difference between a one- and two-sided hypothesis? 3. What
More information5/10/2010. ISPOR Good Research Practices for Comparative Effectiveness Research: Indirect Treatment Comparisons Task Force
ISPOR Good Research Practices for Comparative Effectiveness Research: Indirect Treatment Comparisons Task Force Presentation of Two Draft Reports 17 May 2010 ITC Task Force: Leadership Team Lieven Annemans
More informationPerformance Assessment for Radiologists Interpreting Screening Mammography
Performance Assessment for Radiologists Interpreting Screening Mammography Dawn Woodard School of Operations Research and Information Engineering Cornell University Joint work with: Alan Gelfand Department
More informationStandards for Heterogeneity of Treatment Effect (HTE)
Standards for Heterogeneity of Treatment Effect (HTE) Ravi Varadhan, PhD (Biostat), PhD (Chem.Engg) Chenguang Wang, PhD (Statistics) Johns Hopkins University July 21, 2015 Module 1 Introduction Objectives
More informationPRACTICAL STATISTICS FOR MEDICAL RESEARCH
PRACTICAL STATISTICS FOR MEDICAL RESEARCH Douglas G. Altman Head of Medical Statistical Laboratory Imperial Cancer Research Fund London CHAPMAN & HALL/CRC Boca Raton London New York Washington, D.C. Contents
More informationCancer Incidence Predictions (Finnish Experience)
Cancer Incidence Predictions (Finnish Experience) Tadeusz Dyba Joint Research Center EPAAC Workshop, January 22-23 2014, Ispra Rational for making cancer incidence predictions Administrative: to plan the
More informationSome alternatives for Inhomogeneous Poisson Point Processes for presence only data
Some alternatives for Inhomogeneous Poisson Point Processes for presence only data Hassan Doosti Macquarie University hassan.doosti@mq.edu.au July 6, 2017 Hassan Doosti (MQU) Inhomogeneous Spatial Point
More informationCorrelation and regression
PG Dip in High Intensity Psychological Interventions Correlation and regression Martin Bland Professor of Health Statistics University of York http://martinbland.co.uk/ Correlation Example: Muscle strength
More informationDownloaded from:
Hemingway, H; Croft, P; Perel, P; Hayden, JA; Abrams, K; Timmis, A; Briggs, A; Udumyan, R; Moons, KG; Steyerberg, EW; Roberts, I; Schroter, S; Altman, DG; Riley, RD; PROGRESS Group (2013) Prognosis research
More informationWhere a licence is displayed above, please note the terms and conditions of the licence govern your use of this document.
Multivariate meta-analysis using individual participant data Riley, Richard; Price, Malcolm; Jackson, D.; Wardle, M.; Gueyffier, F.; Wang, J.; Staessen, J. A.; White, I. R. DOI: 10.1002/jrsm.1129 License:
More informationEPI 200C Final, June 4 th, 2009 This exam includes 24 questions.
Greenland/Arah, Epi 200C Sp 2000 1 of 6 EPI 200C Final, June 4 th, 2009 This exam includes 24 questions. INSTRUCTIONS: Write all answers on the answer sheets supplied; PRINT YOUR NAME and STUDENT ID NUMBER
More informationIdentifying patients with undetected pancreatic cancer in primary care:
Research Gary S Collins and Douglas G Altman Identifying patients with undetected pancreatic cancer in primary care: an independent and external validation of QCancer (Pancreas) Abstract Background Despite
More informationEvidence synthesis with limited studies
Evidence synthesis with limited studies Incorporating genuine prior information about between-study heterogeneity PSI conference 2018 Dr. Shijie (Kate) Ren, Research Fellow, School of Health and Related
More informationImproved control for confounding using propensity scores and instrumental variables?
Improved control for confounding using propensity scores and instrumental variables? Dr. Olaf H.Klungel Dept. of Pharmacoepidemiology & Clinical Pharmacology, Utrecht Institute of Pharmaceutical Sciences
More informationSeeing the Forest & Trees: novel analyses of complex interventions to guide health system decision making
Seeing the Forest & Trees: novel analyses of complex interventions to guide health system decision making Noah Ivers MD CCFP PhD Family Physician, Women s College Hospital Scientist, Women s College Research
More informationEmpirical evidence on sources of bias in randomised controlled trials: methods of and results from the BRANDO study
Empirical evidence on sources of bias in randomised controlled trials: methods of and results from the BRANDO study Jonathan Sterne, University of Bristol, UK Acknowledgements: Tony Ades, Bodil Als-Nielsen,
More informationBayesian Modeling of Multivariate Spatial Binary Data with Application to Dental Caries
Bayesian Modeling of Multivariate Spatial Binary Data with Application to Dental Caries Dipankar Bandyopadhyay dbandyop@umn.edu Division of Biostatistics, School of Public Health University of Minnesota
More informationSTATISTICAL METHODS FOR DIAGNOSTIC TESTING: AN ILLUSTRATION USING A NEW METHOD FOR CANCER DETECTION XIN SUN. PhD, Kansas State University, 2012
STATISTICAL METHODS FOR DIAGNOSTIC TESTING: AN ILLUSTRATION USING A NEW METHOD FOR CANCER DETECTION by XIN SUN PhD, Kansas State University, 2012 A THESIS Submitted in partial fulfillment of the requirements
More informationOverview. All-cause mortality for males with colon cancer and Finnish population. Relative survival
An overview and some recent advances in statistical methods for population-based cancer survival analysis: relative survival, cure models, and flexible parametric models Paul W Dickman 1 Paul C Lambert
More informationBayes-Verfahren in klinischen Studien
Bayes-Verfahren in klinischen Studien Dr. rer. nat. Joachim Gerß, Dipl.-Stat. joachim.gerss@ukmuenster.de Institute of Biostatistics and Clinical Research J. Gerß: Bayesian Methods in Clinical Trials 2
More informationBiostatistics Primer
BIOSTATISTICS FOR CLINICIANS Biostatistics Primer What a Clinician Ought to Know: Subgroup Analyses Helen Barraclough, MSc,* and Ramaswamy Govindan, MD Abstract: Large randomized phase III prospective
More informationLec 02: Estimation & Hypothesis Testing in Animal Ecology
Lec 02: Estimation & Hypothesis Testing in Animal Ecology Parameter Estimation from Samples Samples We typically observe systems incompletely, i.e., we sample according to a designed protocol. We then
More informationDesigning a Bayesian randomised controlled trial in osteosarcoma. How to incorporate historical data?
Designing a Bayesian randomised controlled trial in osteosarcoma: How to incorporate historical data? C. Brard, L.V Hampson, M-C Le Deley, G. Le Teuff SCT - Montreal, May 18th 2016 Brard et al. Designing
More information(A) (B) 2019 American Diabetes Association. Published online at
Supplementary Figure S1. Risk of bias for all included trials Studies were rated Low Risk of Bias if the study design is unlikely to have little influence over the true outcome; High Risk of Bias if the
More informationTWISTED SURVIVAL: IDENTIFYING SURROGATE ENDPOINTS FOR MORTALITY USING QTWIST AND CONDITIONAL DISEASE FREE SURVIVAL. Beth A.
TWISTED SURVIVAL: IDENTIFYING SURROGATE ENDPOINTS FOR MORTALITY USING QTWIST AND CONDITIONAL DISEASE FREE SURVIVAL by Beth A. Zamboni BS Statistics, University of Pittsburgh, 1997 MS Biostatistics, Harvard
More informationRAG Rating Indicator Values
Technical Guide RAG Rating Indicator Values Introduction This document sets out Public Health England s standard approach to the use of RAG ratings for indicator values in relation to comparator or benchmark
More informationKarel G.M. Moons UMC Utrecht Julius Center for Health Sciences and Primary Care,
Prediction Models From development to validation to clinical impact Karel G.M. Moons UMC Utrecht Julius Center for Health Sciences and Primary Care, www.juliuscenter.nl Summary of various papers/consortia
More informationSystematic Reviews and meta-analyses of Diagnostic Test Accuracy. Mariska Leeflang
Systematic Reviews and meta-analyses of Diagnostic Test Accuracy Mariska Leeflang m.m.leeflang@amc.uva.nl This presentation 1. Introduction: accuracy? 2. QUADAS-2 exercise 3. Meta-analysis of diagnostic
More informationHeart Rate in Patients with Coronary Artery Disease - the Lower the Better? An Analysis from the Treating to New Targets (TNT) trial
Heart Rate in Patients with Coronary Artery Disease - the Lower the Better? An Analysis from the Treating to New Targets (TNT) trial Sripal Bangalore, MD, MHA, Chuan-Chuan Wun, PhD, David A DeMicco, PharmD,
More informationSample size and power calculations in Mendelian randomization with a single instrumental variable and a binary outcome
Sample size and power calculations in Mendelian randomization with a single instrumental variable and a binary outcome Stephen Burgess July 10, 2013 Abstract Background: Sample size calculations are an
More informationToday Retrospective analysis of binomial response across two levels of a single factor.
Model Based Statistics in Biology. Part V. The Generalized Linear Model. Chapter 18.3 Single Factor. Retrospective Analysis ReCap. Part I (Chapters 1,2,3,4), Part II (Ch 5, 6, 7) ReCap Part III (Ch 9,
More informationA note on the graphical presentation of prediction intervals in random-effects meta-analyses
Guddat et al. Systematic Reviews 2012, 1:34 METHODOLOGY A note on the graphical presentation of prediction intervals in random-effects meta-analyses Charlotte Guddat 1*, Ulrich Grouven 1,2, Ralf Bender
More informationSummary HTA. HTA-Report Summary
Summary HTA HTA-Report Summary Prognostic value, clinical effectiveness and cost-effectiveness of high sensitivity C-reactive protein as a marker in primary prevention of major cardiac events Schnell-Inderst
More information