Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co.

Size: px
Start display at page:

Download "Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co."

Transcription

1 Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co.

2 Meta-Analysis Defined A meta-analysis is: the statistical combination of two or more separate studies In other words: overview, pooling, data synthesis, and quantitative review

3 Why Perform A Meta- Analysis? Meta-analysis of multiple trials should enhance the precision of estimates of treatment effect from individual clinical studies Greater estimate of precision may: accelerate changes in treatment adoption avoid unnecessary or harmful treatments eliminate the need for further clinical trials Meta-analysis can be used to examine or establish a research hypothesis

4 Types of Meta-Analysis Traditional (aggregate data) metaanalysis Cumulative meta-analysis Individual patient meta-analysis

5 Meta-Analysis: Effect Size vs. Direction Anticipated Unexpected Meta-analyses are predicated on the assumption that effects are more likely to differ in size than in direction Line of equivalence

6 Features of the Forest Plot Weight (%) Each study is represented by a point estimate and specified confidence interval (CI) Size of point estimate is proportional to the contribution each study makes to the metaanalysis. This is indicated by the weight Smaller studies tend to have wider CIs but this is not important in meta-analysis what matters is the consistency of the trend between studies Meta-analysis effect size estimate (including CI) appears as a diamond at the bottom of the plot. This is the grand mean Line of equivalence

7 Principles of Evidence-Based Medicine First principle There is a hierarchy of evidence Some evidence is stronger than others Use evidence from the top of the hierarchy (or as high as possible) for each clinical decision Second principle Evidence itself is never enough to make clinical decisions or recommendations Always use evidence and value judgment Guyatt et al 1999

8 Hierarchy of Evidence Meta-analysis of RCTs systematic review of RCTs Individual RCT Observational studies patient-important outcomes Basic research test tube, animal, human physiology Clinical experience nonsystematic clinical observation

9 Key Question What is the process of developing a clinical recommendation that follows from the principles of evidence-based medicine? Define the question Gather the evidence Summarize the evidence Make a judgment on the evidence Guyatt et al 1999

10 Gathering the Evidence Identifying and selecting evidence explicit and sensible process Systematic overview appropriate inclusion and exclusion criteria comprehensive search databases, citations, unpublished data reproducible assessments Hayward et al 1995

11 Summarizing the Evidence Quantitative summary Meta-analysis Relative risk reduction Absolute risk reduction Quality Summary Completeness of studies

12 Why Meta-Analysis? Meta-analysis of multiple trials provides more reliable indications of drug efficacy than studying individual trials separately (Guyatt et al., 1999) Meta-analysis provides guidance as to the approximate effect of treatment in patients studied in the trials and more importantly to the likely effect of treatment in future patients outside of the trials (Peto, 1987) Meta-analysis provides a logical framework to a research review (Dickersin & Berlin, 1992)

13 Well done Meta-Analyses are critical Components that facilitate the Practice of EBM Did the overview address a focused clinical question? Were the selection criteria used to select studies for inclusion appropriate? Is it likely that important relevant studies were missed? Publication bias Studies where this outcome was secondary endpoint Subgroups from large studies

14 Meta-analysis: The Key Assumption It is reasonable to assume that if trials address related questions then there there will be a tendency for the answers to come out in the same direction. It is this tendency that we are trying to detect in an overview.

15 The missing data problem Systematic reviews lose their credibility when done with missing data Missing at random Selection bias Poor quality and hence not published Deliberate: don t like the results Studies not accessible Positive studies are more likely than to be published Use of composite endpoints

16 Possible Effect of Publication Bias Reported Missing Studies Overviews of trials are based on the assumption that there was completeness of information

17 Meta-analysis: Corrected for Missing

18 Identifying Bias in Meta-Analysis (1) The Funnel Plot A plot of effect size versus study size Large studies are at the top of the plot (because effect estimate is usually relatively small) Small studies are at the bottom of the plot (because effect estimate is usually relatively large) If there is no bias, the plot is symmetrical If there is bias, the plot is asymmetrical The type of asymmetry may indicate the type of bias

19 Some Funnel Plot Profiles Publication bias Methodology bias Publication deficit in this area Effect size Effect size

20 Correcting for Publication Bias in Meta-Analysis What can be done to correct for publication bias in meta-analysis? Not very much! Correction of treatment effect estimates for bias should be avoided as such corrections may depend heavily on the assumptions made. Sterne JAC et al. BMJ 2001;323:101-5.

21 Completeness of Data A complete clinical trial registry will provide a path to ensure completeness of information Overviews are usually post hoc Affords us the opportunity of prespecification Meta-analysis is only as strong as the weakest link

22 Sensitivity Analysis Sensitivity analysis is a method for determining whether a particular study or factor has overly influenced the results of a meta-analysis Systematically omit data one study at a time to see whether the omission of that study has a substantial effect on the overall metaanalysis results Apply a range of reasonable assumptions about the value of the factor of interest to see whether the meta-analysis results are robust to variations in the value of that factor

23 Sensitivity Analysis: Is The Overall Treatment Effect Seen Consistently In Every Study? Grand mean of 4 studies 29% (p = 0.012) Study 1 omitted Study 2 omitted Study 3 omitted Study 4 omitted Relative risk

24 Sensitivity Analysis: Is The Overall Treatment Effect Seen Consistently In Every Study? Grand mean of 5 studies 35% (p = 0.005) Study 1 omitted Study 2 omitted Study 3 omitted Study 4 omitted Study 5 omitted Relative risk

25 An Essential Principle of EBM All data are important! Not all will contribute directly to the summary Need for completeness to make recommendation useful

26 Consequences of Publication Bias Can affect answers to key questions Are the results of the overview valid? What are the results? Will the results help in caring for patients? Guyatt et al 1993

27 Will the results help in Evidence- Based Clinical Care? Use of evidence in decision-making Allows identification of best evidence Estimate of magnitude of treatment effect Quantify the impact on individual patients Evidence to action Evidence-based medicine facilitates explicit acknowledgment of patient values in decision-making Facilitates choice of style and philosophy of patientdoctor relationship

28 Summary The big picture is what matters To appreciate the big picture you need an overview An overview is best achieved from metaanalysis of all relevant RCTs Failure to obtain all the evidence is likely to result in a biased selection Peto: Stat Med 1987; 6:

Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death. Debra Moy Faculty of Pharmacy University of Toronto

Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death. Debra Moy Faculty of Pharmacy University of Toronto Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death Debra Moy Faculty of Pharmacy University of Toronto Goal To provide practitioners with a systematic approach to evaluating a meta analysis

More information

How to Conduct a Meta-Analysis

How to Conduct a Meta-Analysis How to Conduct a Meta-Analysis Faculty Development and Diversity Seminar ludovic@bu.edu Dec 11th, 2017 Periodontal disease treatment and preterm birth We conducted a metaanalysis of randomized controlled

More information

Meta-Analysis. Zifei Liu. Biological and Agricultural Engineering

Meta-Analysis. Zifei Liu. Biological and Agricultural Engineering Meta-Analysis Zifei Liu What is a meta-analysis; why perform a metaanalysis? How a meta-analysis work some basic concepts and principles Steps of Meta-analysis Cautions on meta-analysis 2 What is Meta-analysis

More information

Meta Analysis. David R Urbach MD MSc Outcomes Research Course December 4, 2014

Meta Analysis. David R Urbach MD MSc Outcomes Research Course December 4, 2014 Meta Analysis David R Urbach MD MSc Outcomes Research Course December 4, 2014 Overview Definitions Identifying studies Appraising studies Quantitative synthesis Presentation of results Examining heterogeneity

More information

Clinical research in AKI Timing of initiation of dialysis in AKI

Clinical research in AKI Timing of initiation of dialysis in AKI Clinical research in AKI Timing of initiation of dialysis in AKI Josée Bouchard, MD Krescent Workshop December 10 th, 2011 1 Acute kidney injury in ICU 15 25% of critically ill patients experience AKI

More information

Systematic Reviews and Meta- Analysis in Kidney Transplantation

Systematic Reviews and Meta- Analysis in Kidney Transplantation Systematic Reviews and Meta- Analysis in Kidney Transplantation Greg Knoll MD MSc Associate Professor of Medicine Medical Director, Kidney Transplantation University of Ottawa and The Ottawa Hospital KRESCENT

More information

Critical appraisal: Systematic Review & Meta-analysis

Critical appraisal: Systematic Review & Meta-analysis Critical appraisal: Systematic Review & Meta-analysis Atiporn Ingsathit MD.PhD. Section for Clinical Epidemiology and biostatistics Faculty of Medicine Ramathibodi Hospital Mahidol University What is a

More information

SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS

SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS A Case Study By Anil Khedkar, India (Masters in Pharmaceutical Science, PhD in Clinical Research Student of Texila American University)

More information

Research Synthesis and meta-analysis: themes. Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH

Research Synthesis and meta-analysis: themes. Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH Research Synthesis and meta-analysis: themes Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH Today Course format Goals, competencies Overview of themes for the class SRMA M19-551 Course Format Lectures»

More information

Principles of meta-analysis

Principles of meta-analysis Principles of meta-analysis 1 The popularity of meta-analyses Search on 22 October 2015 10000 9000 8156 8875 8000 7000 6554 6000 5000 4852 4000 3000 2000 1000 0 1 1 1 272 334 371 323 386 429 482 596 639

More information

Evaluating the results of a Systematic Review/Meta- Analysis

Evaluating the results of a Systematic Review/Meta- Analysis Open Access Publication Evaluating the results of a Systematic Review/Meta- Analysis by Michael Turlik, DPM 1 The Foot and Ankle Online Journal 2 (7): 5 This is the second of two articles discussing the

More information

Are the likely benefits worth the potential harms and costs? From McMaster EBCP Workshop/Duke University Medical Center

Are the likely benefits worth the potential harms and costs? From McMaster EBCP Workshop/Duke University Medical Center CRITICAL REVIEW FORM FOR THERAPY STUDY Did experimental and control groups begin the study with a similar prognosis? Were patients randomized? Was randomization concealed? Were patients analyzed in the

More information

The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews

The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews David Moher 1, Alessandro Liberati 2, Douglas G Altman 3, Jennifer Tetzlaff 1 for the QUOROM Group

More information

Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist.

Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. MOOSE Checklist Infliximab reduces hospitalizations and surgery interventions in patients with inflammatory bowel disease:

More information

Performance of the Trim and Fill Method in Adjusting for the Publication Bias in Meta-Analysis of Continuous Data

Performance of the Trim and Fill Method in Adjusting for the Publication Bias in Meta-Analysis of Continuous Data American Journal of Applied Sciences 9 (9): 1512-1517, 2012 ISSN 1546-9239 2012 Science Publication Performance of the Trim and Fill Method in Adjusting for the Publication Bias in Meta-Analysis of Continuous

More information

Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias

Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias Technical appendix Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias Choice of axis in funnel plots Funnel plots were first used in educational research and psychology,

More information

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health.

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health. Workshop: Cochrane Rehabilitation 05th May 2018 Trusted evidence. Informed decisions. Better health. Disclosure I have no conflicts of interest with anything in this presentation How to read a systematic

More information

Fixed Effect Combining

Fixed Effect Combining Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse

More information

What is indirect comparison?

What is indirect comparison? ...? series New title Statistics Supported by sanofi-aventis What is indirect comparison? Fujian Song BMed MMed PhD Reader in Research Synthesis, Faculty of Health, University of East Anglia Indirect comparison

More information

Systematic Reviews and Meta-analysis

Systematic Reviews and Meta-analysis Systematic Reviews and Meta-analysis Introduction to Clinical Research: A Two-week Intensive Course July 22, 2014 Sonal Singh, MD, MPH Assistant Professor Key messages Systematic reviews (SR) summarize

More information

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews J Nurs Sci Vol.28 No.4 Oct - Dec 2010 Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews Jeanne Grace Corresponding author: J Grace E-mail: Jeanne_Grace@urmc.rochester.edu

More information

Tiago Villanueva MD Associate Editor, The BMJ. 9 January Dear Dr. Villanueva,

Tiago Villanueva MD Associate Editor, The BMJ. 9 January Dear Dr. Villanueva, Tiago Villanueva MD Associate Editor, The BMJ 9 January 2018 Dear Dr. Villanueva, Thank you for your thoughtful re-review of our Manuscript (BMJ.2017.041528) entitled "Immune-related Toxicities in PD-1

More information

Introduction to systematic reviews/metaanalysis

Introduction to systematic reviews/metaanalysis Introduction to systematic reviews/metaanalysis Hania Szajewska The Medical University of Warsaw Department of Paediatrics hania@ipgate.pl Do I needknowledgeon systematicreviews? Bastian H, Glasziou P,

More information

The Royal College of Pathologists Journal article evaluation questions

The Royal College of Pathologists Journal article evaluation questions The Royal College of Pathologists Journal article evaluation questions Previous exam questions Dorrian CA, Toole, BJ, Alvarez-Madrazo S, Kelly A, Connell JMC, Wallace AM. A screening procedure for primary

More information

Applying Evidence-Based Practice with Meta-Analysis

Applying Evidence-Based Practice with Meta-Analysis Applying Evidence-Based Practice with Meta-Analysis Mike W.-L. Cheung, PhD 1 1 March 2018 1 Department of Psychology, National University of Singapore (NUS) 1 A little bit background about me (1) PhD:

More information

Meta-analysis of diagnostic research. Karen R Steingart, MD, MPH Chennai, 15 December Overview

Meta-analysis of diagnostic research. Karen R Steingart, MD, MPH Chennai, 15 December Overview Meta-analysis of diagnostic research Karen R Steingart, MD, MPH karenst@uw.edu Chennai, 15 December 2010 Overview Describe key steps in a systematic review/ meta-analysis of diagnostic test accuracy studies

More information

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard

More information

Further data analysis topics

Further data analysis topics Further data analysis topics Jonathan Cook Centre for Statistics in Medicine, NDORMS, University of Oxford EQUATOR OUCAGS training course 24th October 2015 Outline Ideal study Further topics Multiplicity

More information

Cochrane Breast Cancer Group

Cochrane Breast Cancer Group Cochrane Breast Cancer Group Version and date: V3.2, September 2013 Intervention Cochrane Protocol checklist for authors This checklist is designed to help you (the authors) complete your Cochrane Protocol.

More information

Models for potentially biased evidence in meta-analysis using empirically based priors

Models for potentially biased evidence in meta-analysis using empirically based priors Models for potentially biased evidence in meta-analysis using empirically based priors Nicky Welton Thanks to: Tony Ades, John Carlin, Doug Altman, Jonathan Sterne, Ross Harris RSS Avon Local Group Meeting,

More information

Cochrane Pregnancy and Childbirth Group Methodological Guidelines

Cochrane Pregnancy and Childbirth Group Methodological Guidelines Cochrane Pregnancy and Childbirth Group Methodological Guidelines [Prepared by Simon Gates: July 2009, updated July 2012] These guidelines are intended to aid quality and consistency across the reviews

More information

Systematic Reviews. Simon Gates 8 March 2007

Systematic Reviews. Simon Gates 8 March 2007 Systematic Reviews Simon Gates 8 March 2007 Contents Reviewing of research Why we need reviews Traditional narrative reviews Systematic reviews Components of systematic reviews Conclusions Key reference

More information

EPSE 594: Meta-Analysis: Quantitative Research Synthesis

EPSE 594: Meta-Analysis: Quantitative Research Synthesis EPSE 594: Meta-Analysis: Quantitative Research Synthesis Ed Kroc University of British Columbia ed.kroc@ubc.ca March 28, 2019 Ed Kroc (UBC) EPSE 594 March 28, 2019 1 / 32 Last Time Publication bias Funnel

More information

Fundamental Clinical Trial Design

Fundamental Clinical Trial Design Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003

More information

GUIDELINE COMPARATORS & COMPARISONS:

GUIDELINE COMPARATORS & COMPARISONS: GUIDELINE COMPARATORS & COMPARISONS: Direct and indirect comparisons Adapted version (2015) based on COMPARATORS & COMPARISONS: Direct and indirect comparisons - February 2013 The primary objective of

More information

Downloaded from:

Downloaded from: Hemingway, H; Croft, P; Perel, P; Hayden, JA; Abrams, K; Timmis, A; Briggs, A; Udumyan, R; Moons, KG; Steyerberg, EW; Roberts, I; Schroter, S; Altman, DG; Riley, RD; PROGRESS Group (2013) Prognosis research

More information

5/10/2010. ISPOR Good Research Practices for Comparative Effectiveness Research: Indirect Treatment Comparisons Task Force

5/10/2010. ISPOR Good Research Practices for Comparative Effectiveness Research: Indirect Treatment Comparisons Task Force ISPOR Good Research Practices for Comparative Effectiveness Research: Indirect Treatment Comparisons Task Force Presentation of Two Draft Reports 17 May 2010 ITC Task Force: Leadership Team Lieven Annemans

More information

In many healthcare situations, it is common to find

In many healthcare situations, it is common to find Interpreting and Using Meta-Analysis in Clinical Practice Cheryl Holly Jason T. Slyer Systematic reviews, which can include a meta-analysis, are considered the gold standard for determination of best practice.

More information

Determinants of quality: Factors that lower or increase the quality of evidence

Determinants of quality: Factors that lower or increase the quality of evidence Determinants of quality: Factors that lower or increase the quality of evidence GRADE Workshop CBO, NHG and Dutch Cochrane Centre CBO, April 17th, 2013 Outline The GRADE approach: step by step Factors

More information

MSc Programme in International Health Epidemiology and Statistics. Before lecture exercise. Aims of the lecture

MSc Programme in International Health Epidemiology and Statistics. Before lecture exercise. Aims of the lecture MSc Programme in International Health Epidemiology and Statistics Why was the advert for Actimel banned by the ASA? Lecture 9 1 Before lecture exercise Select 10 red tiles and 10 blue tiles at random from

More information

Index. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI /

Index. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI / Index A Adjusted Heterogeneity without Overdispersion, 63 Agenda-driven bias, 40 Agenda-Driven Meta-Analyses, 306 307 Alternative Methods for diagnostic meta-analyses, 133 Antihypertensive effect of potassium,

More information

Meta-analysis: Advanced methods using the STATA software

Meta-analysis: Advanced methods using the STATA software Page 1 sur 5 Wednesday 20 September 2017 - Introduction to meta-analysis Introduction I. Why do a meta-analysis? II. How does a meta-analysis work? Some concepts III. Definition of an «effect size» 1.

More information

Evidence Based Medicine

Evidence Based Medicine Course Goals Goals 1. Understand basic concepts of evidence based medicine (EBM) and how EBM facilitates optimal patient care. 2. Develop a basic understanding of how clinical research studies are designed

More information

Standards for the reporting of new Cochrane Intervention Reviews

Standards for the reporting of new Cochrane Intervention Reviews Methodological Expectations of Cochrane Intervention Reviews (MECIR) Standards for the reporting of new Cochrane Intervention Reviews 24 September 2012 Preface The standards below summarize proposed attributes

More information

Live WebEx meeting agenda

Live WebEx meeting agenda 10:00am 10:30am Using OpenMeta[Analyst] to extract quantitative data from published literature Live WebEx meeting agenda August 25, 10:00am-12:00pm ET 10:30am 11:20am Lecture (this will be recorded) 11:20am

More information

CRITICAL APPRAISAL WORKSHEET 1

CRITICAL APPRAISAL WORKSHEET 1 For Residents CRITICAL APPRAISAL WORKSHEET 1 AN ARTICLE ON THERAPY This worksheet should be submitted along with the completed Submission Form to your supervisor. It is based on the articles on therapy

More information

EBP STEP 2. APPRAISING THE EVIDENCE : So how do I know that this article is any good? (Quantitative Articles) Alison Hoens

EBP STEP 2. APPRAISING THE EVIDENCE : So how do I know that this article is any good? (Quantitative Articles) Alison Hoens EBP STEP 2 APPRAISING THE EVIDENCE : So how do I know that this article is any good? (Quantitative Articles) Alison Hoens Clinical Assistant Prof, UBC Clinical Coordinator, PHC Maggie McIlwaine Clinical

More information

Methodological standards for the conduct of new Cochrane Intervention Reviews Version 2.1, 8 December 2011

Methodological standards for the conduct of new Cochrane Intervention Reviews Version 2.1, 8 December 2011 Methodological Expectations of Cochrane Intervention Reviews (MECIR) Methodological standards for the conduct of new Cochrane Intervention Reviews Version 2.1, 8 December 2011 Jackie Chandler, Rachel Churchill,

More information

GLOSSARY OF GENERAL TERMS

GLOSSARY OF GENERAL TERMS GLOSSARY OF GENERAL TERMS Absolute risk reduction Absolute risk reduction (ARR) is the difference between the event rate in the control group (CER) and the event rate in the treated group (EER). ARR =

More information

ISPOR Task Force Report: ITC & NMA Study Questionnaire

ISPOR Task Force Report: ITC & NMA Study Questionnaire INDIRECT TREATMENT COMPARISON / NETWORK META-ANALYSIS STUDY QUESTIONNAIRE TO ASSESS RELEVANCE AND CREDIBILITY TO INFORM HEALTHCARE DECISION-MAKING: AN ISPOR-AMCP-NPC GOOD PRACTICE TASK FORCE REPORT DRAFT

More information

JBI GRADE Research School Workshop. Presented by JBI Adelaide GRADE Centre Staff

JBI GRADE Research School Workshop. Presented by JBI Adelaide GRADE Centre Staff JBI GRADE Research School Workshop Presented by JBI Adelaide GRADE Centre Staff Declarations of Interest Presented by members of the GRADE Working Group www.gradeworkinggroup.org The Joanna Briggs Institute

More information

Meta-Analyses: Considerations for Probiotics & Prebiotics Studies

Meta-Analyses: Considerations for Probiotics & Prebiotics Studies Meta-Analyses: Considerations for Probiotics & Prebiotics Studies Daniel J. Tancredi, PhD Associate Professor in Residence Department of Pediatrics UC Davis School of Medicine Objectives Provide an overview

More information

SUPPLEMENTARY DATA. Supplementary Figure S1. Search terms*

SUPPLEMENTARY DATA. Supplementary Figure S1. Search terms* Supplementary Figure S1. Search terms* *mh = exploded MeSH: Medical subject heading (Medline medical index term); tw = text word; pt = publication type; the asterisk (*) stands for any character(s) #1:

More information

The Cochrane Collaboration, the US Cochrane Center, and The Cochrane Library

The Cochrane Collaboration, the US Cochrane Center, and The Cochrane Library The Cochrane Collaboration, the US Cochrane Center, and The Cochrane Library Kay Dickersin, PhD Association for Population/Family Planning Libraries & Information Centers International Boston, Ma 30 March

More information

Using Evidence-Based Practice in Social Work Denise Bronson, MSW, Ph.D. The Ohio State University College of Social Work

Using Evidence-Based Practice in Social Work Denise Bronson, MSW, Ph.D. The Ohio State University College of Social Work Using Evidence-Based Practice in Social Work Denise Bronson, MSW, Ph.D. The Ohio State University College of Social Work Bronson.6@osu.edu Goals for today s webinar What is Evidence-Based Practice (EBP)?

More information

Summarizing the Evidence. Cathleen Colon-Emeric, MD, MHS Jane Gagliardi, MD, MHS

Summarizing the Evidence. Cathleen Colon-Emeric, MD, MHS Jane Gagliardi, MD, MHS Summarizing the Evidence Cathleen Colon-Emeric, MD, MHS Jane Gagliardi, MD, MHS Objectives Define a systematic review, meta-analysis What they can and can t do for you Explain terms of Heterogeneity Weighting

More information

Evidence Based Medicine

Evidence Based Medicine Hamadan University of medical sciences School of Public Health Department of Epidemiology Evidence Based Medicine Amin Doosti-Irani, PhD in Epidemiology 10 March 2017 a_doostiirani@yahoo.com 1 Outlines

More information

Learning objectives. Examining the reliability of published research findings

Learning objectives. Examining the reliability of published research findings Examining the reliability of published research findings Roger Chou, MD Associate Professor of Medicine Department of Medicine and Department of Medical Informatics and Clinical Epidemiology Scientific

More information

18/11/2013. An Introduction to Meta-analysis. In this session: What is meta-analysis? Some Background Clinical Trials. What questions are addressed?

18/11/2013. An Introduction to Meta-analysis. In this session: What is meta-analysis? Some Background Clinical Trials. What questions are addressed? In this session: What is meta-analysis? An Introduction to Meta-analysis Geoff Der Unit Statistician MRC/CSO Social and Public Health Sciences Unit, University of Glasgow When is it appropriate to use?

More information

Trials and Tribulations of Systematic Reviews and Meta-Analyses

Trials and Tribulations of Systematic Reviews and Meta-Analyses Trials and Tribulations of Systematic Reviews and Meta-Analyses Mark A. Crowther and Deborah J. Cook St. Joseph s Hospital, Hamilton, Ontario, Canada; McMaster University, Hamilton, Ontario, Canada Systematic

More information

Overview and Comparisons of Risk of Bias and Strength of Evidence Assessment Tools: Opportunities and Challenges of Application in Developing DRIs

Overview and Comparisons of Risk of Bias and Strength of Evidence Assessment Tools: Opportunities and Challenges of Application in Developing DRIs Workshop on Guiding Principles for the Inclusion of Chronic Diseases Endpoints in Future Dietary Reference Intakes (DRIs) Overview and Comparisons of Risk of Bias and Strength of Evidence Assessment Tools:

More information

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2018

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2018 GRADE Grading of Recommendations Assessment, Development and Evaluation British Association of Dermatologists April 2018 Previous grading system Level of evidence Strength of recommendation Level of evidence

More information

Meta-analysis of safety thoughts from CIOMS X

Meta-analysis of safety thoughts from CIOMS X CIOMS Working Group X Meta-analysis of safety thoughts from CIOMS X Stephen.Evans@Lshtm.ac.uk Improving health worldwide www.lshtm.ac.uk Evans: ENCePP CIOMS Meta Analysis 1 Acknowledgements, conflicts,

More information

Title: Efficacy and Safety of Prophylactic Vaccines against Cervical HPV Infection and Diseases among Women: A Systematic Review & Meta-Analysis

Title: Efficacy and Safety of Prophylactic Vaccines against Cervical HPV Infection and Diseases among Women: A Systematic Review & Meta-Analysis Author's response to reviews Title: Efficacy and Safety of Prophylactic Vaccines against Cervical HPV Infection and Diseases among Women: A Systematic Review & Meta-Analysis Authors: Beibei Lu (beibei.lu@moffitt.org)

More information

Robert M. Jacobson, M.D. Department of Pediatric and Adolescent Medicine Mayo Clinic, Rochester, Minnesota

Robert M. Jacobson, M.D. Department of Pediatric and Adolescent Medicine Mayo Clinic, Rochester, Minnesota How to Conduct a Systematic Review: A Workshop 24 th Annual Primary Care Research Methods & Statistics Conference, San Antonio, Texas Saturday, December 3, 2011 Robert M. Jacobson, M.D. Department of Pediatric

More information

Assessing the risk of outcome reporting bias in systematic reviews

Assessing the risk of outcome reporting bias in systematic reviews Assessing the risk of outcome reporting bias in systematic reviews Kerry Dwan (kdwan@liv.ac.uk) Jamie Kirkham (jjk@liv.ac.uk) ACKNOWLEDGEMENTS: Doug G Altman, Carrol Gamble, Paula R Williamson Funding:

More information

Coping with Publication and Reporting Biases in Research Reviews

Coping with Publication and Reporting Biases in Research Reviews Bryn Mawr College Scholarship, Research, and Creative Work at Bryn Mawr College Graduate School of Social Work and Social Research Faculty Research and Scholarship Graduate School of Social Work and Social

More information

CRITICAL APPRAISAL OF CLINICAL PRACTICE GUIDELINE (CPG)

CRITICAL APPRAISAL OF CLINICAL PRACTICE GUIDELINE (CPG) CRITICAL APPRAISAL OF CLINICAL PRACTICE GUIDELINE (CPG) Atiporn Ingsathit MD, PhD. 1 Rationale for Clinical Practice Guidelines Worldwide concerns about: Unexplained variations in clinical practice Rising

More information

Incorporating Clinical Information into the Label

Incorporating Clinical Information into the Label ECC Population Health Group LLC expertise-driven consulting in global maternal-child health & pharmacoepidemiology Incorporating Clinical Information into the Label Labels without Categories: A Workshop

More information

How to do a meta-analysis. Orestis Efthimiou Dpt. Of Hygiene and Epidemiology, School of Medicine University of Ioannina, Greece

How to do a meta-analysis. Orestis Efthimiou Dpt. Of Hygiene and Epidemiology, School of Medicine University of Ioannina, Greece How to do a meta-analysis Orestis Efthimiou Dpt. Of Hygiene and Epidemiology, School of Medicine University of Ioannina, Greece 1 Overview (A brief reminder of ) What is a Randomized Controlled Trial (RCT)

More information

Types of Data. Systematic Reviews: Data Synthesis Professor Jodie Dodd 4/12/2014. Acknowledgements: Emily Bain Australasian Cochrane Centre

Types of Data. Systematic Reviews: Data Synthesis Professor Jodie Dodd 4/12/2014. Acknowledgements: Emily Bain Australasian Cochrane Centre Early Nutrition Workshop, December 2014 Systematic Reviews: Data Synthesis Professor Jodie Dodd 1 Types of Data Acknowledgements: Emily Bain Australasian Cochrane Centre 2 1 What are dichotomous outcomes?

More information

Avoiding common errors in research reporting:

Avoiding common errors in research reporting: Avoiding common errors in research reporting: Increasing usability (and potential impact) of your research Iveta Simera Outline Common reporting deficiencies in published research Particularly those limiting

More information

EPSE 594: Meta-Analysis: Quantitative Research Synthesis

EPSE 594: Meta-Analysis: Quantitative Research Synthesis EPSE 594: Meta-Analysis: Quantitative Research Synthesis Ed Kroc University of British Columbia ed.kroc@ubc.ca March 14, 2019 Ed Kroc (UBC) EPSE 594 March 14, 2019 1 / 39 Last Time Synthesizing multiple

More information

CEU screening programme: Overview of common errors & good practice in Cochrane intervention reviews

CEU screening programme: Overview of common errors & good practice in Cochrane intervention reviews CEU screening programme: Overview of common errors & good practice in Cochrane intervention reviews Since September 2013, the CEU has been responsible for pre-publication screening of new intervention

More information

Surveillance report Published: 6 April 2016 nice.org.uk. NICE All rights reserved.

Surveillance report Published: 6 April 2016 nice.org.uk. NICE All rights reserved. Surveillance report 2016 Chronic obstructive pulmonary disease in over 16s: diagnosis and management (2010) NICE guideline CG101 Surveillance report Published: 6 April 2016 nice.org.uk NICE 2016. All rights

More information

Data extraction. Specific interventions included in the review Dressings and topical agents in relation to wound healing.

Data extraction. Specific interventions included in the review Dressings and topical agents in relation to wound healing. Systematic reviews of wound care management: (2) dressings and topical agents used in the healing of chronic wounds Bradley M, Cullum N, Nelson E A, Petticrew M, Sheldon T, Torgerson D Authors' objectives

More information

EVIDENCE DETECTIVES December 28, 2005 Edward Amores, M.D. Reviewed and edited by P. Wyer, M.D. Part I Question Formulation

EVIDENCE DETECTIVES December 28, 2005 Edward Amores, M.D. Reviewed and edited by P. Wyer, M.D. Part I Question Formulation EVIDENCE DETECTIVES December 28, 2005 Edward Amores, M.D. Reviewed and edited by P. Wyer, M.D. Part I Question Formulation Clinical Scenario Quite often in the Pediatric ED and at times in the adult ED

More information

Guidance Document for Claims Based on Non-Inferiority Trials

Guidance Document for Claims Based on Non-Inferiority Trials Guidance Document for Claims Based on Non-Inferiority Trials February 2013 1 Non-Inferiority Trials Checklist Item No Checklist Item (clients can use this tool to help make decisions regarding use of non-inferiority

More information

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai Systematic reviews: From evidence to recommendation Session 2 - June 18, 2014 Going beyond design, going beyond intervention: The American Academy of Neurology (AAN) Clinical Practice Guideline process

More information

Retrieving and appraising systematic reviews

Retrieving and appraising systematic reviews Retrieving and appraising systematic reviews rslavik@interchange.ubc.ca Richard S. Slavik, Pharm.D. Pharmacotherapeutic Specialist Critical Care CSU Pharmaceutical Sciences Vancouver Hospital & Health

More information

Alcohol interventions in secondary and further education

Alcohol interventions in secondary and further education National Institute for Health and Care Excellence Guideline version (Draft for Consultation) Alcohol interventions in secondary and further education NICE guideline: methods NICE guideline Methods

More information

To evaluate a single epidemiological article we need to know and discuss the methods used in the underlying study.

To evaluate a single epidemiological article we need to know and discuss the methods used in the underlying study. Critical reading 45 6 Critical reading As already mentioned in previous chapters, there are always effects that occur by chance, as well as systematic biases that can falsify the results in population

More information

Meta-analysis: Methodology

Meta-analysis: Methodology Meta-analysis: Methodology Example: Assessment of cardiovascular safety profile of new generation BCR-ABL TKIs in patients with CML Haguet Hélène 04/03/2016 Meta-analysis = statistical combination of results

More information

Standards for the conduct and reporting of new Cochrane Intervention Reviews 2012

Standards for the conduct and reporting of new Cochrane Intervention Reviews 2012 Methodological Expectations of Cochrane Intervention Reviews (MECIR) s for the conduct and reporting of new Cochrane Intervention Reviews 2012 Booklet Version 2 September 2013 1 Preface Cochrane Reviews

More information

Safeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines

Safeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines Safeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines Rob Hemmings Statistics Unit Manager, MHRA CHMP member Chair, CHMP Scientific Advice Working Party Biostatistics

More information

Application of human epidemiological studies to pesticide risk assessment

Application of human epidemiological studies to pesticide risk assessment Workshop What does the future hold for harmonised human health risk assessment of plant protection products? Application of human epidemiological studies to pesticide risk assessment Antonio F. Hernández,

More information

Critique a Research Article. Aliza Ben-Zacharia DNP, ANP, MSCN Heidi Maloni, PhD, ANP, MSCN

Critique a Research Article. Aliza Ben-Zacharia DNP, ANP, MSCN Heidi Maloni, PhD, ANP, MSCN Critique a Research Article Aliza Ben-Zacharia DNP, ANP, MSCN Heidi Maloni, PhD, ANP, MSCN Reading literature One of the most valuable skills to develop is an ability to critically evaluate literature

More information

The Meta on Meta-Analysis. Presented by Endia J. Lindo, Ph.D. University of North Texas

The Meta on Meta-Analysis. Presented by Endia J. Lindo, Ph.D. University of North Texas The Meta on Meta-Analysis Presented by Endia J. Lindo, Ph.D. University of North Texas Meta-Analysis What is it? Why use it? How to do it? Challenges and benefits? Current trends? What is meta-analysis?

More information

A protocol for a systematic review on the impact of unpublished studies and studies published in the gray literature in meta-analyses

A protocol for a systematic review on the impact of unpublished studies and studies published in the gray literature in meta-analyses Systematic Reviews This Provisional PDF corresponds to the article as it appeared upon acceptance. Fully formatted PDF and full text (HTML) versions will be made available soon. A protocol for a systematic

More information

Revised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials

Revised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials Revised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials Edited by Julian PT Higgins on behalf of the RoB 2.0 working group on cross-over trials

More information

heterogeneity in meta-analysis stats methodologists meeting 3 September 2015

heterogeneity in meta-analysis stats methodologists meeting 3 September 2015 heterogeneity in meta-analysis stats methodologists meeting 3 September 2015 basic framework k experiments (i=1 k) each gives an estimate x i of θ, with variance s i 2 best overall estimate is weighted

More information

Meta-analysen Methodik für Mediziner

Meta-analysen Methodik für Mediziner Kardiolunch, 11.2.2014 Meta-analysen Methodik für Mediziner PD Dr Matthias Briel Basel Institute for Clin Epi & Biostats, Switzerland McMaster University, Hamilton, Canada Agenda SystematischeReviews &

More information

Methodological standards for the conduct of new Cochrane Intervention Reviews Version 2.3, 02 December 2013

Methodological standards for the conduct of new Cochrane Intervention Reviews Version 2.3, 02 December 2013 Methodological Expectations of Cochrane Intervention Reviews (MECIR) Methodological standards for the conduct of new Cochrane Intervention Reviews Version 2.3, 02 December 2013 Jackie Chandler, Rachel

More information

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2014

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2014 GRADE Grading of Recommendations Assessment, Development and Evaluation British Association of Dermatologists April 2014 Previous grading system Level of evidence Strength of recommendation Level of evidence

More information

The Regression-Discontinuity Design

The Regression-Discontinuity Design Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations

More information

Critical Thinking A tour through the science of neuroscience

Critical Thinking A tour through the science of neuroscience Critical Thinking A tour through the science of neuroscience NEBM 10032/5 Publication Bias Emily S Sena Centre for Clinical Brain Sciences, University of Edinburgh slides at @CAMARADES_ Bias Biases in

More information

C2 Training: August 2010

C2 Training: August 2010 C2 Training: August 2010 Introduction to meta-analysis The Campbell Collaboration www.campbellcollaboration.org Pooled effect sizes Average across studies Calculated using inverse variance weights Studies

More information

Meta-analyses: analyses:

Meta-analyses: analyses: Meta-analyses: analyses: how do they help, and when can they not? Lee Hooper Senior Lecturer in research synthesis & nutrition l.hooper@uea.ac.uk 01603 591268 Aims Systematic Reviews Discuss the scientific

More information

Critical Appraisal of a Systematic Review

Critical Appraisal of a Systematic Review Critical Appraisal of a Systematic Review Goal: Participants will be able to critically appraise a systematic review. Objectives: 1. Assess the validity of a systematic review 2. Understand the concept

More information