Systematic Reviews and Meta- Analysis in Kidney Transplantation

Size: px
Start display at page:

Download "Systematic Reviews and Meta- Analysis in Kidney Transplantation"

Transcription

1 Systematic Reviews and Meta- Analysis in Kidney Transplantation Greg Knoll MD MSc Associate Professor of Medicine Medical Director, Kidney Transplantation University of Ottawa and The Ottawa Hospital KRESCENT Workshop November 27, 2010

2 Objectives To understand the importance and necessity of systematic reviews in the conduct of research To learn the components in a meta-analysis To understand and recognize the advantages and disadvantages of meta-analyses

3 Definitions Number of terms are used, including: Quantitative review, systematic review, meta-analysis, overview, pooled analysis

4 Definitions Systematic review A review in which there is a comprehensive search for relevant studies on a specific topic, and those identified are then appraised and synthesized according to a predetermined and explicit method (Cook, Sackett, and Spitzer, 1995)

5 Definitions Meta-analysis A statistical analysis of a collection of studies Focus is on contrasting and combining results form different studies to identify consistent patterns and sources of disagreement among results (Rothman & Greenland, 1998)

6 Differences between Narrative Reviews and Systematic Reviews Cook DJ et al, Ann Intern Med 1997;126:

7 Importance of Systematic Reviews and Meta-Analyses Can provide the highest quality evidence to guide clinical care Can help resolve current controversies in the medical community (e.g. 1 positive trial, then 2 negative trials, then ) Can discover new hypotheses (i.e. from subgroups) Identify areas where additional studies is unethical Can identify effective/non-effective/harmful therapies earlier

8 Cumulative metaanalysis of Aprotinin vs placebo Approximately 5000 more patients unnecessarily randomized into a trial when the answer was already known Fergusson et al, Clinical Trials 2005; 2:

9 Limitations Identifying all relevant trials Methodological concerns Quality of included studies Statistical methods for pooling Study level data versus individual patient data Concern that all possible sources of heterogeneity have been accounted for

10 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

11 Development of a Review Protocol The how to do it list Should include all the previous elements in a study protocol format 1. Background 2. Objective(s) 3. Research question(s) 4. Selection criteria 5. Search strategy 6. Methods 7. Implications/Impact of Review

12 Importance of a protocol It is important to note that SR/MAs represent secondary analyses of data collected by others i.e. they are retrospective in nature Need to state a priori the question and methods Process needs to be: well-defined thorough transparent reproducible practical/efficient

13 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

14 Formulating a Research Question Key components of a research question Needs to specify 1. Types of patients 2. Types of therapies 3. Types of outcomes 4. Types of studies Increase precision increase focus

15 Formulating a Research Question 1. Types of Patients 1 St Step: define disease/condition e.g. diabetics vs Hep C pos etc 2 nd Step: define population e.g. all kidney Tx vs ECD recipients etc 3 rd Step: define setting e.g. early vs 6-months vs 1-yr post-tx etc Need to justify decisions at each step e.g. biological rationale: Does it make sense to separate diabetics from nondiabetics? First transplants from repeat transplants?

16 Formulating a Research Question 2. Types of Therapies What are the types of comparisons of interest? Control groups: placebo vs usual care vs active drug Intervention: drug or technique or management process e.g. ureteric stent vs no stent e.g. prednisone vs placebo e.g. outpatient vs inpatient management of rejection

17 Formulating a Research Question 3. Types of Outcomes Outcomes need to be clinically relevant and meaningful to the end-user e.g. acute rejection, graft survival, death Should not solely depend on whether data is available or not Your search may yield data not previously known or highlight need for more rigorous data Do not overlook harm or safety endpoints e.g. polyoma virus infection, anemia, PTDM

18 Formulating a Research Question 4. Types of Study Designs Interventional RCTs gold standard for establishing effectiveness/efficacy blinded vs open-label effectiveness vs efficacy Observational Case-control, cohort, cross-sectional

19 Formulating a Research Question Focus of Research Question has implications on: how and where to locate studies define inclusion/exclusion criteria what data to collect how to assess quality how to analyze/present/interpret results

20 Poorly vs Well-formulated Question Use of tacrolimus in kidney transplantation? Versus Does tacrolimus use reduce the occurrence of graft loss at 1-year in de novo kidney transplant recipients versus those receiving cyclosporine?

21 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

22 Inclusion/Exclusion Criteria Analogous to setting inclusion criteria in a clinical trial Inclusion criteria needs to include: Treatment Patient population Study design Diagnosis Outcomes

23 Inclusion/Exclusion Criteria and Study Question Should mirror one another Certainly with regards to treatment, outcome, and population Study design may be separate as this is the method chosen to answer your research question e.g. might only want to include RCTs if looking at efficacy; cohort studies if examining for adverse effects in realworld situation

24 Other inclusion/exclusion items can include Type of comparators Subgroups Language Years of publication Type of publication Choice among multiple sources of a study Sample size Peer vs non-peer review Methdological quality

25 Key points to remember A well-formulated question drives the inclusion/exclusion criteria The inclusion/exclusion criteria drives the literature search for eligible studies

26 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

27 Locating Studies Where do we find studies? Published data versus unpublished Published Reference databases (Medline, EMBASE, Cochrane) Conference proceedings (abstracts) Unpublished Filing cabinets industry

28 Locating Studies: The Literature Search The literature search of reference databases is absolutely critical to locating studies Needs to be systematic and applicable to more than one database Get help if necessary experienced librarian, methodologist, etc

29 Locating Studies: The Literature Search Literature search strategy needs to be sensitive Therefore, for purposes of the search, some components of the inclusion/exclusion criteria may need to be broadened or even omitted e.g. don t try to exclude studies from search based on quality, make this assessment from the full paper once retrieved This does not necessarily mean that selection criteria changes

30 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies 2 step process Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

31 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

32 Rating Quality RCTs Randomization Allocation concealment Blinding Withdrawals/loss to follow-up Scores vs global assessment

33 Once all studies are rated How do you incorporate quality? Threshold for inclusion into review Could very well be a possible cause of differences between study results (heterogeneity) (methodological versus clinical) Sensitivity analysis (i.e. exclude low quality studies) Weight overall results by study quality

34 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

35 Data Abstraction Rationale and Purpose: Bridge between what is reported by primary investigators and what is reported by reviewer

36 Data Abstraction Form Serves three important functions: 1. Visual representation of study question and inclusion/exclusion criteria 2. Provides the historical record of the review process 3. Provides the data base from which analysis can be conducted

37 Components of a Systematic Review The to do list Formulate a review question Define inclusion/exclusion criteria Locate studies Select studies Assess study quality Extract data Analyze and present results Interpret results Dissemination plan

38 Developing An Analytical Plan Two Types of Analysis Qualitative Quantitative Varying degrees of analytical rigor e.g. a quantitative review may be simple vote counting or a meta-analysis of pooled trials

39 Analytical Plan Important to have a systematic approach to analysis Need to carefully consider the important issues Plan stated a priori

40 Analytical Plan Considerations 1. What comparisons should be made? 2. What study results should be used in each comparison? 3. Are the results similar within each comparison? 4. What is the best summary of effect for each comparison? 5. How reliable are those summaries?

41 Comparisons Comparison consists of treatments and outcome Data Required Trial Identification Treatment groups Number of patients enrolled/analyzed Outcomes Number of patients with outcome in each treatment group Clinical/Methodological subgroups of interest e. g. high quality vs low quality trials; diabetics only etc

42 Data Binary (e.g. graft loss, acute rejection) Number of pts in each treatment arm Number of pts experiencing outcome Continuous (e.g. GFR, BP, Hgb) Number of patients in each treatment arm Measure of central tendency (usually mean) Measure of dispersion (usually SD)

43 Summary Measures Binary Odds ratio similar to RR when outcomes rare (<20%) Relative risk Risk Difference e.g. absolute difference in acute rejection at 1-year Continuous Weighted Mean Difference e.g. GFR at 1-yr Standardized Mean difference

44 When to produce a summary measure of effect? When clinically relevant to do so Probably wouldn t combine trials of induction vs no induction when examining incidence of CMV infection No large discrepancies between the studies i.e. no obvious sources of heterogeneity that will bias the results

45 Assessment of Heterogeneity Heterogeneity Any variability among studies in a systematic review Clinical: variability in participants (pediatric vs adult), severity of disease, intervention, drug dosage etc Methodological: variability in trial design, how outcomes defined or measured (e.g. presumed vs biopsy-proven rejection), trial quality (blinding, allocation concealment etc) Visual Statistical

46 Assessment of Heterogeneity Outcome: Difference in GFR Hiremath et al, AJT 7: 2350, 2007

47 Assessment of Heterogeneity Webster et al, Polyclonal and monoclonal antibodies for treating acute rejection episodes in kidney transplant recipients

48 Pooling Studies vary in size Trial summary effect based on 5000 patients is assumed to be more precise than summary effect based on 50 patients Therefore, larger studies should carry more weight in the pooling To do this we weight each study based on variance Lower variance (i.e. more precise) studies weighted more heavily more precise studies usually have larger sample size [ weight = 1/standard error 2 ]

49 Pooling of Trials Forest Plot FK Csa Outcome = graft failure at 3-yrs Tacrolimus vs ciclosporin as primary immunosuppression for kidney transplant recipients: meta-analysis of randomised trial data. Webster et al, BMJ, 2005

50 Fixed vs Random Effects Fixed Effects Model: Assumes within trial variation only Assumes that all studies come from a common population and that the true treatment effect is the same (i.e. FIXED across all studies) Inference based only on studies you have located for the analysis Therefore, the pooled summary is not significantly different among the different trials Test with visual or formal heterogeneity tests

51 Fixed vs Random Effects Random Effects Model: Assumes random variation within the studies and between the studies Inference based on the assumption that studies you have located come from a random sample of hypothetical population of studies Adjusts study weights according to extent of variation or heterogeneity among the treatment effects of each study More conservative (i.e. wider confidence intervals) and used more often if some degree of heterogeneity exists

52 Problems and Limitations of Systematic Reviews Two issues have led to skepticism of systematic reviews and meta-analyses Large trials contradicting meta-analyses of smaller trials Contradicting meta-analyses

53 Problems and Limitations of Systematic Reviews Two key components to help ensure a good review Understanding the strengths and limitations of the clinical and methodological quality of included trials Clinical and methodological rigor of the meta-analysis itself Did they pool trials inappropriately? Did they miss important trials?

54 Problems and Limitations of Systematic Reviews Publication bias Time lag bias Duplicate publication bias Citation bias Language bias Outcome reporting bias All contribute to the biased inclusion of studies in a systematic review This is SELECTION BIAS at the systematic review/metaanalysis level

55 Publication Bias The file drawer problem Negative studies not published Researcher and Journal Problem What is the impact? Influence on benefit Detection of harm

56 Publication Bias: Time Lag Bias Significant positive studies published before null studies Thus, trials with positive results could dominate the literature and could introduce bias for several years

57 Duplicate Publication Publication of previous study results Different language Different audience Different outcome Need to be aware and protect against double-counting e.g. ACE meta-analysis, 34 potential studies; 8 (24%) turned out to be publications based on same patients Confounded by the problem of the publication of positive studies

58 Language Bias Inclusion of trials only published in English can lead to a biased estimate of effect Publication in non-english language journal could be dependent on whether trial is positive or not

59 Summary Rigorous methods exist for the conduct and reporting of systematic reviews and metaanalyses These analyses are retrospective in nature and thus have limitations that need to be addressed

60 Summary However, unlike traditional narrative reviews, metaanalyses produce systematic, quantitative summaries of all the available evidence Researchers in kidney transplantation should strive for an increase in the number of rigorously conducted RCTs An increase in RCTs will inevitably lead to more systematic reviews which will allow for more accurate, unbiased estimates of treatment effect

61 Systematic Reviews and Meta- Analysis in Kidney Transplantation Greg Knoll MD MSc Associate Professor of Medicine Medical Director, Kidney Transplantation University of Ottawa and The Ottawa Hospital KRESCENT Workshop November 27, 2010

Meta Analysis. David R Urbach MD MSc Outcomes Research Course December 4, 2014

Meta Analysis. David R Urbach MD MSc Outcomes Research Course December 4, 2014 Meta Analysis David R Urbach MD MSc Outcomes Research Course December 4, 2014 Overview Definitions Identifying studies Appraising studies Quantitative synthesis Presentation of results Examining heterogeneity

More information

Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist.

Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. MOOSE Checklist Infliximab reduces hospitalizations and surgery interventions in patients with inflammatory bowel disease:

More information

Meta-Analysis. Zifei Liu. Biological and Agricultural Engineering

Meta-Analysis. Zifei Liu. Biological and Agricultural Engineering Meta-Analysis Zifei Liu What is a meta-analysis; why perform a metaanalysis? How a meta-analysis work some basic concepts and principles Steps of Meta-analysis Cautions on meta-analysis 2 What is Meta-analysis

More information

Introduction to systematic reviews/metaanalysis

Introduction to systematic reviews/metaanalysis Introduction to systematic reviews/metaanalysis Hania Szajewska The Medical University of Warsaw Department of Paediatrics hania@ipgate.pl Do I needknowledgeon systematicreviews? Bastian H, Glasziou P,

More information

Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co.

Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co. Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co. Meta-Analysis Defined A meta-analysis is: the statistical combination of two or more separate studies In other words: overview,

More information

Trials and Tribulations of Systematic Reviews and Meta-Analyses

Trials and Tribulations of Systematic Reviews and Meta-Analyses Trials and Tribulations of Systematic Reviews and Meta-Analyses Mark A. Crowther and Deborah J. Cook St. Joseph s Hospital, Hamilton, Ontario, Canada; McMaster University, Hamilton, Ontario, Canada Systematic

More information

The Royal College of Pathologists Journal article evaluation questions

The Royal College of Pathologists Journal article evaluation questions The Royal College of Pathologists Journal article evaluation questions Previous exam questions Dorrian CA, Toole, BJ, Alvarez-Madrazo S, Kelly A, Connell JMC, Wallace AM. A screening procedure for primary

More information

The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews

The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews David Moher 1, Alessandro Liberati 2, Douglas G Altman 3, Jennifer Tetzlaff 1 for the QUOROM Group

More information

SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS

SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS A Case Study By Anil Khedkar, India (Masters in Pharmaceutical Science, PhD in Clinical Research Student of Texila American University)

More information

Results. NeuRA Treatments for internalised stigma December 2017

Results. NeuRA Treatments for internalised stigma December 2017 Introduction Internalised stigma occurs within an individual, such that a person s attitude may reinforce a negative self-perception of mental disorders, resulting in reduced sense of selfworth, anticipation

More information

School of Dentistry. What is a systematic review?

School of Dentistry. What is a systematic review? School of Dentistry What is a systematic review? Screen Shot 2012-12-12 at 09.38.42 Where do I find the best evidence? The Literature Information overload 2 million articles published a year 20,000 biomedical

More information

Critical appraisal: Systematic Review & Meta-analysis

Critical appraisal: Systematic Review & Meta-analysis Critical appraisal: Systematic Review & Meta-analysis Atiporn Ingsathit MD.PhD. Section for Clinical Epidemiology and biostatistics Faculty of Medicine Ramathibodi Hospital Mahidol University What is a

More information

Systematic Reviews. Simon Gates 8 March 2007

Systematic Reviews. Simon Gates 8 March 2007 Systematic Reviews Simon Gates 8 March 2007 Contents Reviewing of research Why we need reviews Traditional narrative reviews Systematic reviews Components of systematic reviews Conclusions Key reference

More information

Systematic Reviews and Meta-analysis

Systematic Reviews and Meta-analysis Systematic Reviews and Meta-analysis Introduction to Clinical Research: A Two-week Intensive Course July 22, 2014 Sonal Singh, MD, MPH Assistant Professor Key messages Systematic reviews (SR) summarize

More information

PROGRAMMA DELLA GIORNATA

PROGRAMMA DELLA GIORNATA PROGRAMMA DELLA GIORNATA si riprendono i concetti della volta precedente compiti dati da fare a casa si richiama il programma del corso 1.1.1. Studi integrativi 1.1.2. Revisioni sistematiche 1.1.4.1. TEST

More information

Clinical research in AKI Timing of initiation of dialysis in AKI

Clinical research in AKI Timing of initiation of dialysis in AKI Clinical research in AKI Timing of initiation of dialysis in AKI Josée Bouchard, MD Krescent Workshop December 10 th, 2011 1 Acute kidney injury in ICU 15 25% of critically ill patients experience AKI

More information

Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death. Debra Moy Faculty of Pharmacy University of Toronto

Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death. Debra Moy Faculty of Pharmacy University of Toronto Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death Debra Moy Faculty of Pharmacy University of Toronto Goal To provide practitioners with a systematic approach to evaluating a meta analysis

More information

Results. NeuRA Hypnosis June 2016

Results. NeuRA Hypnosis June 2016 Introduction may be experienced as an altered state of consciousness or as a state of relaxation. There is no agreed framework for administering hypnosis, but the procedure often involves induction (such

More information

Animal-assisted therapy

Animal-assisted therapy Introduction Animal-assisted interventions use trained animals to help improve physical, mental and social functions in people with schizophrenia. It is a goal-directed intervention in which an animal

More information

Problem solving therapy

Problem solving therapy Introduction People with severe mental illnesses such as schizophrenia may show impairments in problem-solving ability. Remediation interventions such as problem solving skills training can help people

More information

Evidence Based Medicine

Evidence Based Medicine Course Goals Goals 1. Understand basic concepts of evidence based medicine (EBM) and how EBM facilitates optimal patient care. 2. Develop a basic understanding of how clinical research studies are designed

More information

Live WebEx meeting agenda

Live WebEx meeting agenda 10:00am 10:30am Using OpenMeta[Analyst] to extract quantitative data from published literature Live WebEx meeting agenda August 25, 10:00am-12:00pm ET 10:30am 11:20am Lecture (this will be recorded) 11:20am

More information

Alcohol interventions in secondary and further education

Alcohol interventions in secondary and further education National Institute for Health and Care Excellence Guideline version (Draft for Consultation) Alcohol interventions in secondary and further education NICE guideline: methods NICE guideline Methods

More information

Traumatic brain injury

Traumatic brain injury Introduction It is well established that traumatic brain injury increases the risk for a wide range of neuropsychiatric disturbances, however there is little consensus on whether it is a risk factor for

More information

Robert M. Jacobson, M.D. Department of Pediatric and Adolescent Medicine Mayo Clinic, Rochester, Minnesota

Robert M. Jacobson, M.D. Department of Pediatric and Adolescent Medicine Mayo Clinic, Rochester, Minnesota How to Conduct a Systematic Review: A Workshop 24 th Annual Primary Care Research Methods & Statistics Conference, San Antonio, Texas Saturday, December 3, 2011 Robert M. Jacobson, M.D. Department of Pediatric

More information

Overview of Study Designs in Clinical Research

Overview of Study Designs in Clinical Research Overview of Study Designs in Clinical Research Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines + Evidence Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort

More information

Evidence Based Medicine

Evidence Based Medicine Hamadan University of medical sciences School of Public Health Department of Epidemiology Evidence Based Medicine Amin Doosti-Irani, PhD in Epidemiology 10 March 2017 a_doostiirani@yahoo.com 1 Outlines

More information

GLOSSARY OF GENERAL TERMS

GLOSSARY OF GENERAL TERMS GLOSSARY OF GENERAL TERMS Absolute risk reduction Absolute risk reduction (ARR) is the difference between the event rate in the control group (CER) and the event rate in the treated group (EER). ARR =

More information

Distraction techniques

Distraction techniques Introduction are a form of coping skills enhancement, taught during cognitive behavioural therapy. These techniques are used to distract and draw attention away from the auditory symptoms of schizophrenia,

More information

OUT OF DATE. Choice of calcineurin inhibitors in adult renal transplantation: Effects on transplant outcomes

OUT OF DATE. Choice of calcineurin inhibitors in adult renal transplantation: Effects on transplant outcomes nep_734.fm Page 88 Friday, January 26, 2007 6:47 PM Blackwell Publishing AsiaMelbourne, AustraliaNEPNephrology1320-5358 2006 The Author; Journal compilation 2006 Asian Pacific Society of Nephrology? 200712S18897MiscellaneousCalcineurin

More information

In many healthcare situations, it is common to find

In many healthcare situations, it is common to find Interpreting and Using Meta-Analysis in Clinical Practice Cheryl Holly Jason T. Slyer Systematic reviews, which can include a meta-analysis, are considered the gold standard for determination of best practice.

More information

NeuRA Sleep disturbance April 2016

NeuRA Sleep disturbance April 2016 Introduction People with schizophrenia may show disturbances in the amount, or the quality of sleep they generally receive. Typically sleep follows a characteristic pattern of four stages, where stage

More information

ISPOR Task Force Report: ITC & NMA Study Questionnaire

ISPOR Task Force Report: ITC & NMA Study Questionnaire INDIRECT TREATMENT COMPARISON / NETWORK META-ANALYSIS STUDY QUESTIONNAIRE TO ASSESS RELEVANCE AND CREDIBILITY TO INFORM HEALTHCARE DECISION-MAKING: AN ISPOR-AMCP-NPC GOOD PRACTICE TASK FORCE REPORT DRAFT

More information

Types of Data. Systematic Reviews: Data Synthesis Professor Jodie Dodd 4/12/2014. Acknowledgements: Emily Bain Australasian Cochrane Centre

Types of Data. Systematic Reviews: Data Synthesis Professor Jodie Dodd 4/12/2014. Acknowledgements: Emily Bain Australasian Cochrane Centre Early Nutrition Workshop, December 2014 Systematic Reviews: Data Synthesis Professor Jodie Dodd 1 Types of Data Acknowledgements: Emily Bain Australasian Cochrane Centre 2 1 What are dichotomous outcomes?

More information

Fixed Effect Combining

Fixed Effect Combining Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse

More information

Results. NeuRA Worldwide incidence April 2016

Results. NeuRA Worldwide incidence April 2016 Introduction The incidence of schizophrenia refers to how many new cases there are per population in a specified time period. It is different from prevalence, which refers to how many existing cases there

More information

Principles of meta-analysis

Principles of meta-analysis Principles of meta-analysis 1 The popularity of meta-analyses Search on 22 October 2015 10000 9000 8156 8875 8000 7000 6554 6000 5000 4852 4000 3000 2000 1000 0 1 1 1 272 334 371 323 386 429 482 596 639

More information

USDA Nutrition Evidence Library: Systematic Review Methodology

USDA Nutrition Evidence Library: Systematic Review Methodology USDA Nutrition Evidence Library: Systematic Review Methodology Julie E. Obbagy, PhD, RD USDA Center for Nutrition Policy & Promotion Meeting #2 October 17, 2016 The National Academies of Sciences, Engineering,

More information

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health.

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health. Workshop: Cochrane Rehabilitation 05th May 2018 Trusted evidence. Informed decisions. Better health. Disclosure I have no conflicts of interest with anything in this presentation How to read a systematic

More information

Meta-analyses: analyses:

Meta-analyses: analyses: Meta-analyses: analyses: how do they help, and when can they not? Lee Hooper Senior Lecturer in research synthesis & nutrition l.hooper@uea.ac.uk 01603 591268 Aims Systematic Reviews Discuss the scientific

More information

How to interpret results of metaanalysis

How to interpret results of metaanalysis How to interpret results of metaanalysis Tony Hak, Henk van Rhee, & Robert Suurmond Version 1.0, March 2016 Version 1.3, Updated June 2018 Meta-analysis is a systematic method for synthesizing quantitative

More information

Research Synthesis and meta-analysis: themes. Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH

Research Synthesis and meta-analysis: themes. Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH Research Synthesis and meta-analysis: themes Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH Today Course format Goals, competencies Overview of themes for the class SRMA M19-551 Course Format Lectures»

More information

Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials(review)

Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials(review) Cochrane Database of Systematic Reviews Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials (Review) Anglemyer A, Horvath HT, Bero L Anglemyer

More information

Implementing scientific evidence into clinical practice guidelines

Implementing scientific evidence into clinical practice guidelines Evidence Based Dentistry Implementing scientific evidence into clinical practice guidelines Asbjørn Jokstad University of Oslo, Norway 15/07/2004 1 PRACTICE GUIDELINES IN DENTISTRY (Medline) 2100 1945

More information

Results. NeuRA Mindfulness and acceptance therapies August 2018

Results. NeuRA Mindfulness and acceptance therapies August 2018 Introduction involve intentional and non-judgmental focus of one's attention on emotions, thoughts and sensations that are occurring in the present moment. The aim is to open awareness to present experiences,

More information

Systematic reviews & Meta-analysis

Systematic reviews & Meta-analysis Systematic reviews & Meta-analysis Asbjørn Jokstad University of Oslo, Norway 15/07/2004 1 The Review article An attempt to synthesise the results and conclusions of two or more publications on a given

More information

PROSPERO International prospective register of systematic reviews

PROSPERO International prospective register of systematic reviews PROSPERO International prospective register of systematic reviews High-dose chemotherapy followed by autologous haematopoietic cell transplantation for children, adolescents and young adults with first

More information

Are the likely benefits worth the potential harms and costs? From McMaster EBCP Workshop/Duke University Medical Center

Are the likely benefits worth the potential harms and costs? From McMaster EBCP Workshop/Duke University Medical Center CRITICAL REVIEW FORM FOR THERAPY STUDY Did experimental and control groups begin the study with a similar prognosis? Were patients randomized? Was randomization concealed? Were patients analyzed in the

More information

Systematic Review & Course outline. Lecture (20%) Class discussion & tutorial (30%)

Systematic Review & Course outline. Lecture (20%) Class discussion & tutorial (30%) Systematic Review & Meta-analysisanalysis Ammarin Thakkinstian, Ph.D. Section for Clinical Epidemiology and Biostatistics Faculty of Medicine, Ramathibodi Hospital Tel: 02-201-1269, 02-201-1762 Fax: 02-2011284

More information

Cochrane Breast Cancer Group

Cochrane Breast Cancer Group Cochrane Breast Cancer Group Version and date: V3.2, September 2013 Intervention Cochrane Protocol checklist for authors This checklist is designed to help you (the authors) complete your Cochrane Protocol.

More information

Retrieving and appraising systematic reviews

Retrieving and appraising systematic reviews Retrieving and appraising systematic reviews rslavik@interchange.ubc.ca Richard S. Slavik, Pharm.D. Pharmacotherapeutic Specialist Critical Care CSU Pharmaceutical Sciences Vancouver Hospital & Health

More information

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2018

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2018 GRADE Grading of Recommendations Assessment, Development and Evaluation British Association of Dermatologists April 2018 Previous grading system Level of evidence Strength of recommendation Level of evidence

More information

GUIDELINE COMPARATORS & COMPARISONS:

GUIDELINE COMPARATORS & COMPARISONS: GUIDELINE COMPARATORS & COMPARISONS: Direct and indirect comparisons Adapted version (2015) based on COMPARATORS & COMPARISONS: Direct and indirect comparisons - February 2013 The primary objective of

More information

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai Systematic reviews: From evidence to recommendation Session 2 - June 18, 2014 Going beyond design, going beyond intervention: The American Academy of Neurology (AAN) Clinical Practice Guideline process

More information

Results. NeuRA Family relationships May 2017

Results. NeuRA Family relationships May 2017 Introduction Familial expressed emotion involving hostility, emotional over-involvement, and critical comments has been associated with increased psychotic relapse in people with schizophrenia, so these

More information

Appendix 2 Quality assessment tools. Cochrane risk of bias tool for RCTs. Support for judgment

Appendix 2 Quality assessment tools. Cochrane risk of bias tool for RCTs. Support for judgment Appendix 2 Quality assessment tools Cochrane risk of bias tool for RCTs Item Judgment (H/L/Unclear) Random sequence generation (selection bias) Allocation concealment (selection bias) Blinding of participants

More information

NeuRA Obsessive-compulsive disorders October 2017

NeuRA Obsessive-compulsive disorders October 2017 Introduction (OCDs) involve persistent and intrusive thoughts (obsessions) and repetitive actions (compulsions). The DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition) defines

More information

Pharmacotherapy for Alcohol Dependence

Pharmacotherapy for Alcohol Dependence Evidence Report/Technology Assessment: Number 3 Pharmacotherapy for Alcohol Dependence Summary Under its Evidence-Based Practice Program, the Agency for Health Care Policy and Research (AHCPR) is developing

More information

Results. NeuRA Motor dysfunction April 2016

Results. NeuRA Motor dysfunction April 2016 Introduction Subtle deviations in various developmental trajectories during childhood and adolescence may foreshadow the later development of schizophrenia. Studies exploring these deviations (antecedents)

More information

PROSPERO International prospective register of systematic reviews

PROSPERO International prospective register of systematic reviews PROSPERO International prospective register of systematic reviews Review title and timescale 1 Review title Give the working title of the review. This must be in English. Ideally it should state succinctly

More information

Issues to Consider in the Design of Randomized Controlled Trials

Issues to Consider in the Design of Randomized Controlled Trials Issues to Consider in the Design of Randomized Controlled Trials Jay Wilkinson, MD, MPH Professor of Pediatrics & Epidemiology Miller School of Medicine Seminar Purpose To facilitate an interactive discussion

More information

Clinical problems and choice of study designs

Clinical problems and choice of study designs Evidence Based Dentistry Clinical problems and choice of study designs Asbjørn Jokstad University of Oslo, Norway Nov 21 2001 1 Manipulation with intervention Yes Experimental study No Non-experimental

More information

Results. NeuRA Forensic settings April 2016

Results. NeuRA Forensic settings April 2016 Introduction Prevalence quantifies the proportion of individuals in a population who have a disease during a specific time period. Many studies have reported a high prevalence of various health problems,

More information

Database of Abstracts of Reviews of Effects (DARE) Produced by the Centre for Reviews and Dissemination Copyright 2017 University of York.

Database of Abstracts of Reviews of Effects (DARE) Produced by the Centre for Reviews and Dissemination Copyright 2017 University of York. A comparison of the cost-effectiveness of five strategies for the prevention of non-steroidal anti-inflammatory drug-induced gastrointestinal toxicity: a systematic review with economic modelling Brown

More information

Evidence-Based Review Process to Link Dietary Factors with Chronic Disease Case Study: Cardiovascular Disease and n- 3 Fatty Acids

Evidence-Based Review Process to Link Dietary Factors with Chronic Disease Case Study: Cardiovascular Disease and n- 3 Fatty Acids Evidence-Based Review Process to Link Dietary Factors with Chronic Disease Case Study: Cardiovascular Disease and n- 3 Fatty Acids Alice H. Lichtenstein, D.Sc. Gershoff Professor of Nutrition Science and

More information

Deep vein thrombosis and its prevention in critically ill adults Attia J, Ray J G, Cook D J, Douketis J, Ginsberg J S, Geerts W H

Deep vein thrombosis and its prevention in critically ill adults Attia J, Ray J G, Cook D J, Douketis J, Ginsberg J S, Geerts W H Deep vein thrombosis and its prevention in critically ill adults Attia J, Ray J G, Cook D J, Douketis J, Ginsberg J S, Geerts W H Authors' objectives To systematically review the incidence of deep vein

More information

Method. NeuRA Biofeedback May 2016

Method. NeuRA Biofeedback May 2016 Introduction is a technique in which information about the person s body is fed back to the person so that they may be trained to alter the body s conditions. Physical therapists use biofeedback to help

More information

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2014

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2014 GRADE Grading of Recommendations Assessment, Development and Evaluation British Association of Dermatologists April 2014 Previous grading system Level of evidence Strength of recommendation Level of evidence

More information

The Cochrane Collaboration, the US Cochrane Center, and The Cochrane Library

The Cochrane Collaboration, the US Cochrane Center, and The Cochrane Library The Cochrane Collaboration, the US Cochrane Center, and The Cochrane Library Kay Dickersin, PhD Association for Population/Family Planning Libraries & Information Centers International Boston, Ma 30 March

More information

Meta-Analyses: Considerations for Probiotics & Prebiotics Studies

Meta-Analyses: Considerations for Probiotics & Prebiotics Studies Meta-Analyses: Considerations for Probiotics & Prebiotics Studies Daniel J. Tancredi, PhD Associate Professor in Residence Department of Pediatrics UC Davis School of Medicine Objectives Provide an overview

More information

Bayesian approaches to analysing studies and summarizing evidences

Bayesian approaches to analysing studies and summarizing evidences Bruxelles, February 10, 2012 Bayesian approaches to analysing studies and summarizing evidences Paolo Bruzzi Clinical Epidemiology Unit National Cancer Research Institute Genova - Italy Conventional Statistical

More information

Results. NeuRA Treatments for dual diagnosis August 2016

Results. NeuRA Treatments for dual diagnosis August 2016 Introduction Many treatments have been targeted to improving symptom severity for people suffering schizophrenia in combination with substance use problems. Studies of dual diagnosis often investigate

More information

A Systematic Review of the Efficacy and Clinical Effectiveness of Group Analysis and Analytic/Dynamic Group Psychotherapy

A Systematic Review of the Efficacy and Clinical Effectiveness of Group Analysis and Analytic/Dynamic Group Psychotherapy A Systematic Review of the Efficacy and Clinical Effectiveness of Group Analysis and Analytic/Dynamic Group Psychotherapy Executive summary Aims of the review The main aim of the review was to assess the

More information

Outline. What is Evidence-Based Practice? EVIDENCE-BASED PRACTICE. What EBP is Not:

Outline. What is Evidence-Based Practice? EVIDENCE-BASED PRACTICE. What EBP is Not: Evidence Based Practice Primer Outline Evidence Based Practice (EBP) EBP overview and process Formulating clinical questions (PICO) Searching for EB answers Trial design Critical appraisal Assessing the

More information

SUPPLEMENTARY DATA. Supplementary Figure S1. Search terms*

SUPPLEMENTARY DATA. Supplementary Figure S1. Search terms* Supplementary Figure S1. Search terms* *mh = exploded MeSH: Medical subject heading (Medline medical index term); tw = text word; pt = publication type; the asterisk (*) stands for any character(s) #1:

More information

A systematic review of treatments for severe psoriasis Griffiths C E, Clark C M, Chalmers R J, Li Wan Po A, Williams H C

A systematic review of treatments for severe psoriasis Griffiths C E, Clark C M, Chalmers R J, Li Wan Po A, Williams H C A systematic review of treatments for severe psoriasis Griffiths C E, Clark C M, Chalmers R J, Li Wan Po A, Williams H C Authors' objectives To compare the effectiveness of currently available treatments

More information

CHECK-LISTS AND Tools DR F. R E Z A E I DR E. G H A D E R I K U R D I S TA N U N I V E R S I T Y O F M E D I C A L S C I E N C E S

CHECK-LISTS AND Tools DR F. R E Z A E I DR E. G H A D E R I K U R D I S TA N U N I V E R S I T Y O F M E D I C A L S C I E N C E S CHECK-LISTS AND Tools DR F. R E Z A E I DR E. G H A D E R I K U R D I S TA N U N I V E R S I T Y O F M E D I C A L S C I E N C E S What is critical appraisal? Critical appraisal is the assessment of evidence

More information

Module 5. The Epidemiological Basis of Randomised Controlled Trials. Landon Myer School of Public Health & Family Medicine, University of Cape Town

Module 5. The Epidemiological Basis of Randomised Controlled Trials. Landon Myer School of Public Health & Family Medicine, University of Cape Town Module 5 The Epidemiological Basis of Randomised Controlled Trials Landon Myer School of Public Health & Family Medicine, University of Cape Town Introduction The Randomised Controlled Trial (RCT) is the

More information

Overview and Comparisons of Risk of Bias and Strength of Evidence Assessment Tools: Opportunities and Challenges of Application in Developing DRIs

Overview and Comparisons of Risk of Bias and Strength of Evidence Assessment Tools: Opportunities and Challenges of Application in Developing DRIs Workshop on Guiding Principles for the Inclusion of Chronic Diseases Endpoints in Future Dietary Reference Intakes (DRIs) Overview and Comparisons of Risk of Bias and Strength of Evidence Assessment Tools:

More information

CONSORT 2010 checklist of information to include when reporting a randomised trial*

CONSORT 2010 checklist of information to include when reporting a randomised trial* CONSORT 2010 checklist of information to include when reporting a randomised trial* Section/Topic Title and abstract Introduction Background and objectives Item No Checklist item 1a Identification as a

More information

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard

More information

Standards for the reporting of new Cochrane Intervention Reviews

Standards for the reporting of new Cochrane Intervention Reviews Methodological Expectations of Cochrane Intervention Reviews (MECIR) Standards for the reporting of new Cochrane Intervention Reviews 24 September 2012 Preface The standards below summarize proposed attributes

More information

PROSPERO International prospective register of systematic reviews

PROSPERO International prospective register of systematic reviews PROSPERO International prospective register of systematic reviews Effectiveness of progressive muscle relaxation training for adults diagnosed with schizophrenia: a systematic review protocol Carlos Melo-Dias,

More information

Introduction to Evidence Based Medicine

Introduction to Evidence Based Medicine Introduction to Evidence Based Medicine Outline 1. Introduction: what is EBM 2. The steps in evidence based practice 3.An example 4. Reflection and further information Chaisiri Angkurawaranon Department

More information

[population] or for TREATMENT: [Intervention or intervention contrast] for [health problem] in [population] Review information

[population] or for TREATMENT: [Intervention or intervention contrast] for [health problem] in [population] Review information Model Review (Version 1.0): for PREVENTION: [Intervention] for prevention of [health... Page 1 of 28 Model Review (Version 1.0): for PREVENTION: [Intervention] for prevention of [health problem] in [population]

More information

T A B L E O F C O N T E N T S

T A B L E O F C O N T E N T S Short-term psychodynamic psychotherapies for anxiety, depression and somatoform disorders (Unknown) Abbass AA, Hancock JT, Henderson J, Kisely S This is a reprint of a Cochrane unknown, prepared and maintained

More information

Systematic review with multiple treatment comparison metaanalysis. on interventions for hepatic encephalopathy

Systematic review with multiple treatment comparison metaanalysis. on interventions for hepatic encephalopathy Systematic review with multiple treatment comparison metaanalysis on interventions for hepatic encephalopathy Hepatic encephalopathy (HE) is a reversible neuropsychiatric syndrome associated with severe

More information

POST GRADUATE DIPLOMA IN BIOETHICS (PGDBE) Term-End Examination June, 2016 MHS-014 : RESEARCH METHODOLOGY

POST GRADUATE DIPLOMA IN BIOETHICS (PGDBE) Term-End Examination June, 2016 MHS-014 : RESEARCH METHODOLOGY No. of Printed Pages : 12 MHS-014 POST GRADUATE DIPLOMA IN BIOETHICS (PGDBE) Term-End Examination June, 2016 MHS-014 : RESEARCH METHODOLOGY Time : 2 hours Maximum Marks : 70 PART A Attempt all questions.

More information

Low-adherence to recommendations from an authoritative Consensus Conference on trials in cgvhd led to overestimation of treatment effect

Low-adherence to recommendations from an authoritative Consensus Conference on trials in cgvhd led to overestimation of treatment effect Low-adherence to recommendations from an authoritative Consensus Conference on trials in cgvhd led to overestimation of treatment effect Giovanni Pomponio, Jacopo Olivieri*, Lucia Manfredi, Laura Postacchini,

More information

4/10/2018. Choosing a study design to answer a specific research question. Importance of study design. Types of study design. Types of study design

4/10/2018. Choosing a study design to answer a specific research question. Importance of study design. Types of study design. Types of study design Choosing a study design to answer a specific research question Importance of study design Will determine how you collect, analyse and interpret your data Helps you decide what resources you need Impact

More information

Meta-analysen Methodik für Mediziner

Meta-analysen Methodik für Mediziner Kardiolunch, 11.2.2014 Meta-analysen Methodik für Mediziner PD Dr Matthias Briel Basel Institute for Clin Epi & Biostats, Switzerland McMaster University, Hamilton, Canada Agenda SystematischeReviews &

More information

The role of meta-analysis in the evaluation of the effects of early nutrition on neurodevelopment

The role of meta-analysis in the evaluation of the effects of early nutrition on neurodevelopment Note: for non-commercial purposes only The role of meta-analysis in the evaluation of the effects of early nutrition on neurodevelopment Hania Szajewska The Medical University of Warsaw Department of Paediatrics

More information

Robotic Bariatric Surgery. Richdeep S. Gill, MD Research Fellow Center for the Advancement of Minimally Invasive Surgery (CAMIS)

Robotic Bariatric Surgery. Richdeep S. Gill, MD Research Fellow Center for the Advancement of Minimally Invasive Surgery (CAMIS) Robotic Bariatric Surgery Richdeep S. Gill, MD Research Fellow Center for the Advancement of Minimally Invasive Surgery (CAMIS) Background Over 500 million obese individuals worldwide Bariatric surgery

More information

EBP STEP 2. APPRAISING THE EVIDENCE : So how do I know that this article is any good? (Quantitative Articles) Alison Hoens

EBP STEP 2. APPRAISING THE EVIDENCE : So how do I know that this article is any good? (Quantitative Articles) Alison Hoens EBP STEP 2 APPRAISING THE EVIDENCE : So how do I know that this article is any good? (Quantitative Articles) Alison Hoens Clinical Assistant Prof, UBC Clinical Coordinator, PHC Maggie McIlwaine Clinical

More information

Cochrane Pregnancy and Childbirth Group Methodological Guidelines

Cochrane Pregnancy and Childbirth Group Methodological Guidelines Cochrane Pregnancy and Childbirth Group Methodological Guidelines [Prepared by Simon Gates: July 2009, updated July 2012] These guidelines are intended to aid quality and consistency across the reviews

More information

A Systematic Review and Meta-Analysis of Pre-Transfusion Hemoglobin Thresholds for Allogeneic Red Blood Cell Transfusions

A Systematic Review and Meta-Analysis of Pre-Transfusion Hemoglobin Thresholds for Allogeneic Red Blood Cell Transfusions A Systematic Review and Meta-Analysis of Pre-Transfusion Hemoglobin Thresholds for Allogeneic Red Blood Cell Transfusions Authors: Lesley J.J. Soril 1,2, MSc; Laura E. Leggett 1,2, MSc; Joseph Ahn, MSc

More information

PROSPERO International prospective register of systematic reviews

PROSPERO International prospective register of systematic reviews PROSPERO International prospective register of systematic reviews Prophylactic cranial irradiation in patients with non-small-cell lung cancer: a systematic review and meta-analysis of randomized controlled

More information

PROSPERO International prospective register of systematic reviews

PROSPERO International prospective register of systematic reviews PROSPERO International prospective register of systematic reviews Drug-eluting balloon angioplasty versus non-stenting balloon angioplasty for peripheral arterial disease of the lower limbs [Cochrane Protocol]

More information

Evidence-Based Medicine Journal Club. A Primer in Statistics, Study Design, and Epidemiology. August, 2013

Evidence-Based Medicine Journal Club. A Primer in Statistics, Study Design, and Epidemiology. August, 2013 Evidence-Based Medicine Journal Club A Primer in Statistics, Study Design, and Epidemiology August, 2013 Rationale for EBM Conscientious, explicit, and judicious use Beyond clinical experience and physiologic

More information