Meta-analysis: A Brief Introduction
|
|
- Thomasina Jennings
- 5 years ago
- Views:
Transcription
1 Meta-analysis: A Brief Introduction Jocelyn A. Andrel, M.S.P.H., Scott W. Keith, Ph.D., and Benjamin E. Leiby, Ph.D. Abstract Meta-analysis is the process of combining data from multiple sources and analyzing it together to increase power and provide a clearer picture of the effect of intervention or exposure on an outcome. The process is not complicated, but requires a great deal of attention to detail. A specifi c set of inclusion criteria for studies must be defi ned. Published or available study results may be affected by publication bias of several different types, so the researcher should be sure to conduct a thorough search of available databases in order to include unpublished fi ndings. Following selection, the group of studies should be examined using funnel plots or statistical tests. Meta-analysis models themselves must be selected to properly refl ect the combined studies. Both fi xed- and random-effects modeling are discussed. Two case studies are presented, illustrating a well-conducted meta-analysis and a meta-analysis that was more controversial. Keywords: meta-analysis, funnel plot, fi xed-effects, random-effects Introduction Meta-analysis is the process of combining data from multiple studies with the goal of better estimating the true effect of a specific intervention or exposure on a particular outcome. Individual studies are often insufficiently powered to draw definitive results, and even larger studies are often unable to adequately estimate differences in risk of rare adverse events. The systematic combination of results from multiple studies, even if they are inconclusive or contradictory, can help to more definitively determine the true measure of effect. Meta-analyses have become quite common in the biomedical literature and have gained attention in the mainstream press. 1,2 Numerous references on the theory and proper procedures for meta-analysis exist in the medical and statistical literature. 3 8 In this paper, we review the basics of meta-analysis, including issues in study identification and selection, issues of publication and other bias, and choices in statistical modeling. We follow this with two illustrative case studies. Our goal is to encourage appropriate use of meta-analysis methods and increase understanding of published systematic reviews. Study Selection It is our opinion that perhaps the most critical part of any metaanalysis is the evaluation of studies for inclusion in the analysis. Inclusion of a particular study in a meta-analysis should be based on criteria established well before undertaking study evaluation. The criteria should be rigorous, but not overly restrictive. The goal is for the studies to be similar, but they obviously will not be identical. Study heterogeneity can impact the validity of the analysis; careful attention to selection criteria and appropriate modeling of study heterogeneity are essential. Eligible studies should be similar in at least two ways the hypothesis addressed and the type of the study. Hypothesis addressed A good meta-analysis first carefully defines the question of interest; studies are selected for inclusion in the meta-analysis only if they address this hypothesis. Adequate definition of the problem is necessary for any study, but is especially important in meta-analysis as it directly impacts the selection of studies for combined analysis. 3 In meta-analysis of treatment studies, this question may be whether an intervention is efficacious or whether an intervention increases the risk of adverse events. Types of studies Meta-analyses commonly combine information from randomized trials because of their typically rigorous study designs and randomization schemes, but well-conducted observational studies can also be used in the same way. 5 Sample characteristics, outcomes analyzed, and type of treatment all may influence whether a study is included or excluded from the analysis. More detailed methods for the selection of studies are described elsewhere. 3 Identifying studies Researchers conducting a meta-analysis have numerous data sources available to them. It is essential that the researcher investigate as many as possible to both bolster the strength of the meta-analysis and mitigate potential publication bias. We have listed many of these sources in Table 1. The meta-analyst should conduct their search in a systematic fashion, keeping track of search terms, keywords, and procedures to produce the most comprehensive list of eligible studies. The most common source of studies is published journal articles. These can be searched through MEDLINE/PubMed, or through subscription databases such as EMBASE. Additional sources outside of journals are referred to as gray literature, including book chapters, abstracts, presentations, unpublished results, theses, or letters. 9,10 The Cochrane Collaboration s CENTRAL Registry of controlled clinical trials combines these in an effort to compile all available information, both in journals and gray literature. 11 Clinical trials registries afford another avenue for identifying studies. Disease- and pharmaceutical-specific trials registries have been in existence for some time. However, neither is as comprehensive as a mandatory trials registry, such as the Clinical Trials Data Bank. 12 There are currently multiple national and international trials registries, as well as meta-registries. The Food and Drug Administration (FDA) can provide similar information; however, their database was not designed to be a public-access registry. 13 Division of Biostatistics, Thomas Jefferson University, Philadelphia, Pennsylvania, USA. Correspondence: JA Andrel (jocelyn.andrel@mail.jci.tju.edu) DOI: /j x 374 VOLUME 2 ISSUE 5
2 Data source Location Government sponsored Clinical trials data bank ClinicalTrials.gov Australia New Zealand Clinical Trials Registry Chinese Clinical Trial Register (ChiCTR) Clinical Trials Registry India (CTRI) German Clinical Trials Register (DRKS) Iranian Registry of Clinical Trials (IRCT) Japan Primary Registries Network (in Japanese) (English available) (English available) (English available) The Netherlands National Trial Register (NTR) (in Dutch) Sri Lanka Clinical Trials Registry (SLCTR) International Standard Randomized Controlled Trial Number Aggregator databases WHO ICTRP Meta-register of controlled trials Disease/location specific registries Physician data query (PDQ) database European Leukemia Trials Registry Clinical Trial Registry of the University Medical Center Freiburg extern_en.html German Registry for Somatic Gene-Transfer Trials (DeReG) Industry registries AstraZeneca Eli Lilly Roche GlaxoSmithKline Bristol-Myers Squibb PhRMA Clinical Study Results Database FDA Table 1. Database resources. Publication and related bias No matter how thorough the search, the researcher is frequently limited to published results. Bias in study reporting where publication is influenced by the direction or strength of the results is the most obvious source of error. Reporting bias can refer to several situations, influencing the if, when, or how of publication. Due to the nature of the source data for meta-analyses, reporting bias of all types can contribute substantial error, leading the researcher to draw flawed or incorrect conclusions Publication bias describes the situation where positive results are preferentially published over inconclusive or negative results. This can refer to action on the part of either the publisher or the submitter. At least one major journal provides authors with instructions outlining that already known or negative results will only be accepted under extraordinary circumstances Additionally, researchers themselves may refrain from submitting negative or inconclusive results for publication, either in anticipation of rejection or simply deciding not to put forth the effort to publish. 18 Time-lag bias has also been observed, where nonpositive results may take a significantly longer period of time to be submitted and published. 17,18 In a related fashion, positive results can lead to multiple publication bias, where more than one paper is published reporting the same results. 17,19 Another type of bias is outcome reporting bias, where primary hypothesis results are nonsignificant, but secondary hypotheses may have a positive result. These results are then reported as though they were the primary result. For example, a publication of a study of setraline reported results for several hypotheses, but did not identify the primary hypothesis as it was reported to the FDA, and the discussion focused more on significant secondary hypotheses. 13,20 Reporting results in this fashion not VOLUME 2 ISSUE 5 375
3 results. Statistical significance tests, including Begg s test 23 and Egger s test, 24 have been developed to indicate significance of the asymmetry. However, departures from symmetry can also result from poor study methodology, spurious reporting, real relationships between effect size and standard error, sampling variability, and random chance. 1 Thus, meta-analysts should research the sources of asymmetry in these funnel plots before drawing the conclusion of publication bias. Figure 1. (A) A funnel plot with pooled estimate (solid line) and approximate pointwise 95% confi dence limits showing no apparent publication bias. (B) A funnel plot suggesting publication bias in favor of larger studies and positive results. only contributes to publication bias, but has potential to obscure the original study design, further hampering the meta-analyst. There is also evidence that legitimately significant effect sizes may be inflated in published literature in comparison to results submitted for FDA approval. 13,21 Analysis Methods Assessing publication bias Regardless of the source of reporting bias, the impact remains the same. The meta-analyst may be left to contend with an incomplete list of questionably reported results. Funnel plots provide a graphical approach to investigating bias. These display the effect size estimates plotted against the sample sizes or standard errors. An unbiased sample of studies should appear as a roughly symmetric funnel centered on the population average effect. Departures from this shape, particularly if one side of the funnel is missing, indicates selection bias is likely present. Figure 1 shows two funnel plots of hypothetical odds ratio (OR) results generated with Stata 10 software (StataCorp, College Station, TX, USA). 22 The vertical lines in the middle of each plot represent the log of the pooled OR estimate and the dashed lines represent approximate point-wise 95% confidence limits. The symmetry in Figure 1A suggests no publication bias in the selected studies. We removed the studies having smaller effect and sample sizes and plotted the remainder in Figure 1B. The asymmetry in this plot would suggest publication bias toward larger studies and positive Combining studies Once studies have been selected, data must be combined appropriately to estimate the effect or association of interest and answer the research question. Analysis of data from multiple studies may be divided into two types: combined analysis of summary measures and pooled analysis of subject-level data. Pooled analysis of subject-level data from multiple studies is increasingly common and generally preferred if the data are available, but may be too restrictive in some areas of research. Methods for this type of analysis can be found in several references As subject-level data may be difficult to obtain, a more common approach is to combine measures of effect from the selected studies using weighted averaging or a regression model. The idea is to calculate the average measure of this effect where study-specific estimates are weighted by some function of the sample size and/or standard error of the estimate, reflecting the relative importance of each study. Models for combining effect estimates can be further divided into two categories: fixed effects and random effects. Fixed-effect models assume the studies being combined are multiple replicates of the same study where the true effect measure being estimated in each study is the same. By contrast, random-effects models assume that each study is chosen at random from a multitude of possible studies. The true effect measure is assumed to be different for each study due to, e.g., differences in the precise populations sampled or differences in study methodology. The choice of method can have a substantial impact on the results, particularly if sample sizes or event rates are small for most of the studies. In particular, if a study has no events, it will be excluded from a fixed-effects analysis of ratio estimates as the study-specific estimate is undefined. Careful thought should be given to the choice of statistical model and the assumptions underlying each model when combining data from multiple studies. Further insight into the differences between fixed- and random-effects models can be found elsewhere. 28,29 Heterogeneity in either the populations sampled or the manner in which the data were modeled should raise suspicion of the validity or reliability of the results, as it can introduce confounding and other defects into the meta-analysis. Unfortunately, heterogeneity is typically unavoidable. The extent of its influence can be investigated by diagnostic analysis of the sensitivity of the results to one or more of the studies, similar to the methods used in regression model diagnostics. Additionally, the Q-statistic 30 or the I 2 -statistic 31 can be calculated to test for the homogeneity or constancy of the effects or associations reported among studies. Moreover, to correct for sources of observed heterogeneity, fixed- and random-effects meta-analytic regression models can include study-level covariate information if it has been consistently reported in the selected studies. Presentation of results As the results from a meta-analysis summarize the results of multiple studies, the presentation of the results should describe 376 VOLUME 2 ISSUE 5
4 assumption that each included study meets the preset inclusion criteria and there is no information with which to extend the model, for example by meta-regression, then the heterogeneity may be attributed to random sampling error. A random-effects model would then be a more appropriate choice, which produces a pooled OR of 1.11 with 95% confidence interval (0.91, 1.34). Figure 2. A forest plot from a weighted meta-analysis of odds ratios. both final pooled summary statistics and the data from each study. It is customary to produce a table of descriptive information on each study under consideration, which concisely summarizes each study s design, targeted population, characteristics of the sample (e.g., demographic information), and the statistical methods used to analyze the data. This allows the reader to assess the heterogeneity among the studies which might influence the quality of the results. The more similar the selected studies are with respect to sample selection and effect or association modeling, the better the meta-analytic sample will represent the population under study. The meta-analytic sample will thus have qualities similar to a simple random sample and the summary statistics from the meta-analysis will tend to be unbiased and considered reliable. We recommend that the original results from each study, in terms of the effect estimate, their standard errors, and statistical significance (i.e., 95% confidence intervals or p values), should be reported in a single table along with the results of the metaanalysis. The information from this table as well as the respective contributions of each study to the pooled meta-analytic estimate can also be displayed graphically using a forest plot. 32 Figure 2 displays a forest plot of hypothetical ORs on the log-scale. Each study is summarized by a row in the plot from left to right by a study identifier, a plot of the reported OR estimate and 95% confidence interval, a box proportional in size to the sample size relative to the other studies, the tabulated OR and 95% confidence interval, and the relative weight given to the study. The last row represents the overall pooled results from a fixed-effects model. The plotted values can be easily compared to the null hypothesis of no association represented by the solid vertical line or to the pooled estimate represented by the diamond shape and dashed vertical line. The 95% confidence interval for the pooled OR (0.96, 1.31) includes 1. Thus, at the 0.05 significance level we would not reject a null hypothesis of no association. Furthermore, the I 2 test statistic suggests that if the population of studies from which these results came were homogeneous, then the probability of observing these data would be low (p = 0.016). The source of the heterogeneity is unclear from the data presented and should spur the meta-analyst to review the included studies. Under the Case Study 1 Almost half of cancer survivors are younger than 65, but subsequent employment status has not been well examined. de Boer et al. published what we feel to be a good example of a well-conducted meta-analysis on observational studies. At the outset, specific study inclusion and exclusion criteria were set, based on presence of a control group, average age between 18 and 60, and assessment of employment status after cancer treatment. MEDLINE and four additional subscription databases were searched for eligible studies. Individual study characteristics were then reported in a table. Additionally, quality of each study was assessed on twelve aspects using the methodological index for nonrandomized studies (MINOR) and reported as well. Publication bias was examined using the Egger statistic, from which it was determined that none was present. Heterogeneity was quantified using the I 2 -statistic. To account for heterogeneity, separate meta-analyses were run within cancer diagnosis subgroups and using randomeffects models. Furthermore, associations were calculated using the multivariate meta-regression models that adjusted for other employment-related variables. A forest plot of results was included. The researchers were able to conclude that cancer survivors were about 1.37 times more likely to be unemployed as healthy controls. This meta-analysis serves as a good example of the procedure, with straightforward inclusion/exclusion criteria, an intensive search of available literature, assessment of publication bias, multiple methods for addressing study heterogeneity, and the proper use of random-effects methods. 33 Case Study 2 Rosiglitazone is a drug used to control blood glucose levels in patients with type 2 diabetes mellitus. While the drug was extensively studied with respect to efficacy, none of the trials were large enough to conclusively establish the risk of cardiovascular (CV) events. Nissen and Wolski reported on results of a metaanalysis assessing the impact of Rosiglitazone on risk of myocardial infarction (MI) and cardiac death (CD). 34 They identified 116 studies from published and unpublished reports, out of which 48 met their criteria for inclusion. A fixed-effects analysis concluded that Rosiglitazone increased the risk of myocardial infarction (RR = 1.43 [ ], p = 0.03) but could not conclude that there was increased risk of CD (RR = 1.64 [ ], p = 0.06). After these findings were published, the FDA issued a public safety alert about potential for increased risk of CV events and sales of the drug plummeted. While the authors followed proper procedures in study selection, less careful attention was paid to the choice of statistical model. Of the 48 studies, 6 had no MI in either study drug arm and 23 had no CD and were consequently excluded from the fixed-effects analyses. A subsequent reanalysis of the same data using a random-effects model showed insufficient evidence for a difference in the risk of MI (RR = 1.51 [ ], p = 0.11), but concluded that there was a significant increase in the risk of CD (RR = 2.37 [ ], p = ). 28 The authors of this analysis used it as a cautionary tale of over-reliance on VOLUME 2 ISSUE 5 377
5 meta-analysis for setting public policy, and expressed confidence that large ongoing randomized trials for evaluating long-term cardiac outcomes would provide more conclusive evidence. However, the recent inconclusive results of one of these trials, the RECORD trial, may indicate that this confidence was misplaced and argue for the value of meta-analysis even when data from large trials are available. 35,36 Conclusions Meta-analysis is generally a relatively simple analytic procedure. The effort that surrounds meta-analysis is not concentrated in the data analysis, but rather in the strict attention to detail, both in the background research and the correct selection of analytical models. This requires carefully defining a hypothesis, establishing and strictly adhering to inclusion and exclusion criteria, and thoroughly searching through all available resources for eligible studies, assessing potential bias and heterogeneity, and appropriately selecting a model. Only after these preliminary objectives have been achieved should the meta-analyst proceed with the relatively straightforward process of conducting the data analysis and reporting findings. Inattention to these details can lead to a meta-analysis that is inaccurate and misleading, as shown in our second case study. It is not our intention to discourage researchers from attempting a meta-analysis, but rather to encourage vigilance in approaching all aspects of this important process. References 1. Altman LK. New method of analyzing health data stirs debate. NewYork Times Saul S. Heart attack risk seen in drug for diabetes. NewYork Times Berman NG, Parker RA. Meta-analysis: neither quick nor easy. BMC Med Res Methodol. 2002; 2: Benson JR, Saeb-Parsy K. Meta-analyses in cancer clinical trials: principles and pitfalls. World J Surg. 2006; 30: Jones DR. Meta-analysis of observational epidemiological studies: a review. J R Soc Med. 1992; 85: Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses Lancet. 1999; 354: Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB. Meta-analysis of observational studies in epidemiology a proposal for reporting. JAMA. 2000; 283: Moher D, Liberati A, Tetzlaff J, Altman DG, Group The PRISMA. Preferred reporting items for systematic reviews and meta-analysis: the PRISMA statement. PLoS Med. 2009; 6(7): e McAuley I, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature infl uence estimates of intervention effectiveness reported in meta-analyses? Lancet. 2000; 356: Hopewell S, McDonald S, Clarke M, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions Cochrane Database Syst Rev. 2007; 2: Dickersin K, Manheimer E, Wieland S, Robinson KA, Lefebvre C, McDonald S. Development of the Cochrane Collaboration s CENTRAL Register of controlled clinical trials. Eval Health Prof. 2002; 25: McCray AT, Ide NC. Design and implementation of a national clinical trials registry. J Am Med Inform Assoc. 2000; 7: Turner EH. A taxpayer-funded clinical trials registry and results database. PLoS Med. 2004; 1: e Egger M, Smith GD, Phillips AN. Meta-analysis: principles and procedures. BMJ. 1997; 315: Egger M, Smith GD. Misleading meta-analysis. BMJ. 1995; 310: Egger M, Smith GD, Sterne JA. Uses and abuses of meta-analysis. Clin Med. 2001; 1: Egger M, Smith GD. Bias in location and selection of studies. BMJ. 1998; 316: Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ. 1997; 8: Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991; 337: Fabre LF, Abuzzahab FS, Amin M, Claghorn JL, Mendels J, Petrie WM, Dubé S, Small JG. Sertraline safety and effi cacy in major depression: a double-blind fi xed-dose comparison with placebo. Biol Psychiatr. 1995; 38: Turner EH, Matthews AM, Linardatos E, Rosenthal RA, Tell R. Selective publication of antidepressant trials and its infl uence on apparent effi cacy. N Engl J Med. 2008; 358: Sterne JAC, ed. Meta-Analysis: An Updated Collection from the Stata Journal. College Station, TX: Stata Press, Begg CB. Publication Bias. In: The Handbook of Research Synthesis. Cooper H, Hedges LV, eds. New York: Russell Sage Foundation, 1994, Egger M, Davey-Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997; 315: Clarke M, Stewart L, Pignon JP, Bijnens L. Individual patient data meta-analyses in cancer Br J Cancer. 1998; 77: Stewart LA, Tierney JF. To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Eval Health Prof. 2002; 25: Stewart LA, Clarke MJ. Practical methodology of meta-anlyses (overviews) using updated individual patient data. Stat Med. 1995; 14: Shuster JJ, Jones LS, Salmon DA. Fixed vs random effects meta-analysis in rare event studies: the rosiglitazone link with myocardial infarction and cardiac death. Stat Med. 2007; 26: Hedges LV, Vevea JL. Fixed- and random-effects models in meta-analysis. Psycholl Methods. 1998; 3: DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986; 7: Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003; 327: Lewis S, Clarke M. Forest plots: trying to see the wood and the trees. BMJ. 2001; 322: Boer AGEM, Tasklia T, Dijk Anneli Ojajärvi, Verbeek Jos HAM. Cancer survivors and unemployment: a meta-analysis and meta-regression. JAMA. 2009; 301: Nissen SE, Wolski K. Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. N Engl J Med. 2007; 49: Home PD, Pocock SJ, Beck-Nielsen H, Curtis PS, Gomis R, Hanefeld M, Jones NP, Komajda M, McMurray JJ; RECORD Study Team. Rosiglitazone evaluated for cardiovascular outcomes in oral agent combination therapy for type 2 diabetes (RECORD): a multicentre, randomised, open-label trial. The Lancet. 2009; 373: Retnakaran R, Zinman B. Thiazolidinediones and clinical outcomes in type 2 diabetes. The Lancet. 2009; 373: VOLUME 2 ISSUE 5
Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias
Technical appendix Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias Choice of axis in funnel plots Funnel plots were first used in educational research and psychology,
More information18/11/2013. An Introduction to Meta-analysis. In this session: What is meta-analysis? Some Background Clinical Trials. What questions are addressed?
In this session: What is meta-analysis? An Introduction to Meta-analysis Geoff Der Unit Statistician MRC/CSO Social and Public Health Sciences Unit, University of Glasgow When is it appropriate to use?
More informationA protocol for a systematic review on the impact of unpublished studies and studies published in the gray literature in meta-analyses
Systematic Reviews This Provisional PDF corresponds to the article as it appeared upon acceptance. Fully formatted PDF and full text (HTML) versions will be made available soon. A protocol for a systematic
More informationSystematic Reviews. Simon Gates 8 March 2007
Systematic Reviews Simon Gates 8 March 2007 Contents Reviewing of research Why we need reviews Traditional narrative reviews Systematic reviews Components of systematic reviews Conclusions Key reference
More informationCritical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death. Debra Moy Faculty of Pharmacy University of Toronto
Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death Debra Moy Faculty of Pharmacy University of Toronto Goal To provide practitioners with a systematic approach to evaluating a meta analysis
More informationEvidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co.
Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co. Meta-Analysis Defined A meta-analysis is: the statistical combination of two or more separate studies In other words: overview,
More informationEvaluating the results of a Systematic Review/Meta- Analysis
Open Access Publication Evaluating the results of a Systematic Review/Meta- Analysis by Michael Turlik, DPM 1 The Foot and Ankle Online Journal 2 (7): 5 This is the second of two articles discussing the
More informationMeta-Analysis. Zifei Liu. Biological and Agricultural Engineering
Meta-Analysis Zifei Liu What is a meta-analysis; why perform a metaanalysis? How a meta-analysis work some basic concepts and principles Steps of Meta-analysis Cautions on meta-analysis 2 What is Meta-analysis
More informationResults. NeuRA Hypnosis June 2016
Introduction may be experienced as an altered state of consciousness or as a state of relaxation. There is no agreed framework for administering hypnosis, but the procedure often involves induction (such
More informationSchool of Dentistry. What is a systematic review?
School of Dentistry What is a systematic review? Screen Shot 2012-12-12 at 09.38.42 Where do I find the best evidence? The Literature Information overload 2 million articles published a year 20,000 biomedical
More informationCochrane Pregnancy and Childbirth Group Methodological Guidelines
Cochrane Pregnancy and Childbirth Group Methodological Guidelines [Prepared by Simon Gates: July 2009, updated July 2012] These guidelines are intended to aid quality and consistency across the reviews
More informationIntroduction to meta-analysis
Introduction to meta-analysis Steps of a Cochrane review 1. define the question 2. plan eligibility criteria 3. plan methods 4. search for studies 5. apply eligibility criteria 6. collect data 7. assess
More informationResults. NeuRA Treatments for internalised stigma December 2017
Introduction Internalised stigma occurs within an individual, such that a person s attitude may reinforce a negative self-perception of mental disorders, resulting in reduced sense of selfworth, anticipation
More informationWhat is indirect comparison?
...? series New title Statistics Supported by sanofi-aventis What is indirect comparison? Fujian Song BMed MMed PhD Reader in Research Synthesis, Faculty of Health, University of East Anglia Indirect comparison
More informationSYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS
SYSTEMATIC REVIEW: AN APPROACH FOR TRANSPARENT RESEARCH SYNTHESIS A Case Study By Anil Khedkar, India (Masters in Pharmaceutical Science, PhD in Clinical Research Student of Texila American University)
More informationDisclosures. An Introduction to Meta Analysis. Biography, SL Norris 2/20/2012
An Introduction to Meta Analysis Susan L. Norris, MD, MPH, MS Associate Professor Oregon Health & Science University Portland, OR norriss@ohsu.edu Biography, SL Norris MD, MS, University of Alberta MPH,
More informationContour enhanced funnel plots for meta-analysis
Contour enhanced funnel plots for meta-analysis Tom Palmer 1, Jaime Peters 2, Alex Sutton 3, Santiago Moreno 3 1. MRC Centre for Causal Analyses in Translational Epidemiology, Department of Social Medicine,
More informationProblem solving therapy
Introduction People with severe mental illnesses such as schizophrenia may show impairments in problem-solving ability. Remediation interventions such as problem solving skills training can help people
More informationIntroduction to systematic reviews/metaanalysis
Introduction to systematic reviews/metaanalysis Hania Szajewska The Medical University of Warsaw Department of Paediatrics hania@ipgate.pl Do I needknowledgeon systematicreviews? Bastian H, Glasziou P,
More informationResults. NeuRA Mindfulness and acceptance therapies August 2018
Introduction involve intentional and non-judgmental focus of one's attention on emotions, thoughts and sensations that are occurring in the present moment. The aim is to open awareness to present experiences,
More informationSystematic Reviews and Meta- Analysis in Kidney Transplantation
Systematic Reviews and Meta- Analysis in Kidney Transplantation Greg Knoll MD MSc Associate Professor of Medicine Medical Director, Kidney Transplantation University of Ottawa and The Ottawa Hospital KRESCENT
More informationIssues in Meta-Analysis: An Overview
REVIEW Issues in Meta-Analysis: An Overview Alfred A. Bartolucci, Charles R. Katholi, Karan P. Singh, and Graciela S. Alarc6n A summary is provided for the relevant issues that investigators must address
More informationDistraction techniques
Introduction are a form of coping skills enhancement, taught during cognitive behavioural therapy. These techniques are used to distract and draw attention away from the auditory symptoms of schizophrenia,
More informationAnimal-assisted therapy
Introduction Animal-assisted interventions use trained animals to help improve physical, mental and social functions in people with schizophrenia. It is a goal-directed intervention in which an animal
More informationLive WebEx meeting agenda
10:00am 10:30am Using OpenMeta[Analyst] to extract quantitative data from published literature Live WebEx meeting agenda August 25, 10:00am-12:00pm ET 10:30am 11:20am Lecture (this will be recorded) 11:20am
More informationTrials and Tribulations of Systematic Reviews and Meta-Analyses
Trials and Tribulations of Systematic Reviews and Meta-Analyses Mark A. Crowther and Deborah J. Cook St. Joseph s Hospital, Hamilton, Ontario, Canada; McMaster University, Hamilton, Ontario, Canada Systematic
More informationFixed Effect Combining
Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse
More informationControlled Trials. Spyros Kitsiou, PhD
Assessing Risk of Bias in Randomized Controlled Trials Spyros Kitsiou, PhD Assistant Professor Department of Biomedical and Health Information Sciences College of Applied Health Sciences University of
More informationHow to do a meta-analysis. Orestis Efthimiou Dpt. Of Hygiene and Epidemiology, School of Medicine University of Ioannina, Greece
How to do a meta-analysis Orestis Efthimiou Dpt. Of Hygiene and Epidemiology, School of Medicine University of Ioannina, Greece 1 Overview (A brief reminder of ) What is a Randomized Controlled Trial (RCT)
More informationCochrane Bone, Joint & Muscle Trauma Group How To Write A Protocol
A p r i l 2 0 0 8 Cochrane Bone, Joint & Muscle Trauma Group How To Write A Protocol This booklet was originally produced by the Cochrane Renal Group to make the whole process of preparing a protocol as
More informationTraumatic brain injury
Introduction It is well established that traumatic brain injury increases the risk for a wide range of neuropsychiatric disturbances, however there is little consensus on whether it is a risk factor for
More informationResults. NeuRA Worldwide incidence April 2016
Introduction The incidence of schizophrenia refers to how many new cases there are per population in a specified time period. It is different from prevalence, which refers to how many existing cases there
More informationWhat is meta-analysis?
...? series Supported by sanofi-aventis Second edition Evidence-based medicine What is Iain K Crombie PhD FFPHM Professor of Public Health, University of Dundee Huw TO Davies PhD Professor of Health Care
More informationPerformance of the Trim and Fill Method in Adjusting for the Publication Bias in Meta-Analysis of Continuous Data
American Journal of Applied Sciences 9 (9): 1512-1517, 2012 ISSN 1546-9239 2012 Science Publication Performance of the Trim and Fill Method in Adjusting for the Publication Bias in Meta-Analysis of Continuous
More informationCapture-recapture method for assessing publication bias
Received: 30.9.2009 Accepted: 19.1.2010 Original Article Capture-recapture method for assessing publication bias Jalal Poorolajal* a, Ali Akbar Haghdoost b, Mahmood Mahmoodi a, Reza Majdzadeh a, Siavosh
More informationSystematic Review & Course outline. Lecture (20%) Class discussion & tutorial (30%)
Systematic Review & Meta-analysisanalysis Ammarin Thakkinstian, Ph.D. Section for Clinical Epidemiology and Biostatistics Faculty of Medicine, Ramathibodi Hospital Tel: 02-201-1269, 02-201-1762 Fax: 02-2011284
More informationClinical research in AKI Timing of initiation of dialysis in AKI
Clinical research in AKI Timing of initiation of dialysis in AKI Josée Bouchard, MD Krescent Workshop December 10 th, 2011 1 Acute kidney injury in ICU 15 25% of critically ill patients experience AKI
More informationHow to Conduct a Meta-Analysis
How to Conduct a Meta-Analysis Faculty Development and Diversity Seminar ludovic@bu.edu Dec 11th, 2017 Periodontal disease treatment and preterm birth We conducted a metaanalysis of randomized controlled
More informationCochrane Breast Cancer Group
Cochrane Breast Cancer Group Version and date: V3.2, September 2013 Intervention Cochrane Protocol checklist for authors This checklist is designed to help you (the authors) complete your Cochrane Protocol.
More informationA brief history of the Fail Safe Number in Applied Research. Moritz Heene. University of Graz, Austria
History of the Fail Safe Number 1 A brief history of the Fail Safe Number in Applied Research Moritz Heene University of Graz, Austria History of the Fail Safe Number 2 Introduction Rosenthal s (1979)
More informationMeta-analyses: analyses:
Meta-analyses: analyses: how do they help, and when can they not? Lee Hooper Senior Lecturer in research synthesis & nutrition l.hooper@uea.ac.uk 01603 591268 Aims Systematic Reviews Discuss the scientific
More informationResearch Synthesis and meta-analysis: themes. Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH
Research Synthesis and meta-analysis: themes Graham A. Colditz, MD, DrPH Method Tuuli, MD, MPH Today Course format Goals, competencies Overview of themes for the class SRMA M19-551 Course Format Lectures»
More informationMeta-analysis: Methodology
Meta-analysis: Methodology Example: Assessment of cardiovascular safety profile of new generation BCR-ABL TKIs in patients with CML Haguet Hélène 04/03/2016 Meta-analysis = statistical combination of results
More informationThe Meta on Meta-Analysis. Presented by Endia J. Lindo, Ph.D. University of North Texas
The Meta on Meta-Analysis Presented by Endia J. Lindo, Ph.D. University of North Texas Meta-Analysis What is it? Why use it? How to do it? Challenges and benefits? Current trends? What is meta-analysis?
More informationStatistical methods for assessing the inuence of study characteristics on treatment eects in meta-epidemiological research
STATISTICS IN MEDICINE Statist. Med. 2002; 21:1513 1524 (DOI: 10.1002/sim.1184) Statistical methods for assessing the inuence of study characteristics on treatment eects in meta-epidemiological research
More informationResults. NeuRA Motor dysfunction April 2016
Introduction Subtle deviations in various developmental trajectories during childhood and adolescence may foreshadow the later development of schizophrenia. Studies exploring these deviations (antecedents)
More informationAssessing publication bias in genetic association studies: evidence from a recent meta-analysis
Psychiatry Research 129 (2004) 39 44 www.elsevier.com/locate/psychres Assessing publication bias in genetic association studies: evidence from a recent meta-analysis Marcus R. Munafò a, *, Taane G. Clark
More informationResults. NeuRA Forensic settings April 2016
Introduction Prevalence quantifies the proportion of individuals in a population who have a disease during a specific time period. Many studies have reported a high prevalence of various health problems,
More informationResults. NeuRA Family relationships May 2017
Introduction Familial expressed emotion involving hostility, emotional over-involvement, and critical comments has been associated with increased psychotic relapse in people with schizophrenia, so these
More informationThe QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews
The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews David Moher 1, Alessandro Liberati 2, Douglas G Altman 3, Jennifer Tetzlaff 1 for the QUOROM Group
More informationWorkshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health.
Workshop: Cochrane Rehabilitation 05th May 2018 Trusted evidence. Informed decisions. Better health. Disclosure I have no conflicts of interest with anything in this presentation How to read a systematic
More informationSystematic reviews and meta-analyses of observational studies (MOOSE): Checklist.
Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. MOOSE Checklist Infliximab reduces hospitalizations and surgery interventions in patients with inflammatory bowel disease:
More informationResults. NeuRA Treatments for dual diagnosis August 2016
Introduction Many treatments have been targeted to improving symptom severity for people suffering schizophrenia in combination with substance use problems. Studies of dual diagnosis often investigate
More informationAssessing the risk of outcome reporting bias in systematic reviews
Assessing the risk of outcome reporting bias in systematic reviews Kerry Dwan (kdwan@liv.ac.uk) Jamie Kirkham (jjk@liv.ac.uk) ACKNOWLEDGEMENTS: Doug G Altman, Carrol Gamble, Paula R Williamson Funding:
More informationStatistical probability was first discussed in the
COMMON STATISTICAL ERRORS EVEN YOU CAN FIND* PART 1: ERRORS IN DESCRIPTIVE STATISTICS AND IN INTERPRETING PROBABILITY VALUES Tom Lang, MA Tom Lang Communications Critical reviewers of the biomedical literature
More informationThe moderating impact of temporal separation on the association between intention and physical activity: a meta-analysis
PSYCHOLOGY, HEALTH & MEDICINE, 2016 VOL. 21, NO. 5, 625 631 http://dx.doi.org/10.1080/13548506.2015.1080371 The moderating impact of temporal separation on the association between intention and physical
More informationLearning from Systematic Review and Meta analysis
Learning from Systematic Review and Meta analysis Efficacy and Safety of Antiscabietic Agents: A Systematic Review and Network Meta analysis of Randomized Controlled Trials KUNLAWAT THADANIPON, MD 4 TH
More informationHow to interpret a meta-analysis and judge its value as a guide for clinical practice
Acta Orthopaedica ISSN: 1745-3674 (Print) 1745-3682 (Online) Journal homepage: http://www.tandfonline.com/loi/iort20 How to interpret a meta-analysis and judge its value as a guide for clinical practice
More informationMethod. NeuRA Biofeedback May 2016
Introduction is a technique in which information about the person s body is fed back to the person so that they may be trained to alter the body s conditions. Physical therapists use biofeedback to help
More informationMisleading funnel plot for detection of bias in meta-analysis
Journal of Clinical Epidemiology 53 (2000) 477 484 Misleading funnel plot for detection of bias in meta-analysis Jin-Ling Tang a, *, Joseph LY Liu b a Department of Community and Family Medicine, Faculty
More informationMeta-analysis: Basic concepts and analysis
Meta-analysis: Basic concepts and analysis Matthias Egger Institute of Social & Preventive Medicine (ISPM) University of Bern Switzerland www.ispm.ch Outline Rationale Definitions Steps The forest plot
More informationPlacebo-controlled trials of Chinese herbal medicine and conventional medicine comparative study
Published by Oxford University Press on behalf of the International Epidemiological Association ß The Author 2007; all rights reserved. Advance Access publication 30 June 2007 International Journal of
More informationPrinciples of meta-analysis
Principles of meta-analysis 1 The popularity of meta-analyses Search on 22 October 2015 10000 9000 8156 8875 8000 7000 6554 6000 5000 4852 4000 3000 2000 1000 0 1 1 1 272 334 371 323 386 429 482 596 639
More informationPROTOCOL. Francesco Brigo, Luigi Giuseppe Bongiovanni
COMMON REFERENCE-BASED INDIRECT COMPARISON META-ANALYSIS OF INTRAVENOUS VALPROATE VERSUS INTRAVENOUS PHENOBARBITONE IN GENERALIZED CONVULSIVE STATUS EPILEPTICUS PROTOCOL Francesco Brigo, Luigi Giuseppe
More informationSupplementary Online Content
Supplementary Online Content Wu HY, Peng YS, Chiang CK, et al. Diagnostic performance of random urine samples using albumin concentration vs ratio of albumin to creatinine for microalbuminuria screening
More informationSystematic reviewers neglect bias that results from trials stopped early for benefit
Journal of Clinical Epidemiology 60 (2007) 869e873 REVIEW ARTICLE Systematic reviewers neglect bias that results from trials stopped early for benefit Dirk Bassler a,b, Ignacio Ferreira-Gonzalez a,c,d,
More informationCritical appraisal: Systematic Review & Meta-analysis
Critical appraisal: Systematic Review & Meta-analysis Atiporn Ingsathit MD.PhD. Section for Clinical Epidemiology and biostatistics Faculty of Medicine Ramathibodi Hospital Mahidol University What is a
More informationStudy protocol v. 1.0 Systematic review of the Sequential Organ Failure Assessment score as a surrogate endpoint in randomized controlled trials
Study protocol v. 1.0 Systematic review of the Sequential Organ Failure Assessment score as a surrogate endpoint in randomized controlled trials Harm Jan de Grooth, Jean Jacques Parienti, [to be determined],
More informationresearch methods & reporting
research methods & reporting Meta-analysis of individual participant data: rationale, conduct, and reporting Richard D Riley, 1 Paul C Lambert, 2 Ghada Abo-Zaid 3 1 Department of Public Health, Epidemiology
More informationMeta-analysis of safety thoughts from CIOMS X
CIOMS Working Group X Meta-analysis of safety thoughts from CIOMS X Stephen.Evans@Lshtm.ac.uk Improving health worldwide www.lshtm.ac.uk Evans: ENCePP CIOMS Meta Analysis 1 Acknowledgements, conflicts,
More informationGUIDELINE COMPARATORS & COMPARISONS:
GUIDELINE COMPARATORS & COMPARISONS: Direct and indirect comparisons Adapted version (2015) based on COMPARATORS & COMPARISONS: Direct and indirect comparisons - February 2013 The primary objective of
More informationSupplementary Online Content
Supplementary Online Content Tsai WC, Wu HY, Peng YS, et al. Association of intensive blood pressure control and kidney disease progression in nondiabetic patients with chronic kidney disease: a systematic
More informationThe angiotensin-converting enzyme (ACE) I/D polymorphism in Parkinson s disease
4432JRA0010.1177/1470320313494432Journal of the Renin-Angiotensin-Aldosterone SystemSu et al Original Article The angiotensin-converting enzyme (ACE) I/D polymorphism in Parkinson s disease Journal of
More informationAn example of a systematic review and meta-analysis
An example of a systematic review and meta-analysis Sattar N et al. Statins and risk of incident diabetes: a collaborative meta-analysis of randomised statin trials. Lancet 2010; 375: 735-742. Search strategy
More informationCotrimoxazole preventive therapy in adults and pregnant women with HIV: a systematic review and meta-analysis
Cotrimoxazole preventive therapy in adults and pregnant women with HIV: a systematic review and meta-analysis Introduction Global efforts to scale-up antiretroviral therapy (ART) averted an estimated 4.2
More informationThe Royal College of Pathologists Journal article evaluation questions
The Royal College of Pathologists Journal article evaluation questions Previous exam questions Dorrian CA, Toole, BJ, Alvarez-Madrazo S, Kelly A, Connell JMC, Wallace AM. A screening procedure for primary
More informationEssential Skills for Evidence-based Practice Understanding and Using Systematic Reviews
J Nurs Sci Vol.28 No.4 Oct - Dec 2010 Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews Jeanne Grace Corresponding author: J Grace E-mail: Jeanne_Grace@urmc.rochester.edu
More informationC2 Training: August 2010
C2 Training: August 2010 Introduction to meta-analysis The Campbell Collaboration www.campbellcollaboration.org Pooled effect sizes Average across studies Calculated using inverse variance weights Studies
More informationNeuRA Obsessive-compulsive disorders October 2017
Introduction (OCDs) involve persistent and intrusive thoughts (obsessions) and repetitive actions (compulsions). The DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition) defines
More informationNeuRA Sleep disturbance April 2016
Introduction People with schizophrenia may show disturbances in the amount, or the quality of sleep they generally receive. Typically sleep follows a characteristic pattern of four stages, where stage
More informationPublication Bias in Meta-analysis. Hannah R. Rothstein Department of Management, Zicklin School of Business, Baruch College, New York, USA
CHAPTER 1 Publication Bias in Meta-analysis Hannah R. Rothstein Department of Management, Zicklin School of Business, Baruch College, New York, USA Alex J. Sutton Department of Health Sciences, University
More informationBiostatistics Primer
BIOSTATISTICS FOR CLINICIANS Biostatistics Primer What a Clinician Ought to Know: Subgroup Analyses Helen Barraclough, MSc,* and Ramaswamy Govindan, MD Abstract: Large randomized phase III prospective
More informationResults. NeuRA Essential fatty acids August 2016
Introduction Alternative treatments are investigated as a possible replacement for antipsychotic medication, which can be associated with severe side effects. Alternative therapies may have less debilitating
More informationSystematic Review of RCTs of Haemophilus influenzae Type b Conjugate Vaccines: Efficacy and immunogenicity
Supplementary text 1 Systematic Review of RCTs of Haemophilus influenzae Type b Conjugate Vaccines: Efficacy and immunogenicity Review protocol Pippa Scott, Shelagh Redmond, Nicola Low and Matthias Egger
More informationIndex. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI /
Index A Adjusted Heterogeneity without Overdispersion, 63 Agenda-driven bias, 40 Agenda-Driven Meta-Analyses, 306 307 Alternative Methods for diagnostic meta-analyses, 133 Antihypertensive effect of potassium,
More informationResults. NeuRA Herbal medicines August 2016
Introduction have been suggested as a potential alternative treatment which may positively contribute to the treatment of schizophrenia. Herbal therapies can include traditional Chinese medicines and Indian
More informationPROSPERO International prospective register of systematic reviews
PROSPERO International prospective register of systematic reviews High-dose chemotherapy followed by autologous haematopoietic cell transplantation for children, adolescents and young adults with first
More informationMeta-Analysis De-Mystified: A Step-by-Step Workshop
Meta-Analysis De-Mystified: A Step-by-Step Workshop Eval Café Evaluation Center at WMU January, 2012 Robert McCowen, IDPE robert.h.mccowen@wmich.edu Overview Background and Context Applications of Meta-Analysis
More informationMeta Analysis. David R Urbach MD MSc Outcomes Research Course December 4, 2014
Meta Analysis David R Urbach MD MSc Outcomes Research Course December 4, 2014 Overview Definitions Identifying studies Appraising studies Quantitative synthesis Presentation of results Examining heterogeneity
More informationNeuRA Decision making April 2016
Introduction requires an individual to use their knowledge and experience of a context in order to choose a course of action 1. A person s ability to autonomously make decisions is referred to as their
More informationThresholds for statistical and clinical significance in systematic reviews with meta-analytic methods
Jakobsen et al. BMC Medical Research Methodology 2014, 14:120 CORRESPONDENCE Open Access Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods Janus Christian
More informationWeb appendix (published as supplied by the authors)
Web appendix (published as supplied by the authors) In this appendix we provide motivation and considerations for assessing the risk of bias for each of the items included in the Cochrane Collaboration
More informationNeuRA Schizophrenia diagnosis May 2017
Introduction Diagnostic scales are widely used within clinical practice and research settings to ensure consistency of illness ratings. These scales have been extensively validated and provide a set of
More informationMeasuring and Assessing Study Quality
Measuring and Assessing Study Quality Jeff Valentine, PhD Co-Chair, Campbell Collaboration Training Group & Associate Professor, College of Education and Human Development, University of Louisville Why
More informationPROSPERO International prospective register of systematic reviews
PROSPERO International prospective register of systematic reviews Prophylactic cranial irradiation in patients with non-small-cell lung cancer: a systematic review and meta-analysis of randomized controlled
More informationSystematic reviews and meta-analyses
Systematic reviews and meta-analyses Oulu 8.4.2015 Jouko Miettunen, professor Center for Life Course Epidemiology and Systems Medicine University of Oulu jouko.miettunen@oulu.fi Contents Background Literature
More informationTranscranial Direct-Current Stimulation
Introduction (tdcs) is a non-invasive form of brain stimulation similar to transcranial magnetic stimulation, but instead of using magnets, it uses a lowintensity, constant current applied through scalp
More informationApplicable or non-applicable: investigations of clinical heterogeneity in systematic reviews
Chess and Gagnier BMC Medical Research Methodology (2016) 16:19 DOI 10.1186/s12874-016-0121-7 RESEARCH ARTICLE Applicable or non-applicable: investigations of clinical heterogeneity in systematic reviews
More informationHeterogeneity and statistical signi"cance in meta-analysis: an empirical study of 125 meta-analyses -
STATISTICS IN MEDICINE Statist. Med. 2000; 19: 1707}1728 Heterogeneity and statistical signi"cance in meta-analysis: an empirical study of 125 meta-analyses - Eric A. Engels *, Christopher H. Schmid, Norma
More information