Module 5. The Epidemiological Basis of Randomised Controlled Trials. Landon Myer School of Public Health & Family Medicine, University of Cape Town

Size: px
Start display at page:

Download "Module 5. The Epidemiological Basis of Randomised Controlled Trials. Landon Myer School of Public Health & Family Medicine, University of Cape Town"

Transcription

1 Module 5 The Epidemiological Basis of Randomised Controlled Trials Landon Myer School of Public Health & Family Medicine, University of Cape Town Introduction The Randomised Controlled Trial (RCT) is the most rigorous experimental design in clinical research. In this design, a researcher randomly allocates eligible people to receive (intervention group) or not to receive (control group) one or more interventions that are being compared. The control group receives either the standard treatment or a placebo (an inactive formulation which looks identical to the intervention treatment) if no standard treatment exists. The results of an RCT are assessed by comparing the occurrence of the outcome of interest between the intervention and control groups. This presentation summarises the key principles of design, conduct and analysis of RCTs for a GCP audience. Basic design of a randomised controlled trial An RCT is a prospective study designed to establish a causal relationship between an intervention and an outcome. In the case of clinical research, the intervention is usually a medical treatment (eg, a new drug, management approach or surgical technique). The outcome may be any health-related event, usually a specific form of morbidity or mortality. Participants must meet specified criteria before being considered eligible for participation in the study. In an RCT, the researcher begins with individuals who are free of the outcome of interest, but who are at risk of developing that outcome. For example, in a hypothetical trial of a new drug to prevent diabetic nephropathy (the outcome of interest), researchers would start with a population of individuals with diabetes (and thus are at risk of developing the outcome of interest) who had not yet developed diabetic nephropathy. Figure 1 shows a basic schema for the design of a RCT. Eligible individuals are randomized to an intervention or a control group. After they are allocated to receive the intervention or control, participants are followed-up through time and the occurrence of the outcome in each of the groups is compared. The purpose of the RCT is to see if the incidence of the outcome differs between those randomized to the intervention and those randomized to the control group. RCTs also allow researchers to document adverse events associated with the intervention.

2 Figure 1

3 Key features of a randomised controlled trial Randomisation means that each participant is randomly allocated to one of the two groups and has an equal chance of being allocated to either of the groups. The purpose of randomizing participants is to ensure that two groups being compared are equivalent with respect to baseline characteristics, including known risk factors for the disease as well as unknown risk factors and those not measured in the study. Randomization prevents selection bias (that is, it prevents participants, clinicians or researchers from using their subjective judgment to decide into which group to place participants). It also assists with the control of confounding by ensuring that (within the limits of chance) the two groups are comparable at

4 the beginning of the study. Thus, assuming the randomization works, any differences in disease outcomes at the end of the study can be attributed to the intervention being tested. The best practical method for randomisation is by a computer-generated random allocation sequence. Methods for ensuring that the random allocation sequence is concealed from researchers, clinicians and participants until treatment has been assigned ( allocation concealment ), such as using opaque envelopes, are important. If the random allocation sequence is known before treatment assignment then, for example, clinicians could manipulate the order of participant enrollment to place their patients into the groups of their preference. This would be a form of selection bias, and would defeat the purpose of randomization. In addition, participants and researchers should be blinded during a randomised controlled trial. Blinding means that the participants and study staff do not know to which trial group an individual has been assigned. Blinding reduces the likelihood of bias due to differences in perceived response to treatment (sometimes called performance or reporting bias) on the part of participants. It also prevents bias in healthcare provider behaviour and provider/researcher outcome assessment (sometimes called assessment, diagnostic or detection bias). Blinding can also prevent data analysts from knowing trial group assignments until the last possible moment. In single-blind trials only the participant is blinded; in double-blind trials both the participant and the clinicians/researchers are blinded; and in triple-blind trials, the participants, clinicians, researchers and data analysts (and/or other groups) may be blinded. Blinding is not possible in all RCTs, depending on what the intervention and control conditions are. Blinding is most important when subjective outcomes such as reported adherence, quality of life and quality of care are being measured. In therapeutic research, blinding often involves using a placebo drug in the control arm that appears identical to the active drug being tested in the intervention arm. Placebos are an important tool to facilitate the blinding of study participants. Analysis of a randomised controlled trial The analysis of a randomized controlled trial can be quite simple. If randomization succeeded, the possibility of confounding (and in turn, the need for statistical adjustment) should be minimized. As a result, the primary analysis of most RCTs is a simple comparison of the occurrence (incidence, measured as either a risk or a rate) of the outcome of interest between the intervention and control groups. This comparison is most often expressed as a risk ratio or a rate ratio (sometimes also known as a relative risk : the rate of the outcome in the intervention group divided by the rate of the outcome in the control group). Sometimes, this comparison is expressed as a risk difference or a rate difference: the rate of the outcome in the intervention group subtracted from the rate of the outcome in the control group). Another measure often calculated from an RCT is the number needed to treat (NNT). NNT represents the number of people who need to receive the intervention in order to prevent one case of the outcome or disease in the intervention group. NNT is important when making decisions about whether or not to implement an intervention that has been shown to be effective in an RCT on a wider scale. One important principle in the analysis of randomized controlled trials is that the analysis should include all individuals as they were randomized (to intervention or control groups). This is called the intention to treat principle ~ that individuals should be analysed as they

5 were randomized, regardless of whether or not they actually adhered to the intervention (or control) during the trial. While not all analyses in an RCT need to adhere to the intention to treat principal, the principal analysis should do so, as it is an important measure to prevent biased study results. Example of a hypothetical randomised controlled trial A hypothetical RCT was conducted in Cape Town, South Africa, to compare a successful a new drug (drug A) to the existing standard medication (drug B) in the prevention of repeated myocardial infarcations (MI) among individuals with unstable angina. (Table 1). Patients with unstable angina were randomly allocated to either drug A (n=105) or drug B (n=111) and followed for two years to measure the proportion of patients who experienced an MI in the two groups. Sixty percent of those receiving drug A and and 54% of those receiving drug B patients experienced an MI. Table 1. Randomized trial calculations Participants followed through time to see if outcome develops Developed MI Participants Randomized to Did not develop MI Totals either intervention or Drug A / 105 control Drug B / 111 Incidence of the outcome calculated in each group and compared In this example, patients who received drug A were 1.1 times more likely to develop an MI within two years compared to patients who received drug B. In other words, for practical purposes, drug A and drug B were equivalent in the prevention of MI among patients with unstable angina.

6 Strengths of randomised controlled trials Of all study designs, RCTs can provide the strongest information about the effectiveness of medical interventions. An RCT has the potential to prevent confounding and selection biases that are common to observational studies. An RCT can thus isolate the effect of a single intervention on a particular disease outcome. Because the intervention is controlled by the researcher, and the study started with participants who did not have the outcome of interest, the researcher can be assured that the intervention preceded the outcome. This is important for establishing a causal relationship between the exposure and the outcome with confidence. Blinding can be used to reduce reporting and assessment/detection biases associated with participant and researcher knowledge of the study group to which a participant has been allocated. This includes the use of placebos, where possible. Limitations of randomised controlled trials For ethical reasons, RCTs cannot be used to test hypotheses about whether certain factors cause disease or about the effect of harmful exposures (although they can test the effect of removing potentially harmful exposures, for example, interventions to promote smoking cessation). Even for beneficial interventions, RCTs raise many ethical problems, which have to be dealt with before, during and after the trial. RCTs are vulnerable to biases from loss to follow-up, particularly if the period of follow-up is long. As a result, efforts must be made to minimize the chance of loss of participants through time. RCTs tend to be complex, time-consuming and expensive. Conclusion: Understanding the design of clinical trials is crucial. All investigators and site co-ordinators are charged with the responsibility of explaining these very complicated scientific terms to study participants in lay language. It is therefore important that all members of the research team are familiar with clinical trial design, randomisation, blinding and placebos, at minimum.

Randomized Controlled Trial

Randomized Controlled Trial Randomized Controlled Trial Training Course in Sexual and Reproductive Health Research Geneva 2016 Dr Khalifa Elmusharaf MBBS, PgDip, FRSPH, PHD Senior Lecturer in Public Health Graduate Entry Medical

More information

Critical Appraisal Series

Critical Appraisal Series Definition for therapeutic study Terms Definitions Study design section Observational descriptive studies Observational analytical studies Experimental studies Pragmatic trial Cluster trial Researcher

More information

The role of Randomized Controlled Trials

The role of Randomized Controlled Trials The role of Randomized Controlled Trials Dr. Georgia Salanti Lecturer in Epidemiology University of Ioannina School of Medicine Outline Understanding study designs and the role of confounding Observational

More information

In this second module in the clinical trials series, we will focus on design considerations for Phase III clinical trials. Phase III clinical trials

In this second module in the clinical trials series, we will focus on design considerations for Phase III clinical trials. Phase III clinical trials In this second module in the clinical trials series, we will focus on design considerations for Phase III clinical trials. Phase III clinical trials are comparative, large scale studies that typically

More information

GATE CAT Intervention RCT/Cohort Studies

GATE CAT Intervention RCT/Cohort Studies GATE: a Graphic Approach To Evidence based practice updates from previous version in red Critically Appraised Topic (CAT): Applying the 5 steps of Evidence Based Practice Using evidence about interventions

More information

EBM: Therapy. Thunyarat Anothaisintawee, M.D., Ph.D. Department of Family Medicine, Ramathibodi Hospital, Mahidol University

EBM: Therapy. Thunyarat Anothaisintawee, M.D., Ph.D. Department of Family Medicine, Ramathibodi Hospital, Mahidol University EBM: Therapy Thunyarat Anothaisintawee, M.D., Ph.D. Department of Family Medicine, Ramathibodi Hospital, Mahidol University How to appraise therapy literature Are the result valid? What are the result?

More information

Critical Appraisal of RCT

Critical Appraisal of RCT Critical Appraisal of RCT What is critical appraisal? Definition Process of systematically examining research evidence to assess its reliability (validity/internal validity), results and relevance (external

More information

GLOSSARY OF GENERAL TERMS

GLOSSARY OF GENERAL TERMS GLOSSARY OF GENERAL TERMS Absolute risk reduction Absolute risk reduction (ARR) is the difference between the event rate in the control group (CER) and the event rate in the treated group (EER). ARR =

More information

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2014

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2014 GRADE Grading of Recommendations Assessment, Development and Evaluation British Association of Dermatologists April 2014 Previous grading system Level of evidence Strength of recommendation Level of evidence

More information

Version No. 7 Date: July Please send comments or suggestions on this glossary to

Version No. 7 Date: July Please send comments or suggestions on this glossary to Impact Evaluation Glossary Version No. 7 Date: July 2012 Please send comments or suggestions on this glossary to 3ie@3ieimpact.org. Recommended citation: 3ie (2012) 3ie impact evaluation glossary. International

More information

How to Interpret a Clinical Trial Result

How to Interpret a Clinical Trial Result How to Interpret a Clinical Trial Result Edward V. Loftus, Jr., M.D. Professor of Medicine Division of Gastroenterology and Hepatology Mayo Clinic College of Medicine Rochester MN CP123456-1 Are results

More information

Clinical Trials. Susan G. Fisher, Ph.D. Dept. of Clinical Sciences

Clinical Trials. Susan G. Fisher, Ph.D. Dept. of Clinical Sciences Clinical Trials Susan G. Fisher, Ph.D. Dept. of Clinical Sciences When to Do a RCT Exposure of interest is modifiable and individuals are willing to relinquish control Legitimate uncertainty exists about

More information

Evidence Based Practice

Evidence Based Practice Evidence Based Practice RCS 6740 7/26/04 Evidence Based Practice: Definitions Evidence based practice is the integration of the best available external clinical evidence from systematic research with individual

More information

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2018

GRADE. Grading of Recommendations Assessment, Development and Evaluation. British Association of Dermatologists April 2018 GRADE Grading of Recommendations Assessment, Development and Evaluation British Association of Dermatologists April 2018 Previous grading system Level of evidence Strength of recommendation Level of evidence

More information

Overview of Study Designs in Clinical Research

Overview of Study Designs in Clinical Research Overview of Study Designs in Clinical Research Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines + Evidence Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort

More information

Design strategies in quantitative research an introduction

Design strategies in quantitative research an introduction Design strategies in quantitative research an introduction Key messages Research design can be broadly divided in to descriptive and analytical. Descriptive studies look at the individual, location and

More information

RANDOMIZED CLINICAL TRIALS. Study Designs. Randomized Clinical Trials (RCT) ASSIGN EXPOSURE Follow up Check for OUTCOME. Experimental studies

RANDOMIZED CLINICAL TRIALS. Study Designs. Randomized Clinical Trials (RCT) ASSIGN EXPOSURE Follow up Check for OUTCOME. Experimental studies RANDOMIZED CLINICAL TRIALS Study Designs Observational studies Analytic studies Descriptive studies Randomized Controlled trials Case control Cohort Cross sectional Randomized Clinical Trials (RCT) Assign

More information

Critical Appraisal of Evidence A Focus on Intervention/Treatment Studies

Critical Appraisal of Evidence A Focus on Intervention/Treatment Studies Critical Appraisal of Evidence A Focus on Intervention/Treatment Studies Bernadette Mazurek Melnyk, PhD, CPNP/PMHNP, FAANP, FAAN Associate Vice President for Health Promotion University Chief Wellness

More information

CLINICAL DECISION USING AN ARTICLE ABOUT TREATMENT JOSEFINA S. ISIDRO LAPENA MD, MFM, FPAFP PROFESSOR, UPCM

CLINICAL DECISION USING AN ARTICLE ABOUT TREATMENT JOSEFINA S. ISIDRO LAPENA MD, MFM, FPAFP PROFESSOR, UPCM CLINICAL DECISION USING AN ARTICLE ABOUT TREATMENT JOSEFINA S. ISIDRO LAPENA MD, MFM, FPAFP PROFESSOR, UPCM Principles of Decision Making Knowing the patient s true state is often unnecessary Does my patient

More information

Experimental Design. Terminology. Chusak Okascharoen, MD, PhD September 19 th, Experimental study Clinical trial Randomized controlled trial

Experimental Design. Terminology. Chusak Okascharoen, MD, PhD September 19 th, Experimental study Clinical trial Randomized controlled trial Experimental Design Chusak Okascharoen, MD, PhD September 19 th, 2016 Terminology Experimental study Clinical trial Randomized controlled trial 1 PHASES OF CLINICAL TRIALS Phase I: First-time-in-man studies

More information

GATE: Graphic Appraisal Tool for Epidemiology picture, 2 formulas & 3 acronyms

GATE: Graphic Appraisal Tool for Epidemiology picture, 2 formulas & 3 acronyms GATE: Graphic Appraisal Tool for Epidemiology 1991-2015 1 picture, 2 formulas & 3 acronyms 1 GATE: Graphic Appraisal Tool for Epidemiology Graphic Architectural Tool for Epidemiology Graphic Approach To

More information

The comparison or control group may be allocated a placebo intervention, an alternative real intervention or no intervention at all.

The comparison or control group may be allocated a placebo intervention, an alternative real intervention or no intervention at all. 1. RANDOMISED CONTROLLED TRIALS (Treatment studies) (Relevant JAMA User s Guides, Numbers IIA & B: references (3,4) Introduction: The most valid study design for assessing the effectiveness (both the benefits

More information

115 remained abstinent. 140 remained abstinent. Relapsed Remained abstinent Total

115 remained abstinent. 140 remained abstinent. Relapsed Remained abstinent Total Chapter 10 Exercises 1. Intent-to-treat analysis: Example 1 In a randomized controlled trial to determine whether the nicotine patch reduces the risk of relapse among smokers who have committed to quit,

More information

Choosing the right study design

Choosing the right study design Choosing the right study design Main types of study design Randomised controlled trial (RCT) Cohort study Case-control study Cross-sectional study Case series/case note review Expert opinion BEST QUALITY

More information

ACR OA Guideline Development Process Knee and Hip

ACR OA Guideline Development Process Knee and Hip ACR OA Guideline Development Process Knee and Hip 1. Literature searching frame work Literature searches were developed based on the scenarios. A comprehensive search strategy was used to guide the process

More information

4/10/2018. Choosing a study design to answer a specific research question. Importance of study design. Types of study design. Types of study design

4/10/2018. Choosing a study design to answer a specific research question. Importance of study design. Types of study design. Types of study design Choosing a study design to answer a specific research question Importance of study design Will determine how you collect, analyse and interpret your data Helps you decide what resources you need Impact

More information

Clinical problems and choice of study designs

Clinical problems and choice of study designs Evidence Based Dentistry Clinical problems and choice of study designs Asbjørn Jokstad University of Oslo, Norway Nov 21 2001 1 Manipulation with intervention Yes Experimental study No Non-experimental

More information

Checklist for Randomized Controlled Trials. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews

Checklist for Randomized Controlled Trials. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Randomized Controlled Trials http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org

More information

Evidence Based Medicine

Evidence Based Medicine Course Goals Goals 1. Understand basic concepts of evidence based medicine (EBM) and how EBM facilitates optimal patient care. 2. Develop a basic understanding of how clinical research studies are designed

More information

Review. Chapter 5. Common Language. Ch 3: samples. Ch 4: real world sample surveys. Experiments, Good and Bad

Review. Chapter 5. Common Language. Ch 3: samples. Ch 4: real world sample surveys. Experiments, Good and Bad Review Ch 3: samples Sampling terminology Proportions Margin of error Ch 4: real world sample surveys Questions to ask about a study Errors in sample surveys Concerns about survey questions Probability

More information

Study Designs. Randomized Clinical Trials (RCT) RCT: Example 1. RCT: Two by Two Table. Outcome. Exposure. Yes a b No c d

Study Designs. Randomized Clinical Trials (RCT) RCT: Example 1. RCT: Two by Two Table. Outcome. Exposure. Yes a b No c d Study Designs Randomized Clinical Trials (RCT) Assign Exposure Randomly Experimental studies Analytic studies Observational studies Descriptive studies POPULATION Population People without the outcome

More information

CLINICAL PROTOCOL DEVELOPMENT

CLINICAL PROTOCOL DEVELOPMENT CLINICAL PROTOCOL DEVELOPMENT Clinical Protocol (1) Background/Justification --Where we are in the field --What the study will add that is important Objectives --Primary hypothesis --Secondary hypotheses

More information

Checklist for Randomized Controlled Trials. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews

Checklist for Randomized Controlled Trials. The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews The Joanna Briggs Institute Critical Appraisal tools for use in JBI Systematic Reviews Checklist for Randomized Controlled Trials http://joannabriggs.org/research/critical-appraisal-tools.html www.joannabriggs.org

More information

Critical Appraisal of Evidence

Critical Appraisal of Evidence Critical Appraisal of Evidence A Focus on Intervention/Treatment Studies Bernadette Mazurek Melnyk, PhD, CPNP/PMHNP, FNAP, FAAN Associate Vice President for Health Promotion University Chief Wellness Officer

More information

MAT Mathematics in Today's World

MAT Mathematics in Today's World MAT 1000 Mathematics in Today's World Last Time 1. What does a sample tell us about the population? 2. Practical problems in sample surveys. Last Time Parameter: Number that describes a population Statistic:

More information

Appraising the Literature Overview of Study Designs

Appraising the Literature Overview of Study Designs Chapter 5 Appraising the Literature Overview of Study Designs Barbara M. Sullivan, PhD Department of Research, NUHS Jerrilyn A. Cambron, PhD, DC Department of Researach, NUHS EBP@NUHS Ch 5 - Overview of

More information

Teaching critical appraisal of randomised controlled trials

Teaching critical appraisal of randomised controlled trials Teaching critical appraisal of randomised controlled trials Dr Kamal R. Mahtani BSc PhD MBBS PGDip MRCGP Deputy Director Centre for Evidence Based Medicine University of Oxford November 2014 1 objectives

More information

Quantitative research Quiz Answers

Quantitative research Quiz Answers Quantitative research Quiz Answers 1. What is a clinical trial? A. A clinical trial is an experiment where patients volunteer to test new ways of screening for, preventing, diagnosing or treating a disease.

More information

Evidence Informed Practice Online Learning Module Glossary

Evidence Informed Practice Online Learning Module Glossary Term Abstract Associations Attrition Bias Background and Significance Baseline Basic Science Bias Blinding Definition An abstract is a summary of a research article. It usually includes the purpose, methods,

More information

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Scientific Study of Causation and Treatment Methods for studying causation Case

More information

Controlled Trials. Spyros Kitsiou, PhD

Controlled Trials. Spyros Kitsiou, PhD Assessing Risk of Bias in Randomized Controlled Trials Spyros Kitsiou, PhD Assistant Professor Department of Biomedical and Health Information Sciences College of Applied Health Sciences University of

More information

Varenicline and cardiovascular and neuropsychiatric events: Do Benefits outweigh risks?

Varenicline and cardiovascular and neuropsychiatric events: Do Benefits outweigh risks? Varenicline and cardiovascular and neuropsychiatric events: Do Benefits outweigh risks? Sonal Singh M.D., M.P.H, Johns Hopkins University Presented by: Sonal Singh, MD MPH September 19, 2012 1 CONFLICTS

More information

Study Designs in Epidemiology

Study Designs in Epidemiology Study Designs in Epidemiology Dr. Sireen Alkhaldi, BDS, MPH, DrPH First semester 2017/ 2018 Department of Family and Community Medicine School of Medicine/ The University of Jordan Epidemiologic Study

More information

The RoB 2.0 tool (individually randomized, cross-over trials)

The RoB 2.0 tool (individually randomized, cross-over trials) The RoB 2.0 tool (individually randomized, cross-over trials) Study design Randomized parallel group trial Cluster-randomized trial Randomized cross-over or other matched design Specify which outcome is

More information

Epidemiological study design. Paul Pharoah Department of Public Health and Primary Care

Epidemiological study design. Paul Pharoah Department of Public Health and Primary Care Epidemiological study design Paul Pharoah Department of Public Health and Primary Care Molecules What/why? Organelles Cells Tissues Organs Clinical medicine Individuals Public health medicine Populations

More information

Systematic Reviews and Meta- Analysis in Kidney Transplantation

Systematic Reviews and Meta- Analysis in Kidney Transplantation Systematic Reviews and Meta- Analysis in Kidney Transplantation Greg Knoll MD MSc Associate Professor of Medicine Medical Director, Kidney Transplantation University of Ottawa and The Ottawa Hospital KRESCENT

More information

Special Features of Randomized Controlled Trials

Special Features of Randomized Controlled Trials Special Features of Randomized Controlled Trials Bangkok 2006 Kenneth F. Schulz, PhD, MBA Critical Methodological Elements in RCTs Randomization Avoiding and handling exclusions after trial entry Blinding

More information

Delfini Evidence Tool Kit

Delfini Evidence Tool Kit General 1. Who is sponsoring and funding the study? What are the affiliations of the authors? Study Design Assessment Internal Validity Assessment Considerations: This can be helpful information and is

More information

CONCEPTUALIZING A RESEARCH DESIGN

CONCEPTUALIZING A RESEARCH DESIGN CONCEPTUALIZING A RESEARCH DESIGN Detty Nurdiati Dept of Obstetrics & Gynecology Fac of Medicine, Universitas Gadjah Mada Yogyakarta, Indonesia Conceptualizing a Research Design The Research Design The

More information

Department of OUTCOMES RESEARCH

Department of OUTCOMES RESEARCH Department of OUTCOMES RESEARCH Clinical Research Design Sources of Error Types of Clinical Research Randomized Trials! Daniel I. Sessler, M.D. Professor and Chair Department of OUTCOMES RESEARCH The Cleveland

More information

exposure/intervention

exposure/intervention Kathleen A. Kennedy, MD, MPH University of Texas Medical School at Houston Medical School Most clinical research evaluates an association between exposure/intervention outcome. 1 Does the investigator

More information

Study selection Study designs of evaluations included in the review Diagnosis.

Study selection Study designs of evaluations included in the review Diagnosis. Diagnosis and treatment of worker-related musculoskeletal disorders of the upper extremity: epicondylitis Chapell R, Bruening W, Mitchell M D, Reston J T, Treadwell J R Authors' objectives The objectives

More information

Systematic review with multiple treatment comparison metaanalysis. on interventions for hepatic encephalopathy

Systematic review with multiple treatment comparison metaanalysis. on interventions for hepatic encephalopathy Systematic review with multiple treatment comparison metaanalysis on interventions for hepatic encephalopathy Hepatic encephalopathy (HE) is a reversible neuropsychiatric syndrome associated with severe

More information

Evidence- and Value-based Solutions for Health Care Clinical Improvement Consults, Content Development, Training & Seminars, Tools

Evidence- and Value-based Solutions for Health Care Clinical Improvement Consults, Content Development, Training & Seminars, Tools Definition Key Points Key Problems Bias Choice Lack of Control Chance Observational Study Defined Epidemiological study in which observations are made, but investigators do not control the exposure or

More information

Design of Experiments & Introduction to Research

Design of Experiments & Introduction to Research Design of Experiments & Introduction to Research 1 Design of Experiments Introduction to Research Definition and Purpose Scientific Method Research Project Paradigm Structure of a Research Project Types

More information

CRITICAL APPRAISAL OF MEDICAL LITERATURE. Samuel Iff ISPM Bern

CRITICAL APPRAISAL OF MEDICAL LITERATURE. Samuel Iff ISPM Bern CRITICAL APPRAISAL OF MEDICAL LITERATURE Samuel Iff ISPM Bern siff@ispm.unibe.ch Contents Study designs Asking good questions Pitfalls in clinical studies How to assess validity (RCT) Conclusion Step-by-step

More information

Issues to Consider in the Design of Randomized Controlled Trials

Issues to Consider in the Design of Randomized Controlled Trials Issues to Consider in the Design of Randomized Controlled Trials Jay Wilkinson, MD, MPH Professor of Pediatrics & Epidemiology Miller School of Medicine Seminar Purpose To facilitate an interactive discussion

More information

The Research Enterprise in Psychology Chapter 2

The Research Enterprise in Psychology Chapter 2 The Research Enterprise in Psychology Chapter 2 This multimedia product and its contents are protected under copyright law. The following are prohibited by law: any public performance or display, including

More information

UNDERSTANDING EPIDEMIOLOGICAL STUDIES. Csaba P Kovesdy, MD FASN Salem VA Medical Center, Salem VA University of Virginia, Charlottesville VA

UNDERSTANDING EPIDEMIOLOGICAL STUDIES. Csaba P Kovesdy, MD FASN Salem VA Medical Center, Salem VA University of Virginia, Charlottesville VA UNDERSTANDING EPIDEMIOLOGICAL STUDIES Csaba P Kovesdy, MD FASN Salem VA Medical Center, Salem VA University of Virginia, Charlottesville VA Study design in epidemiological research: Summary Observational

More information

Thursday, April 25, 13. Intervention Studies

Thursday, April 25, 13. Intervention Studies Intervention Studies Outline Introduction Advantages and disadvantages Avoidance of bias Parallel group studies Cross-over studies 2 Introduction Intervention study, or clinical trial, is an experiment

More information

GATE: Graphic Appraisal Tool for Epidemiology picture, 2 formulas & 3 acronyms

GATE: Graphic Appraisal Tool for Epidemiology picture, 2 formulas & 3 acronyms 1 GATE: Graphic Appraisal Tool for Epidemiology 1991-2016 1 picture, 2 formulas & 3 acronyms 2 GATE: Graphic Appraisal Tool for Epidemiology Graphic Architectural Tool for Epidemiology Graphic Approach

More information

Study design. Chapter 64. Research Methodology S.B. MARTINS, A. ZIN, W. ZIN

Study design. Chapter 64. Research Methodology S.B. MARTINS, A. ZIN, W. ZIN Chapter 64 Study design S.B. MARTINS, A. ZIN, W. ZIN Research Methodology Scientific methodology comprises a set of rules and procedures to investigate the phenomena of interest. These rules and procedures

More information

Gathering. Useful Data. Chapter 3. Copyright 2004 Brooks/Cole, a division of Thomson Learning, Inc.

Gathering. Useful Data. Chapter 3. Copyright 2004 Brooks/Cole, a division of Thomson Learning, Inc. Gathering Chapter 3 Useful Data Copyright 2004 Brooks/Cole, a division of Thomson Learning, Inc. Principal Idea: The knowledge of how the data were generated is one of the key ingredients for translating

More information

RATING OF A RESEARCH PAPER. By: Neti Juniarti, S.Kp., M.Kes., MNurs

RATING OF A RESEARCH PAPER. By: Neti Juniarti, S.Kp., M.Kes., MNurs RATING OF A RESEARCH PAPER RANDOMISED CONTROLLED TRIAL TO COMPARE SURGICAL STABILISATION OF THE LUMBAR SPINE WITH AN INTENSIVE REHABILITATION PROGRAMME FOR PATIENTS WITH CHRONIC LOW BACK PAIN: THE MRC

More information

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai Systematic reviews: From evidence to recommendation Session 2 - June 18, 2014 Going beyond design, going beyond intervention: The American Academy of Neurology (AAN) Clinical Practice Guideline process

More information

Systematic Reviews. Simon Gates 8 March 2007

Systematic Reviews. Simon Gates 8 March 2007 Systematic Reviews Simon Gates 8 March 2007 Contents Reviewing of research Why we need reviews Traditional narrative reviews Systematic reviews Components of systematic reviews Conclusions Key reference

More information

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Key Dates TU Mar 28 Unit 18 Loss of control drinking in alcoholics (on course website); Marlatt assignment TH Mar 30 Unit 19; Term Paper Step 2 TU Apr 4 Begin Biological Perspectives, Unit IIIA and 20;

More information

Thursday, April 25, 13. Intervention Studies

Thursday, April 25, 13. Intervention Studies Intervention Studies Outline Introduction Advantages and disadvantages Avoidance of bias Parallel group studies Cross-over studies 2 Introduction Intervention study, or clinical trial, is an experiment

More information

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews J Nurs Sci Vol.28 No.4 Oct - Dec 2010 Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews Jeanne Grace Corresponding author: J Grace E-mail: Jeanne_Grace@urmc.rochester.edu

More information

CONSORT 2010 checklist of information to include when reporting a randomised trial*

CONSORT 2010 checklist of information to include when reporting a randomised trial* CONSORT 2010 checklist of information to include when reporting a randomised trial* Section/Topic Title and abstract Introduction Background and objectives Item No Checklist item 1a Identification as a

More information

Beyond the intention-to treat effect: Per-protocol effects in randomized trials

Beyond the intention-to treat effect: Per-protocol effects in randomized trials Beyond the intention-to treat effect: Per-protocol effects in randomized trials Miguel Hernán DEPARTMENTS OF EPIDEMIOLOGY AND BIOSTATISTICS Intention-to-treat analysis (estimator) estimates intention-to-treat

More information

Surveillance report Published: 8 June 2017 nice.org.uk. NICE All rights reserved.

Surveillance report Published: 8 June 2017 nice.org.uk. NICE All rights reserved. Surveillance report 2017 Antenatal and postnatal mental health: clinical management and service guidance (2014) NICE guideline CG192 Surveillance report Published: 8 June 2017 nice.org.uk NICE 2017. All

More information

Welcome Module Index Glossary Epiville Chamber of Commerce About this site Requirements. Faculty Highlight: Dr. Alan Berkman ( )

Welcome Module Index Glossary Epiville Chamber of Commerce About this site Requirements. Faculty Highlight: Dr. Alan Berkman ( ) Epiville: -- http://epiville.ccnmtl.columbiedu/randomized_trials/ The randomized trial is often described as the "gold standard" of epidemiological research. In contrast to observational study designs

More information

Types of Biomedical Research

Types of Biomedical Research INTRODUCTION & MEASUREMENT IN CLINICAL RESEARCH Sakda Arj Ong Vallipakorn, MD MSIT, MA (Information Science) Pediatrics, Pediatric Cardiology Emergency Medicine, Ped Emergency Family Medicine Section of

More information

Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist.

Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. Systematic reviews and meta-analyses of observational studies (MOOSE): Checklist. MOOSE Checklist Infliximab reduces hospitalizations and surgery interventions in patients with inflammatory bowel disease:

More information

EDDA Study Designs Taxonomy (version 2.0)

EDDA Study Designs Taxonomy (version 2.0) 1 EDDA Study Designs Taxonomy (version 2.0) The EDDA Study Designs Taxonomy (v2.0) was developed by the Evidence in Documents, Discovery, and Analytics (EDDA) Group: Tanja Bekhuis (Principal Scientist);

More information

CHL 5225 H Advanced Statistical Methods for Clinical Trials. CHL 5225 H The Language of Clinical Trials

CHL 5225 H Advanced Statistical Methods for Clinical Trials. CHL 5225 H The Language of Clinical Trials CHL 5225 H Advanced Statistical Methods for Clinical Trials Two sources for course material 1. Electronic blackboard required readings 2. www.andywillan.com/chl5225h code of conduct course outline schedule

More information

Chapter 11: Experiments and Observational Studies p 318

Chapter 11: Experiments and Observational Studies p 318 Chapter 11: Experiments and Observational Studies p 318 Observation vs Experiment An observational study observes individuals and measures variables of interest but does not attempt to influence the response.

More information

12/26/2013. Types of Biomedical Research. Clinical Research. 7Steps to do research INTRODUCTION & MEASUREMENT IN CLINICAL RESEARCH S T A T I S T I C

12/26/2013. Types of Biomedical Research. Clinical Research. 7Steps to do research INTRODUCTION & MEASUREMENT IN CLINICAL RESEARCH S T A T I S T I C Types of Biomedical Research INTRODUCTION & MEASUREMENT IN CLINICAL RESEARCH Sakda Arj Ong Vallipakorn, MD MSIT, MA (Information Science) Pediatrics, Pediatric Cardiology Emergency Medicine, Ped Emergency

More information

Role of evidence from observational studies in the process of health care decision making

Role of evidence from observational studies in the process of health care decision making Role of evidence from observational studies in the process of health care decision making Jan van der Meulen Health Services Research Unit London School of Hygiene and Tropical Medicine Clinical Effectiveness

More information

Replicating Randomised Trials of Treatments in Observational Settings Using Propensity Scores Fisher s Aphorisms

Replicating Randomised Trials of Treatments in Observational Settings Using Propensity Scores Fisher s Aphorisms Replicating Randomised Trials of Treatments in Observational Settings Using Propensity Scores Fisher s Aphorisms Nick Freemantle PhD Professor of Clinical Epidemiology & Biostatistics Assessing Causation

More information

Overview of Study Designs

Overview of Study Designs Overview of Study Designs Kyoungmi Kim, Ph.D. July 13 & 20, 2016 This seminar is jointly supported by the following NIH-funded centers: We are video recording this seminar so please hold questions until

More information

Can we teach how to discriminate between good & bad evidence? the GATE approach

Can we teach how to discriminate between good & bad evidence? the GATE approach Can we teach how to discriminate between good & bad evidence? in 20 minutes! the GATE approach Rod Jackson June 2010 GATE: a Graphic Appraisal Tool for Epidemiology A picture, 2 acronyms & 2 formulas A

More information

CHECK-LISTS AND Tools DR F. R E Z A E I DR E. G H A D E R I K U R D I S TA N U N I V E R S I T Y O F M E D I C A L S C I E N C E S

CHECK-LISTS AND Tools DR F. R E Z A E I DR E. G H A D E R I K U R D I S TA N U N I V E R S I T Y O F M E D I C A L S C I E N C E S CHECK-LISTS AND Tools DR F. R E Z A E I DR E. G H A D E R I K U R D I S TA N U N I V E R S I T Y O F M E D I C A L S C I E N C E S What is critical appraisal? Critical appraisal is the assessment of evidence

More information

Empirical evidence on sources of bias in randomised controlled trials: methods of and results from the BRANDO study

Empirical evidence on sources of bias in randomised controlled trials: methods of and results from the BRANDO study Empirical evidence on sources of bias in randomised controlled trials: methods of and results from the BRANDO study Jonathan Sterne, University of Bristol, UK Acknowledgements: Tony Ades, Bodil Als-Nielsen,

More information

ARCHE Risk of Bias (ROB) Guidelines

ARCHE Risk of Bias (ROB) Guidelines Types of Biases and ROB Domains ARCHE Risk of Bias (ROB) Guidelines Bias Selection Bias Performance Bias Detection Bias Attrition Bias Reporting Bias Other Bias ROB Domain Sequence generation Allocation

More information

How to carry out health technology appraisals and guidance. Learning from the Scottish experience Richard Clark, Principal Pharmaceutical

How to carry out health technology appraisals and guidance. Learning from the Scottish experience Richard Clark, Principal Pharmaceutical The Managed Introduction of New Medicines How to carry out health technology appraisals and guidance. Learning from the Scottish experience Richard Clark, Principal Pharmaceutical Analyst July 10 th 2009,

More information

Evidence-based practice tutorial Critical Appraisal Skills

Evidence-based practice tutorial Critical Appraisal Skills Evidence-based practice tutorial Critical Appraisal Skills Earlier evidence based practice tutorials have focussed on skills to search various useful sites on the internet for evidence. Anyone who has

More information

Methodological aspects of non-inferiority and equivalence trials

Methodological aspects of non-inferiority and equivalence trials Methodological aspects of non-inferiority and equivalence trials Department of Clinical Epidemiology Leiden University Medical Center Capita Selecta 09-12-2014 1 Why RCTs Early 1900: Evidence based on

More information

Research Methodology Workshop. Study Type

Research Methodology Workshop. Study Type Research Methodology Workshop Study Type What type of question? Frequency: how common is it? Aetiology: What caused this? Intervention: Does this intervention work? Diagnosis or test evaluation: How accurate

More information

Are the likely benefits worth the potential harms and costs? From McMaster EBCP Workshop/Duke University Medical Center

Are the likely benefits worth the potential harms and costs? From McMaster EBCP Workshop/Duke University Medical Center CRITICAL REVIEW FORM FOR THERAPY STUDY Did experimental and control groups begin the study with a similar prognosis? Were patients randomized? Was randomization concealed? Were patients analyzed in the

More information

Determinants of quality: Factors that lower or increase the quality of evidence

Determinants of quality: Factors that lower or increase the quality of evidence Determinants of quality: Factors that lower or increase the quality of evidence GRADE Workshop CBO, NHG and Dutch Cochrane Centre CBO, April 17th, 2013 Outline The GRADE approach: step by step Factors

More information

10/21/2014. Considerations in the Selection of Research Participants. Reasons to think about participant selection

10/21/2014. Considerations in the Selection of Research Participants. Reasons to think about participant selection Considerations in the Selection of Research Participants Catherine M. Stoney, Ph.D. National Heart, Lung, and Blood Institute Introduction to the Principles & Practice of Clinical Research October 21,

More information

Evaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank)

Evaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank) Evaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank) Attribution The extent to which the observed change in outcome is the result of the intervention, having allowed

More information

The Cochrane Collaboration

The Cochrane Collaboration The Cochrane Collaboration Version and date: V1, 29 October 2012 Guideline notes for consumer referees You have been invited to provide consumer comments on a Cochrane Review or Cochrane Protocol. This

More information

Assessing risk of bias

Assessing risk of bias Assessing risk of bias Norwegian Research School for Global Health Atle Fretheim Research Director, Norwegian Institute of Public Health Professor II, Uiniversity of Oslo Goal for the day We all have an

More information

Mapping the Informed Health Choices (IHC) Key Concepts (KC) to core concepts for the main steps of Evidence-Based Health Care (EBHC).

Mapping the Informed Health Choices (IHC) Key Concepts (KC) to core concepts for the main steps of Evidence-Based Health Care (EBHC). KC No KC Short Title KC Statement EBHC concept EBHC sub concept EBHC statement EBHC Step Reported 1.01 Treatments can harm Treatments may be harmful Explain the use of harm/aetiologies for (rare) adverse

More information

Appendix 2 Quality assessment tools. Cochrane risk of bias tool for RCTs. Support for judgment

Appendix 2 Quality assessment tools. Cochrane risk of bias tool for RCTs. Support for judgment Appendix 2 Quality assessment tools Cochrane risk of bias tool for RCTs Item Judgment (H/L/Unclear) Random sequence generation (selection bias) Allocation concealment (selection bias) Blinding of participants

More information

Aspirin for the Prevention of Cardiovascular Disease

Aspirin for the Prevention of Cardiovascular Disease Detail-Document #250601 This Detail-Document accompanies the related article published in PHARMACIST S LETTER / PRESCRIBER S LETTER June 2009 ~ Volume 25 ~ Number 250601 Aspirin for the Prevention of Cardiovascular

More information