Brief introduction to instrumental variables. IV Workshop, Bristol, Miguel A. Hernán Department of Epidemiology Harvard School of Public Health

Size: px
Start display at page:

Download "Brief introduction to instrumental variables. IV Workshop, Bristol, Miguel A. Hernán Department of Epidemiology Harvard School of Public Health"

Transcription

1 Brief introduction to instrumental variables IV Workshop, Bristol, 2008 Miguel A. Hernán Department of Epidemiology Harvard School of Public Health

2 Goal: To consistently estimate the average causal effect of exposure A on outcome Y Effect measures Causal risk ratio: Pr[Y a=1 =1] / Pr[Y a=0 =1] Causal risk difference: Pr[Y a=1 =1] Pr[Y a=0 =1] Etc... Assume no selection bias, no measurement error 19-Jun-09 Instrumental variables 2

3 All available methods Including Stratification Regression Matching Standardization Inverse probability weighting G-estimation (more later) require one unverifiable condition 19-Jun-09 Instrumental variables 3

4 Exchangeability conditional on the measured covariates L Y a A L l for all a Equivalent expressions exposure is randomized no unmeasured confounding the risk in the exposed if unexposed is the same as the risk in the unexposed, and vice versa within levels of the covariates in L 19-Jun-09 Instrumental variables 4

5 The assumption of exchangeability is Necessary for all the methods above Empirically unverifiable in observational studies Even if there is conditional exchangeability, there is no way we can know it with certainty Data necessary to test this condition is, by definition, unavailable 19-Jun-09 Instrumental variables 5

6 Instrumental variables (IV) methods Unlike all other methods, IV methods can be used to consistently estimate causal effects in the absence of exchangeability i.e., in the presence of unmeasured confounding 19-Jun-09 Instrumental variables 6

7 Overview of this lecture 1. IV in randomized experiments Standard IV estimator 2. IV in observational studies 3. Problems of IV methods 4. Conclusion 19-Jun-09 Instrumental variables 7

8 Definition of an instrument Z (provisional) i. Z has a causal effect on the exposure A ii. Z affects the outcome Y only through A no direct effect of Z on Y iii. Z does not share common causes with the outcome Y no confounding for the effect of Z on Y Note: what follows is a conceptual discussion more rigorous discussion in Hernán and Robins Epidemiology Jun-09 Instrumental variables 8

9 Instrument Z U Z A Y Example: Randomized experiment Z: assigned treatment (dichotomous) A: actual treatment (dichotomous) Y: outcome U: unmeasured factors 19-Jun-09 Instrumental variables 9

10 Effects that can be computed (risk difference scale) U Z A Y average effect of Z on Y PrY 1 Z 1 PrY 1 Z 0 average effect of Z on A PrA 1 Z 1 PrA 1 Z 0 19-Jun-09 Instrumental variables 10

11 IV estimator for the average effect of A on Y U Z A Y effect of Z on Y effect of Z on A PrY 1 Z 1 PrY 1 Z 0 PrA 1 Z 1 PrA 1 Z 0 19-Jun-09 Instrumental variables 11

12 Standard IV estimator EY a1 EY a0 EY Z 1 EY Z 0 EA Z 1 EA Z 0 Intention-to-treat effect in the numerator is inflated by a denominator that decreases with the degree of noncompliance Equal to intent-to-treat effect in the absence of noncompliance Can also be used in observational settings 19-Jun-09 Instrumental variables 12

13 Definition of an instrument Z (final) i. Z and exposure A are associated because Z has a causal effect on A Z and A share common causes ii. Z affects the outcome Y only through A no direct effect of Z on Y iii. Z does not share common causes with the outcome Y no confounding for the effect of Z on Y 19-Jun-09 Instrumental variables 13

14 Instrument Z U U* A Y Z 19-Jun-09 Instrumental variables 14

15 Overview of this lecture 1. IV in randomized experiments Standard IV estimator 2. IV in observational studies 3. Problems of IV methods 4. Conclusion 19-Jun-09 Instrumental variables 15

16 Examples of instruments in observational studies: Access Patients with myocardial infarction A: Invasive procedures Y: Mortality Z: Distance to hospital with capability for invasive procedures McClellan et al Jun-09 Instrumental variables 16

17 Examples of instruments in observational studies: Access Patients with myocardial infarction A: Cigarette smoking Y: Health outcome (physical functional status) Z: Cigarette price Leigh and Schembri Jun-09 Instrumental variables 17

18 Examples of instruments in observational studies: Genes Mendelian randomization A: Alcohol intake Y: Coronary heart disease Z: genetic variants associated with alcohol metabolism, e.g., ADH3 polymorphic forms: slow/fast oxidizers Katan 1986, Davey Smith and Ebrahim 2004, 19-Jun-09 Instrumental variables 18

19 Examples of instruments in observational studies: Genes A: Dietary calcium Y: Osteoporosis U*: Lactose intolerance gene (unmeasured) Z: Self-reported lactose intolerance 19-Jun-09 Instrumental variables 19

20 Examples of instruments in observational studies: Preference Pharmacoepidemiology / Outcomes research A: Type of drug (e.g., chemotherapy) Y: Outcome (e.g., mortality in lung cancer patients) Z: Physician s preference e.g., Korn and Baumrind 1998, Craig et al 2001, Brooks et al 2003, Brookhart et al 2006, 19-Jun-09 Instrumental variables 20

21 Examples of instruments in observational studies: Preference A: Type of drug (e.g., chemotherapy) Y: Outcome (e.g., mortality in lung cancer patients) U*: Physician s preference (unmeasured) Z: Proxy for preference, e.g., proportion of patients receiving A=1 19-Jun-09 Instrumental variables 21

22 Isn t it amazing? After all, we can consistently estimate causal effects in observational studies in the presence of unmeasured confounding If we find an instrument conditional exchangeability of the exposed and unexposed is not necessary for causal inference from observational data! Why were we wasting our time with methods that require exchangeability for the exposure? 19-Jun-09 Instrumental variables 22

23 Overview of this lecture 1. IV in randomized experiments Standard IV estimator 2. IV in observational studies 3. Problems of IV methods 4. Conclusion 19-Jun-09 Instrumental variables 23

24 The problems of IV methods 1. It is impossible to verify that Z is an instrument A non instrument introduces bias 2. A weak instrument Z blows up the bias 3. Instruments are insufficient to estimate causal effects Additional unverifiable assumptions are required 4. Standard IV methods deal poorly with time-varying exposures 19-Jun-09 Instrumental variables 24

25 Problem 1: Conditions (ii) and (iii) are not empirically verifiable ii. Z affects the outcome Y only through A no direct effect of Z on Y iii. Z does not share common causes with the outcome Y no confounding for the effect of Z on Y IV estimate may be more biased than the unadjusted estimate 19-Jun-09 Instrumental variables 25

26 Problem 1 effect of Z on Y effect of Z on A PrY 1 Z 1 PrY 1 Z 0 PrA 1 Z 1 PrA 1 Z 0 19-Jun-09 Instrumental variables 26

27 Problem 2: A weak instrument amplifies the bias i. Z and A are associated because Z has a causal effect on A Z and A share common causes If Z weakly associated with A Small denominator of the IV estimator Biases that affect the numerator (unmeasured confounding for Z, direct effect of Z) or small sample bias in the denominator will be exaggerated IV estimate may be more biased than the unadjusted estimate 19-Jun-09 Instrumental variables 27

28 Problems 1 and 2 Effects of exposure estimated by IV methods may be much larger than effects estimated by conventional adjustment methods or randomized experiments Because violation of the IV assumptions or small sample size may result in large bias that exaggerates the effect estimate This may be counterintuitive to epidemiologists used to conventional methods 19-Jun-09 Instrumental variables 28

29 Problem 3: An instrument is not enough An instrument only allows to compute bounds for, not a point estimate of, the causal effect Bounds may be too wide: not very informative In addition, 95% confidence intervals around the bounds Robins 1989 But what about the standard IV estimator? 19-Jun-09 Instrumental variables 29

30 Problem 3: An instrument is not enough EY a1 EY a0 EY Z 1 EY Z 0 EA Z 1 EA Z 0 The standard IV estimate provides a point estimate, not bounds The above equality only true under additional identifying assumptions All unverifiable 19-Jun-09 Instrumental variables 30

31 Problem 3: An instrument is not enough Some examples of assumptions a) No between-subject heterogeneity b) No interaction between instrument and exposure Additive or multiplicative 19-Jun-09 Instrumental variables 31

32 Unverifiable assumption a): No between-subject heterogeneity The effect of A on Y is the same for every individual implicit in econometric methods (e.g., 2-stage least squares) along with modeling assumptions Special case: sharp null hypothesis In general, biologically implausible for continuous exposures and logically impossible for dichotomous exposures Too strong an assumption the extreme no interaction assumption 19-Jun-09 Instrumental variables 32

33 Unverifiable assumption b): No interaction No effect modification by Z (or U*) of the effect of A on Y If no effect modification on the additive scale: estimator of E[Y a=1 ] E[Y a=0 ] is the standard IV estimator multiplicative scale: estimator of E[Y a=1 ] E[Y a=0 ] is another IV estimator See Theorem 4 in Hernán and Robins Jun-09 Instrumental variables 33

34 Unverifiable assumption b.1): No interaction on the additive scale The effect of A on Y on the risk difference scale is the same in treated subjects with Z=1 as in treated subjects with Z=0 and similarly among untreated subjects Such effect modification may occur if unmeasured factors U interact with A on an additive scale to cause outcome Y 19-Jun-09 Instrumental variables 34

35 Such effect modification is expected in many studies e.g., in a study of lung cancer patients A: Type of chemotherapy Y: Mortality U: Past response to treatment Z: Physician s preference Effect modification in the treated if the risk difference for the effect of chemotherapy A on mortality Y was modified by past response to treatment U 19-Jun-09 Instrumental variables 35

36 An alternative to the previous unverifiable assumptions Monotonicity: For all subjects, the level of treatment A that the subject would take if given a level of the instrument Z is a monotone increasing function of the level of Z See Hernán and Robins 2006 for definition of monotonicity for continuous instruments Also an unverifiable assumption Let us see some examples 19-Jun-09 Instrumental variables 36

37 Monotonicity Randomized trial Instrument Z is randomized assignment 4 types of people: Always takers: A z=0 =1, A z=1 =1 Never takers: A z=0 =0, A z=1 =0 Compliers (cooperative): A z=0 =0, A z=1 =1 Defiers: A z=0 =1, A z=1 =0 Monotonicity if no defiers plausible 19-Jun-09 Instrumental variables 37

38 Monotonicity Observational study Instrument Z is not randomized assignment Still 4 types of people: A z=0 =1, A z=1 =1 A z=0 =0, A z=1 =0 A z=0 =0, A z=1 =1 A z=0 =1, A z=1 =0 Monotonicity holds if there are no subjects of the type (A z=0 =1, A z=1 =0) We do not refer to subjects (A z=0 =1, A z=1 =0) as defiers because there is no assignment to be defied 19-Jun-09 Instrumental variables 38

39 Monotonicity: Observational study of chemotherapy and lung cancer Instrument Z is physician s preference If only 2 doctors in the study: doctor Z=1 prefers A=1, and doctor Z=0 prefers A=0 Monotonicity if no patient would receive A=0 if treated by doctor Z=1 and A=1 if treated by doctor Z=0 If many doctors in the study: Monotonicity if no patient would receive A=0 if treated by any of the doctors Z=1 (those who prefer A=1) and A=1 if treated by any of the doctors Z=0 (those who prefer A=0) Plausible? 19-Jun-09 Instrumental variables 39

40 Under the monotonicity assumption The standard IV estimator does not estimate the average effect of A on Y in the population but in a subset of the population: the compliers A z=0 =0, A z=1 =1 Angrist, Imbens, Rubin 1986 Problem: the compliers cannot be identified the subset of the population the effect estimate refers to is unknown 19-Jun-09 Instrumental variables 40

41 Who are the compliers? In the randomized trial example, the subset of the population who would comply with whichever treatment is assigned to them In the preference example, the subset of the population who would be treated with A=1 by all doctors who prefer A=1 with A=0 by all doctors who prefer A=0 Less clear if exposure is continuous 19-Jun-09 Instrumental variables 41

42 Problem 4: Time-varying exposures Most epidemiologic exposures are timevarying The standard IV estimator estimates the effect of a non time-varying exposure using a non time-varying instrument What if time-varying exposures and/or instruments? G-estimation of structural nested models Standard IV estimator is a particular case of a structural nested model 19-Jun-09 Instrumental variables 42

43 Conclusions (I) IV methods require FOUR assumptions The first 3 (instrumental) assumptions are nonnegotiable association between instrument and exposure no direct effect of the instrument on outcome no unmeasured confounding (conditional exchangeability) for the instrument Wide variety of fourth assumptions no interaction, monotonicity, etc Different assumptions result in the estimation of different causal effects 19-Jun-09 Instrumental variables 43

44 Conclusions (II) IV methods replace one unverifiable assumption no unmeasured confounding (conditional exchangeability) for the exposure By other unverifiable assumptions no unmeasured confounding (conditional exchangeability) for the instrument no direct effect of the instrument no interaction, monotonicity, etc The fundamental problem of causal inference is not solved but simply shifted Need to decide which assumptions are more likely to hold in each particular example 19-Jun-09 Instrumental variables 44

45 Conclusions (III) IV methods are not a magic bullet for unmeasured confounding reliance on different unverifiable assumptions compared with IPW, etc. IV methods are underutilized deserve greater attention in epidemiology But users of IV methods need to be aware of the limitations of these methods otherwise, conflicting estimates may result counterintuitive 19-Jun-09 Instrumental variables 45

46 References Hernán MA, Robins JM. Instruments for causal inference: an epidemiologist s dream? Epidemiology 2006; 17: Plus all the other papers the organizers considered good enough to them to you 19-Jun-09 Instrumental variables 46

An introduction to instrumental variable assumptions, validation and estimation

An introduction to instrumental variable assumptions, validation and estimation https://doi.org/10.1186/s12982-018-0069-7 Emerging Themes in Epidemiology RESEARCH ARTICLE Open Access An introduction to instrumental variable assumptions, validation and estimation Mette Lise Lousdal

More information

Mendelian randomization with a binary exposure variable: interpretation and presentation of causal estimates

Mendelian randomization with a binary exposure variable: interpretation and presentation of causal estimates Mendelian randomization with a binary exposure variable: interpretation and presentation of causal estimates arxiv:1804.05545v1 [stat.me] 16 Apr 2018 Stephen Burgess 1,2 Jeremy A Labrecque 3 1 MRC Biostatistics

More information

Simulation study of instrumental variable approaches with an application to a study of the antidiabetic effect of bezafibrate

Simulation study of instrumental variable approaches with an application to a study of the antidiabetic effect of bezafibrate pharmacoepidemiology and drug safety 2012; 21(S2): 114 120 Published online in Wiley Online Library (wileyonlinelibrary.com).3252 ORIGINAL REPORT Simulation study of instrumental variable approaches with

More information

Can you guarantee that the results from your observational study are unaffected by unmeasured confounding? H.Hosseini

Can you guarantee that the results from your observational study are unaffected by unmeasured confounding? H.Hosseini Instrumental Variable (Instrument) applications in Epidemiology: An Introduction Hamed Hosseini Can you guarantee that the results from your observational study are unaffected by unmeasured confounding?

More information

Complier Average Causal Effect (CACE)

Complier Average Causal Effect (CACE) Complier Average Causal Effect (CACE) Booil Jo Stanford University Methodological Advancement Meeting Innovative Directions in Estimating Impact Office of Planning, Research & Evaluation Administration

More information

Supplement 2. Use of Directed Acyclic Graphs (DAGs)

Supplement 2. Use of Directed Acyclic Graphs (DAGs) Supplement 2. Use of Directed Acyclic Graphs (DAGs) Abstract This supplement describes how counterfactual theory is used to define causal effects and the conditions in which observed data can be used to

More information

Mendelian Randomisation and Causal Inference in Observational Epidemiology. Nuala Sheehan

Mendelian Randomisation and Causal Inference in Observational Epidemiology. Nuala Sheehan Mendelian Randomisation and Causal Inference in Observational Epidemiology Nuala Sheehan Department of Health Sciences UNIVERSITY of LEICESTER MRC Collaborative Project Grant G0601625 Vanessa Didelez,

More information

Bounding the per-protocol effect in randomized trials: an application to colorectal cancer screening

Bounding the per-protocol effect in randomized trials: an application to colorectal cancer screening Bounding the per-protocol effect in randomized trials: an application to colorectal cancer screening The Harvard community has made this article openly available. Please share how this access benefits

More information

Sensitivity Analysis in Observational Research: Introducing the E-value

Sensitivity Analysis in Observational Research: Introducing the E-value Sensitivity Analysis in Observational Research: Introducing the E-value Tyler J. VanderWeele Harvard T.H. Chan School of Public Health Departments of Epidemiology and Biostatistics 1 Plan of Presentation

More information

Randomized Experiments with Noncompliance. David Madigan

Randomized Experiments with Noncompliance. David Madigan Randomized Experiments with Noncompliance David Madigan Introduction Noncompliance is an important problem in randomized experiments involving humans Includes e.g. switching subjects to standard therapy

More information

Instrumental Variables. Application and Limitations

Instrumental Variables. Application and Limitations ORIGINAL ARTICL Application and Limitations dwin P. Martens,* Wiebe R. Pestman, Anthonius de Boer,* Svetlana V. Belitser,* and Olaf H. Klungel* Abstract: To correct for confounding, the method of instrumental

More information

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research 2012 CCPRC Meeting Methodology Presession Workshop October 23, 2012, 2:00-5:00 p.m. Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy

More information

Generalizing the right question, which is?

Generalizing the right question, which is? Generalizing RCT results to broader populations IOM Workshop Washington, DC, April 25, 2013 Generalizing the right question, which is? Miguel A. Hernán Harvard School of Public Health Observational studies

More information

Estimating Direct Effects of New HIV Prevention Methods. Focus: the MIRA Trial

Estimating Direct Effects of New HIV Prevention Methods. Focus: the MIRA Trial Estimating Direct Effects of New HIV Prevention Methods. Focus: the MIRA Trial Michael Rosenblum UCSF: Helen Cheng, Nancy Padian, Steve Shiboski, Ariane van der Straten Berkeley: Nicholas P. Jewell, Mark

More information

CAN EFFECTIVENESS BE MEASURED OUTSIDE A CLINICAL TRIAL?

CAN EFFECTIVENESS BE MEASURED OUTSIDE A CLINICAL TRIAL? CAN EFFECTIVENESS BE MEASURED OUTSIDE A CLINICAL TRIAL? Mette Nørgaard, Professor, MD, PhD Department of Clinical Epidemiology Aarhus Universitety Hospital Aarhus, Denmark Danish Medical Birth Registry

More information

Dichotomizing partial compliance and increased participant burden in factorial designs: the performance of four noncompliance methods

Dichotomizing partial compliance and increased participant burden in factorial designs: the performance of four noncompliance methods Merrill and McClure Trials (2015) 16:523 DOI 1186/s13063-015-1044-z TRIALS RESEARCH Open Access Dichotomizing partial compliance and increased participant burden in factorial designs: the performance of

More information

Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015

Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015 Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015 Learning Objectives At the end of this confounding control overview, you will be able to: Understand how

More information

Comparative Effectiveness Research Using Observational Data: Active Comparators to Emulate Target Trials with Inactive Comparators

Comparative Effectiveness Research Using Observational Data: Active Comparators to Emulate Target Trials with Inactive Comparators Comparative Effectiveness Research Using Observational Data: Active Comparators to Emulate Target Trials with Inactive Comparators The Harvard community has made this article openly available. Please share

More information

Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies

Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies September 27, 2018 Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies A Case Study of Screening Colonoscopy Our Team Xabier Garcia

More information

Beyond the intention-to treat effect: Per-protocol effects in randomized trials

Beyond the intention-to treat effect: Per-protocol effects in randomized trials Beyond the intention-to treat effect: Per-protocol effects in randomized trials Miguel Hernán DEPARTMENTS OF EPIDEMIOLOGY AND BIOSTATISTICS Intention-to-treat analysis (estimator) estimates intention-to-treat

More information

Genetics, epigenetics, and Mendelian randomization: cuttingedge tools for causal inference in epidemiology

Genetics, epigenetics, and Mendelian randomization: cuttingedge tools for causal inference in epidemiology Genetics, epigenetics, and Mendelian randomization: cuttingedge tools for causal inference in epidemiology COURSE DURATION This is an online distance learning course. Material will be available June 1st

More information

Instrumental variable (IV) analysis is increasingly used in

Instrumental variable (IV) analysis is increasingly used in Original Article Physician s Prescribing Preference as an Instrumental Variable Exploring Assumptions Using Survey Data Anna G. C. Boef, a Saskia le Cessie, a,b Olaf M. Dekkers, a,c,d Peter Frey, e Patricia

More information

Title:Bounding the Per-Protocol Effect in Randomized Trials: An Application to Colorectal Cancer Screening

Title:Bounding the Per-Protocol Effect in Randomized Trials: An Application to Colorectal Cancer Screening Author's response to reviews Title:Bounding the Per-Protocol Effect in Randomized Trials: An Application to Colorectal Cancer Screening Authors: Sonja A Swanson (sswanson@hsph.harvard.edu) Oyvind Holme

More information

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard

More information

Comparisons of Dynamic Treatment Regimes using Observational Data

Comparisons of Dynamic Treatment Regimes using Observational Data Comparisons of Dynamic Treatment Regimes using Observational Data Bryan Blette University of North Carolina at Chapel Hill 4/19/18 Blette (UNC) BIOS 740 Final Presentation 4/19/18 1 / 15 Overview 1 Motivation

More information

THREATS TO VALIDITY. Presentation by: Raul Sanchez de la Sierra

THREATS TO VALIDITY. Presentation by: Raul Sanchez de la Sierra THREATS TO VALIDITY Presentation by: Raul Sanchez de la Sierra What I want you to avoid Captain, sorry, I forgot the spillovers! Lecture Overview External Validity Attrition Spillovers Partial Compliance

More information

Mediation Analysis With Principal Stratification

Mediation Analysis With Principal Stratification University of Pennsylvania ScholarlyCommons Statistics Papers Wharton Faculty Research 3-30-009 Mediation Analysis With Principal Stratification Robert Gallop Dylan S. Small University of Pennsylvania

More information

Propensity scores: what, why and why not?

Propensity scores: what, why and why not? Propensity scores: what, why and why not? Rhian Daniel, Cardiff University @statnav Joint workshop S3RI & Wessex Institute University of Southampton, 22nd March 2018 Rhian Daniel @statnav/propensity scores:

More information

The Logic of Causal Inference. Uwe Siebert, MD, MPH, MSc, ScD

The Logic of Causal Inference. Uwe Siebert, MD, MPH, MSc, ScD The Logic of Causal Inference Uwe Siebert, MD, MPH, MSc, ScD (1) Dept. of Public Health, Health Services Research and Health Technology Assessment, UMIT - University for Health Sciences, Medical Informatics

More information

Manitoba Centre for Health Policy. Inverse Propensity Score Weights or IPTWs

Manitoba Centre for Health Policy. Inverse Propensity Score Weights or IPTWs Manitoba Centre for Health Policy Inverse Propensity Score Weights or IPTWs 1 Describe Different Types of Treatment Effects Average Treatment Effect Average Treatment Effect among Treated Average Treatment

More information

Per-Protocol Analyses of Pragmatic Trials

Per-Protocol Analyses of Pragmatic Trials The new england journal of medicine Statistics in Medicine Per-Protocol Analyses of Pragmatic Trials Miguel A. Hernán, M.D., Dr.P.H., and James M. Robins, M.D. Pragmatic trials are designed to address

More information

Dylan Small Department of Statistics, Wharton School, University of Pennsylvania. Based on joint work with Paul Rosenbaum

Dylan Small Department of Statistics, Wharton School, University of Pennsylvania. Based on joint work with Paul Rosenbaum Instrumental variables and their sensitivity to unobserved biases Dylan Small Department of Statistics, Wharton School, University of Pennsylvania Based on joint work with Paul Rosenbaum Overview Instrumental

More information

16:35 17:20 Alexander Luedtke (Fred Hutchinson Cancer Research Center)

16:35 17:20 Alexander Luedtke (Fred Hutchinson Cancer Research Center) Conference on Causal Inference in Longitudinal Studies September 21-23, 2017 Columbia University Thursday, September 21, 2017: tutorial 14:15 15:00 Miguel Hernan (Harvard University) 15:00 15:45 Miguel

More information

Cover Page. The handle holds various files of this Leiden University dissertation.

Cover Page. The handle  holds various files of this Leiden University dissertation. Cover Page The handle http://hdl.handle.net/1887/37763 holds various files of this Leiden University dissertation. Author: Boef, Anna Gunnel Christina Title: Obtaining causal estimates of therapeutic effects

More information

Assessing the impact of unmeasured confounding: confounding functions for causal inference

Assessing the impact of unmeasured confounding: confounding functions for causal inference Assessing the impact of unmeasured confounding: confounding functions for causal inference Jessica Kasza jessica.kasza@monash.edu Department of Epidemiology and Preventive Medicine, Monash University Victorian

More information

Introducing a SAS macro for doubly robust estimation

Introducing a SAS macro for doubly robust estimation Introducing a SAS macro for doubly robust estimation 1Michele Jonsson Funk, PhD, 1Daniel Westreich MSPH, 2Marie Davidian PhD, 3Chris Weisen PhD 1Department of Epidemiology and 3Odum Institute for Research

More information

in Medicine Tutorial in Biostatistics: Instrumental Variable Methods for Causal Inference

in Medicine Tutorial in Biostatistics: Instrumental Variable Methods for Causal Inference Received XXXX Statistics (www.interscience.wiley.com) DOI: 10.1002/sim.0000 Research Article in Medicine Tutorial in Biostatistics: Instrumental Variable Methods for Causal Inference Michael Baiocchi a,jing

More information

Comparison And Application Of Methods To Address Confounding By Indication In Non- Randomized Clinical Studies

Comparison And Application Of Methods To Address Confounding By Indication In Non- Randomized Clinical Studies University of Massachusetts Amherst ScholarWorks@UMass Amherst Masters Theses 1911 - February 2014 Dissertations and Theses 2013 Comparison And Application Of Methods To Address Confounding By Indication

More information

Demystifying causal inference in randomised trials

Demystifying causal inference in randomised trials Demystifying causal inference in randomised trials Ian White 1, Sabine Landau 2, Graham Dunn 3,4 and Richard Emsley 3,4 1 MRC Biostatistics Unit Cambridge 2 Department of Biostatistics, Institute of Psychiatry,

More information

Statistical Techniques for Analyzing Data From Prevention Trials: Treatment of No-Shows Using Rubin's Causal Model

Statistical Techniques for Analyzing Data From Prevention Trials: Treatment of No-Shows Using Rubin's Causal Model Psychological Methods 1998, Vol. 3, No. 2,147-159 Copyright 1998 by the American Psychological Association, Inc. 1082-989X/98/$3.00 Statistical Techniques for Analyzing Data From Prevention Trials: Treatment

More information

Instrumental variable analysis in randomized trials with noncompliance. for observational pharmacoepidemiologic

Instrumental variable analysis in randomized trials with noncompliance. for observational pharmacoepidemiologic Page 1 of 7 Statistical/Methodological Debate Instrumental variable analysis in randomized trials with noncompliance and observational pharmacoepidemiologic studies RHH Groenwold 1,2*, MJ Uddin 1, KCB

More information

Confounding and Bias

Confounding and Bias 28 th International Conference on Pharmacoepidemiology and Therapeutic Risk Management Barcelona, Spain August 22, 2012 Confounding and Bias Tobias Gerhard, PhD Assistant Professor, Ernest Mario School

More information

Propensity Score Analysis Shenyang Guo, Ph.D.

Propensity Score Analysis Shenyang Guo, Ph.D. Propensity Score Analysis Shenyang Guo, Ph.D. Upcoming Seminar: April 7-8, 2017, Philadelphia, Pennsylvania Propensity Score Analysis 1. Overview 1.1 Observational studies and challenges 1.2 Why and when

More information

The problem of attrition in longitudinal studies of the elderly

The problem of attrition in longitudinal studies of the elderly The problem of attrition in longitudinal studies of the elderly Emeritus Professor of Biostatistics, University of Cambridge, UK Honorary Professor, London School of Hygiene and Tropical Medicine, UK April

More information

Structural Approach to Bias in Meta-analyses

Structural Approach to Bias in Meta-analyses Original Article Received 26 July 2011, Revised 22 November 2011, Accepted 12 December 2011 Published online 2 February 2012 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/jrsm.52 Structural

More information

AVOIDING BIAS AND RANDOM ERROR IN DATA ANALYSIS

AVOIDING BIAS AND RANDOM ERROR IN DATA ANALYSIS AVOIDING BIAS AND RANDOM ERROR IN DATA ANALYSIS Susan S. Ellenberg, Ph.D. Perelman School of Medicine University of Pennsylvania FDA Clinical Investigator Course Silver Spring, MD November 14, 2018 OVERVIEW

More information

Introduction and motivation

Introduction and motivation 1 Introduction and motivation This book concerns making inferences about causal effects based on observational data using genetic instrumental variables, a concept known as Mendelian randomization. In

More information

Propensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018

Propensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018 Propensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018 Institute Institute for Clinical for Clinical Evaluative Evaluative Sciences Sciences Overview 1.

More information

Application of Marginal Structural Models in Pharmacoepidemiologic Studies

Application of Marginal Structural Models in Pharmacoepidemiologic Studies Virginia Commonwealth University VCU Scholars Compass Theses and Dissertations Graduate School 2014 Application of Marginal Structural Models in Pharmacoepidemiologic Studies Shibing Yang Virginia Commonwealth

More information

Online Supplementary Material

Online Supplementary Material Section 1. Adapted Newcastle-Ottawa Scale The adaptation consisted of allowing case-control studies to earn a star when the case definition is based on record linkage, to liken the evaluation of case-control

More information

Approaches to Improving Causal Inference from Mediation Analysis

Approaches to Improving Causal Inference from Mediation Analysis Approaches to Improving Causal Inference from Mediation Analysis David P. MacKinnon, Arizona State University Pennsylvania State University February 27, 2013 Background Traditional Mediation Methods Modern

More information

INTERNAL VALIDITY, BIAS AND CONFOUNDING

INTERNAL VALIDITY, BIAS AND CONFOUNDING OCW Epidemiology and Biostatistics, 2010 J. Forrester, PhD Tufts University School of Medicine October 6, 2010 INTERNAL VALIDITY, BIAS AND CONFOUNDING Learning objectives for this session: 1) Understand

More information

Using Ensemble-Based Methods for Directly Estimating Causal Effects: An Investigation of Tree-Based G-Computation

Using Ensemble-Based Methods for Directly Estimating Causal Effects: An Investigation of Tree-Based G-Computation Institute for Clinical Evaluative Sciences From the SelectedWorks of Peter Austin 2012 Using Ensemble-Based Methods for Directly Estimating Causal Effects: An Investigation of Tree-Based G-Computation

More information

Propensity scores and instrumental variables to control for confounding. ISPE mid-year meeting München, 2013 Rolf H.H. Groenwold, MD, PhD

Propensity scores and instrumental variables to control for confounding. ISPE mid-year meeting München, 2013 Rolf H.H. Groenwold, MD, PhD Propensity scores and instrumental variables to control for confounding ISPE mid-year meeting München, 2013 Rolf H.H. Groenwold, MD, PhD WP2 WG2: aims Evaluate methods to control for observed and unobserved

More information

CAUSAL INFERENCE IN HIV/AIDS RESEARCH: GENERALIZABILITY AND APPLICATIONS

CAUSAL INFERENCE IN HIV/AIDS RESEARCH: GENERALIZABILITY AND APPLICATIONS CAUSAL INFERENCE IN HIV/AIDS RESEARCH: GENERALIZABILITY AND APPLICATIONS Ashley L. Buchanan A dissertation submitted to the faculty at the University of North Carolina at Chapel Hill in partial fulfillment

More information

Identification of population average treatment effects using nonlinear instrumental variables estimators : another cautionary note

Identification of population average treatment effects using nonlinear instrumental variables estimators : another cautionary note University of Iowa Iowa Research Online Theses and Dissertations Fall 2014 Identification of population average treatment effects using nonlinear instrumental variables estimators : another cautionary

More information

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Biases in clinical research Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Learning objectives Describe the threats to causal inferences in clinical studies Understand the role of

More information

A Guide to Quasi-Experimental Designs

A Guide to Quasi-Experimental Designs Western Kentucky University From the SelectedWorks of Matt Bogard Fall 2013 A Guide to Quasi-Experimental Designs Matt Bogard, Western Kentucky University Available at: https://works.bepress.com/matt_bogard/24/

More information

Instrumental Variables Estimation: An Introduction

Instrumental Variables Estimation: An Introduction Instrumental Variables Estimation: An Introduction Susan L. Ettner, Ph.D. Professor Division of General Internal Medicine and Health Services Research, UCLA The Problem The Problem Suppose you wish to

More information

Mendelian Randomization

Mendelian Randomization Mendelian Randomization Drawback with observational studies Risk factor X Y Outcome Risk factor X? Y Outcome C (Unobserved) Confounders The power of genetics Intermediate phenotype (risk factor) Genetic

More information

Program Evaluations and Randomization. Lecture 5 HSE, Dagmara Celik Katreniak

Program Evaluations and Randomization. Lecture 5 HSE, Dagmara Celik Katreniak Program Evaluations and Randomization Lecture 5 HSE, 10.11.2014 Dagmara Celik Katreniak Overview Treatment Effect under perfect conditions Average Treatment Effect Treatment effect under imperfect conditions

More information

Chapter 10. Considerations for Statistical Analysis

Chapter 10. Considerations for Statistical Analysis Chapter 10. Considerations for Statistical Analysis Patrick G. Arbogast, Ph.D. (deceased) Kaiser Permanente Northwest, Portland, OR Tyler J. VanderWeele, Ph.D. Harvard School of Public Health, Boston,

More information

Instrumental Variables I (cont.)

Instrumental Variables I (cont.) Review Instrumental Variables Observational Studies Cross Sectional Regressions Omitted Variables, Reverse causation Randomized Control Trials Difference in Difference Time invariant omitted variables

More information

Rise of the Machines

Rise of the Machines Rise of the Machines Statistical machine learning for observational studies: confounding adjustment and subgroup identification Armand Chouzy, ETH (summer intern) Jason Wang, Celgene PSI conference 2018

More information

Measuring cancer survival in populations: relative survival vs cancer-specific survival

Measuring cancer survival in populations: relative survival vs cancer-specific survival Int. J. Epidemiol. Advance Access published February 8, 2010 Published by Oxford University Press on behalf of the International Epidemiological Association ß The Author 2010; all rights reserved. International

More information

Supplementary Online Content

Supplementary Online Content Supplementary Online Content Holme Ø, Løberg M, Kalager M, et al. Effect of flexible sigmoidoscopy screening on colorectal cancer incidence and mortality: a randomized clinical trial. JAMA. doi:10.1001/jama.2014.8266

More information

In the 1700s patients in charity hospitals sometimes slept two or more to a bed, regardless of diagnosis.

In the 1700s patients in charity hospitals sometimes slept two or more to a bed, regardless of diagnosis. Control Case In the 1700s patients in charity hospitals sometimes slept two or more to a bed, regardless of diagnosis. This depicts a patient who finds himself lying with a corpse (definitely a case ).

More information

Epidemiology: Overview of Key Concepts and Study Design. Polly Marchbanks

Epidemiology: Overview of Key Concepts and Study Design. Polly Marchbanks Epidemiology: Overview of Key Concepts and Study Design Polly Marchbanks Lecture Outline (1) Key epidemiologic concepts - Definition - What epi is not - What epi is - Process of epi research Lecture Outline

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

Causal Validity Considerations for Including High Quality Non-Experimental Evidence in Systematic Reviews

Causal Validity Considerations for Including High Quality Non-Experimental Evidence in Systematic Reviews Non-Experimental Evidence in Systematic Reviews OPRE REPORT #2018-63 DEKE, MATHEMATICA POLICY RESEARCH JUNE 2018 OVERVIEW Federally funded systematic reviews of research evidence play a central role in

More information

Session 1: Dealing with Endogeneity

Session 1: Dealing with Endogeneity Niehaus Center, Princeton University GEM, Sciences Po ARTNeT Capacity Building Workshop for Trade Research: Behind the Border Gravity Modeling Thursday, December 18, 2008 Outline Introduction 1 Introduction

More information

Measures of Association

Measures of Association Measures of Association Lakkana Thaikruea M.D., M.S., Ph.D. Community Medicine Department, Faculty of Medicine, Chiang Mai University, Thailand Introduction One of epidemiological studies goal is to determine

More information

Anatomy of Medical Studies: Part I. Emily D Agostino Epidemiology and Biostatistics CUNY School of Public Health at Hunter College

Anatomy of Medical Studies: Part I. Emily D Agostino Epidemiology and Biostatistics CUNY School of Public Health at Hunter College Anatomy of Medical Studies: Part I!! Emily D Agostino Epidemiology and Biostatistics CUNY School of Public Health at Hunter College I. Standard format of a Medical Study Abstract (quick overview: what

More information

Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha

Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha attrition: When data are missing because we are unable to measure the outcomes of some of the

More information

Studying the effect of change on change : a different viewpoint

Studying the effect of change on change : a different viewpoint Studying the effect of change on change : a different viewpoint Eyal Shahar Professor, Division of Epidemiology and Biostatistics, Mel and Enid Zuckerman College of Public Health, University of Arizona

More information

School of Population and Public Health SPPH 503 Epidemiologic methods II January to April 2019

School of Population and Public Health SPPH 503 Epidemiologic methods II January to April 2019 School of Population and Public Health SPPH 503 Epidemiologic methods II January to April 2019 Time: Tuesday, 1330 1630 Location: School of Population and Public Health, UBC Course description Students

More information

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany Overview of Perspectives on Causal Inference: Campbell and Rubin Stephen G. West Arizona State University Freie Universität Berlin, Germany 1 Randomized Experiment (RE) Sir Ronald Fisher E(X Treatment

More information

Lecture II: Difference in Difference. Causality is difficult to Show from cross

Lecture II: Difference in Difference. Causality is difficult to Show from cross Review Lecture II: Regression Discontinuity and Difference in Difference From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

Handling time varying confounding in observational research

Handling time varying confounding in observational research Handling time varying confounding in observational research Mohammad Ali Mansournia, 1 Mahyar Etminan, 2 Goodarz Danaei, 3 Jay S Kaufman, 4 Gary Collins 5 1 Department of Epidemiology and Biostatistics,

More information

Quantification of collider-stratification bias and the birthweight paradox

Quantification of collider-stratification bias and the birthweight paradox University of Massachusetts Amherst From the SelectedWorks of Brian W. Whitcomb 2009 Quantification of collider-stratification bias and the birthweight paradox Brian W Whitcomb, University of Massachusetts

More information

G , G , G MHRN

G , G , G MHRN Estimation of treatment-effects from randomized controlled trials in the presence non-compliance with randomized treatment allocation Graham Dunn University of Manchester Research funded by: MRC Methodology

More information

Overview of Clinical Study Design Laura Lee Johnson, Ph.D. Statistician National Center for Complementary and Alternative Medicine US National

Overview of Clinical Study Design Laura Lee Johnson, Ph.D. Statistician National Center for Complementary and Alternative Medicine US National Overview of Clinical Study Design Laura Lee Johnson, Ph.D. Statistician National Center for Complementary and Alternative Medicine US National Institutes of Health 2012 How Many Taken a similar course

More information

(b) empirical power. IV: blinded IV: unblinded Regr: blinded Regr: unblinded α. empirical power

(b) empirical power. IV: blinded IV: unblinded Regr: blinded Regr: unblinded α. empirical power Supplementary Information for: Using instrumental variables to disentangle treatment and placebo effects in blinded and unblinded randomized clinical trials influenced by unmeasured confounders by Elias

More information

Confounding by indication developments in matching, and instrumental variable methods. Richard Grieve London School of Hygiene and Tropical Medicine

Confounding by indication developments in matching, and instrumental variable methods. Richard Grieve London School of Hygiene and Tropical Medicine Confounding by indication developments in matching, and instrumental variable methods Richard Grieve London School of Hygiene and Tropical Medicine 1 Outline 1. Causal inference and confounding 2. Genetic

More information

Should Causality Be Defined in Terms of Experiments? University of Connecticut University of Colorado

Should Causality Be Defined in Terms of Experiments? University of Connecticut University of Colorado November 2004 Should Causality Be Defined in Terms of Experiments? David A. Kenny Charles M. Judd University of Connecticut University of Colorado The research was supported in part by grant from the National

More information

Introduction to Observational Studies. Jane Pinelis

Introduction to Observational Studies. Jane Pinelis Introduction to Observational Studies Jane Pinelis 22 March 2018 Outline Motivating example Observational studies vs. randomized experiments Observational studies: basics Some adjustment strategies Matching

More information

Ec331: Research in Applied Economics Spring term, Panel Data: brief outlines

Ec331: Research in Applied Economics Spring term, Panel Data: brief outlines Ec331: Research in Applied Economics Spring term, 2014 Panel Data: brief outlines Remaining structure Final Presentations (5%) Fridays, 9-10 in H3.45. 15 mins, 8 slides maximum Wk.6 Labour Supply - Wilfred

More information

Effects of propensity score overlap on the estimates of treatment effects. Yating Zheng & Laura Stapleton

Effects of propensity score overlap on the estimates of treatment effects. Yating Zheng & Laura Stapleton Effects of propensity score overlap on the estimates of treatment effects Yating Zheng & Laura Stapleton Introduction Recent years have seen remarkable development in estimating average treatment effects

More information

Supplementary Appendix

Supplementary Appendix Supplementary Appendix This appendix has been provided by the authors to give readers additional information about their work. Supplement to: Weintraub WS, Grau-Sepulveda MV, Weiss JM, et al. Comparative

More information

Title: New Perspectives on the Synthetic Control Method. Authors: Eli Ben-Michael, UC Berkeley,

Title: New Perspectives on the Synthetic Control Method. Authors: Eli Ben-Michael, UC Berkeley, Title: New Perspectives on the Synthetic Control Method Authors: Eli Ben-Michael, UC Berkeley, ebenmichael@berkeley.edu Avi Feller, UC Berkeley, afeller@berkeley.edu [presenting author] Jesse Rothstein,

More information

Advanced IPD meta-analysis methods for observational studies

Advanced IPD meta-analysis methods for observational studies Advanced IPD meta-analysis methods for observational studies Simon Thompson University of Cambridge, UK Part 4 IBC Victoria, July 2016 1 Outline of talk Usual measures of association (e.g. hazard ratios)

More information

Best (but oft-forgotten) practices: the design, analysis, and interpretation of Mendelian randomization studies 1

Best (but oft-forgotten) practices: the design, analysis, and interpretation of Mendelian randomization studies 1 AJCN. First published ahead of print March 9, 2016 as doi: 10.3945/ajcn.115.118216. Statistical Commentary Best (but oft-forgotten) practices: the design, analysis, and interpretation of Mendelian randomization

More information

The ROBINS-I tool is reproduced from riskofbias.info with the permission of the authors. The tool should not be modified for use.

The ROBINS-I tool is reproduced from riskofbias.info with the permission of the authors. The tool should not be modified for use. Table A. The Risk Of Bias In Non-romized Studies of Interventions (ROBINS-I) I) assessment tool The ROBINS-I tool is reproduced from riskofbias.info with the permission of the auths. The tool should not

More information

What is: regression discontinuity design?

What is: regression discontinuity design? What is: regression discontinuity design? Mike Brewer University of Essex and Institute for Fiscal Studies Part of Programme Evaluation for Policy Analysis (PEPA), a Node of the NCRM Regression discontinuity

More information

Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods

Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Dean Eckles Department of Communication Stanford University dean@deaneckles.com Abstract

More information

Sample size and power calculations in Mendelian randomization with a single instrumental variable and a binary outcome

Sample size and power calculations in Mendelian randomization with a single instrumental variable and a binary outcome Sample size and power calculations in Mendelian randomization with a single instrumental variable and a binary outcome Stephen Burgess July 10, 2013 Abstract Background: Sample size calculations are an

More information

Regression Discontinuity Analysis

Regression Discontinuity Analysis Regression Discontinuity Analysis A researcher wants to determine whether tutoring underachieving middle school students improves their math grades. Another wonders whether providing financial aid to low-income

More information

Causal Inference in Statistics and the Quantitative Sciences

Causal Inference in Statistics and the Quantitative Sciences Causal Inference in Statistics and the Quantitative Sciences Erica E. M. Moodie (McGill University) and David A. Stephens (McGill University) May 3 8, 2009 1 A Short Overview of the Field Causal inference

More information

Welcome to this third module in a three-part series focused on epidemiologic measures of association and impact.

Welcome to this third module in a three-part series focused on epidemiologic measures of association and impact. Welcome to this third module in a three-part series focused on epidemiologic measures of association and impact. 1 This three-part series focuses on the estimation of the association between exposures

More information

Worth the weight: Using Inverse Probability Weighted Cox Models in AIDS Research

Worth the weight: Using Inverse Probability Weighted Cox Models in AIDS Research University of Rhode Island DigitalCommons@URI Pharmacy Practice Faculty Publications Pharmacy Practice 2014 Worth the weight: Using Inverse Probability Weighted Cox Models in AIDS Research Ashley L. Buchanan

More information