CONFOUNDING (CHAPTER 7) BIOS Confounding

Size: px
Start display at page:

Download "CONFOUNDING (CHAPTER 7) BIOS Confounding"

Transcription

1 CONFONDING (CHPTER 7) BIOS Confounding

2 Confounding ( 7) Outline 7.1 The structure of confounding 7.2 Confounding and identifiability of causal effects 7.3 Confounders 7.4 Confounding and exchangeability 7.5 How to adjust for confounding BIOS Confounding

3 conditional on its parents, is independent of its non-descendants. This latter to the statement that the density ( ) of the variables in DG satisfies t 7.1 The structure of confounding Confounding is the bias that arises when the treatment and the outcome share a common cause Consider Figure 7.1 (same as Fig. 6.1) Figure 6.1 Figure 6.2 ( ) = which indicates two sources of association between and 1. The causal effect 2. The backdoor path ( ). =1 effect not mediated through any other va individual, or that we are unwilling to a do not exist. lternatively, the lack of a willingtoassume,that has no direct ca the population. For example, in Figure 6 either we know that disease severity affec transplant or that we are not willing to diagram does not distinguish whether an a protective effect. Furthermore, if, as i two causes, the diagram does not encode Causal diagrams like the one in Figu graphs, which is commonly abbreviated edges imply a direction: because the arro, but not the other way around. cy In general, a backdoor path is a noncausal path between treatment and outcome that remains even if all arrows pointing from treatment to other variables (in graph-theoretic terms, the descendants of treatment) are removed. That is, the path has an arrow pointing into treatment. variable cannot cause itself, either direct Directed acyclic graphs have applicat we focus on causal directed acyclic graph is causal if the common causes of any p in the graph. For example, suppose in assigned to heart transplant with a pro of their disease. Then is a common included in the graph, as shown in the suppose in our study individuals are ra with the same probability regardless of a common cause of and and need n Figure 6.1 represents a conditionally ran BIOS Confounding

4 7.1 The structure of confounding If the backdoor path was absent in Figure 7.1, the only path between treatment and outcome would be, and thus the entire association between and would be due to the causal effect of on, Eg, the associational risk ratio would equal the causal risk ratio However, the common cause creates an additional source of association between and, which we refer to as confounding the effect of on Because of confounding, the associational risk ratio does not necessarily equal the causal risk ratio BIOS Confounding

5 ( ) = =1 ( ). Figure The structure of confounding Figure 6.1 Figure 6.2 effect not mediated through any other va individual, or that we are unwilling to a do not exist. lternatively, the lack of a willingtoassume,that has no direct ca the population. For example, in Figure 6 either we know that disease severity affec transplant or that we are not willing to diagram does not distinguish whether an a protective effect. Furthermore, if, as i two causes, the diagram does not encode Causal diagrams like the one in Figu graphs, which is commonly abbreviated edges imply a direction: because the arro, but not the other way around. cy variable cannot cause itself, either direct Directed acyclic graphs have applicat we focus on causal directed acyclic graph is causal if the common causes of any p in the graph. For example, suppose in assigned to heart transplant with a pro of their disease. Then is a common included in the graph, as shown in the suppose in our study individuals are ra with the same probability regardless of a common cause of and and need n Figure 6.1 represents a conditionally ran 6.2 represents a marginally randomized e Figure 6.1 may also represent an obs might depict many examples of confounding in observational research Healty worker bias: Effect of working as a firefighter on risk of death confounded by being physically fit Confounding by indication or channeling: Effect of drug (eg, aspirin) on the risk of disease (eg, stroke) confounded if drug more likely prescribed to individuals with certain condition (eg, heart disease) BIOS Confounding

6 7.1 The structure of confounding In the above example, has a direct effect on. It may be instead that there is an unmeasured variable (eg, atherosceloris) that affects both and, as in Fig. 7.2 Figure 7.2 In this case there is still confounding because and share a common cause Figure 7.3 BIOS Confounding bias, depicted in the causal diagram a healthy worker bias. Clinical decisions: The effect of d disease (say, stroke) will be con be prescribed to individuals with ce that is both an indication for treatm Heart disease is a risk factor for s effect on as in Figure 7.1 or, as are caused by atherosclerosis, a known as confounding by indicatio being reserved to describe the bias c that encourage doctors to use ce ifestyle: The effect of behavior death) will be confounded if the be havior (say, cigarette smoking) th to co-occur with. The structure picted in the causal diagram in F variable represents the sort of pe to both lack of exercise and smoki clinical disease resultsbothinlac of clinical disease. This form o reverse causation. Genetic factors: The effect of a DN certain trait will be confounded i has a causal effect on and is mor This bias, also represented by the c as linkage disequilibrium or populat being reserved to describe the bias mixture of individuals from differe can stand for ethnicity or other sequences.

7 7.1 The structure of confounding Genetic factors: Suppose DN sequence affects risk of developing trait Suppose there is another DN sequence that also affects nd and associated due to common cause such as ethnicity Figure 7.3 Figure 7.2 Figure 7.3 gain there is confounding because is a common cause of and BIOS Confounding Clinical decisions: The effect of d disease (say, stroke) will be con be prescribed to individuals with ce that is both an indication for treatm Heart disease is a risk factor for s effect on as in Figure 7.1 or, as are caused by atherosclerosis, a known as confounding by indicatio being reserved to describe the bias that encourage doctors to use ce ifestyle: The effect of behavior death) will be confounded if the be havior (say, cigarette smoking) th to co-occur with. The structure picted in the causal diagram in F variable represents the sort of pe to both lack of exercise and smoki clinical disease resultsbothinla of clinical disease. This form o reverse causation. Genetic factors: The effect of a DN certain trait will be confounded has a causal effect on and is mor This bias, also represented by the c as linkage disequilibrium or popula being reserved to describe the bias mixture of individuals from differe can stand for ethnicity or other sequences. Social factors: The effect of income at age 75 will be confounded if th both future income and disability

8 7.2 Confounding and identifiability of causal effects Two settings where causal effects are identifiable (assuming no selection bias, measurement error, or random variability) 1. No common causes, e.g., Fig Common causes but enough measured variables (which are nondescendants of treatment) to block all backdoor paths Fig. 7.1 is an example of the 2nd Figure setting, 7.2 where we can identify the effect of on by conditioning on (or standardizing by) bias, depicted in the causal diagram a healthy worker bias. Clinical decisions: The effect of d disease (say, stroke) will be con be prescribed to individuals with ce that is both an indication for treatm Heart disease is a risk factor for s effect on as in Figure 7.1 or, as are caused by atherosclerosis, a known as confounding by indicatio being reserved to describe the bias that encourage doctors to use ce ifestyle: The effect of behavior death) will be confounded if the be havior (say, cigarette smoking) th to co-occur with. The structure picted in the causal diagram in F variable represents the sort of pe to both lack of exercise and smoki clinical disease resultsbothinla of clinical disease. This form o reverse causation. has a causal effect on and is mor This bias, also represented by the c as linkage disequilibrium or popula being reserved to describe the bias mixture of individuals from differe Figure 7.3 Genetic factors: The effect of a DN certain trait will be confounded can stand for ethnicity or other BIOS sequences. 7 Confounding

9 7.2 Confounding and identifiability of causal effects Backdoor criterion: all backdoor paths are blocked if treatment and outcome are d-separated given the measured coveraties in a graph in which the arrows out of are removed The backdoor criteiron answers three questions: 1. Does confounding exist? es if there are unblocked backdoor paths. No o/w. 2. Can confounding be eliminated? es if all backdoor paths can be blocked by some subset of measured covariates. No o/w. 3. What variables are sufficient to eliminate confounding? ny set that blocks all backdoor paths. BIOS Confounding

10 7.3 Confounders The tradition definition of confounder (statistical rather than structural criterion) 1. ssociated with treatment 2. ssociated with outcome conditional on treatment 3. Not on the causal path Confounding between treatment and outcome Consider Fig Figure 7.4 The bias induced in Figure 7.4 was described by Greenland et al (1999), and referred to as M- bias (Greenland 2003) because the structure of the variables involved in it 2 1 resembles a letter between the structural and traditional d In Figure 7.3 there is also confoundi outcome share the common cause blocked by conditioning on. Therefore given, and we say that is a confo definition, is also a confounder and associated with the treatment (it share associated with the outcome conditiona effect on ), and it does not lie on the ca outcome. gain, there is no discrepancy definitions of confounder for the causal d The key figure is Figure 7.4. In this causes of treatment and outcome, a The backdoor path between and th blocked because is a collider on that p and is due to the effect of on : need to adjust for. (djustment for eit unmeasured variables.) In fact, adjustme Traditional definition suggests M is a confounder (and therefore we should adjust for M) BIOS Confounding

11 Fig. 7.4 (M-bias) 7.3 Confounders Confounding 1 2 Figure 7.4 The bias induced in Figure 7.4 was described by Greenland et al (1999), and referred to as M- bias (Greenland 2003) because the structure of the variables involved in it 2 1 resembles a letter Mlyingonitsside. between the structural and traditional d In Figure 7.3 there is also confoundi outcome share the common cause blocked by conditioning on. Therefore given, and we say that is a confo definition, is also a confounder and associated with the treatment (it share associated with the outcome conditiona effect on ), and it does not lie on the ca outcome. gain, there is no discrepancy definitions of confounder for the causal d The key figure is Figure 7.4. In this causes of treatment and outcome, a The backdoor path between and th blocked because is a collider on that p and is due to the effect of on : need to adjust for. (djustment for eit unmeasured variables.) In fact, adjustme bias because conditioning on would o path between and. This implies tha bias, there is conditional bias for at leas bias as selection bias because it arises fro in which the association between and Though there is no confounding, m founder: it is associated with the treatm with ), it is associated with the outco shares the common cause 1 with ), a In fact, there is no confounding in this example, so there is no need to adjust for M Why? Is the path 2 1 open or blocked? et the tradition definition suggests we should adjust for M Moreover, if we do adjust, then the path above becomes open, inducing non-causal association between and BIOS Confounding

12 7.3 Confounders: M-bias example (R) set.seed(123) n < # sample size u1 <- rbinom(n,1,.25) # unmeasured covariates u1 and u2 u2 <- rbinom(n,1,.75) l <- pmax(u1,u2) # measured covariate l a <- rbinom(n,1,.25+.5*u2) # treatment y0 <- rnorm(n,u1,1); y1 <- y0 + 1 # potential outcomes yobs <- y0*(1-a)+y1*a # observed outcomes # naive estimator acehat <- mean(yobs[a==1]) - mean(yobs[a==0]) # standardized estimator ace.str0 <- mean(yobs[a==1 & l==0]) - mean(yobs[a==0 & l==0]) ace.str1 <- mean(yobs[a==1 & l==1]) - mean(yobs[a==0 & l==1]) ace.str <- ace.str0*mean(l==0)+ace.str1*mean(l==1) print(paste("acehat:",acehat,"standardized",ace.str)) [1] "acehat: standardized " BIOS Confounding

13 Mlyingonitsside. 7.3 Confounders Fig. 7.5 is another example where there is no confounding Figure 7.5 et the tradition definition suggests we should adjust for Why? Figure 7.5 is another example in which, in the absence of confounding, the traditional criteria lead to bias because conditioning on would o path between and. This implies tha bias, there is conditional bias for at leas bias as selection bias because it arises fro in which the association between and Though there is no confounding, m founder: it is associated with the treatm with ), it is associated with the outco shares the common cause 1 with ), a way between treatment and outcome. definition, is considered a confounder the absence of confounding! The result of trying to adjust for th selection bias. For example, suppose r cancer, 1 a pre-cancer lesion, a diagn and 2 a health-conscious personality (m the doctor). Then, under the causal diagr activity on cancer is unconfounded nd conditioning onselection willbias open dueatonon-causal adjustment forpath But from let us say tothat one decides to adjust. The traditional criteria would not have resulted in bias had condition 3) been replaced by the condition that the variable is not caused by treatment, i.e., it is a nondescendant of. analysis to women with a negative test ( opens the backdoor path between and was previously blocked by the collider and would be a mixture of the ass and the association due to the open back causation any more. We have described an example in w founder fails because it misleads invest when adjustment for such variable is no This problem arises because the standar founder, rather than that of confounding the structural definition first establishes t causes and then identifies the confoun confounding in the analysis. Confound causes of treatment and outcome either BIOS Confounding

14 7.4 Confounding and exchangeability How do DGs related to potential outcomes/counterfactuals? How does the structural definition of confounding relate to conditional exchangeability? Exchangeability a equivalent to no confoudning Conditional exchangability a equivalent to being a sufficient set for confounding adjustment (i.e., no unblocked backdoor paths) Single World Intervention Graphs (SWIGs) make this connection between potential outcomes and graphs explicit BIOS Confounding

15 P E[ =1 ] E[ =0 ]= ual confounding bias, depicted whose in the elimination causal diagram would require in Figure adj7 E[ = =1]Pr[ = ] variables. a healthy For brevity, workerwe bias. say that there is no unmeas P E[ = =0]Pr[ = ]. If conditioning on a set of variables (that are Clinical decisions: The effect of drug (say blocks all backdoor paths, then the treated and unt disease (say, stroke) will be confounded if th formal 7.4proof SWIGs of this result was within levels of, i.e., is a sufficient set for confo be prescribed to individuals with certain condit given by Pearl (2000). the previous section). To a non-mathematician suc that is both an indication for treatment and a r magical as there appears to be no obvious relationship Heart disease is a risk factor for stroke beca Recall Fig. 7.2 independences and the absence of back door paths bec effect on as in Figure 7.1 or, as in Figure 7.2 not included as variables on a causal graph. new are caused by atherosclerosis, an unmeasure SWIGs overcome the shortcomings World Intervention Graphs (SWIGs) seamlessly unif known as confounding by indication or channe of previously proposed twin causal graphical approaches by explicitly including the cou being reserved to describe the bias created by pa diagrams (Balke and Pearl 1994). the graph. The SWIG depicts the variables and causa that encourage doctors to use certain drug observed in a hypothetical world in which all subjects. Thatis,aSWIGisagraph ifestyle: The effect of behavior that represents (say, aexercis coun by a single death) intervention. will be confounded In contrast, if the a standard behavior is causa ass Figure 7.2 variables havior and causal (say, cigarette relations smoking) that are observed that has in a cau th The corresponding SWIGs is Fig. 7.7 can betoviewed co-occur as awith function. The that structure transforms of the a given varia given intervention. picted thethe causal following diagram examples in Figure describe 7.3, in t a a Suppose variable the causal represents diagram the sort in Figure of personality 7.2 repres an data. to The both SWIG lackinoffigure exercise 7.7and is asmoking. transformation nother o sents the clinical datadisease from a hypothetical resultsbothinlackofexercise intervention w thesametreatmentlevel. of clinical disease. This The form treatment of confoundin node is semicircles. reversethe causation. right semicircle encodes the treatmen semicircle encodes the value of that would have been Genetic factors: The effect of a DN sequence 7.3 of intervention. We use semicircles simply to remind t Figure 7.7 certain trait will be confounded if there exist variables were derived by splitting the treatment node The treatment node is split into two nodes. has a causal effect on and is more common a The is notleft a cause does node isnot the have an arrow into be This bias, also represented by the causal diagram same for all subjects. The outcome is as linkage disequilibrium or population,thevalue value of that would have stratifica 1 been observed instudy. thethe absence remainingof variables an are temporally prior being reserved to describe the bias arising from ables and take the same value as in the observati intervention, i.e., the factual in an observationalmixture of individuals from different ethnic gr exchangeability study can stand q holds because, on the SWI for ethnicity or other factors that a a and are blocked after conditioning on. sequences. Replace with potential outcome a Consider now the causal diagram in Figure 7.4 a 7.8. Marginal Social factors: exchangeability The effect of qincome holds at age because, 65 between at age 75 and will are be blocked confounded (without if the level conditioni of dis Progress! Now use the d-separation 2 rule to conclude conditional both future exchangeability income and disability q does level. notthis hold the path the causal diagram 1 in Figure is open Figure 7.8 conditioned on. This is why the marginal - assoc Environmental exposures: The effect of airborne conditional - association given is not, and thus BIOS the risk of coronary heart disease will be confo for results in bias. 7 Confounding These examples show how SWIGs whose levels co-vary with those of cause cor and graphical approaches. See also Fine Point 7.2.

16 7.4 SWIGs The SWIG for the M-bias example is 1 2 Figure 7.7 a Figure 7.8 a sents the data from a hypothetical inter thesametreatmentlevel. The treatm semicircles. The right semicircle encodes semicircle encodes the value of that wo of intervention. We use semicircles simpl variables were derived by splitting the tre is not a cause does not have an arro same for all subjects. The outcome is study. The remaining variables are tem ables and take the same value as in t exchangeability q holds because, and are blocked after conditioning on Consider now the causal diagram in 7.8. Marginal exchangeability q ho between and are blocked (withou conditional exchangeability q do the path 1 2 conditioned on. This is why the margin conditional - association given is no for results in bias. These examples show and graphical approaches. See also Fine Knowledge of the causal structure is tence of confounding and label a variable which variables need to be measured and ies, investigators measure many variable treated and the untreated are conditiona covariates. The underlying assumption may exist (confounding), the measured backdoor paths (no unmeasured confoun tee that the assumption of no unmeasur causal inference from observational data Marginal exchangeability a holds because the path between and a is blocked (unconditionally). Why? In contrast, conditional exchangeability a does not hold BIOS Confounding

17 Constructing a SWIG entails two steps this example. This failure can be verified by analyzing the SWIG in Figure 7.10, which has been set to the value. In this world, the factual variable is repl that is, the value of that would have been observed if if all subjects had receiv all paths 7.4from SWIGs to we conclude that q holds, but we cannot c q holds as is not even on the graph. (nder an FFRCISTG, any ind SWIG cannot be assumed to hold.) Therefore, we cannot ensure that the averag is identified from data on ( ). 1. Split intervention node or nodes 2. Replace all descendants of split nodes with potential outcomes E.g., the DG in Fig 7.9 becomes the SWIG in Fig 7.10 a Figure 7.9 a a There is a scientific consequence to t tional studies. Suppose you conducted a effect of heart transplant on death sured confounding given disease severity inferences from this observational study confounding. The critic is not making a Since the findings from any observationa viously true that those of your study can was to provide evidence about the short failed. His criticism is completely noninf a characteristic of observational research knew before the study was conducted. Figure 7.10 dditional conditions (e.g., no bias due to selection or measurement) arerequiredforvalidcausalinfer- To appropriately criticize your study engage in a truly scientific conversation experimental or observational findings th say something along the lines of the inf may be incorrect because of potential co c a common cause through which a back latter option provides you with a testabl unmeasured confounding. The burden o move is to try and adjust for smoking. BIOS Confounding

18 Fig SWIGs a Figure 7.9 a a effect of heart transplant on death sured confounding given disease severity inferences from this observational study confounding. The critic is not making a Since the findings from any observationa viously true that those of your study can was to provide evidence about the short failed. His criticism is completely noninf a characteristic of observational research knew before the study was conducted. Figure 7.10 dditional conditions (e.g., no bias due to selection or measurement) arerequiredforvalidcausalinference from observational data. But, unlike the expectation of no unmeasured confounding, these additional conditions may fail to hold in both observational studies and randomized experiments. To appropriately criticize your study engage in a truly scientific conversation experimental or observational findings th say something along the lines of the inf may be incorrect because of potential co a common cause through which a back latter option provides you with a testabl unmeasured confounding. The burden o move is to try and adjust for smoking. This example demonstrates that confounders cannot be descendants of treatment Note there is an open backdoor path from to a Conditioning on a blocks this backdoor path, implying a a The next section reviews the methods when, as in Figures , enough conf backdoor paths between treatment and o However we cannot make the same conclusion from the SWIG about the observable, i.e., that a, because is not on the graph n important point. We have referr all or nothing issue: either bias exists is important to consider the expected dir Fine Point 7.4. BIOS Confounding

19 7.4 Confounding and exchangeability Note that this structural definition of confounding as well as the construction of DGs or SWIGs relies on strong assumptions HR assert that knowledge of causal structure is a prerequisite to determine the existence of confounding Of course the assumption of no unmeasured confounding is never guaranteed to hold in an observational setting (there may always be some unmeasured common cause which creates a backdoor path not blocked by any set of measured covariates ) Causal inference from observational data is risky business BIOS Confounding

20 7.5 How to adjust for confounding Ideally, conduct a randomized experiment. Then there will be no common causes of exposure and treatment, no confounding, association is causality, etc. In observational studies, two sets of methods to adjust for confouding 1. G-methods: standardization ( 2), IP weighting ( 2), G-estimation ( 14) 2. Stratification based-methods: stratification/restriction ( 4.4), matching ( 4.5). BIOS Confounding

Supplement 2. Use of Directed Acyclic Graphs (DAGs)

Supplement 2. Use of Directed Acyclic Graphs (DAGs) Supplement 2. Use of Directed Acyclic Graphs (DAGs) Abstract This supplement describes how counterfactual theory is used to define causal effects and the conditions in which observed data can be used to

More information

Okayama University, Japan

Okayama University, Japan Directed acyclic graphs in Neighborhood and Health research (Social Epidemiology) Basile Chaix Inserm, France Etsuji Suzuki Okayama University, Japan Inference in n hood & health research N hood (neighborhood)

More information

Causal Inference in Statistics A primer, J. Pearl, M Glymur and N. Jewell

Causal Inference in Statistics A primer, J. Pearl, M Glymur and N. Jewell Causal Inference in Statistics A primer, J. Pearl, M Glymur and N. Jewell Rina Dechter Bren School of Information and Computer Sciences 6/7/2018 dechter, class 8, 276-18 The book of Why Pearl https://www.nytimes.com/2018/06/01/business/dealbook/revi

More information

Using directed acyclic graphs to guide analyses of neighbourhood health effects: an introduction

Using directed acyclic graphs to guide analyses of neighbourhood health effects: an introduction University of Michigan, Ann Arbor, Michigan, USA Correspondence to: Dr A V Diez Roux, Center for Social Epidemiology and Population Health, 3rd Floor SPH Tower, 109 Observatory St, Ann Arbor, MI 48109-2029,

More information

From Description to Causation

From Description to Causation From Description to Causation Department of Government London School of Economics and Political Science 1 Correlation vs. Causation 2 Over-Time Changes 3 Getting Systematic about Causality What makes something

More information

Studying the effect of change on change : a different viewpoint

Studying the effect of change on change : a different viewpoint Studying the effect of change on change : a different viewpoint Eyal Shahar Professor, Division of Epidemiology and Biostatistics, Mel and Enid Zuckerman College of Public Health, University of Arizona

More information

INTERPRETATION OF STUDY FINDINGS: PART I. Julie E. Buring, ScD Harvard School of Public Health Boston, MA

INTERPRETATION OF STUDY FINDINGS: PART I. Julie E. Buring, ScD Harvard School of Public Health Boston, MA INTERPRETATION OF STUDY FINDINGS: PART I Julie E. Buring, ScD Harvard School of Public Health Boston, MA Drawing Conclusions TRUTH IN THE UNIVERSE Infer TRUTH IN THE STUDY Infer FINDINGS IN THE STUDY Designing

More information

Evaluating the Causal Role of Unobserved Variables

Evaluating the Causal Role of Unobserved Variables Evaluating the Causal Role of Unobserved Variables Christian C. Luhmann (christian.luhmann@vanderbilt.edu) Department of Psychology, Vanderbilt University 301 Wilson Hall, Nashville, TN 37203 USA Woo-kyoung

More information

Causal Mediation Analysis with the CAUSALMED Procedure

Causal Mediation Analysis with the CAUSALMED Procedure Paper SAS1991-2018 Causal Mediation Analysis with the CAUSALMED Procedure Yiu-Fai Yung, Michael Lamm, and Wei Zhang, SAS Institute Inc. Abstract Important policy and health care decisions often depend

More information

Careful with Causal Inference

Careful with Causal Inference Careful with Causal Inference Richard Emsley Professor of Medical Statistics and Trials Methodology Department of Biostatistics & Health Informatics Institute of Psychiatry, Psychology & Neuroscience Correlation

More information

Control of Confounding in the Assessment of Medical Technology

Control of Confounding in the Assessment of Medical Technology International Journal of Epidemiology Oxford University Press 1980 Vol.9, No. 4 Printed in Great Britain Control of Confounding in the Assessment of Medical Technology SANDER GREENLAND* and RAYMOND NEUTRA*

More information

Challenges of Observational and Retrospective Studies

Challenges of Observational and Retrospective Studies Challenges of Observational and Retrospective Studies Kyoungmi Kim, Ph.D. March 8, 2017 This seminar is jointly supported by the following NIH-funded centers: Background There are several methods in which

More information

A Primer on Causality in Data Science

A Primer on Causality in Data Science A Primer on Causality in Data Science Hachem Saddiki and Laura B. Balzer January 10, 2019 arxiv:1809.02408v2 [stat.ap] 5 Mar 2019 Abstract Many questions in Data Science are fundamentally causal in that

More information

CHAPTER 4 RESEARCH METHODS (PP )

CHAPTER 4 RESEARCH METHODS (PP ) 1 Research 2 Methods Return CHAPTER 4 RESEARCH METHODS (PP. 104-127) Research Studies Hypothesis Ind/Dep Variable Int/Ext Validity Concepts Significance Statistical Case Study Corr Coeff Average Client

More information

Adjustments and their Consequences Collapsibility Analysis using Graphical Models

Adjustments and their Consequences Collapsibility Analysis using Graphical Models doi:10.1111/j.1751-5823.2011.00158.x Adjustments and their Consequences Collapsibility Analysis using Graphical Models TECHNICAL REPORT R-369 November 2011 Sander Greenland 1 and Judea Pearl 2 1 Departments

More information

Sensitivity Analysis in Observational Research: Introducing the E-value

Sensitivity Analysis in Observational Research: Introducing the E-value Sensitivity Analysis in Observational Research: Introducing the E-value Tyler J. VanderWeele Harvard T.H. Chan School of Public Health Departments of Epidemiology and Biostatistics 1 Plan of Presentation

More information

Lecture Notes Module 2

Lecture Notes Module 2 Lecture Notes Module 2 Two-group Experimental Designs The goal of most research is to assess a possible causal relation between the response variable and another variable called the independent variable.

More information

Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl

Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl Judea Pearl University of California, Los Angeles Computer Science Department Los

More information

Lecture II: Difference in Difference. Causality is difficult to Show from cross

Lecture II: Difference in Difference. Causality is difficult to Show from cross Review Lecture II: Regression Discontinuity and Difference in Difference From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

Collecting Data Example: Does aspirin prevent heart attacks?

Collecting Data Example: Does aspirin prevent heart attacks? Collecting Data In an experiment, the researcher controls or manipulates the environment of the individuals. The intent of most experiments is to study the effect of changes in the explanatory variable

More information

Doing After Seeing. Seeing vs. Doing in Causal Bayes Nets

Doing After Seeing. Seeing vs. Doing in Causal Bayes Nets Doing After Seeing Björn Meder (bmeder@uni-goettingen.de) York Hagmayer (york.hagmayer@bio.uni-goettingen.de) Michael R. Waldmann (michael.waldmann@bio.uni-goettingen.de) Department of Psychology, University

More information

UNIT 5 - Association Causation, Effect Modification and Validity

UNIT 5 - Association Causation, Effect Modification and Validity 5 UNIT 5 - Association Causation, Effect Modification and Validity Introduction In Unit 1 we introduced the concept of causality in epidemiology and presented different ways in which causes can be understood

More information

Temporalization In Causal Modeling. Jonathan Livengood & Karen Zwier TaCitS 06/07/2017

Temporalization In Causal Modeling. Jonathan Livengood & Karen Zwier TaCitS 06/07/2017 Temporalization In Causal Modeling Jonathan Livengood & Karen Zwier TaCitS 06/07/2017 Temporalization In Causal Modeling Jonathan Livengood & Karen Zwier TaCitS 06/07/2017 Introduction Causal influence,

More information

Simpson s Paradox and the implications for medical trials

Simpson s Paradox and the implications for medical trials Simpson s Paradox and the implications for medical trials Norman Fenton, Martin Neil and Anthony Constantinou 31 August 2015 Abstract This paper describes Simpson s paradox, and explains its serious implications

More information

EXPERIMENTAL RESEARCH DESIGNS

EXPERIMENTAL RESEARCH DESIGNS ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study

More information

III. WHAT ANSWERS DO YOU EXPECT?

III. WHAT ANSWERS DO YOU EXPECT? III. WHAT ANSWERS DO YOU EXPECT? IN THIS CHAPTER: Theories and Hypotheses: Definitions Similarities and Differences Why Theories Cannot be Verified The Importance of Theories Types of Hypotheses Hypotheses

More information

Brief introduction to instrumental variables. IV Workshop, Bristol, Miguel A. Hernán Department of Epidemiology Harvard School of Public Health

Brief introduction to instrumental variables. IV Workshop, Bristol, Miguel A. Hernán Department of Epidemiology Harvard School of Public Health Brief introduction to instrumental variables IV Workshop, Bristol, 2008 Miguel A. Hernán Department of Epidemiology Harvard School of Public Health Goal: To consistently estimate the average causal effect

More information

Bayesian (Belief) Network Models,

Bayesian (Belief) Network Models, Bayesian (Belief) Network Models, 2/10/03 & 2/12/03 Outline of This Lecture 1. Overview of the model 2. Bayes Probability and Rules of Inference Conditional Probabilities Priors and posteriors Joint distributions

More information

Addressing Inadequate Information on Important Health Factors in Pharmacoepidemiology Studies relying on Healthcare Databases

Addressing Inadequate Information on Important Health Factors in Pharmacoepidemiology Studies relying on Healthcare Databases Addressing Inadequate Information on Important Health Factors in Pharmacoepidemiology Studies relying on Healthcare Databases Efe Eworuke, Ph.D. Simone P. Pinheiro, Sc.D. M.Sc. Division of Epidemiology

More information

Causality and counterfactual analysis

Causality and counterfactual analysis Chapter 6.4 Causality and counterfactual analysis Daniel M. Hausman In chapter 6.2 of this book, Sander Greenland provides an introduction to contemporary views of causal inference (see also Pearl 2000)

More information

Structural Approach to Bias in Meta-analyses

Structural Approach to Bias in Meta-analyses Original Article Received 26 July 2011, Revised 22 November 2011, Accepted 12 December 2011 Published online 2 February 2012 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/jrsm.52 Structural

More information

Beyond the intention-to treat effect: Per-protocol effects in randomized trials

Beyond the intention-to treat effect: Per-protocol effects in randomized trials Beyond the intention-to treat effect: Per-protocol effects in randomized trials Miguel Hernán DEPARTMENTS OF EPIDEMIOLOGY AND BIOSTATISTICS Intention-to-treat analysis (estimator) estimates intention-to-treat

More information

2013/4/28. Experimental Research

2013/4/28. Experimental Research 2013/4/28 Experimental Research Definitions According to Stone (Research methods in organizational behavior, 1978, pp 118), a laboratory experiment is a research method characterized by the following:

More information

BOOTSTRAPPING CONFIDENCE LEVELS FOR HYPOTHESES ABOUT REGRESSION MODELS

BOOTSTRAPPING CONFIDENCE LEVELS FOR HYPOTHESES ABOUT REGRESSION MODELS BOOTSTRAPPING CONFIDENCE LEVELS FOR HYPOTHESES ABOUT REGRESSION MODELS 17 December 2009 Michael Wood University of Portsmouth Business School SBS Department, Richmond Building Portland Street, Portsmouth

More information

Understanding the Causal Logic of Confounds

Understanding the Causal Logic of Confounds Understanding the Causal Logic of Confounds Björn Meder (bmeder@uni-goettingen.de) York Hagmayer (york.hagmayer@bio.uni-goettingen.de) Michael R. Waldmann (michael.waldmann@bio.uni-goettingen.de) Department

More information

Graphical Representation of Missing Data Problems

Graphical Representation of Missing Data Problems TECHNICAL REPORT R-448 January 2015 Structural Equation Modeling: A Multidisciplinary Journal, 22: 631 642, 2015 Copyright Taylor & Francis Group, LLC ISSN: 1070-5511 print / 1532-8007 online DOI: 10.1080/10705511.2014.937378

More information

SRDC Technical Paper Series How Random Must Random Assignment Be in Random Assignment Experiments?

SRDC Technical Paper Series How Random Must Random Assignment Be in Random Assignment Experiments? SRDC Technical Paper Series 03-01 How Random Must Random Assignment Be in Random Assignment Experiments? Paul Gustafson Department of Statistics University of British Columbia February 2003 SOCIAL RESEARCH

More information

Lecture II: Difference in Difference and Regression Discontinuity

Lecture II: Difference in Difference and Regression Discontinuity Review Lecture II: Difference in Difference and Regression Discontinuity it From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

INVESTIGATING FIT WITH THE RASCH MODEL. Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form

INVESTIGATING FIT WITH THE RASCH MODEL. Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form INVESTIGATING FIT WITH THE RASCH MODEL Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form of multidimensionality. The settings in which measurement

More information

AUTHOR: Robert Gerst. Partner, Converge Consulting Group Inc. BIOGRAPHY:

AUTHOR: Robert Gerst. Partner, Converge Consulting Group Inc. BIOGRAPHY: AUTHOR: Robert Gerst Partner, rgerst@converge-group.com BIOGRAPHY: Robert Gerst is Partner in Charge of Operational Excellence and Research Methods at a Calgary based consulting practice. He is author

More information

Introduction. Step 2: Student Role - Your Plan of Action. Confounding. Good luck and have fun!

Introduction. Step 2: Student Role - Your Plan of Action. Confounding. Good luck and have fun! Confounding Introduction You have learned that random error and bias must be considered as possible explanations for an observed association between an exposure and disease. This week we will examine the

More information

t-test for r Copyright 2000 Tom Malloy. All rights reserved

t-test for r Copyright 2000 Tom Malloy. All rights reserved t-test for r Copyright 2000 Tom Malloy. All rights reserved This is the text of the in-class lecture which accompanied the Authorware visual graphics on this topic. You may print this text out and use

More information

Chapter 1 Introduction to Educational Research

Chapter 1 Introduction to Educational Research Chapter 1 Introduction to Educational Research The purpose of Chapter One is to provide an overview of educational research and introduce you to some important terms and concepts. My discussion in this

More information

The degree to which a measure is free from error. (See page 65) Accuracy

The degree to which a measure is free from error. (See page 65) Accuracy Accuracy The degree to which a measure is free from error. (See page 65) Case studies A descriptive research method that involves the intensive examination of unusual people or organizations. (See page

More information

Hoare Logic and Model Checking. LTL and CTL: a perspective. Learning outcomes. Model Checking Lecture 12: Loose ends

Hoare Logic and Model Checking. LTL and CTL: a perspective. Learning outcomes. Model Checking Lecture 12: Loose ends Learning outcomes Hoare Logic and Model Checking Model Checking Lecture 12: Loose ends Dominic Mulligan Based on previous slides by Alan Mycroft and Mike Gordon Programming, Logic, and Semantics Group

More information

Bayesian methods for combining multiple Individual and Aggregate data Sources in observational studies

Bayesian methods for combining multiple Individual and Aggregate data Sources in observational studies Bayesian methods for combining multiple Individual and Aggregate data Sources in observational studies Sara Geneletti Department of Epidemiology and Public Health Imperial College, London s.geneletti@imperial.ac.uk

More information

Keppel, G. & Wickens, T. D. Design and Analysis Chapter 10: Introduction to Factorial Designs

Keppel, G. & Wickens, T. D. Design and Analysis Chapter 10: Introduction to Factorial Designs Keppel, G. & Wickens, T. D. Design and nalysis Chapter : Introduction to Factorial Designs. asic Information from a Factorial Design a factorial design contains within it a set of separate single-factor

More information

efigure. Directed Acyclic Graph to Determine Whether Familial Factors Exist That Contribute to Both Eating Disorders and Suicide

efigure. Directed Acyclic Graph to Determine Whether Familial Factors Exist That Contribute to Both Eating Disorders and Suicide Supplementary Online Content Yao S, Kuja-Halkola R, Thornton LM, et al. Familial liability for eating s and suicide attempts: evidence from a population registry in Sweden. JAMA Psychiatry. Published online

More information

Confounding and DAGs. Causal inference

Confounding and DAGs. Causal inference ausality onfounding and AGs Klaus Kähler Holst 24 Jan 2017 So far we have developed statistical techniques to judge variation In order to establish whether or not and association between two variables

More information

Causal mediation analysis on survival data: an application on the National March Cohort

Causal mediation analysis on survival data: an application on the National March Cohort Università degli Studi di Milano - Bicocca FACOLTÀ DI SCIENZE STATISTICHE Corso di Dottorato di Ricerca in Statistica XXV ciclo Causal mediation analysis on survival data: an application on the National

More information

Econometric analysis and counterfactual studies in the context of IA practices

Econometric analysis and counterfactual studies in the context of IA practices Econometric analysis and counterfactual studies in the context of IA practices Giulia Santangelo http://crie.jrc.ec.europa.eu Centre for Research on Impact Evaluation DG EMPL - DG JRC CRIE Centre for Research

More information

Bayesian Networks in Medicine: a Model-based Approach to Medical Decision Making

Bayesian Networks in Medicine: a Model-based Approach to Medical Decision Making Bayesian Networks in Medicine: a Model-based Approach to Medical Decision Making Peter Lucas Department of Computing Science University of Aberdeen Scotland, UK plucas@csd.abdn.ac.uk Abstract Bayesian

More information

Chapter 11. Experimental Design: One-Way Independent Samples Design

Chapter 11. Experimental Design: One-Way Independent Samples Design 11-1 Chapter 11. Experimental Design: One-Way Independent Samples Design Advantages and Limitations Comparing Two Groups Comparing t Test to ANOVA Independent Samples t Test Independent Samples ANOVA Comparing

More information

Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies

Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies September 27, 2018 Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies A Case Study of Screening Colonoscopy Our Team Xabier Garcia

More information

Published online: 27 Jan 2015.

Published online: 27 Jan 2015. This article was downloaded by: [Cornell University Library] On: 23 February 2015, At: 11:27 Publisher: Routledge Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office:

More information

Analysis of Environmental Data Conceptual Foundations: En viro n m e n tal Data

Analysis of Environmental Data Conceptual Foundations: En viro n m e n tal Data Analysis of Environmental Data Conceptual Foundations: En viro n m e n tal Data 1. Purpose of data collection...................................................... 2 2. Samples and populations.......................................................

More information

Underlying Theory & Basic Issues

Underlying Theory & Basic Issues Underlying Theory & Basic Issues Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 All Too True 2 Validity In software engineering, we worry about various issues: E-Type systems: Usefulness is it doing what

More information

Recent advances in non-experimental comparison group designs

Recent advances in non-experimental comparison group designs Recent advances in non-experimental comparison group designs Elizabeth Stuart Johns Hopkins Bloomberg School of Public Health Department of Mental Health Department of Biostatistics Department of Health

More information

Chapter 3 Tools for Practical Theorizing: Theoretical Maps and Ecosystem Maps

Chapter 3 Tools for Practical Theorizing: Theoretical Maps and Ecosystem Maps Chapter 3 Tools for Practical Theorizing: Theoretical Maps and Ecosystem Maps Chapter Outline I. Introduction A. Understanding theoretical languages requires universal translators 1. Theoretical maps identify

More information

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research Chapter 11 Nonexperimental Quantitative Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) Nonexperimental research is needed because

More information

Audio: In this lecture we are going to address psychology as a science. Slide #2

Audio: In this lecture we are going to address psychology as a science. Slide #2 Psychology 312: Lecture 2 Psychology as a Science Slide #1 Psychology As A Science In this lecture we are going to address psychology as a science. Slide #2 Outline Psychology is an empirical science.

More information

EPI 200C Final, June 4 th, 2009 This exam includes 24 questions.

EPI 200C Final, June 4 th, 2009 This exam includes 24 questions. Greenland/Arah, Epi 200C Sp 2000 1 of 6 EPI 200C Final, June 4 th, 2009 This exam includes 24 questions. INSTRUCTIONS: Write all answers on the answer sheets supplied; PRINT YOUR NAME and STUDENT ID NUMBER

More information

Math for Liberal Arts MAT 110: Chapter 5 Notes

Math for Liberal Arts MAT 110: Chapter 5 Notes Math for Liberal Arts MAT 110: Chapter 5 Notes Statistical Reasoning David J. Gisch Fundamentals of Statistics Two Definitions of Statistics Statistics is the science of collecting, organizing, and interpreting

More information

Propensity Score Analysis Shenyang Guo, Ph.D.

Propensity Score Analysis Shenyang Guo, Ph.D. Propensity Score Analysis Shenyang Guo, Ph.D. Upcoming Seminar: April 7-8, 2017, Philadelphia, Pennsylvania Propensity Score Analysis 1. Overview 1.1 Observational studies and challenges 1.2 Why and when

More information

International Standard on Auditing (UK) 530

International Standard on Auditing (UK) 530 Standard Audit and Assurance Financial Reporting Council June 2016 International Standard on Auditing (UK) 530 Audit Sampling The FRC s mission is to promote transparency and integrity in business. The

More information

Confounding and Bias

Confounding and Bias 28 th International Conference on Pharmacoepidemiology and Therapeutic Risk Management Barcelona, Spain August 22, 2012 Confounding and Bias Tobias Gerhard, PhD Assistant Professor, Ernest Mario School

More information

Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015

Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015 Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015 Learning Objectives At the end of this confounding control overview, you will be able to: Understand how

More information

Miguel A. Hernán, 1 Sonia Hernández-Díaz, 2 Martha M. Werler, 2 and Allen A. MitcheIl 2

Miguel A. Hernán, 1 Sonia Hernández-Díaz, 2 Martha M. Werler, 2 and Allen A. MitcheIl 2 American Journal of Epidemiology Copyright 2002 by the Johns Hopkins Bloomberg School of Public Health All rights reserved Vol. 155, No. 2 Printed in U.S.A. Causal Knowledge and Confounding Evaluation

More information

Mining Medical Data for Causal and Temporal Patterns

Mining Medical Data for Causal and Temporal Patterns Mining Medical Data for Causal and Temporal Patterns Ahmed Y. Tawfik 1 and Krista Strickland 2 1 School of Computer Science, University of Windsor, Windsor, Ontario N9B 3P4, Canada atawfik@uwindsor.ca

More information

Why do Psychologists Perform Research?

Why do Psychologists Perform Research? PSY 102 1 PSY 102 Understanding and Thinking Critically About Psychological Research Thinking critically about research means knowing the right questions to ask to assess the validity or accuracy of a

More information

observational studies Descriptive studies

observational studies Descriptive studies form one stage within this broader sequence, which begins with laboratory studies using animal models, thence to human testing: Phase I: The new drug or treatment is tested in a small group of people for

More information

Confounded: Causal Inference and the Requirement of Independence

Confounded: Causal Inference and the Requirement of Independence Confounded: Causal Inference and the Requirement of Independence Christian C. Luhmann (christian.luhmann@vanderbilt.edu) Department of Psychology, 2 Hillhouse Ave New Haven, CT 06511 USA Abstract One of

More information

Carrying out an Empirical Project

Carrying out an Empirical Project Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric

More information

Trial designs fully integrating biomarker information for the evaluation of treatment-effect mechanisms in stratified medicine

Trial designs fully integrating biomarker information for the evaluation of treatment-effect mechanisms in stratified medicine Trial designs fully integrating biomarker information for the evaluation of treatment-effect mechanisms in stratified medicine Dr Richard Emsley Centre for Biostatistics, Institute of Population Health,

More information

Measurement. Reliability vs. Validity. Reliability vs. Validity

Measurement. Reliability vs. Validity. Reliability vs. Validity MEASUREMENT Outline 1. Measurement - Reliability vs. Validity - Validity - Threats to Internal Validity - Construct Validity (measurement validity) - Face validity - Content validity - Predictive validity

More information

Intro to SPSS. Using SPSS through WebFAS

Intro to SPSS. Using SPSS through WebFAS Intro to SPSS Using SPSS through WebFAS http://www.yorku.ca/computing/students/labs/webfas/ Try it early (make sure it works from your computer) If you need help contact UIT Client Services Voice: 416-736-5800

More information

Applied mediation analysis - basics

Applied mediation analysis - basics Applied mediation analysis - basics Copenhagen, April 2013 Course homepage: www.biostat.ku.dk/thla + link to the left. Theis Lange Department of Biostatistics Faculty of Health and Medical Sciences Dias

More information

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA PharmaSUG 2014 - Paper SP08 Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA ABSTRACT Randomized clinical trials serve as the

More information

V. Gathering and Exploring Data

V. Gathering and Exploring Data V. Gathering and Exploring Data With the language of probability in our vocabulary, we re now ready to talk about sampling and analyzing data. Data Analysis We can divide statistical methods into roughly

More information

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research 2012 CCPRC Meeting Methodology Presession Workshop October 23, 2012, 2:00-5:00 p.m. Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy

More information

Student Performance Q&A:

Student Performance Q&A: Student Performance Q&A: 2009 AP Statistics Free-Response Questions The following comments on the 2009 free-response questions for AP Statistics were written by the Chief Reader, Christine Franklin of

More information

A Brief Introduction to Bayesian Statistics

A Brief Introduction to Bayesian Statistics A Brief Introduction to Statistics David Kaplan Department of Educational Psychology Methods for Social Policy Research and, Washington, DC 2017 1 / 37 The Reverend Thomas Bayes, 1701 1761 2 / 37 Pierre-Simon

More information

Bayesian graphical models for combining multiple data sources, with applications in environmental epidemiology

Bayesian graphical models for combining multiple data sources, with applications in environmental epidemiology Bayesian graphical models for combining multiple data sources, with applications in environmental epidemiology Sylvia Richardson 1 sylvia.richardson@imperial.co.uk Joint work with: Alexina Mason 1, Lawrence

More information

Representation and Analysis of Medical Decision Problems with Influence. Diagrams

Representation and Analysis of Medical Decision Problems with Influence. Diagrams Representation and Analysis of Medical Decision Problems with Influence Diagrams Douglas K. Owens, M.D., M.Sc., VA Palo Alto Health Care System, Palo Alto, California, Section on Medical Informatics, Department

More information

TRIPLL Webinar: Propensity score methods in chronic pain research

TRIPLL Webinar: Propensity score methods in chronic pain research TRIPLL Webinar: Propensity score methods in chronic pain research Felix Thoemmes, PhD Support provided by IES grant Matching Strategies for Observational Studies with Multilevel Data in Educational Research

More information

Lecture 9 Internal Validity

Lecture 9 Internal Validity Lecture 9 Internal Validity Objectives Internal Validity Threats to Internal Validity Causality Bayesian Networks Internal validity The extent to which the hypothesized relationship between 2 or more variables

More information

ACCTG 533, Section 1: Module 2: Causality and Measurement: Lecture 1: Performance Measurement and Causality

ACCTG 533, Section 1: Module 2: Causality and Measurement: Lecture 1: Performance Measurement and Causality ACCTG 533, Section 1: Module 2: Causality and Measurement: Lecture 1: Performance Measurement and Causality Performance Measurement and Causality Performance Measurement and Causality: We ended before

More information

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera Homework assignment topics 37-42 Georgina Salas Topics 37-42 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 37 1. What is the purpose of an experiment? The purpose of an experiment is to explore

More information

PÄIVI KARHU THE THEORY OF MEASUREMENT

PÄIVI KARHU THE THEORY OF MEASUREMENT PÄIVI KARHU THE THEORY OF MEASUREMENT AGENDA 1. Quality of Measurement a) Validity Definition and Types of validity Assessment of validity Threats of Validity b) Reliability True Score Theory Definition

More information

W e have previously described the disease impact

W e have previously described the disease impact 606 THEORY AND METHODS Impact numbers: measures of risk factor impact on the whole population from case-control and cohort studies R F Heller, A J Dobson, J Attia, J Page... See end of article for authors

More information

Epidemiological study design. Paul Pharoah Department of Public Health and Primary Care

Epidemiological study design. Paul Pharoah Department of Public Health and Primary Care Epidemiological study design Paul Pharoah Department of Public Health and Primary Care Molecules What/why? Organelles Cells Tissues Organs Clinical medicine Individuals Public health medicine Populations

More information

Quantification of collider-stratification bias and the birthweight paradox

Quantification of collider-stratification bias and the birthweight paradox University of Massachusetts Amherst From the SelectedWorks of Brian W. Whitcomb 2009 Quantification of collider-stratification bias and the birthweight paradox Brian W Whitcomb, University of Massachusetts

More information

Can you guarantee that the results from your observational study are unaffected by unmeasured confounding? H.Hosseini

Can you guarantee that the results from your observational study are unaffected by unmeasured confounding? H.Hosseini Instrumental Variable (Instrument) applications in Epidemiology: An Introduction Hamed Hosseini Can you guarantee that the results from your observational study are unaffected by unmeasured confounding?

More information

Analysis A step in the research process that involves describing and then making inferences based on a set of data.

Analysis A step in the research process that involves describing and then making inferences based on a set of data. 1 Appendix 1:. Definitions of important terms. Additionality The difference between the value of an outcome after the implementation of a policy, and its value in a counterfactual scenario in which the

More information

The Regression-Discontinuity Design

The Regression-Discontinuity Design Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations

More information

Functionalist theories of content

Functionalist theories of content Functionalist theories of content PHIL 93507 April 22, 2012 Let s assume that there is a certain stable dependence relation between the physical internal states of subjects and the phenomenal characters

More information

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis

Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard

More information

IAASB Main Agenda (February 2007) Page Agenda Item PROPOSED INTERNATIONAL STANDARD ON AUDITING 530 (REDRAFTED)

IAASB Main Agenda (February 2007) Page Agenda Item PROPOSED INTERNATIONAL STANDARD ON AUDITING 530 (REDRAFTED) IAASB Main Agenda (February 2007) Page 2007 423 Agenda Item 6-A PROPOSED INTERNATIONAL STANDARD ON AUDITING 530 (REDRAFTED) AUDIT SAMPLING AND OTHER MEANS OF TESTING CONTENTS Paragraph Introduction Scope

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

Objectives. Quantifying the quality of hypothesis tests. Type I and II errors. Power of a test. Cautions about significance tests

Objectives. Quantifying the quality of hypothesis tests. Type I and II errors. Power of a test. Cautions about significance tests Objectives Quantifying the quality of hypothesis tests Type I and II errors Power of a test Cautions about significance tests Designing Experiments based on power Evaluating a testing procedure The testing

More information