Confounding and Effect Modification

Size: px
Start display at page:

Download "Confounding and Effect Modification"

Transcription

1 Confounding and Effect Modification Karen Bandeen-Roche, Ph.D. Hurley-Dorrier Chair and Professor of Biostatistics July 17, 2012 JHU Intro to Clinical Research 1 Outline 1. Causal inference: comparing otherwise similar populations 2. Confounding is confusing 3. Graphical representation of causation 4. Addressing confounding 5. Effect modification JHU Intro to Clinical Research 2 Counterfactual Data Table Person Drug Y(0) Y(1) Y(1)-Y(0) Average JHU Intro to Clinical Research 3 1

2 Actual Data Table Person Drug Y(0) Y(1) Y(1)-Y(0) ?? ?? ?? 4 1? 18? 5 1? 16? 6 1? 14? Average JHU Intro to Clinical Research 4 Goal of Statistical Causal Inference Fill-in missing information in the counterfactual data table Use data for persons receiving the other treatment to fill-in a persons missing outcome Inherent assumption that the other persons are similar except for the treatment: otherwise similar Compare like-to-like JHU Intro to Clinical Research 5 Confounding Confound means to confuse When the comparison is between groups that are otherwise not similar in ways that affect the outcome Simpson s paradox; lurking variables,. JHU Intro to Clinical Research 6 2

3 Confounding Example: Drowning and Ice Cream Consumption Drowning rate JHU Intro to Clinical Research Ice Cream consumption 7 Confounding Epidemiology definition: A characteristic C is a confounder if it is associated (related) with both the outcome (Y: drowning) and the risk factor (X: ice cream) and is not causally in between Ice Cream Consumption Drowning rate?? JHU Intro to Clinical Research 8 Confounding Statistical definition: A characteristic C is a confounder if the strength of relationship between the outcome (Y: drowning) and the risk factor (X: ice cream) differs with, versus without, adjustment for C Ice Cream Consumption Drowning rate Outdoor Temperature JHU Intro to Clinical Research 9 3

4 Confounding Example: Drowning and Ice Cream Consumption Drowning rate Cool temperature Warm temperature JHU Intro to Clinical Research Ice Cream consumption 10 Mediation A characteristic M is a mediator if it is causally in the pathway by which the risk factor (X: ice cream) leads the outcome (Y: drowning) Ice Cream Consumption Drowning rate Cramping JHU Intro to Clinical Research 11 Confounding Statistical definition: A characteristic C is a confounder if the strength of relationship between the outcome and the risk factor differs with, versus without, comparing like to like on C Thought example: Outcome = remaining lifespan Risk factor = # diseases Confounder = age JHU Intro to Clinical Research 12 4

5 Example: Graduate School Admissions UC Berkeley Number Percent Applied Male Female JHU Intro to Clinical Research 13 Number Males Applied Number Males Male % Female % Number Females Number Females Applied A B C D Total JHU Intro to Clinical Research 14 Percent Admitted Percent Male Applicants Percent Female Applicants A B C D Total July 2010 JHU Intro to Clinical Research 15 5

6 JHU Intro to Clinical Research 16 What is the lurking variable causing admissions rates to be lower in departments to which more women apply? Gender Admission?? JHU Intro to Clinical Research 17 What is the lurking variable causing admissions rates to be lower in departments to which more women apply? Gender Admission Department to which applied JHU Intro to Clinical Research 18 6

7 Number Males Applied Number Males Male % Female Male % Female % Number Females Number Females Applied A B C D Total JHU Intro to Clinical Research 19 in admission rates between women and men: in admission rates between women and men: July 2010 JHU Intro to Clinical Research 20 Now for something entirely different Particulate air pollution and mortality JHU Intro to Clinical Research 21 7

8 Chicago Los Angeles July 2010 Correlation: Daily mortality and PM 10 New York Chicago Los Angeles Is season confounding the correlation between PM 10 and mortality? What would happen if we removed season from the analysis? 8

9 Season-specific correlations All Year Winter Spring Summer Fall NY Chicago LA Overall association for New York 9

10 10

11 Season-specific associations are positive, overall association is negative Overall correlations All Year Average over Seasons New York Chicago LA Overall correlations All Year Unadjusted Average 4 within-season values Adjusted Average 12 within month values Adjusted New York Chicago LA

12 Effect modification A characteristic E is an effect modifier if the strength of relationship between the outcome (Y: drowning) and the risk factor (X: ice cream) differs within levels of E Ice Cream Consumption Drowning rate Outdoor temperature JHU Intro to Clinical Research 34 Effect Modification Example: Drowning and Ice Cream Consumption Drowning rate Cool temperature Warm temperature JHU Intro to Clinical Research Ice Cream consumption 35 Question: Does aspirin use modify the association between treatment and adverse outcomes? 36 12

13 July 2008 JHU Intro to Clinical Research 37 JHU Intro to Clinical Research 38 JHU Intro to Clinical Research 39 13

14 Aspirin use modifies the effect of treatment on the risk of stroke? Losartan vs- Atenolol Stroke Aspirin Use JHU Intro to Clinical Research 40 Summary 1. Causal inference: comparing otherwise similar populations 2. Confounding means confusing: comparing otherwise groups 3. Stratify by confounders and make comparisons within strata, then pool results across strata to avoid the effects of confounding 4. Effect modification when the treatment effect varies by stratum of another variable JHU Intro to Clinical Research 41 14

Acknowledgements. Section 1: The Science of Clinical Investigation. Scott Zeger. Marie Diener-West. ICTR Leadership / Team

Acknowledgements. Section 1: The Science of Clinical Investigation. Scott Zeger. Marie Diener-West. ICTR Leadership / Team INTRODUCTION TO CLINICAL RESEARCH Scientific Concepts for Clinical Research Karen Bandeen-Roche, Ph.D. July 15, 2013 Scott Zeger Acknowledgements Marie Diener-West ICTR Leadership / Team July 2013 JHU

More information

Confounding and Effect Modification. John McGready Johns Hopkins University

Confounding and Effect Modification. John McGready Johns Hopkins University This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Unit 8 Day 1 Correlation Coefficients.notebook January 02, 2018

Unit 8 Day 1 Correlation Coefficients.notebook January 02, 2018 [a] Welcome Back! Please pick up a new packet Get a Chrome Book Complete the warm up Choose points on each graph and find the slope of the line. [b] Agenda 05 MIN Warm Up 25 MIN Notes Correlation 15 MIN

More information

Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl

Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl Judea Pearl University of California, Los Angeles Computer Science Department Los

More information

3.4 What are some cautions in analyzing association?

3.4 What are some cautions in analyzing association? 3.4 What are some cautions in analyzing association? Objectives Extrapolation Outliers and Influential Observations Correlation does not imply causation Lurking variables and confounding Simpson s Paradox

More information

10. Introduction to Multivariate Relationships

10. Introduction to Multivariate Relationships 10. Introduction to Multivariate Relationships Bivariate analyses are informative, but we usually need to take into account many variables. Many explanatory variables have an influence on any particular

More information

Section 1: The Science of Clinical Investigation

Section 1: The Science of Clinical Investigation INTRODUCTION TO CLINICAL RESEARCH Scientific Concepts for Clinical Research Scott L. Zeger, Ph.D. July 14, 2014 Section 1: The Science of Clinical Investigation 1. Platonic model: science as the search

More information

Lecture 9 Internal Validity

Lecture 9 Internal Validity Lecture 9 Internal Validity Objectives Internal Validity Threats to Internal Validity Causality Bayesian Networks Internal validity The extent to which the hypothesized relationship between 2 or more variables

More information

Biostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras

Biostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras Biostatistics and Design of Experiments Prof Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras Lecture 02 Experimental Design Strategy Welcome back to the course on Biostatistics

More information

Confounding Bias: Stratification

Confounding Bias: Stratification OUTLINE: Confounding- cont. Generalizability Reproducibility Effect modification Confounding Bias: Stratification Example 1: Association between place of residence & Chronic bronchitis Residence Chronic

More information

Stratified Tables. Example: Effect of seat belt use on accident fatality

Stratified Tables. Example: Effect of seat belt use on accident fatality Stratified Tables Often, a third measure influences the relationship between the two primary measures (i.e. disease and exposure). How do we remove or control for the effect of the third measure? Issues

More information

Lecture Outline. Biost 517 Applied Biostatistics I. Purpose of Descriptive Statistics. Purpose of Descriptive Statistics

Lecture Outline. Biost 517 Applied Biostatistics I. Purpose of Descriptive Statistics. Purpose of Descriptive Statistics Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 3: Overview of Descriptive Statistics October 3, 2005 Lecture Outline Purpose

More information

Overview of Key Ozone Epidemiology Literature

Overview of Key Ozone Epidemiology Literature Overview of Key Ozone Epidemiology Literature Julie E. Goodman, Ph.D., DABT, ACE, ATS Ozone Webinar Texas Commission on Environmental Quality March 20, 2015 Epidemiology The study of the causes, distribution,

More information

4.2: Experiments. SAT Survey vs. SAT. Experiment. Confounding Variables. Section 4.2 Experiments. Observational Study vs.

4.2: Experiments. SAT Survey vs. SAT. Experiment. Confounding Variables. Section 4.2 Experiments. Observational Study vs. 4.2: s SAT Survey vs. SAT Describe a survey and an experiment that can be used to determine the relationship between SAT scores and hours studied? Section 4.2 s After this section, you should be able to

More information

Main objective of Epidemiology. Statistical Inference. Statistical Inference: Example. Statistical Inference: Example

Main objective of Epidemiology. Statistical Inference. Statistical Inference: Example. Statistical Inference: Example Main objective of Epidemiology Inference to a population Example: Treatment of hypertension: Research question (hypothesis): Is treatment A better than treatment B for patients with hypertension? Study

More information

How Bad Data Analyses Can Sabotage Discrimination Cases

How Bad Data Analyses Can Sabotage Discrimination Cases How Bad Data Analyses Can Sabotage Discrimination Cases By Mike Nguyen; Analysis Group, Inc. Law360, New York (December 15, 2016) Mike Nguyen When Mark Twain popularized the phrase, there are three kinds

More information

Estimating indirect and direct effects of a Cancer of Unknown Primary (CUP) diagnosis on survival for a 6 month-period after diagnosis.

Estimating indirect and direct effects of a Cancer of Unknown Primary (CUP) diagnosis on survival for a 6 month-period after diagnosis. Estimating indirect and direct effects of a Cancer of Unknown Primary (CUP) diagnosis on survival for a 6 month-period after diagnosis. A Manuscript prepared in Fulfillment of a B.S Honors Thesis in Statistics

More information

Lecture 4. Confounding

Lecture 4. Confounding Lecture 4 Confounding Learning Objectives In this set of lectures we will: - Formally define confounding and give explicit examples of it s impact - Define adjustment and adjusted estimates conceptually

More information

A teaching presentation to help general psychology students overcome the common misconception that correlation equals causation

A teaching presentation to help general psychology students overcome the common misconception that correlation equals causation A teaching presentation to help general psychology students overcome the common misconception that correlation equals causation 1 Original A teaching presentation to help general psychology students overcome

More information

Causal Inference in Statistics A primer, J. Pearl, M Glymur and N. Jewell

Causal Inference in Statistics A primer, J. Pearl, M Glymur and N. Jewell Causal Inference in Statistics A primer, J. Pearl, M Glymur and N. Jewell Rina Dechter Bren School of Information and Computer Sciences 6/7/2018 dechter, class 8, 276-18 The book of Why Pearl https://www.nytimes.com/2018/06/01/business/dealbook/revi

More information

Epidemiologic Methods I & II Epidem 201AB Winter & Spring 2002

Epidemiologic Methods I & II Epidem 201AB Winter & Spring 2002 DETAILED COURSE OUTLINE Epidemiologic Methods I & II Epidem 201AB Winter & Spring 2002 Hal Morgenstern, Ph.D. Department of Epidemiology UCLA School of Public Health Page 1 I. THE NATURE OF EPIDEMIOLOGIC

More information

AMS 5 EXPERIMENTAL DESIGN

AMS 5 EXPERIMENTAL DESIGN AMS 5 EXPERIMENTAL DESIGN Controlled Experiment Suppose a new drug is introduced, how do we gather evidence that it is effective to treat a given disease? The key idea is comparison. A group of patients

More information

HEAT GUIDELINES HEAT RELATED ILLNESS

HEAT GUIDELINES HEAT RELATED ILLNESS Heat-related illnesses, such as heat stroke and heat exhaustion can be serious and potentially life-threatening conditions. U.S. Soccer s RECOGNIZE TO RECOVER program prepared this guide for coaches, referees

More information

BIOSTATISTICAL METHODS

BIOSTATISTICAL METHODS BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH PROPENSITY SCORE Confounding Definition: A situation in which the effect or association between an exposure (a predictor or risk factor) and

More information

What is Statistics? (*) Collection of data Experiments and Observational studies. (*) Summarizing data Descriptive statistics.

What is Statistics? (*) Collection of data Experiments and Observational studies. (*) Summarizing data Descriptive statistics. What is Statistics? The science of collecting, summarizing and analyzing data. In particular, Statistics is concerned with drawing inferences from a sample about the population from which the sample was

More information

M 140 Test 1 A Name SHOW YOUR WORK FOR FULL CREDIT! Problem Max. Points Your Points Total 60

M 140 Test 1 A Name SHOW YOUR WORK FOR FULL CREDIT! Problem Max. Points Your Points Total 60 M 140 Test 1 A Name SHOW YOUR WORK FOR FULL CREDIT! Problem Max. Points Your Points 1-10 10 11 3 12 4 13 3 14 10 15 14 16 10 17 7 18 4 19 4 Total 60 Multiple choice questions (1 point each) For questions

More information

Simpson s Paradox and the implications for medical trials

Simpson s Paradox and the implications for medical trials Simpson s Paradox and the implications for medical trials Norman Fenton, Martin Neil and Anthony Constantinou 31 August 2015 Abstract This paper describes Simpson s paradox, and explains its serious implications

More information

Judea Pearl. Cognitive Systems Laboratory. Computer Science Department. University of California, Los Angeles, CA

Judea Pearl. Cognitive Systems Laboratory. Computer Science Department. University of California, Los Angeles, CA THREE STATISTICAL PUZZLES Judea Pearl Cognitive Systems Laboratory Computer Science Department University of California, Los Angeles, CA 90024 judea@cs.ucla.edu Preface The puzzles in this note are meant

More information

Triggering of Ischemic Stroke Onset by Decreased Temperature: A case-crossover study

Triggering of Ischemic Stroke Onset by Decreased Temperature: A case-crossover study Triggering of Ischemic Stroke Onset by Decreased Temperature: A case-crossover study Yun-Chul Hong, MD, PhD, 1 Joung-Ho Rha, MD 2, Jong-Tae Lee, PhD 3, Ho-Jang Kwon, MD, PhD 4, Eun-Hee Ha, MD, PhD 5, Chang-Kiu

More information

What is Data? Part 2: Patterns & Associations. INFO-1301, Quantitative Reasoning 1 University of Colorado Boulder

What is Data? Part 2: Patterns & Associations. INFO-1301, Quantitative Reasoning 1 University of Colorado Boulder What is Data? Part 2: Patterns & Associations INFO-1301, Quantitative Reasoning 1 University of Colorado Boulder August 29, 2016 Prof. Michael Paul Prof. William Aspray Overview This lecture will look

More information

So You Want to do a Survey?

So You Want to do a Survey? Institute of Nuclear Power Operations So You Want to do a Survey? G. Kenneth Koves Ph.D. NAECP Conference, Austin TX 2015 September 29 1 Who am I? Ph.D. in Industrial/Organizational Psychology from Georgia

More information

Geographic Data Science - Lecture IX

Geographic Data Science - Lecture IX Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference & strategies to overcome them

More information

Understanding Confounding in Research Kantahyanee W. Murray and Anne Duggan. DOI: /pir

Understanding Confounding in Research Kantahyanee W. Murray and Anne Duggan. DOI: /pir Understanding Confounding in Research Kantahyanee W. Murray and Anne Duggan Pediatr. Rev. 2010;31;124-126 DOI: 10.1542/pir.31-3-124 The online version of this article, along with updated information and

More information

Math 140 Introductory Statistics

Math 140 Introductory Statistics Math 140 Introductory Statistics Professor Silvia Fernández Sample surveys and experiments Most of what we ve done so far is data exploration ways to uncover, display, and describe patterns in data. Unfortunately,

More information

CURRICULUM VITAE Hong Zhu

CURRICULUM VITAE Hong Zhu CURRICULUM VITAE Hong Zhu 615 N. Wolfe Street, E3031 Home Address 4008 Linkwood Rd Apt C Baltimore, MD 21210 Phone: (410) 608-1183 Email: hongzhu@jhsph.edu Webpage: http://www.biostat.jhsph.edu/~hongzhu

More information

Introduction. Lecture 1. What is Statistics?

Introduction. Lecture 1. What is Statistics? Lecture 1 Introduction What is Statistics? Statistics is the science of collecting, organizing and interpreting data. The goal of statistics is to gain information and understanding from data. A statistic

More information

STAT 201 Chapter 3. Association and Regression

STAT 201 Chapter 3. Association and Regression STAT 201 Chapter 3 Association and Regression 1 Association of Variables Two Categorical Variables Response Variable (dependent variable): the outcome variable whose variation is being studied Explanatory

More information

PubH 7405: REGRESSION ANALYSIS. Propensity Score

PubH 7405: REGRESSION ANALYSIS. Propensity Score PubH 7405: REGRESSION ANALYSIS Propensity Score INTRODUCTION: There is a growing interest in using observational (or nonrandomized) studies to estimate the effects of treatments on outcomes. In observational

More information

STATS Relationships between variables: Correlation

STATS Relationships between variables: Correlation STATS 1060 Relationships between variables: Correlation READINGS: Chapter 7 of your text book (DeVeaux, Vellman and Bock); on-line notes for correlation; on-line practice problems for correlation NOTICE:

More information

Causation. Victor I. Piercey. October 28, 2009

Causation. Victor I. Piercey. October 28, 2009 October 28, 2009 What does a high correlation mean? If you have high correlation, can you necessarily infer causation? What issues can arise? What does a high correlation mean? If you have high correlation,

More information

Genetics, epigenetics, and Mendelian randomization: cuttingedge tools for causal inference in epidemiology

Genetics, epigenetics, and Mendelian randomization: cuttingedge tools for causal inference in epidemiology Genetics, epigenetics, and Mendelian randomization: cuttingedge tools for causal inference in epidemiology COURSE DURATION This is an online distance learning course. Material will be available June 1st

More information

Unit 1 Exploring and Understanding Data

Unit 1 Exploring and Understanding Data Unit 1 Exploring and Understanding Data Area Principle Bar Chart Boxplot Conditional Distribution Dotplot Empirical Rule Five Number Summary Frequency Distribution Frequency Polygon Histogram Interquartile

More information

Estimating Direct Effects of New HIV Prevention Methods. Focus: the MIRA Trial

Estimating Direct Effects of New HIV Prevention Methods. Focus: the MIRA Trial Estimating Direct Effects of New HIV Prevention Methods. Focus: the MIRA Trial Michael Rosenblum UCSF: Helen Cheng, Nancy Padian, Steve Shiboski, Ariane van der Straten Berkeley: Nicholas P. Jewell, Mark

More information

Designed Experiments have developed their own terminology. The individuals in an experiment are often called subjects.

Designed Experiments have developed their own terminology. The individuals in an experiment are often called subjects. When we wish to show a causal relationship between our explanatory variable and the response variable, a well designed experiment provides the best option. Here, we will discuss a few basic concepts and

More information

Chapter 3. Producing Data

Chapter 3. Producing Data Chapter 3. Producing Data Introduction Mostly data are collected for a specific purpose of answering certain questions. For example, Is smoking related to lung cancer? Is use of hand-held cell phones associated

More information

Summer AP Statistic. Chapter 4 : Sampling and Surveys: Read What s the difference between a population and a sample?

Summer AP Statistic. Chapter 4 : Sampling and Surveys: Read What s the difference between a population and a sample? Chapter 4 : Sampling and Surveys: Read 207-208 Summer AP Statistic What s the difference between a population and a sample? Alternate Example: Identify the population and sample in each of the following

More information

General Biostatistics Concepts

General Biostatistics Concepts General Biostatistics Concepts Dongmei Li Department of Public Health Sciences Office of Public Health Studies University of Hawai i at Mānoa Outline 1. What is Biostatistics? 2. Types of Measurements

More information

Choosing Research Designs II. Nonexperimental Methods

Choosing Research Designs II. Nonexperimental Methods Choosing Research Designs II Nonexperimental Methods The Purpose of Control Variables We use control variables to account for possible alternative explanations we can think of. For example, when I examined

More information

UNIT 5 - Association Causation, Effect Modification and Validity

UNIT 5 - Association Causation, Effect Modification and Validity 5 UNIT 5 - Association Causation, Effect Modification and Validity Introduction In Unit 1 we introduced the concept of causality in epidemiology and presented different ways in which causes can be understood

More information

STATISTICS INFORMED DECISIONS USING DATA

STATISTICS INFORMED DECISIONS USING DATA STATISTICS INFORMED DECISIONS USING DATA Fifth Edition Chapter 4 Describing the Relation between Two Variables 4.1 Scatter Diagrams and Correlation Learning Objectives 1. Draw and interpret scatter diagrams

More information

CHAPTER 4 Designing Studies

CHAPTER 4 Designing Studies CHAPTER 4 Designing Studies 4.2 Experiments The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers Experiments Learning Objectives After this section, you

More information

Preventing Heat Stress on the Golf Course

Preventing Heat Stress on the Golf Course How to Protect Employees from Heat Stress Preventing Heat Stress on the Golf Course Heat stress and heat related illnesses are a major concern in golf maintenance, especially during the hot summer months.

More information

Assessing the impact of unmeasured confounding: confounding functions for causal inference

Assessing the impact of unmeasured confounding: confounding functions for causal inference Assessing the impact of unmeasured confounding: confounding functions for causal inference Jessica Kasza jessica.kasza@monash.edu Department of Epidemiology and Preventive Medicine, Monash University Victorian

More information

Sampling. (James Madison University) January 9, / 13

Sampling. (James Madison University) January 9, / 13 Sampling The population is the entire group of individuals about which we want information. A sample is a part of the population from which we actually collect information. A sampling design describes

More information

Using directed acyclic graphs to guide analyses of neighbourhood health effects: an introduction

Using directed acyclic graphs to guide analyses of neighbourhood health effects: an introduction University of Michigan, Ann Arbor, Michigan, USA Correspondence to: Dr A V Diez Roux, Center for Social Epidemiology and Population Health, 3rd Floor SPH Tower, 109 Observatory St, Ann Arbor, MI 48109-2029,

More information

Study Methodology: Tricks and Traps

Study Methodology: Tricks and Traps Study Methodology: Tricks and Traps Designed Experiments Observational Studies Weighted Averages 1 1. DEs and OSs Chapters 1 and 2 contrast designed experiments (DEs) with observational studies (OSs).

More information

ONLINE MATERIAL THAT ACCOMPANIES CHAPTER 11. Box 1. Assessing additive interaction using ratio measures

ONLINE MATERIAL THAT ACCOMPANIES CHAPTER 11. Box 1. Assessing additive interaction using ratio measures ONLINE MATERIAL THAT ACCOMPANIES CHAPTER 11 Box 1. Assessing additive interaction using ratio measures Often times we may not be able to estimate risk or rate differences when assessing interaction. For

More information

CS 520 Theory and Practice of Software Engineering Fall 2017

CS 520 Theory and Practice of Software Engineering Fall 2017 CS 520 Theory and Practice of Software Engineering Fall 2017 Experimental design and validity October 12, 2017 Today The scientific method. Internal, external, and construct validity. Reasoning about two

More information

Confounding. Confounding and effect modification. Example (after Rothman, 1998) Beer and Rectal Ca. Confounding (after Rothman, 1998)

Confounding. Confounding and effect modification. Example (after Rothman, 1998) Beer and Rectal Ca. Confounding (after Rothman, 1998) Confounding Confounding and effect modification Epidemiology 511 W. A. Kukull vember 23 2004 A function of the complex interrelationships between various exposures and disease. Occurs when the disease

More information

Descriptive Methods: Correlation

Descriptive Methods: Correlation LP 1E correlation and limits of correlations 1 Descriptive Methods: Correlation A correlational study is a research strategy that allows the calculation of how strongly related two factors are to each

More information

Chapter 4. More On Bivariate Data. More on Bivariate Data: 4.1: Transforming Relationships 4.2: Cautions about Correlation

Chapter 4. More On Bivariate Data. More on Bivariate Data: 4.1: Transforming Relationships 4.2: Cautions about Correlation Chapter 4 More On Bivariate Data Chapter 3 discussed methods for describing and summarizing bivariate data. However, the focus was on linear relationships. In this chapter, we are introduced to methods

More information

Chapter 4: More about Relationships between Two-Variables Review Sheet

Chapter 4: More about Relationships between Two-Variables Review Sheet Review Sheet 4. Which of the following is true? A) log(ab) = log A log B. D) log(a/b) = log A log B. B) log(a + B) = log A + log B. C) log A B = log A log B. 5. Suppose we measure a response variable Y

More information

Supplement 2. Use of Directed Acyclic Graphs (DAGs)

Supplement 2. Use of Directed Acyclic Graphs (DAGs) Supplement 2. Use of Directed Acyclic Graphs (DAGs) Abstract This supplement describes how counterfactual theory is used to define causal effects and the conditions in which observed data can be used to

More information

STATE ENVIRONMENTAL HEALTH INDICATORS COLLABORATIVE (SEHIC) CLIMATE AND HEALTH INDICATORS

STATE ENVIRONMENTAL HEALTH INDICATORS COLLABORATIVE (SEHIC) CLIMATE AND HEALTH INDICATORS STATE ENVIRONMENTAL HEALTH INDICATORS COLLABORATIVE (SEHIC) CLIMATE AND HEALTH INDICATORS Category: Indicator: Health Outcome Indicators Allergic Disease MEASURE DESCRIPTION Measure: Time scale: Measurement

More information

Lesson Plan. Class Policies. Designed Experiments. Observational Studies. Weighted Averages

Lesson Plan. Class Policies. Designed Experiments. Observational Studies. Weighted Averages Lesson Plan 1 Class Policies Designed Experiments Observational Studies Weighted Averages 0. Class Policies and General Information Our class website is at www.stat.duke.edu/ banks. My office hours are

More information

How Causal Heterogeneity Can Influence Statistical Significance in Clinical Trials

How Causal Heterogeneity Can Influence Statistical Significance in Clinical Trials How Causal Heterogeneity Can Influence Statistical Significance in Clinical Trials Milo Schield, W. M. Keck Statistical Literacy Project. Minneapolis, MN. Abstract: Finding that an association is statistically

More information

Chapter 3. Producing Data

Chapter 3. Producing Data Chapter 3 Producing Data Types of data collected Anecdotal data data collected haphazardly (not representative!!) Available data existing data (examples: internet, library, census bureau,.) Gather own

More information

Pre-Calculus Multiple Choice Questions - Chapter S4

Pre-Calculus Multiple Choice Questions - Chapter S4 1 Which of the following represents the dependent variable in experimental design? a Treatment b Factor 2 Which of the following represents the independent variable in experimental design? a Treatment

More information

Homework #3. SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question.

Homework #3. SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question. Homework #3 Name Due Due on on February Tuesday, Due on February 17th, Sept Friday 28th 17th, Friday SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question. Fill

More information

NANO: Network Access Neutrality Observatory

NANO: Network Access Neutrality Observatory NANO: Network Access Neutrality Observatory Mukarram Bin Tariq, Murtaza Motiwala, Nick Feamster, Mostafa Ammar Georgia Tech 1 Net Neutrality 2 Net Neutrality 2 Net Neutrality 2 Example: BitTorrent Blocking

More information

Issues in Randomization

Issues in Randomization INTRODUCTION TO THE PRINCIPLES AND PRACTICE OF CLINICAL RESEARCH Issues in Randomization Paul Wakim, PhD Chief, Biostatistics and Clinical Epidemiology Service Clinical Center, National Institutes of Health

More information

16:35 17:20 Alexander Luedtke (Fred Hutchinson Cancer Research Center)

16:35 17:20 Alexander Luedtke (Fred Hutchinson Cancer Research Center) Conference on Causal Inference in Longitudinal Studies September 21-23, 2017 Columbia University Thursday, September 21, 2017: tutorial 14:15 15:00 Miguel Hernan (Harvard University) 15:00 15:45 Miguel

More information

STATISTICS & PROBABILITY

STATISTICS & PROBABILITY STATISTICS & PROBABILITY LAWRENCE HIGH SCHOOL STATISTICS & PROBABILITY CURRICULUM MAP 2015-2016 Quarter 1 Unit 1 Collecting Data and Drawing Conclusions Unit 2 Summarizing Data Quarter 2 Unit 3 Randomness

More information

From Description to Causation

From Description to Causation From Description to Causation Department of Government London School of Economics and Political Science 1 Correlation vs. Causation 2 Over-Time Changes 3 Getting Systematic about Causality What makes something

More information

Confounders and Corfield: Back to the Future 12 July, 2018

Confounders and Corfield: Back to the Future 12 July, 2018 Confounders and Corfield: Back to the Future 12 July, 2018 0G 1 Confounding and Cornfield: Back to the Future 0G 2 Back to the Future: The Movie Milo Schield, US Fellow: American Statistical Assoc. US

More information

Chapter 4: Understanding Others

Chapter 4: Understanding Others 4A Understanding Others 1 Chapter 4: Understanding Others From Physical Appearance to Inferences about Personality Traits The Accuracy of Snap Judgments From Acts to Dispositions: The Importance of Causal

More information

INTERNAL VALIDITY, BIAS AND CONFOUNDING

INTERNAL VALIDITY, BIAS AND CONFOUNDING OCW Epidemiology and Biostatistics, 2010 J. Forrester, PhD Tufts University School of Medicine October 6, 2010 INTERNAL VALIDITY, BIAS AND CONFOUNDING Learning objectives for this session: 1) Understand

More information

Examining Relationships Least-squares regression. Sections 2.3

Examining Relationships Least-squares regression. Sections 2.3 Examining Relationships Least-squares regression Sections 2.3 The regression line A regression line describes a one-way linear relationship between variables. An explanatory variable, x, explains variability

More information

Chapter 5: Producing Data

Chapter 5: Producing Data Chapter 5: Producing Data Key Vocabulary: observational study vs. experiment confounded variables population vs. sample sampling vs. census sample design voluntary response sampling convenience sampling

More information

Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015

Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015 Methods to control for confounding - Introduction & Overview - Nicolle M Gatto 18 February 2015 Learning Objectives At the end of this confounding control overview, you will be able to: Understand how

More information

Designing Pharmacy Practice Research

Designing Pharmacy Practice Research Designing Pharmacy Practice Research Ross T. Tsuyuki, BSc(Pharm), PharmD, MSc, FCHSP, FACC Professor of Medicine (Cardiology) Director, EPICORE Centre Faculty of Medicine and Dentistry University of Alberta

More information

Delgado Safety Topic RECOGNITION AND PREVENTION OF HEAT RELATED ILLNESSES. Prepared by: Corey Valdary

Delgado Safety Topic RECOGNITION AND PREVENTION OF HEAT RELATED ILLNESSES. Prepared by: Corey Valdary Delgado Safety Topic RECOGNITION AND PREVENTION OF HEAT RELATED ILLNESSES Prepared by: Corey Valdary Purpose To understand the causes and preventive measures to eliminate heat stress during the Spring/Summer

More information

A NEW TRIAL DESIGN FULLY INTEGRATING BIOMARKER INFORMATION FOR THE EVALUATION OF TREATMENT-EFFECT MECHANISMS IN PERSONALISED MEDICINE

A NEW TRIAL DESIGN FULLY INTEGRATING BIOMARKER INFORMATION FOR THE EVALUATION OF TREATMENT-EFFECT MECHANISMS IN PERSONALISED MEDICINE A NEW TRIAL DESIGN FULLY INTEGRATING BIOMARKER INFORMATION FOR THE EVALUATION OF TREATMENT-EFFECT MECHANISMS IN PERSONALISED MEDICINE Dr Richard Emsley Centre for Biostatistics, Institute of Population

More information

Observational Substance Use Epidemiology: A case study

Observational Substance Use Epidemiology: A case study Observational Substance Use Epidemiology: A case study Evan Wood MD, PhD, FRCPC, ABAM Dip. FASAM Director, BC Centre on Substance Use Professor of Medicine and Canada Research Chair University of British

More information

Penn State MPH Program Competencies 2013

Penn State MPH Program Competencies 2013 Core Competencies Five Core Areas of Public Health: Biostatistics 1. Explain the fundamental concepts of biostatistics. 2. Utilize common statistical methods (i.e., calculate, analyze, interpret, report)

More information

Confounding and Interaction

Confounding and Interaction Confounding and Interaction Why did you do clinical research? To find a better diagnosis tool To determine risk factor of disease To identify prognosis factor To evaluate effectiveness of therapy To decide

More information

Gathering. Useful Data. Chapter 3. Copyright 2004 Brooks/Cole, a division of Thomson Learning, Inc.

Gathering. Useful Data. Chapter 3. Copyright 2004 Brooks/Cole, a division of Thomson Learning, Inc. Gathering Chapter 3 Useful Data Copyright 2004 Brooks/Cole, a division of Thomson Learning, Inc. Principal Idea: The knowledge of how the data were generated is one of the key ingredients for translating

More information

Appendix B. Fundamentals of Experimental Design I. BASIC CONCEPTS. THREATS TO INTERNAL VALIDITY (i.e. sources of experimental error)

Appendix B. Fundamentals of Experimental Design I. BASIC CONCEPTS. THREATS TO INTERNAL VALIDITY (i.e. sources of experimental error) ppendix Fundamentals of Experimental Design The following information was developed by Steven Rothke, PhD, Department of Psychology, Rehabilitation Institute of Chicago and expanded by Mary F. Schmidt,

More information

Climate Change and our Children s Health

Climate Change and our Children s Health Climate Change and our Children s Health Robert J. Laumbach M.D., M.P.H., C.I.H. Department of Environmental and Occupational Medicine Rutgers Robert Wood Johnson Medical School March 1, 2014 Not just

More information

8/10/2012. Education level and diabetes risk: The EPIC-InterAct study AIM. Background. Case-cohort design. Int J Epidemiol 2012 (in press)

8/10/2012. Education level and diabetes risk: The EPIC-InterAct study AIM. Background. Case-cohort design. Int J Epidemiol 2012 (in press) Education level and diabetes risk: The EPIC-InterAct study 50 authors from European countries Int J Epidemiol 2012 (in press) Background Type 2 diabetes mellitus (T2DM) is one of the most common chronic

More information

Two-Way Frequency Tables: Teaching a New Statistics Standard Conceptually

Two-Way Frequency Tables: Teaching a New Statistics Standard Conceptually Two-Way Frequency Tables: Teaching a New Statistics Standard Conceptually Presenters: Chase Orton chase@mathandteaching.org @mathgeek76 Shelley Kriegler shelley@mathandteaching.org Presentation #, Last

More information

t-test for r Copyright 2000 Tom Malloy. All rights reserved

t-test for r Copyright 2000 Tom Malloy. All rights reserved t-test for r Copyright 2000 Tom Malloy. All rights reserved This is the text of the in-class lecture which accompanied the Authorware visual graphics on this topic. You may print this text out and use

More information

Leah A. Jacobs, M.S.W., Ph.D Cathedral of Learning Pittsburgh, PA Phone: (412)

Leah A. Jacobs, M.S.W., Ph.D Cathedral of Learning Pittsburgh, PA Phone: (412) CURRENT APPOINTMENTS Leah A. Jacobs, M.S.W., Ph.D. 2206 Cathedral of Learning Pittsburgh, PA 15260 Phone: (412) 623-2169 leahjacobs@pitt.edu Assistant Professor 2017-Current: University of Pittsburgh,

More information

CHAPTER OFFICER GUIDE

CHAPTER OFFICER GUIDE CHAPTER OFFICER GUIDE gustavus adolphus college Saint Peter, Minnesota 1-800-GUSTAVUS gustavus.edu Chapter Officer Guide Gusties gather with President Bergman in San Francisco, CA. What is the Role of

More information

115 remained abstinent. 140 remained abstinent. Relapsed Remained abstinent Total

115 remained abstinent. 140 remained abstinent. Relapsed Remained abstinent Total Chapter 10 Exercises 1. Intent-to-treat analysis: Example 1 In a randomized controlled trial to determine whether the nicotine patch reduces the risk of relapse among smokers who have committed to quit,

More information

Bystander and Indoor Residential Pesticide Exposure

Bystander and Indoor Residential Pesticide Exposure Bystander and Indoor Residential Pesticide Exposure Chensheng (Alex) Lu, Ph.D. Mark and Catherine Winkler Assistant Professor of Environmental Exposure Biology Department of Environmental Health Harvard

More information

An Introduction to Statistical Thinking Dan Schafer Table of Contents

An Introduction to Statistical Thinking Dan Schafer Table of Contents An Introduction to Statistical Thinking Dan Schafer Table of Contents PART I: CONCLUSIONS AND THEIR UNCERTAINTY NUMERICAL AND ELEMENTS OF Chapter1 Statistics as a Branch of Human Reasoning Chapter 2 What

More information

Mark Petersen & Jen Muscha. Livestock & Range Research Laboratory

Mark Petersen & Jen Muscha. Livestock & Range Research Laboratory Mark Petersen & Jen Muscha USDA ARS Fort USDA-ARS F t Keogh K h Livestock & Range Research Laboratory OUTLINE Background t quality lit W Water Winter water temperature important? How much does water quality

More information

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two lab exam when: Nov 27 - Dec 1 length = 1 hour each lab section divided in two register for the exam in your section so there is a computer reserved for you If you write in the 1st hour, you can t leave

More information