Geographic Data Science - Lecture IX

Similar documents
Lecture II: Difference in Difference and Regression Discontinuity

Lecture II: Difference in Difference. Causality is difficult to Show from cross

Public Policy & Evidence:

Quantitative Methods. Lonnie Berger. Research Training Policy Practice

Instrumental Variables Estimation: An Introduction

Write your identification number on each paper and cover sheet (the number stated in the upper right hand corner on your exam cover).

Bugbears or Legitimate Threats? (Social) Scientists Criticisms of Machine Learning. Sendhil Mullainathan Harvard University

Causal Inference in Observational Settings

8/25/2016. One More: Sample test question on first lecture

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.

Today s reading concerned what method? A. Randomized control trials. B. Regression discontinuity. C. Latent variable analysis. D.

Study Designs. Lecture 3. Kevin Frick

Lecture 12 Cautions in Analyzing Associations

BIVARIATE DATA ANALYSIS

Results & Statistics: Description and Correlation. I. Scales of Measurement A Review

CRITICAL APPRAISAL SKILLS PROGRAMME Making sense of evidence about clinical effectiveness. 11 questions to help you make sense of case control study

Chapter 1 Introduction to Educational Research

Instrumental Variables I (cont.)

The Perils of Empirical Work on Institutions

What is Data? Part 2: Patterns & Associations. INFO-1301, Quantitative Reasoning 1 University of Colorado Boulder

Regression and causal analysis. Harry Ganzeboom Research Skills, December Lecture #5

Designs. February 17, 2010 Pedro Wolf

Best Practice Model Communication/Relational Skills in Soliciting the Patient/Family Story Stuart Farber

Version No. 7 Date: July Please send comments or suggestions on this glossary to

A Guide to Reading a Clinical or Research Publication

Manitoba Centre for Health Policy. Inverse Propensity Score Weights or IPTWs

Conducting Strong Quasi-experiments

F1: Introduction to Econometrics

Experimental / Quasi-Experimental Research Methods

Unit 8 Day 1 Correlation Coefficients.notebook January 02, 2018

Why Coaching Clients Give Up

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research

Causation. Victor I. Piercey. October 28, 2009

ECON Microeconomics III

t-test for r Copyright 2000 Tom Malloy. All rights reserved

Does executive coaching work? The questions every coach needs to ask and (at least try to) answer. Rob B Briner

Penn State MPH Program Competencies 2013

Carrying out an Empirical Project

Biostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras

August 29, Introduction and Overview

Methods for Addressing Selection Bias in Observational Studies

University of Oxford Intermediate Social Statistics: Lecture One

Chapter 5: Research Language. Published Examples of Research Concepts

STATISTICS INFORMED DECISIONS USING DATA

Economics 2010a. Fall Lecture 11. Edward L. Glaeser

Man of the Year 2016 Acceptance Speech

observational studies Descriptive studies

Writing Reaction Papers Using the QuALMRI Framework

Confounding and Effect Modification

Confounding and Effect Modification. John McGready Johns Hopkins University

Introduction to Observational Studies. Jane Pinelis

SOCIOLOGICAL RESEARCH PART I. If you've got the truth you can demonstrate it. Talking doesn't prove it. Robert A. Heinlein

Why randomize? Rohini Pande Harvard University and J-PAL.

9 INSTRUCTOR GUIDELINES

Experimental design (continued)

9.63 Laboratory in Cognitive Science

EXPERT PANEL AND FIELD PARTICIPANTS BELIEVE

In this chapter we discuss validity issues for quantitative research and for qualitative research.

Political Science 30: Political Inquiry Section 1

Anatomy of Medical Studies: Part I. Emily D Agostino Epidemiology and Biostatistics CUNY School of Public Health at Hunter College

Causal Research Design- Experimentation

Introduction to Applied Research in Economics Kamiljon T. Akramov, Ph.D. IFPRI, Washington, DC, USA

Introduction to Program Evaluation

Observational Studies and Experiments. Observational Studies

ACCTG 533, Section 1: Module 2: Causality and Measurement: Lecture 1: Performance Measurement and Causality

Recent advances in non-experimental comparison group designs

12 hours. Your body has eliminates all excess carbon monoxide and your blood oxygen levels become normal.

Political Science 15, Winter 2014 Final Review

You must answer question 1.

Why Tobacco Cessation?

The Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016

Relapse Prevention Workbook

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC

CSC2130: Empirical Research Methods for Software Engineering

Healing, Justice, & Trust

So You Want to do a Survey?

Introduction: Research design

LAST LECTURE. What Do Sociologists Do? Forms of Truth. What Is a Valid Sociological Topic? Any kind of human behaviour & social interaction

Experimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design

Scientific Method Stations

UNIT II: RESEARCH METHODS

Dr. Sabol s paper offers readers a twofer it covers two areas in one paper.

Chapter-2 RESEARCH DESIGN

Quasi-experimental analysis Notes for "Structural modelling".

Propensity Score Analysis Shenyang Guo, Ph.D.

Dare to believe it! Live to prove it! JOHN VON ACHEN

Cross-Lagged Panel Analysis

Collecting Data: Observational Studies

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

Graphic Organizers. Compare/Contrast. 1. Different. 2. Different. Alike

The Limits of Inference Without Theory

DECISION QUALITY WORKSHEET TREATMENTS FOR DEPRESSION

PSYC1024 Clinical Perspectives on Anxiety, Mood and Stress

Evaluation and Assessment of Health Policy. Gerard F. Anderson, PhD Johns Hopkins University

10. Introduction to Multivariate Relationships

Regression Discontinuity Design (RDD)

Causality and Treatment Effects

Introduction to Quantitative Research and Program Evaluation Methods

CORPORATE PLAN Supporting housing professionals to create a future in which everyone has a place to call home

Transcription:

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel

Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference & strategies to overcome them

Correlation Vs Causation

"Association breeds similarity" (sometimes) Nasir bin Olu Dara Jones (a.k.a. Nas)

Correlation Vs Causation Two fundamental ways to look at the relationship between two (or more) variables:

Correlation Vs Causation Two fundamental ways to look at the relationship between two (or more) variables: Correlation Two variables have co-movement. If we know the value of one, we know something about the value of the other one.

Correlation Vs Causation Two fundamental ways to look at the relationship between two (or more) variables: Correlation Two variables have co-movement. If we know the value of one, we know something about the value of the other one. Causation There is a "cause-effect" link between the two and, as a result, they display co-movement.

Correlation Vs Causation Both are useful, but for different purposes Causation implies correlation but not the other way around It is vital to keep this distinction in mind for meaningful and credible analysis

Examples Sign correlation? Causal link? Take a guess (2mins)... Temperature and ice-cream consumption Non-commercial space launches & Sociology PhDs awarded Crime & policing IMD Moran Plot in Liverpool

Examples Sign correlation? Causal link? Take a guess (2mins)... Temperature and ice-cream consumption Positive. Positive. Non-commercial space launches & Sociology PhDs awarded Crime & policing IMD Moran Plot in Liverpool

Worldwide non-commercial space launches correlates with Sociology doctorates awarded (US) 2000 2001 2002 2003 2004 2005 2006 2007 [ Source] 2000 2001 2002 2003 2004 2005 2006 2007 Sociology doctorates awarded (US) Worldwide non-commercial space launche

Examples Positive or negative correlation? Causal link? Take a guess (2mins)... Temperature and ice-cream consumption Positive. Positive. Non-commercial space launches & Sociology PhDs awarded Positive. None. Crime & policing IMD Moran Plot in Liverpool

Examples Positive or negative correlation? Causal link? Take a guess (2mins)... Temperature and ice-cream consumption Positive. Positive. Non-commercial space launches & Sociology PhDs awarded Positive. None. Crime & policing Positive. Negative. IMD Moran Plot in Liverpool

Examples Positive or negative correlation? Causal link? Take a guess (2mins)... Temperature and ice-cream consumption Positive. Positive. Non-commercial space launches & Sociology PhDs awarded Positive. None. Crime & policing Positive. Negative. IMD Moran Plot in Liverpool Positive.?

Causal inference

Causal inference is hard (or how I learned to stop worrying a Playback isn't supported on this device. 0:00 / 5:29 [ Source]

Why/When get causal?

Why Most often, we are interested in understanding the processes that generate the world, not only in observing its outcomes Many of these processes are only indirectly observable through outcomes The only way to link both is through causal channels

When Essentially when the core interest is to find out if something causes something else Policy interventions Medical trials Business decisions (product/feature development...) Empirical (Social) Sciences...

When not (necessarily)

When not (necessarily) Exploratory analysis When you are not sure what you are after, inferring causality might be too high of a price to pay to get a sense of the main relationships

When not (necessarily) Exploratory analysis When you are not sure what you are after, inferring causality might be too high of a price to pay to get a sense of the main relationships Predictive settings Interest not in understanding the underlying mechanisms but want to obtain best possible estimates of a variable you do not have by combining others you do have E.g. Population density in a specific point using population density in all available nearby locations

Hurdles to causal inference

Hurdles to causal inference Causation implies Correlation Correlation does not imply Causation Why?

Hurdles to causal inference Causation implies Correlation Correlation does not imply Causation Why?

Hurdles to causal inference Causation implies Correlation Correlation does not imply Causation Why? Reverse causality Confounding factors/endogeneity

Reverse causality There is a causal link between the two variables but it either runs the oposite direction as we think, or runs in both

Reverse causality There is a causal link between the two variables but it either runs the oposite direction as we think, or runs in both E.g. Education and income

Confounding factors Two variables are correlated because they are both determined by other, unobserved, variables (factors) that confound the effect

Confounding factors Two variables are correlated because they are both determined by other, unobserved, variables (factors) that confound the effect E.g. Ice cream and cold beverages consumption

Strategies

Is there any way to overcome reverse causality and confounding factors to recover causal effects?

Is there any way to overcome reverse causality and confounding factors to recover causal effects? The key is to get an exogenous source of variation

Strategies

Strategies Randomized Control Trials Treated and control groups Probability of treatment is independent of everything else

Strategies Randomized Control Trials Treated and control groups Probability of treatment is independent of everything else Quasi-natural experiments Like a RCT, but that just "happen to occur naturally" (natural dissasters, exogenous law changes...)

Strategies Randomized Control Trials Treated and control groups Probability of treatment is independent of everything else Quasi-natural experiments Like a RCT, but that just "happen to occur naturally" (natural dissasters, exogenous law changes...) Econometric techniques For the interested reader: space-time regression, instrumental variables, propensity score matching, differences-in-differences, regression discontinuity...

So, why correlation at all?

So, why correlation at all? Establishing causality is much harder than identifying correlation, and sometimes it is just not possible with a given dataset (e.g. many observational surveys).

So, why correlation at all? Establishing causality is much harder than identifying correlation, and sometimes it is just not possible with a given dataset (e.g. many observational surveys).... correlation most often precludes causation and, depending on the application/analysis, it is all that is needed.

So, why correlation at all? Establishing causality is much harder than identifying correlation, and sometimes it is just not possible with a given dataset (e.g. many observational surveys).... correlation most often precludes causation and, depending on the application/analysis, it is all that is needed. It is important to always draw conclusions based on analysis, know what the data can and cannot tell, and stay honest.

Recapitulation Correlation does NOT imply causation Causality implies more than correlation, a direct effect channel that is harder to identify but might be worthwhile There are several techniques to identify causality, all usually based on obtaining exogenous sources of variation You don't always need causality

[ Source]

Geographic Data Science'16 - Lecture 9 by Dani Arribas-Bel is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.