Establishing Causality Convincingly: Some Neat Tricks

Size: px
Start display at page:

Download "Establishing Causality Convincingly: Some Neat Tricks"

Transcription

1 Establishing Causality Convincingly: Some Neat Tricks

2 Establishing Causality In the last set of notes, I discussed how causality can be difficult to establish in a straightforward OLS context If assumptions for unbiasedness hold, you re OK. But generally x will be endogenous, meaning that the zero conditional mean assumption will fail (i.e. the assumptions for unbiasedness won t hold) Snow s study of how cholera spreads gave a nice example of how finding exogenous variation in x (i.e. variation uncorrelated with the error term) can lead to convincing findings on causality.

3 Establishing Causality Variables (x) that are chosen by individuals are likely to be endogenous Whether I smoke How much I exercise Whether I save a lot or a little If we want to find the effect of such things on y, we have to worry about this endogeneity Ideally, what we d like is to exogenize x; use only the exogenous component of the variation in x to test for x s causal effect on y.

4 Isolating Exogenous Variation in x Take something like an individual s level of education and its effect on the wage. Individual chooses how much education to get Therefore x and u will be correlated, if unobserved differences between individuals with high education and low education are contained in u (e.g. work ethic) To some extent one s choice of education is a function of personal choice (endogenous component), but to some extent it s also a function of factors that are arguably random (exogenous component) What the minimum school drop-out age is in one s province (affects how many years of education some people get) How close one lives to a university (affects cost of attendance; therefore decision to attend)

5 Isolating Exogenous Variation in x If we can isolate the exogenous variation in x, we can use that variation to identify the causal effect of x on y. Remember, the ideal randomized experiment to determine the effect of education on the wage is to randomly sprinkle people with different levels of education and compare their wages. Suppose people are randomly sprinkled with various shocks to their decisionmaking that affect their choice of education. The variation in education that results from these random factors can be treated as random (thus exogenous). The rest of the variation in education should be treated as endogenous.

6 Example: Instrumental Variables One technique that does this is called instrumental variables (IV) estimation. This has become very popular in empirical economics. The idea is to take an endog RHS variable like educ, and find something that exogenously shifts it around. The intuition is essentially to regress educ on this exogenous shifter, predict values of educ using values of the exogenous shifter, and then substitute these predicted values of educ into the wage equation. The variation in educ should now be greatly diminished because the endogenous component has been removed This means standard error of the coefficient on educ will go up But the coefficient will be estimated using only exogenous variation in educ. This removes bias due to endogeneity of educ

7 Example: Instrumental Variables The exogenous shifter is called an instrumental variable or an instrument The estimator we obtain is called the IV estimator (as opposed to the OLS estimator) Picking a good instrument is essential to obtaining reliable IV estimators Suppose we are testing the effect of x on y, but we believe x is endogenous. Need an instrument, z, that is both: 1) Correlated with x (the stronger the better) 2) Uncorrelated with u (this means z only affects y through its effect on x)

8 Example: Instrumental Variables More formally, let s assume we want to estimate y = β 0 + β 1 x + u But we have reason to believe that x is endogenous (correlated with u) If we estimate the model as is, then our estimate of the effect of x on y will be biased Suppose that z affects x but has no effect (other than through x) on y Can instrument for z with x.

9 Example: Instrumental Variables Remember our OLS estimator is an approximation (using data) of Cov(x,y)/Var(x). This means it uses all variation in x and all covariation between x and y, whether endogenous or exogenous Consider Cov(z,y) where z is an instrument for x. Intuitively, this is the variation in y due to variation in x caused by variation in the exogenous instrument z (because the only way z affects y is through variation it causes in x).

10 Example: Instrumental Variables Cov(z, y) = Cov[z,(β 0 + β 1 x + u) β 1 = = β 1 Cov(z, x) + Cov(z,u) Cov(z, y) Cov(z, x) Note that Cov(z,u)=0 by assumption of z being exogenous We can get the sample analog of this ˆβ 1 IV = n i=1 (z i z )(y i y) (z i z )(x i x)

11 Example: Instrumental Variables This is very straightforward to estimate using a statistical package like EViews Using IV, you ve arguably done what Snow did by searching out a form of exogenous variation in water contamination levels To put this back in the randomized trials context, you can think of z as causing random variation in x which then allows you to treat x as if it s truly random. Note that if z is correlated with u in the original equation, then you can get into serious trouble IV estimator can be more biased than OLS estimator Also note that because we re only using exogeous variation in x to identify the causal effect of x on y, the standard error on the coeff on x will be much higher than it is with OLS (which uses all variation in x)

12 Some Famous Instruments Think back to our wage equation and the effect of education Important policy question What are some instruments for education? Proximity to a 4-year university may affect an individual s decision whether or not to attend university; this location might be able to be treated as random. Parents education; arguably this says something about the educational values you were exposed to growing up. Might be able to view this as random. Here s a neat one: quarter of birth. Why?

13 Some Famous Instruments Quarter of Birth In US and Canada students enter school according to a set formula (e.g. If you turn 5 by December 31st of a year, you start kindergarten that year) There are also minimum dropout ages (e.g. age 16 in many states/provinces) The interaction of these two policies causes a certain amount of variation in the years of education that people get. Example: If a kid turns 5 on Dec 31 this year, she starts school this year; if she turns 5 on January 1, she starts school next year. Yet, both kids turn 16 at essentially same time, so if both drop out at 16, one will have 1 more year of education than the other

14 Some Famous Instruments Arguably one s quarter of birth should be completely random Yet, the quarter of birth causes some people to have more education than others. A source of exogenous variation! A very famous paper (Angrist and Kreuger, 1991) exploited this idea to estimate the effect of an extra year of education Actually find a higher return to education using this instrument than people had typically found with OLS (about a 10% increase in earnings)

15 Some Famous Instruments Vietnam draft number Following Vietnam war, people became interested in the experience that Vietnam vets had in labour market Lots of stories of stress, emotional problems among returning troops Whether one served in Vietnam is arguably endogenous, because some chose to serve Choosers to serve may differ fundamentally from choosers not to serve Ideally, we want something that randomly forces some people to serve and some not to serve Draft number! A source of exogenous variation in whether you served in Vietnam or not.

16 Some more on IV estimation There are lots of potential instruments out there; creative use of them tends to be rewarded with (potentially more) convincing findings and publications But some cautionary notes IV estimates are biased but consistent Tend to have high standard errors (difficult to reject null) For both these reasons, large samples are needed If your instrument is badly chosen so that it is correlated with u you can make things worse than OLS by doing IV estimation Finally, IV estimation can only say something about the part of the sample the exogenous variation occurs in QOB only causes variation among high school dropouts. Therefore the estimate we obtain using this instrument only gives the return to an extra year of education for someone on the margin of dropping out. The effect could be much different for non-marginal students. This is called the local average treatment effect problem (LATE)

17 Example: Regression Discontinuity Design This is another nifty way to come up with plausibly exogenous variation in x Suppose x is determined by a stochastic process that involves a discontinuity Example: Some states in US have local budget referenda that determine school spending for individual districts. If the new budget is approved, spending rises to the proposed level. If it s rejected, spending falls to some state-mandated minimum. 50% plus 1 vote passes the budget, 50% minus 1 vote fails to pass the budget. Arguably the number of votes for the budget is partly randomly determined. Outcome is highly discontinuous; a small perturbation in the number of votes leads to big variation in the budget size

18 Example: Regression Discontinuity Design (RD) Why is this useful? One could simply regress some student outcome, like score on a standardized test, on level of spending in each school district. The problem is that spending in a school district is likely correlated with unobservable determinants of a student s performance on a standardized test Parents may care more about child s education in highspending districts than in low-spending districts, may not have a care variable to control for this Hence coefficient on spending would likely be biased (positively in this case) The RD approach lets us compare districts with close voting outcomes (say all those that were 50-51% for against those that were 49-50% for the budget)

19 Example: Regression Discontinuity Design (RD) Districts that vote 80% for maybe different than those that vote 20% for in unobservable ways However, arguably districts that vote 51% for are virtually identical to districts that vote 49% for. Yet, there s a huge difference in spending outcomes for these districts Arguably the difference in voting outcomes is driven by randomness (maybe there was a traffic jam in the second district that caused a few busy parents not to make it to the polls in time) If this is true, then the variation we get in spending between the 51% and 49% districts is completely exogenous

20 Example: Regression Discontinuity Design (RD) Therefore, we may be more inclined to trust the results we get with an RD approach than with a straight OLS regression of test score on spending Another voting example was the 2000 US presidential election. Suppose you re interested in how different industries perform under different political parties More specifically, how does having a Republican in the White House affect stock price performance of drug companies or oil companies?

21 Example: Regression Discontinuity Design (RD) You could simply compare stock price performances of an index of oil companies over various presidential administrations, and include a dummy for party in White House. (basic time series analysis) However, there may be factors correlated with who is in the White House that affect stock price of oil companies Maybe people vote Republican when they re worried we re running short of oil. So the standard OLS approach would be suspect

22 Example: Regression Discontinuity Design (RD) The 2000 election provided a great RD experiment The day of the election, no one knew with any confidence who was going to win. People were speculating that the result would probably depend on the weather in a few key states (i.e. the outcome was essentially going to be a coin toss--random!) The result was determined by a Supreme Court ruling.

23 Example: Regression Discontinuity Design (RD) People could essentially treat price changes in various stocks between Election Day and the Supreme Court ruling as a function of a coin toss on the presidential election outcome The fact that the party in power shifted from Democrat to Republican could basically be attributed to randomness (the 500 vote margin in Florida) Many studies were actually done exploiting this experiment

24 Natural Experiments These types of empirical approaches are generally referred to as natural experiments The name points to the way in which they approximate randomized trials Ethically, randomized trials couldn t be used in any of these studies. However, researchers if researchers find ways that nature imparts some randomness on x, they can exploit that randomness as if a randomized trial had been done. Often times we can learn much more about the relationship between two variables if we employ this type of an approach

25 unnatural Experiments in Economics Randomized trials are sometimes used in economics Lab experiments Interested students should consider Dr. Rondeau s occasionally offered experiments course (400 level) Honours students (e.g. Shiva Shirazi-Kia) sometimes perform experiments as part of thesis research. Field experiments Dr. Rondeau: Fundraising letters (getting permission from charities to vary wording of appeals to donors) There s a large literature on private contributions to public goods that considers the motivation of those who donate to charity Studies of strategic behavior

26 unnatural Experiments in Economics Bertrand and Mullainathan resume studies Researchers sent job application cover letter and resumes out to employers who were advertising openings Used a core set of resumes and a core set of cover letters Varied names of applicants Chose some names to be black (e.g. Tyrone Jackson, Shanika Jefferson) and some names to be white (e.g. Dylan Peters, Ashley Hutchinson) Mailed resumes with different names to employers, found that black names got fewer callbacks for interviews than white names This is considered a field experiment Phil Oreopoulos at UBC/U Toronto has done similar experiments in the BC labor market looking at discrimination against immigrants (people with East Asian and South Asian names versus those with Caucasian names) Note, you can use econometrics to analyze data in studies like these, but you often can get by with simple techniques like OLS.

Class 1: Introduction, Causality, Self-selection Bias, Regression

Class 1: Introduction, Causality, Self-selection Bias, Regression Class 1: Introduction, Causality, Self-selection Bias, Regression Ricardo A Pasquini April 2011 Ricardo A Pasquini () April 2011 1 / 23 Introduction I Angrist s what should be the FAQs of a researcher:

More information

Applied Quantitative Methods II

Applied Quantitative Methods II Applied Quantitative Methods II Lecture 7: Endogeneity and IVs Klára Kaĺıšková Klára Kaĺıšková AQM II - Lecture 7 VŠE, SS 2016/17 1 / 36 Outline 1 OLS and the treatment effect 2 OLS and endogeneity 3 Dealing

More information

Instrumental Variables Estimation: An Introduction

Instrumental Variables Estimation: An Introduction Instrumental Variables Estimation: An Introduction Susan L. Ettner, Ph.D. Professor Division of General Internal Medicine and Health Services Research, UCLA The Problem The Problem Suppose you wish to

More information

EMPIRICAL STRATEGIES IN LABOUR ECONOMICS

EMPIRICAL STRATEGIES IN LABOUR ECONOMICS EMPIRICAL STRATEGIES IN LABOUR ECONOMICS University of Minho J. Angrist NIPE Summer School June 2009 This course covers core econometric ideas and widely used empirical modeling strategies. The main theoretical

More information

August 29, Introduction and Overview

August 29, Introduction and Overview August 29, 2018 Introduction and Overview Why are we here? Haavelmo(1944): to become master of the happenings of real life. Theoretical models are necessary tools in our attempts to understand and explain

More information

The Limits of Inference Without Theory

The Limits of Inference Without Theory The Limits of Inference Without Theory Kenneth I. Wolpin University of Pennsylvania Koopmans Memorial Lecture (2) Cowles Foundation Yale University November 3, 2010 Introduction Fuller utilization of the

More information

Carrying out an Empirical Project

Carrying out an Empirical Project Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric

More information

Methods for Addressing Selection Bias in Observational Studies

Methods for Addressing Selection Bias in Observational Studies Methods for Addressing Selection Bias in Observational Studies Susan L. Ettner, Ph.D. Professor Division of General Internal Medicine and Health Services Research, UCLA What is Selection Bias? In the regression

More information

A NON-TECHNICAL INTRODUCTION TO REGRESSIONS. David Romer. University of California, Berkeley. January Copyright 2018 by David Romer

A NON-TECHNICAL INTRODUCTION TO REGRESSIONS. David Romer. University of California, Berkeley. January Copyright 2018 by David Romer A NON-TECHNICAL INTRODUCTION TO REGRESSIONS David Romer University of California, Berkeley January 2018 Copyright 2018 by David Romer CONTENTS Preface ii I Introduction 1 II Ordinary Least Squares Regression

More information

Instrumental Variables I (cont.)

Instrumental Variables I (cont.) Review Instrumental Variables Observational Studies Cross Sectional Regressions Omitted Variables, Reverse causation Randomized Control Trials Difference in Difference Time invariant omitted variables

More information

Economics 345 Applied Econometrics

Economics 345 Applied Econometrics Economics 345 Applied Econometrics Lab Exam Version 1: Solutions Fall 2016 Prof: Martin Farnham TAs: Joffré Leroux Rebecca Wortzman Last Name (Family Name) First Name Student ID Open EViews, and open the

More information

Problem Set 5 ECN 140 Econometrics Professor Oscar Jorda. DUE: June 6, Name

Problem Set 5 ECN 140 Econometrics Professor Oscar Jorda. DUE: June 6, Name Problem Set 5 ECN 140 Econometrics Professor Oscar Jorda DUE: June 6, 2006 Name 1) Earnings functions, whereby the log of earnings is regressed on years of education, years of on-the-job training, and

More information

Regression Discontinuity Design (RDD)

Regression Discontinuity Design (RDD) Regression Discontinuity Design (RDD) Caroline Flammer Ivey Business School 2015 SMS Denver Conference October 4, 2015 The Identification Challenge Does X cause Y? Tempting to regress Y on X Y = a + b

More information

What is: regression discontinuity design?

What is: regression discontinuity design? What is: regression discontinuity design? Mike Brewer University of Essex and Institute for Fiscal Studies Part of Programme Evaluation for Policy Analysis (PEPA), a Node of the NCRM Regression discontinuity

More information

Lecture II: Difference in Difference. Causality is difficult to Show from cross

Lecture II: Difference in Difference. Causality is difficult to Show from cross Review Lecture II: Regression Discontinuity and Difference in Difference From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

Stat 13, Intro. to Statistical Methods for the Life and Health Sciences.

Stat 13, Intro. to Statistical Methods for the Life and Health Sciences. Stat 13, Intro. to Statistical Methods for the Life and Health Sciences. 0. SEs for percentages when testing and for CIs. 1. More about SEs and confidence intervals. 2. Clinton versus Obama and the Bradley

More information

Dylan Small Department of Statistics, Wharton School, University of Pennsylvania. Based on joint work with Paul Rosenbaum

Dylan Small Department of Statistics, Wharton School, University of Pennsylvania. Based on joint work with Paul Rosenbaum Instrumental variables and their sensitivity to unobserved biases Dylan Small Department of Statistics, Wharton School, University of Pennsylvania Based on joint work with Paul Rosenbaum Overview Instrumental

More information

Session 1: Dealing with Endogeneity

Session 1: Dealing with Endogeneity Niehaus Center, Princeton University GEM, Sciences Po ARTNeT Capacity Building Workshop for Trade Research: Behind the Border Gravity Modeling Thursday, December 18, 2008 Outline Introduction 1 Introduction

More information

Citation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n.

Citation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n. University of Groningen Latent instrumental variables Ebbes, P. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document

More information

Assessing Studies Based on Multiple Regression. Chapter 7. Michael Ash CPPA

Assessing Studies Based on Multiple Regression. Chapter 7. Michael Ash CPPA Assessing Studies Based on Multiple Regression Chapter 7 Michael Ash CPPA Assessing Regression Studies p.1/20 Course notes Last time External Validity Internal Validity Omitted Variable Bias Misspecified

More information

Session 3: Dealing with Reverse Causality

Session 3: Dealing with Reverse Causality Principal, Developing Trade Consultants Ltd. ARTNeT Capacity Building Workshop for Trade Research: Gravity Modeling Thursday, August 26, 2010 Outline Introduction 1 Introduction Overview Endogeneity and

More information

MEA DISCUSSION PAPERS

MEA DISCUSSION PAPERS Inference Problems under a Special Form of Heteroskedasticity Helmut Farbmacher, Heinrich Kögel 03-2015 MEA DISCUSSION PAPERS mea Amalienstr. 33_D-80799 Munich_Phone+49 89 38602-355_Fax +49 89 38602-390_www.mea.mpisoc.mpg.de

More information

Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha

Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha attrition: When data are missing because we are unable to measure the outcomes of some of the

More information

Principle underlying all of statistics

Principle underlying all of statistics Sampling Bias Principle underlying all of statistics Drawing inferences from a suitable sample of a population is far less labor intensive than, but can be equally as informative as, studying the entire

More information

Probability Models for Sampling

Probability Models for Sampling Probability Models for Sampling Chapter 18 May 24, 2013 Sampling Variability in One Act Probability Histogram for ˆp Act 1 A health study is based on a representative cross section of 6,672 Americans age

More information

Marno Verbeek Erasmus University, the Netherlands. Cons. Pros

Marno Verbeek Erasmus University, the Netherlands. Cons. Pros Marno Verbeek Erasmus University, the Netherlands Using linear regression to establish empirical relationships Linear regression is a powerful tool for estimating the relationship between one variable

More information

1 Simple and Multiple Linear Regression Assumptions

1 Simple and Multiple Linear Regression Assumptions 1 Simple and Multiple Linear Regression Assumptions The assumptions for simple are in fact special cases of the assumptions for multiple: Check: 1. What is external validity? Which assumption is critical

More information

The Logic of Causal Order Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 15, 2015

The Logic of Causal Order Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 15, 2015 The Logic of Causal Order Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 15, 2015 [NOTE: Toolbook files will be used when presenting this material] First,

More information

EC352 Econometric Methods: Week 07

EC352 Econometric Methods: Week 07 EC352 Econometric Methods: Week 07 Gordon Kemp Department of Economics, University of Essex 1 / 25 Outline Panel Data (continued) Random Eects Estimation and Clustering Dynamic Models Validity & Threats

More information

WRITTEN PRELIMINARY Ph.D. EXAMINATION. Department of Applied Economics. January 17, Consumer Behavior and Household Economics.

WRITTEN PRELIMINARY Ph.D. EXAMINATION. Department of Applied Economics. January 17, Consumer Behavior and Household Economics. WRITTEN PRELIMINARY Ph.D. EXAMINATION Department of Applied Economics January 17, 2012 Consumer Behavior and Household Economics Instructions Identify yourself by your code letter, not your name, on each

More information

Chapter 1 Review Questions

Chapter 1 Review Questions Chapter 1 Review Questions 1.1 Why is the standard economic model a good thing, and why is it a bad thing, in trying to understand economic behavior? A good economic model is simple and yet gives useful

More information

SOME NOTES ON THE INTUITION BEHIND POPULAR ECONOMETRIC TECHNIQUES

SOME NOTES ON THE INTUITION BEHIND POPULAR ECONOMETRIC TECHNIQUES SOME NOTES ON THE INTUITION BEHIND POPULAR ECONOMETRIC TECHNIQUES These notes have been put together by Dave Donaldson (EC307 class teacher 2004-05) and by Hannes Mueller (EC307 class teacher 2004-present).

More information

Correlation Ex.: Ex.: Causation: Ex.: Ex.: Ex.: Ex.: Randomized trials Treatment group Control group

Correlation Ex.: Ex.: Causation: Ex.: Ex.: Ex.: Ex.: Randomized trials Treatment group Control group Ch. 3 1 Public economists use empirical tools to test theory and estimate policy effects. o Does the demand for illicit drugs respond to price changes (what is the elasticity)? o Do reduced welfare benefits

More information

Causality and Statistical Learning

Causality and Statistical Learning Department of Statistics and Department of Political Science, Columbia University 29 Sept 2012 1. Different questions, different approaches Forward causal inference: What might happen if we do X? Effects

More information

Problems to go with Mastering Metrics Steve Pischke

Problems to go with Mastering Metrics Steve Pischke Problems to go with Mastering Metrics Steve Pischke Chapter 1 1. Consider the following three causal questions: Many firms, particularly in southern European countries, are small, and owned and run by

More information

The Economics of Obesity

The Economics of Obesity The Economics of Obesity John Cawley Cornell University Usefulness of Economics in Studying Obesity Offers widely-accepted theoretical framework for human behavior (constrained maximization) We ask different

More information

Randomized Evaluations

Randomized Evaluations Randomized Evaluations Introduction, Methodology, & Basic Econometrics using Mexico s Progresa program as a case study (with thanks to Clair Null, author of 2008 Notes) Sept. 15, 2009 Not All Correlations

More information

Lecture II: Difference in Difference and Regression Discontinuity

Lecture II: Difference in Difference and Regression Discontinuity Review Lecture II: Difference in Difference and Regression Discontinuity it From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

Motherhood and Female Labor Force Participation: Evidence from Infertility Shocks

Motherhood and Female Labor Force Participation: Evidence from Infertility Shocks Motherhood and Female Labor Force Participation: Evidence from Infertility Shocks Jorge M. Agüero Univ. of California, Riverside jorge.aguero@ucr.edu Mindy S. Marks Univ. of California, Riverside mindy.marks@ucr.edu

More information

The Issue of Endogeneity within Theory-Based, Quantitative Management Accounting Research

The Issue of Endogeneity within Theory-Based, Quantitative Management Accounting Research European Accounting Review Vol. 16, No. 1, 173 195, 2007 The Issue of Endogeneity within Theory-Based, Quantitative Management Accounting Research ROBERT H. CHENHALL, & FRANK MOERS Monash University, James

More information

Introduction to Observational Studies. Jane Pinelis

Introduction to Observational Studies. Jane Pinelis Introduction to Observational Studies Jane Pinelis 22 March 2018 Outline Motivating example Observational studies vs. randomized experiments Observational studies: basics Some adjustment strategies Matching

More information

School Autonomy and Regression Discontinuity Imbalance

School Autonomy and Regression Discontinuity Imbalance School Autonomy and Regression Discontinuity Imbalance Todd Kawakita 1 and Colin Sullivan 2 Abstract In this research note, we replicate and assess Damon Clark s (2009) analysis of school autonomy reform

More information

Chapter Eight: Multivariate Analysis

Chapter Eight: Multivariate Analysis Chapter Eight: Multivariate Analysis Up until now, we have covered univariate ( one variable ) analysis and bivariate ( two variables ) analysis. We can also measure the simultaneous effects of two or

More information

ECONOMICS Component 2 Exploring Economic Issues

ECONOMICS Component 2 Exploring Economic Issues GCE AS Level NEW AS B520U20-1 S16-B520U20-1 ECONOMICS Component 2 Exploring Economic Issues A.M. MONDAY, 23 May 2016 2 hours B520U201 01 ADDITIONAL MATERIALS In addition to this examination paper, you

More information

Public Policy & Evidence:

Public Policy & Evidence: Public Policy & Evidence: How to discriminate, interpret and communicate scientific research to better inform society. Rachel Glennerster Executive Director J-PAL Global Press coverage of microcredit:

More information

Reading and maths skills at age 10 and earnings in later life: a brief analysis using the British Cohort Study

Reading and maths skills at age 10 and earnings in later life: a brief analysis using the British Cohort Study Reading and maths skills at age 10 and earnings in later life: a brief analysis using the British Cohort Study CAYT Impact Study: REP03 Claire Crawford Jonathan Cribb The Centre for Analysis of Youth Transitions

More information

Pros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany

Pros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Dan A. Black University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Matching as a regression estimator Matching avoids making assumptions about the functional form of the regression

More information

(b) empirical power. IV: blinded IV: unblinded Regr: blinded Regr: unblinded α. empirical power

(b) empirical power. IV: blinded IV: unblinded Regr: blinded Regr: unblinded α. empirical power Supplementary Information for: Using instrumental variables to disentangle treatment and placebo effects in blinded and unblinded randomized clinical trials influenced by unmeasured confounders by Elias

More information

Facilitated Discussion Notes Autism and Mental Health May 12, 2014

Facilitated Discussion Notes Autism and Mental Health May 12, 2014 Facilitated Discussion Notes Autism and Mental Health May 12, 2014 Below are notes distilling the comments made by participants during a Facilitated Discussion of this topic. Generally, the comments are

More information

Causality and Statistical Learning

Causality and Statistical Learning Department of Statistics and Department of Political Science, Columbia University 27 Mar 2013 1. Different questions, different approaches Forward causal inference: What might happen if we do X? Effects

More information

Economics 2010a. Fall Lecture 11. Edward L. Glaeser

Economics 2010a. Fall Lecture 11. Edward L. Glaeser Economics 2010a Fall 2003 Lecture 11 Edward L. Glaeser Final notes how to write a theory paper: (1) A highbrow theory paper go talk to Jerry or Drew don t listen to me. (2) A lowbrow or applied theory

More information

Political Science 15, Winter 2014 Final Review

Political Science 15, Winter 2014 Final Review Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically

More information

TAXOTERE: WHAT YOU NEED TO KNOW ABOUT IT

TAXOTERE: WHAT YOU NEED TO KNOW ABOUT IT TAXOTERE: WHAT YOU NEED TO KNOW ABOUT IT 1 Fighting breast cancer is a very emotional battle for women. Doctors are trying to save the lives of women by trying new and innovative methods and drugs. One

More information

DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Research Methods Posc 302 ANALYSIS OF SURVEY DATA

DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Research Methods Posc 302 ANALYSIS OF SURVEY DATA DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Research Methods Posc 302 ANALYSIS OF SURVEY DATA I. TODAY S SESSION: A. Second steps in data analysis and interpretation 1. Examples and explanation

More information

Econ 270: Theoretical Modeling 1

Econ 270: Theoretical Modeling 1 Econ 270: Theoretical Modeling 1 Economics is certainly not the only social science to use mathematical theoretical models to examine a particular question. But economics, since the 1960s, has evolved

More information

Sampling for Impact Evaluation. Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015

Sampling for Impact Evaluation. Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015 Sampling for Impact Evaluation Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015 How many hours do you expect to sleep tonight? A. 2 or less B. 3 C.

More information

For each of the following cases, describe the population, sample, population parameters, and sample statistics.

For each of the following cases, describe the population, sample, population parameters, and sample statistics. Chapter 5: Statistical Reasoning Section 5A Fundamentals of Statistics Statistics is the science of collecting, organizing and interpreting data Statistics is the data that describe or summarize something

More information

Chapter Eight: Multivariate Analysis

Chapter Eight: Multivariate Analysis Chapter Eight: Multivariate Analysis Up until now, we have covered univariate ( one variable ) analysis and bivariate ( two variables ) analysis. We can also measure the simultaneous effects of two or

More information

Practice for Exam 1 Econ B2000, MA Econometrics Kevin R Foster, CCNY Fall 2011

Practice for Exam 1 Econ B2000, MA Econometrics Kevin R Foster, CCNY Fall 2011 Practice for Exam 1 Econ B2000, MA Econometrics Kevin R Foster, CCNY Fall 2011 Not all of these questions are strictly relevant; some might require a bit of knowledge that we haven't covered this year,

More information

2015 Survey on Prescription Drugs

2015 Survey on Prescription Drugs 2015 Survey on Prescription Drugs AARP Research January 26, 2016 (For media inquiries, contact Gregory Phillips at 202-434-2544 or gphillips@aarp.org) https://doi.org/10.26419/res.00122.001 Objectives

More information

Supporting Information

Supporting Information Supporting Information Baldwin and Lammers 10.1073/pnas.1610834113 SI Methods and Results The patterns of predicted results were not affected when age, race (non-white = 0, White = 1), sex (female = 0,

More information

Handout: Instructions for 1-page proposal (including a sample)

Handout: Instructions for 1-page proposal (including a sample) 15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 1 (Given by Head TA) Handout: Instructions for 1-page proposal (including a sample) Contact info given: email, phone, office Self description

More information

Multiple Comparisons and the Known or Potential Error Rate

Multiple Comparisons and the Known or Potential Error Rate Journal of Forensic Economics 19(2), 2006, pp. 231-236 2007 by the National Association of Forensic Economics Multiple Comparisons and the Known or Potential Error Rate David Tabak * I. Introduction Many

More information

Sheila Barron Statistics Outreach Center 2/8/2011

Sheila Barron Statistics Outreach Center 2/8/2011 Sheila Barron Statistics Outreach Center 2/8/2011 What is Power? When conducting a research study using a statistical hypothesis test, power is the probability of getting statistical significance when

More information

Survey Research. We can learn a lot simply by asking people what we want to know... THE PREVALENCE OF SURVEYS IN COMMUNICATION RESEARCH

Survey Research. We can learn a lot simply by asking people what we want to know... THE PREVALENCE OF SURVEYS IN COMMUNICATION RESEARCH Survey Research From surveys we can learn how large groups of people think and act. To trust generalizations made on the basis of surveys, however, the sample must be representative, the response rate

More information

ECON Microeconomics III

ECON Microeconomics III ECON 7130 - Microeconomics III Spring 2016 Notes for Lecture #5 Today: Difference-in-Differences (DD) Estimators Difference-in-Difference-in-Differences (DDD) Estimators (Triple Difference) Difference-in-Difference

More information

Theory Building and Hypothesis Testing. POLI 205 Doing Research in Politics. Theory. Building. Hypotheses. Testing. Fall 2015

Theory Building and Hypothesis Testing. POLI 205 Doing Research in Politics. Theory. Building. Hypotheses. Testing. Fall 2015 and and Fall 2015 and The Road to Scientific Knowledge and Make your Theories Causal Think in terms of causality X causes Y Basis of causality Rules of the Road Time Ordering: The cause precedes the effect

More information

Measuring Impact. Program and Policy Evaluation with Observational Data. Daniel L. Millimet. Southern Methodist University.

Measuring Impact. Program and Policy Evaluation with Observational Data. Daniel L. Millimet. Southern Methodist University. Measuring mpact Program and Policy Evaluation with Observational Data Daniel L. Millimet Southern Methodist University 23 May 2013 DL Millimet (SMU) Observational Data May 2013 1 / 23 ntroduction Measuring

More information

Quasi-experimental analysis Notes for "Structural modelling".

Quasi-experimental analysis Notes for Structural modelling. Quasi-experimental analysis Notes for "Structural modelling". Martin Browning Department of Economics, University of Oxford Revised, February 3 2012 1 Quasi-experimental analysis. 1.1 Modelling using quasi-experiments.

More information

Introduction to Applied Research in Economics Kamiljon T. Akramov, Ph.D. IFPRI, Washington, DC, USA

Introduction to Applied Research in Economics Kamiljon T. Akramov, Ph.D. IFPRI, Washington, DC, USA Introduction to Applied Research in Economics Kamiljon T. Akramov, Ph.D. IFPRI, Washington, DC, USA Training Course on Applied Econometric Analysis June 1, 2015, WIUT, Tashkent, Uzbekistan Why do we need

More information

SAMPLING AND SAMPLE SIZE

SAMPLING AND SAMPLE SIZE SAMPLING AND SAMPLE SIZE Andrew Zeitlin Georgetown University and IGC Rwanda With slides from Ben Olken and the World Bank s Development Impact Evaluation Initiative 2 Review We want to learn how a program

More information

Abdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs Spring 2009

Abdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs Spring 2009 MIT OpenCourseWare http://ocw.mit.edu Abdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs Spring 2009 For information about citing these materials or our Terms of Use,

More information

Bias in Sampling. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics

Bias in Sampling. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics Bias in Sampling MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Bias If the results of the sample are not representative of the population, then the sample has

More information

How Can We Improve the Blood Donation Process in the United States?

How Can We Improve the Blood Donation Process in the United States? How Can We Improve the Blood Donation Process in the United States? By H. H. Modeling Team: H. H. and Hilary Johnson Wilson High School Math Modeling and System Dynamics May 8, 009 System Dynamics Advisor:

More information

Sampling Controlled experiments Summary. Study design. Patrick Breheny. January 22. Patrick Breheny Introduction to Biostatistics (BIOS 4120) 1/34

Sampling Controlled experiments Summary. Study design. Patrick Breheny. January 22. Patrick Breheny Introduction to Biostatistics (BIOS 4120) 1/34 Sampling Study design Patrick Breheny January 22 Patrick Breheny to Biostatistics (BIOS 4120) 1/34 Sampling Sampling in the ideal world The 1936 Presidential Election Pharmaceutical trials and children

More information

CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH

CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH Why Randomize? This case study is based on Training Disadvantaged Youth in Latin America: Evidence from a Randomized Trial by Orazio Attanasio,

More information

Sleeping Beauty is told the following:

Sleeping Beauty is told the following: Sleeping beauty Sleeping Beauty is told the following: You are going to sleep for three days, during which time you will be woken up either once Now suppose that you are sleeping beauty, and you are woken

More information

ELECTION NIGHT 2018 HOT SHEET

ELECTION NIGHT 2018 HOT SHEET ELECTION NIGHT 2018 HOT SHEET YOUR GUIDE TO PROFIT FROM MARIJUANA S TIPPING POINT MOMENT SEVEN FIGURE PUBLISHING Election Night 2018 HOT SHEET Your Guide to Profit from Marijuana s Tipping Point Moment

More information

Why randomize? Rohini Pande Harvard University and J-PAL.

Why randomize? Rohini Pande Harvard University and J-PAL. Why randomize? Rohini Pande Harvard University and J-PAL www.povertyactionlab.org Agenda I. Background on Program Evaluation II. What is a randomized experiment? III. Advantages and Limitations of Experiments

More information

Multiple Linear Regression (Dummy Variable Treatment) CIVL 7012/8012

Multiple Linear Regression (Dummy Variable Treatment) CIVL 7012/8012 Multiple Linear Regression (Dummy Variable Treatment) CIVL 7012/8012 2 In Today s Class Recap Single dummy variable Multiple dummy variables Ordinal dummy variables Dummy-dummy interaction Dummy-continuous/discrete

More information

Pooling Subjective Confidence Intervals

Pooling Subjective Confidence Intervals Spring, 1999 1 Administrative Things Pooling Subjective Confidence Intervals Assignment 7 due Friday You should consider only two indices, the S&P and the Nikkei. Sorry for causing the confusion. Reading

More information

Project Evaluation from Application to Econometric Theory: A Qualitative Explanation of Difference in Difference (DiD) Approach

Project Evaluation from Application to Econometric Theory: A Qualitative Explanation of Difference in Difference (DiD) Approach International Journal of Data Science and Analysis 2017; 3(1): 5-12 http://www.sciencepublishinggroup.com/j/ijdsa doi: 10.11648/j.ijdsa.20170301.12 Project Evaluation from Application to Econometric Theory:

More information

Objectives. Quantifying the quality of hypothesis tests. Type I and II errors. Power of a test. Cautions about significance tests

Objectives. Quantifying the quality of hypothesis tests. Type I and II errors. Power of a test. Cautions about significance tests Objectives Quantifying the quality of hypothesis tests Type I and II errors Power of a test Cautions about significance tests Designing Experiments based on power Evaluating a testing procedure The testing

More information

CAMPAIGN FOR TOBACCO-FREE KIDS SURVEY OF WASHINGTON VOTERS Raising the Age of Tobacco Sales DECEMBER 2015.

CAMPAIGN FOR TOBACCO-FREE KIDS SURVEY OF WASHINGTON VOTERS Raising the Age of Tobacco Sales DECEMBER 2015. CAMPAIGN FOR TOBACT CCO-FREE KIDS SURVEY OF WASHINGTON VOTERS Raising the Age of Tobacco Sales DECEMBER 2015. METHODOLOGY SAMPLE: TECHNIQUE: 500 Registered Voters in Washington state Telephone Survey Live

More information

Does It Pay To Work During Study? The Effect Of Student Employment On Later Hiring Chances

Does It Pay To Work During Study? The Effect Of Student Employment On Later Hiring Chances Does It Pay To Work During Study? The Effect Of Student Employment On Later Hiring Chances Stijn Baert, Eddy Omey, Olivier Rotsaert and Dieter Verhaest Does It Pay To Work During Study? The Effect Of Student

More information

Recent advances in non-experimental comparison group designs

Recent advances in non-experimental comparison group designs Recent advances in non-experimental comparison group designs Elizabeth Stuart Johns Hopkins Bloomberg School of Public Health Department of Mental Health Department of Biostatistics Department of Health

More information

Section The Question of Causation

Section The Question of Causation Section 2.5 - The Question of Causation Statistics 104 Autumn 2004 Copyright c 2004 by Mark E. Irwin Causation Does smoking cause cancer? Did chemical weapons exposure cause health problems in Gulf War

More information

Section 2: Data & Measurement

Section 2: Data & Measurement Section 2: Data & Measurement Michael Gill Gov 50 September 21, 2011 Outline (0) Questions/Concerns (1) Review of Lecture (2) Measurement (3) Sampling Last Week Last week, we talked about theories, which

More information

The Assisted Decision-Making (Capacity) Act 2015 and the Decision Support Service

The Assisted Decision-Making (Capacity) Act 2015 and the Decision Support Service The Assisted Decision-Making (Capacity) Act 2015 and the Decision Support Service Inclusion Ireland AGM 9/6/2018 Áine Flynn Director of the Decision Support Service 1 Assisted Decision-Making Capacity

More information

I. Survey Methodology

I. Survey Methodology I. Survey Methodology The Elon University Poll is conducted using a stratified random sample of households with telephones in the population of interest in this case, citizens in North Carolina. The sample

More information

15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA

15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA 15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA Statistics does all kinds of stuff to describe data Talk about baseball, other useful stuff We can calculate the probability.

More information

Doing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling. Olli-Pekka Kauppila Daria Kautto

Doing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling. Olli-Pekka Kauppila Daria Kautto Doing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling Olli-Pekka Kauppila Daria Kautto Session VI, September 20 2017 Learning objectives 1. Get familiar with the basic idea

More information

M E M O R A N D U M. Peter D. Hart Research Associates, Inc./ American Viewpoint

M E M O R A N D U M. Peter D. Hart Research Associates, Inc./ American Viewpoint Peter D. Hart Research Associates, Inc./ American Viewpoint 1724 Connecticut Avenue, N.W. Washington, D.C. 20009 202-234-5570 202-232-8134 FAX M E M O R A N D U M TO: FROM: ALL INTERESTED PARTIES PETER

More information

Technical Track Session IV Instrumental Variables

Technical Track Session IV Instrumental Variables Impact Evaluation Technical Track Session IV Instrumental Variables Christel Vermeersch Beijing, China, 2009 Human Development Human Network Development Network Middle East and North Africa Region World

More information

Do Comparisons of Fictional Applicants Measure Discrimination When Search Externalities Are Present? Evidence from Existing Experiments

Do Comparisons of Fictional Applicants Measure Discrimination When Search Externalities Are Present? Evidence from Existing Experiments Do Comparisons of Fictional Applicants Measure Discrimination When Search Externalities Are Present? Evidence from Existing Experiments David C. Phillips 1 Wilson Sheehan Lab for Economic Opportunities

More information

Study Design. Study design. Patrick Breheny. January 23. Patrick Breheny Introduction to Biostatistics (171:161) 1/34

Study Design. Study design. Patrick Breheny. January 23. Patrick Breheny Introduction to Biostatistics (171:161) 1/34 Study design Patrick Breheny January 23 Patrick Breheny Introduction to Biostatistics (171:161) 1/34 in the ideal world In an ideal world, We have a list of everyone in the population of interest We randomly

More information

How to CRITICALLY APPRAISE

How to CRITICALLY APPRAISE How to CRITICALLY APPRAISE an RCT in 10 minutes James McCormack BSc(Pharm), Pharm D Professor Faculty of Pharmaceutical Sciences, UBC Vancouver, BC, Canada medicationmythbusters.com CRITICAL APPRAISAL

More information

WE CAN DO AMAZING THINGS TOGETHER.

WE CAN DO AMAZING THINGS TOGETHER. WE CAN DO AMAZING THINGS TOGETHER. BECOME A PARTNER TODAY. As a member of Partners for Life, you ll give and receive. Because doing good for the community is also good for your business, group or organization,

More information

WELLBEING: The Happiness Advantage

WELLBEING: The Happiness Advantage WELLBEING: The Happiness Advantage Why is The Happiness Advantage so important? Not just knowing but applying the Happiness Advantage Principles that say when you are more happy and positive you overcome

More information