Establishing Causality Convincingly: Some Neat Tricks
|
|
- Lambert Page
- 5 years ago
- Views:
Transcription
1 Establishing Causality Convincingly: Some Neat Tricks
2 Establishing Causality In the last set of notes, I discussed how causality can be difficult to establish in a straightforward OLS context If assumptions for unbiasedness hold, you re OK. But generally x will be endogenous, meaning that the zero conditional mean assumption will fail (i.e. the assumptions for unbiasedness won t hold) Snow s study of how cholera spreads gave a nice example of how finding exogenous variation in x (i.e. variation uncorrelated with the error term) can lead to convincing findings on causality.
3 Establishing Causality Variables (x) that are chosen by individuals are likely to be endogenous Whether I smoke How much I exercise Whether I save a lot or a little If we want to find the effect of such things on y, we have to worry about this endogeneity Ideally, what we d like is to exogenize x; use only the exogenous component of the variation in x to test for x s causal effect on y.
4 Isolating Exogenous Variation in x Take something like an individual s level of education and its effect on the wage. Individual chooses how much education to get Therefore x and u will be correlated, if unobserved differences between individuals with high education and low education are contained in u (e.g. work ethic) To some extent one s choice of education is a function of personal choice (endogenous component), but to some extent it s also a function of factors that are arguably random (exogenous component) What the minimum school drop-out age is in one s province (affects how many years of education some people get) How close one lives to a university (affects cost of attendance; therefore decision to attend)
5 Isolating Exogenous Variation in x If we can isolate the exogenous variation in x, we can use that variation to identify the causal effect of x on y. Remember, the ideal randomized experiment to determine the effect of education on the wage is to randomly sprinkle people with different levels of education and compare their wages. Suppose people are randomly sprinkled with various shocks to their decisionmaking that affect their choice of education. The variation in education that results from these random factors can be treated as random (thus exogenous). The rest of the variation in education should be treated as endogenous.
6 Example: Instrumental Variables One technique that does this is called instrumental variables (IV) estimation. This has become very popular in empirical economics. The idea is to take an endog RHS variable like educ, and find something that exogenously shifts it around. The intuition is essentially to regress educ on this exogenous shifter, predict values of educ using values of the exogenous shifter, and then substitute these predicted values of educ into the wage equation. The variation in educ should now be greatly diminished because the endogenous component has been removed This means standard error of the coefficient on educ will go up But the coefficient will be estimated using only exogenous variation in educ. This removes bias due to endogeneity of educ
7 Example: Instrumental Variables The exogenous shifter is called an instrumental variable or an instrument The estimator we obtain is called the IV estimator (as opposed to the OLS estimator) Picking a good instrument is essential to obtaining reliable IV estimators Suppose we are testing the effect of x on y, but we believe x is endogenous. Need an instrument, z, that is both: 1) Correlated with x (the stronger the better) 2) Uncorrelated with u (this means z only affects y through its effect on x)
8 Example: Instrumental Variables More formally, let s assume we want to estimate y = β 0 + β 1 x + u But we have reason to believe that x is endogenous (correlated with u) If we estimate the model as is, then our estimate of the effect of x on y will be biased Suppose that z affects x but has no effect (other than through x) on y Can instrument for z with x.
9 Example: Instrumental Variables Remember our OLS estimator is an approximation (using data) of Cov(x,y)/Var(x). This means it uses all variation in x and all covariation between x and y, whether endogenous or exogenous Consider Cov(z,y) where z is an instrument for x. Intuitively, this is the variation in y due to variation in x caused by variation in the exogenous instrument z (because the only way z affects y is through variation it causes in x).
10 Example: Instrumental Variables Cov(z, y) = Cov[z,(β 0 + β 1 x + u) β 1 = = β 1 Cov(z, x) + Cov(z,u) Cov(z, y) Cov(z, x) Note that Cov(z,u)=0 by assumption of z being exogenous We can get the sample analog of this ˆβ 1 IV = n i=1 (z i z )(y i y) (z i z )(x i x)
11 Example: Instrumental Variables This is very straightforward to estimate using a statistical package like EViews Using IV, you ve arguably done what Snow did by searching out a form of exogenous variation in water contamination levels To put this back in the randomized trials context, you can think of z as causing random variation in x which then allows you to treat x as if it s truly random. Note that if z is correlated with u in the original equation, then you can get into serious trouble IV estimator can be more biased than OLS estimator Also note that because we re only using exogeous variation in x to identify the causal effect of x on y, the standard error on the coeff on x will be much higher than it is with OLS (which uses all variation in x)
12 Some Famous Instruments Think back to our wage equation and the effect of education Important policy question What are some instruments for education? Proximity to a 4-year university may affect an individual s decision whether or not to attend university; this location might be able to be treated as random. Parents education; arguably this says something about the educational values you were exposed to growing up. Might be able to view this as random. Here s a neat one: quarter of birth. Why?
13 Some Famous Instruments Quarter of Birth In US and Canada students enter school according to a set formula (e.g. If you turn 5 by December 31st of a year, you start kindergarten that year) There are also minimum dropout ages (e.g. age 16 in many states/provinces) The interaction of these two policies causes a certain amount of variation in the years of education that people get. Example: If a kid turns 5 on Dec 31 this year, she starts school this year; if she turns 5 on January 1, she starts school next year. Yet, both kids turn 16 at essentially same time, so if both drop out at 16, one will have 1 more year of education than the other
14 Some Famous Instruments Arguably one s quarter of birth should be completely random Yet, the quarter of birth causes some people to have more education than others. A source of exogenous variation! A very famous paper (Angrist and Kreuger, 1991) exploited this idea to estimate the effect of an extra year of education Actually find a higher return to education using this instrument than people had typically found with OLS (about a 10% increase in earnings)
15 Some Famous Instruments Vietnam draft number Following Vietnam war, people became interested in the experience that Vietnam vets had in labour market Lots of stories of stress, emotional problems among returning troops Whether one served in Vietnam is arguably endogenous, because some chose to serve Choosers to serve may differ fundamentally from choosers not to serve Ideally, we want something that randomly forces some people to serve and some not to serve Draft number! A source of exogenous variation in whether you served in Vietnam or not.
16 Some more on IV estimation There are lots of potential instruments out there; creative use of them tends to be rewarded with (potentially more) convincing findings and publications But some cautionary notes IV estimates are biased but consistent Tend to have high standard errors (difficult to reject null) For both these reasons, large samples are needed If your instrument is badly chosen so that it is correlated with u you can make things worse than OLS by doing IV estimation Finally, IV estimation can only say something about the part of the sample the exogenous variation occurs in QOB only causes variation among high school dropouts. Therefore the estimate we obtain using this instrument only gives the return to an extra year of education for someone on the margin of dropping out. The effect could be much different for non-marginal students. This is called the local average treatment effect problem (LATE)
17 Example: Regression Discontinuity Design This is another nifty way to come up with plausibly exogenous variation in x Suppose x is determined by a stochastic process that involves a discontinuity Example: Some states in US have local budget referenda that determine school spending for individual districts. If the new budget is approved, spending rises to the proposed level. If it s rejected, spending falls to some state-mandated minimum. 50% plus 1 vote passes the budget, 50% minus 1 vote fails to pass the budget. Arguably the number of votes for the budget is partly randomly determined. Outcome is highly discontinuous; a small perturbation in the number of votes leads to big variation in the budget size
18 Example: Regression Discontinuity Design (RD) Why is this useful? One could simply regress some student outcome, like score on a standardized test, on level of spending in each school district. The problem is that spending in a school district is likely correlated with unobservable determinants of a student s performance on a standardized test Parents may care more about child s education in highspending districts than in low-spending districts, may not have a care variable to control for this Hence coefficient on spending would likely be biased (positively in this case) The RD approach lets us compare districts with close voting outcomes (say all those that were 50-51% for against those that were 49-50% for the budget)
19 Example: Regression Discontinuity Design (RD) Districts that vote 80% for maybe different than those that vote 20% for in unobservable ways However, arguably districts that vote 51% for are virtually identical to districts that vote 49% for. Yet, there s a huge difference in spending outcomes for these districts Arguably the difference in voting outcomes is driven by randomness (maybe there was a traffic jam in the second district that caused a few busy parents not to make it to the polls in time) If this is true, then the variation we get in spending between the 51% and 49% districts is completely exogenous
20 Example: Regression Discontinuity Design (RD) Therefore, we may be more inclined to trust the results we get with an RD approach than with a straight OLS regression of test score on spending Another voting example was the 2000 US presidential election. Suppose you re interested in how different industries perform under different political parties More specifically, how does having a Republican in the White House affect stock price performance of drug companies or oil companies?
21 Example: Regression Discontinuity Design (RD) You could simply compare stock price performances of an index of oil companies over various presidential administrations, and include a dummy for party in White House. (basic time series analysis) However, there may be factors correlated with who is in the White House that affect stock price of oil companies Maybe people vote Republican when they re worried we re running short of oil. So the standard OLS approach would be suspect
22 Example: Regression Discontinuity Design (RD) The 2000 election provided a great RD experiment The day of the election, no one knew with any confidence who was going to win. People were speculating that the result would probably depend on the weather in a few key states (i.e. the outcome was essentially going to be a coin toss--random!) The result was determined by a Supreme Court ruling.
23 Example: Regression Discontinuity Design (RD) People could essentially treat price changes in various stocks between Election Day and the Supreme Court ruling as a function of a coin toss on the presidential election outcome The fact that the party in power shifted from Democrat to Republican could basically be attributed to randomness (the 500 vote margin in Florida) Many studies were actually done exploiting this experiment
24 Natural Experiments These types of empirical approaches are generally referred to as natural experiments The name points to the way in which they approximate randomized trials Ethically, randomized trials couldn t be used in any of these studies. However, researchers if researchers find ways that nature imparts some randomness on x, they can exploit that randomness as if a randomized trial had been done. Often times we can learn much more about the relationship between two variables if we employ this type of an approach
25 unnatural Experiments in Economics Randomized trials are sometimes used in economics Lab experiments Interested students should consider Dr. Rondeau s occasionally offered experiments course (400 level) Honours students (e.g. Shiva Shirazi-Kia) sometimes perform experiments as part of thesis research. Field experiments Dr. Rondeau: Fundraising letters (getting permission from charities to vary wording of appeals to donors) There s a large literature on private contributions to public goods that considers the motivation of those who donate to charity Studies of strategic behavior
26 unnatural Experiments in Economics Bertrand and Mullainathan resume studies Researchers sent job application cover letter and resumes out to employers who were advertising openings Used a core set of resumes and a core set of cover letters Varied names of applicants Chose some names to be black (e.g. Tyrone Jackson, Shanika Jefferson) and some names to be white (e.g. Dylan Peters, Ashley Hutchinson) Mailed resumes with different names to employers, found that black names got fewer callbacks for interviews than white names This is considered a field experiment Phil Oreopoulos at UBC/U Toronto has done similar experiments in the BC labor market looking at discrimination against immigrants (people with East Asian and South Asian names versus those with Caucasian names) Note, you can use econometrics to analyze data in studies like these, but you often can get by with simple techniques like OLS.
Class 1: Introduction, Causality, Self-selection Bias, Regression
Class 1: Introduction, Causality, Self-selection Bias, Regression Ricardo A Pasquini April 2011 Ricardo A Pasquini () April 2011 1 / 23 Introduction I Angrist s what should be the FAQs of a researcher:
More informationApplied Quantitative Methods II
Applied Quantitative Methods II Lecture 7: Endogeneity and IVs Klára Kaĺıšková Klára Kaĺıšková AQM II - Lecture 7 VŠE, SS 2016/17 1 / 36 Outline 1 OLS and the treatment effect 2 OLS and endogeneity 3 Dealing
More informationInstrumental Variables Estimation: An Introduction
Instrumental Variables Estimation: An Introduction Susan L. Ettner, Ph.D. Professor Division of General Internal Medicine and Health Services Research, UCLA The Problem The Problem Suppose you wish to
More informationEMPIRICAL STRATEGIES IN LABOUR ECONOMICS
EMPIRICAL STRATEGIES IN LABOUR ECONOMICS University of Minho J. Angrist NIPE Summer School June 2009 This course covers core econometric ideas and widely used empirical modeling strategies. The main theoretical
More informationAugust 29, Introduction and Overview
August 29, 2018 Introduction and Overview Why are we here? Haavelmo(1944): to become master of the happenings of real life. Theoretical models are necessary tools in our attempts to understand and explain
More informationThe Limits of Inference Without Theory
The Limits of Inference Without Theory Kenneth I. Wolpin University of Pennsylvania Koopmans Memorial Lecture (2) Cowles Foundation Yale University November 3, 2010 Introduction Fuller utilization of the
More informationCarrying out an Empirical Project
Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric
More informationMethods for Addressing Selection Bias in Observational Studies
Methods for Addressing Selection Bias in Observational Studies Susan L. Ettner, Ph.D. Professor Division of General Internal Medicine and Health Services Research, UCLA What is Selection Bias? In the regression
More informationA NON-TECHNICAL INTRODUCTION TO REGRESSIONS. David Romer. University of California, Berkeley. January Copyright 2018 by David Romer
A NON-TECHNICAL INTRODUCTION TO REGRESSIONS David Romer University of California, Berkeley January 2018 Copyright 2018 by David Romer CONTENTS Preface ii I Introduction 1 II Ordinary Least Squares Regression
More informationInstrumental Variables I (cont.)
Review Instrumental Variables Observational Studies Cross Sectional Regressions Omitted Variables, Reverse causation Randomized Control Trials Difference in Difference Time invariant omitted variables
More informationEconomics 345 Applied Econometrics
Economics 345 Applied Econometrics Lab Exam Version 1: Solutions Fall 2016 Prof: Martin Farnham TAs: Joffré Leroux Rebecca Wortzman Last Name (Family Name) First Name Student ID Open EViews, and open the
More informationProblem Set 5 ECN 140 Econometrics Professor Oscar Jorda. DUE: June 6, Name
Problem Set 5 ECN 140 Econometrics Professor Oscar Jorda DUE: June 6, 2006 Name 1) Earnings functions, whereby the log of earnings is regressed on years of education, years of on-the-job training, and
More informationRegression Discontinuity Design (RDD)
Regression Discontinuity Design (RDD) Caroline Flammer Ivey Business School 2015 SMS Denver Conference October 4, 2015 The Identification Challenge Does X cause Y? Tempting to regress Y on X Y = a + b
More informationWhat is: regression discontinuity design?
What is: regression discontinuity design? Mike Brewer University of Essex and Institute for Fiscal Studies Part of Programme Evaluation for Policy Analysis (PEPA), a Node of the NCRM Regression discontinuity
More informationLecture II: Difference in Difference. Causality is difficult to Show from cross
Review Lecture II: Regression Discontinuity and Difference in Difference From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused
More informationStat 13, Intro. to Statistical Methods for the Life and Health Sciences.
Stat 13, Intro. to Statistical Methods for the Life and Health Sciences. 0. SEs for percentages when testing and for CIs. 1. More about SEs and confidence intervals. 2. Clinton versus Obama and the Bradley
More informationDylan Small Department of Statistics, Wharton School, University of Pennsylvania. Based on joint work with Paul Rosenbaum
Instrumental variables and their sensitivity to unobserved biases Dylan Small Department of Statistics, Wharton School, University of Pennsylvania Based on joint work with Paul Rosenbaum Overview Instrumental
More informationSession 1: Dealing with Endogeneity
Niehaus Center, Princeton University GEM, Sciences Po ARTNeT Capacity Building Workshop for Trade Research: Behind the Border Gravity Modeling Thursday, December 18, 2008 Outline Introduction 1 Introduction
More informationCitation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n.
University of Groningen Latent instrumental variables Ebbes, P. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document
More informationAssessing Studies Based on Multiple Regression. Chapter 7. Michael Ash CPPA
Assessing Studies Based on Multiple Regression Chapter 7 Michael Ash CPPA Assessing Regression Studies p.1/20 Course notes Last time External Validity Internal Validity Omitted Variable Bias Misspecified
More informationSession 3: Dealing with Reverse Causality
Principal, Developing Trade Consultants Ltd. ARTNeT Capacity Building Workshop for Trade Research: Gravity Modeling Thursday, August 26, 2010 Outline Introduction 1 Introduction Overview Endogeneity and
More informationMEA DISCUSSION PAPERS
Inference Problems under a Special Form of Heteroskedasticity Helmut Farbmacher, Heinrich Kögel 03-2015 MEA DISCUSSION PAPERS mea Amalienstr. 33_D-80799 Munich_Phone+49 89 38602-355_Fax +49 89 38602-390_www.mea.mpisoc.mpg.de
More informationGlossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha
Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha attrition: When data are missing because we are unable to measure the outcomes of some of the
More informationPrinciple underlying all of statistics
Sampling Bias Principle underlying all of statistics Drawing inferences from a suitable sample of a population is far less labor intensive than, but can be equally as informative as, studying the entire
More informationProbability Models for Sampling
Probability Models for Sampling Chapter 18 May 24, 2013 Sampling Variability in One Act Probability Histogram for ˆp Act 1 A health study is based on a representative cross section of 6,672 Americans age
More informationMarno Verbeek Erasmus University, the Netherlands. Cons. Pros
Marno Verbeek Erasmus University, the Netherlands Using linear regression to establish empirical relationships Linear regression is a powerful tool for estimating the relationship between one variable
More information1 Simple and Multiple Linear Regression Assumptions
1 Simple and Multiple Linear Regression Assumptions The assumptions for simple are in fact special cases of the assumptions for multiple: Check: 1. What is external validity? Which assumption is critical
More informationThe Logic of Causal Order Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 15, 2015
The Logic of Causal Order Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 15, 2015 [NOTE: Toolbook files will be used when presenting this material] First,
More informationEC352 Econometric Methods: Week 07
EC352 Econometric Methods: Week 07 Gordon Kemp Department of Economics, University of Essex 1 / 25 Outline Panel Data (continued) Random Eects Estimation and Clustering Dynamic Models Validity & Threats
More informationWRITTEN PRELIMINARY Ph.D. EXAMINATION. Department of Applied Economics. January 17, Consumer Behavior and Household Economics.
WRITTEN PRELIMINARY Ph.D. EXAMINATION Department of Applied Economics January 17, 2012 Consumer Behavior and Household Economics Instructions Identify yourself by your code letter, not your name, on each
More informationChapter 1 Review Questions
Chapter 1 Review Questions 1.1 Why is the standard economic model a good thing, and why is it a bad thing, in trying to understand economic behavior? A good economic model is simple and yet gives useful
More informationSOME NOTES ON THE INTUITION BEHIND POPULAR ECONOMETRIC TECHNIQUES
SOME NOTES ON THE INTUITION BEHIND POPULAR ECONOMETRIC TECHNIQUES These notes have been put together by Dave Donaldson (EC307 class teacher 2004-05) and by Hannes Mueller (EC307 class teacher 2004-present).
More informationCorrelation Ex.: Ex.: Causation: Ex.: Ex.: Ex.: Ex.: Randomized trials Treatment group Control group
Ch. 3 1 Public economists use empirical tools to test theory and estimate policy effects. o Does the demand for illicit drugs respond to price changes (what is the elasticity)? o Do reduced welfare benefits
More informationCausality and Statistical Learning
Department of Statistics and Department of Political Science, Columbia University 29 Sept 2012 1. Different questions, different approaches Forward causal inference: What might happen if we do X? Effects
More informationProblems to go with Mastering Metrics Steve Pischke
Problems to go with Mastering Metrics Steve Pischke Chapter 1 1. Consider the following three causal questions: Many firms, particularly in southern European countries, are small, and owned and run by
More informationThe Economics of Obesity
The Economics of Obesity John Cawley Cornell University Usefulness of Economics in Studying Obesity Offers widely-accepted theoretical framework for human behavior (constrained maximization) We ask different
More informationRandomized Evaluations
Randomized Evaluations Introduction, Methodology, & Basic Econometrics using Mexico s Progresa program as a case study (with thanks to Clair Null, author of 2008 Notes) Sept. 15, 2009 Not All Correlations
More informationLecture II: Difference in Difference and Regression Discontinuity
Review Lecture II: Difference in Difference and Regression Discontinuity it From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused
More informationMotherhood and Female Labor Force Participation: Evidence from Infertility Shocks
Motherhood and Female Labor Force Participation: Evidence from Infertility Shocks Jorge M. Agüero Univ. of California, Riverside jorge.aguero@ucr.edu Mindy S. Marks Univ. of California, Riverside mindy.marks@ucr.edu
More informationThe Issue of Endogeneity within Theory-Based, Quantitative Management Accounting Research
European Accounting Review Vol. 16, No. 1, 173 195, 2007 The Issue of Endogeneity within Theory-Based, Quantitative Management Accounting Research ROBERT H. CHENHALL, & FRANK MOERS Monash University, James
More informationIntroduction to Observational Studies. Jane Pinelis
Introduction to Observational Studies Jane Pinelis 22 March 2018 Outline Motivating example Observational studies vs. randomized experiments Observational studies: basics Some adjustment strategies Matching
More informationSchool Autonomy and Regression Discontinuity Imbalance
School Autonomy and Regression Discontinuity Imbalance Todd Kawakita 1 and Colin Sullivan 2 Abstract In this research note, we replicate and assess Damon Clark s (2009) analysis of school autonomy reform
More informationChapter Eight: Multivariate Analysis
Chapter Eight: Multivariate Analysis Up until now, we have covered univariate ( one variable ) analysis and bivariate ( two variables ) analysis. We can also measure the simultaneous effects of two or
More informationECONOMICS Component 2 Exploring Economic Issues
GCE AS Level NEW AS B520U20-1 S16-B520U20-1 ECONOMICS Component 2 Exploring Economic Issues A.M. MONDAY, 23 May 2016 2 hours B520U201 01 ADDITIONAL MATERIALS In addition to this examination paper, you
More informationPublic Policy & Evidence:
Public Policy & Evidence: How to discriminate, interpret and communicate scientific research to better inform society. Rachel Glennerster Executive Director J-PAL Global Press coverage of microcredit:
More informationReading and maths skills at age 10 and earnings in later life: a brief analysis using the British Cohort Study
Reading and maths skills at age 10 and earnings in later life: a brief analysis using the British Cohort Study CAYT Impact Study: REP03 Claire Crawford Jonathan Cribb The Centre for Analysis of Youth Transitions
More informationPros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany
Dan A. Black University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Matching as a regression estimator Matching avoids making assumptions about the functional form of the regression
More information(b) empirical power. IV: blinded IV: unblinded Regr: blinded Regr: unblinded α. empirical power
Supplementary Information for: Using instrumental variables to disentangle treatment and placebo effects in blinded and unblinded randomized clinical trials influenced by unmeasured confounders by Elias
More informationFacilitated Discussion Notes Autism and Mental Health May 12, 2014
Facilitated Discussion Notes Autism and Mental Health May 12, 2014 Below are notes distilling the comments made by participants during a Facilitated Discussion of this topic. Generally, the comments are
More informationCausality and Statistical Learning
Department of Statistics and Department of Political Science, Columbia University 27 Mar 2013 1. Different questions, different approaches Forward causal inference: What might happen if we do X? Effects
More informationEconomics 2010a. Fall Lecture 11. Edward L. Glaeser
Economics 2010a Fall 2003 Lecture 11 Edward L. Glaeser Final notes how to write a theory paper: (1) A highbrow theory paper go talk to Jerry or Drew don t listen to me. (2) A lowbrow or applied theory
More informationPolitical Science 15, Winter 2014 Final Review
Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically
More informationTAXOTERE: WHAT YOU NEED TO KNOW ABOUT IT
TAXOTERE: WHAT YOU NEED TO KNOW ABOUT IT 1 Fighting breast cancer is a very emotional battle for women. Doctors are trying to save the lives of women by trying new and innovative methods and drugs. One
More informationDEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Research Methods Posc 302 ANALYSIS OF SURVEY DATA
DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Research Methods Posc 302 ANALYSIS OF SURVEY DATA I. TODAY S SESSION: A. Second steps in data analysis and interpretation 1. Examples and explanation
More informationEcon 270: Theoretical Modeling 1
Econ 270: Theoretical Modeling 1 Economics is certainly not the only social science to use mathematical theoretical models to examine a particular question. But economics, since the 1960s, has evolved
More informationSampling for Impact Evaluation. Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015
Sampling for Impact Evaluation Maria Jones 24 June 2015 ieconnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015 How many hours do you expect to sleep tonight? A. 2 or less B. 3 C.
More informationFor each of the following cases, describe the population, sample, population parameters, and sample statistics.
Chapter 5: Statistical Reasoning Section 5A Fundamentals of Statistics Statistics is the science of collecting, organizing and interpreting data Statistics is the data that describe or summarize something
More informationChapter Eight: Multivariate Analysis
Chapter Eight: Multivariate Analysis Up until now, we have covered univariate ( one variable ) analysis and bivariate ( two variables ) analysis. We can also measure the simultaneous effects of two or
More informationPractice for Exam 1 Econ B2000, MA Econometrics Kevin R Foster, CCNY Fall 2011
Practice for Exam 1 Econ B2000, MA Econometrics Kevin R Foster, CCNY Fall 2011 Not all of these questions are strictly relevant; some might require a bit of knowledge that we haven't covered this year,
More information2015 Survey on Prescription Drugs
2015 Survey on Prescription Drugs AARP Research January 26, 2016 (For media inquiries, contact Gregory Phillips at 202-434-2544 or gphillips@aarp.org) https://doi.org/10.26419/res.00122.001 Objectives
More informationSupporting Information
Supporting Information Baldwin and Lammers 10.1073/pnas.1610834113 SI Methods and Results The patterns of predicted results were not affected when age, race (non-white = 0, White = 1), sex (female = 0,
More informationHandout: Instructions for 1-page proposal (including a sample)
15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 1 (Given by Head TA) Handout: Instructions for 1-page proposal (including a sample) Contact info given: email, phone, office Self description
More informationMultiple Comparisons and the Known or Potential Error Rate
Journal of Forensic Economics 19(2), 2006, pp. 231-236 2007 by the National Association of Forensic Economics Multiple Comparisons and the Known or Potential Error Rate David Tabak * I. Introduction Many
More informationSheila Barron Statistics Outreach Center 2/8/2011
Sheila Barron Statistics Outreach Center 2/8/2011 What is Power? When conducting a research study using a statistical hypothesis test, power is the probability of getting statistical significance when
More informationSurvey Research. We can learn a lot simply by asking people what we want to know... THE PREVALENCE OF SURVEYS IN COMMUNICATION RESEARCH
Survey Research From surveys we can learn how large groups of people think and act. To trust generalizations made on the basis of surveys, however, the sample must be representative, the response rate
More informationECON Microeconomics III
ECON 7130 - Microeconomics III Spring 2016 Notes for Lecture #5 Today: Difference-in-Differences (DD) Estimators Difference-in-Difference-in-Differences (DDD) Estimators (Triple Difference) Difference-in-Difference
More informationTheory Building and Hypothesis Testing. POLI 205 Doing Research in Politics. Theory. Building. Hypotheses. Testing. Fall 2015
and and Fall 2015 and The Road to Scientific Knowledge and Make your Theories Causal Think in terms of causality X causes Y Basis of causality Rules of the Road Time Ordering: The cause precedes the effect
More informationMeasuring Impact. Program and Policy Evaluation with Observational Data. Daniel L. Millimet. Southern Methodist University.
Measuring mpact Program and Policy Evaluation with Observational Data Daniel L. Millimet Southern Methodist University 23 May 2013 DL Millimet (SMU) Observational Data May 2013 1 / 23 ntroduction Measuring
More informationQuasi-experimental analysis Notes for "Structural modelling".
Quasi-experimental analysis Notes for "Structural modelling". Martin Browning Department of Economics, University of Oxford Revised, February 3 2012 1 Quasi-experimental analysis. 1.1 Modelling using quasi-experiments.
More informationIntroduction to Applied Research in Economics Kamiljon T. Akramov, Ph.D. IFPRI, Washington, DC, USA
Introduction to Applied Research in Economics Kamiljon T. Akramov, Ph.D. IFPRI, Washington, DC, USA Training Course on Applied Econometric Analysis June 1, 2015, WIUT, Tashkent, Uzbekistan Why do we need
More informationSAMPLING AND SAMPLE SIZE
SAMPLING AND SAMPLE SIZE Andrew Zeitlin Georgetown University and IGC Rwanda With slides from Ben Olken and the World Bank s Development Impact Evaluation Initiative 2 Review We want to learn how a program
More informationAbdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs Spring 2009
MIT OpenCourseWare http://ocw.mit.edu Abdul Latif Jameel Poverty Action Lab Executive Training: Evaluating Social Programs Spring 2009 For information about citing these materials or our Terms of Use,
More informationBias in Sampling. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics
Bias in Sampling MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Bias If the results of the sample are not representative of the population, then the sample has
More informationHow Can We Improve the Blood Donation Process in the United States?
How Can We Improve the Blood Donation Process in the United States? By H. H. Modeling Team: H. H. and Hilary Johnson Wilson High School Math Modeling and System Dynamics May 8, 009 System Dynamics Advisor:
More informationSampling Controlled experiments Summary. Study design. Patrick Breheny. January 22. Patrick Breheny Introduction to Biostatistics (BIOS 4120) 1/34
Sampling Study design Patrick Breheny January 22 Patrick Breheny to Biostatistics (BIOS 4120) 1/34 Sampling Sampling in the ideal world The 1936 Presidential Election Pharmaceutical trials and children
More informationCASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH
CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH Why Randomize? This case study is based on Training Disadvantaged Youth in Latin America: Evidence from a Randomized Trial by Orazio Attanasio,
More informationSleeping Beauty is told the following:
Sleeping beauty Sleeping Beauty is told the following: You are going to sleep for three days, during which time you will be woken up either once Now suppose that you are sleeping beauty, and you are woken
More informationELECTION NIGHT 2018 HOT SHEET
ELECTION NIGHT 2018 HOT SHEET YOUR GUIDE TO PROFIT FROM MARIJUANA S TIPPING POINT MOMENT SEVEN FIGURE PUBLISHING Election Night 2018 HOT SHEET Your Guide to Profit from Marijuana s Tipping Point Moment
More informationWhy randomize? Rohini Pande Harvard University and J-PAL.
Why randomize? Rohini Pande Harvard University and J-PAL www.povertyactionlab.org Agenda I. Background on Program Evaluation II. What is a randomized experiment? III. Advantages and Limitations of Experiments
More informationMultiple Linear Regression (Dummy Variable Treatment) CIVL 7012/8012
Multiple Linear Regression (Dummy Variable Treatment) CIVL 7012/8012 2 In Today s Class Recap Single dummy variable Multiple dummy variables Ordinal dummy variables Dummy-dummy interaction Dummy-continuous/discrete
More informationPooling Subjective Confidence Intervals
Spring, 1999 1 Administrative Things Pooling Subjective Confidence Intervals Assignment 7 due Friday You should consider only two indices, the S&P and the Nikkei. Sorry for causing the confusion. Reading
More informationProject Evaluation from Application to Econometric Theory: A Qualitative Explanation of Difference in Difference (DiD) Approach
International Journal of Data Science and Analysis 2017; 3(1): 5-12 http://www.sciencepublishinggroup.com/j/ijdsa doi: 10.11648/j.ijdsa.20170301.12 Project Evaluation from Application to Econometric Theory:
More informationObjectives. Quantifying the quality of hypothesis tests. Type I and II errors. Power of a test. Cautions about significance tests
Objectives Quantifying the quality of hypothesis tests Type I and II errors Power of a test Cautions about significance tests Designing Experiments based on power Evaluating a testing procedure The testing
More informationCAMPAIGN FOR TOBACCO-FREE KIDS SURVEY OF WASHINGTON VOTERS Raising the Age of Tobacco Sales DECEMBER 2015.
CAMPAIGN FOR TOBACT CCO-FREE KIDS SURVEY OF WASHINGTON VOTERS Raising the Age of Tobacco Sales DECEMBER 2015. METHODOLOGY SAMPLE: TECHNIQUE: 500 Registered Voters in Washington state Telephone Survey Live
More informationDoes It Pay To Work During Study? The Effect Of Student Employment On Later Hiring Chances
Does It Pay To Work During Study? The Effect Of Student Employment On Later Hiring Chances Stijn Baert, Eddy Omey, Olivier Rotsaert and Dieter Verhaest Does It Pay To Work During Study? The Effect Of Student
More informationRecent advances in non-experimental comparison group designs
Recent advances in non-experimental comparison group designs Elizabeth Stuart Johns Hopkins Bloomberg School of Public Health Department of Mental Health Department of Biostatistics Department of Health
More informationSection The Question of Causation
Section 2.5 - The Question of Causation Statistics 104 Autumn 2004 Copyright c 2004 by Mark E. Irwin Causation Does smoking cause cancer? Did chemical weapons exposure cause health problems in Gulf War
More informationSection 2: Data & Measurement
Section 2: Data & Measurement Michael Gill Gov 50 September 21, 2011 Outline (0) Questions/Concerns (1) Review of Lecture (2) Measurement (3) Sampling Last Week Last week, we talked about theories, which
More informationThe Assisted Decision-Making (Capacity) Act 2015 and the Decision Support Service
The Assisted Decision-Making (Capacity) Act 2015 and the Decision Support Service Inclusion Ireland AGM 9/6/2018 Áine Flynn Director of the Decision Support Service 1 Assisted Decision-Making Capacity
More informationI. Survey Methodology
I. Survey Methodology The Elon University Poll is conducted using a stratified random sample of households with telephones in the population of interest in this case, citizens in North Carolina. The sample
More information15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA
15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA Statistics does all kinds of stuff to describe data Talk about baseball, other useful stuff We can calculate the probability.
More informationDoing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling. Olli-Pekka Kauppila Daria Kautto
Doing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling Olli-Pekka Kauppila Daria Kautto Session VI, September 20 2017 Learning objectives 1. Get familiar with the basic idea
More informationM E M O R A N D U M. Peter D. Hart Research Associates, Inc./ American Viewpoint
Peter D. Hart Research Associates, Inc./ American Viewpoint 1724 Connecticut Avenue, N.W. Washington, D.C. 20009 202-234-5570 202-232-8134 FAX M E M O R A N D U M TO: FROM: ALL INTERESTED PARTIES PETER
More informationTechnical Track Session IV Instrumental Variables
Impact Evaluation Technical Track Session IV Instrumental Variables Christel Vermeersch Beijing, China, 2009 Human Development Human Network Development Network Middle East and North Africa Region World
More informationDo Comparisons of Fictional Applicants Measure Discrimination When Search Externalities Are Present? Evidence from Existing Experiments
Do Comparisons of Fictional Applicants Measure Discrimination When Search Externalities Are Present? Evidence from Existing Experiments David C. Phillips 1 Wilson Sheehan Lab for Economic Opportunities
More informationStudy Design. Study design. Patrick Breheny. January 23. Patrick Breheny Introduction to Biostatistics (171:161) 1/34
Study design Patrick Breheny January 23 Patrick Breheny Introduction to Biostatistics (171:161) 1/34 in the ideal world In an ideal world, We have a list of everyone in the population of interest We randomly
More informationHow to CRITICALLY APPRAISE
How to CRITICALLY APPRAISE an RCT in 10 minutes James McCormack BSc(Pharm), Pharm D Professor Faculty of Pharmaceutical Sciences, UBC Vancouver, BC, Canada medicationmythbusters.com CRITICAL APPRAISAL
More informationWE CAN DO AMAZING THINGS TOGETHER.
WE CAN DO AMAZING THINGS TOGETHER. BECOME A PARTNER TODAY. As a member of Partners for Life, you ll give and receive. Because doing good for the community is also good for your business, group or organization,
More informationWELLBEING: The Happiness Advantage
WELLBEING: The Happiness Advantage Why is The Happiness Advantage so important? Not just knowing but applying the Happiness Advantage Principles that say when you are more happy and positive you overcome
More information