CAUSATION FOR USE SOME PRACTICAL PROBLEMS JULIAN REISS, ERASMUS UNIVERSITY ROTTERDAM

Size: px
Start display at page:

Download "CAUSATION FOR USE SOME PRACTICAL PROBLEMS JULIAN REISS, ERASMUS UNIVERSITY ROTTERDAM"

Transcription

1 CAUSATION FOR USE SOME PRACTICAL PROBLEMS JULIAN REISS, ERASMUS UNIVERSITY ROTTERDAM

2 OVERVIEW THE THEME OF THIS CONFERENCE IS PHILOSOPHY OF SCIENCE IN USE A GOOD TEST CASE FOR A PHILOSOPHY OF SCIENCE WITH A PRACTICAL BITE ARE SCIENTIFIC CONTROVERSIES HERE I LOOK AT A CONTROVERSY IN ECONOMICS: THE MINIMUM- WAGE DEBATE THE CASE SHOWS THAT PHILOSOPHY OF SCIENCE, AS CURRENTLY PRACTISED, IS OF LITTLE HELP THE CASE ALSO HIGHLIGHTS SOME PARTICULARITIES OF ECONOMIC RESEARCH I CONCLUDE WITH SOME LESSONS FOR PHILOSOPHY OF SCIENCE FOR USE

3 A MOTIVATION: F 53 FRIEDMAN, THE METHODOLOGY OF POSITIVE ECONOMICS (1953): I VENTURE THE JUDGMENT, HOWEVER, THAT CURRENTLY IN THE WESTERN WORLD, AND ESPECIALLY IN THE UNITED STATES, DIFFERENCES ABOUT ECONOMIC POLICY AMONG DISINTERESTED CITIZENS DERIVE PREDOMINANTLY FROM DIFFERENT PREDICTIONS ABOUT THE ECONOMIC CONSEQUENCES OF TAKING ACTION DIFFERENCES THAT IN PRINCIPLE CAN BE ELIMINATED BY THE PROGRESS OF POSITIVE ECONOMICS RATHER THAN FROM FUNDAMENTAL DIFFERENCES IN BASIC VALUES, DIFFERENCES ABOUT WHICH MEN CAN ULTIMATELY ONLY FIGHT. AN OBVIOUS AND NOT UNIMPORTANT EXAMPLE IS MINIMUM-WAGE LEGISLATION. UNDERNEATH THE WELTER OF ARGUMENTS OFFERED FOR AN AGAINST SUCH LEGISLATION THERE IS AN UNDERLYING CONSENSUS ON THE OBJECTIVE OF ACHIEVING A LIVING WAGE FOR ALL...

4 THE MINIMUM WAGE: A SHORT HISTORY S: EARLY WAVE OF STATE-WIDE LEGISLATIONS (MA/OR/UT MODELS), FOLLOWING NZ/AUS/UK, IN 1923 DECLARED UNCONSTITUTIONAL 1938: FAIR LABOR STANDARDS ACT UNDER ROOSEVELT, $0.25/HR NATIONWIDE (EXEMPTIONS/ADJUSTMENTS BY INDUSTRY) SINCE: GRADUAL INCREASES IN THE FEDERAL RATE UP TO $7.25 TODAY; UNTIL 1981: PERIODS OF DECREASING REAL MINIMUM WAGES WOULD FOLLOW A SHARP INCREASE; STEADY DECLINE SINCE (BUT STATE LEGISLATION) AMONG ECONOMISTS, THE EFFECTS OF THE MINIMUM WAGE HAVE ALWAYS BEEN A SOURCE OF DISPUTE: CLARK (CON) VS WEBB (PRO) MARGINALISM: STIGLER/MACHLUP (CON) VS LESTER (PRO) IN 1960S EMERGENCE OF A CONSENSUS, EARLY 1980S MWSC REPORT

5 THE MINIMUM WAGE: A SHORT HISTORY S: EARLY WAVE OF STATE-WIDE LEGISLATIONS (MA/OR/UT MODELS), FOLLOWING NZ/AUS/UK, IN 1923 DECLARED UNCONSTITUTIONAL 1938: FAIR LABOR STANDARDS ACT UNDER ROOSEVELT, $0.25/HR NATIONWIDE 6 (EXEMPTIONS/ADJUSTMENTS BY INDUSTRY) SINCE: GRADUAL INCREASES IN THE FEDERAL RATE UP TO $7.25 TODAY; UNTIL 1981: PERIODS OF DECREASING REAL MINIMUM WAGES WOULD FOLLOW 4 A SHARP INCREASE; STEADY DECLINE SINCE (BUT STATE LEGISLATION) $/hr AMONG ECONOMISTS, THE EFFECTS OF THE MINIMUM WAGE HAVE ALWAYS BEEN A SOURCE OF DISPUTE: 2 CLARK (CON) VS WEBB (PRO) MARGINALISM: STIGLER/MACHLUP (CON) VS LESTER (PRO) 0 Minimum Wages U.S. IN S EMERGENCE OF A CONSENSUS, EARLY S MWSC REPORT Nominal Real Year

6 THE MINIMUM WAGE: A SHORT HISTORY S: EARLY WAVE OF STATE-WIDE LEGISLATIONS (MA/OR/UT MODELS), FOLLOWING NZ/AUS/UK, IN 1923 DECLARED UNCONSTITUTIONAL 1938: FAIR LABOR STANDARDS ACT UNDER ROOSEVELT, $0.25/HR NATIONWIDE (EXEMPTIONS/ADJUSTMENTS BY INDUSTRY) SINCE: GRADUAL INCREASES IN THE FEDERAL RATE UP TO $7.25 TODAY; UNTIL 1981: PERIODS OF DECREASING REAL MINIMUM WAGES WOULD FOLLOW A SHARP INCREASE; STEADY DECLINE SINCE (BUT STATE LEGISLATION) AMONG ECONOMISTS, THE EFFECTS OF THE MINIMUM WAGE HAVE ALWAYS BEEN A SOURCE OF DISPUTE: CLARK (CON) VS WEBB (PRO) MARGINALISM: STIGLER/MACHLUP (CON) VS LESTER (PRO) IN 1960S EMERGENCE OF A CONSENSUS, EARLY 1980S MWSC REPORT

7 THE MINIMUM WAGES: THEORY A) THE COMPETITIVE EQUILIBRIUM

8 THE MINIMUM WAGES: THEORY B)MONOPSONY

9 THE CURRENT CONTROVERSY... STARTED WITH A 1992 ILRR SYMPOSIUM IN WHICH FINDINGS RANGED FROM 0.2 TO 2.65 MOST PREVIOUS STUDIES HAD BEEN OF THE FORM: Y IT = αmw IT + R IT β + ε IT ; THE NEW WAVE INCLUDES NATURAL EXPERIMENTS IN PARTICULAR INDUSTRIES AND REGIONS IN A 2008 REVIEW, NEUMARK AND WASCHER FIND THAT ABOUT TWO-THIRDS OF THE 100 OR SO STUDIES OF THE NEW WAVE FIND SOMETIMES SIGNIFICANT NEGATIVE EFFECTS, MANY FIND NO EFFECTS AND 8 FIND POSITIVE EFFECTS IMPORTANTLY, MANY THOUGH BY NO MEANS ALL OR A GREAT MAJORITY OF ECONOMISTS REGARD THE NATURAL-EXPERIMENT EVIDENCE AS COMPELLING

10 THE HEART OF THE PROBLEM THE VARIETY OF RESULTS CANNOT BE EXPLAINED BY LOCAL DIFFERENCES ALONE CARD AND KRUEGER 1994: 0.63 TO 0.73, NEW JERSEY 1992 NEUMARK AND WASCHER 2000: 0.1 TO 0.25, NEW JERSEY 1992 THE KEY QUESTION THUS IS: HOW CAN WE CONDUCT EVIDENCE-BASED POLICY IN THE ABSENCE OF GOOD EVIDENCE?

11 FORMAL THEORIES OF EVIDENCE INSTANCE THEORIES AN INSTANCE IS EVIDENCE FOR ITS GENERALISATION HYPOTHETICO-DEDUCTIVE THEORIES AN OBSERVED IMPLICATION OF A HYPOTHESIS IS EVIDENCE FOR IT PROBABILISTIC THEORIES WHATEVER INCREASES AN AGENT S BELIEF IN A HYPOTHESIS (OR RENDERS IT HIGH) IS EVIDENCE FOR IT... ALL HAVE PROBLEMS OF THEIR OWN BUT MORE IMPORTANTLY: THEY DON T SEEM TO GIVE US WHAT WE WANT

12 MATERIAL THEORIES OF EVIDENCE NORTON 2003: THE INDUCTIVE INFERENCES OF SCIENCE ARE GROUNDED IN MATTERS OF FACT THAT HOLD ONLY IN PARTICULAR DOMAINS, SO THAT ALL INDUCTIVE INFERENCE IS LOCAL CARTWRIGHT 2006: EPISTEMOLOGICAL WARRANTS (EVIDENCE) ARE IN LARGE PARTS ALSO USE- AND CONTEXT-SPECIFIC CF. SOBER 1991, REISS 2007

13 MID-RANGE THEORIES OF EVIDENCE RECENT PHILOSOPHY/METHODOLOGY OF SCIENCE HAS MADE MUCH HEADWAY IN SHOWING THAT CERTAIN METHODS YIELD CORRECT RESULTS, GIVEN A SET OF ASSUMPTIONS MOST PROMINENTLY, BAYES NETS (PEARL, SGS) CARTWRIGHT S 2008 PROOF OF RCTS REISS 2005 PROOF OF INSTRUMENTAL VARIABLES THESE PROOFS PROVIDE A NORMATIVE JUSTIFICATION FOR THE USE OF SUCH METHODS WHERE THEY WORK ADVANTAGE: CHECKLIST FOR APPLICABILITY BUT: CONDITIONS OF APPLICABILITY HIGHLY STRINGENT (NB: CARTWRIGHT S CLINCHERS VS VOUCHERS )

14 AN EXAMPLE: CAUSAL INSTRUMENTAL VARIABLES REISS 2005/2007: IF CORRELATION IS EQUIVALENT TO CAUSAL CONNECTEDNESS CAUSATION IS TRANSITIVE THE INSTRUMENT CAUSES THE PUTATIVE CAUSE-VARIABLE THE INSTRUMENT CAUSES THE PUTATIVE EFFECT-VARIABLE, IF AT ALL, ONLY THROUGH THE PUTATIVE CAUSE VARIABLE THE INSTRUMENT AND THE PUTATIVE EFFECT VARIABLE DO NOT SHARE ANY CAUSES THEN IF THE INSTRUMENT IS CORRELATED WITH THE PUTATIVE EFFECT, THE PUTATIVE CAUSE IS A GENUINE CAUSE OF THE EFFECT

15 WHERE CLINCHERS FAIL THE PROBLEM WITH THE CLINCHING METHODOLOGY IS THAT THE REQUIRED ASSUMPTIONS ARE HARD TO MEET, E.G.: CONFOUNDERS INCLUDING YEAR EFFECTS SOLVES THE PROBLEM IN ONE GO BUT EXCLUDES A LOT OF INFORMATION; INCLUDING KNOWN CONFOUNDERS IS IMPRACTICAL LAGS SHORTER PERIODS ARE LESS LIKELY TO BE CONFOUNDED BUT EMPLOYMENT EFFECTS ARE LIKELY TO SHOW UP ONLY IN THE LONGER RUN (BECAUSE OF CAPITAL SUBSTITUTION, WHICH TAKES TIME)

16 WHERE CLINCHERS FAIL MIXING ANY TWO GROUPS ARE LIKELY TO DIFFER IN SOME IMPORTANT RESPECT; BUT AN AVERAGE ACROSS ALL STATES IS LIKELY TO BE OVER MIXED POPULATIONS (CF. RCTS VS CASE-CONTROL STUDIES) INTERACTION FOCUSING ON AN INDUSTRY ENABLES TO ESTIMATE THE EFFECT FOR THAT INDUSTRY MORE PRECISELY BUT IS LIKELY TO EITHER CHANGE THE QUESTION OR IGNORE INTERACTION EFFECTS, E.G., FROM HIGHER INCOMES IN ONE INDUSTRY TO HIGHER DEMAND OF FAST FOOD TO HIGHER EMPLOYMENT THERE (P. 76) MEASURING VARIABLES MORE STANDARD MEASURES ALLOW COMPARABILITY BUT MAY NOT MEASURE WHAT IS REQUIRED; MORE TAILOR MADE MEASURES DO THE LATTER BUT INVALIDATE COMPARISONS SIMILAR TRADE OFF BETWEEN TESTING THEORY AND POLICY RELEVANCE (P. 78)

17 WHAT TO DO WHEN CLINCHERS FAIL 6 SILLY ANSWERS USE CONSILIENCE TYPE ARGUMENTS RELY ON ECONOMISTS EXPERTISE AGGREGATE RESULTS WAIT AND GET MORE EVIDENCE IN RELY MORE HEAVILY ON THEORY USE NON-EPISTEMIC VALUES TO THE RESCUE

18 CONSILIENCE? ARGUMENT IN FAVOUR IS PROBABILISTIC: REGARDED AS INDEPENDENT DRAWS, THE PROBABILITY THAT THE SAME RESULT APPEARS DECREASES WITH THE NUMBER OF DRAWS IN THE PRESENT CASE THERE IS TOO MUCH VARIATION MORE IMPORTANTLY, THE DIFFERENT STUDIES ARE HARDLY INDEPENDENT FROM NEUMARK AND WASCHER 2008 : THE JOURNAL S PROJECT WOULD HAVE BEEN MORE VALUABLE HAD MORE RESEARCHERS INVOLVED IN THE MINIMUM WAGE DEBATE WHO WERE INVITED TO PARTICIPATE AGREED TO DO SO, BUT ONLY ONE PRESPECIFIED RESEARCH DESIGN... WAS SUBMITTED AND PUBLISHED

19 CONSILIENCE? ARGUMENT IN FAVOUR IS PROBABILISTIC: REGARDED AS INDEPENDENT DRAWS, THE PROBABILITY THAT THE SAME RESULT APPEARS DECREASES WITH THE NUMBER OF DRAWS IN THE PRESENT CASE THERE IS TOO MUCH VARIATION MORE IMPORTANTLY, THE DIFFERENT STUDIES ARE HARDLY INDEPENDENT FROM NEUMARK AND WASCHER 2008 : THE JOURNAL S PROJECT WOULD HAVE BEEN MORE VALUABLE HAD MORE RESEARCHERS INVOLVED IN THE MINIMUM WAGE DEBATE WHO WERE INVITED TO PARTICIPATE AGREED TO DO SO, BUT ONLY ONE PRESPECIFIED RESEARCH DESIGN... WAS SUBMITTED AND PUBLISHED

20 CONSILIENCE? ARGUMENT IN FAVOUR IS PROBABILISTIC: REGARDED AS INDEPENDENT DRAWS, THE PROBABILITY THAT THE SAME RESULT APPEARS DECREASES WITH THE NUMBER OF DRAWS IN THE PRESENT CASE THERE IS TOO MUCH VARIATION MORE IMPORTANTLY, THE DIFFERENT STUDIES ARE HARDLY INDEPENDENT FROM NEUMARK AND WASCHER 2008 : THE JOURNAL S PROJECT WOULD HAVE BEEN MORE VALUABLE HAD MORE RESEARCHERS INVOLVED IN THE MINIMUM WAGE DEBATE WHO WERE INVITED TO PARTICIPATE AGREED TO DO SO, BUT ONLY ONE PRESPECIFIED RESEARCH DESIGN... WAS SUBMITTED AND PUBLISHED

21 TURNING TO YOUR TRUSTED ECONOMIST? NOBEL 1986 JAMES BUCHANAN (AND WITH HIM, MANKIW AND BECKER):...NO SELF-RESPECTING ECONOMIST WOULD CLAIM THAT INCREASES IN THE MINIMUM WAGE INCREASE EMPLOYMENT. SUCH A CLAIM, IF SERIOUSLY ADVANCED, BECOMES EQUIVALENT TO A DENIAL THAT THERE IS EVEN MINIMUM SCIENTIFIC CONTENT IN ECONOMICS, AND THAT, IN CONSEQUENCE, ECONOMISTS CAN DO NOTHING BUT WRITE AS ADVOCATES FOR IDEOLOGICAL INTERESTS. FORTUNATELY, ONLY A HANDFUL OF ECONOMISTS ARE WILLING TO THROW OVER THE TEACHING OF TWO CENTURIES; WE HAVE NOT YET BECOME A BEVY OF CAMP-FOLLOWING WHORES.

22 TURNING TO YOUR TRUSTED ECONOMIST? NOBEL 2008 PAUL KRUGMAN (AND WITH HIM, STIGLITZ):... FOUND NO EVIDENCE THAT MINIMUM WAGE INCREASES IN THE RANGE THAT THE UNITED STATES HAS EXPERIENCES LED TO JOB LOSSES. THEIR WORK HAS BEEN ATTACKED BECAUSE IT SEEMS TO CONTRADICT ECON 101 AND BECAUSE IT WAS IDEOLOGICALLY DISTURBING TO MANY. YET IT HAS STOOD UP VERY WELL TO REPEATED CHALLENGES, AND NEW CASES CONFIRMING ITS RESULTS KEEP COMING IN.

23 AGGREGATE EVIDENCE? HOW? CHOOSE FAVOURITE STUDY? COMPUTE AN AVERAGE OF THE CENTRAL PARAMETER? VOTE? META-ANALYSIS?

24 RELY ON THEORY? THIS IS PERHAPS WHAT DROVE THE PRE-1994 CONSENSUS PROBLEM: PERHAPS DO DATA UNDERDETERMINE THEORY BUT CERTAINLY DOES THEORY UNDERDETERMINE A LOW-LEVEL CAUSAL CLAIM WHETHER MINIMUM WAGES DECREASE EMPLOYMENT DEPENDS ON... INDUSTRY STRUCTURE/MARKET POWER LEVEL OF WAGE RELATIVE TO COMPETITIVE LEVEL NUMBER OF EMPLOYERS COVERED BY MINIMUM WAGE WHETHER OR NOT HIGHER WAGES HAVE PRODUCTIVITY EFFECTS WHETHER CAPITAL IS REGARDED AS FIXED OR VARIABLE WHETHER OR NOT TIPS ARE INCLUDED

25 VALUES TO THE RESCUE? SOME ARGUE THAT VALUES CANNOT BE SEPARATED FROM FACTS BECAUSE OF QUINE-DUHEM UNDERDETERMINATION THUS, WE DON T SELECT THE THEORY THAT S BEST SUPPORTED BY EVIDENCE (AS THERE IS NO SUCH THING) BUT RATHER THE SIMPLEST, MOST FECUND OR LOVELIEST THEORY ARGUABLY, THE ORIGINAL COMPETITIVE MODEL IS SIMPLER THAN ITS COMPETITORS THIS SEEMS HOPELESSLY ARBITRARY

26 FOUR LESS SILLY (ALBEIT RATHER TRIVIAL) SUGGESTIONS A) RESTRICT INFERENCES TO CLAIMS THE EVIDENCE CAN SUPPORT THE STUDIES SHOW FOR INSTANCE THAT WHATEVER THE EFFECT OF MINIMUM WAGES ON EMPLOYMENT IS, IT CAN T BE LARGE B) DESIGN MORE SURGICAL POLICIES INTRODUCE MINIMUM WAGES ONLY WHERE THERE IS ADDITIONAL EVIDENCE THAT EMPLOYERS HAVE MARKET POWER C) HEDGE YOUR BETS CO-INTRODUCE MEASURES THAT ARE LIKELY TO HAVE EFFECTS THAT COUNTERACT THE POSSIBLE NEGATIVE EFFECTS D) SEEK ALTERNATIVES LIKELY TO PROMOTE THE MORE ULTIMATE GOAL HERBERT SIMON, FRIEDRICH VON HAYEK, JAMES TOBIN, JAMES MEADE, ROBERT SOLOW AND JAN TINBERGEN ALL SUPPORT A BASIC INCOME

27 CONCLUSIONS FOR PHILOSOPHY OF SCIENCE IN USE MOST IMPORTANT CONCLUSION IS THAT A THEORY OF VOUCHERS IS BADLY NEEDED WHAT ARE THE PRINCIPLES OF LEARNING FROM STUDIES WHEN IT IS KNOWN THAT RESULTS ARE CONFOUNDED VARIABLES ARE BADLY MEASURED CAUSAL STRUCTURES ARE MIXED ETC.? FURTHER, WE NEED A THEORY OF DECISION MAKING UNDER RADICAL UNCERTAINTY (WHEN NO PROBABILITIES ARE KNOWN) THAT INCLUDES DECISION COSTS

PHILOSOPHY OF ECONOMICS & POLITICS

PHILOSOPHY OF ECONOMICS & POLITICS PHILOSOPHY OF ECONOMICS & POLITICS LECTURE 12: EVIDENCE-BASED SOCIAL POLICY DATE 21 JANUARY 2019 LECTURER JULIAN REISS Today s agenda Recall Michael Young: segregation works obviously! But how do we know?

More information

Durham Research Online

Durham Research Online Durham Research Online Deposited in DRO: 12 February 2016 Version of attached le: Accepted Version Peer-review status of attached le: Peer-reviewed Citation for published item: Cartwright, N. (2007) 'Are

More information

EXPERIMENTAL ECONOMICS INTRODUCTION. Ernesto Reuben

EXPERIMENTAL ECONOMICS INTRODUCTION. Ernesto Reuben EXPERIMENTAL ECONOMICS INTRODUCTION Ernesto Reuben WHAT IS EXPERIMENTAL ECONOMICS? 2 WHAT IS AN ECONOMICS EXPERIMENT? A method of collecting data in controlled environments with the purpose of furthering

More information

Beyond Subjective and Objective in Statistics

Beyond Subjective and Objective in Statistics June 05 Foundations of Statistics Other objectivity vs. subjectivity issues The current discourse is not helpful. Objectivity and Subjectivity in Statistics Starting point: how are these terms used in

More information

AP SEMINAR 2016 SCORING GUIDELINES

AP SEMINAR 2016 SCORING GUIDELINES AP SEMINAR 2016 SCORING GUIDELINES AP SEMINAR END OF COURSE EXAM RUBRIC: SECTION I, PART A CONTENT AREA PERFORMANCE LEVELS Question 1 1 Understanding and Analyzing Argument Question 2 The response misstates

More information

Lecture II: Difference in Difference and Regression Discontinuity

Lecture II: Difference in Difference and Regression Discontinuity Review Lecture II: Difference in Difference and Regression Discontinuity it From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

Identification with Models and Exogenous Data Variation

Identification with Models and Exogenous Data Variation Identification with Models and Exogenous Data Variation R. Jay Kahn Toni M. Whited University of Michigan University of Michigan and NBER June 11, 2016 Abstract We distinguish between identification and

More information

Cognitive domain: Comprehension Answer location: Elements of Empiricism Question type: MC

Cognitive domain: Comprehension Answer location: Elements of Empiricism Question type: MC Chapter 2 1. Knowledge that is evaluative, value laden, and concerned with prescribing what ought to be is known as knowledge. *a. Normative b. Nonnormative c. Probabilistic d. Nonprobabilistic. 2. Most

More information

Reassessing Quasi-Experiments: Policy Evaluation, Induction, and SUTVA. Tom Boesche

Reassessing Quasi-Experiments: Policy Evaluation, Induction, and SUTVA. Tom Boesche Reassessing Quasi-Experiments: Policy Evaluation, Induction, and SUTVA Tom Boesche Abstract This paper defends the use of quasi-experiments for causal estimation in economics against the widespread objection

More information

An Experimental Investigation of Self-Serving Biases in an Auditing Trust Game: The Effect of Group Affiliation: Discussion

An Experimental Investigation of Self-Serving Biases in an Auditing Trust Game: The Effect of Group Affiliation: Discussion 1 An Experimental Investigation of Self-Serving Biases in an Auditing Trust Game: The Effect of Group Affiliation: Discussion Shyam Sunder, Yale School of Management P rofessor King has written an interesting

More information

Lecture II: Difference in Difference. Causality is difficult to Show from cross

Lecture II: Difference in Difference. Causality is difficult to Show from cross Review Lecture II: Regression Discontinuity and Difference in Difference From Lecture I Causality is difficult to Show from cross sectional observational studies What caused what? X caused Y, Y caused

More information

CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH

CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH Why Randomize? This case study is based on Training Disadvantaged Youth in Latin America: Evidence from a Randomized Trial by Orazio Attanasio,

More information

What Counts as Credible Evidence in Evaluation Practice?

What Counts as Credible Evidence in Evaluation Practice? What Counts as Credible Evidence in Evaluation Practice? Stewart I. Donaldson, Ph.D. Claremont Graduate University stewart.donaldson@cgu.edu CDC/OSH Evaluation Net Conference March 28, 2012 "The issue

More information

ICPSR Causal Inference in the Social Sciences. Course Syllabus

ICPSR Causal Inference in the Social Sciences. Course Syllabus ICPSR 2012 Causal Inference in the Social Sciences Course Syllabus Instructors: Dominik Hangartner London School of Economics Marco Steenbergen University of Zurich Teaching Fellow: Ben Wilson London School

More information

Mechanisms and the evidence hierarchy

Mechanisms and the evidence hierarchy Mechanisms and the evidence hierarchy Federica Russo Dipartimento di Studi Umanistici, Università di Ferrara 2 Overview The background Evidence-based medicine The Russo-Williamson Thesis Mechanisms and

More information

Western Philosophy of Social Science

Western Philosophy of Social Science Western Philosophy of Social Science Lecture 4. Frameworks for the social sciences Professor Daniel Little University of Michigan-Dearborn delittle@umd.umich.edu www-personal.umd.umich.edu/~delittle/ V.

More information

Belief behavior Smoking is bad for you I smoke

Belief behavior Smoking is bad for you I smoke LP 12C Cognitive Dissonance 1 Cognitive Dissonance Cognitive dissonance: An uncomfortable mental state due to a contradiction between two attitudes or between an attitude and behavior (page 521). Belief

More information

PSYCHOLOGICAL CONSCIOUSNESS AND PHENOMENAL CONSCIOUSNESS. Overview

PSYCHOLOGICAL CONSCIOUSNESS AND PHENOMENAL CONSCIOUSNESS. Overview Lecture 28-29 PSYCHOLOGICAL CONSCIOUSNESS AND PHENOMENAL CONSCIOUSNESS Overview David J. Chalmers in his famous book The Conscious Mind 1 tries to establish that the problem of consciousness as the hard

More information

HERO. Rational addiction theory a survey of opinions UNIVERSITY OF OSLO HEALTH ECONOMICS RESEARCH PROGRAMME. Working paper 2008: 7

HERO. Rational addiction theory a survey of opinions UNIVERSITY OF OSLO HEALTH ECONOMICS RESEARCH PROGRAMME. Working paper 2008: 7 Rational addiction theory a survey of opinions Hans Olav Melberg Institute of Health Management and Health Economics UNIVERSITY OF OSLO HEALTH ECONOMICS RESEARCH PROGRAMME Working paper 2008: 7 HERO Rational

More information

I. Introduction. Armin Falk IZA and University of Bonn April Falk: Behavioral Labor Economics: Psychology of Incentives 1/18

I. Introduction. Armin Falk IZA and University of Bonn April Falk: Behavioral Labor Economics: Psychology of Incentives 1/18 I. Introduction Armin Falk IZA and University of Bonn April 2004 1/18 This course Study behavioral effects for labor related outcomes Empirical studies Overview Introduction Psychology of incentives Reciprocity

More information

GPP 501 Microeconomic Analysis for Public Policy Fall 2017

GPP 501 Microeconomic Analysis for Public Policy Fall 2017 GPP 501 Microeconomic Analysis for Public Policy Fall 2017 Given by Kevin Milligan Vancouver School of Economics University of British Columbia Lecture Sept 6th: Consumer Choice GPP501: Lecture Sept 6

More information

UNDERSTANDING GIVING: ACROSS GENERATIONS

UNDERSTANDING GIVING: ACROSS GENERATIONS UNDERSTANDING GIVING: ACROSS GENERATIONS A REPORT OF THE COLORADO GENEROSITY PROJECT In Understanding Giving: Beliefs & Behaviors of Colorado s Donors, we explored what, how, and why Coloradans give. The

More information

Modelling Experimental Interventions: Results and Challenges

Modelling Experimental Interventions: Results and Challenges Concrete Causation Munich 2010 Modelling Experimental Interventions: Results and Challenges Jan-Willem Romeijn Faculty of Philosophy University of Groningen Contents 1 Overview 3 2 Interventions and confirmation

More information

Pros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany

Pros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Dan A. Black University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Matching as a regression estimator Matching avoids making assumptions about the functional form of the regression

More information

The Conference That Counts! March, 2018

The Conference That Counts! March, 2018 The Conference That Counts! March, 2018 Statistics, Definitions, & Theories The Audit Process Getting it Wrong Practice & Application Some Numbers You Should Know Objectivity Analysis Interpretation Reflection

More information

The Objects of Social Sciences: Idea, Action, and Outcome [From Ontology to Epistemology and Methodology]

The Objects of Social Sciences: Idea, Action, and Outcome [From Ontology to Epistemology and Methodology] The Objects of Social Sciences: Idea, Action, and Outcome [From Ontology to Epistemology and Methodology] Shiping Tang Fudan University Shanghai 2013-05-07/Beijing, 2013-09-09 Copyright@ Shiping Tang Outline

More information

Clinical Research Ethics Question of the Month: Stipends Bases on Income

Clinical Research Ethics Question of the Month: Stipends Bases on Income Vol. 14, No. 12, December 2018 Happy Trials to You Clinical Research Ethics Question of the Month: Stipends Bases on Income By Norman M. Goldfarb You are a member of an IRB reviewing a study with an unusual

More information

UNCORRECTED PROOF. Daniel Steel / Across the Boundaries 01-DanielSteel-chap01 Page Proof page :48pm ACROSS THE BOUNDARIES

UNCORRECTED PROOF. Daniel Steel / Across the Boundaries 01-DanielSteel-chap01 Page Proof page :48pm ACROSS THE BOUNDARIES Daniel Steel / Across the Boundaries 01-DanielSteel-chap01 Page Proof page 1 15.6.2007 9:48pm ACROSS THE BOUNDARIES Daniel Steel / Across the Boundaries 01-DanielSteel-chap01 Page Proof page 2 15.6.2007

More information

ECONOMICS OF HEALTH INEQUALITY

ECONOMICS OF HEALTH INEQUALITY TINBERGEN INSTITUTE SUMMER SCHOOL ECONOMICS OF HEALTH INEQUALITY ERASMUS UNIVERSITY ROTTERDAM 25-29 JUNE 2018 This course will arm you with tools to measure health inequality. In addition to gaining competence

More information

August 29, Introduction and Overview

August 29, Introduction and Overview August 29, 2018 Introduction and Overview Why are we here? Haavelmo(1944): to become master of the happenings of real life. Theoretical models are necessary tools in our attempts to understand and explain

More information

Insight Assessment Measuring Thinking Worldwide

Insight Assessment Measuring Thinking Worldwide California Critical Thinking Skills Test (CCTST). The CCTST measures the reasoning skills human beings use in the process of reflectively deciding what to believe or what to do. Skill/Attribute Name SE

More information

COHERENCE: THE PRICE IS RIGHT

COHERENCE: THE PRICE IS RIGHT The Southern Journal of Philosophy Volume 50, Issue 1 March 2012 COHERENCE: THE PRICE IS RIGHT Paul Thagard abstract: This article is a response to Elijah Millgram s argument that my characterization of

More information

What Counts as Credible Evidence in Contemporary Evaluation Practice?

What Counts as Credible Evidence in Contemporary Evaluation Practice? What Counts as Credible Evidence in Contemporary Evaluation Practice? Stewart I. Donaldson, Ph.D. Claremont Graduate University stewart.donaldson@cgu.edu Hawaii-Pacific Evaluation Association Annual Conference

More information

CHAPTER 2 FOUNDATIONS OF INDIVIDUAL BEHAVIOR

CHAPTER 2 FOUNDATIONS OF INDIVIDUAL BEHAVIOR CHAPTER 2 FOUNDATIONS OF INDIVIDUAL BEHAVIOR "Intelligence is but one characteristic that people bring with them when they join an organization. In this chapter, we look at how biographical characteristics

More information

Political Science 15, Winter 2014 Final Review

Political Science 15, Winter 2014 Final Review Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically

More information

Chapter 1 Introduction to Educational Research

Chapter 1 Introduction to Educational Research Chapter 1 Introduction to Educational Research The purpose of Chapter One is to provide an overview of educational research and introduce you to some important terms and concepts. My discussion in this

More information

Dental insurance: A bright idea for your business

Dental insurance: A bright idea for your business Dental insurance: A bright idea for your business Many challenges, one solution Your business faces a variety of challenges every day. Fortunately, you can solve many of them through one solution: offering

More information

Review of Animals and the Economy. Steven McMullen Palgrave, pp., ebook and hardcover. Bob Fischer Texas State University

Review of Animals and the Economy. Steven McMullen Palgrave, pp., ebook and hardcover. Bob Fischer Texas State University 153 Between the Species Review of Animals and the Economy Steven McMullen Palgrave, 2016 216 pp., ebook and hardcover Bob Fischer Texas State University fischer@txstate.edu Volume 20, Issue 1 Summer, 2017

More information

Presentation to the Standing Committee on Health on Bill C-206, an Act to Amend the Food and Drugs Act

Presentation to the Standing Committee on Health on Bill C-206, an Act to Amend the Food and Drugs Act Check against delivery Presentation to the Standing Committee on Health on Bill C-206, an Act to Amend the Food and Drugs Act Michel Perron, CEO The Canadian Centre on Substance Abuse March 21, 2005 I

More information

On the diversity principle and local falsifiability

On the diversity principle and local falsifiability On the diversity principle and local falsifiability Uriel Feige October 22, 2012 1 Introduction This manuscript concerns the methodology of evaluating one particular aspect of TCS (theoretical computer

More information

EC Macroeconomic Theory Supplement 13 Professor Sanjay Chugh

EC Macroeconomic Theory Supplement 13 Professor Sanjay Chugh Department of Economics Boston College EC 202.05 Macroeconomic Theory Supplement 13 Professor Sanjay Chugh The following New York Times op-ed piece by Harvard Professor Raj Chetty criticizes those who

More information

By Olivia Smith and Steven van de Put Third Year, Second Prize

By Olivia Smith and Steven van de Put Third Year, Second Prize Are humans always the rational, self-interested agents that mainstream economics assumes them to be? Discuss, using ideas of reciprocity, altruism and fairness By Olivia Smith and Steven van de Put Third

More information

Moving to an Interdisciplinary Perspective on the Causes and Consequences of Unemployment

Moving to an Interdisciplinary Perspective on the Causes and Consequences of Unemployment Moving to an Interdisciplinary Perspective on the Causes and Consequences of Unemployment This section provides questions and prototype answers that can be used to guide educators in providing students

More information

Response to the ASA s statement on p-values: context, process, and purpose

Response to the ASA s statement on p-values: context, process, and purpose Response to the ASA s statement on p-values: context, process, purpose Edward L. Ionides Alexer Giessing Yaacov Ritov Scott E. Page Departments of Complex Systems, Political Science Economics, University

More information

Recognizing Ambiguity

Recognizing Ambiguity Recognizing Ambiguity How Lack of Information Scares Us Mark Clements Columbia University I. Abstract In this paper, I will examine two different approaches to an experimental decision problem posed by

More information

Econ 270: Theoretical Modeling 1

Econ 270: Theoretical Modeling 1 Econ 270: Theoretical Modeling 1 Economics is certainly not the only social science to use mathematical theoretical models to examine a particular question. But economics, since the 1960s, has evolved

More information

Behavioral Game Theory

Behavioral Game Theory Outline (September 3, 2007) Outline (September 3, 2007) Introduction Outline (September 3, 2007) Introduction Examples of laboratory experiments Outline (September 3, 2007) Introduction Examples of laboratory

More information

Causality and Statistical Learning

Causality and Statistical Learning Department of Statistics and Department of Political Science, Columbia University 29 Sept 2012 1. Different questions, different approaches Forward causal inference: What might happen if we do X? Effects

More information

Citation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n.

Citation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n. University of Groningen Latent instrumental variables Ebbes, P. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document

More information

I. Logical Argument (argument) appeals to reason and intellect.

I. Logical Argument (argument) appeals to reason and intellect. Page 1 of 5 Argument strategies for manipulating others to agree with your opinion, premise or idea; i.e. to convince others. Argumentative writing has a different motivation from expository writing, in

More information

A Comment on the Absent-Minded Driver Paradox*

A Comment on the Absent-Minded Driver Paradox* Ž. GAMES AND ECONOMIC BEHAVIOR 20, 25 30 1997 ARTICLE NO. GA970508 A Comment on the Absent-Minded Driver Paradox* Itzhak Gilboa MEDS KGSM, Northwestern Uni ersity, E anston, Illinois 60201 Piccione and

More information

Paul Figueroa. Washington Municipal Clerks Association ANNUAL CONFERENCE. Workplace Bullying: Solutions and Prevention. for

Paul Figueroa. Washington Municipal Clerks Association ANNUAL CONFERENCE. Workplace Bullying: Solutions and Prevention. for Workplace Bullying: Solutions and Prevention for Washington Municipal Clerks Association ANNUAL CONFERENCE Paul@PeaceEnforcement.com 206-650-5364 Peace Enforcement LLC Bullying described: Why people do

More information

A Brief Introduction to Bayesian Statistics

A Brief Introduction to Bayesian Statistics A Brief Introduction to Statistics David Kaplan Department of Educational Psychology Methods for Social Policy Research and, Washington, DC 2017 1 / 37 The Reverend Thomas Bayes, 1701 1761 2 / 37 Pierre-Simon

More information

PLANS AND THE REPRESENTATION OF ACTS

PLANS AND THE REPRESENTATION OF ACTS States such as: believe, know, expect,... (4) Dispositional Properties such as: can, ought,... (5) Motivational States such as: want, desire,... (6) Role Relations such as: father of, friend of,... and

More information

The Regression-Discontinuity Design

The Regression-Discontinuity Design Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations

More information

Improving statistical estimates used in the courtroom. Precis. Bayes Theorem. Professor Norman Fenton. Queen Mary University of London and Agena Ltd

Improving statistical estimates used in the courtroom. Precis. Bayes Theorem. Professor Norman Fenton. Queen Mary University of London and Agena Ltd Improving statistical estimates used in the courtroom Professor Norman Fenton Queen Mary University of London and Agena Ltd Address: Queen Mary University of London School of Electronic Engineering and

More information

What role should heroes, saints and sages play within moral theory? While it would be unfair to

What role should heroes, saints and sages play within moral theory? While it would be unfair to Zagzebski. Linda Trinkaus. Exemplarist Moral Theory. Oxford: Oxford University Press. 2017. Pp. 274. $69.00 (cloth). What role should heroes, saints and sages play within moral theory? While it would be

More information

Qualitative Data Analysis. Richard Boateng, PhD. Arguments with Qualitative Data. Office: UGBS RT18 (rooftop)

Qualitative Data Analysis. Richard Boateng, PhD. Arguments with Qualitative Data. Office: UGBS RT18 (rooftop) Qualitative Data Analysis Lecturer/Convenor: Richard Boateng, PhD. Email: richard@pearlrichards.org Office: UGBS RT18 (rooftop) Arguments with Qualitative Data Photo Illustrations from Getty Images www.gettyimages.com

More information

Underlying Theory & Basic Issues

Underlying Theory & Basic Issues Underlying Theory & Basic Issues Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 All Too True 2 Validity In software engineering, we worry about various issues: E-Type systems: Usefulness is it doing what

More information

A Note On the Design of Experiments Involving Public Goods

A Note On the Design of Experiments Involving Public Goods University of Colorado From the SelectedWorks of PHILIP E GRAVES 2009 A Note On the Design of Experiments Involving Public Goods PHILIP E GRAVES, University of Colorado at Boulder Available at: https://works.bepress.com/philip_graves/40/

More information

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. Decision-Making under Uncertainty in the Setting of Environmental Health Regulations Author(s): James M. Robins, Philip J. Landrigan, Thomas G. Robins, Lawrence J. Fine Source: Journal of Public Health

More information

Homeopathy: A Critique of Current Clinical Research

Homeopathy: A Critique of Current Clinical Research Homeopathy: A Critique of Current Clinical Research Edzard Ernst From SKEPTICAL INQUIRER Volume 36.6, November/December 2012 An evaluation of the clinical research by the group that has published most

More information

Stability and Change of Adolescent. Coping Styles and Mental Health: An Intervention Study. Bernd Heubeck & James T. Neill. Division of Psychology

Stability and Change of Adolescent. Coping Styles and Mental Health: An Intervention Study. Bernd Heubeck & James T. Neill. Division of Psychology Stability and Change of Adolescent Coping Styles and Mental Health: An Intervention Study Bernd Heubeck & James T. Neill Division of Psychology The Australian National University Paper presented to the

More information

Kahneman, Daniel. Thinking Fast and Slow. New York: Farrar, Straus & Giroux, 2011.

Kahneman, Daniel. Thinking Fast and Slow. New York: Farrar, Straus & Giroux, 2011. The accumulating research indicates that individuals cognitive and behavioral orientations to objects (their thoughts and actions) are frequently based on rapid shortcuts or heuristics. The past few decades

More information

The Common Priors Assumption: A comment on Bargaining and the Nature of War

The Common Priors Assumption: A comment on Bargaining and the Nature of War The Common Priors Assumption: A comment on Bargaining and the Nature of War Mark Fey Kristopher W. Ramsay June 10, 2005 Abstract In a recent article in the JCR, Smith and Stam (2004) call into question

More information

Measuring Impact. Conceptual Issues in Program and Policy Evaluation. Daniel L. Millimet. Southern Methodist University.

Measuring Impact. Conceptual Issues in Program and Policy Evaluation. Daniel L. Millimet. Southern Methodist University. Measuring mpact Conceptual ssues in Program and Policy Evaluation Daniel L. Millimet Southern Methodist University 23 May 2013 DL Millimet (SMU) Measuring mpact May 2013 1 / 25 ntroduction Primary concern

More information

VIRGINIA LAW REVIEW IN BRIEF

VIRGINIA LAW REVIEW IN BRIEF VIRGINIA LAW REVIEW IN BRIEF VOLUME 96 JUNE 15, 2010 PAGES 35 39 REPLY GOOD INTENTIONS MATTER Katharine T. Bartlett * W HILE writing the article to which Professors Mitchell and Bielby have published responses,

More information

Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985)

Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Confirmations and Contradictions Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Estimates of the Deterrent Effect of Capital Punishment: The Importance of the Researcher's Prior Beliefs Walter

More information

Socialization Peter L. Berger

Socialization Peter L. Berger Socialization What happens in socialization is that the social world is internalized within the child. The same process, though perhaps weaker in quality, occurs every time the adult is initiated into

More information

Shaping the Economics of Happiness: The Fundamental Contributions of Richard A. Easterlin

Shaping the Economics of Happiness: The Fundamental Contributions of Richard A. Easterlin I Shaping the Economics of Happiness: The Fundamental Contributions of Richard A. Easterlin Holger Hinte and Klaus F. Zimmermann Did it take a global economic and financial crisis to remind us that money

More information

Developmental Perspectives on Problem-Solving

Developmental Perspectives on Problem-Solving Developmental Perspectives on Problem-Solving You can never solve a problem on the level on which it was created Albert Einstein Pre-Conventional Opportunist Wins any way possible Short-term horizon, not

More information

11/8/2013. Homecare Association of Arkansas 2013 Fall Conference and Trade Show. Objectives. What is patient engagement?

11/8/2013. Homecare Association of Arkansas 2013 Fall Conference and Trade Show. Objectives. What is patient engagement? Homecare Association of Arkansas 2013 Fall Conference and Trade Show Motivational Interviewing and Patient Activation Paula Suter, BSN, MA Clincal Director Sutter Center for Integrated Care Sutter Health,

More information

A Difference that Makes a Difference: Welfare and the Equality of Consideration

A Difference that Makes a Difference: Welfare and the Equality of Consideration 84 A Difference that Makes a Difference: Welfare and the Equality of Consideration Abstract Elijah Weber Philosophy Department Bowling Green State University eliweber1980@gmail.com In Welfare, Happiness,

More information

Why Economics Needs Philosophy. Julian Reiss

Why Economics Needs Philosophy. Julian Reiss Why Economics Needs Philosophy Julian Reiss The 2008- financial crisis This crisis is considered by many economists to be the worst financial crisis since the Great Depression of the 1930s It has resulted

More information

Samsung Leukemia Case, Occupational Disease and Risk System. Domyung Paek Korea

Samsung Leukemia Case, Occupational Disease and Risk System. Domyung Paek Korea Samsung Leukemia Case, Occupational Disease and Risk System Domyung Paek Korea 1 Key Points Samsung Leukemia Cases through Conventional Occupational Disease Diagnosis Framework Controversies Why they didn

More information

Thoughts on Social Design

Thoughts on Social Design 577 Center for Mathematical Economics Working Papers September 2017 Thoughts on Social Design Walter Trockel and Claus-Jochen Haake Center for Mathematical Economics(IMW) Bielefeld University Universitätsstraße

More information

Issues in Conducting Rigorous and Relevant Research in Education

Issues in Conducting Rigorous and Relevant Research in Education Issues in Conducting Rigorous and Relevant Research in Education Richard J. Shavelson Stanford University Keynote Presentation Rigor and Relevance in Educational Research Litteraturhuset, Oslo 4 March

More information

Comparing Direct and Indirect Measures of Just Rewards: What Have We Learned?

Comparing Direct and Indirect Measures of Just Rewards: What Have We Learned? Comparing Direct and Indirect Measures of Just Rewards: What Have We Learned? BARRY MARKOVSKY University of South Carolina KIMMO ERIKSSON Mälardalen University We appreciate the opportunity to comment

More information

Irrationality in Game Theory

Irrationality in Game Theory Irrationality in Game Theory Yamin Htun Dec 9, 2005 Abstract The concepts in game theory have been evolving in such a way that existing theories are recasted to apply to problems that previously appeared

More information

Further Properties of the Priority Rule

Further Properties of the Priority Rule Further Properties of the Priority Rule Michael Strevens Draft of July 2003 Abstract In Strevens (2003), I showed that science s priority system for distributing credit promotes an allocation of labor

More information

Science, Society, and Social Research (1) Benjamin Graham

Science, Society, and Social Research (1) Benjamin Graham Science, Society, and Social Research (1) Nuts and Bolts My computer croaked, so no clickers today We will start collecting clicker data for grades next Thurs Discussion sections start next week Homework

More information

A NON-TECHNICAL INTRODUCTION TO REGRESSIONS. David Romer. University of California, Berkeley. January Copyright 2018 by David Romer

A NON-TECHNICAL INTRODUCTION TO REGRESSIONS. David Romer. University of California, Berkeley. January Copyright 2018 by David Romer A NON-TECHNICAL INTRODUCTION TO REGRESSIONS David Romer University of California, Berkeley January 2018 Copyright 2018 by David Romer CONTENTS Preface ii I Introduction 1 II Ordinary Least Squares Regression

More information

Behavioural Economics University of Oxford Vincent P. Crawford Michaelmas Term 2012

Behavioural Economics University of Oxford Vincent P. Crawford Michaelmas Term 2012 Behavioural Economics University of Oxford Vincent P. Crawford Michaelmas Term 2012 Introduction to Behavioral Economics and Decision Theory (with very large debts to David Laibson and Matthew Rabin) Revised

More information

Clicker quiz: Should the cocaine trade be legalized? (either answer will tell us if you are here or not) 1. yes 2. no

Clicker quiz: Should the cocaine trade be legalized? (either answer will tell us if you are here or not) 1. yes 2. no Clicker quiz: Should the cocaine trade be legalized? (either answer will tell us if you are here or not) 1. yes 2. no Economic Liberalism Summary: Assumptions: self-interest, rationality, individual freedom

More information

Simpson s paradox (or reversal paradox)

Simpson s paradox (or reversal paradox) Fallacy of division It is the opposite of the fallacy of composition. It occurs when it is automatically presumed that what is true at a larger scale (the global level) is true at some smaller scale (the

More information

Abstract. When one looks at the legalization of marijuana, he can choose many

Abstract. When one looks at the legalization of marijuana, he can choose many Peter Hu Feb. 20 th 2008 Econ 4999 Edward Morey Abstract When one looks at the legalization of marijuana, he can choose many different angles to criticize or simply agree with whatever the law deems most

More information

Comments on Limits of Econometrics by David Freedman. Arnold Zellner. University of Chicago

Comments on Limits of Econometrics by David Freedman. Arnold Zellner. University of Chicago Comments on Limits of Econometrics by David Freedman Arnold Zellner University of Chicago David Freedman s impressive paper reveals well his deep understanding of not only statistical techniques and their

More information

V71LAR: Locke, Appearance and Reality. TOPIC 2: WHAT IS IT TO PERCEIVE AN OBJECT? Continued...

V71LAR: Locke, Appearance and Reality. TOPIC 2: WHAT IS IT TO PERCEIVE AN OBJECT? Continued... V71LAR: Locke, Appearance and Reality TOPIC 2: WHAT IS IT TO PERCEIVE AN OBJECT? Continued... Are you getting this? Yes No Summary of theories of perception Type of theory Things we are directly aware

More information

What do Americans know about inequality? It depends on how you ask them

What do Americans know about inequality? It depends on how you ask them Judgment and Decision Making, Vol. 7, No. 6, November 2012, pp. 741 745 What do Americans know about inequality? It depends on how you ask them Kimmo Eriksson Brent Simpson Abstract A recent survey of

More information

MS&E 226: Small Data

MS&E 226: Small Data MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector

More information

CEMO RESEARCH PROGRAM

CEMO RESEARCH PROGRAM 1 CEMO RESEARCH PROGRAM Methodological Challenges in Educational Measurement CEMO s primary goal is to conduct basic and applied research seeking to generate new knowledge in the field of educational measurement.

More information

Thinking and Intelligence

Thinking and Intelligence Thinking and Intelligence Learning objectives.1 The basic elements of thought.2 Whether the language you speak affects the way you think.3 How subconscious thinking, nonconscious thinking, and mindlessness

More information

An Analytical Review of the Pew Report Entitled, It Takes A Team and the Accompanying Productivity and Profit Calculator

An Analytical Review of the Pew Report Entitled, It Takes A Team and the Accompanying Productivity and Profit Calculator An Analytical Review of the Pew Report Entitled, It Takes A Team and the Accompanying Productivity and Profit Calculator The report, It Takes a Team, was released by the Pew Center on the States in December

More information

Critical Thinking Assessment at MCC. How are we doing?

Critical Thinking Assessment at MCC. How are we doing? Critical Thinking Assessment at MCC How are we doing? Prepared by Maura McCool, M.S. Office of Research, Evaluation and Assessment Metropolitan Community Colleges Fall 2003 1 General Education Assessment

More information

Carrying out an Empirical Project

Carrying out an Empirical Project Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric

More information

Hypothesis-Driven Research

Hypothesis-Driven Research Hypothesis-Driven Research Research types Descriptive science: observe, describe and categorize the facts Discovery science: measure variables to decide general patterns based on inductive reasoning Hypothesis-driven

More information

Michael J. McQuestion, PhD, MPH Johns Hopkins University. Measurement Concepts and Introduction to Problem Solving

Michael J. McQuestion, PhD, MPH Johns Hopkins University. Measurement Concepts and Introduction to Problem Solving This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

King, Keohane and Verba, Designing Social Inquiry, pp. 3-9, 36-46, notes for Comparative Politics Field Seminar, Fall, 1998.

King, Keohane and Verba, Designing Social Inquiry, pp. 3-9, 36-46, notes for Comparative Politics Field Seminar, Fall, 1998. King, Keohane and Verba, Designing Social Inquiry, pp. 3-9, 36-46, 115-149 notes for Comparative Politics Field Seminar, Fall, 1998. (pp. 1-9) King, Keohane and Verba s (from now on KKV) primary goal is

More information

THE INTERPRETATION OF EFFECT SIZE IN PUBLISHED ARTICLES. Rink Hoekstra University of Groningen, The Netherlands

THE INTERPRETATION OF EFFECT SIZE IN PUBLISHED ARTICLES. Rink Hoekstra University of Groningen, The Netherlands THE INTERPRETATION OF EFFECT SIZE IN PUBLISHED ARTICLES Rink University of Groningen, The Netherlands R.@rug.nl Significance testing has been criticized, among others, for encouraging researchers to focus

More information

For general queries, contact

For general queries, contact Much of the work in Bayesian econometrics has focused on showing the value of Bayesian methods for parametric models (see, for example, Geweke (2005), Koop (2003), Li and Tobias (2011), and Rossi, Allenby,

More information