The Logic of Causal Inference
|
|
- Toby Bruce
- 5 years ago
- Views:
Transcription
1 The Logic of Causal Inference Judea Pearl University of California, Los Angeles Computer Science Department Los Angeles, CA, , USA September 13, Introduction The role of causality in behavioral research is widely perceived to be, on the one hand, of pivotal methodological importance (Maxwell, 2010) and, on the other hand, confusing, enigmatic and controversial (Freedman, 1987;?; Rubin, 2009; Kraemer et al., 2008; Fleming and DeMets, 1996; Green et al., 2010). The traditional approach to causal analysis, based need on Structural Equation Modeling (SEM), (Bollen, 1989; Bentler, 2006; Steiger, 2001; Shrout freedman and Bolger, 2002), though it has gone through several cycles of reformation and consolidation, is still viewed with suspicion and confusion by many researchers (Sørensen, 1998; 2010 Berk, 2004; Sobel, 2008; Rubin, 2010) To witness, a recent issue of Psychological Methods, whose goal was to introduce the works Donald Campbell and Donald Rubin to psychologists, (Maxwell, 2010), remains totally silent on how these two approaches compare to the traditional methodology based on SEM. The impression is thus created that traditional methods This research was supported in parts by NIH grant #1R01 LM , NSF grant #IIS , and ONR grant #N
2 are either orthogonal, or inferior to those of Campbell and Rubin s when, in fact, they subsume the latter (Pearl, 2009, pp ) and provide a formal setting for the former. This confusion is further exposed, for example, in the influential report of Wilkinson and Task Force s (1999) on Statistical Methods in Psychology Journals: Guidelines and Explanations. After warning readers against the false premise that, while correlation does not prove causation causal modeling does, the report reaches a surprising conclusion: The use of complicated causal-modeling software [read SEM] rarely yields any results that have any interpretation as causal effects. The implication being that the entire enterprise of causal modeling, from Sewell Wright (1921) to Blalock (1964) and Duncan (1975), the entire literature in econometric research, including modern advances in graphical and non-parametric structural models have all been misguided, for they have been chasing parameters that have no causal interpretation. The absurdity of such conclusions notwithstanding, readers may rightly ask: If SEM methods do not prove causation, how can they yield results that have causal interpretation? Put another way, if the structural coefficients that SEM researchers labor to estimate can legitimately be interpreted as causal effects then, unless these parameters are grossly misestimated, why deny SEM researchers the honor of establishing causation or at least of deriving some useful claims about causation. The answer is that a huge logical gap exists between establishing causation, which requires manipulative experiments, and interpreting parameters as causal effects, which may be based on scientific knowledge or on previously conducted experiments. One can legitimately be in a possession of a parameter that stands for a causal effect and still be unable, using statistical means alone, to determine the magnitude of that parameter given non-experimental data. As a matter of fact, we know that no such statistical means exists; that is, causal effects in observational studies can only be substantiated from a combination of data and untested, theoretical assumptions; not from the data alone. Thus, if reliance on theoretical assumptions disqualifies SEM s parameters from having an interpretation as causal effects, no method whatsoever can endow any parameter with such interpretation, and science is not prepared to accept this limitation. But then, if the parameters estimated by SEM methods are legitimate carriers of causal
3 claims, and if those claims cannot be proven valid by the data alone, what is the empirical content of those claims? What good are the numerical values of the parameters? Can they inform prediction, decision or scientific understanding? Are they not merely fiction of one s fancy, comparable say to horoscopic speculations? The aim of this chapter is to lay a coherent logical framework for answering these foundational questions. Following a brief historical account of how the causal interpretation of SEM was obscured (Section??), we will explicate the empirical content of SEM s claims (Section??), and describe the tools needed for solving most (if not all) problems involving causal relationships (Sections?? and??). The tools are based on non-parametric structural equation models a natural generalization of those used by econometricians and social scientists in the s, which will serve as an Archimedean Point to liberate SEM from its parametric blinders and illucidate its causal content. In particular we will introduce 1. Tools of reading and explicating the causal assumptions embodied in SEM models as well as the set of assumptions that support each individual causal claim. 2. Methods of identifying the testable implications (if any) of the assumptions in (1), and ways of testing, not the model in its entirety, but the testable implications of the assumptions behind each individual causal claim. 3. Methods of deciding, prior to taking any data, what measurements ought to be taken, whether one set of measurements is as good as to another, and which measurements tend to bias our estimates of the target quantities. 4. Methods for devising critical statistical tests by which two competing theories can be distinguished. 5. Methods of deciding mathematically if the causal relationships of interest are estimable from the data and, if not, what additional assumptions, measurements or experiments would render them estimable, 6. Methods of recognizing and generating equivalent models which solidify, extend, and amend the heuristic methods of Stelzl (1986) and Lee and Hershberger (1990)
4 7. Generalization of SEM to categorical data and non-linear interactions, including a solution to the so called Mediation Problem, (Baron and Kenny, 1986; MacKinnon, 2008). still to cite???: Shadish (2010); West and Thoemmes (2010); Imbens (2010); Cook and Steiner (2010) References Baron, R. and Kenny, D. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology Bentler, P. (2006). EQS Structural Equations Program Manual. Multivariate Software, Inc., Encino, CA, USA. Berk, R. (2004). Regression Analysis: A Constructive Critique. Sage, Thousand Oaks, CA. Blalock, H. (1964). Causal Inferences in Nonexperimental Research. University of North Carolina Press, Chapel Hill. Bollen, K. (1989). Structural Equations with Latent Variables. John Wiley, New York. Cook, T. and Steiner, P. (2010). Case matching and the reduction of selection bias in quasi-experiments: The relative importance of pretest measures of outcome, of unreliable measurement, and of mode of data analysis. Psychological Methods Duncan, O. (1975). Introduction to Structural Equation Models. Academic Press, New York. Fleming, T. and DeMets, D. (1996). Surrogate end points in clinical trials: are we being misled? Annals of Internal Medicine Freedman, D. (1987). As others see us: A case study in path analysis (with discussion). Journal of Educational Statistics
5 Green, D., Ha, S. and Bullock, J. (2010). Enough already about black box experiments: Studying mediation is more difficult than most scholars suppose. Annals of the American Academy of Political and Social Science Imbens, G. (2010). An economists perspective on Shadish (2010) and West and Thoemmes (2010). Psychological Methods Kraemer, H., Kiernan, M., Essex, M. and Kupfer, D. (2008). How and why criteria defining moderators and mediators differ between the Baron & Kenny and MacArthur approaches. Health Psychology 27 S101 S108. Lee, S. and Hershberger, S. (1990). A simple rule for generating equivalent models in covariance structure modeling. Multivariate Behavioral Research MacKinnon, D. (2008). Introduction to Statistical Mediation Analysis. Lawrence Erlbaum Associates, New York. Maxwell, S. (2010). Introduction to the special section on Campbells and Rubins conceptualizations of causality. Psychological Methods Pearl, J. (2009). Causality: Models, Reasoning, and Inference. 2nd ed. Cambridge University Press, New York. Rubin, D. (2009). Author s reply: Should observational studies be designed to allow lack of balance in covariate distributions across treatment group? Statistics in Medicine Rubin, D. (2010). Reflections stimulated by the comments of Shadish (2010) and West and Thoemmes (2010). Psychological Methods Shadish, W. (2010). Campbell and Rubin: A primer and comparison of their approaches to causal inference in field settings. Psychological Methods Shrout, P. and Bolger, N. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods
6 Sobel, M. (2008). Identification of causal parameters in randomized studies with mediating variables. Journal of Educational and Behavioral Statistics Sørensen, A. (1998). Theoretical methanisms and the empirical study of social processes. In Social Mechanisms: An Analytical Approach to Social Theory, Studies in Rationality and Social Change (P. Hedström and R. Swedberg, eds.). Cambridge University Press, Cambridge, Steiger, J. (2001). Driving fast in reverse. Journal of the American Statistical Association Stelzl, I. (1986). Changing a causal hypothesis without changing the fit: Some rules for generating equivalent path models. Multivariate Behavioral Research West, S. and Thoemmes, F. (2010). Campbells and Rubins perspectives on causal inference. Psychological Methods Wilkinson, L., the Task Force on Statistical Inference and APA Board of Scientific Affairs (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist Wright, S. (1921). Correlation and causation. Journal of Agricultural Research
Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl
Book review of Herbert I. Weisberg: Bias and Causation, Models and Judgment for Valid Comparisons Reviewed by Judea Pearl Judea Pearl University of California, Los Angeles Computer Science Department Los
More informationPropensity Score Analysis Shenyang Guo, Ph.D.
Propensity Score Analysis Shenyang Guo, Ph.D. Upcoming Seminar: April 7-8, 2017, Philadelphia, Pennsylvania Propensity Score Analysis 1. Overview 1.1 Observational studies and challenges 1.2 Why and when
More informationTHE INDIRECT EFFECT IN MULTIPLE MEDIATORS MODEL BY STRUCTURAL EQUATION MODELING ABSTRACT
European Journal of Business, Economics and Accountancy Vol. 4, No. 3, 016 ISSN 056-6018 THE INDIRECT EFFECT IN MULTIPLE MEDIATORS MODEL BY STRUCTURAL EQUATION MODELING Li-Ju Chen Department of Business
More informationHow to Model Mediating and Moderating Effects. Hsueh-Sheng Wu CFDR Workshop Series November 3, 2014
How to Model Mediating and Moderating Effects Hsueh-Sheng Wu CFDR Workshop Series November 3, 2014 1 Outline Why study moderation and/or mediation? Moderation Logic Testing moderation in regression Checklist
More informationHow to Model Mediating and Moderating Effects. Hsueh-Sheng Wu CFDR Workshop Series Summer 2012
How to Model Mediating and Moderating Effects Hsueh-Sheng Wu CFDR Workshop Series Summer 2012 1 Outline Why study moderation and/or mediation? Moderation Logic Testing moderation in regression Checklist
More informationCausal Thinking in the Twilight Zone
Observational Studies 1 (2015) 200-204 Submitted 7/15; Published 8/15 TECHNICAL REPORT R-456 August 2015 Causal Thinking in the Twilight Zone Judea Pearl Computer Science Department University of California,
More informationOverview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany
Overview of Perspectives on Causal Inference: Campbell and Rubin Stephen G. West Arizona State University Freie Universität Berlin, Germany 1 Randomized Experiment (RE) Sir Ronald Fisher E(X Treatment
More informationSupplement 2. Use of Directed Acyclic Graphs (DAGs)
Supplement 2. Use of Directed Acyclic Graphs (DAGs) Abstract This supplement describes how counterfactual theory is used to define causal effects and the conditions in which observed data can be used to
More informationGroup Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search.
Group Assignment #1: Concept Explication 1. Preliminary identification of the concept. Identify and name each concept your group is interested in examining. Questions to asked and answered: Is each concept
More informationPharmaSUG Paper HA-04 Two Roads Diverged in a Narrow Dataset...When Coarsened Exact Matching is More Appropriate than Propensity Score Matching
PharmaSUG 207 - Paper HA-04 Two Roads Diverged in a Narrow Dataset...When Coarsened Exact Matching is More Appropriate than Propensity Score Matching Aran Canes, Cigna Corporation ABSTRACT Coarsened Exact
More informationAlternative Methods for Assessing the Fit of Structural Equation Models in Developmental Research
Alternative Methods for Assessing the Fit of Structural Equation Models in Developmental Research Michael T. Willoughby, B.S. & Patrick J. Curran, Ph.D. Duke University Abstract Structural Equation Modeling
More informationCausal Thinking in the Twilight Zone
Forthcoming: Observational Studies Special Issue on William Cochran's contributions. TECHNICAL REPORT R-456 July 2015 Causal Thinking in the Twilight Zone Judea Pearl University of California, Los Angeles
More informationCurrent Directions in Mediation Analysis David P. MacKinnon 1 and Amanda J. Fairchild 2
CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Current Directions in Mediation Analysis David P. MacKinnon 1 and Amanda J. Fairchild 2 1 Arizona State University and 2 University of South Carolina ABSTRACT
More informationMediation Testing in Management Research: A Review and Proposals
Utah State University From the SelectedWorks of Alison Cook January 1, 2008 Mediation Testing in Management Research: A Review and Proposals R. E. Wood J. S. Goodman N. Beckmann Alison Cook, Utah State
More informationDurham Research Online
Durham Research Online Deposited in DRO: 15 April 2015 Version of attached le: Accepted Version Peer-review status of attached le: Peer-reviewed Citation for published item: Wood, R.E. and Goodman, J.S.
More informationStrategies to Measure Direct and Indirect Effects in Multi-mediator Models. Paloma Bernal Turnes
China-USA Business Review, October 2015, Vol. 14, No. 10, 504-514 doi: 10.17265/1537-1514/2015.10.003 D DAVID PUBLISHING Strategies to Measure Direct and Indirect Effects in Multi-mediator Models Paloma
More informationRealism and Qualitative Research. Joseph A. Maxwell George Mason University
Realism and Qualitative Research Joseph A. Maxwell George Mason University Philosophic realism in general is "the view that entities exist independently of being perceived, or independently of our theories
More informationExperimental Psychology
Title Experimental Psychology Type Individual Document Map Authors Aristea Theodoropoulos, Patricia Sikorski Subject Social Studies Course None Selected Grade(s) 11, 12 Location Roxbury High School Curriculum
More informationExperimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8
Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to
More informationINTERVIEWS II: THEORIES AND TECHNIQUES 5. CLINICAL APPROACH TO INTERVIEWING PART 1
INTERVIEWS II: THEORIES AND TECHNIQUES 5. CLINICAL APPROACH TO INTERVIEWING PART 1 5.1 Clinical Interviews: Background Information The clinical interview is a technique pioneered by Jean Piaget, in 1975,
More informationChapter 21 Multilevel Propensity Score Methods for Estimating Causal Effects: A Latent Class Modeling Strategy
Chapter 21 Multilevel Propensity Score Methods for Estimating Causal Effects: A Latent Class Modeling Strategy Jee-Seon Kim and Peter M. Steiner Abstract Despite their appeal, randomized experiments cannot
More informationShould Causality Be Defined in Terms of Experiments? University of Connecticut University of Colorado
November 2004 Should Causality Be Defined in Terms of Experiments? David A. Kenny Charles M. Judd University of Connecticut University of Colorado The research was supported in part by grant from the National
More informationW e l e a d
http://www.ramayah.com 1 2 Developing a Robust Research Framework T. Ramayah School of Management Universiti Sains Malaysia ramayah@usm.my Variables in Research Moderator Independent Mediator Dependent
More informationThe University of North Carolina at Chapel Hill School of Social Work
The University of North Carolina at Chapel Hill School of Social Work SOWO 918: Applied Regression Analysis and Generalized Linear Models Spring Semester, 2014 Instructor Shenyang Guo, Ph.D., Room 524j,
More informationTACKLING WITH REVIEWER S COMMENTS:
TACKLING WITH REVIEWER S COMMENTS: Comment (a): The abstract of the research paper does not provide a bird s eye view (snapshot view) of what is being discussed throughout the paper. The reader is likely
More informationCausal Validity Considerations for Including High Quality Non-Experimental Evidence in Systematic Reviews
Non-Experimental Evidence in Systematic Reviews OPRE REPORT #2018-63 DEKE, MATHEMATICA POLICY RESEARCH JUNE 2018 OVERVIEW Federally funded systematic reviews of research evidence play a central role in
More informationLecture 9 Internal Validity
Lecture 9 Internal Validity Objectives Internal Validity Threats to Internal Validity Causality Bayesian Networks Internal validity The extent to which the hypothesized relationship between 2 or more variables
More information(CORRELATIONAL DESIGN AND COMPARATIVE DESIGN)
UNIT 4 OTHER DESIGNS (CORRELATIONAL DESIGN AND COMPARATIVE DESIGN) Quasi Experimental Design Structure 4.0 Introduction 4.1 Objectives 4.2 Definition of Correlational Research Design 4.3 Types of Correlational
More information26:010:557 / 26:620:557 Social Science Research Methods
26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview
More informationUse of Structural Equation Modeling in Social Science Research
Asian Social Science; Vol. 11, No. 4; 2015 ISSN 1911-2017 E-ISSN 1911-2025 Published by Canadian Center of Science and Education Use of Structural Equation Modeling in Social Science Research Wali Rahman
More informationRegression Discontinuity Analysis
Regression Discontinuity Analysis A researcher wants to determine whether tutoring underachieving middle school students improves their math grades. Another wonders whether providing financial aid to low-income
More informationinvestigate. educate. inform.
investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced
More informationPSYC3010 Advanced Statistics for Psychology
PSYC3010 Advanced Statistics for Psychology Unit of Study Code: PSYC3010 Coordinators: REGRESSION - SECTION 1 Dr Sabina Kleitman Office: BM441 Phone: 9351 7703 E- mail: sabina.kleitman@sydney.edu.au ANOVA
More informationMoving beyond regression toward causality:
Moving beyond regression toward causality: INTRODUCING ADVANCED STATISTICAL METHODS TO ADVANCE SEXUAL VIOLENCE RESEARCH Regine Haardörfer, Ph.D. Emory University rhaardo@emory.edu OR Regine.Haardoerfer@Emory.edu
More informationHow and Why Criteria Defining Moderators and Mediators Differ Between the Baron & Kenny and MacArthur Approaches
Health Psychology Copyright 2008 by the American Psychological Association 2008, Vol. 27, No. 2(Suppl.), S101 S108 0278-6133/08/$12.00 DOI: 10.1037/0278-6133.27.2(Suppl.).S101 How and Why Criteria Defining
More informationComments on Limits of Econometrics by David Freedman. Arnold Zellner. University of Chicago
Comments on Limits of Econometrics by David Freedman Arnold Zellner University of Chicago David Freedman s impressive paper reveals well his deep understanding of not only statistical techniques and their
More informationAbstract Title Page Not included in page count. Title: Analyzing Empirical Evaluations of Non-experimental Methods in Field Settings
Abstract Title Page Not included in page count. Title: Analyzing Empirical Evaluations of Non-experimental Methods in Field Settings Authors and Affiliations: Peter M. Steiner, University of Wisconsin-Madison
More informationCan Quasi Experiments Yield Causal Inferences? Sample. Intervention 2/20/2012. Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University
Can Quasi Experiments Yield Causal Inferences? Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University Sample Study 1 Study 2 Year Age Race SES Health status Intervention Study 1 Study 2 Intervention
More informationCausal Inference in Randomized Experiments With Mediational Processes
Psychological Methods 2008, Vol. 13, No. 4, 314 336 Copyright 2008 by the American Psychological Association 1082-989X/08/$12.00 DOI: 10.1037/a0014207 Causal Inference in Randomized Experiments With Mediational
More informationThis module illustrates SEM via a contrast with multiple regression. The module on Mediation describes a study of post-fire vegetation recovery in
This module illustrates SEM via a contrast with multiple regression. The module on Mediation describes a study of post-fire vegetation recovery in southern California woodlands. Here I borrow that study
More informationFull terms and conditions of use:
This article was downloaded by: [University of Massachusetts, Amherst] On: 14 December 2012, At: 09:57 Publisher: Routledge Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered
More informationSpeaker Notes: Qualitative Comparative Analysis (QCA) in Implementation Studies
Speaker Notes: Qualitative Comparative Analysis (QCA) in Implementation Studies PART 1: OVERVIEW Slide 1: Overview Welcome to Qualitative Comparative Analysis in Implementation Studies. This narrated powerpoint
More informationApproaches to Improving Causal Inference from Mediation Analysis
Approaches to Improving Causal Inference from Mediation Analysis David P. MacKinnon, Arizona State University Pennsylvania State University February 27, 2013 Background Traditional Mediation Methods Modern
More informationTHE USE OF MULTIVARIATE ANALYSIS IN DEVELOPMENT THEORY: A CRITIQUE OF THE APPROACH ADOPTED BY ADELMAN AND MORRIS A. C. RAYNER
THE USE OF MULTIVARIATE ANALYSIS IN DEVELOPMENT THEORY: A CRITIQUE OF THE APPROACH ADOPTED BY ADELMAN AND MORRIS A. C. RAYNER Introduction, 639. Factor analysis, 639. Discriminant analysis, 644. INTRODUCTION
More informationSimultaneous Equation and Instrumental Variable Models for Sexiness and Power/Status
Simultaneous Equation and Instrumental Variable Models for Seiness and Power/Status We would like ideally to determine whether power is indeed sey, or whether seiness is powerful. We here describe the
More informationPrinciples of Sociology
Principles of Sociology DEPARTMENT OF ECONOMICS ATHENS UNIVERSITY OF ECONOMICS AND BUSINESS [Academic year 2017/18, FALL SEMESTER] Lecturer: Dimitris Lallas Principles of Sociology 4th Session Sociological
More informationPractical propensity score matching: a reply to Smith and Todd
Journal of Econometrics 125 (2005) 355 364 www.elsevier.com/locate/econbase Practical propensity score matching: a reply to Smith and Todd Rajeev Dehejia a,b, * a Department of Economics and SIPA, Columbia
More informationRESEARCH METHODS. Winfred, research methods, ; rv ; rv
RESEARCH METHODS 1 Research Methods means of discovering truth 2 Research Methods means of discovering truth what is truth? 3 Research Methods means of discovering truth what is truth? Riveda Sandhyavandanam
More informationControl of Confounding in the Assessment of Medical Technology
International Journal of Epidemiology Oxford University Press 1980 Vol.9, No. 4 Printed in Great Britain Control of Confounding in the Assessment of Medical Technology SANDER GREENLAND* and RAYMOND NEUTRA*
More informationInteraction Effects: Centering, Variance Inflation Factor, and Interpretation Issues
Robinson & Schumacker Interaction Effects: Centering, Variance Inflation Factor, and Interpretation Issues Cecil Robinson Randall E. Schumacker University of Alabama Research hypotheses that include interaction
More informationRESEARCH METHODS. Winfred, research methods,
RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,
More informationUnderstanding. Regression Analysis
Understanding Regression Analysis Understanding Regression Analysis Michael Patrick Allen Washington State University Pullman, Washington Plenum Press New York and London Llbrary of Congress Cataloging-in-Publication
More informationDEVELOPING THE RESEARCH FRAMEWORK Dr. Noly M. Mascariñas
DEVELOPING THE RESEARCH FRAMEWORK Dr. Noly M. Mascariñas Director, BU-CHED Zonal Research Center Bicol University Research and Development Center Legazpi City Research Proposal Preparation Seminar-Writeshop
More informationThe Role of Mediator in Relationship between Motivations with Learning Discipline of Student Academic Achievement
The Role of Mediator in Relationship between Motivations with Learning Discipline of Student Academic Achievement Zamri Chik, Abdul Hakim Abdullah To Link this Article: http://dx.doi.org/10.6007/ijarbss/v8-i11/4959
More informationChapter 02. Basic Research Methodology
Chapter 02 Basic Research Methodology Definition RESEARCH Research is a quest for knowledge through diligent search or investigation or experimentation aimed at the discovery and interpretation of new
More informationA reply to Rose, Livengood, Sytsma, and Machery
A reply to Rose, Livengood, Sytsma, and Machery Chandra Sekhar Sripada 1,2, Richard Gonzalez 3,4,5, Daniel Kessler 2, Eric Laber 6, Sara Konrath 7,8, Vijay Nair 4 1 Department of Philosophy, University
More informationIntroduction to Meta-Analysis
Introduction to Meta-Analysis Nazım Ço galtay and Engin Karada g Abstract As a means to synthesize the results of multiple studies, the chronological development of the meta-analysis method was in parallel
More informationUsing Mediated Moderation to Explain Treatment-by-Site Interaction in Multisite Clinical Trials
Using Mediated Moderation to Explain Treatment-by-Site Interaction in Multisite Clinical Trials Assistant Professor of Medicine, Biostatistics, and Clinical & Translational Sciences Center for Research
More informationJournal of Political Economy, Vol. 93, No. 2 (Apr., 1985)
Confirmations and Contradictions Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Estimates of the Deterrent Effect of Capital Punishment: The Importance of the Researcher's Prior Beliefs Walter
More informationBusiness Statistics Probability
Business Statistics The following was provided by Dr. Suzanne Delaney, and is a comprehensive review of Business Statistics. The workshop instructor will provide relevant examples during the Skills Assessment
More informationWhich Comparison-Group ( Quasi-Experimental ) Study Designs Are Most Likely to Produce Valid Estimates of a Program s Impact?:
Which Comparison-Group ( Quasi-Experimental ) Study Designs Are Most Likely to Produce Valid Estimates of a Program s Impact?: A Brief Overview and Sample Review Form February 2012 This publication was
More informationMachine Learning and Computational Social Science Intersections and Collisions
Machine Learning and Computational Social Science Intersections and Collisions David Jensen Department of Computer Science University of Massachusetts mherst 17 December 2011 1202 Introduced new representations
More informationPsych 1Chapter 2 Overview
Psych 1Chapter 2 Overview After studying this chapter, you should be able to answer the following questions: 1) What are five characteristics of an ideal scientist? 2) What are the defining elements of
More informationModelling Double-Moderated-Mediation & Confounder Effects Using Bayesian Statistics
Modelling Double-Moderated-Mediation & Confounder Effects Using Bayesian Statistics George Chryssochoidis*, Lars Tummers**, Rens van de Schoot***, * Norwich Business School, University of East Anglia **
More informationChapter 2. The Research Enterprise in Psychology 8 th Edition
Chapter 2 The Research Enterprise in Psychology 8 th Edition The Scientific Approach: A Search for Laws Empiricism Basic assumption: events are governed by some lawful order Goals: Measurement and description
More informationPros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany
Dan A. Black University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Matching as a regression estimator Matching avoids making assumptions about the functional form of the regression
More informationModerating and Mediating Variables in Psychological Research
Milin, P., & Hadžić, O. (2011). Moderating and Mediating Variables in Psychological Research. In M. Lovrić (Ed.) International Encyclopedia of Statistical Science (pp. 849-852). Berlin: Springer. Moderating
More informationBill Wilson. Categorizing Cognition: Toward Conceptual Coherence in the Foundations of Psychology
Categorizing Cognition: Toward Conceptual Coherence in the Foundations of Psychology Halford, G.S., Wilson, W.H., Andrews, G., & Phillips, S. (2014). Cambridge, MA: MIT Press http://mitpress.mit.edu/books/categorizing-cognition
More informationCognitive domain: Comprehension Answer location: Elements of Empiricism Question type: MC
Chapter 2 1. Knowledge that is evaluative, value laden, and concerned with prescribing what ought to be is known as knowledge. *a. Normative b. Nonnormative c. Probabilistic d. Nonprobabilistic. 2. Most
More informationStatistical Interaction between Two Continuous (Latent) Variables
11th Congress of the Swiss Psychological Society August 19-20, 2009, University of Neuchâtel Statistical Interaction between Two Continuous (Latent) Variables Guillaume Fürst & Paolo Ghisletta University
More informationFrom Description to Causation
From Description to Causation Department of Government London School of Economics and Political Science 1 Correlation vs. Causation 2 Over-Time Changes 3 Getting Systematic about Causality What makes something
More informationCHAPTER NINE DATA ANALYSIS / EVALUATING QUALITY (VALIDITY) OF BETWEEN GROUP EXPERIMENTS
CHAPTER NINE DATA ANALYSIS / EVALUATING QUALITY (VALIDITY) OF BETWEEN GROUP EXPERIMENTS Chapter Objectives: Understand Null Hypothesis Significance Testing (NHST) Understand statistical significance and
More informationTOWARD IMPROVED USE OF REGRESSION IN MACRO-COMPARATIVE ANALYSIS
TOWARD IMPROVED USE OF REGRESSION IN MACRO-COMPARATIVE ANALYSIS Lane Kenworthy I agree with much of what Michael Shalev (2007) says in his paper, both about the limits of multiple regression and about
More informationDurkheim. Durkheim s fundamental task in Rules of the Sociological Method is to lay out
Michelle Lynn Tey Meadow Jane Jones Deirdre O Sullivan Durkheim Durkheim s fundamental task in Rules of the Sociological Method is to lay out the basic disciplinary structure of sociology. He begins by
More informationREPEATED MEASURES DESIGNS
Repeated Measures Designs The SAGE Encyclopedia of Educational Research, Measurement and Evaluation Markus Brauer (University of Wisconsin-Madison) Target word count: 1000 - Actual word count: 1071 REPEATED
More informationCSC2130: Empirical Research Methods for Software Engineering
CSC2130: Empirical Research Methods for Software Engineering Steve Easterbrook sme@cs.toronto.edu www.cs.toronto.edu/~sme/csc2130/ 2004-5 Steve Easterbrook. This presentation is available free for non-commercial
More informationGeneralizing Experimental Findings
Forthcoming, Journal of Causal Inference, Causal, Casual, and Curious Section. TECHNICAL REPORT R-452 July 2015 Generalizing Experimental Findings Judea Pearl University of California, Los Angeles Computer
More informationEXPERIMENTAL RESEARCH DESIGNS
ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study
More informationImpact and adjustment of selection bias. in the assessment of measurement equivalence
Impact and adjustment of selection bias in the assessment of measurement equivalence Thomas Klausch, Joop Hox,& Barry Schouten Working Paper, Utrecht, December 2012 Corresponding author: Thomas Klausch,
More informationCHAPTER VI RESEARCH METHODOLOGY
CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the
More informationICPSR Causal Inference in the Social Sciences. Course Syllabus
ICPSR 2012 Causal Inference in the Social Sciences Course Syllabus Instructors: Dominik Hangartner London School of Economics Marco Steenbergen University of Zurich Teaching Fellow: Ben Wilson London School
More informationThe Use of Meta-Analysis in Validating the Delone and McLean Information Systems Success Model
The Use of Meta-Analysis in Validating the Delone and McLean Information Systems Success Model Mark Hwang The University of Texas-Pan American Edinburg, Texas Ephraim R. McLean Georgia State University
More informationHerman Aguinis Avram Tucker Distinguished Scholar George Washington U. School of Business
Herman Aguinis Avram Tucker Distinguished Scholar George Washington U. School of Business The Urgency of Methods Training Research methodology is now more important than ever Retractions, ethical violations,
More informationDefinitions of Nature of Science and Scientific Inquiry that Guide Project ICAN: A Cheat Sheet
Definitions of Nature of Science and Scientific Inquiry that Guide Project ICAN: A Cheat Sheet What is the NOS? The phrase nature of science typically refers to the values and assumptions inherent to scientific
More informationBy Mats Alvesson & Jörgen Sandberg (Constructing Research Questions, Sage 2013)
Generating research questions through problematization By Mats Alvesson & Jörgen Sandberg (Constructing Research Questions, Sage 2013) What research questions produce significant theories? Gap-spotting:
More informationCausal Inference Course Syllabus
ICPSR Summer Program Causal Inference Course Syllabus Instructors: Dominik Hangartner Marco R. Steenbergen Summer 2011 Contact Information: Marco Steenbergen, Department of Social Sciences, University
More informationCross-Lagged Panel Analysis
Cross-Lagged Panel Analysis Michael W. Kearney Cross-lagged panel analysis is an analytical strategy used to describe reciprocal relationships, or directional influences, between variables over time. Cross-lagged
More informationWhat is: regression discontinuity design?
What is: regression discontinuity design? Mike Brewer University of Essex and Institute for Fiscal Studies Part of Programme Evaluation for Policy Analysis (PEPA), a Node of the NCRM Regression discontinuity
More information9 research designs likely for PSYC 2100
9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one
More informationEmpirical Tools of Public Finance. 131 Undergraduate Public Economics Emmanuel Saez UC Berkeley
Empirical Tools of Public Finance 131 Undergraduate Public Economics Emmanuel Saez UC Berkeley 1 DEFINITIONS Empirical public finance: The use of data and statistical methods to measure the impact of government
More informationWorking Paper: Designs of Empirical Evaluations of Non-Experimental Methods in Field Settings. Vivian C. Wong 1 & Peter M.
EdPolicyWorks Working Paper: Designs of Empirical Evaluations of Non-Experimental Methods in Field Settings Vivian C. Wong 1 & Peter M. Steiner 2 Over the last three decades, a research design has emerged
More informationValidity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04
Validity and Quantitative Research RCS 6740 6/16/04 What is Validity? Valid Definition (Dictionary.com): Well grounded; just: a valid objection. Producing the desired results; efficacious: valid methods.
More information1. Between White and Black: The Faces of American Institutions in the Ghetto
1. Between White and Black: The Faces of American Institutions in the Ghetto 2. Collective Behavior 3. The Roots of Urban Discontent 4. A Measure of Justice: An Empirical Study, Changes in the California
More informationFrom Bivariate Through Multivariate Techniques
A p p l i e d S T A T I S T I C S From Bivariate Through Multivariate Techniques R e b e c c a M. W a r n e r University of New Hampshire DAI HOC THAI NGUYEN TRUNG TAM HOC LIEU *)SAGE Publications '55'
More informationCarrying out an Empirical Project
Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric
More informationMediational Analysis in HIV/AIDS Research: Estimating Multivariate Path Analytic Models in a Structural Equation Modeling Framework
AIDS Behav (2007) 11:365 383 DOI 10.1007/s10461-006-9150-2 REVIEW PAPER Mediational Analysis in HIV/AIDS Research: Estimating Multivariate Path Analytic Models in a Structural Equation Modeling Framework
More informationUsing mediation analysis to identify causal mechanisms in disease management interventions
Health Serv Outcomes Res Method (2013) 13:86 108 DOI 10.1007/s10742-013-0106-5 Using mediation analysis to identify causal mechanisms in disease management interventions Ariel Linden Kristian Bernt Karlson
More informationA SAS Macro to Investigate Statistical Power in Meta-analysis Jin Liu, Fan Pan University of South Carolina Columbia
Paper 109 A SAS Macro to Investigate Statistical Power in Meta-analysis Jin Liu, Fan Pan University of South Carolina Columbia ABSTRACT Meta-analysis is a quantitative review method, which synthesizes
More informationRelationship, Correlation, & Causation DR. MIKE MARRAPODI
Relationship, Correlation, & Causation DR. MIKE MARRAPODI Topics Relationship Correlation Causation Relationship Definition The way in which two or more people or things are connected, or the state of
More informationJake Bowers Wednesdays, 2-4pm 6648 Haven Hall ( ) CPS Phone is
Political Science 688 Applied Bayesian and Robust Statistical Methods in Political Research Winter 2005 http://www.umich.edu/ jwbowers/ps688.html Class in 7603 Haven Hall 10-12 Friday Instructor: Office
More information