Effects of propensity score overlap on the estimates of treatment effects. Yating Zheng & Laura Stapleton
|
|
- Mervin Montgomery
- 5 years ago
- Views:
Transcription
1 Effects of propensity score overlap on the estimates of treatment effects Yating Zheng & Laura Stapleton Introduction Recent years have seen remarkable development in estimating average treatment effects in non-experimental designs. Researchers have developed various methods, including matching (Rosenbaum, 1989), regression (Hahn, 1998; Heckman et al., 1998), and propensity score methods (Rosenbaum & Rubin, 1983; Hirano et al., 2003). Among these methods, propensity score methods are popular because 1) compared with matching, they can easily construct matched sets with similar distributions of multiple covariates to facilitate estimation of unbiased treatment effects, 2) they can avoid the assumption violation problems in regression (e.g., the functional form may not correctly specify the relation between the covariates and the outcome for data not observed). However, propensity score methods are not without their limitations. A potential concern is that they require sufficient overlap of the propensity score distributions between the treatment and control groups (Crump et al., 2009), which sometimes may not be the case in practice. However, previous studies have seldom explored what it is sufficient overlap and how it would influence the estimates of the treatment effects. In this study, a simulation study is used to explore the effects of propensity score overlap on the point estimates of treatment effects as well as their sampling variance. Theoretical Framework The propensity score is defined as the probability of receiving the treatment given the observed covariates (Rosenbaum & Rubin, 1983). In general, propensity score methods (matching, weighting and sub-classification) work through five steps: 1) identify baseline confounding covariates that could potentially bias estimates of the treatment effect, 2) calculate propensity scores into treatment using logistic regression (or a nonparametric approach) on the baseline covariates, 3) condition the propensity scores between the treatment and control groups through matching or reweighting of the data, 4) check the conditioning quality (e.g., balance check) of the matched samples, 5) estimate the treatment effects (Stuart, 2010). To obtain reliable estimates of treatment effects, it requires a sufficient overlap between the treatment and control groups. The lack of overlap can lead to imprecise estimates of the treatment effects (Crump et al., 2009) as insufficient overlap implies that the treatment and control groups are not balanced in the covariates. Step 3 aims to address this issue of unbalanced covariate distributions. However, the current methods have limitations. A common way is to discard individuals with propensity scores outside the range of the other group (Grzybowski et al., 2003; Vincent et al., 2002), which may change the population for which the results apply (Crump et al., 2009). Another way is to change the weight, or contribution, of data from participants in the control group, increasing the weights of those with propensity scores similar to the participants in the treatment group and decreasing the weights of individuals with propensity scores different from those in the treatment group (Heckman et al., 1998; Dehejia & Wahba,
2 1999). A potential drawback of the weighting method is that the variance may be high if the weights are extreme (Stuart, 2010). Few studies have explored the effects of propensity score overlap on the estimates of treatment effects and how imprecise the estimates would be for different levels of overlap. In this study, we use an index to quantify the overlap and explore the reliability and validity of the estimates at different overlap levels. In addition, we also explore the effects of insufficient overlap on the estimates of treatment effects using different propensity score methods (weighting, matching and doubly robust methods) to provide a guide rule about which method performs better under what overlap level. Methods Research Design The data generation process follows a common approach used in prior propensity score simulation studies (Kaplan & Chen, 2011; Craycrot, 2016): 1. generate confounding covariates X 1, X 2 and X 3 from normal and binomial distributions 2. calculate the propensity score (ps) using Eq(1) exp (β! X! + β! X! + β! X! ) ps = Eq(1) 1 + exp (β! X! + β! X! + β! X! ) 3. use Bernoulli distribution with probability of the calculated propensity score to decide treatment assignment 4. calculate the outcome value using Eq(2) Y = α! X! + α! X! + α! X! + α! T Eq 2 where T is an indicator of treatment assignment, control = 0, and treat = 1; α 4 is the true treatment effect. The values of all parameters are listed in Table 1 (In the full presentation, interactions between predictors, and interactions between the treatment assignment and the predictors will be added). Ten thousand replications are run. For each replication, the sample size is 1,000. Table 1. Values of the parameters X 1 ~ Normal(mean1, 1), mean1 ~ Normal(0, 1) X 2 ~ Normal(mean2, 1), mean2 ~ Normal(0.5, 1) X 3 ~ Binomial(1,000, 0.5) β 1 = 0.3, β 2 = 0.4, β 3 = -1 α 1 = 0.4, α 2 = -0.3, α 3 = 0.2, α 4 = 0.15 Note. Mean1 and mean2 are both vectors of size 10,000. Propensity score methods are then used to estimate treatment effects. First, a logistic regression model is run using the generated covariates as predictors and the treatment assignment as the outcome and the fitted model is used to obtain estimated propensity scores. The next step is to calculate the overlap rate of the propensity score distributions, which equals the intersection area of the density plots of the two groups divided by the sum of the area of the two density plots (the intersection area is only counted once). For example, in Figure 1, the overlap rate is the ratio of area 2 over the sum of areas 1, 2 and 3. As the overlap rate is empirically defined, we cannot control the number of replications
3 for each overlap rate level. Finally, different propensity score methods are used to estimate the treatment effect. For propensity score weighting, the method of weighting by the odds (WBO) is used, calculated as: w! = T! + (1 T!) e! 1 e! Eq(3) where w! is the weight for subject i, T! is an indicator about whether subject i received the treatment, and e! is the estimated propensity score for subject i Figure 1. Propensity score distributions of treatment and control groups. Analysis The estimated treatment effect is calculated as the average group mean difference after matching/weighting/sub-classification. Relative bias (the proportional difference between the true and estimated treatment effect) and variance (variance of the estimated treatment effects for a specific overlap level over replications) are used to measure the performance of the estimates. Preliminary Results The results from propensity score weighting shows that, in general, as the overlap rate increases the variance of the estimates decreases (see Figure 2) which is consistent with the findings of previous studies (Stuart, 2010); we quantify this decrease in variance for different overlap levels. Regarding bias, when the overlap rate is extremely small (<0.2), the relative average bias is comparatively large (see Table 2) but when the overlap rate goes beyond 0.2, the relative average bias becomes small. This implies that we need to be cautious about using propensity score weighting method to estimate treatment effects when the propensity score overlap rate is smaller than 0.2. A possible reason for the comparatively higher bias at low overlap levels is that the WBO method does not exclude control individuals who are very different from those receiving treatment. Although their weights are decreased, inclusion of a large amount of people with very different propensities, which is the case at low overlap rates, may bias the estimates. In
4 the full presentation, other propensity score methods (e.g., matching, doubly robust methods) will be explored as well as inclusion of interactions within the treatment effect generation model (Eq2). Results from different methods will be compared to provide guidelines about which method is recommended under what overlap rate. Figure 2. Relationship between bias and estimated overlap rate. Table 2. Average bias and variance of the estimated treatment effect overlap level N Relative mean bias Variance* [0, 0.1) % [0.1, 0.2) % [0.2, 0.3) % [0.3, 0.4) % [0.4, 0.5) % 54.2 [0.5, 0.6) % 17.0 [0.6, 0.7) % 7.2 [0.7, 0.8) % 2.9 [0.8, 0.9) % 0.5 [0.9, 1] 2 0.3% 0.0 Note. N is the number of replications with empirical overlap rates in the category listed. Extremely high overlap rates are difficult to obtain given the generation model in Eq1, so the frequency of replications with high overlap levels is very small. Relative mean bias is the ratio of mean bias over true treatment effect, where true treatment effect is 0.15 in this case. Variance has been rescaled by a factor of 100,000.
5 References Crump, R. K., Hotz, V. J., Imbens, G., W. & Mitnik, O. A. (2009). Dealing with limited overlap in estimation of average treatment effects. Biometrika, 96(1), Dehejia, R. H. & Wahba, S. (1999). Causal effects in nonexperimental studies: Reevluating the evaluation of training programs. Journal of the American Statitstical Association, 94(448), Grzybowski, M., Clements, E. A., Parsons, L., Welch, R., Tintinalli, A. T. & Ross, M. A. (2003). Mortality benefit of immediate revascularization of acute STT-segement elevation myocardinal infarction in patients with contraindications to thrombolytic therapy: A propensity analysis. Journal of the American Medical Association, 290, Hahn, J. (1998). On the role of the propensity score in efficient semiparametric estimation of average treatment effects. Econometrica, 66, Heckman, J., Ichimura, H. & Todd, P. (1998). Matching as an econometric evaluation estimator. The Reviews of Economic Studies, 65, Hirano, K., Imbens, G. W., & Ridder, G. (2003). Efficient estimation of average treatment effects using the estimated propensity score. Econometrica, 71(4), Kaplan, D. & Chen, C. J. (2011). Bayesian propensity score analysis: Simulation and case study. Presentation at the annual conference of Society of Research on Educational Effectiveness, Washington D. C.. Rosenbaum, P. R., & Rubin, D. B. (1983). The central of the propensity score in observational studies for casual effects. Biometrika, 70(1), Rosenbaum, P. R. (1989). Optimal matching in observational studies. Journal of the American Statistical Association, 84, Stuart, E. A. (2010). Matching methods for casual inference: A review and a look forward. Statistical Science, 25(1), Vincent, J. L., Baron, J., Reinhart. K., Gattinoni, L., Thijs, L., Webb, A., Meier- Hellmann, A., Nollet, G. & Peres-Bota, D. (2002). Anemia and blood transfusion in critically ill patients. Journal of the American Medical Association, 288,
Propensity Score Matching with Limited Overlap. Abstract
Propensity Score Matching with Limited Overlap Onur Baser Thomson-Medstat Abstract In this article, we have demostrated the application of two newly proposed estimators which accounts for lack of overlap
More informationPractical propensity score matching: a reply to Smith and Todd
Journal of Econometrics 125 (2005) 355 364 www.elsevier.com/locate/econbase Practical propensity score matching: a reply to Smith and Todd Rajeev Dehejia a,b, * a Department of Economics and SIPA, Columbia
More informationEMPIRICAL STRATEGIES IN LABOUR ECONOMICS
EMPIRICAL STRATEGIES IN LABOUR ECONOMICS University of Minho J. Angrist NIPE Summer School June 2009 This course covers core econometric ideas and widely used empirical modeling strategies. The main theoretical
More informationEmpirical Strategies
Empirical Strategies Joshua Angrist BGPE March 2012 These lectures cover many of the empirical modeling strategies discussed in Mostly Harmless Econometrics (MHE). The main theoretical ideas are illustrated
More informationPros. University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany
Dan A. Black University of Chicago and NORC at the University of Chicago, USA, and IZA, Germany Matching as a regression estimator Matching avoids making assumptions about the functional form of the regression
More informationTHE USE OF NONPARAMETRIC PROPENSITY SCORE ESTIMATION WITH DATA OBTAINED USING A COMPLEX SAMPLING DESIGN
THE USE OF NONPARAMETRIC PROPENSITY SCORE ESTIMATION WITH DATA OBTAINED USING A COMPLEX SAMPLING DESIGN Ji An & Laura M. Stapleton University of Maryland, College Park May, 2016 WHAT DOES A PROPENSITY
More informationA Guide to Quasi-Experimental Designs
Western Kentucky University From the SelectedWorks of Matt Bogard Fall 2013 A Guide to Quasi-Experimental Designs Matt Bogard, Western Kentucky University Available at: https://works.bepress.com/matt_bogard/24/
More informationEstimating average treatment effects from observational data using teffects
Estimating average treatment effects from observational data using teffects David M. Drukker Director of Econometrics Stata 2013 Nordic and Baltic Stata Users Group meeting Karolinska Institutet September
More informationMatching methods for causal inference: A review and a look forward
Matching methods for causal inference: A review and a look forward Elizabeth A. Stuart Johns Hopkins Bloomberg School of Public Health Department of Mental Health Department of Biostatistics 624 N Broadway,
More informationPropensity Score Methods for Causal Inference with the PSMATCH Procedure
Paper SAS332-2017 Propensity Score Methods for Causal Inference with the PSMATCH Procedure Yang Yuan, Yiu-Fai Yung, and Maura Stokes, SAS Institute Inc. Abstract In a randomized study, subjects are randomly
More informationCausal Validity Considerations for Including High Quality Non-Experimental Evidence in Systematic Reviews
Non-Experimental Evidence in Systematic Reviews OPRE REPORT #2018-63 DEKE, MATHEMATICA POLICY RESEARCH JUNE 2018 OVERVIEW Federally funded systematic reviews of research evidence play a central role in
More information1. INTRODUCTION. Lalonde estimates the impact of the National Supported Work (NSW) Demonstration, a labor
1. INTRODUCTION This paper discusses the estimation of treatment effects in observational studies. This issue, which is of great practical importance because randomized experiments cannot always be implemented,
More informationPropensity Score Analysis Shenyang Guo, Ph.D.
Propensity Score Analysis Shenyang Guo, Ph.D. Upcoming Seminar: April 7-8, 2017, Philadelphia, Pennsylvania Propensity Score Analysis 1. Overview 1.1 Observational studies and challenges 1.2 Why and when
More informationICPSR Causal Inference in the Social Sciences. Course Syllabus
ICPSR 2012 Causal Inference in the Social Sciences Course Syllabus Instructors: Dominik Hangartner London School of Economics Marco Steenbergen University of Zurich Teaching Fellow: Ben Wilson London School
More informationPropensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018
Propensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018 Institute Institute for Clinical for Clinical Evaluative Evaluative Sciences Sciences Overview 1.
More informationPredicting the efficacy of future training programs using past experiences at other locations
Journal of Econometrics ] (]]]]) ]]] ]]] www.elsevier.com/locate/econbase Predicting the efficacy of future training programs using past experiences at other locations V. Joseph Hotz a, *, Guido W. Imbens
More informationComparing Experimental and Matching Methods using a Large-Scale Field Experiment on Voter Mobilization
Comparing Experimental and Matching Methods using a Large-Scale Field Experiment on Voter Mobilization Kevin Arceneaux Alan S. Gerber Donald P. Green Yale University Institution for Social and Policy Studies
More informationUsing Ensemble-Based Methods for Directly Estimating Causal Effects: An Investigation of Tree-Based G-Computation
Institute for Clinical Evaluative Sciences From the SelectedWorks of Peter Austin 2012 Using Ensemble-Based Methods for Directly Estimating Causal Effects: An Investigation of Tree-Based G-Computation
More informationIdentifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods
Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Dean Eckles Department of Communication Stanford University dean@deaneckles.com Abstract
More informationManitoba Centre for Health Policy. Inverse Propensity Score Weights or IPTWs
Manitoba Centre for Health Policy Inverse Propensity Score Weights or IPTWs 1 Describe Different Types of Treatment Effects Average Treatment Effect Average Treatment Effect among Treated Average Treatment
More informationHow should the propensity score be estimated when some confounders are partially observed?
How should the propensity score be estimated when some confounders are partially observed? Clémence Leyrat 1, James Carpenter 1,2, Elizabeth Williamson 1,3, Helen Blake 1 1 Department of Medical statistics,
More informationPropensity scores: what, why and why not?
Propensity scores: what, why and why not? Rhian Daniel, Cardiff University @statnav Joint workshop S3RI & Wessex Institute University of Southampton, 22nd March 2018 Rhian Daniel @statnav/propensity scores:
More informationFundamental Clinical Trial Design
Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003
More informationAssessing the impact of unmeasured confounding: confounding functions for causal inference
Assessing the impact of unmeasured confounding: confounding functions for causal inference Jessica Kasza jessica.kasza@monash.edu Department of Epidemiology and Preventive Medicine, Monash University Victorian
More informationImputation classes as a framework for inferences from non-random samples. 1
Imputation classes as a framework for inferences from non-random samples. 1 Vladislav Beresovsky (hvy4@cdc.gov) National Center for Health Statistics, CDC 1 Disclaimer: The findings and conclusions in
More informationPropensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research
2012 CCPRC Meeting Methodology Presession Workshop October 23, 2012, 2:00-5:00 p.m. Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy
More informationPropensity Score Analysis and Strategies for Its Application to Services Training Evaluation
Propensity Score Analysis and Strategies for Its Application to Services Training Evaluation Shenyang Guo, Ph.D. School of Social Work University of North Carolina at Chapel Hill June 14, 2011 For the
More informationCarrying out an Empirical Project
Carrying out an Empirical Project Empirical Analysis & Style Hint Special program: Pre-training 1 Carrying out an Empirical Project 1. Posing a Question 2. Literature Review 3. Data Collection 4. Econometric
More informationEarly Release from Prison and Recidivism: A Regression Discontinuity Approach *
Early Release from Prison and Recidivism: A Regression Discontinuity Approach * Olivier Marie Department of Economics, Royal Holloway University of London and Centre for Economic Performance, London School
More information1. Introduction Consider a government contemplating the implementation of a training (or other social assistance) program. The decision to implement t
1. Introduction Consider a government contemplating the implementation of a training (or other social assistance) program. The decision to implement the program depends on the assessment of its likely
More informationAbstract Title Page. Authors and Affiliations: Chi Chang, Michigan State University. SREE Spring 2015 Conference Abstract Template
Abstract Title Page Title: Sensitivity Analysis for Multivalued Treatment Effects: An Example of a Crosscountry Study of Teacher Participation and Job Satisfaction Authors and Affiliations: Chi Chang,
More informationSyllabus.
Business 41903 Applied Econometrics - Spring 2018 Instructor: Christian Hansen Office: HPC 329 Phone: 773 834 1702 E-mail: chansen1@chicagobooth.edu TA: Jianfei Cao E-mail: jcao0@chicagobooth.edu Syllabus
More informationGeorge B. Ploubidis. The role of sensitivity analysis in the estimation of causal pathways from observational data. Improving health worldwide
George B. Ploubidis The role of sensitivity analysis in the estimation of causal pathways from observational data Improving health worldwide www.lshtm.ac.uk Outline Sensitivity analysis Causal Mediation
More informationPropensity scores and causal inference using machine learning methods
Propensity scores and causal inference using machine learning methods Austin Nichols (Abt) & Linden McBride (Cornell) July 27, 2017 Stata Conference Baltimore, MD Overview Machine learning methods dominant
More informationThe Prevalence of HIV in Botswana
The Prevalence of HIV in Botswana James Levinsohn Yale University and NBER Justin McCrary University of California, Berkeley and NBER January 6, 2010 Abstract This paper implements five methods to correct
More informationMediation Analysis With Principal Stratification
University of Pennsylvania ScholarlyCommons Statistics Papers Wharton Faculty Research 3-30-009 Mediation Analysis With Principal Stratification Robert Gallop Dylan S. Small University of Pennsylvania
More informationJake Bowers Wednesdays, 2-4pm 6648 Haven Hall ( ) CPS Phone is
Political Science 688 Applied Bayesian and Robust Statistical Methods in Political Research Winter 2005 http://www.umich.edu/ jwbowers/ps688.html Class in 7603 Haven Hall 10-12 Friday Instructor: Office
More informationPubH 7405: REGRESSION ANALYSIS. Propensity Score
PubH 7405: REGRESSION ANALYSIS Propensity Score INTRODUCTION: There is a growing interest in using observational (or nonrandomized) studies to estimate the effects of treatments on outcomes. In observational
More informationCausal Methods for Observational Data Amanda Stevenson, University of Texas at Austin Population Research Center, Austin, TX
Causal Methods for Observational Data Amanda Stevenson, University of Texas at Austin Population Research Center, Austin, TX ABSTRACT Comparative effectiveness research often uses non-experimental observational
More informationCombining the regression discontinuity design and propensity score-based weighting to improve causal inference in program evaluationjep_
Journal of Evaluation in Clinical Practice ISSN 1365-2753 Combining the regression discontinuity design and propensity score-based weighting to improve causal inference in program evaluationjep_1768 317..325
More informationPeter C. Austin Institute for Clinical Evaluative Sciences and University of Toronto
Multivariate Behavioral Research, 46:119 151, 2011 Copyright Taylor & Francis Group, LLC ISSN: 0027-3171 print/1532-7906 online DOI: 10.1080/00273171.2011.540480 A Tutorial and Case Study in Propensity
More informationPropensity score methods : a simulation and case study involving breast cancer patients.
University of Louisville ThinkIR: The University of Louisville's Institutional Repository Electronic Theses and Dissertations 5-2016 Propensity score methods : a simulation and case study involving breast
More informationEvaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_
Journal of Evaluation in Clinical Practice ISSN 1356-1294 Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_1361 180..185 Ariel
More informationPropensity score analysis with the latest SAS/STAT procedures PSMATCH and CAUSALTRT
Propensity score analysis with the latest SAS/STAT procedures PSMATCH and CAUSALTRT Yuriy Chechulin, Statistician Modeling, Advanced Analytics What is SAS Global Forum One of the largest global analytical
More informationRise of the Machines
Rise of the Machines Statistical machine learning for observational studies: confounding adjustment and subgroup identification Armand Chouzy, ETH (summer intern) Jason Wang, Celgene PSI conference 2018
More informationChapter 21 Multilevel Propensity Score Methods for Estimating Causal Effects: A Latent Class Modeling Strategy
Chapter 21 Multilevel Propensity Score Methods for Estimating Causal Effects: A Latent Class Modeling Strategy Jee-Seon Kim and Peter M. Steiner Abstract Despite their appeal, randomized experiments cannot
More informationEconometric Evaluation of Health Policies
HEDG Working Paper 09/09 Econometric Evaluation of Health Policies Andrew M Jones Nigel Rice May 2009 ISSN 1751-1976 http://www.york.ac.uk/res/herc/research/hedg/wp.htm ECONOMETRIC EVALUATION OF HEALTH
More informationAnalysis methods for improved external validity
Analysis methods for improved external validity Elizabeth Stuart Johns Hopkins Bloomberg School of Public Health Department of Mental Health Department of Biostatistics www.biostat.jhsph.edu/ estuart estuart@jhsph.edu
More informationConfounding by indication developments in matching, and instrumental variable methods. Richard Grieve London School of Hygiene and Tropical Medicine
Confounding by indication developments in matching, and instrumental variable methods Richard Grieve London School of Hygiene and Tropical Medicine 1 Outline 1. Causal inference and confounding 2. Genetic
More informationPOL 574: Quantitative Analysis IV
POL 574: Quantitative Analysis IV Spring 2009 Kosuke Imai 1 Contact Information Office: Corwin Hall 041 Office Phone: 258 6601 Email: kimai@princeton.edu URL: http://imai.princeton.edu 2 Logistics Fridays
More informationIntroduction to Observational Studies. Jane Pinelis
Introduction to Observational Studies Jane Pinelis 22 March 2018 Outline Motivating example Observational studies vs. randomized experiments Observational studies: basics Some adjustment strategies Matching
More informationIntroducing a SAS macro for doubly robust estimation
Introducing a SAS macro for doubly robust estimation 1Michele Jonsson Funk, PhD, 1Daniel Westreich MSPH, 2Marie Davidian PhD, 3Chris Weisen PhD 1Department of Epidemiology and 3Odum Institute for Research
More informationMethods for treating bias in ISTAT mixed mode social surveys
Methods for treating bias in ISTAT mixed mode social surveys C. De Vitiis, A. Guandalini, F. Inglese and M.D. Terribili ITACOSM 2017 Bologna, 16th June 2017 Summary 1. The Mixed Mode in ISTAT social surveys
More informationImplementing double-robust estimators of causal effects
The Stata Journal (2008) 8, Number 3, pp. 334 353 Implementing double-robust estimators of causal effects Richard Emsley Biostatistics, Health Methodology Research Group The University of Manchester, UK
More informationImpact and adjustment of selection bias. in the assessment of measurement equivalence
Impact and adjustment of selection bias in the assessment of measurement equivalence Thomas Klausch, Joop Hox,& Barry Schouten Working Paper, Utrecht, December 2012 Corresponding author: Thomas Klausch,
More informationExample 7.2. Autocorrelation. Pilar González and Susan Orbe. Dpt. Applied Economics III (Econometrics and Statistics)
Example 7.2 Autocorrelation Pilar González and Susan Orbe Dpt. Applied Economics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Example 7.2. Autocorrelation 1 / 17 Questions.
More informationToo Much Ado about Propensity Score Models? Comparing Methods of Propensity Score Matching
Blackwell Publishing IncMalden, USAVHEValue in Health1098-30152006 Blackwell Publishing200696377385Original ArticleComparison of Types of Propensity Score MatchingBaser Volume 9 Number 6 2006 VALUE IN
More informationMethodological requirements for realworld cost-effectiveness assessment
Methodological requirements for realworld cost-effectiveness assessment Ismo Linnosmaa Department of Health and Social Management, UEF Centre for Health and Social Economics, THL Ismo Linnosmaa Outline
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector
More informationIntroduction to Survival Analysis Procedures (Chapter)
SAS/STAT 9.3 User s Guide Introduction to Survival Analysis Procedures (Chapter) SAS Documentation This document is an individual chapter from SAS/STAT 9.3 User s Guide. The correct bibliographic citation
More informationImpact Assessment of Livestock Research and Development in West Africa: A Propensity Score Matching Approach
Quarterly Journal of International Agriculture 50 (2011), No. 3: 253-266 Impact Assessment of Livestock Research and Development in West Africa: A Propensity Score Matching Approach Sabine Liebenehm Leibniz
More informationCombining machine learning and matching techniques to improve causal inference in program evaluation
bs_bs_banner Journal of Evaluation in Clinical Practice ISSN1365-2753 Combining machine learning and matching techniques to improve causal inference in program evaluation Ariel Linden DrPH 1,2 and Paul
More informationMatt Laidler, MPH, MA Acute and Communicable Disease Program Oregon Health Authority. SOSUG, April 17, 2014
Matt Laidler, MPH, MA Acute and Communicable Disease Program Oregon Health Authority SOSUG, April 17, 2014 The conditional probability of being assigned to a particular treatment given a vector of observed
More informationSUNGUR GUREL UNIVERSITY OF FLORIDA
THE PERFORMANCE OF PROPENSITY SCORE METHODS TO ESTIMATE THE AVERAGE TREATMENT EFFECT IN OBSERVATIONAL STUDIES WITH SELECTION BIAS: A MONTE CARLO SIMULATION STUDY By SUNGUR GUREL A THESIS PRESENTED TO THE
More informationBayesian Model Averaging for Propensity Score Analysis
Multivariate Behavioral Research, 49:505 517, 2014 Copyright C Taylor & Francis Group, LLC ISSN: 0027-3171 print / 1532-7906 online DOI: 10.1080/00273171.2014.928492 Bayesian Model Averaging for Propensity
More informationCausal Inference Course Syllabus
ICPSR Summer Program Causal Inference Course Syllabus Instructors: Dominik Hangartner Marco R. Steenbergen Summer 2011 Contact Information: Marco Steenbergen, Department of Social Sciences, University
More informationMEA DISCUSSION PAPERS
Inference Problems under a Special Form of Heteroskedasticity Helmut Farbmacher, Heinrich Kögel 03-2015 MEA DISCUSSION PAPERS mea Amalienstr. 33_D-80799 Munich_Phone+49 89 38602-355_Fax +49 89 38602-390_www.mea.mpisoc.mpg.de
More informationInstitute for Policy Research, Northwestern University, b Friedrich-Schiller-Universität, Jena, Germany. Online publication date: 11 December 2009
This article was downloaded by: [Northwestern University] On: 3 January 2010 Access details: Access Details: [subscription number 906871786] Publisher Psychology Press Informa Ltd Registered in England
More informationBias and high-dimensional adjustment in observational studies of peer effects
Bias and high-dimensional adjustment in observational studies of peer effects arxiv:1706.04692v1 [stat.me] 14 Jun 2017 Dean Eckles 1 and Eytan Bakshy 2 1 Massachusetts Institute of Technology, 2 Facebook
More informationA Potential Outcomes View of Value-Added Assessment in Education
A Potential Outcomes View of Value-Added Assessment in Education Donald B. Rubin, Elizabeth A. Stuart, and Elaine L. Zanutto Invited discussion to appear in Journal of Educational and Behavioral Statistics
More informationUnderstanding Regression Discontinuity Designs As Observational Studies
Observational Studies 2 (2016) 174-182 Submitted 10/16; Published 12/16 Understanding Regression Discontinuity Designs As Observational Studies Jasjeet S. Sekhon Robson Professor Departments of Political
More information1 Introduction. st0020. The Stata Journal (2002) 2, Number 3, pp
The Stata Journal (22) 2, Number 3, pp. 28 289 Comparative assessment of three common algorithms for estimating the variance of the area under the nonparametric receiver operating characteristic curve
More informationUsing Inverse Probability-Weighted Estimators in Comparative Effectiveness Analyses With Observational Databases
ORIGINAL ARTICLE Using in Comparative Effectiveness Analyses With Observational Databases Lesley H. Curtis, PhD,* Bradley G. Hammill, MS,* Eric L. Eisenstein, DBA,* Judith M. Kramer, MD, MS,* and Kevin
More informationYou must answer question 1.
Research Methods and Statistics Specialty Area Exam October 28, 2015 Part I: Statistics Committee: Richard Williams (Chair), Elizabeth McClintock, Sarah Mustillo You must answer question 1. 1. Suppose
More informationData Analysis Using Regression and Multilevel/Hierarchical Models
Data Analysis Using Regression and Multilevel/Hierarchical Models ANDREW GELMAN Columbia University JENNIFER HILL Columbia University CAMBRIDGE UNIVERSITY PRESS Contents List of examples V a 9 e xv " Preface
More informationApplications. DSC 410/510 Multivariate Statistical Methods. Discriminating Two Groups. What is Discriminant Analysis
DSC 4/5 Multivariate Statistical Methods Applications DSC 4/5 Multivariate Statistical Methods Discriminant Analysis Identify the group to which an object or case (e.g. person, firm, product) belongs:
More informationIdentifying Mechanisms behind Policy Interventions via Causal Mediation Analysis
Identifying Mechanisms behind Policy Interventions via Causal Mediation Analysis December 20, 2013 Abstract Causal analysis in program evaluation has largely focused on the assessment of policy effectiveness.
More informationIn this module I provide a few illustrations of options within lavaan for handling various situations.
In this module I provide a few illustrations of options within lavaan for handling various situations. An appropriate citation for this material is Yves Rosseel (2012). lavaan: An R Package for Structural
More informationComplier Average Causal Effect (CACE)
Complier Average Causal Effect (CACE) Booil Jo Stanford University Methodological Advancement Meeting Innovative Directions in Estimating Impact Office of Planning, Research & Evaluation Administration
More informationStatistical Tolerance Regions: Theory, Applications and Computation
Statistical Tolerance Regions: Theory, Applications and Computation K. KRISHNAMOORTHY University of Louisiana at Lafayette THOMAS MATHEW University of Maryland Baltimore County Contents List of Tables
More informationPharmaSUG Paper HA-04 Two Roads Diverged in a Narrow Dataset...When Coarsened Exact Matching is More Appropriate than Propensity Score Matching
PharmaSUG 207 - Paper HA-04 Two Roads Diverged in a Narrow Dataset...When Coarsened Exact Matching is More Appropriate than Propensity Score Matching Aran Canes, Cigna Corporation ABSTRACT Coarsened Exact
More informationOverview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany
Overview of Perspectives on Causal Inference: Campbell and Rubin Stephen G. West Arizona State University Freie Universität Berlin, Germany 1 Randomized Experiment (RE) Sir Ronald Fisher E(X Treatment
More informationBy: Mei-Jie Zhang, Ph.D.
Propensity Scores By: Mei-Jie Zhang, Ph.D. Medical College of Wisconsin, Division of Biostatistics Friday, March 29, 2013 12:00-1:00 pm The Medical College of Wisconsin is accredited by the Accreditation
More informationTitle: New Perspectives on the Synthetic Control Method. Authors: Eli Ben-Michael, UC Berkeley,
Title: New Perspectives on the Synthetic Control Method Authors: Eli Ben-Michael, UC Berkeley, ebenmichael@berkeley.edu Avi Feller, UC Berkeley, afeller@berkeley.edu [presenting author] Jesse Rothstein,
More informationBiostatistics II
Biostatistics II 514-5509 Course Description: Modern multivariable statistical analysis based on the concept of generalized linear models. Includes linear, logistic, and Poisson regression, survival analysis,
More informationREDUCING BIAS IN VALIDATING HEALTH MEASURES WITH PROPENSITY SCORE METHODS. Xian Liu, Ph.D. Charles C. Engel, Jr., M.D., M.PH. Kristie Gore, Ph.D.
REDUCING BIAS IN VALIDATING HEALTH MEASURES WITH PROPENSITY SCORE METHODS Xian Liu, Ph.D. Charles C. Engel, Jr., M.D., M.PH. Kristie Gore, Ph.D. Michael Freed, Ph.D. Abstract In this article, we present
More informationCausal inference with large scale assessments in education from a Bayesian perspective: a review and synthesis
DOI 10.1186/s40536-016-0022-6 RESEARCH Open Access Causal inference with large scale assessments in education from a Bayesian perspective: a review and synthesis David Kaplan * *Correspondence: david.kaplan@wisc.edu
More informationComparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment
Political Analysis Advance Access published September 16, 2005 doi:10.1093/pan/mpj001 Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment Kevin Arceneaux Department
More informationFROM LOCAL TO GLOBAL: EXTERNAL VALIDITY IN A FERTILITY NATURAL EXPERIMENT. Rajeev Dehejia, Cristian Pop-Eleches, and Cyrus Samii * August 2018
FROM LOCAL TO GLOBAL: EXTERNAL VALIDITY IN A FERTILITY NATURAL EXPERIMENT Rajeev Dehejia, Cristian Pop-Eleches, and Cyrus Samii * August 2018 * Dehejia, Wagner Graduate School of Public Service, New York
More informationCitation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n.
University of Groningen Latent instrumental variables Ebbes, P. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document
More informationQuantitative Methods. Lonnie Berger. Research Training Policy Practice
Quantitative Methods Lonnie Berger Research Training Policy Practice Defining Quantitative and Qualitative Research Quantitative methods: systematic empirical investigation of observable phenomena via
More informationSupplementary Appendix
Supplementary Appendix This appendix has been provided by the authors to give readers additional information about their work. Supplement to: Weintraub WS, Grau-Sepulveda MV, Weiss JM, et al. Comparative
More informationBrief introduction to instrumental variables. IV Workshop, Bristol, Miguel A. Hernán Department of Epidemiology Harvard School of Public Health
Brief introduction to instrumental variables IV Workshop, Bristol, 2008 Miguel A. Hernán Department of Epidemiology Harvard School of Public Health Goal: To consistently estimate the average causal effect
More informationIs Hospital Admission Useful for Syncope Patients? Preliminary Results of a Multicenter Cohort
Is Hospital Admission Useful for Syncope Patients? Preliminary Results of a Multicenter Cohort F. Dipaola, E. Pivetta, G. Costantino, G. Casazza, M.J. Reed, B. Sun, M. Solbiati, F. Barbic, D. Shiffer,
More informationEPI 200C Final, June 4 th, 2009 This exam includes 24 questions.
Greenland/Arah, Epi 200C Sp 2000 1 of 6 EPI 200C Final, June 4 th, 2009 This exam includes 24 questions. INSTRUCTIONS: Write all answers on the answer sheets supplied; PRINT YOUR NAME and STUDENT ID NUMBER
More informationCausal Inference in Statistics and the Quantitative Sciences
Causal Inference in Statistics and the Quantitative Sciences Erica E. M. Moodie (McGill University) and David A. Stephens (McGill University) May 3 8, 2009 1 A Short Overview of the Field Causal inference
More informationWorking Paper: Designs of Empirical Evaluations of Non-Experimental Methods in Field Settings. Vivian C. Wong 1 & Peter M.
EdPolicyWorks Working Paper: Designs of Empirical Evaluations of Non-Experimental Methods in Field Settings Vivian C. Wong 1 & Peter M. Steiner 2 Over the last three decades, a research design has emerged
More informationRajeev Dehejia* Experimental and Non-Experimental Methods in Development Economics: A Porous Dialectic
JGD 2015; 6(1): 47 69 Rajeev Dehejia* Experimental and Non-Experimental Methods in Development Economics: A Porous Dialectic Open Access Abstract: This paper surveys six widely-used non-experimental methods
More information