Abstract. Introduction A SIMULATION STUDY OF ESTIMATORS FOR RATES OF CHANGES IN LONGITUDINAL STUDIES WITH ATTRITION

Size: px
Start display at page:

Download "Abstract. Introduction A SIMULATION STUDY OF ESTIMATORS FOR RATES OF CHANGES IN LONGITUDINAL STUDIES WITH ATTRITION"

Transcription

1 A SIMULATION STUDY OF ESTIMATORS FOR RATES OF CHANGES IN LONGITUDINAL STUDIES WITH ATTRITION Fong Wang, Genentech Inc. Mary Lange, Immunex Corp. Abstract Many longitudinal studies and clinical trials are designed to estimate rates of change over time in one or more outcome variables in several groups. Most such studies have incomplete data because some patients drop out before completing the study. The missing data may induce bias and inefficiency in naive estimates of important parameters. We used Monte Carlo methods to compare the bias and efficiency of several two-stage estimators of the effect of treatment on the mean rate of change when the missing data arise from one of four processes. In general, the weighted least squares estimator does relatively well, as does an analysis-of-covariance type estimator proposed by Wu et al. (1989). Introduction In longitudinal studies, responses are measured on each individual on multiple occasions. In this paper, we consider longitudinal clinical trials designed to estimate and compare rates of change of response over time, as measured by the slope of the linear regression of response on time, in two treatment groups. In designed studies with each individual measured at every occasion, an optimal estimate of each group's mean slope is obtained by first computing a least squares slope for each individual in the group, then averaging these least squares slopes (Lange and Laird, 1989). Attrition in studies can cause both bias and loss of efficiency, as well as complicate the analysis. In a study similar to ours, Wu and Carroll (1988) compared the bias and efficiency of three estimators: unweighted least squares, weighted least squares, and a pseudo maximum likelihood approach, through a Monte Carlo experiment. Wu and Bailey (1988) compared five estimators: unweighted least squares, weighted least squares, pseudo maximum likelihood, and two noniterative univariate weighted least squares estimators designed to account for time of dropout. They used simulated data subject to missing data processes that are missing completely at random and nonignorable (Little and Rubin, 1987). This paper builds on their work by using Wu and Carroll's (1988) basic study design, but examines four types of mechanisms for missing data and considers several additional estimators. We compare seven two-stage estimators: (1) the unweighted least squares estimator, (2) the completecase estimator, (3) the restricted maximum likelihood (REML) estimator, (4) the generalized least squares estimator, (5) the weighted least squares estimator, and (6)- 1167

2 (7) the two estimators (ANCOVA and weighted mean) proposed by Wu and Bailey (1988). The Model We assume that the experimental units in a study are assigned to two groups with sample sizes nk, where k=1 and k=2 represent a control group and a treatment group, respectively; the total sample size is n=n1 +n2. There are T measurements taken at pre specified times for every individual with complete data. We now give the model for the complete data. Stage one: A Tx1 complete observation vector for the ith individual in the kth group satisfies Yik = ZBik + eik where i=1,oo,nk; k=1,2; eik - N(O, ii); B'ik = (Bi1 k, Bi2k>; and Z is a Tx2 design matrix determined by the times at which the measurements are taken. Stage two: The unobservable vector Bik, representing the true intercept and slope of the corresponding individual, is bivariate normally distributed with mean vector a'k= (u1 k u2k> and covariance matrix D. The main parameter of interest is the difference in mean slopes, ~=a21 - a22. Missing Data Mechanisms For simplicity, we assume missing data are due to attrition only. Because most estimators are based on first computing a least squares slope for each individual, we assume that each individual in the study has at least three observations. The types of missing data mechanisms we study can be classified using the typology described in Rubin (1976) and Little and Rubin (1987): a. Missing completely at random (MCAR): Attrition occurs at random and does not depend on an individual's characteristics. b. Missing at random (MAR): Attrition occurs at random, but with a probability that depends on an individual's previously observed response. c. Two types of nonignorable (NOI) missingness: Here the probability of attrition depends on unobserved characteristics (true slope and/or intercept) of the individuals under study. We use A 1 through A4 to denote the four missing data processes. Following Little and Rubin (1987) and Wu and Carroll (1988), we assumed that the probability 7t of attrition during any time interval (tj, tj+1) was determined by a probit model: n=ci>(zijk>, where Zijk= y 1 ~i1 k+ Y 2~i2k+ Y 3 Yi,j-1,k+ y 4j, and a different subset of the Ys is set to zero for each process. We chose the parameters of the model so that, at the end of the study, the attrition rate for each process was approximately 50%. Process A1 is MCAR; the conditional probability 7t that an individual drops out in 1168

3 the intenal (ti' ti+1), given they are still in the study at ti is constant (Y1 =Y2=Y3=0). Under the MCAR assumption, the sampling distribution of the obsened data is a marginal of the complete data distribution. This implies that moment-based estimators will be unbiased in this missing data setting. Process A2 is MAR; here, it depends on the previously obsened Yiik (Y1 =Y2=0). Individuals with lower values are more likely to drop out. When data are MAR, the sampling distribution of the obsened data no longer equals the marginal distribution, but depends upon the missing process (Rubin, 1976). Hence we might expect moment estimators to be biased. However, the likelihood of the obsened data is proportional to the marginal likelihood; thus it is not necessary to specify the missingness process in order to obtain valid MLE's. Processes A3 and A4 are both nonignorable. Here, it depends upon an individual's true, unobsened parameter vector ~ik (Y3=0). For A3, we assume the dependence of it on ~ik is the same for both treatment groups; for A4 we assume the two treatment groups have different dependence of it on ~ik. This might occur, for example, in an unblinded study. Monte Carlo Experiment Our study was motivated by design and analysis problems encountered in clinical trials of lung diseases. The data are simulated using a model developed by Wu and Carroll (1988) for a study of anti proteolytic replacement therapy among individuals with PiZ emphysema. Early studies (Laurell and Eriksson, 1963) showed that individuals with PiZ phenotype tend to develop severe u1-antitrypsin deficiency and hence pulmonary emphysema and more rapid decline in lung function. The clinical trial was designed to compare rates of loss of FEV1 (musec.) in therapeutic and control groups over time. The simulation model consists of patients randomly divided into two groups with equal sample sizes of 100 in each group. The study duration is three years, with obsenations bimonthly during the first 6 months, and then quarterly through 3 years. The simulation involved 600 replications under each of four types of missingness. Methods We ran the simulation using PC-SAS on a local area network. We computed all but the REML estimates using the SASIIML procedure PROC IML; we used EPILOG- PLUS to obtain the REML estimates. Disk space was at a premium, but computer time was free, so we set up the replications to run overnight on whatever dormant machines were available. After estimates from a replication were computed, they were appended to a permanent SAS dataset. We used the SAS macro language to design programs that were interruptible and restartable from the point of 1169

4 interruption. Thus, higher priority (daytime) tasks were not delayed, and we were able to develop and execute the analyses incrementally. Results Table 1 displays the means and standard deviations of the estimates of slope for the two groups; Table 2 presents the results for the estimated difference of slopes. As expected, when the dropout process is MCAR, all estimators are unbiased, both for the group means and their difference. The unweighted estimator is quite inefficient, even compared to the complete-case estimator. The situation is quite different when the likelihood of dropout depends on a previously observed data value (MAR). In this case, the REML estimator is unbiased and efficient for both the group means and their difference. The complete-case analysis also works well here, and except for a small bias, it is quite competitive with the REML estimator. All the other estimators suffer from considerable bias in estimating the group means, or their difference, or both; and the UWLS and weighted mean estimators are grossly inefficient for the difference. (The relatively large bias of these estimators for group effects is due to the dependence of missingness on the value of the last observed value. Because these estimators are based on the individual LS slopes, the leverage of the last observation is greatest for the dropouts, resulting in negativelybiased estimates.) When the dropout process is nonignorable, but the same in both groups (A3), the UWLS, ANCOVA and weighted mean estimators are all relatively unbiased for group mean slopes. The UWLS is, as usual, unacceptably inefficient. For the difference, the ANCOVA estimator is the best in terms of bias, with an acceptable efficiency. For the case in which the missing data process differs for the two groups (A4), all estimators except the inefficient UWLS have substantial bias. Among the remaining estimators, the ANCOVA is acceptably efficient, and has the smallest bias, although that bias is substantial. Discussion We have investigated the relative performance of several commonly used estimators of rates of change in the presence of attrition. Not unexpectedly, our findings concerning their relative performance depend strongly on our assumptions about the nature of the dropout process. The missing completely at random process assumes attrition from the study is at random, without regard to treatment or individual characteristics. The classical example of MCAR is patients leaving town for reasons unrelated to the study. The missing at random mechanism assumes the likelihood of dropout depends 1170

5 upon previously observed outcomes. Thus, in a trial designed to test effectiveness of a drug in inhibiting the decline of T 4 counts among HIV-infected patients, the MAR process could correspond to patients dropping out if their T4 count reached some threshold. Nonignorable processes assume the probability of dropout depends on unobservable quantities. For example, in a study designed to control hypertension, patients with home blood pressure kits may decide not to return for protocol measurements on the basis of their own measurements of blood pressure. In practice, investigators usually do not know the dropout mechanism, although some scenarios may be more plausible than others. The real situation is usually complex, and may involve dropouts of several types. Although there is much discussion in the literature of the MAR assumption because of the implications for validity of likelihood-based methods, whether it is more or less appropriate than a nonignorable model must depend on the particular situation. While the missing at random assumption is testable as an alternative to the missing completely at random assumption, it will generally not be possible to distinguish between ignorable and nonignorable mechanisms by examination of the data. References Lange N and Laird NM, (1989), "The Effect of Covariance Structure on Variance Estimation in Balanced Growth-Curve Models with Random Parameters," JASA, 84, Laurel! Band Erikkson S, (1963), "The Electrophoretic Alphal-3 Lobeline Pattern of Serum in Alpha 1-trypsin Deficiency," Scand J of Clinical Laboratory Investigation, 15, Little RJA and Rubin DB, (1987), Statistical Analysis with Missing Data, New York: Wiley & Son. Rubin DB, (1976), "Inference on Missing Data," Biometrika, 63(3), Wu MC and Bailey KR, (1988), "Analyzing Changes in the Presence of Informative Right Censoring Caused by Death and Withdrawal," Statistics in Medicine, 7, Wu MC and Bailey KR, (1989), "Estimation and Comparison of Changes in the Presence of Informative Right Censoring: Conditional Linear Model," Biometrics, 45, Wu MC and Carroll RJ, (1988), "Estimation and Comparison of Changes in the Presence of Informative Right Censoring: Modeling the Censoring Process," Biometrics, 44, Acknowledgements We would like to thank our colleagues at Syntex, Immunex, and Genentech for their generous support in the preparation of this paper. SAS and SAS/IML are registered trademarks of SAS Institute Inc., Cary, NC, USA. EPILOG-PLUS is a registered trademark of Epicenter Software, Pasadena, CA, USA. 1171

6 Table 1. Mean and Standard Deviation (SO) of the Estimates for the Treatment (Trt) and Control (CtI) Groups A1-MCAR A2- MAR A3 - NOI A4- NOI.. Constant Yi j-l k Bilk & Bi2k Bil k. Bi2k & group Tn Ctl Tn Ctl Tn Cli Tn Cli True Value UWLS SD GLS SD WLS SD ANCOVA SD Weighted Mean A A SD REML SD A Complete Case A A -67A SD A Table 2. Bias (SO) of the Difference between Control and Treatment Groups' A1- MCAR. A2- MAR A3 - NOI A4- NOI.. Constant Yi j-l k Bilk & Bi2k Bil k. Bi2k & group UWLS 0.8 (29.8) -0.6 (39.8) 1.2 (41.6) 1.6 (40.2) GLS 0.7 (16.6) -0.1 (18.3) 8.8 (17.5) 23.1 (17.7) WLS 0.9 (16.6) 0.1 (18.1) 4.6 (17.3) 18.1 (17.2) ANCOVA 1.0 (16.5) -1.7 (19.7) -1.3 (18.2) 12.6 (18.0) Weighted Mean 1.2 (18.1) 6.9 (31.2) 6.9 (22.7) 14.7 (20A) REML 1.2 (16.0) 0.7 (17.6) 11.9 (17.0) 25.7 (16.9) Complete case 1.0 (19.5) 2.5 (18.2) 6.0 (18A) 23A (17.9) 1172

Analysis of Vaccine Effects on Post-Infection Endpoints Biostat 578A Lecture 3

Analysis of Vaccine Effects on Post-Infection Endpoints Biostat 578A Lecture 3 Analysis of Vaccine Effects on Post-Infection Endpoints Biostat 578A Lecture 3 Analysis of Vaccine Effects on Post-Infection Endpoints p.1/40 Data Collected in Phase IIb/III Vaccine Trial Longitudinal

More information

Catherine A. Welch 1*, Séverine Sabia 1,2, Eric Brunner 1, Mika Kivimäki 1 and Martin J. Shipley 1

Catherine A. Welch 1*, Séverine Sabia 1,2, Eric Brunner 1, Mika Kivimäki 1 and Martin J. Shipley 1 Welch et al. BMC Medical Research Methodology (2018) 18:89 https://doi.org/10.1186/s12874-018-0548-0 RESEARCH ARTICLE Open Access Does pattern mixture modelling reduce bias due to informative attrition

More information

Logistic Regression with Missing Data: A Comparison of Handling Methods, and Effects of Percent Missing Values

Logistic Regression with Missing Data: A Comparison of Handling Methods, and Effects of Percent Missing Values Logistic Regression with Missing Data: A Comparison of Handling Methods, and Effects of Percent Missing Values Sutthipong Meeyai School of Transportation Engineering, Suranaree University of Technology,

More information

Missing Data and Imputation

Missing Data and Imputation Missing Data and Imputation Barnali Das NAACCR Webinar May 2016 Outline Basic concepts Missing data mechanisms Methods used to handle missing data 1 What are missing data? General term: data we intended

More information

Section on Survey Research Methods JSM 2009

Section on Survey Research Methods JSM 2009 Missing Data and Complex Samples: The Impact of Listwise Deletion vs. Subpopulation Analysis on Statistical Bias and Hypothesis Test Results when Data are MCAR and MAR Bethany A. Bell, Jeffrey D. Kromrey

More information

Sampling Weights, Model Misspecification and Informative Sampling: A Simulation Study

Sampling Weights, Model Misspecification and Informative Sampling: A Simulation Study Sampling Weights, Model Misspecification and Informative Sampling: A Simulation Study Marianne (Marnie) Bertolet Department of Statistics Carnegie Mellon University Abstract Linear mixed-effects (LME)

More information

Module 14: Missing Data Concepts

Module 14: Missing Data Concepts Module 14: Missing Data Concepts Jonathan Bartlett & James Carpenter London School of Hygiene & Tropical Medicine Supported by ESRC grant RES 189-25-0103 and MRC grant G0900724 Pre-requisites Module 3

More information

Accommodating informative dropout and death: a joint modelling approach for longitudinal and semicompeting risks data

Accommodating informative dropout and death: a joint modelling approach for longitudinal and semicompeting risks data Appl. Statist. (2018) 67, Part 1, pp. 145 163 Accommodating informative dropout and death: a joint modelling approach for longitudinal and semicompeting risks data Qiuju Li and Li Su Medical Research Council

More information

Score Tests of Normality in Bivariate Probit Models

Score Tests of Normality in Bivariate Probit Models Score Tests of Normality in Bivariate Probit Models Anthony Murphy Nuffield College, Oxford OX1 1NF, UK Abstract: A relatively simple and convenient score test of normality in the bivariate probit model

More information

An Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy

An Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy Number XX An Empirical Assessment of Bivariate Methods for Meta-analysis of Test Accuracy Prepared for: Agency for Healthcare Research and Quality U.S. Department of Health and Human Services 54 Gaither

More information

SESUG Paper SD

SESUG Paper SD SESUG Paper SD-106-2017 Missing Data and Complex Sample Surveys Using SAS : The Impact of Listwise Deletion vs. Multiple Imputation Methods on Point and Interval Estimates when Data are MCAR, MAR, and

More information

A COMPARISON OF IMPUTATION METHODS FOR MISSING DATA IN A MULTI-CENTER RANDOMIZED CLINICAL TRIAL: THE IMPACT STUDY

A COMPARISON OF IMPUTATION METHODS FOR MISSING DATA IN A MULTI-CENTER RANDOMIZED CLINICAL TRIAL: THE IMPACT STUDY A COMPARISON OF IMPUTATION METHODS FOR MISSING DATA IN A MULTI-CENTER RANDOMIZED CLINICAL TRIAL: THE IMPACT STUDY Lingqi Tang 1, Thomas R. Belin 2, and Juwon Song 2 1 Center for Health Services Research,

More information

Bias reduction with an adjustment for participants intent to dropout of a randomized controlled clinical trial

Bias reduction with an adjustment for participants intent to dropout of a randomized controlled clinical trial ARTICLE Clinical Trials 2007; 4: 540 547 Bias reduction with an adjustment for participants intent to dropout of a randomized controlled clinical trial Andrew C Leon a, Hakan Demirtas b, and Donald Hedeker

More information

Statistical data preparation: management of missing values and outliers

Statistical data preparation: management of missing values and outliers KJA Korean Journal of Anesthesiology Statistical Round pissn 2005-6419 eissn 2005-7563 Statistical data preparation: management of missing values and outliers Sang Kyu Kwak 1 and Jong Hae Kim 2 Departments

More information

Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_

Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_ Journal of Evaluation in Clinical Practice ISSN 1356-1294 Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_1361 180..185 Ariel

More information

An application of a pattern-mixture model with multiple imputation for the analysis of longitudinal trials with protocol deviations

An application of a pattern-mixture model with multiple imputation for the analysis of longitudinal trials with protocol deviations Iddrisu and Gumedze BMC Medical Research Methodology (2019) 19:10 https://doi.org/10.1186/s12874-018-0639-y RESEARCH ARTICLE Open Access An application of a pattern-mixture model with multiple imputation

More information

The Relative Performance of Full Information Maximum Likelihood Estimation for Missing Data in Structural Equation Models

The Relative Performance of Full Information Maximum Likelihood Estimation for Missing Data in Structural Equation Models University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Educational Psychology Papers and Publications Educational Psychology, Department of 7-1-2001 The Relative Performance of

More information

Selected Topics in Biostatistics Seminar Series. Missing Data. Sponsored by: Center For Clinical Investigation and Cleveland CTSC

Selected Topics in Biostatistics Seminar Series. Missing Data. Sponsored by: Center For Clinical Investigation and Cleveland CTSC Selected Topics in Biostatistics Seminar Series Missing Data Sponsored by: Center For Clinical Investigation and Cleveland CTSC Brian Schmotzer, MS Biostatistician, CCI Statistical Sciences Core brian.schmotzer@case.edu

More information

Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials

Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials STATISTICS 303 Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials Craig H. Mallinckrodt, PhD Research Advisor, Lilly Research Laboratories, Eli Lilly and Company,

More information

Impact and adjustment of selection bias. in the assessment of measurement equivalence

Impact and adjustment of selection bias. in the assessment of measurement equivalence Impact and adjustment of selection bias in the assessment of measurement equivalence Thomas Klausch, Joop Hox,& Barry Schouten Working Paper, Utrecht, December 2012 Corresponding author: Thomas Klausch,

More information

Estimands, Missing Data and Sensitivity Analysis: some overview remarks. Roderick Little

Estimands, Missing Data and Sensitivity Analysis: some overview remarks. Roderick Little Estimands, Missing Data and Sensitivity Analysis: some overview remarks Roderick Little NRC Panel s Charge To prepare a report with recommendations that would be useful for USFDA's development of guidance

More information

A novel approach to estimation of the time to biomarker threshold: Applications to HIV

A novel approach to estimation of the time to biomarker threshold: Applications to HIV A novel approach to estimation of the time to biomarker threshold: Applications to HIV Pharmaceutical Statistics, Volume 15, Issue 6, Pages 541-549, November/December 2016 PSI Journal Club 22 March 2017

More information

A Comparison of Methods for Determining HIV Viral Set Point

A Comparison of Methods for Determining HIV Viral Set Point STATISTICS IN MEDICINE Statist. Med. 2006; 00:1 6 [Version: 2002/09/18 v1.11] A Comparison of Methods for Determining HIV Viral Set Point Y. Mei 1, L. Wang 2, S. E. Holte 2 1 School of Industrial and Systems

More information

Missing Data: Our View of the State of the Art

Missing Data: Our View of the State of the Art Psychological Methods Copyright 2002 by the American Psychological Association, Inc. 2002, Vol. 7, No. 2, 147 177 1082-989X/02/$5.00 DOI: 10.1037//1082-989X.7.2.147 Missing Data: Our View of the State

More information

Missing Data in Longitudinal Studies: Strategies for Bayesian Modeling, Sensitivity Analysis, and Causal Inference

Missing Data in Longitudinal Studies: Strategies for Bayesian Modeling, Sensitivity Analysis, and Causal Inference COURSE: Missing Data in Longitudinal Studies: Strategies for Bayesian Modeling, Sensitivity Analysis, and Causal Inference Mike Daniels (Department of Statistics, University of Florida) 20-21 October 2011

More information

Introduction to Survival Analysis Procedures (Chapter)

Introduction to Survival Analysis Procedures (Chapter) SAS/STAT 9.3 User s Guide Introduction to Survival Analysis Procedures (Chapter) SAS Documentation This document is an individual chapter from SAS/STAT 9.3 User s Guide. The correct bibliographic citation

More information

Write your identification number on each paper and cover sheet (the number stated in the upper right hand corner on your exam cover).

Write your identification number on each paper and cover sheet (the number stated in the upper right hand corner on your exam cover). STOCKHOLM UNIVERSITY Department of Economics Course name: Empirical methods 2 Course code: EC2402 Examiner: Per Pettersson-Lidbom Number of credits: 7,5 credits Date of exam: Sunday 21 February 2010 Examination

More information

Estimating drug effects in the presence of placebo response: Causal inference using growth mixture modeling

Estimating drug effects in the presence of placebo response: Causal inference using growth mixture modeling STATISTICS IN MEDICINE Statist. Med. 2009; 28:3363 3385 Published online 3 September 2009 in Wiley InterScience (www.interscience.wiley.com).3721 Estimating drug effects in the presence of placebo response:

More information

Inclusive Strategy with Confirmatory Factor Analysis, Multiple Imputation, and. All Incomplete Variables. Jin Eun Yoo, Brian French, Susan Maller

Inclusive Strategy with Confirmatory Factor Analysis, Multiple Imputation, and. All Incomplete Variables. Jin Eun Yoo, Brian French, Susan Maller Inclusive strategy with CFA/MI 1 Running head: CFA AND MULTIPLE IMPUTATION Inclusive Strategy with Confirmatory Factor Analysis, Multiple Imputation, and All Incomplete Variables Jin Eun Yoo, Brian French,

More information

Comparison of imputation and modelling methods in the analysis of a physical activity trial with missing outcomes

Comparison of imputation and modelling methods in the analysis of a physical activity trial with missing outcomes IJE vol.34 no.1 International Epidemiological Association 2004; all rights reserved. International Journal of Epidemiology 2005;34:89 99 Advance Access publication 27 August 2004 doi:10.1093/ije/dyh297

More information

Methods for Computing Missing Item Response in Psychometric Scale Construction

Methods for Computing Missing Item Response in Psychometric Scale Construction American Journal of Biostatistics Original Research Paper Methods for Computing Missing Item Response in Psychometric Scale Construction Ohidul Islam Siddiqui Institute of Statistical Research and Training

More information

The prevention and handling of the missing data

The prevention and handling of the missing data Review Article Korean J Anesthesiol 2013 May 64(5): 402-406 http://dx.doi.org/10.4097/kjae.2013.64.5.402 The prevention and handling of the missing data Department of Anesthesiology and Pain Medicine,

More information

1 Introduction. st0020. The Stata Journal (2002) 2, Number 3, pp

1 Introduction. st0020. The Stata Journal (2002) 2, Number 3, pp The Stata Journal (22) 2, Number 3, pp. 28 289 Comparative assessment of three common algorithms for estimating the variance of the area under the nonparametric receiver operating characteristic curve

More information

Estimating treatment effects from longitudinal clinical trial data with missing values: comparative analyses using different methods

Estimating treatment effects from longitudinal clinical trial data with missing values: comparative analyses using different methods Psychiatry Research 129 (2004) 209 215 www.elsevier.com/locate/psychres Estimating treatment effects from longitudinal clinical trial data with missing values: comparative analyses using different methods

More information

Methods Research Report. An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy

Methods Research Report. An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy Methods Research Report An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy Methods Research Report An Empirical Assessment of Bivariate Methods for Meta-Analysis of Test Accuracy

More information

Missing by Design: Planned Missing-Data Designs in Social Science

Missing by Design: Planned Missing-Data Designs in Social Science Research & Methods ISSN 1234-9224 Vol. 20 (1, 2011): 81 105 Institute of Philosophy and Sociology Polish Academy of Sciences, Warsaw www.ifi span.waw.pl e-mail: publish@ifi span.waw.pl Missing by Design:

More information

Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models, 2nd Ed.

Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models, 2nd Ed. Eric Vittinghoff, David V. Glidden, Stephen C. Shiboski, and Charles E. McCulloch Division of Biostatistics Department of Epidemiology and Biostatistics University of California, San Francisco Regression

More information

Strategies for handling missing data in randomised trials

Strategies for handling missing data in randomised trials Strategies for handling missing data in randomised trials NIHR statistical meeting London, 13th February 2012 Ian White MRC Biostatistics Unit, Cambridge, UK Plan 1. Why do missing data matter? 2. Popular

More information

How to analyze correlated and longitudinal data?

How to analyze correlated and longitudinal data? How to analyze correlated and longitudinal data? Niloofar Ramezani, University of Northern Colorado, Greeley, Colorado ABSTRACT Longitudinal and correlated data are extensively used across disciplines

More information

Help! Statistics! Missing data. An introduction

Help! Statistics! Missing data. An introduction Help! Statistics! Missing data. An introduction Sacha la Bastide-van Gemert Medical Statistics and Decision Making Department of Epidemiology UMCG Help! Statistics! Lunch time lectures What? Frequently

More information

Parameter Estimation of Cognitive Attributes using the Crossed Random- Effects Linear Logistic Test Model with PROC GLIMMIX

Parameter Estimation of Cognitive Attributes using the Crossed Random- Effects Linear Logistic Test Model with PROC GLIMMIX Paper 1766-2014 Parameter Estimation of Cognitive Attributes using the Crossed Random- Effects Linear Logistic Test Model with PROC GLIMMIX ABSTRACT Chunhua Cao, Yan Wang, Yi-Hsin Chen, Isaac Y. Li University

More information

Multilevel IRT for group-level diagnosis. Chanho Park Daniel M. Bolt. University of Wisconsin-Madison

Multilevel IRT for group-level diagnosis. Chanho Park Daniel M. Bolt. University of Wisconsin-Madison Group-Level Diagnosis 1 N.B. Please do not cite or distribute. Multilevel IRT for group-level diagnosis Chanho Park Daniel M. Bolt University of Wisconsin-Madison Paper presented at the annual meeting

More information

MEA DISCUSSION PAPERS

MEA DISCUSSION PAPERS Inference Problems under a Special Form of Heteroskedasticity Helmut Farbmacher, Heinrich Kögel 03-2015 MEA DISCUSSION PAPERS mea Amalienstr. 33_D-80799 Munich_Phone+49 89 38602-355_Fax +49 89 38602-390_www.mea.mpisoc.mpg.de

More information

Using SAS to Calculate Tests of Cliff s Delta. Kristine Y. Hogarty and Jeffrey D. Kromrey

Using SAS to Calculate Tests of Cliff s Delta. Kristine Y. Hogarty and Jeffrey D. Kromrey Using SAS to Calculate Tests of Cliff s Delta Kristine Y. Hogarty and Jeffrey D. Kromrey Department of Educational Measurement and Research, University of South Florida ABSTRACT This paper discusses a

More information

COMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO CONSIDER ON MISSING DATA

COMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO CONSIDER ON MISSING DATA The European Agency for the Evaluation of Medicinal Products Evaluation of Medicines for Human Use London, 15 November 2001 CPMP/EWP/1776/99 COMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO

More information

Implementing Worst Rank Imputation Using SAS

Implementing Worst Rank Imputation Using SAS Paper SP12 Implementing Worst Rank Imputation Using SAS Qian Wang, Merck Sharp & Dohme (Europe), Inc., Brussels, Belgium Eric Qi, Merck & Company, Inc., Upper Gwynedd, PA ABSTRACT Classic designs of randomized

More information

Growth Modeling with Non-Ignorable Dropout: Alternative Analyses of the STAR*D Antidepressant Trial

Growth Modeling with Non-Ignorable Dropout: Alternative Analyses of the STAR*D Antidepressant Trial Growth Modeling with Non-Ignorable Dropout: Alternative Analyses of the STAR*D Antidepressant Trial Bengt Muthén Tihomir Asparouhov Muthén & Muthén, Los Angeles Aimee Hunter Andrew Leuchter University

More information

Adjusting for mode of administration effect in surveys using mailed questionnaire and telephone interview data

Adjusting for mode of administration effect in surveys using mailed questionnaire and telephone interview data Adjusting for mode of administration effect in surveys using mailed questionnaire and telephone interview data Karl Bang Christensen National Institute of Occupational Health, Denmark Helene Feveille National

More information

Bias in regression coefficient estimates when assumptions for handling missing data are violated: a simulation study

Bias in regression coefficient estimates when assumptions for handling missing data are violated: a simulation study STATISTICAL METHODS Epidemiology Biostatistics and Public Health - 2016, Volume 13, Number 1 Bias in regression coefficient estimates when assumptions for handling missing data are violated: a simulation

More information

Lec 02: Estimation & Hypothesis Testing in Animal Ecology

Lec 02: Estimation & Hypothesis Testing in Animal Ecology Lec 02: Estimation & Hypothesis Testing in Animal Ecology Parameter Estimation from Samples Samples We typically observe systems incompletely, i.e., we sample according to a designed protocol. We then

More information

S Imputation of Categorical Missing Data: A comparison of Multivariate Normal and. Multinomial Methods. Holmes Finch.

S Imputation of Categorical Missing Data: A comparison of Multivariate Normal and. Multinomial Methods. Holmes Finch. S05-2008 Imputation of Categorical Missing Data: A comparison of Multivariate Normal and Abstract Multinomial Methods Holmes Finch Matt Margraf Ball State University Procedures for the imputation of missing

More information

Manuscript Presentation: Writing up APIM Results

Manuscript Presentation: Writing up APIM Results Manuscript Presentation: Writing up APIM Results Example Articles Distinguishable Dyads Chung, M. L., Moser, D. K., Lennie, T. A., & Rayens, M. (2009). The effects of depressive symptoms and anxiety on

More information

Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods

Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Identifying Peer Influence Effects in Observational Social Network Data: An Evaluation of Propensity Score Methods Dean Eckles Department of Communication Stanford University dean@deaneckles.com Abstract

More information

A Potential Outcomes View of Value-Added Assessment in Education

A Potential Outcomes View of Value-Added Assessment in Education A Potential Outcomes View of Value-Added Assessment in Education Donald B. Rubin, Elizabeth A. Stuart, and Elaine L. Zanutto Invited discussion to appear in Journal of Educational and Behavioral Statistics

More information

Supplementary Online Content

Supplementary Online Content Supplementary Online Content Rollman BL, Herbeck Belnap B, Abebe KZ, et al. Effectiveness of online collaborative care for treating mood and anxiety disorders in primary care: a randomized clinical trial.

More information

Exploring the Impact of Missing Data in Multiple Regression

Exploring the Impact of Missing Data in Multiple Regression Exploring the Impact of Missing Data in Multiple Regression Michael G Kenward London School of Hygiene and Tropical Medicine 28th May 2015 1. Introduction In this note we are concerned with the conduct

More information

Unit 1 Exploring and Understanding Data

Unit 1 Exploring and Understanding Data Unit 1 Exploring and Understanding Data Area Principle Bar Chart Boxplot Conditional Distribution Dotplot Empirical Rule Five Number Summary Frequency Distribution Frequency Polygon Histogram Interquartile

More information

Missing data in clinical trials: making the best of what we haven t got.

Missing data in clinical trials: making the best of what we haven t got. Missing data in clinical trials: making the best of what we haven t got. Royal Statistical Society Professional Statisticians Forum Presentation by Michael O Kelly, Senior Statistical Director, IQVIA Copyright

More information

Bias in Area Under the Curve for Longitudinal Clinical Trials With Missing Patient Reported Outcome Data: Summary Measures Versus Summary Statistics

Bias in Area Under the Curve for Longitudinal Clinical Trials With Missing Patient Reported Outcome Data: Summary Measures Versus Summary Statistics 534858SGOXXX10.1177/2158244014534858SAGE OpenBell et al. research-article2014 Article Bias in Area Under the Curve for Longitudinal Clinical Trials With Missing Patient Reported Outcome Data: Summary Measures

More information

In this module I provide a few illustrations of options within lavaan for handling various situations.

In this module I provide a few illustrations of options within lavaan for handling various situations. In this module I provide a few illustrations of options within lavaan for handling various situations. An appropriate citation for this material is Yves Rosseel (2012). lavaan: An R Package for Structural

More information

Small Sample Bayesian Factor Analysis. PhUSE 2014 Paper SP03 Dirk Heerwegh

Small Sample Bayesian Factor Analysis. PhUSE 2014 Paper SP03 Dirk Heerwegh Small Sample Bayesian Factor Analysis PhUSE 2014 Paper SP03 Dirk Heerwegh Overview Factor analysis Maximum likelihood Bayes Simulation Studies Design Results Conclusions Factor Analysis (FA) Explain correlation

More information

Bayesian approaches to handling missing data: Practical Exercises

Bayesian approaches to handling missing data: Practical Exercises Bayesian approaches to handling missing data: Practical Exercises 1 Practical A Thanks to James Carpenter and Jonathan Bartlett who developed the exercise on which this practical is based (funded by ESRC).

More information

Maria-Athina Altzerinakou1, Xavier Paoletti2. 9 May, 2017

Maria-Athina Altzerinakou1, Xavier Paoletti2. 9 May, 2017 An adaptive design for the identification of the optimal dose using joint modelling of efficacy and toxicity in phase I/II clinical trials of molecularly targeted agents Maria-Athina Altzerinakou1, Xavier

More information

ST440/550: Applied Bayesian Statistics. (10) Frequentist Properties of Bayesian Methods

ST440/550: Applied Bayesian Statistics. (10) Frequentist Properties of Bayesian Methods (10) Frequentist Properties of Bayesian Methods Calibrated Bayes So far we have discussed Bayesian methods as being separate from the frequentist approach However, in many cases methods with frequentist

More information

Bayesian hierarchical modelling

Bayesian hierarchical modelling Bayesian hierarchical modelling Matthew Schofield Department of Mathematics and Statistics, University of Otago Bayesian hierarchical modelling Slide 1 What is a statistical model? A statistical model:

More information

An Introduction to Multiple Imputation for Missing Items in Complex Surveys

An Introduction to Multiple Imputation for Missing Items in Complex Surveys An Introduction to Multiple Imputation for Missing Items in Complex Surveys October 17, 2014 Joe Schafer Center for Statistical Research and Methodology (CSRM) United States Census Bureau Views expressed

More information

Package speff2trial. February 20, 2015

Package speff2trial. February 20, 2015 Version 1.0.4 Date 2012-10-30 Package speff2trial February 20, 2015 Title Semiparametric efficient estimation for a two-sample treatment effect Author Michal Juraska , with contributions

More information

OLS Regression with Clustered Data

OLS Regression with Clustered Data OLS Regression with Clustered Data Analyzing Clustered Data with OLS Regression: The Effect of a Hierarchical Data Structure Daniel M. McNeish University of Maryland, College Park A previous study by Mundfrom

More information

Appendix 1. Sensitivity analysis for ACQ: missing value analysis by multiple imputation

Appendix 1. Sensitivity analysis for ACQ: missing value analysis by multiple imputation Appendix 1 Sensitivity analysis for ACQ: missing value analysis by multiple imputation A sensitivity analysis was carried out on the primary outcome measure (ACQ) using multiple imputation (MI). MI is

More information

Analysis Strategies for Clinical Trials with Treatment Non-Adherence Bohdana Ratitch, PhD

Analysis Strategies for Clinical Trials with Treatment Non-Adherence Bohdana Ratitch, PhD Analysis Strategies for Clinical Trials with Treatment Non-Adherence Bohdana Ratitch, PhD Acknowledgments: Michael O Kelly, James Roger, Ilya Lipkovich, DIA SWG On Missing Data Copyright 2016 QuintilesIMS.

More information

Complier Average Causal Effect (CACE)

Complier Average Causal Effect (CACE) Complier Average Causal Effect (CACE) Booil Jo Stanford University Methodological Advancement Meeting Innovative Directions in Estimating Impact Office of Planning, Research & Evaluation Administration

More information

Multiple imputation for multivariate missing-data. problems: a data analyst s perspective. Joseph L. Schafer and Maren K. Olsen

Multiple imputation for multivariate missing-data. problems: a data analyst s perspective. Joseph L. Schafer and Maren K. Olsen Multiple imputation for multivariate missing-data problems: a data analyst s perspective Joseph L. Schafer and Maren K. Olsen The Pennsylvania State University March 9, 1998 1 Abstract Analyses of multivariate

More information

By: Mei-Jie Zhang, Ph.D.

By: Mei-Jie Zhang, Ph.D. Propensity Scores By: Mei-Jie Zhang, Ph.D. Medical College of Wisconsin, Division of Biostatistics Friday, March 29, 2013 12:00-1:00 pm The Medical College of Wisconsin is accredited by the Accreditation

More information

Advanced Handling of Missing Data

Advanced Handling of Missing Data Advanced Handling of Missing Data One-day Workshop Nicole Janz ssrmcta@hermes.cam.ac.uk 2 Goals Discuss types of missingness Know advantages & disadvantages of missing data methods Learn multiple imputation

More information

The Impact of Relative Standards on the Propensity to Disclose. Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX

The Impact of Relative Standards on the Propensity to Disclose. Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX The Impact of Relative Standards on the Propensity to Disclose Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX 2 Web Appendix A: Panel data estimation approach As noted in the main

More information

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research

Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy Research 2012 CCPRC Meeting Methodology Presession Workshop October 23, 2012, 2:00-5:00 p.m. Propensity Score Methods for Estimating Causality in the Absence of Random Assignment: Applications for Child Care Policy

More information

1 Missing Data. Geert Molenberghs and Emmanuel Lesaffre. 1.1 Introduction

1 Missing Data. Geert Molenberghs and Emmanuel Lesaffre. 1.1 Introduction 1 Missing Data Geert Molenberghs and Emmanuel Lesaffre 1.1 Introduction Data from longitudinal studies in general, and from clinical trials in particular, are prone to incompleteness. As incompleteness

More information

Imputation approaches for potential outcomes in causal inference

Imputation approaches for potential outcomes in causal inference Int. J. Epidemiol. Advance Access published July 25, 2015 International Journal of Epidemiology, 2015, 1 7 doi: 10.1093/ije/dyv135 Education Corner Education Corner Imputation approaches for potential

More information

Validity and reliability of measurements

Validity and reliability of measurements Validity and reliability of measurements 2 3 Request: Intention to treat Intention to treat and per protocol dealing with cross-overs (ref Hulley 2013) For example: Patients who did not take/get the medication

More information

SLAUGHTER PIG MARKETING MANAGEMENT: UTILIZATION OF HIGHLY BIASED HERD SPECIFIC DATA. Henrik Kure

SLAUGHTER PIG MARKETING MANAGEMENT: UTILIZATION OF HIGHLY BIASED HERD SPECIFIC DATA. Henrik Kure SLAUGHTER PIG MARKETING MANAGEMENT: UTILIZATION OF HIGHLY BIASED HERD SPECIFIC DATA Henrik Kure Dina, The Royal Veterinary and Agricuural University Bülowsvej 48 DK 1870 Frederiksberg C. kure@dina.kvl.dk

More information

Heritability. The Extended Liability-Threshold Model. Polygenic model for continuous trait. Polygenic model for continuous trait.

Heritability. The Extended Liability-Threshold Model. Polygenic model for continuous trait. Polygenic model for continuous trait. The Extended Liability-Threshold Model Klaus K. Holst Thomas Scheike, Jacob Hjelmborg 014-05-1 Heritability Twin studies Include both monozygotic (MZ) and dizygotic (DZ) twin

More information

Applied Medical. Statistics Using SAS. Geoff Der. Brian S. Everitt. CRC Press. Taylor Si Francis Croup. Taylor & Francis Croup, an informa business

Applied Medical. Statistics Using SAS. Geoff Der. Brian S. Everitt. CRC Press. Taylor Si Francis Croup. Taylor & Francis Croup, an informa business Applied Medical Statistics Using SAS Geoff Der Brian S. Everitt CRC Press Taylor Si Francis Croup Boca Raton London New York CRC Press is an imprint of the Taylor & Francis Croup, an informa business A

More information

Adjustments for Rater Effects in

Adjustments for Rater Effects in Adjustments for Rater Effects in Performance Assessment Walter M. Houston, Mark R. Raymond, and Joseph C. Svec American College Testing Alternative methods to correct for rater leniency/stringency effects

More information

Analysis of TB prevalence surveys

Analysis of TB prevalence surveys Workshop and training course on TB prevalence surveys with a focus on field operations Analysis of TB prevalence surveys Day 8 Thursday, 4 August 2011 Phnom Penh Babis Sismanidis with acknowledgements

More information

Should a Normal Imputation Model Be Modified to Impute Skewed Variables?

Should a Normal Imputation Model Be Modified to Impute Skewed Variables? Sociological Methods and Research, 2013, 42(1), 105-138 Should a Normal Imputation Model Be Modified to Impute Skewed Variables? Paul T. von Hippel Abstract (169 words) Researchers often impute continuous

More information

Growth Modeling With Nonignorable Dropout: Alternative Analyses of the STAR*D Antidepressant Trial

Growth Modeling With Nonignorable Dropout: Alternative Analyses of the STAR*D Antidepressant Trial Psychological Methods 2011, Vol. 16, No. 1, 17 33 2011 American Psychological Association 1082-989X/11/$12.00 DOI: 10.1037/a0022634 Growth Modeling With Nonignorable Dropout: Alternative Analyses of the

More information

On Regression Analysis Using Bivariate Extreme Ranked Set Sampling

On Regression Analysis Using Bivariate Extreme Ranked Set Sampling On Regression Analysis Using Bivariate Extreme Ranked Set Sampling Atsu S. S. Dorvlo atsu@squ.edu.om Walid Abu-Dayyeh walidan@squ.edu.om Obaid Alsaidy obaidalsaidy@gmail.com Abstract- Many forms of ranked

More information

Using dynamic prediction to inform the optimal intervention time for an abdominal aortic aneurysm screening programme

Using dynamic prediction to inform the optimal intervention time for an abdominal aortic aneurysm screening programme Using dynamic prediction to inform the optimal intervention time for an abdominal aortic aneurysm screening programme Michael Sweeting Cardiovascular Epidemiology Unit, University of Cambridge Friday 15th

More information

What to do with missing data in clinical registry analysis?

What to do with missing data in clinical registry analysis? Melbourne 2011; Registry Special Interest Group What to do with missing data in clinical registry analysis? Rory Wolfe Acknowledgements: James Carpenter, Gerard O Reilly Department of Epidemiology & Preventive

More information

Methods of Reducing Bias in Time Series Designs: A Within Study Comparison

Methods of Reducing Bias in Time Series Designs: A Within Study Comparison Methods of Reducing Bias in Time Series Designs: A Within Study Comparison Kylie Anglin, University of Virginia Kate Miller-Bains, University of Virginia Vivian Wong, University of Virginia Coady Wing,

More information

On the Use of Local Assessments for Monitoring Centrally Reviewed Endpoints with Missing Data in Clinical Trials*

On the Use of Local Assessments for Monitoring Centrally Reviewed Endpoints with Missing Data in Clinical Trials* On the Use of Local Assessments for Monitoring Centrally Reviewed Endpoints with Missing Data in Clinical Trials* The Harvard community has made this article openly available. Please share how this access

More information

What is Multilevel Modelling Vs Fixed Effects. Will Cook Social Statistics

What is Multilevel Modelling Vs Fixed Effects. Will Cook Social Statistics What is Multilevel Modelling Vs Fixed Effects Will Cook Social Statistics Intro Multilevel models are commonly employed in the social sciences with data that is hierarchically structured Estimated effects

More information

LINEAR REGRESSION FOR BIVARIATE CENSORED DATA VIA MULTIPLE IMPUTATION

LINEAR REGRESSION FOR BIVARIATE CENSORED DATA VIA MULTIPLE IMPUTATION STATISTICS IN MEDICINE Statist. Med. 18, 3111} 3121 (1999) LINEAR REGRESSION FOR BIVARIATE CENSORED DATA VIA MULTIPLE IMPUTATION WEI PAN * AND CHARLES KOOPERBERG Division of Biostatistics, School of Public

More information

The Late Pretest Problem in Randomized Control Trials of Education Interventions

The Late Pretest Problem in Randomized Control Trials of Education Interventions The Late Pretest Problem in Randomized Control Trials of Education Interventions Peter Z. Schochet ACF Methods Conference, September 2012 In Journal of Educational and Behavioral Statistics, August 2010,

More information

Best Practice in Handling Cases of Missing or Incomplete Values in Data Analysis: A Guide against Eliminating Other Important Data

Best Practice in Handling Cases of Missing or Incomplete Values in Data Analysis: A Guide against Eliminating Other Important Data Best Practice in Handling Cases of Missing or Incomplete Values in Data Analysis: A Guide against Eliminating Other Important Data Sub-theme: Improving Test Development Procedures to Improve Validity Dibu

More information

MMI 409 Spring 2009 Final Examination Gordon Bleil. 1. Is there a difference in depression as a function of group and drug?

MMI 409 Spring 2009 Final Examination Gordon Bleil. 1. Is there a difference in depression as a function of group and drug? MMI 409 Spring 2009 Final Examination Gordon Bleil Table of Contents Research Scenario and General Assumptions Questions for Dataset (Questions are hyperlinked to detailed answers) 1. Is there a difference

More information

Validity and reliability of measurements

Validity and reliability of measurements Validity and reliability of measurements 2 Validity and reliability of measurements 4 5 Components in a dataset Why bother (examples from research) What is reliability? What is validity? How should I treat

More information

George B. Ploubidis. The role of sensitivity analysis in the estimation of causal pathways from observational data. Improving health worldwide

George B. Ploubidis. The role of sensitivity analysis in the estimation of causal pathways from observational data. Improving health worldwide George B. Ploubidis The role of sensitivity analysis in the estimation of causal pathways from observational data Improving health worldwide www.lshtm.ac.uk Outline Sensitivity analysis Causal Mediation

More information

Master thesis Department of Statistics

Master thesis Department of Statistics Master thesis Department of Statistics Masteruppsats, Statistiska institutionen Missing Data in the Swedish National Patients Register: Multiple Imputation by Fully Conditional Specification Jesper Hörnblad

More information