Generalized Estimating Equations for Depression Dose Regimes

Size: px
Start display at page:

Download "Generalized Estimating Equations for Depression Dose Regimes"

Transcription

1 Generalized Estimating Equations for Depression Dose Regimes Karen Walker, Walker Consulting LLC, Menifee CA Generalized Estimating Equations on the average produce consistent estimates of the regression coefficients and variances under weak assumptions about the actual correlation as the number of treatments becomes large. Use the GEE to: Relate the marginal response with a link function, for example the log of odds. Specify the variance function. Test the data to choose a working correlation matrix. Compute an initial estimate of β, for example with an ordinary generalized linear model assuming independence. Compute the working correlation matrix R i. Compute an estimate of the covariance matrix Update β Compute residuals and update V i Iterate until convergence ABSTRACT While working on a study for a depression drug, I came across drug administration data by where subjects had no real treatment definition. Subject dose regimes consisted of scenarios like: 10 mg per day, 10mg + 20mg +40mg per week, or 20mg + 10mg + 10mg... And so on. At first glance, I thought "there has to be missing data and those regimes will have a definition later. However, what if there's a need to process this data just as it is? How can this be done? Will it make sense to define a response level for each cumulative logits of the dose values over the course of a study, then fit it to a Proportional Odds model? In this paper I will demonstrate how cumulative logits are affect in the same ways using a parallel slopes test. We will use this information to see if the log cumulative odds are proportional, and discover the influence of explanatory variable, and find the points where regression lines "connect the dots" for a single continuous explanatory variable. INTRODUCTION So what is depression? According to WEBMD Clinical Depression is diagnosed when a change in one or more chemicals in the brain cause abnormal brain function. Since the cause of depression can be a mix of chemicals, there is no single disease to treat like say an infection, chronic pain, or even cancer. To treat depression we must examine all the risk factors that will change the brain s chemical balance, for example GENDER because of chemicals introduced in the brain for women during pregnancy and menopause, AGE because as people grow older chemicals are elevated in the brain because of the grief and trauma that are experienced with age. Health conditions like cancer, heart disease, being overweight or chronic pain are the biggest complaints in person that are diagnosed as clinically depressed. Anyone can suffer clinical depression due to physical emotional abuse or violence. And other stressful events that cause clinical depression are moving, marriage, divorce, new baby, or a new job can cause clinical depression symptoms that are more than just sadness. What makes treating clinical depression tricky, and what makes this paper so interesting is that where millions of are people suffer from clinical depression there s no definite way to treat it. How can we know when clinical depression is cured when some subjects have a clear sense of why they became depressed, and other subjects don t know when and where it happened? For the next 20 minutes or so we ll explore the many ways to treat it to see if we can uncover the best way. DOSE REGIMES FOR DEPRESSION First we will recognize that depression has to be managed on a daily basis at the very least to cover those subjects that didn t know when or where it happened. We ll build a Trial Arm dataset (TA) that contains the data points mentioned above and a few others so we can measure the effects for SEX, AGE, OBESITY, SUBSTANCE USE, DRUG, DOSE, and RESPONSE. Where response is Better=4, Slightly Better=3, No Change=2, Slightly Worst=1, Worst=0. This depression dataset will contain all the subject records to be analyzed, and assign a sequential number each time that subject takes a dose, so that sequential number will be both the visit and the number of times the subject had treatment. Note: we also want to deal with over eating, too much sugar, and substance use of alcohol, tobacco, or caffeine, so we ll have obesity and substance uses as covariates. 1

2 There are over 30 known drugs available for the treatment of clinical depression, and many subjects; at least 200, surveyed admit to taking more than one kind of drug when dealing with the sadness they experienced. We ll consider 12 depression dose regimes for discussion here. This kind of complex data distribution can be fitted to a generalized linear model because it allows for response variables that have arbitrary distributions and for an arbitrary link function as well. The Generalized Linear Model or (GLM) relates a mean response to a vector of explanatory variables through a link function. However where a regular Linear Model works best for a simple normal distribution, the Generalized Model allows for an arbitrary distribution on the response variable. So the link function can have assorted shapes. The GLM consists of three elements: 1. A probability distribution from the exponential family. 2. A linear predictor η = Xβ. 3. A link function g such that E(Y) = μ = g 1(η). Generalized Estimating Equations were introduced by Liang and Zeger in 1986 as a method of handling correlated data that can be modeled as a Generalized Linear Model for health outcomes (longitudinal studies) or litters (clustered data). Generalized estimating equations are an extension of GLMs to accommodate correlated data; they are an extension of quazi-score equations. The GEE approach models a known function for the marginal expectation of the dependent variable as a linear function of one or more variables. With quasi-likelihood, you can pursue statistical models by making assumptions about the link function and the relationship between the first two moments, but without specifying the complete distribution of the response. The GEE describes the random component with a common link and variance function. The GEE accounts for the covariance structure of the correlated measures So let Y ij (j = 1.n i, i= 1. K) Represent the jth measurement on the ith subject. For our purpose, j is the Dose Regimes and i is one dose for a Clinical Depression Subject. There are n i Dose Regimens for one subject i and. K i=1 n i Total measurements 2

3 Here s how to make it work. Step 1 The generalized estimating equation for β is an extension of the GLM estimating equation: K π β V i 1 (Y i μ i (β)) = 0 i=1 Where μ is the corresponding vector of means μ = [μ i1,,μ ini ] and V i is an estimate of the covariance matrix Y. Step 2 The working correlation matrix R i (α) is estimated as r ij = y ij μ ij v(μ ij ) For using the current value of the parameter vector β to compute the appropriate function of the Pearson residual. Step 3 Specify the variance of Y by a covariance matrix modeled as V i = A i 1/2 R i (α)a i 1/2 Where A i is an n i X n i diagonal matrix with V(μ ij ) as the jth diagonal element. Step 4 Test the β Q c =(Cβ ) [CV β C ] 1 (Cβ ) Update β K β r+1 = β r [ μ i 1 i=1 V μ i β i β ] 1 K [ μ i β i=1 V i 1 (Y - μ i ) ] Step 5 Compute residuals and update V i. Step 6 Iterate until convergence. 3

4 DEPRESSION DATA ID SEX AGE OBESITY Su VISIT Treatment Regime RESPONSE 101 Female 39 Yes Alcohol 1 30mg standard Female 39 Yes Alcohol 2 30mg Second time standard 101 Female 39 Yes Tobacco 3 30mg new Female 39 Yes Sugar 4 30mg standard Male 27 No Tobacco 1 10mg standard 2 1 Table 1. The Depression data dataset looks something like this except with at least 12 dose regimes ID Baseline Visit_1 Visit_2 Visit_3 Visit_4 Visit_5 Visit_6 Visit_7 Visit_8 up to Table 2.Visit 1 is set to Baseline and after PROC transpose depression data (depr_t.sas7bdat) is read in for analysis to temporary SAS dataset depres. The depression data can be analyzed with a logistic regression using GEE. Create 12 observations per subject, one for each visit. Data depres(keep=(regime id treatment sex age obesity su visit: outcome)); run; Set depr_t; visit=1; outcome=visit_1; output; visit=2; outcome=visit_2; output; visit=3; outcome=visit_3; output; visit=4; outcome=visit_4; output; visit=5; outcome=visit_5; output; visit=6; outcome=visit_6; output; visit=7; outcome=visit_7; output; visit=8; outcome=visit_8; output; visit=9; outcome=visit_9; output; visit=10; outcome=visit_10; output; visit=11; outcome=visit_11; output; visit=12; outcome=visit_12; output; 4

5 data depression; set depres; if outcome>=3 then dichot=1; else dichot=0; if baseline>=3 then di_base=1; else di_base=0; run; GEE ANALYSIS Using an exchangeable working correlation Matrix patients on either standard or new regimes are assigned to treatment doses, with a response measured as worst, slightly worst, no change, slightly better, and better ( 0, 1, 2, 3, 4). Subjects are measured at baseline and 12 visits. Response is slightly better, or better versus not. Proc genmod data=depression descending; Class id regime sex age obesity substance treatment visit; Model dichot = treatment sex age regime di_base visit visit*treatment Treatment*regime / Link=logit dist=bin type3; Repeated subject=id*regime / type=exch; Run; Model Information Correlation Structure Exchangeable Subject Effect Id*regimes (levels) Number of Clusters Equal to number of Subjects Correlation Matric Dimension 12 Maxim Cluster Size 12 Minimum Cluster Size 12 If you need to include a numbered or an ordered list: 1. The Type 3 analysis shows nonsignificant interaction terms.. 2. When interactions are removed visit remains nonsignificant. 3. Patients on standard treatment have, on the average greater odds of better or slightly better response. The SAS PROC GEE procedure is now available in SAS / STAT, version 9.4. It supports generalized logits as well as the ESTIMATE, LSMEANS, and OUTPUT statements. It also provides the LOGOR=option in the Repeated statement for alternating logistic regression with an extension for ordinal data.. 5

6 THE RESULTS Patients on standard regime of 30mg have, on the average e times greater odds of a slightly better of better response that those patients on new regime of 10mg adjusted for the other effect in the model. Output 1. Analysis of GEE Parameter Estimates Empirical Standard Error Estimates Parameter Estimate Standard Error 95% Confidence Limits Z Pr > z intercept Regime Standard Regime New sex F sex M Treatment 30mg Treatment 10mg age di_base <.0001 obesity Source: Fictitious data, for illustration purposes only 6

7 LET S DO THAT AGAIN Using an unstructured working correlation Matrix patients on either standard or new regimes are assigned to treatment doses, with a response measured as worst, slightly worst, no change, slightly better, and better ( 0, 1, 2, 3, 4). Subjects are measured at baseline and 12 visits. Response is slightly better, or better versus not. Proc genmod data=depression descending; Class id regime sex age obesity substance treatment visit; Model dichot = treatment sex age regime di_base visit visit*treatment Treatment*regime / Link=logit dist=bin type3; Repeated subject=id*regime / type=unstr; Run; Patients on standard regime of 30mg have, on the average e times greater odds of a slightly better of better response that those patients on new regime of 10mg adjusted for the other effect in the model. Output 1. Analysis of GEE Parameter Estimates Empirical Standard Error Estimates Parameter Estimate Standard Error 95% Confidence Limits Z Pr > z intercept Regime Standard Regime New sex F sex M Treatment 30mg Treatment 10mg age di_base <.0001 obesity Source: Fictitious data, for illustration purposes only 7

8 CONCLUSION With GEE both Exchangeable and Unstructured working correlation matrix yield results that are very close. Many statisticians routinely use the independent structure because the parameter estimates and standard errors are consistent even if the correlation structure isn t correctly specified. Here the working correlation matrix are consistent as well. With smaller number of treatments it is often better to use a simpler structure because that means fewer parameters to estimate. With GEE even the more complex structures are simplified. REFERENCES Modeling Longitudinal Categorical Response Data: Stokes, Maura: (April 6, 2015) SAS Global Forum, Dallas, Texas( 2015). Analysis of Longitudinal Data Diggle P.J., and Zeger, S.L. (1994) Oxford: Oxford Science <Copyright date>. Methods for Massive, Missing or Multifaceted Data<Stokes Maura> Proceedings of the SAS Global Forum 2015 Conference>. <Dallas, Texas>:Available at ACKNOWLEDGMENTS Thank you to all my friends working with SAS year after year you are most kind. Bless you, and in God I trust. RECOMMENDED READING Base SAS Procedures Guide SAS For Dummies CONTACT INFORMATION Your comments and questions are valued and encouraged. Contact the author at: Name: Karen Walker Enterprise: Walker Consulting LLC Address: Sunnywood City, State ZIP: Menifee, California Work Phone: (480) Fax: kkwalker77@yahoo.com Web: SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc. in the USA and other countries. indicates USA registration. Other brand and product names are trademarks of their respective companies. 8

How to analyze correlated and longitudinal data?

How to analyze correlated and longitudinal data? How to analyze correlated and longitudinal data? Niloofar Ramezani, University of Northern Colorado, Greeley, Colorado ABSTRACT Longitudinal and correlated data are extensively used across disciplines

More information

GENERALIZED ESTIMATING EQUATIONS FOR LONGITUDINAL DATA. Anti-Epileptic Drug Trial Timeline. Exploratory Data Analysis. Exploratory Data Analysis

GENERALIZED ESTIMATING EQUATIONS FOR LONGITUDINAL DATA. Anti-Epileptic Drug Trial Timeline. Exploratory Data Analysis. Exploratory Data Analysis GENERALIZED ESTIMATING EQUATIONS FOR LONGITUDINAL DATA 1 Example: Clinical Trial of an Anti-Epileptic Drug 59 epileptic patients randomized to progabide or placebo (Leppik et al., 1987) (Described in Fitzmaurice

More information

A Comparison of Linear Mixed Models to Generalized Linear Mixed Models: A Look at the Benefits of Physical Rehabilitation in Cardiopulmonary Patients

A Comparison of Linear Mixed Models to Generalized Linear Mixed Models: A Look at the Benefits of Physical Rehabilitation in Cardiopulmonary Patients Paper PH400 A Comparison of Linear Mixed Models to Generalized Linear Mixed Models: A Look at the Benefits of Physical Rehabilitation in Cardiopulmonary Patients Jennifer Ferrell, University of Louisville,

More information

Analysis of Hearing Loss Data using Correlated Data Analysis Techniques

Analysis of Hearing Loss Data using Correlated Data Analysis Techniques Analysis of Hearing Loss Data using Correlated Data Analysis Techniques Ruth Penman and Gillian Heller, Department of Statistics, Macquarie University, Sydney, Australia. Correspondence: Ruth Penman, Department

More information

Analytic Strategies for the OAI Data

Analytic Strategies for the OAI Data Analytic Strategies for the OAI Data Charles E. McCulloch, Division of Biostatistics, Dept of Epidemiology and Biostatistics, UCSF ACR October 2008 Outline 1. Introduction and examples. 2. General analysis

More information

Department of Statistics, Biostatistics & Informatics, University of Dhaka, Dhaka-1000, Bangladesh. Abstract

Department of Statistics, Biostatistics & Informatics, University of Dhaka, Dhaka-1000, Bangladesh. Abstract Bangladesh J. Sci. Res. 29(1): 1-9, 2016 (June) Introduction GENERALIZED QUASI-LIKELIHOOD APPROACH FOR ANALYZING LONGITUDINAL COUNT DATA OF NUMBER OF VISITS TO A DIABETES HOSPITAL IN BANGLADESH Kanchan

More information

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA PharmaSUG 2014 - Paper SP08 Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA ABSTRACT Randomized clinical trials serve as the

More information

1. Objective: analyzing CD4 counts data using GEE marginal model and random effects model. Demonstrate the analysis using SAS and STATA.

1. Objective: analyzing CD4 counts data using GEE marginal model and random effects model. Demonstrate the analysis using SAS and STATA. LDA lab Feb, 6 th, 2002 1 1. Objective: analyzing CD4 counts data using GEE marginal model and random effects model. Demonstrate the analysis using SAS and STATA. 2. Scientific question: estimate the average

More information

Parameter Estimation of Cognitive Attributes using the Crossed Random- Effects Linear Logistic Test Model with PROC GLIMMIX

Parameter Estimation of Cognitive Attributes using the Crossed Random- Effects Linear Logistic Test Model with PROC GLIMMIX Paper 1766-2014 Parameter Estimation of Cognitive Attributes using the Crossed Random- Effects Linear Logistic Test Model with PROC GLIMMIX ABSTRACT Chunhua Cao, Yan Wang, Yi-Hsin Chen, Isaac Y. Li University

More information

11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES

11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES Correlational Research Correlational Designs Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are

More information

Use of GEEs in STATA

Use of GEEs in STATA Use of GEEs in STATA 1. When generalised estimating equations are used and example 2. Stata commands and options for GEEs 3. Results from Stata (and SAS!) 4. Another use of GEEs Use of GEEs GEEs are one

More information

11/24/2017. Do not imply a cause-and-effect relationship

11/24/2017. Do not imply a cause-and-effect relationship Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection

More information

Analysis of Vaccine Effects on Post-Infection Endpoints Biostat 578A Lecture 3

Analysis of Vaccine Effects on Post-Infection Endpoints Biostat 578A Lecture 3 Analysis of Vaccine Effects on Post-Infection Endpoints Biostat 578A Lecture 3 Analysis of Vaccine Effects on Post-Infection Endpoints p.1/40 Data Collected in Phase IIb/III Vaccine Trial Longitudinal

More information

LOGLINK Example #1. SUDAAN Statements and Results Illustrated. Input Data Set(s): EPIL.SAS7bdat ( Thall and Vail (1990)) Example.

LOGLINK Example #1. SUDAAN Statements and Results Illustrated. Input Data Set(s): EPIL.SAS7bdat ( Thall and Vail (1990)) Example. LOGLINK Example #1 SUDAAN Statements and Results Illustrated Log-linear regression modeling MODEL TEST SUBPOPN EFFECTS Input Data Set(s): EPIL.SAS7bdat ( Thall and Vail (1990)) Example Use the Epileptic

More information

Daniel Boduszek University of Huddersfield

Daniel Boduszek University of Huddersfield Daniel Boduszek University of Huddersfield d.boduszek@hud.ac.uk Introduction to Multinominal Logistic Regression SPSS procedure of MLR Example based on prison data Interpretation of SPSS output Presenting

More information

Today: Binomial response variable with an explanatory variable on an ordinal (rank) scale.

Today: Binomial response variable with an explanatory variable on an ordinal (rank) scale. Model Based Statistics in Biology. Part V. The Generalized Linear Model. Single Explanatory Variable on an Ordinal Scale ReCap. Part I (Chapters 1,2,3,4), Part II (Ch 5, 6, 7) ReCap Part III (Ch 9, 10,

More information

Statistical reports Regression, 2010

Statistical reports Regression, 2010 Statistical reports Regression, 2010 Niels Richard Hansen June 10, 2010 This document gives some guidelines on how to write a report on a statistical analysis. The document is organized into sections that

More information

Poisson regression. Dae-Jin Lee Basque Center for Applied Mathematics.

Poisson regression. Dae-Jin Lee Basque Center for Applied Mathematics. Dae-Jin Lee dlee@bcamath.org Basque Center for Applied Mathematics http://idaejin.github.io/bcam-courses/ D.-J. Lee (BCAM) Intro to GLM s with R GitHub: idaejin 1/40 Modeling count data Introduction Response

More information

Midterm Exam ANSWERS Categorical Data Analysis, CHL5407H

Midterm Exam ANSWERS Categorical Data Analysis, CHL5407H Midterm Exam ANSWERS Categorical Data Analysis, CHL5407H 1. Data from a survey of women s attitudes towards mammography are provided in Table 1. Women were classified by their experience with mammography

More information

Regression so far... Lecture 22 - Logistic Regression. Odds. Recap of what you should know how to do... At this point we have covered: Sta102 / BME102

Regression so far... Lecture 22 - Logistic Regression. Odds. Recap of what you should know how to do... At this point we have covered: Sta102 / BME102 Background Regression so far... Lecture 22 - Sta102 / BME102 Colin Rundel November 23, 2015 At this point we have covered: Simple linear regression Relationship between numerical response and a numerical

More information

Analyzing diastolic and systolic blood pressure individually or jointly?

Analyzing diastolic and systolic blood pressure individually or jointly? Analyzing diastolic and systolic blood pressure individually or jointly? Chenglin Ye a, Gary Foster a, Lisa Dolovich b, Lehana Thabane a,c a. Department of Clinical Epidemiology and Biostatistics, McMaster

More information

NORTH SOUTH UNIVERSITY TUTORIAL 2

NORTH SOUTH UNIVERSITY TUTORIAL 2 NORTH SOUTH UNIVERSITY TUTORIAL 2 AHMED HOSSAIN,PhD Data Management and Analysis AHMED HOSSAIN,PhD - Data Management and Analysis 1 Correlation Analysis INTRODUCTION In correlation analysis, we estimate

More information

Logistic regression. Department of Statistics, University of South Carolina. Stat 205: Elementary Statistics for the Biological and Life Sciences

Logistic regression. Department of Statistics, University of South Carolina. Stat 205: Elementary Statistics for the Biological and Life Sciences Logistic regression Department of Statistics, University of South Carolina Stat 205: Elementary Statistics for the Biological and Life Sciences 1 / 1 Logistic regression: pp. 538 542 Consider Y to be binary

More information

Applied Medical. Statistics Using SAS. Geoff Der. Brian S. Everitt. CRC Press. Taylor Si Francis Croup. Taylor & Francis Croup, an informa business

Applied Medical. Statistics Using SAS. Geoff Der. Brian S. Everitt. CRC Press. Taylor Si Francis Croup. Taylor & Francis Croup, an informa business Applied Medical Statistics Using SAS Geoff Der Brian S. Everitt CRC Press Taylor Si Francis Croup Boca Raton London New York CRC Press is an imprint of the Taylor & Francis Croup, an informa business A

More information

Today Retrospective analysis of binomial response across two levels of a single factor.

Today Retrospective analysis of binomial response across two levels of a single factor. Model Based Statistics in Biology. Part V. The Generalized Linear Model. Chapter 18.3 Single Factor. Retrospective Analysis ReCap. Part I (Chapters 1,2,3,4), Part II (Ch 5, 6, 7) ReCap Part III (Ch 9,

More information

Inverse Probability of Censoring Weighting for Selective Crossover in Oncology Clinical Trials.

Inverse Probability of Censoring Weighting for Selective Crossover in Oncology Clinical Trials. Paper SP02 Inverse Probability of Censoring Weighting for Selective Crossover in Oncology Clinical Trials. José Luis Jiménez-Moro (PharmaMar, Madrid, Spain) Javier Gómez (PharmaMar, Madrid, Spain) ABSTRACT

More information

Quasicomplete Separation in Logistic Regression: A Medical Example

Quasicomplete Separation in Logistic Regression: A Medical Example Quasicomplete Separation in Logistic Regression: A Medical Example Madeline J Boyle, Carolinas Medical Center, Charlotte, NC ABSTRACT Logistic regression can be used to model the relationship between a

More information

THE ANALYSIS OF METHADONE CLINIC DATA USING MARGINAL AND CONDITIONAL LOGISTIC MODELS WITH MIXTURE OR RANDOM EFFECTS

THE ANALYSIS OF METHADONE CLINIC DATA USING MARGINAL AND CONDITIONAL LOGISTIC MODELS WITH MIXTURE OR RANDOM EFFECTS Austral. & New Zealand J. Statist. 40(1), 1998, 1 10 THE ANALYSIS OF METHADONE CLINIC DATA USING MARGINAL AND CONDITIONAL LOGISTIC MODELS WITH MIXTURE OR RANDOM EFFECTS JENNIFER S.K. CHAN 1,ANTHONY Y.C.

More information

Original Article Downloaded from jhs.mazums.ac.ir at 22: on Friday October 5th 2018 [ DOI: /acadpub.jhs ]

Original Article Downloaded from jhs.mazums.ac.ir at 22: on Friday October 5th 2018 [ DOI: /acadpub.jhs ] Iranian journal of health sciences 213;1(3):58-7 http://jhs.mazums.ac.ir Original Article Downloaded from jhs.mazums.ac.ir at 22:2 +33 on Friday October 5th 218 [ DOI: 1.18869/acadpub.jhs.1.3.58 ] A New

More information

Lecture 14: Adjusting for between- and within-cluster covariates in the analysis of clustered data May 14, 2009

Lecture 14: Adjusting for between- and within-cluster covariates in the analysis of clustered data May 14, 2009 Measurement, Design, and Analytic Techniques in Mental Health and Behavioral Sciences p. 1/3 Measurement, Design, and Analytic Techniques in Mental Health and Behavioral Sciences Lecture 14: Adjusting

More information

m 11 m.1 > m 12 m.2 risk for smokers risk for nonsmokers

m 11 m.1 > m 12 m.2 risk for smokers risk for nonsmokers SOCY5061 RELATIVE RISKS, RELATIVE ODDS, LOGISTIC REGRESSION RELATIVE RISKS: Suppose we are interested in the association between lung cancer and smoking. Consider the following table for the whole population:

More information

Multivariate Multilevel Models

Multivariate Multilevel Models Multivariate Multilevel Models Getachew A. Dagne George W. Howe C. Hendricks Brown Funded by NIMH/NIDA 11/20/2014 (ISSG Seminar) 1 Outline What is Behavioral Social Interaction? Importance of studying

More information

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Today s Class: Features of longitudinal data Features of longitudinal models What can MLM do for you? What to expect in this

More information

Analysis of Rheumatoid Arthritis Data using Logistic Regression and Penalized Approach

Analysis of Rheumatoid Arthritis Data using Logistic Regression and Penalized Approach University of South Florida Scholar Commons Graduate Theses and Dissertations Graduate School November 2015 Analysis of Rheumatoid Arthritis Data using Logistic Regression and Penalized Approach Wei Chen

More information

A Handbook of Statistical Analyses Using R. Brian S. Everitt and Torsten Hothorn

A Handbook of Statistical Analyses Using R. Brian S. Everitt and Torsten Hothorn A Handbook of Statistical Analyses Using R Brian S. Everitt and Torsten Hothorn CHAPTER 11 Analysing Longitudinal Data II Generalised Estimation Equations: Treating Respiratory Illness and Epileptic Seizures

More information

12/30/2017. PSY 5102: Advanced Statistics for Psychological and Behavioral Research 2

12/30/2017. PSY 5102: Advanced Statistics for Psychological and Behavioral Research 2 PSY 5102: Advanced Statistics for Psychological and Behavioral Research 2 Selecting a statistical test Relationships among major statistical methods General Linear Model and multiple regression Special

More information

Daniel Boduszek University of Huddersfield

Daniel Boduszek University of Huddersfield Daniel Boduszek University of Huddersfield d.boduszek@hud.ac.uk Introduction to Logistic Regression SPSS procedure of LR Interpretation of SPSS output Presenting results from LR Logistic regression is

More information

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Today s Class: Features of longitudinal data Features of longitudinal models What can MLM do for you? What to expect in this

More information

Lecture 21. RNA-seq: Advanced analysis

Lecture 21. RNA-seq: Advanced analysis Lecture 21 RNA-seq: Advanced analysis Experimental design Introduction An experiment is a process or study that results in the collection of data. Statistical experiments are conducted in situations in

More information

Reveal Relationships in Categorical Data

Reveal Relationships in Categorical Data SPSS Categories 15.0 Specifications Reveal Relationships in Categorical Data Unleash the full potential of your data through perceptual mapping, optimal scaling, preference scaling, and dimension reduction

More information

THE UNIVERSITY OF OKLAHOMA HEALTH SCIENCES CENTER GRADUATE COLLEGE A COMPARISON OF STATISTICAL ANALYSIS MODELING APPROACHES FOR STEPPED-

THE UNIVERSITY OF OKLAHOMA HEALTH SCIENCES CENTER GRADUATE COLLEGE A COMPARISON OF STATISTICAL ANALYSIS MODELING APPROACHES FOR STEPPED- THE UNIVERSITY OF OKLAHOMA HEALTH SCIENCES CENTER GRADUATE COLLEGE A COMPARISON OF STATISTICAL ANALYSIS MODELING APPROACHES FOR STEPPED- WEDGE CLUSTER RANDOMIZED TRIALS THAT INCLUDE MULTILEVEL CLUSTERING,

More information

Correlation and regression

Correlation and regression PG Dip in High Intensity Psychological Interventions Correlation and regression Martin Bland Professor of Health Statistics University of York http://martinbland.co.uk/ Correlation Example: Muscle strength

More information

Longitudinal and Hierarchical Analytic Strategies for OAI Data

Longitudinal and Hierarchical Analytic Strategies for OAI Data Longitudinal and Hierarchical Analytic Strategies for OAI Data Charles E. McCulloch, Division of Biostatistics, Dept of Epidemiology and Biostatistics, UCSF OARSI Montreal September 10, 2009 Outline 1.

More information

Class 7 Everything is Related

Class 7 Everything is Related Class 7 Everything is Related Correlational Designs l 1 Topics Types of Correlational Designs Understanding Correlation Reporting Correlational Statistics Quantitative Designs l 2 Types of Correlational

More information

STAT 201 Chapter 3. Association and Regression

STAT 201 Chapter 3. Association and Regression STAT 201 Chapter 3 Association and Regression 1 Association of Variables Two Categorical Variables Response Variable (dependent variable): the outcome variable whose variation is being studied Explanatory

More information

A COMPARISON OF IMPUTATION METHODS FOR MISSING DATA IN A MULTI-CENTER RANDOMIZED CLINICAL TRIAL: THE IMPACT STUDY

A COMPARISON OF IMPUTATION METHODS FOR MISSING DATA IN A MULTI-CENTER RANDOMIZED CLINICAL TRIAL: THE IMPACT STUDY A COMPARISON OF IMPUTATION METHODS FOR MISSING DATA IN A MULTI-CENTER RANDOMIZED CLINICAL TRIAL: THE IMPACT STUDY Lingqi Tang 1, Thomas R. Belin 2, and Juwon Song 2 1 Center for Health Services Research,

More information

Linear Regression in SAS

Linear Regression in SAS 1 Suppose we wish to examine factors that predict patient s hemoglobin levels. Simulated data for six patients is used throughout this tutorial. data hgb_data; input id age race $ bmi hgb; cards; 21 25

More information

Day Hospital versus Ordinary Hospitalization: factors in treatment discrimination

Day Hospital versus Ordinary Hospitalization: factors in treatment discrimination Working Paper Series, N. 7, July 2004 Day Hospital versus Ordinary Hospitalization: factors in treatment discrimination Luca Grassetti Department of Statistical Sciences University of Padua Italy Michela

More information

Ashwini S Erande MPH, Shaista Malik MD University of California Irvine, Orange, California

Ashwini S Erande MPH, Shaista Malik MD University of California Irvine, Orange, California The Association of Morbid Obesity with Mortality and Coronary Revascularization among Patients with Acute Myocardial Infarction using ARRAYS, PROC FREQ and PROC LOGISTIC ABSTRACT Ashwini S Erande MPH,

More information

Ordinary Least Squares Regression

Ordinary Least Squares Regression Ordinary Least Squares Regression March 2013 Nancy Burns (nburns@isr.umich.edu) - University of Michigan From description to cause Group Sample Size Mean Health Status Standard Error Hospital 7,774 3.21.014

More information

Applications. DSC 410/510 Multivariate Statistical Methods. Discriminating Two Groups. What is Discriminant Analysis

Applications. DSC 410/510 Multivariate Statistical Methods. Discriminating Two Groups. What is Discriminant Analysis DSC 4/5 Multivariate Statistical Methods Applications DSC 4/5 Multivariate Statistical Methods Discriminant Analysis Identify the group to which an object or case (e.g. person, firm, product) belongs:

More information

Stepwise method Modern Model Selection Methods Quantile-Quantile plot and tests for normality

Stepwise method Modern Model Selection Methods Quantile-Quantile plot and tests for normality Week 9 Hour 3 Stepwise method Modern Model Selection Methods Quantile-Quantile plot and tests for normality Stat 302 Notes. Week 9, Hour 3, Page 1 / 39 Stepwise Now that we've introduced interactions,

More information

Midterm project due next Wednesday at 2 PM

Midterm project due next Wednesday at 2 PM Course Business Midterm project due next Wednesday at 2 PM Please submit on CourseWeb Next week s class: Discuss current use of mixed-effects models in the literature Short lecture on effect size & statistical

More information

Knowledge is Power: The Basics of SAS Proc Power

Knowledge is Power: The Basics of SAS Proc Power ABSTRACT Knowledge is Power: The Basics of SAS Proc Power Elaina Gates, California Polytechnic State University, San Luis Obispo There are many statistics applications where it is important to understand

More information

Week 8 Hour 1: More on polynomial fits. The AIC. Hour 2: Dummy Variables what are they? An NHL Example. Hour 3: Interactions. The stepwise method.

Week 8 Hour 1: More on polynomial fits. The AIC. Hour 2: Dummy Variables what are they? An NHL Example. Hour 3: Interactions. The stepwise method. Week 8 Hour 1: More on polynomial fits. The AIC Hour 2: Dummy Variables what are they? An NHL Example Hour 3: Interactions. The stepwise method. Stat 302 Notes. Week 8, Hour 1, Page 1 / 34 Human growth

More information

Why Mixed Effects Models?

Why Mixed Effects Models? Why Mixed Effects Models? Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions

More information

George B. Ploubidis. The role of sensitivity analysis in the estimation of causal pathways from observational data. Improving health worldwide

George B. Ploubidis. The role of sensitivity analysis in the estimation of causal pathways from observational data. Improving health worldwide George B. Ploubidis The role of sensitivity analysis in the estimation of causal pathways from observational data Improving health worldwide www.lshtm.ac.uk Outline Sensitivity analysis Causal Mediation

More information

SCHOOL OF MATHEMATICS AND STATISTICS

SCHOOL OF MATHEMATICS AND STATISTICS Data provided: Tables of distributions MAS603 SCHOOL OF MATHEMATICS AND STATISTICS Further Clinical Trials Spring Semester 014 015 hours Candidates may bring to the examination a calculator which conforms

More information

The Association of Morbid Obesity with Mortality and Coronary Revascularization among Patients with Acute Myocardial Infarction

The Association of Morbid Obesity with Mortality and Coronary Revascularization among Patients with Acute Myocardial Infarction PharmaSUG 2014 - Paper HA06 The Association of Morbid Obesity with Mortality and Coronary Revascularization among Patients with Acute Myocardial Infarction ABSTRACT Ashwini S Erande MPH University Of California

More information

Analysis of TB prevalence surveys

Analysis of TB prevalence surveys Workshop and training course on TB prevalence surveys with a focus on field operations Analysis of TB prevalence surveys Day 8 Thursday, 4 August 2011 Phnom Penh Babis Sismanidis with acknowledgements

More information

Bootstrapping Residuals to Estimate the Standard Error of Simple Linear Regression Coefficients

Bootstrapping Residuals to Estimate the Standard Error of Simple Linear Regression Coefficients Bootstrapping Residuals to Estimate the Standard Error of Simple Linear Regression Coefficients Muhammad Hasan Sidiq Kurniawan 1) 1)* Department of Statistics, Universitas Islam Indonesia hasansidiq@uiiacid

More information

Studying the effect of change on change : a different viewpoint

Studying the effect of change on change : a different viewpoint Studying the effect of change on change : a different viewpoint Eyal Shahar Professor, Division of Epidemiology and Biostatistics, Mel and Enid Zuckerman College of Public Health, University of Arizona

More information

Dan Byrd UC Office of the President

Dan Byrd UC Office of the President Dan Byrd UC Office of the President 1. OLS regression assumes that residuals (observed value- predicted value) are normally distributed and that each observation is independent from others and that the

More information

Palo. Alto Medical WHAT IS. combining segmented. Regression and. intervention, then. receiving the. over. The GLIMMIX. change of a. follow.

Palo. Alto Medical WHAT IS. combining segmented. Regression and. intervention, then. receiving the. over. The GLIMMIX. change of a. follow. Regression and Stepped Wedge Designs Eric C. Wong, Po-Han Foundation Researchh Institute, Palo Alto, CA ABSTRACT Impact evaluation often equires assessing the impact of a new policy, intervention, product,

More information

Lab 8: Multiple Linear Regression

Lab 8: Multiple Linear Regression Lab 8: Multiple Linear Regression 1 Grading the Professor Many college courses conclude by giving students the opportunity to evaluate the course and the instructor anonymously. However, the use of these

More information

Modeling unobserved heterogeneity in Stata

Modeling unobserved heterogeneity in Stata Modeling unobserved heterogeneity in Stata Rafal Raciborski StataCorp LLC November 27, 2017 Rafal Raciborski (StataCorp) Modeling unobserved heterogeneity November 27, 2017 1 / 59 Plan of the talk Concepts

More information

Accommodating informative dropout and death: a joint modelling approach for longitudinal and semicompeting risks data

Accommodating informative dropout and death: a joint modelling approach for longitudinal and semicompeting risks data Appl. Statist. (2018) 67, Part 1, pp. 145 163 Accommodating informative dropout and death: a joint modelling approach for longitudinal and semicompeting risks data Qiuju Li and Li Su Medical Research Council

More information

Propensity Score Methods for Causal Inference with the PSMATCH Procedure

Propensity Score Methods for Causal Inference with the PSMATCH Procedure Paper SAS332-2017 Propensity Score Methods for Causal Inference with the PSMATCH Procedure Yang Yuan, Yiu-Fai Yung, and Maura Stokes, SAS Institute Inc. Abstract In a randomized study, subjects are randomly

More information

In this module I provide a few illustrations of options within lavaan for handling various situations.

In this module I provide a few illustrations of options within lavaan for handling various situations. In this module I provide a few illustrations of options within lavaan for handling various situations. An appropriate citation for this material is Yves Rosseel (2012). lavaan: An R Package for Structural

More information

The Food Consumption Analysis

The Food Consumption Analysis The Food Consumption Analysis BACKGROUND FOR STUDY The CHIS 2005 Adult Survey contains data on the individual records from the adult component of 2005 California Health Interview Survey. That is the population

More information

Name: emergency please discuss this with the exam proctor. 6. Vanderbilt s academic honor code applies.

Name: emergency please discuss this with the exam proctor. 6. Vanderbilt s academic honor code applies. Name: Biostatistics 1 st year Comprehensive Examination: Applied in-class exam May 28 th, 2015: 9am to 1pm Instructions: 1. There are seven questions and 12 pages. 2. Read each question carefully. Answer

More information

Prediction Model For Risk Of Breast Cancer Considering Interaction Between The Risk Factors

Prediction Model For Risk Of Breast Cancer Considering Interaction Between The Risk Factors INTERNATIONAL JOURNAL OF SCIENTIFIC & TECHNOLOGY RESEARCH VOLUME, ISSUE 0, SEPTEMBER 01 ISSN 81 Prediction Model For Risk Of Breast Cancer Considering Interaction Between The Risk Factors Nabila Al Balushi

More information

Content. Basic Statistics and Data Analysis for Health Researchers from Foreign Countries. Research question. Example Newly diagnosed Type 2 Diabetes

Content. Basic Statistics and Data Analysis for Health Researchers from Foreign Countries. Research question. Example Newly diagnosed Type 2 Diabetes Content Quantifying association between continuous variables. Basic Statistics and Data Analysis for Health Researchers from Foreign Countries Volkert Siersma siersma@sund.ku.dk The Research Unit for General

More information

Simple Linear Regression One Categorical Independent Variable with Several Categories

Simple Linear Regression One Categorical Independent Variable with Several Categories Simple Linear Regression One Categorical Independent Variable with Several Categories Does ethnicity influence total GCSE score? We ve learned that variables with just two categories are called binary

More information

Introduction to Machine Learning. Katherine Heller Deep Learning Summer School 2018

Introduction to Machine Learning. Katherine Heller Deep Learning Summer School 2018 Introduction to Machine Learning Katherine Heller Deep Learning Summer School 2018 Outline Kinds of machine learning Linear regression Regularization Bayesian methods Logistic Regression Why we do this

More information

Analyzing binary outcomes, going beyond logistic regression

Analyzing binary outcomes, going beyond logistic regression Analyzing binary outcomes, going beyond logistic regression 2018 EHE Forum presentation James O. Uanhoro Department of Educational Studies Premise Obtaining relative risk using Poisson regression Obtaining

More information

Selected Topics in Biostatistics Seminar Series. Missing Data. Sponsored by: Center For Clinical Investigation and Cleveland CTSC

Selected Topics in Biostatistics Seminar Series. Missing Data. Sponsored by: Center For Clinical Investigation and Cleveland CTSC Selected Topics in Biostatistics Seminar Series Missing Data Sponsored by: Center For Clinical Investigation and Cleveland CTSC Brian Schmotzer, MS Biostatistician, CCI Statistical Sciences Core brian.schmotzer@case.edu

More information

Bayesian approaches to handling missing data: Practical Exercises

Bayesian approaches to handling missing data: Practical Exercises Bayesian approaches to handling missing data: Practical Exercises 1 Practical A Thanks to James Carpenter and Jonathan Bartlett who developed the exercise on which this practical is based (funded by ESRC).

More information

Midterm STAT-UB.0003 Regression and Forecasting Models. I will not lie, cheat or steal to gain an academic advantage, or tolerate those who do.

Midterm STAT-UB.0003 Regression and Forecasting Models. I will not lie, cheat or steal to gain an academic advantage, or tolerate those who do. Midterm STAT-UB.0003 Regression and Forecasting Models The exam is closed book and notes, with the following exception: you are allowed to bring one letter-sized page of notes into the exam (front and

More information

Multiple Regression. James H. Steiger. Department of Psychology and Human Development Vanderbilt University

Multiple Regression. James H. Steiger. Department of Psychology and Human Development Vanderbilt University Multiple Regression James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) Multiple Regression 1 / 19 Multiple Regression 1 The Multiple

More information

Bayesian Logistic Regression Modelling via Markov Chain Monte Carlo Algorithm

Bayesian Logistic Regression Modelling via Markov Chain Monte Carlo Algorithm Journal of Social and Development Sciences Vol. 4, No. 4, pp. 93-97, Apr 203 (ISSN 222-52) Bayesian Logistic Regression Modelling via Markov Chain Monte Carlo Algorithm Henry De-Graft Acquah University

More information

Stat 13, Lab 11-12, Correlation and Regression Analysis

Stat 13, Lab 11-12, Correlation and Regression Analysis Stat 13, Lab 11-12, Correlation and Regression Analysis Part I: Before Class Objective: This lab will give you practice exploring the relationship between two variables by using correlation, linear regression

More information

What Are Your Odds? : An Interactive Web Application to Visualize Health Outcomes

What Are Your Odds? : An Interactive Web Application to Visualize Health Outcomes What Are Your Odds? : An Interactive Web Application to Visualize Health Outcomes Abstract Spreading health knowledge and promoting healthy behavior can impact the lives of many people. Our project aims

More information

Supporting Information

Supporting Information Supporting Information Baldwin and Lammers 10.1073/pnas.1610834113 SI Methods and Results The patterns of predicted results were not affected when age, race (non-white = 0, White = 1), sex (female = 0,

More information

Generalized Estimating Equations: an overview and application in IndiMed study

Generalized Estimating Equations: an overview and application in IndiMed study UNIVERSITY OF TARTU FACULTY OF SCIENCE AND TECHNOLOGY INSTITUTE OF MATHEMATICS AND STATISTICS Maia Arge Generalized Estimating Equations: an overview and application in IndiMed study Mathematical statistics

More information

The Impact of Relative Standards on the Propensity to Disclose. Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX

The Impact of Relative Standards on the Propensity to Disclose. Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX The Impact of Relative Standards on the Propensity to Disclose Alessandro Acquisti, Leslie K. John, George Loewenstein WEB APPENDIX 2 Web Appendix A: Panel data estimation approach As noted in the main

More information

Power & Sample Size. Dr. Andrea Benedetti

Power & Sample Size. Dr. Andrea Benedetti Power & Sample Size Dr. Andrea Benedetti Plan Review of hypothesis testing Power and sample size Basic concepts Formulae for common study designs Using the software When should you think about power &

More information

Design and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP I 5/2/2016

Design and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP I 5/2/2016 Design and Analysis Plan Quantitative Synthesis of Federally-Funded Teen Pregnancy Prevention Programs HHS Contract #HHSP233201500069I 5/2/2016 Overview The goal of the meta-analysis is to assess the effects

More information

Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests

Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Yemisi Takwoingi, Richard Riley and Jon Deeks Outline Rationale Methods Findings Summary Motivating

More information

Intro to SPSS. Using SPSS through WebFAS

Intro to SPSS. Using SPSS through WebFAS Intro to SPSS Using SPSS through WebFAS http://www.yorku.ca/computing/students/labs/webfas/ Try it early (make sure it works from your computer) If you need help contact UIT Client Services Voice: 416-736-5800

More information

Math 215, Lab 7: 5/23/2007

Math 215, Lab 7: 5/23/2007 Math 215, Lab 7: 5/23/2007 (1) Parametric versus Nonparamteric Bootstrap. Parametric Bootstrap: (Davison and Hinkley, 1997) The data below are 12 times between failures of airconditioning equipment in

More information

Preliminary Report on Simple Statistical Tests (t-tests and bivariate correlations)

Preliminary Report on Simple Statistical Tests (t-tests and bivariate correlations) Preliminary Report on Simple Statistical Tests (t-tests and bivariate correlations) After receiving my comments on the preliminary reports of your datasets, the next step for the groups is to complete

More information

Part 8 Logistic Regression

Part 8 Logistic Regression 1 Quantitative Methods for Health Research A Practical Interactive Guide to Epidemiology and Statistics Practical Course in Quantitative Data Handling SPSS (Statistical Package for the Social Sciences)

More information

1. Family context. a) Positive Disengaged

1. Family context. a) Positive Disengaged Online Supplementary Materials for Emotion manuscript 015-197 Emotions and Concerns: Situational Evidence for their Systematic Co-Occurrence. by Jozefien De Leersnyder, Peter Koval, Peter Kuppens, & Batja

More information

Catherine A. Welch 1*, Séverine Sabia 1,2, Eric Brunner 1, Mika Kivimäki 1 and Martin J. Shipley 1

Catherine A. Welch 1*, Séverine Sabia 1,2, Eric Brunner 1, Mika Kivimäki 1 and Martin J. Shipley 1 Welch et al. BMC Medical Research Methodology (2018) 18:89 https://doi.org/10.1186/s12874-018-0548-0 RESEARCH ARTICLE Open Access Does pattern mixture modelling reduce bias due to informative attrition

More information

Estimating Heterogeneous Choice Models with Stata

Estimating Heterogeneous Choice Models with Stata Estimating Heterogeneous Choice Models with Stata Richard Williams Notre Dame Sociology rwilliam@nd.edu West Coast Stata Users Group Meetings October 25, 2007 Overview When a binary or ordinal regression

More information

Models for HSV shedding must account for two levels of overdispersion

Models for HSV shedding must account for two levels of overdispersion UW Biostatistics Working Paper Series 1-20-2016 Models for HSV shedding must account for two levels of overdispersion Amalia Magaret University of Washington - Seattle Campus, amag@uw.edu Suggested Citation

More information

THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION

THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION Timothy Olsen HLM II Dr. Gagne ABSTRACT Recent advances

More information

Chapter 13 Estimating the Modified Odds Ratio

Chapter 13 Estimating the Modified Odds Ratio Chapter 13 Estimating the Modified Odds Ratio Modified odds ratio vis-à-vis modified mean difference To a large extent, this chapter replicates the content of Chapter 10 (Estimating the modified mean difference),

More information