Why Mixed Effects Models?

Size: px
Start display at page:

Download "Why Mixed Effects Models?"

Transcription

1 Why Mixed Effects Models?

2 Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions Iterative fitting

3 Problem One: Multiple Random Effects Most studies sample both subjects and items Subject 1 Subject 2 Knight story Monkey story

4 Problem One: Crossed Random Effects Most studies sample both subjects and items Typically, subjects crossed with items Each subject sees a version of each item May also be only partially crossed Each subject sees only some of the items

5 ...or Hierarchical Random Effects Most studies sample both subjects and items Typically, subjects crossed with items May also have one nested within the other (hierarchical) e.g. autobiographical memory How to incorporate this into model?

6 Problem One: Multiple Random Effects Why do we care about items, anyway? #1: Investigate robustness of effects across items Concern is that effect could be driven by just 1 or 2 items might not really be what we thought it was Psycholinguistics: View is that we studying language too, not just people Other areas of psychology have not tended to care about this Note: Including items in a model doesn't really confirm that the effect is robust across items. It's still possible to get a reliable effect driven by a small number of items. But it allows you investigate how variable the effect is across items and why different items might be differentially influenced.

7 Problem One: Multiple Random Effects Why do we care about items? #2: Violations of independence A BIG ISSUE Suppose Amélie and Zhenghan see items A & B but Tuan sees items C & D Likely that Amélie's results are more like Zhenghan's than like Tuan's But ANOVA assumes observations independent Even a small amount of dependency can lead to spurious results (Quene & van den Bergh, 2008) Dependency you didn't account for makes the variance look smaller than it actually is C A D B

8 What Constitutes an Item? Items assumed to be independently sampled sampled from population of relevant items 2 related words / sentences not independently sampled The coach knew you missed practice. The coach knew that you missed practice. Not a coincidence both are in your experiment! Should be considered the same item But 2 unrelated things can be different items ALL POSSIBLE DISCOURSES

9 Problem One: Crossed Random Effects ANOVA solution Subjects analysis: Average over multiple items for each subject Items analysis: Average over multiple subjects for each item Two sets of results Sometime combined with min F' An approximation of true min F Note: not real data or statistical tests F 1 = 18.31, p <.001 F 2 = 22.10, p <.0001

10 Problem One: Crossed Random Effects Some debate on how accurate min F' is Scott will admit to not be fully read up on this since I came in after people started switching to mixed effects models Somewhat less relevant now that we can use mixed effects models instead Note: not real data or statistical tests F 1 = 18.31, p <.001 F 2 = 22.10, p <.0001

11 Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions Iterative fitting

12 Problem Two: Categorical Data ANOVA assumes our response is continuous RT: 833 ms But, we often want to look at categorical data 'Lightning hit the church. vs. The church was hit by lightning. Choice of syntactic structure Item recalled or not Region fixated in eye-tracking experiment

13 Problem One: Two: Categorical Data Traditional solution: Analyze proportions Violates assumptions of ANOVA Among other issues: ANOVA assumes normal distribution, which has infinite tails But proportions are clearly bounded Model could predict impossible values like 110% But 0 proportions 1

14 Problem One: Two: Categorical Data Traditional solution: Analyze proportions Violates assumptions of ANOVA Among other issues: ANOVA assumes normal distribution, which has infinite tails But proportions are clearly bounded Model could predict impossible values like 110% But 0 proportions 1

15 Problem One: Two: Categorical Data Traditional solution: Analyze proportions Violates assumptions of ANOVA Can lead to: Spurious effects (Type I error) Missing a true effects (Type II error)

16 Problem One: Two: Categorical Data Transformations improve the situation but don't solve it Empirical logit is good (Jaeger, 2008) Arcsine less so Situation is worse for very high or very low proportions (Jaeger, 2008).30 to.70 are OK

17 Problem One: Two: Categorical Data Why can't we just use logistic regression? Predict if each trial's response is in category A or category B This is essentially what we will end up doing But, if we are looking at things at a trial-bytrial basis... Need to control for the different items on each trial Problem One again!

18 Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions Iterative fitting

19 Problem Three: Focus on Fixed Effects ANOVA doesn't characterize differences between subjects or items The bird that they spotted was a... ENDING Predictable Unpredictable MEAN READING TIME 283 ms 309 ms 26 ms We just have a mean effect No info. about how much it varies across participants or items cardinal pitohui

20 Problem Three: Focus on Fixed Effects Can try to account for some of this with an ANCOVA But not typically done And would have to be done separately for participants and items (Problem One again) Predictable Unpredictable MEAN 283 ms 309 ms 26 ms

21 Power of subjects analysis! Power of items analysis! Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focused on fixed effects Captain MLM to the rescue! What mixed effects models do Random slopes Link functions Iterative fitting

22 Mixed Effects Models to the Rescue! ANOVA: Unit of analysis is cell mean MLM: Unit of analysis is individual trial!

23 Mixed Models to the Rescue! Look at individual trials Model outcome using regression RT Semantic categorization: Is it a dinosaur? = + Subject + Item Prime? Problem One solved!

24 Mixed Models to the Rescue! This means you will need your data formatted differently than you would for an ANOVA Each trial gets its own line

25 Mixed Models to the Rescue! Is this useful for what we care about? Stereotypical view of regression is that it's about predicting values In experimental settings we more typically want to know if Variable X matters Yes! We can test individual effects: Do they contribute to the model? e.g. does priming predict something about RT? RT = + + Prime? Subject Jason Item

26 Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions Iterative fitting

27 88 ms Fixed vs. Random Slopes Fixed Slope: Same for all participants/items Random Slope: Can vary by participants/items RT = + + Prime? 26 ms + Laurel Stego.

28 315 ms Fixed vs. Random Slopes Fixed Slope: Same for all participants/items Random Slope: Can vary by participants/items RT = + + Prime? 26 ms Laurel Dr. L Example: Some items may show a larger priming effect than others +

29 Fixed vs. Random Slopes Fixed Slope: Same for all participants/items Random Slope: Can vary by participants/items Can also test what explains variation RT = + + Prime? 26 ms Laurel Dr. L e.g. Adding lexical frequency to the model may account for variation in priming effect + 15 ms + Lex.Freq. 300 ms

30 Fixed vs. Random Slopes Fixed Slope: Same for all participants/items Random Slope: Can vary by participants/items Can also test what explains variation RT = + + Prime? 26 ms Laurel Dr. L Problem Three Solved! + 15 ms + Lex.Freq. 300 ms

31 Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions Iterative fitting

32 Link Functions Specifies how to connect predictors to the outcome RT ms Prime? Every model has one... Subject...sometimes, just the identity function With Gaussian (normal) data Item

33 Link Functions Specifies how to connect predictors to the outcome Accuracy + + Yes/No Prime? Subject Item For binomial (yes/no) outcomes: Model log odds to predict outcome Problem Two solved!

34 Link Functions Default link function for binomial data is logit (log odds) Odds: p(yes)/p(no) or p(yes)/[1-p(yes)] No upper bound, but lower bound at 0 Log Odds: ln(odds) Now unbounded at both ends Can also use probit Based on cumulative distribution function of normal distribution Very highly correlated with logit; almost always give you same results as logit Probit assumes slightly fewer hits at low end of distribution & slightly more hits at high end

35 Mixed Effects Models Recap/Intro Three issues with ANOVA Multiple random effects Categorical data Focus on fixed effects What mixed effects models do Random slopes Link functions Iterative fitting

36 One Caveat... Where do model results come from? (Answer: When a design matrix and a data matrix really love each other...)

37 One Caveat... Fitting ANOVA / linear regression has easy solution b = (X'X) -1 X'Y A few matrix multiplications a computer can do easily A closed form solution Like a beta machine you put your data in and automatically get the One True Model out

38 One Caveat... MEMs requires iteration Check various sets of betas until you find the best one R does this for you An estimation Not mathematically guaranteed to be best fit The best model: The one that smiles with its eyes Complicated models take longer to fit If too many parameters relative to data, might completely fail to converge (find the best set of betas) Scott's only experience with this is with multiple random slopes of interactions

Midterm project due next Wednesday at 2 PM

Midterm project due next Wednesday at 2 PM Course Business Midterm project due next Wednesday at 2 PM Please submit on CourseWeb Next week s class: Discuss current use of mixed-effects models in the literature Short lecture on effect size & statistical

More information

11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES

11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES Correlational Research Correlational Designs Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are

More information

11/24/2017. Do not imply a cause-and-effect relationship

11/24/2017. Do not imply a cause-and-effect relationship Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection

More information

How to analyze correlated and longitudinal data?

How to analyze correlated and longitudinal data? How to analyze correlated and longitudinal data? Niloofar Ramezani, University of Northern Colorado, Greeley, Colorado ABSTRACT Longitudinal and correlated data are extensively used across disciplines

More information

m 11 m.1 > m 12 m.2 risk for smokers risk for nonsmokers

m 11 m.1 > m 12 m.2 risk for smokers risk for nonsmokers SOCY5061 RELATIVE RISKS, RELATIVE ODDS, LOGISTIC REGRESSION RELATIVE RISKS: Suppose we are interested in the association between lung cancer and smoking. Consider the following table for the whole population:

More information

The Vote! Winners. $100 Question from Ch 10 11/16/11

The Vote! Winners. $100 Question from Ch 10 11/16/11 Winners The Vote! a)! Artificial Intelligence b)! Drugs (including alcohol) and Cognition/Perception c)! Sleep and Dreaming d)! Disorders/Man Who Mistook e)! Other (Consciousness, emotion, twins, linguistic

More information

Review: Logistic regression, Gaussian naïve Bayes, linear regression, and their connections

Review: Logistic regression, Gaussian naïve Bayes, linear regression, and their connections Review: Logistic regression, Gaussian naïve Bayes, linear regression, and their connections New: Bias-variance decomposition, biasvariance tradeoff, overfitting, regularization, and feature selection Yi

More information

Lecture 21. RNA-seq: Advanced analysis

Lecture 21. RNA-seq: Advanced analysis Lecture 21 RNA-seq: Advanced analysis Experimental design Introduction An experiment is a process or study that results in the collection of data. Statistical experiments are conducted in situations in

More information

Distinguishing between Category-based and Similarity-based Induction

Distinguishing between Category-based and Similarity-based Induction Distinguishing between Category-based and Similarity-based Induction Tracey Miser (miser.4@osu.edu) Department of Psychology, 1835 Neil Avenue Columbus, OH43210 USA Vladimir Sloutsky (sloutsky.1@osu.edu)

More information

CSE 258 Lecture 2. Web Mining and Recommender Systems. Supervised learning Regression

CSE 258 Lecture 2. Web Mining and Recommender Systems. Supervised learning Regression CSE 258 Lecture 2 Web Mining and Recommender Systems Supervised learning Regression Supervised versus unsupervised learning Learning approaches attempt to model data in order to solve a problem Unsupervised

More information

Generalized Estimating Equations for Depression Dose Regimes

Generalized Estimating Equations for Depression Dose Regimes Generalized Estimating Equations for Depression Dose Regimes Karen Walker, Walker Consulting LLC, Menifee CA Generalized Estimating Equations on the average produce consistent estimates of the regression

More information

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Today s Class: Features of longitudinal data Features of longitudinal models What can MLM do for you? What to expect in this

More information

Data Analysis Using Regression and Multilevel/Hierarchical Models

Data Analysis Using Regression and Multilevel/Hierarchical Models Data Analysis Using Regression and Multilevel/Hierarchical Models ANDREW GELMAN Columbia University JENNIFER HILL Columbia University CAMBRIDGE UNIVERSITY PRESS Contents List of examples V a 9 e xv " Preface

More information

Week 12: Missing Data

Week 12: Missing Data Week 12: Missing Data! Rank Deficiency! Linear Combinations! Incomplete Designs! Empirical Logit! Missing Data (NA values)! Intro! Types of Missingness! Non-Ignorable! Ignorable! Summary! Possible Solutions!

More information

Statistical reports Regression, 2010

Statistical reports Regression, 2010 Statistical reports Regression, 2010 Niels Richard Hansen June 10, 2010 This document gives some guidelines on how to write a report on a statistical analysis. The document is organized into sections that

More information

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data

Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Introduction to Multilevel Models for Longitudinal and Repeated Measures Data Today s Class: Features of longitudinal data Features of longitudinal models What can MLM do for you? What to expect in this

More information

Small Group Presentations

Small Group Presentations Admin Assignment 1 due next Tuesday at 3pm in the Psychology course centre. Matrix Quiz during the first hour of next lecture. Assignment 2 due 13 May at 10am. I will upload and distribute these at the

More information

Selection and Combination of Markers for Prediction

Selection and Combination of Markers for Prediction Selection and Combination of Markers for Prediction NACC Data and Methods Meeting September, 2010 Baojiang Chen, PhD Sarah Monsell, MS Xiao-Hua Andrew Zhou, PhD Overview 1. Research motivation 2. Describe

More information

TITLE: Acquisition and generalization responses in aphasia treatment: Evidence from sentence-production treatment

TITLE: Acquisition and generalization responses in aphasia treatment: Evidence from sentence-production treatment TITLE: Acquisition and generalization responses in aphasia treatment: Evidence from sentence-production treatment INTRODUCTION Treatment of Underlying Forms (TUF) promotes not only acquisition of treated

More information

CSE 258 Lecture 1.5. Web Mining and Recommender Systems. Supervised learning Regression

CSE 258 Lecture 1.5. Web Mining and Recommender Systems. Supervised learning Regression CSE 258 Lecture 1.5 Web Mining and Recommender Systems Supervised learning Regression What is supervised learning? Supervised learning is the process of trying to infer from labeled data the underlying

More information

Fundamental Concepts for Using Diagnostic Classification Models. Section #2 NCME 2016 Training Session. NCME 2016 Training Session: Section 2

Fundamental Concepts for Using Diagnostic Classification Models. Section #2 NCME 2016 Training Session. NCME 2016 Training Session: Section 2 Fundamental Concepts for Using Diagnostic Classification Models Section #2 NCME 2016 Training Session NCME 2016 Training Session: Section 2 Lecture Overview Nature of attributes What s in a name? Grain

More information

Page 1 of 6 More Log increate an Account April 26, 2012 Edition: U.S. CA Canada Québec FR France US United States UK United Kingdom 18k Page 2 of 6 Follow chronic conditions, Cancer, Health Care, Health

More information

Study Guide #2: MULTIPLE REGRESSION in education

Study Guide #2: MULTIPLE REGRESSION in education Study Guide #2: MULTIPLE REGRESSION in education What is Multiple Regression? When using Multiple Regression in education, researchers use the term independent variables to identify those variables that

More information

Index. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI /

Index. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI / Index A Adjusted Heterogeneity without Overdispersion, 63 Agenda-driven bias, 40 Agenda-Driven Meta-Analyses, 306 307 Alternative Methods for diagnostic meta-analyses, 133 Antihypertensive effect of potassium,

More information

3 CONCEPTUAL FOUNDATIONS OF STATISTICS

3 CONCEPTUAL FOUNDATIONS OF STATISTICS 3 CONCEPTUAL FOUNDATIONS OF STATISTICS In this chapter, we examine the conceptual foundations of statistics. The goal is to give you an appreciation and conceptual understanding of some basic statistical

More information

Media, Discussion and Attitudes Technical Appendix. 6 October 2015 BBC Media Action Andrea Scavo and Hana Rohan

Media, Discussion and Attitudes Technical Appendix. 6 October 2015 BBC Media Action Andrea Scavo and Hana Rohan Media, Discussion and Attitudes Technical Appendix 6 October 2015 BBC Media Action Andrea Scavo and Hana Rohan 1 Contents 1 BBC Media Action Programming and Conflict-Related Attitudes (Part 5a: Media and

More information

Making comparisons. Previous sessions looked at how to describe a single group of subjects However, we are often interested in comparing two groups

Making comparisons. Previous sessions looked at how to describe a single group of subjects However, we are often interested in comparing two groups Making comparisons Previous sessions looked at how to describe a single group of subjects However, we are often interested in comparing two groups Data can be interpreted using the following fundamental

More information

THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION

THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION Timothy Olsen HLM II Dr. Gagne ABSTRACT Recent advances

More information

Categorization and Memory: Representation of Category Information Increases Memory Intrusions

Categorization and Memory: Representation of Category Information Increases Memory Intrusions Categorization and Memory: Representation of Category Information Increases Memory Intrusions Anna V. Fisher (fisher.449@osu.edu) Department of Psychology & Center for Cognitive Science Ohio State University

More information

Exemplars in Syntax: Evidence from Priming

Exemplars in Syntax: Evidence from Priming Exemplars in Syntax: Evidence from Priming Neal Snider, Dept. of Linguistics, Stanford University ESSLLI Workshop on Exemplar-based Models August 15, 2007 Hypothesis What do exemplar models predict about

More information

Use of GEEs in STATA

Use of GEEs in STATA Use of GEEs in STATA 1. When generalised estimating equations are used and example 2. Stata commands and options for GEEs 3. Results from Stata (and SAS!) 4. Another use of GEEs Use of GEEs GEEs are one

More information

Fitting discrete-data regression models in social science

Fitting discrete-data regression models in social science Fitting discrete-data regression models in social science Andrew Gelman Dept. of Statistics and Dept. of Political Science Columbia University For Greg Wawro sclass, 7 Oct 2010 Today s class Example: wells

More information

Stepwise method Modern Model Selection Methods Quantile-Quantile plot and tests for normality

Stepwise method Modern Model Selection Methods Quantile-Quantile plot and tests for normality Week 9 Hour 3 Stepwise method Modern Model Selection Methods Quantile-Quantile plot and tests for normality Stat 302 Notes. Week 9, Hour 3, Page 1 / 39 Stepwise Now that we've introduced interactions,

More information

Language: English Course level: Doctoral level

Language: English Course level: Doctoral level Course Description: Bayesian data analysis and multilevel modeling 7.5hp Course leader Marco Tullio Liuzza Phone: 08-164601 Teachers Marco Tullio Liuzza Phone: 08-164601 Mats Nilsson Phone: 08-16 46 05

More information

Clincial Biostatistics. Regression

Clincial Biostatistics. Regression Regression analyses Clincial Biostatistics Regression Regression is the rather strange name given to a set of methods for predicting one variable from another. The data shown in Table 1 and come from a

More information

Regression so far... Lecture 22 - Logistic Regression. Odds. Recap of what you should know how to do... At this point we have covered: Sta102 / BME102

Regression so far... Lecture 22 - Logistic Regression. Odds. Recap of what you should know how to do... At this point we have covered: Sta102 / BME102 Background Regression so far... Lecture 22 - Sta102 / BME102 Colin Rundel November 23, 2015 At this point we have covered: Simple linear regression Relationship between numerical response and a numerical

More information

Statistical Techniques. Masoud Mansoury and Anas Abulfaraj

Statistical Techniques. Masoud Mansoury and Anas Abulfaraj Statistical Techniques Masoud Mansoury and Anas Abulfaraj What is Statistics? https://www.youtube.com/watch?v=lmmzj7599pw The definition of Statistics The practice or science of collecting and analyzing

More information

The random variable must be a numeric measure resulting from the outcome of a random experiment.

The random variable must be a numeric measure resulting from the outcome of a random experiment. Now we will define, discuss, and apply random variables. This will utilize and expand upon what we have already learned about probability and will be the foundation of the bridge between probability and

More information

Artificial intelligence and judicial systems: The so-called predictive justice. 20 April

Artificial intelligence and judicial systems: The so-called predictive justice. 20 April Artificial intelligence and judicial systems: The so-called predictive justice 20 April 2018 1 Context The use of so-called artificielle intelligence received renewed interest over the past years.. Stakes

More information

Intelligent Systems. Discriminative Learning. Parts marked by * are optional. WS2013/2014 Carsten Rother, Dmitrij Schlesinger

Intelligent Systems. Discriminative Learning. Parts marked by * are optional. WS2013/2014 Carsten Rother, Dmitrij Schlesinger Intelligent Systems Discriminative Learning Parts marked by * are optional 30/12/2013 WS2013/2014 Carsten Rother, Dmitrij Schlesinger Discriminative models There exists a joint probability distribution

More information

MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES OBJECTIVES

MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES OBJECTIVES 24 MULTIPLE LINEAR REGRESSION 24.1 INTRODUCTION AND OBJECTIVES In the previous chapter, simple linear regression was used when you have one independent variable and one dependent variable. This chapter

More information

IAPT: Regression. Regression analyses

IAPT: Regression. Regression analyses Regression analyses IAPT: Regression Regression is the rather strange name given to a set of methods for predicting one variable from another. The data shown in Table 1 and come from a student project

More information

MS&E 226: Small Data

MS&E 226: Small Data MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector

More information

Dan Byrd UC Office of the President

Dan Byrd UC Office of the President Dan Byrd UC Office of the President 1. OLS regression assumes that residuals (observed value- predicted value) are normally distributed and that each observation is independent from others and that the

More information

Modeling Binary outcome

Modeling Binary outcome Statistics April 4, 2013 Debdeep Pati Modeling Binary outcome Test of hypothesis 1. Is the effect observed statistically significant or attributable to chance? 2. Three types of hypothesis: a) tests of

More information

Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests

Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Empirical assessment of univariate and bivariate meta-analyses for comparing the accuracy of diagnostic tests Yemisi Takwoingi, Richard Riley and Jon Deeks Outline Rationale Methods Findings Summary Motivating

More information

Political Science 15, Winter 2014 Final Review

Political Science 15, Winter 2014 Final Review Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically

More information

Mantel-Haenszel Procedures for Detecting Differential Item Functioning

Mantel-Haenszel Procedures for Detecting Differential Item Functioning A Comparison of Logistic Regression and Mantel-Haenszel Procedures for Detecting Differential Item Functioning H. Jane Rogers, Teachers College, Columbia University Hariharan Swaminathan, University of

More information

Business Statistics Probability

Business Statistics Probability Business Statistics The following was provided by Dr. Suzanne Delaney, and is a comprehensive review of Business Statistics. The workshop instructor will provide relevant examples during the Skills Assessment

More information

Fundamental Clinical Trial Design

Fundamental Clinical Trial Design Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003

More information

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA

Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA PharmaSUG 2014 - Paper SP08 Methodology for Non-Randomized Clinical Trials: Propensity Score Analysis Dan Conroy, Ph.D., inventiv Health, Burlington, MA ABSTRACT Randomized clinical trials serve as the

More information

The Lens Model and Linear Models of Judgment

The Lens Model and Linear Models of Judgment John Miyamoto Email: jmiyamot@uw.edu October 3, 2017 File = D:\P466\hnd02-1.p466.a17.docm 1 http://faculty.washington.edu/jmiyamot/p466/p466-set.htm Psych 466: Judgment and Decision Making Autumn 2017

More information

Biostatistics II

Biostatistics II Biostatistics II 514-5509 Course Description: Modern multivariable statistical analysis based on the concept of generalized linear models. Includes linear, logistic, and Poisson regression, survival analysis,

More information

EPSE 594: Meta-Analysis: Quantitative Research Synthesis

EPSE 594: Meta-Analysis: Quantitative Research Synthesis EPSE 594: Meta-Analysis: Quantitative Research Synthesis Ed Kroc University of British Columbia ed.kroc@ubc.ca March 14, 2019 Ed Kroc (UBC) EPSE 594 March 14, 2019 1 / 39 Last Time Synthesizing multiple

More information

Analyzing binary outcomes, going beyond logistic regression

Analyzing binary outcomes, going beyond logistic regression Analyzing binary outcomes, going beyond logistic regression 2018 EHE Forum presentation James O. Uanhoro Department of Educational Studies Premise Obtaining relative risk using Poisson regression Obtaining

More information

(C) Jamalludin Ab Rahman

(C) Jamalludin Ab Rahman SPSS Note The GLM Multivariate procedure is based on the General Linear Model procedure, in which factors and covariates are assumed to have a linear relationship to the dependent variable. Factors. Categorical

More information

CHAPTER TWO REGRESSION

CHAPTER TWO REGRESSION CHAPTER TWO REGRESSION 2.0 Introduction The second chapter, Regression analysis is an extension of correlation. The aim of the discussion of exercises is to enhance students capability to assess the effect

More information

Controlling Bias & Confounding

Controlling Bias & Confounding Controlling Bias & Confounding Chihaya Koriyama August 5 th, 2015 QUESTIONS FOR BIAS Key concepts Bias Should be minimized at the designing stage. Random errors We can do nothing at Is the nature the of

More information

Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data

Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data TECHNICAL REPORT Data and Statistics 101: Key Concepts in the Collection, Analysis, and Application of Child Welfare Data CONTENTS Executive Summary...1 Introduction...2 Overview of Data Analysis Concepts...2

More information

Explanatory Latent Trait Models: A Tale of Two Studies

Explanatory Latent Trait Models: A Tale of Two Studies Explanatory Latent Trait Models: A Tale of Two Studies Lesa Hoffman Associate Professor, Child Language Doctoral Program Associate Scientist, Research Design and Analysis Unit Schiefelbusch Institute for

More information

THE STATSWHISPERER. Introduction to this Issue. Binary Logistic Regression: The Rock Star of Regression

THE STATSWHISPERER. Introduction to this Issue. Binary Logistic Regression: The Rock Star of Regression Spri ng 2 01 3, V o l u m e 3, I s su e 1 + THE STATSWHISPERER The StatsWhisperer Newsletter is published by Dr. William Bannon and the staff at StatsWhisperer. For other resources in learning statistics

More information

Bayesian and Frequentist Approaches

Bayesian and Frequentist Approaches Bayesian and Frequentist Approaches G. Jogesh Babu Penn State University http://sites.stat.psu.edu/ babu http://astrostatistics.psu.edu All models are wrong But some are useful George E. P. Box (son-in-law

More information

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo Business Statistics The following was provided by Dr. Suzanne Delaney, and is a comprehensive review of Business Statistics. The workshop instructor will provide relevant examples during the Skills Assessment

More information

A Race Model of Perceptual Forced Choice Reaction Time

A Race Model of Perceptual Forced Choice Reaction Time A Race Model of Perceptual Forced Choice Reaction Time David E. Huber (dhuber@psyc.umd.edu) Department of Psychology, 1147 Biology/Psychology Building College Park, MD 2742 USA Denis Cousineau (Denis.Cousineau@UMontreal.CA)

More information

The Simulacrum. What is it, how is it created, how does it work? Michael Eden on behalf of Sally Vernon & Cong Chen NAACCR 21 st June 2017

The Simulacrum. What is it, how is it created, how does it work? Michael Eden on behalf of Sally Vernon & Cong Chen NAACCR 21 st June 2017 The Simulacrum What is it, how is it created, how does it work? Michael Eden on behalf of Sally Vernon & Cong Chen NAACCR 21 st June 2017 sally.vernon@phe.gov.uk & cong.chen@phe.gov.uk 1 Overview What

More information

In this module I provide a few illustrations of options within lavaan for handling various situations.

In this module I provide a few illustrations of options within lavaan for handling various situations. In this module I provide a few illustrations of options within lavaan for handling various situations. An appropriate citation for this material is Yves Rosseel (2012). lavaan: An R Package for Structural

More information

Recognizing Ambiguity

Recognizing Ambiguity Recognizing Ambiguity How Lack of Information Scares Us Mark Clements Columbia University I. Abstract In this paper, I will examine two different approaches to an experimental decision problem posed by

More information

Animal Cognition. Introduction to Cognitive Science

Animal Cognition. Introduction to Cognitive Science Animal Cognition Introduction to Cognitive Science Intelligent Animals? Parrot Intelligence Crow Intelligence I Crow Intelligence II Cow Intelligence Orca Intelligence Dolphin Play Funny Animal Intelligence

More information

Available from Deakin Research Online:

Available from Deakin Research Online: This is the published version: Richardson, Ben and Fuller Tyszkiewicz, Matthew 2014, The application of non linear multilevel models to experience sampling data, European health psychologist, vol. 16,

More information

Reflection Questions for Math 58B

Reflection Questions for Math 58B Reflection Questions for Math 58B Johanna Hardin Spring 2017 Chapter 1, Section 1 binomial probabilities 1. What is a p-value? 2. What is the difference between a one- and two-sided hypothesis? 3. What

More information

Part 1. For each of the following questions fill-in the blanks. Each question is worth 2 points.

Part 1. For each of the following questions fill-in the blanks. Each question is worth 2 points. Part 1. For each of the following questions fill-in the blanks. Each question is worth 2 points. 1. The bell-shaped frequency curve is so common that if a population has this shape, the measurements are

More information

Selected Topics in Biostatistics Seminar Series. Missing Data. Sponsored by: Center For Clinical Investigation and Cleveland CTSC

Selected Topics in Biostatistics Seminar Series. Missing Data. Sponsored by: Center For Clinical Investigation and Cleveland CTSC Selected Topics in Biostatistics Seminar Series Missing Data Sponsored by: Center For Clinical Investigation and Cleveland CTSC Brian Schmotzer, MS Biostatistician, CCI Statistical Sciences Core brian.schmotzer@case.edu

More information

Statistical analysis supporting the development of the guidance on dermal absorption

Statistical analysis supporting the development of the guidance on dermal absorption Statistical analysis supporting the development of the guidance on dermal absorption Peter Craig (Gilles Guillot, EFSA) Durham University United Kingdom 27 September, 2017 Variability of percentage absorbed

More information

9 research designs likely for PSYC 2100

9 research designs likely for PSYC 2100 9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one

More information

You must answer question 1.

You must answer question 1. Research Methods and Statistics Specialty Area Exam October 28, 2015 Part I: Statistics Committee: Richard Williams (Chair), Elizabeth McClintock, Sarah Mustillo You must answer question 1. 1. Suppose

More information

Running head: INDIVIDUAL DIFFERENCES 1. Why to treat subjects as fixed effects. James S. Adelman. University of Warwick.

Running head: INDIVIDUAL DIFFERENCES 1. Why to treat subjects as fixed effects. James S. Adelman. University of Warwick. Running head: INDIVIDUAL DIFFERENCES 1 Why to treat subjects as fixed effects James S. Adelman University of Warwick Zachary Estes Bocconi University Corresponding Author: James S. Adelman Department of

More information

STA 3024 Spring 2013 EXAM 3 Test Form Code A UF ID #

STA 3024 Spring 2013 EXAM 3 Test Form Code A UF ID # STA 3024 Spring 2013 Name EXAM 3 Test Form Code A UF ID # Instructions: This exam contains 34 Multiple Choice questions. Each question is worth 3 points, for a total of 102 points (there are TWO bonus

More information

The Law of Attraction Myth Free Report

The Law of Attraction Myth Free Report The Law of Attraction Myth Free Report From www.manifestationintelligence.com Please pass this e-book to all your friends so that they may benefit from the knowledge. This E-book Is Dedicated To You: Where

More information

VARIABLES AND MEASUREMENT

VARIABLES AND MEASUREMENT ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 16A LECTURE NOTES [01/29/16] VARIABLES AND MEASUREMENT AGE 1 Topic #3 VARIABLES AND MEASUREMENT VARIABLES Some definitions of variables include the following: 1.

More information

Numerical Integration of Bivariate Gaussian Distribution

Numerical Integration of Bivariate Gaussian Distribution Numerical Integration of Bivariate Gaussian Distribution S. H. Derakhshan and C. V. Deutsch The bivariate normal distribution arises in many geostatistical applications as most geostatistical techniques

More information

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8 Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to

More information

SPSS output for 420 midterm study

SPSS output for 420 midterm study Ψ Psy Midterm Part In lab (5 points total) Your professor decides that he wants to find out how much impact amount of study time has on the first midterm. He randomly assigns students to study for hours,

More information

Relational Versus Attributional Mode of Problem Solving?

Relational Versus Attributional Mode of Problem Solving? Relational Versus Attributional Mode of Problem Solving? Svetoslav Bliznashki (valsotevs@gmail.com) New Bulgarian University, 2 Montevideo Street Sofia 1618, Bulgaria Boicho Kokinov (bkokinov@nbu.bg) New

More information

ε error εˆ ~ Greenhouse Geisser correction (see p. 25) ε Huynh Feldt correction (see p. 25)

ε error εˆ ~ Greenhouse Geisser correction (see p. 25) ε Huynh Feldt correction (see p. 25) 9: Glossary 14 9 Glossary Symbols: implies is equivalent to x mean of a set of values of x ε error εˆ ~ Greenhouse Geisser correction (see p. 5) ε Huynh Feldt correction (see p. 5) µ mean ρ population

More information

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 Exam policy: This exam allows two one-page, two-sided cheat sheets (i.e. 4 sides); No other materials. Time: 2 hours. Be sure to write

More information

Ecological Statistics

Ecological Statistics A Primer of Ecological Statistics Second Edition Nicholas J. Gotelli University of Vermont Aaron M. Ellison Harvard Forest Sinauer Associates, Inc. Publishers Sunderland, Massachusetts U.S.A. Brief Contents

More information

Psychology 205, Revelle, Fall 2014 Research Methods in Psychology Mid-Term. Name:

Psychology 205, Revelle, Fall 2014 Research Methods in Psychology Mid-Term. Name: Name: 1. (2 points) What is the primary advantage of using the median instead of the mean as a measure of central tendency? It is less affected by outliers. 2. (2 points) Why is counterbalancing important

More information

Limited dependent variable regression models

Limited dependent variable regression models 181 11 Limited dependent variable regression models In the logit and probit models we discussed previously the dependent variable assumed values of 0 and 1, 0 representing the absence of an attribute and

More information

Still important ideas

Still important ideas Readings: OpenStax - Chapters 1 13 & Appendix D & E (online) Plous Chapters 17 & 18 - Chapter 17: Social Influences - Chapter 18: Group Judgments and Decisions Still important ideas Contrast the measurement

More information

Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 2000: Page 1:

Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 2000: Page 1: Research Methods 1 Handouts, Graham Hole,COGS - version 10, September 000: Page 1: T-TESTS: When to use a t-test: The simplest experimental design is to have two conditions: an "experimental" condition

More information

Can Angioplasty Improve Quality of Life for CAD Patients?

Can Angioplasty Improve Quality of Life for CAD Patients? Transcript Details This is a transcript of an educational program accessible on the ReachMD network. Details about the program and additional media formats for the program are accessible by visiting: https://reachmd.com/programs/clinicians-roundtable/can-angioplasty-improve-quality-of-life-for-cadpatients/4000/

More information

THE STATSWHISPERER. Introduction to this Issue. Doing Your Data Analysis INSIDE THIS ISSUE

THE STATSWHISPERER. Introduction to this Issue. Doing Your Data Analysis INSIDE THIS ISSUE Spring 20 11, Volume 1, Issue 1 THE STATSWHISPERER The StatsWhisperer Newsletter is published by staff at StatsWhisperer. Visit us at: www.statswhisperer.com Introduction to this Issue The current issue

More information

The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation Multivariate Analysis of Variance

The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation Multivariate Analysis of Variance The SAGE Encyclopedia of Educational Research, Measurement, Multivariate Analysis of Variance Contributors: David W. Stockburger Edited by: Bruce B. Frey Book Title: Chapter Title: "Multivariate Analysis

More information

Poisson regression. Dae-Jin Lee Basque Center for Applied Mathematics.

Poisson regression. Dae-Jin Lee Basque Center for Applied Mathematics. Dae-Jin Lee dlee@bcamath.org Basque Center for Applied Mathematics http://idaejin.github.io/bcam-courses/ D.-J. Lee (BCAM) Intro to GLM s with R GitHub: idaejin 1/40 Modeling count data Introduction Response

More information

INTRODUCTION TO STATISTICS SORANA D. BOLBOACĂ

INTRODUCTION TO STATISTICS SORANA D. BOLBOACĂ INTRODUCTION TO STATISTICS SORANA D. BOLBOACĂ OBJECTIVES Definitions Stages of Scientific Knowledge Quantification and Accuracy Types of Medical Data Population and sample Sampling methods DEFINITIONS

More information

Lec 02: Estimation & Hypothesis Testing in Animal Ecology

Lec 02: Estimation & Hypothesis Testing in Animal Ecology Lec 02: Estimation & Hypothesis Testing in Animal Ecology Parameter Estimation from Samples Samples We typically observe systems incompletely, i.e., we sample according to a designed protocol. We then

More information

Statistical questions for statistical methods

Statistical questions for statistical methods Statistical questions for statistical methods Unpaired (two-sample) t-test DECIDE: Does the numerical outcome have a relationship with the categorical explanatory variable? Is the mean of the outcome the

More information

Ingredients of Difficult Conversations

Ingredients of Difficult Conversations Ingredients of Difficult Conversations Differing Perceptions In most difficult conversations, there are different perceptions of the same reality. I think I'm right and the person with whom I disagree

More information