Instrument equivalence across ethnic groups. Antonio Olmos (MHCD) Susan R. Hutchinson (UNC)
|
|
- Jonathan Robinson
- 5 years ago
- Views:
Transcription
1 Instrument equivalence across ethnic groups Antonio Olmos (MHCD) Susan R. Hutchinson (UNC)
2 Overview Instrument Equivalence Measurement Invariance Invariance in Reliability Scores Factorial Invariance Item Response Theory The study Sample Instrument Methods Results Future directions
3 Importance of Cross-cultural Measurement Equivalence Standardized psychological measurement instruments must provide equivalent measurement across subpopulations if comparative statements are to have substantive import. Without equivalent measurement, observed scores are not directly comparable (Drasgow & Kanfer, 1985)
4 How is cross-cultural equivalence manifested? Test scores from a given measure should be equally accurate for different groups this means that reliability coefficients should be the same for all groups The factor structure on a given instrument should be the same for all relevant groups e.g., if depression has 2 subdomains, it should have 2 subdomains for all cultural subgroups
5 equivalence -- cont d Each item on a particular instrument should mean the same thing to people from different cultural groups i.e., a psychological test that lacks item equivalence is in essence two different tests; one for each cultural group
6 When do we achieve Instrument Equivalence? Meaningful comparisons across different cultures cannot be guaranteed unless we have: Construct congruence: the factor structure of the instruments is the same across different cultures Scalar equivalence: the numbers assigned to the items have the same meaning in the different cultures
7 What if we are not using questionnaires? Belief that etiology, expression, course, and outcome were universal and independent of cultural factors. Now, it is assumed that culture can play a role in psychopathology by: Determining standards of normality Creating personality configurations that may look like pathological in one culture but not in another
8 Even when using behavioral scores, we could face cross-cultural biases Normal behaviors in one culture can be classified as pathological in other Dependency in Japan is valued, whereas in America it has negative connotations Culturally different individuals are not adequately represented in the norm groups Classifying individuals of different cultures as pathological, based on norms may lead to tragedy
9 Instrument Equivalence in Mental Health Use of behavior rating scales where rater and ratee come from different cultures If cross-cultural differences result in biased ratings, then scales are not diagnostically valid for those groups May suggest the need to generate norms for different cultures Development of models to study the factor structure of the measure across different cultures
10 Measurement Invariance Whether or not, under different conditions of observing a phenomena, measurement operations yield measurement of the same attribute If there is evidence of variability, findings of differences between individuals and groups cannot be unambiguously interpreted Differences in means can be just as easily interpreted as indicating that different things were measured Association between variables will be for different attributes for different groups
11 Reliability Estimates Reflect consistency of responses For clinical instruments, internal consistency reliability, as measured by Cronbach s, reflects the consistency of ratings provided by clinicians for a given client, assuming all items on the measure are measuring the same trait
12 Invariance in reliability scores Technically, a reliability is r 2, therefore, we could treat them as correlation scores and use a Z-score to test differences between groups: 1 Zr1_white. 2 ( ln( 1 corr1_wh ) ln( 1 corr1_wh ) ) se_wh_aa 1 n_wh 3 1 n_aa 3 Z_test_wh_aa_1 Zr1_white se_wh_aa Zr1_aa
13 Factorial Invariance Another way to test measurement invariance is FACTORIAL INVARIANCE The main question it addresses: Do the items making a particular measuring instrument operate equivalently across different populations (e.g., White and Hispanics)? The measurement model is group-invariant Tests for Factorial Invariance (in order of difficulty):
14 Steps in Factor Invariance testing (1) 1 Equivalent Factor structure Same number of factors, items associated with the same factors (Structural model invariance) 2 Equivalent Factor loading paths Factor loadings are identical for every item and every factor
15 Steps in Factor Invariance testing (2) 3 Equivalent Factor variance/covariance Variances and Covariances (correlations) among factors are the same across populations 4 Equivalent Item reliabilities Residuals for every item are the same across populations
16 Testing item equivalence Although there are a number of possible methods for testing item equivalence across groups, in our study, we used Rasch modeling to assess differences in item parameters Rasch modeling is one of many types of Item Response Theory models
17 What is Item Response Theory? Item Response Theory (IRT) is a method for providing information about items on a particular instrument as well as scores for persons responding to the items Historically, IRT has been used primarily by testing companies on aptitude and achievement tests to determine how difficult the items are to determine how well the items discriminate between people of high versus low ability
18 IRT cont d More recently, IRT has been applied to rating scales with much of the rating scale analyses conducted using the Rasch model the Rasch model has a number of favorable characteristics including requiring fewer subjects
19 What does the Rasch analysis tell us about rating scales? It provides difficulty indices for each item that indicate how relatively easy or difficult it is for a given individual to receive a high rating on a clinical scale to measure some type of dysfunction, for example, an easy item suggests that even for clients with low levels of dysfunction, they have a high probability of receiving a high rating a difficult item would require much higher levels of dysfunction in order to receive a high rating
20 Rasch cont d Rasch analysis also provides ability scores for the people responding to the items high scores indicate higher levels of the trait being measured on a clinical scale measuring levels of dysfunction, high scores would indicate greater levels of dysfunction Rasch analysis also provides a map comparing the item difficulties versus person abilities for a given group of items and persons this information is useful in determining how appropriate the test is for that group of individuals a good instrument has items that match the level of dysfunction for that group
21 How is Rasch analysis used in assessing item equivalence? The difficulty indices for different groups can be compared to determine if ratings are being applied in the same way across groups The approach we selected was to compute standardized differences (z-test) between items, with a cutoff value of + or 1.96 suggesting substantial difference Large differences suggest that rating values on that item tend to be higher for clients in one cultural group than in the other, despite their having equal levels of dysfunction such a difference suggests potential bias in ratings
22 The Study Instrument Equivalence in a sample of children with Mental Health Illness Evaluated using Colorado Client Assessment Record (CCAR) Three different Ethnic groups: White/Caucasian, African-American, Hispanic
23 The sample 317 children enrolled at the Mental Health Corporation of Denver between 2000 and 2001 (134 White/Caucasian, 99 African American, 84 Hispanic) Ages between 4 and 15 years old (M = 13.7, SD = 2.9) 96.7% had English as primary language; 3.3% had Spanish as primary language Primary diagnosis: Major Depression
24 The Instrument Colorado Client Assessment Record Problem Severity Scales only Items: Thought Process, Manic Issues, Suicide- Danger Self, Cognitive Problems, Anxiety, Attention Problems, Depressive issues, Emotional Withdrawal, Family issues & problems, Role, Resistiveness, Legal, Aggressive-Danger others, Socialization Issues, Security-Management issues, Interpersonal, Medical-physical, Self Care- Basic needs
25 Method Exploratory Factor Analysis (EFA) All 317 kids PC and PFA, with Promax Rotation to allow correlation among factors Reliability analysis to explore fit (by ethnicity) Factorial Invariance using Confirmatory Factor Analysis based on EFA (entire sample & by ethnicity) Item Response Theory (IRT, or Rasch) Model (by ethnicity)
26 Exploratory Factor Analysis EVERYBODY WHITE-CAUCASSIAN HISPANIC Thought Process Manic Issues Suicide-Danger Self Cognitive Problems Anxiety Attention Problems Depressive issues Emotional Withdrawal Family issues & problems Role Resistiveness Legal Aggresive-Danger others Socialization Issues Security-Management issues Interpersonal Medical-physical Self Care-Basic needs
27 Confirmatory Factor Analysis After requesting advice from clinicians, we reduced the original model from 18 items to 9 Items left out did not contribute to the diagnosis, especially in children Fit of the CFA kept blowing up More information about this when we talk about Item Response Theory
28 Model used for Factor Invariance Socialization Viol-other Interpersonal Cognitive Security-mgmt Factor 1 Factor 2 Emotional wthd Anxiety Depression Suicide
29 Results Reliability Analysis White/Caucasian African American Hispanic Factor Factor Z-test Reliabilities White-African American White-Hispanic African American- Hispanic Factor Factor
30 Results Factorial Invariance Model χ 2 df χ 2 df RMSEA GFI CFI 1) Number of factors invariant ) Model (1) with pattern of factor loadings held invariant (Lambda-X Invariant) 3) Model (2) with factor variances and covariances held invariant (PHI- Invariant) 4) Model (3) with factor invariance of item-pair reliabilities (Theta-Delta- Invariant) # * * p < 0.05 # p < 0.01
31 χ 2 (Chi-Square): in this context, it tests the closeness of fit between the unrestricted sample covariance matrix and the restricted (model) covariance matrix. Very sensitive to sample size: The statistic will be significant when the model fits approximately in the population and the sample size is large. RMSEA (Root Mean Square Error of Approximation): Analyzes the discrepancies between observed and implied covariance matrices. Lower bound of zero indicates perfect fit with values increasing as the fit deteriorates. Suggested that values below 0.1 indicate a good fit to the data, and values below 0.05 indicate a very good fit. It is recommended not to use models with RMSEA values larger than 0.1 GFI (Goodness of Fit Index): Analogous to R 2 in that it indicates the proportion of variance explained by the model. Oscillates between 0 and 1 with values exceeding 0.9 indicating a good fit to the data. CFI (Comparative Fit Index): Indicates the proportion of improvement of the overall fit compared to a null (independent) model. Sample size independent, and penalizes for model complexity. It uses a 0-1 norm, with 1 indicating perfect fit. Values of about 0.9 or higher reflect a good fit.
32 Tables Z-test comparison The formula used to obtain the z scores is z = ( d 1 ( s d 2 s ) 2 2 ) Note that zwb = difference between White and Black estimates, zwh = difference between White and Hispanic estimates, and zbh = difference between Black and Hispanic estimates.
33 Standardized differences between difficulty estimates for each pair of ethnic groups across all 18 items ZWB ZWH ZBH MEDICAL-PHYSICAL SELF-CARE BASIC NEEDS THOUGHT LEGAL MANIC ISSUES SUICIDE-DANGER SELF VIOLENCE-DANGER OTHERS COGNITIVE SECURITY MANAGEMENT SOCIALIZATION ISSUES ANXIETY ROLE INTERPERSONAL EMOTIONAL WITHDRAWAL DEPRESSION FAMILY ISSUES RESISTIVENESS ATTENTION PROBLEMS
34 Standardized mean differences for the final 9 items ZWB ZWH ZBH SUICIDE-DANGER SELF VIOLENCE-DANGER OTHERS COGNITIVE SECURITY MANAGEMENT SOCIALIZATION ISSUES ANXIETY INTERPERSONAL EMOTIONAL WITHDRAWAL DEPRESSION
35 WHITE/CAUCASIAN KIDS ALL 18 ITEMS INPUT: 134 PERSONS, 18 ITEMS ANALYZED: 132 PERSONS, 18 ITEMS, 9 CATS v PERSONS MAP OF ITEMS <frequ> <less> 1. + T MEDICAL-PHYS SELF-CARE THOUGHT-PROCESS S. MANIC-ISS LEGAL SUICIDE VIOLENCE-D-OTHERS COGNITIVE. T SECURITY-MGM 0.# +M # ATTENTION-PRB RESISTIVENESS ## SOCIALIZATION ## ANXIETY ROLE.### S S EMOTIONAL-WTHD INTERPERSONAL. ###### ### DEPRESSION #####.#### T FAMILY-ISSUES -1 ######## M+ #####.#### #### #### ### S.#.#.## -2. T # + <rare> <more>
36 Conclusions The CCAR appears to have comparable reliability across ethnic groups based on the test we used however, there is a more optimal test of reliability differences The results also indicate equal factor structure for depression However, at the item level, there is evidence to suggest that some items are operating differently across ethnic groups based on different loadings based on different difficulty indices
37 Future directions Redo reliability comparisons using the more optimal test Increase N to see if the model holds Replicate the study using a different primary diagnosis Study potential effects of secondary diagnosis Compare findings for depressed children with depressed adults Examine potential gender differences
The MHSIP: A Tale of Three Centers
The MHSIP: A Tale of Three Centers P. Antonio Olmos-Gallo, Ph.D. Kathryn DeRoche, M.A. Mental Health Center of Denver Richard Swanson, Ph.D., J.D. Aurora Research Institute John Mahalik, Ph.D., M.P.A.
More informationThe Psychometric Development Process of Recovery Measures and Markers: Classical Test Theory and Item Response Theory
The Psychometric Development Process of Recovery Measures and Markers: Classical Test Theory and Item Response Theory Kate DeRoche, M.A. Mental Health Center of Denver Antonio Olmos, Ph.D. Mental Health
More informationPrepared for The Colorado Trust by. Kiki Sayre
Guidelines and Best Practices for Culturally Competent Evaluations Prepared for The Colorado Trust by Kiki Sayre September 2002 The mission of The Colorado Trust is to advance the health and well-being
More informationRunning head: CFA OF TDI AND STICSA 1. p Factor or Negative Emotionality? Joint CFA of Internalizing Symptomology
Running head: CFA OF TDI AND STICSA 1 p Factor or Negative Emotionality? Joint CFA of Internalizing Symptomology Caspi et al. (2014) reported that CFA results supported a general psychopathology factor,
More informationConfirmatory Factor Analysis of Preschool Child Behavior Checklist (CBCL) (1.5 5 yrs.) among Canadian children
Confirmatory Factor Analysis of Preschool Child Behavior Checklist (CBCL) (1.5 5 yrs.) among Canadian children Dr. KAMALPREET RAKHRA MD MPH PhD(Candidate) No conflict of interest Child Behavioural Check
More informationDoing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling. Olli-Pekka Kauppila Daria Kautto
Doing Quantitative Research 26E02900, 6 ECTS Lecture 6: Structural Equations Modeling Olli-Pekka Kauppila Daria Kautto Session VI, September 20 2017 Learning objectives 1. Get familiar with the basic idea
More informationAssessing Measurement Invariance in the Attitude to Marriage Scale across East Asian Societies. Xiaowen Zhu. Xi an Jiaotong University.
Running head: ASSESS MEASUREMENT INVARIANCE Assessing Measurement Invariance in the Attitude to Marriage Scale across East Asian Societies Xiaowen Zhu Xi an Jiaotong University Yanjie Bian Xi an Jiaotong
More informationPsychometric Evaluation of the Major Depression Inventory at the Kenyan Coast
Psychometric Evaluation of the Major Depression Inventory at the Kenyan Coast INDEPTH Scientific Conference Addis Ababa 10 th - 13 th November 2015 Mark Otiende IHTAS INDEPTH Healthy Transitions to Adulthood
More informationMeasurement Invariance (MI): a general overview
Measurement Invariance (MI): a general overview Eric Duku Offord Centre for Child Studies 21 January 2015 Plan Background What is Measurement Invariance Methodology to test MI Challenges with post-hoc
More informationRunning head: CFA OF STICSA 1. Model-Based Factor Reliability and Replicability of the STICSA
Running head: CFA OF STICSA 1 Model-Based Factor Reliability and Replicability of the STICSA The State-Trait Inventory of Cognitive and Somatic Anxiety (STICSA; Ree et al., 2008) is a new measure of anxiety
More informationBasic concepts and principles of classical test theory
Basic concepts and principles of classical test theory Jan-Eric Gustafsson What is measurement? Assignment of numbers to aspects of individuals according to some rule. The aspect which is measured must
More informationDevelopment and Psychometric Properties of the Relational Mobility Scale for the Indonesian Population
Development and Psychometric Properties of the Relational Mobility Scale for the Indonesian Population Sukaesi Marianti Abstract This study aims to develop the Relational Mobility Scale for the Indonesian
More informationThe Psychometric Properties of Dispositional Flow Scale-2 in Internet Gaming
Curr Psychol (2009) 28:194 201 DOI 10.1007/s12144-009-9058-x The Psychometric Properties of Dispositional Flow Scale-2 in Internet Gaming C. K. John Wang & W. C. Liu & A. Khoo Published online: 27 May
More informationPurpose of Workshop. Faculty. Culturally Sensitive Research. ISOQOL Workshop 19 Oct 2005
Introduction to ing Health-Related Measures in Diverse Populations Pre-conference Workshop 2 The International Society for Quality of Life Research Center for Aging in Diverse Communities: A Resource Center
More informationSmall Sample Bayesian Factor Analysis. PhUSE 2014 Paper SP03 Dirk Heerwegh
Small Sample Bayesian Factor Analysis PhUSE 2014 Paper SP03 Dirk Heerwegh Overview Factor analysis Maximum likelihood Bayes Simulation Studies Design Results Conclusions Factor Analysis (FA) Explain correlation
More informationDifferential Item Functioning
Differential Item Functioning Lecture #11 ICPSR Item Response Theory Workshop Lecture #11: 1of 62 Lecture Overview Detection of Differential Item Functioning (DIF) Distinguish Bias from DIF Test vs. Item
More informationAssessing e-banking Adopters: an Invariance Approach
Assessing e-banking Adopters: an Invariance Approach Vincent S. Lai 1), Honglei Li 2) 1) The Chinese University of Hong Kong (vslai@cuhk.edu.hk) 2) The Chinese University of Hong Kong (honglei@baf.msmail.cuhk.edu.hk)
More informationMultifactor Confirmatory Factor Analysis
Multifactor Confirmatory Factor Analysis Latent Trait Measurement and Structural Equation Models Lecture #9 March 13, 2013 PSYC 948: Lecture #9 Today s Class Confirmatory Factor Analysis with more than
More informationA 2-STAGE FACTOR ANALYSIS OF THE EMOTIONAL EXPRESSIVITY SCALE IN THE CHINESE CONTEXT
Psychologia, 2010, 53, 44 50 A 2-STAGE FACTOR ANALYSIS OF THE EMOTIONAL EXPRESSIVITY SCALE IN THE CHINESE CONTEXT Raymond C. K. CHAN 1), Yuna WANG 1), Huijie LI 1), Yanfang SHI 1), Ya WANG 1), 1) Institute
More informationMethodological Issues in Measuring the Development of Character
Methodological Issues in Measuring the Development of Character Noel A. Card Department of Human Development and Family Studies College of Liberal Arts and Sciences Supported by a grant from the John Templeton
More informationTitle: The Theory of Planned Behavior (TPB) and Texting While Driving Behavior in College Students MS # Manuscript ID GCPI
Title: The Theory of Planned Behavior (TPB) and Texting While Driving Behavior in College Students MS # Manuscript ID GCPI-2015-02298 Appendix 1 Role of TPB in changing other behaviors TPB has been applied
More informationPaul Irwing, Manchester Business School
Paul Irwing, Manchester Business School Factor analysis has been the prime statistical technique for the development of structural theories in social science, such as the hierarchical factor model of human
More informationPresented by Paul A. Carrola, Ph.D., LPC S The University of Texas at El Paso TCA 2014 Mid Winter Conference
Presented by Paul A. Carrola, Ph.D., LPC S The University of Texas at El Paso TCA 2014 Mid Winter Conference Discussion Outline My Background Culture of Correctional Mental Health Study Overview Rational/Research
More informationAdvantages of Within Group Analysis of Race/Ethnicity
Advantages of Within Group Analysis of Race/Ethnicity KEITH E. WHITFIELD, PH.D. VICE PROVOST FOR ACADEMIC AFFAIRS PROFESSOR OF PSYCHOLOGY AND NEUROSCIENCE RESEARCH PROFESSOR OF MEDICINE CO- DIRECTOR OF
More informationManifestation Of Differences In Item-Level Characteristics In Scale-Level Measurement Invariance Tests Of Multi-Group Confirmatory Factor Analyses
Journal of Modern Applied Statistical Methods Copyright 2005 JMASM, Inc. May, 2005, Vol. 4, No.1, 275-282 1538 9472/05/$95.00 Manifestation Of Differences In Item-Level Characteristics In Scale-Level Measurement
More informationRelationship between Belief System and Depression with Anxiety among Undergraduate Students in Yemen
Relationship between Belief System and Depression with Anxiety among Undergraduate Students in Yemen Nasser Abdul Hafeeth Alareqe,[1] Othman Bin Mohammed,[2] Lily Harun,[3] Bahaman Abu Samah,[4] 1-Introduction
More informationConfirmatory Factor Analysis of the Procrastination Assessment Scale for Students
611456SGOXXX10.1177/2158244015611456SAGE OpenYockey and Kralowec research-article2015 Article Confirmatory Factor Analysis of the Procrastination Assessment Scale for Students SAGE Open October-December
More informationConstruct Invariance of the Survey of Knowledge of Internet Risk and Internet Behavior Knowledge Scale
University of Connecticut DigitalCommons@UConn NERA Conference Proceedings 2010 Northeastern Educational Research Association (NERA) Annual Conference Fall 10-20-2010 Construct Invariance of the Survey
More informationDeveloping Academic Identity Statues Scale (AISS) and Studying its Construct Validity on Iranian Students
Available online at www.sciencedirect.com Procedia Social and Behavioral Sciences 15 (2011) 738 742 WCES-2011 Developing Academic Identity Statues Scale (AISS) and Studying its Construct Validity on Iranian
More informationOriginal Article. Relationship between sport participation behavior and the two types of sport commitment of Japanese student athletes
Journal of Physical Education and Sport (JPES), 17(4), Art 267, pp. 2412-2416, 2017 online ISSN: 2247-806X; p-issn: 2247 8051; ISSN - L = 2247-8051 JPES Original Article Relationship between sport participation
More informationComparability Study of Online and Paper and Pencil Tests Using Modified Internally and Externally Matched Criteria
Comparability Study of Online and Paper and Pencil Tests Using Modified Internally and Externally Matched Criteria Thakur Karkee Measurement Incorporated Dong-In Kim CTB/McGraw-Hill Kevin Fatica CTB/McGraw-Hill
More informationFactor Analysis. MERMAID Series 12/11. Galen E. Switzer, PhD Rachel Hess, MD, MS
Factor Analysis MERMAID Series 2/ Galen E Switzer, PhD Rachel Hess, MD, MS Ways to Examine Groups of Things Groups of People Groups of Indicators Cluster Analysis Exploratory Factor Analysis Latent Class
More informationConnexion of Item Response Theory to Decision Making in Chess. Presented by Tamal Biswas Research Advised by Dr. Kenneth Regan
Connexion of Item Response Theory to Decision Making in Chess Presented by Tamal Biswas Research Advised by Dr. Kenneth Regan Acknowledgement A few Slides have been taken from the following presentation
More informationA 3-Factor Model for the FACIT-Sp
A 3-Factor Model for the FACIT-Sp Reference: Canada, Murphy, Fitchett, Peterman, Schover. Psycho-Oncology. Published Online: Dec 19, 2007; DOI: 10.1002/pon.1307. Copyright John Wiley & Sons Ltd. Investigators
More informationChapter 3. Psychometric Properties
Chapter 3 Psychometric Properties Reliability The reliability of an assessment tool like the DECA-C is defined as, the consistency of scores obtained by the same person when reexamined with the same test
More informationErrors and biases in Structural Equa2on Modeling. Jelte M. Wicherts
Errors and biases in Structural Equa2on Modeling Jelte M. Wicherts 1 De empirical cycle Observe Evaluate Theorize Test Predict 2 Grey zone map Remove outliers (Z > 2 ) P>.05? P>.05 P
More informationConnectedness DEOCS 4.1 Construct Validity Summary
Connectedness DEOCS 4.1 Construct Validity Summary DEFENSE EQUAL OPPORTUNITY MANAGEMENT INSTITUTE DIRECTORATE OF RESEARCH DEVELOPMENT AND STRATEGIC INITIATIVES Directed by Dr. Daniel P. McDonald, Executive
More informationContents. What is item analysis in general? Psy 427 Cal State Northridge Andrew Ainsworth, PhD
Psy 427 Cal State Northridge Andrew Ainsworth, PhD Contents Item Analysis in General Classical Test Theory Item Response Theory Basics Item Response Functions Item Information Functions Invariance IRT
More informationComprehensive Statistical Analysis of a Mathematics Placement Test
Comprehensive Statistical Analysis of a Mathematics Placement Test Robert J. Hall Department of Educational Psychology Texas A&M University, USA (bobhall@tamu.edu) Eunju Jung Department of Educational
More informationA methodological perspective on the analysis of clinical and personality questionnaires Smits, Iris Anna Marije
University of Groningen A methodological perspective on the analysis of clinical and personality questionnaires Smits, Iris Anna Mare IMPORTANT NOTE: You are advised to consult the publisher's version
More informationFactor Structure of Boredom in Iranian Adolescents
Factor Structure of Boredom in Iranian Adolescents Ali Farhadi Assistant Prof., Dept. of Social Medicine, Lorestan University of Medical Sciences Kamalvand, Khorramabad, Iran farhadi@lums.ac.ir Tel: +98
More informationUsing the Rasch Modeling for psychometrics examination of food security and acculturation surveys
Using the Rasch Modeling for psychometrics examination of food security and acculturation surveys Jill F. Kilanowski, PhD, APRN,CPNP Associate Professor Alpha Zeta & Mu Chi Acknowledgements Dr. Li Lin,
More informationValidity and reliability of physical education teachers' beliefs and intentions toward teaching students with disabilities (TBITSD) questionnaire
Advances in Environmental Biology, 7(11) Oct 201, Pages: 469-47 AENSI Journals Advances in Environmental Biology Journal home page: http://www.aensiweb.com/aeb.html Validity and reliability of physical
More informationScale Building with Confirmatory Factor Analysis
Scale Building with Confirmatory Factor Analysis Latent Trait Measurement and Structural Equation Models Lecture #7 February 27, 2013 PSYC 948: Lecture #7 Today s Class Scale building with confirmatory
More informationThe Modification of Dichotomous and Polytomous Item Response Theory to Structural Equation Modeling Analysis
Canadian Social Science Vol. 8, No. 5, 2012, pp. 71-78 DOI:10.3968/j.css.1923669720120805.1148 ISSN 1712-8056[Print] ISSN 1923-6697[Online] www.cscanada.net www.cscanada.org The Modification of Dichotomous
More informationAssessing Cultural Competency from the Patient s Perspective: The CAHPS Cultural Competency (CC) Item Set
Assessing Cultural Competency from the Patient s Perspective: The CAHPS Cultural Competency (CC) Item Set Robert Weech-Maldonado Department of Health Services Administration University of Alabama at Birmingham
More informationInternational Conference on Humanities and Social Science (HSS 2016)
International Conference on Humanities and Social Science (HSS 2016) The Chinese Version of WOrk-reLated Flow Inventory (WOLF): An Examination of Reliability and Validity Yi-yu CHEN1, a, Xiao-tong YU2,
More informationAnalysis of the Reliability and Validity of an Edgenuity Algebra I Quiz
Analysis of the Reliability and Validity of an Edgenuity Algebra I Quiz This study presents the steps Edgenuity uses to evaluate the reliability and validity of its quizzes, topic tests, and cumulative
More informationCulture and Survey Behavior
Culture and Survey Behavior Timothy Johnson Survey Research Laboratory University of Illinois at Chicago 1 What is Culture? the shared elements that provide the standards for perceiving, believing, evaluating,
More informationChapter 2. Test Development Procedures: Psychometric Study and Analytical Plan
Chapter 2 Test Development Procedures: Psychometric Study and Analytical Plan Introduction The Peabody Treatment Progress Battery (PTPB) is designed to provide clinically relevant measures of key mental
More informationDevelopment of self efficacy and attitude toward analytic geometry scale (SAAG-S)
Available online at www.sciencedirect.com Procedia - Social and Behavioral Sciences 55 ( 2012 ) 20 27 INTERNATIONAL CONFERENCE ON NEW HORIZONS IN EDUCATION INTE2012 Development of self efficacy and attitude
More informationGezinskenmerken: De constructie van de Vragenlijst Gezinskenmerken (VGK) Klijn, W.J.L.
UvA-DARE (Digital Academic Repository) Gezinskenmerken: De constructie van de Vragenlijst Gezinskenmerken (VGK) Klijn, W.J.L. Link to publication Citation for published version (APA): Klijn, W. J. L. (2013).
More informationDATE: 8/ 1/2008 TIME: 3:32. L I S R E L 8.71 BY Karl G. J reskog & Dag S rbom
DATE: 8/ 1/2008 TIME: 3:32 L I S R E L 8.71 BY Karl G. J reskog & Dag S rbom This program is published exclusively by Scientific Software International, Inc. 7383 N. Lincoln Avenue, Suite 100 Lincolnwood,
More informationTesting the Multiple Intelligences Theory in Oman
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 190 ( 2015 ) 106 112 2nd GLOBAL CONFERENCE on PSYCHOLOGY RESEARCHES, 28-29, November 2014 Testing the Multiple
More informationLearning Objectives. Outline. The Dyadic Adjustment Scale: Utility for Rural Marital Assessment
The Dyadic Adjustment Scale: Utility for Rural Marital Assessment Kara E. Vick, Ph.D. Randal P. Quevillon, Ph.D. Agriwellness Conference August 4, 2009 Learning Objectives To learn why health care providers
More informationBipolar items for the measurement of personal optimism instead of unipolar items
Psychological Test and Assessment Modeling, Volume 53, 2011 (4), 399-413 Bipolar items for the measurement of personal optimism instead of unipolar items Karl Schweizer 1, Wolfgang Rauch 2 & Andreas Gold
More informationFactorial Validity and Consistency of the MBI-GS Across Occupational Groups in Norway
Brief Report Factorial Validity and Consistency of the MBI-GS Across Occupational Groups in Norway Astrid M. Richardsen Norwegian School of Management Monica Martinussen University of Tromsø The present
More informationBackground. Workshop. Using the WHOQOL in NZ
Using the WHOQOL in NZ Australasian Mental Health Outcomes Conference Workshop Using WHOQOL in New Zealand Prof Rex Billington, Dr Daniel Shepherd, & Dr Chris Krägeloh Rex Billington Chris Krageloh What
More informationValidating the Factorial Structure of the Malaysian Version of Revised Competitive State Anxiety Inventory-2 among Young Taekwondo Athletes
SOCIAL SCIENCES & HUMANITIES Journal homepage: http://www.pertanika.upm.edu.my/ Validating the Factorial Structure of the Malaysian Version of Revised Competitive State Anxiety Inventory-2 among Young
More informationMeasurement and Descriptive Statistics. Katie Rommel-Esham Education 604
Measurement and Descriptive Statistics Katie Rommel-Esham Education 604 Frequency Distributions Frequency table # grad courses taken f 3 or fewer 5 4-6 3 7-9 2 10 or more 4 Pictorial Representations Frequency
More informationMichael Armey David M. Fresco. Jon Rottenberg. James J. Gross Ian H. Gotlib. Kent State University. Stanford University. University of South Florida
Further psychometric refinement of depressive rumination: Support for the Brooding and Pondering factor solution in a diverse community sample with clinician-assessed psychopathology Michael Armey David
More informationCollege Student Self-Assessment Survey (CSSAS)
13 College Student Self-Assessment Survey (CSSAS) Development of College Student Self Assessment Survey (CSSAS) The collection and analysis of student achievement indicator data are of primary importance
More informationStructural Equation Modeling of Multiple- Indicator Multimethod-Multioccasion Data: A Primer
Utah State University DigitalCommons@USU Psychology Faculty Publications Psychology 4-2017 Structural Equation Modeling of Multiple- Indicator Multimethod-Multioccasion Data: A Primer Christian Geiser
More informationFACTOR VALIDITY OF THE MERIDEN SCHOOL CLIMATE SURVEY- STUDENT VERSION (MSCS-SV)
FACTOR VALIDITY OF THE MERIDEN SCHOOL CLIMATE SURVEY- STUDENT VERSION (MSCS-SV) Nela Marinković 1,2, Ivana Zečević 2 & Siniša Subotić 3 2 Faculty of Philosophy, University of Banja Luka 3 University of
More informationWhile many studies have employed Young s Internet
CYBERPSYCHOLOGY, BEHAVIOR, AND SOCIAL NETWORKING Volume 16, Number 3, 2013 ª Mary Ann Liebert, Inc. DOI: 10.1089/cyber.2012.0426 Arabic Validation of the Internet Addiction Test Nazir S. Hawi, EdD Abstract
More informationvalidscale: A Stata module to validate subjective measurement scales using Classical Test Theory
: A Stata module to validate subjective measurement scales using Classical Test Theory Bastien Perrot, Emmanuelle Bataille, Jean-Benoit Hardouin UMR INSERM U1246 - SPHERE "methods in Patient-centered outcomes
More informationA Hierarchical Comparison on Influence Paths from Cognitive & Emotional Trust to Proactive Behavior Between China and Japan
A Hierarchical Comparison on Influence Paths from Cognitive & Emotional Trust to Proactive Behavior Between China and Japan Pei Liu School of Management and Economics, North China Zhen Li Data Science
More informationPsychometric Validation of the Four Factor Situational Temptations for Smoking Inventory in Adult Smokers
University of Rhode Island DigitalCommons@URI Open Access Master's Theses 2013 Psychometric Validation of the Four Factor Situational Temptations for Smoking Inventory in Adult Smokers Hui-Qing Yin University
More informationRevised Motivated Strategies for Learning Questionnaire for Secondary School Students
19 Revised Motivated Strategies for Learning Questionnaire for Secondary School Students Woon Chia Liu, Chee Keng John Wang, Caroline Koh, Stefanie Chye, Bee Leng Chua, and Boon San Coral Lim National
More informationFactor Structure, Validity and Reliability of the Persian version of the Acceptance and Action Questionnaire (AAQ-II-7)
International Journal of Education and Research Vol. 2 No. 9 September 2014 Factor Structure, Validity and Reliability of the Persian version of the Acceptance and Action Questionnaire (AAQ-II-7) Nezamaddin
More information1. Evaluate the methodological quality of a study with the COSMIN checklist
Answers 1. Evaluate the methodological quality of a study with the COSMIN checklist We follow the four steps as presented in Table 9.2. Step 1: The following measurement properties are evaluated in the
More informationThe following lines were read from file C:\Documents and Settings\User\Desktop\Example LISREL-CFA\cfacommand.LS8:
DATE: 8/ 1/2008 TIME: 2:34 L I S R E L 8.52 BY Karl G. J reskog & Dag S rbom This program is published exclusively by Scientific Software International, Inc. 7383 N. Lincoln Avenue, Suite 100 Lincolnwood,
More informationPersonal Well-being Among Medical Students: Findings from a Pilot Survey
Analysis IN BRIEF Volume 14, Number 4 April 2014 Association of American Medical Colleges Personal Well-being Among Medical Students: Findings from a Pilot Survey Supplemental Information References 1.
More informationRunning head: NESTED FACTOR ANALYTIC MODEL COMPARISON 1. John M. Clark III. Pearson. Author Note
Running head: NESTED FACTOR ANALYTIC MODEL COMPARISON 1 Nested Factor Analytic Model Comparison as a Means to Detect Aberrant Response Patterns John M. Clark III Pearson Author Note John M. Clark III,
More informationRunning Head: MULTIPLE CHOICE AND CONSTRUCTED RESPONSE ITEMS. The Contribution of Constructed Response Items to Large Scale Assessment:
Running Head: MULTIPLE CHOICE AND CONSTRUCTED RESPONSE ITEMS The Contribution of Constructed Response Items to Large Scale Assessment: Measuring and Understanding their Impact Robert W. Lissitz 1 and Xiaodong
More informationEmotional Intelligence and Leadership
The Mayer Salovey Caruso Notes Emotional Intelligence Test (MSCEIT) 2 The Mayer Salovey Caruso Emotional Intelligence Test (MSCEIT) 2 The MSCEIT 2 measures four related abilities. 3 Perceiving Facilitating
More informationThe revised short-form of the Eating Beliefs Questionnaire: Measuring positive, negative, and permissive beliefs about binge eating
Burton and Abbott Journal of Eating Disorders (2018) 6:37 https://doi.org/10.1186/s40337-018-0224-0 RESEARCH ARTICLE Open Access The revised short-form of the Eating Beliefs Questionnaire: Measuring positive,
More informationChapter 11 Multiple Regression
Chapter 11 Multiple Regression PSY 295 Oswald Outline The problem An example Compensatory and Noncompensatory Models More examples Multiple correlation Chapter 11 Multiple Regression 2 Cont. Outline--cont.
More informationNonparametric DIF. Bruno D. Zumbo and Petronilla M. Witarsa University of British Columbia
Nonparametric DIF Nonparametric IRT Methodology For Detecting DIF In Moderate-To-Small Scale Measurement: Operating Characteristics And A Comparison With The Mantel Haenszel Bruno D. Zumbo and Petronilla
More informationReliability Analysis: Its Application in Clinical Practice
Reliability Analysis: Its Application in Clinical Practice NahathaiWongpakaran Department of Psychiatry, Faculty of Medicine Chiang Mai University, Thailand TinakonWongpakaran Department of Psychiatry,
More informationTable of Contents. Preface to the third edition xiii. Preface to the second edition xv. Preface to the fi rst edition xvii. List of abbreviations xix
Table of Contents Preface to the third edition xiii Preface to the second edition xv Preface to the fi rst edition xvii List of abbreviations xix PART 1 Developing and Validating Instruments for Assessing
More informationDr Ruth Tully (1) (2) & Dr Tom Bailey (1)
Dr Ruth Tully (1) (2) & Dr Tom Bailey (1) 2017 (1) Research conducted whilst at The University of Nottingham, UK. (2) Tully Forensic Psychology Ltd, Nottingham, UK See: Journal of Criminological Research,
More informationExamining the efficacy of the Theory of Planned Behavior (TPB) to understand pre-service teachers intention to use technology*
Examining the efficacy of the Theory of Planned Behavior (TPB) to understand pre-service teachers intention to use technology* Timothy Teo & Chwee Beng Lee Nanyang Technology University Singapore This
More informationMEASURING STUDENT ATTACHMENT TO SCHOOL : A STRUCTURAL EQUATION MODELING APPROACH
MEASURING STUDENT ATTACHMENT TO SCHOOL : A STRUCTURAL EQUATION MODELING APPROACH Azlina Abu Bakar a a University Malaysia Terengganu, Malaysia. a Corresponding author: azlina@umt.edu.my Ontario International
More informationInstrument Validation Study
Instrument Validation Study REGARDING LEADERSHIP CIRCLE PROFILE By Industrial Psychology Department Bowling Green State University INSTRUMENT VALIDATION STUDY EXECUTIVE SUMMARY AND RESPONSE TO THE RECOMMENDATIONS
More informationThe Youth Experience Survey 2.0: Instrument Revisions and Validity Testing* David M. Hansen 1 University of Illinois, Urbana-Champaign
The Youth Experience Survey 2.0: Instrument Revisions and Validity Testing* David M. Hansen 1 University of Illinois, Urbana-Champaign Reed Larson 2 University of Illinois, Urbana-Champaign February 28,
More informationPersonality Traits Effects on Job Satisfaction: The Role of Goal Commitment
Marshall University Marshall Digital Scholar Management Faculty Research Management, Marketing and MIS Fall 11-14-2009 Personality Traits Effects on Job Satisfaction: The Role of Goal Commitment Wai Kwan
More informationAN EVALUATION OF CONFIRMATORY FACTOR ANALYSIS OF RYFF S PSYCHOLOGICAL WELL-BEING SCALE IN A PERSIAN SAMPLE. Seyed Mohammad Kalantarkousheh 1
AN EVALUATION OF CONFIRMATORY FACTOR ANALYSIS OF RYFF S PSYCHOLOGICAL WELL-BEING SCALE IN A PERSIAN SAMPLE Seyed Mohammad Kalantarkousheh 1 ABSTRACT: This paper examines the construct validity and reliability
More informationMULTISOURCE PERFORMANCE RATINGS: MEASUREMENT EQUIVALENCE ACROSS GENDER. Jacqueline Brooke Elkins
MULTISOURCE PERFORMANCE RATINGS: MEASUREMENT EQUIVALENCE ACROSS GENDER by Jacqueline Brooke Elkins A Thesis Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Arts in Industrial-Organizational
More information11 Validity. Content Validity and BIMAS Scale Structure. Overview of Results
11 Validity The validity of a test refers to the quality of inferences that can be made by the test s scores. That is, how well does the test measure the construct(s) it was designed to measure, and how
More informationPersonal Style Inventory Item Revision: Confirmatory Factor Analysis
Personal Style Inventory Item Revision: Confirmatory Factor Analysis This research was a team effort of Enzo Valenzi and myself. I m deeply grateful to Enzo for his years of statistical contributions to
More informationMeasuring Self-Serving Cognitive Distortions: An analysis of the. Psychometric Properties of the How I think Questionnaire (HIT-16-Q)
The International Journal of Indian Psychology ISSN 2348-5396 (e) ISSN: 2349-3429 (p) Volume 3, Issue 1, No.7, DIP: C03115V3I12015 http://www.ijip.in October December, 2015 Measuring Self-Serving Cognitive
More informationFactorial Validity and Reliability of 12 items General Health Questionnaire in a Bhutanese Population. Tshoki Zangmo *
Factorial Validity and Reliability of 12 items General Health Questionnaire in a Bhutanese Population Tshoki Zangmo * Abstract The aim of this study is to test the factorial structure and the internal
More informationAssessing the Validity and Reliability of a Measurement Model in Structural Equation Modeling (SEM)
British Journal of Mathematics & Computer Science 15(3): 1-8, 2016, Article no.bjmcs.25183 ISSN: 2231-0851 SCIENCEDOMAIN international www.sciencedomain.org Assessing the Validity and Reliability of a
More informationAn Examination Of The Psychometric Properties Of The CPGI In Applied Research (OPGRC# 2328) Final Report 2007
An Examination Of The Psychometric Properties Of The CPGI In Applied Research (OPGRC# 2328) Final Report 2007 Total funds awarded: $34,980.00 Dates of period of support: November 2005 to August 2006 Sponsoring
More informationOn the Performance of Maximum Likelihood Versus Means and Variance Adjusted Weighted Least Squares Estimation in CFA
STRUCTURAL EQUATION MODELING, 13(2), 186 203 Copyright 2006, Lawrence Erlbaum Associates, Inc. On the Performance of Maximum Likelihood Versus Means and Variance Adjusted Weighted Least Squares Estimation
More informationThe Ego Identity Process Questionnaire: Factor Structure, Reliability, and Convergent Validity in Dutch-Speaking Late. Adolescents
33 2 The Ego Identity Process Questionnaire: Factor Structure, Reliability, and Convergent Validity in Dutch-Speaking Late Adolescents Koen Luyckx, Luc Goossens, Wim Beyers, & Bart Soenens (2006). Journal
More informationImpact and adjustment of selection bias. in the assessment of measurement equivalence
Impact and adjustment of selection bias in the assessment of measurement equivalence Thomas Klausch, Joop Hox,& Barry Schouten Working Paper, Utrecht, December 2012 Corresponding author: Thomas Klausch,
More informationModeling the Influential Factors of 8 th Grades Student s Mathematics Achievement in Malaysia by Using Structural Equation Modeling (SEM)
International Journal of Advances in Applied Sciences (IJAAS) Vol. 3, No. 4, December 2014, pp. 172~177 ISSN: 2252-8814 172 Modeling the Influential Factors of 8 th Grades Student s Mathematics Achievement
More informationCHAPTER 4 RESEARCH METHODS (PP )
1 Research 2 Methods Return CHAPTER 4 RESEARCH METHODS (PP. 104-127) Research Studies Hypothesis Ind/Dep Variable Int/Ext Validity Concepts Significance Statistical Case Study Corr Coeff Average Client
More information