Psychological testing
|
|
- Magnus Greene
- 5 years ago
- Views:
Transcription
1 Psychological testing Lecture 11 Mikołaj Winiewski, PhD Marcin Zajenkowski, PhD
2 Strategies for test development and test item considerations The procedures involved in item generation, item selection, and item analysis Critical to test authors and test developers. Test users need to be familiar with the procedures (to understand the nature of the tasks and evaluate the instruments they select). Different perspective Test author -> theory and design Test user -> - test selection - observing test takers responses
3 Test development (what for?) operationalization -> new theory -> sample behaviors from a newly defined test domain meet the needs of a special (not covered by existing tests) group of test takers improve the accuracy of test scores for their intended purpose Tests need to be revised
4 Defining the test universe, target group purpose Test development First Steps Developing a test plan Composing the test items Writing the administration instructions
5 Continued Steps of Test Construction Constructing Scales Piloting the Test Standardizing the Test Collecting Norms Validation & Reliability Studies Manual Writing Test Revision
6 Test Universe working definition of the construct locate studies that explain the construct locate current measures of the construct
7 Target group a list of characteristics of persons who will take the test characteristics that will affect how test takers will respond to the test questions reading level, disabilities, honesty, language, etc >>specific characteristic will depend on the construct<<
8 Purpose what the test will measure (and what for) how scores will be used to compare test takers (normative approach) to indicate achievement (criterion approach) will scores be used to test a theory or to provide information about an individual?
9 Developing a Test Plan a definition of the construct the content to be measured (test domain) the format for the questions how the test will be administered and scored how the test will be scored
10 Defining the Construct Define construct after reviewing literature about the construct and any available measures Operationalize in terms of observable and measurable behaviours Provides boundaries for the test domain (what should and shouldn t be included) Specify approximate number of items needed
11 Choosing the Test Format test format refers to the type of items the test will contain two important aspects of test format: stimulus mechanism for response (e.g., multiple choice, true-false, reaction, etc ). objective or subjective test format test items -> stimuli presented to the test taker form depends on decisions made in the test plan (purpose, target, administration, scoring) multiple options (see lecture no1 and 12)
12 Writing Good Items base of whole test construction process multiple problems (gazillions of tests with poor items) requires originality, creativity, knowledge of test domain and practice not all items perform as expected--may be too easy or difficult, may be misinterpreted, etc. rule of thumb to start with at least twice as many items as you expect to use multiple strategies
13 Administration and scoring Instructions Precise!! specify the testing environment to decrease variation or error in test scores should address: group or individual administration requirements for location (e.g., quiet, amount of space, etc ) required equipment time limits or approximate completion time script for administrator and answers to questions test takers may ask
14 Scoring Methods Cumulative model: most common assumes that the more a test taker responds in a particular fashion the more he/she has of the attribute being measured (e.g., more correct answers, or endorses higher numbers on a Likert scale) correct responses or responses on Likert scale are summed yields interval data that can be interpreted with reference to norms
15 Scoring Methods Categorical model: place test takers in a group e.g., a particular pattern of responses may suggest diagnosis of a certain psychological disorder typically yields nominal data because it places test takers in categories
16 Scoring Methods Ipsative model: test takers scores are not compared to that of other test takers but rather compare the scores on various scales WITHIN the test taker (Which scores are high & low) e.g., a test taker may complete a measure of interpersonal problems of various types and the test administrator may want to determine which of the types the test taker feels is most problematic for him or her Cumulative model may be combined with categorical or ipsative model
17 Response Bias In preparing an item review, each question can be evaluated from two perspectives: Is the item fair? Is the item biased? Tests are subject to error and one form comes from the test takers
18 Response Sets/Styles Are patterns of responding that result in misleading information and limit the accuracy and usefulness of the test scores Reasons for misleading information 1. Information requested is too personal 2. Distort their responses 3. Answer items carelessly 4. May feel coerced into completing the test
19 Response Style People always agree (acquiescence) or disagree (criticalness) with statements without attending to the actual content Usually, when items are ambiguous Solution: use both positively- and negativelykeyed items
20 Social Desirability Some test takers choose socially acceptable answers or present themselves in a favorable light People often do not attend to the accurate answer (trait being measured) but to the social acceptability of the statement This represents unwanted variance it might be a problem of the item itself
21 Faking Faking -- some test takers may respond in a particular way to cause a desired outcome may fake good (e.g., in employment settings) to create a favorable impression may fake bad (e.g., in clinical or forensic settings) as a cry for help or to appear mentally disturbed may use some subtle questions that are difficult to fake because they aren t clearly face valid
22 Faking Bad People try to look worse than they really are Common problem in clinical settings Reasons: Cry for help Want to plea insanity in court Want to avoid draft into military Want to show psychological damage Most people who fake bad overdo it
23 Handling Impression Management Use positive and negative impression scales (endorsed by 10% of the population) Use lie scales to flag those who score high (e.g., I get angry sometime ). Inconsistency scales (e.g., two different responses to two similar questions) (Use multiple assessment methods (other than self-report)
24 Random Responding Random responding may occur when test takers are unwilling or unable to respond accurately. likely to occur when test taker lacks the skills (e.g., reading), does not want to be evaluated, or lacks attention to the task try to detect by embedding a scale that tends to yield clear results from vast majority such that a different result suggests the test taker wasn t cooperating
25 Random Responding Strategies for detection: Duplicate items: I love my mother. I hate my mother. Infrequency scales: I ve never had hair on my head. I have not seen a car in 10 years.
26 Random Responding May occur for several reasons: People are not motivated to participate Reading or language difficulties Do not understand instructions / item content Too confused or disturbed to respond appropriately
Psychological testing
What is a psychological test Psychological testing An evaluative device or procedure in which a sample of an examinee s behavior in a specified domain is obtained and subsequently evaluated and scored
More informationAdaptive Testing With the Multi-Unidimensional Pairwise Preference Model Stephen Stark University of South Florida
Adaptive Testing With the Multi-Unidimensional Pairwise Preference Model Stephen Stark University of South Florida and Oleksandr S. Chernyshenko University of Canterbury Presented at the New CAT Models
More informationALABAMA SELF-ASSESSMENT INDEX PILOT PROGRAM SUMMARY REPORT
ALABAMA SELF-ASSESSMENT INDEX PILOT PROGRAM SUMMARY REPORT July 7, 2000 A large sample (N = 1,127) of welfare recipient clients were administered the Self-Assessment Index Behavior Data Systems, Ltd. P.O.
More informationTECH 646 Analysis of Research in Industry and Technology
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement,, Questionnaires & Instruments, Sampling Ch. 12 Lecture note based on the text book and
More informationCLINICAL VS. BEHAVIOR ASSESSMENT
CLINICAL VS. BEHAVIOR ASSESSMENT Informal Tes3ng Personality Tes3ng Assessment Procedures Ability Tes3ng The Clinical Interview 3 Defining Clinical Assessment The process of assessing the client through
More informationADMS Sampling Technique and Survey Studies
Principles of Measurement Measurement As a way of understanding, evaluating, and differentiating characteristics Provides a mechanism to achieve precision in this understanding, the extent or quality As
More informationAssessment: Interviews, Tests, Techniques. Clinical Psychology Lectures
Lecture 6 Assessment: Interviews, Tests, Techniques Clinical Psychology Lectures Psychodiagnostic Assessment Also termed: personality assessment, diagnostic assessment, pretreatment assessments or psychological
More informationStrategies for Dealing with Challenging Interpersonal Interactions in a Mental Health Setting
Strategies for Dealing with Challenging Interpersonal Interactions in a Mental Health Setting Liam E. Marshall, PhD Waypoint Centre for Mental Health Care & Rockwood Psychological Services 1 Objectives
More informationTHE PROFESSIONAL BOARD FOR PSYCHOLOGY HEALTH PROFESSIONS COUNCIL OF SOUTH AFRICA TEST DEVELOPMENT / ADAPTATION PROPOSAL FORM
FORM A THE PROFESSIONAL BOARD FOR PSYCHOLOGY HEALTH PROFESSIONS COUNCIL OF SOUTH AFRICA TEST DEVELOPMENT / ADAPTATION PROPOSAL FORM This document consists of two sections. Please complete section 1 if
More informationA Guide to Clinical Interpretation of the Test of Variables of Attention (T.O.V.A. TM )
A Guide to Clinical Interpretation of the Test of Variables of Attention (T.O.V.A. TM ) Steven J. Hughes, PhD, LP, ABPdN Director of Education and Research The TOVA Company 2008 The TOVA Company Purpose:
More informationFree Choice or Forced Choice? Your Choice
Free Choice or Forced Choice? Your Choice Peter Saville, Rab MacIver, Rainer Kurz Liverpool, 15 th July 2008 Normative and Ipsative Normative Questionnaires: The respondent rates their agreement or disagreement
More informationChapter 6. Methods of Measuring Behavior Pearson Prentice Hall, Salkind. 1
Chapter 6 Methods of Measuring Behavior 2009 Pearson Prentice Hall, Salkind. 1 CHAPTER OVERVIEW Tests and Their Development Types of Tests Observational Techniques Questionnaires 2009 Pearson Prentice
More informationDoes the Use of Personality Inventory Cause Bias on Assessment Center Results Because of Social Desirability? Yasin Rofcanin Levent Sevinç
Does the Use of Personality Inventory Cause Bias on Assessment Center Results Because of Social Desirability? Yasin Rofcanin Levent Sevinç Introduction According to the guidelines, in an assessment center
More informationPiers Harris Children s Self-Concept Scale, Second Edition (Piers-Harris 2)
Piers Harris Children s Self-Concept Scale, Second Edition (Piers-Harris 2) WPS TEST REPORT Copyright 2002 by Western Psychological Services 12031 Wilshire Blvd., Los Angeles, California 90025-1251 Version
More informationANXIETY A brief guide to the PROMIS Anxiety instruments:
ANXIETY A brief guide to the PROMIS Anxiety instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Pediatric Bank v1.0 Anxiety PROMIS Pediatric Short Form v1.0 - Anxiety 8a PROMIS Item Bank v1.0 Anxiety PROMIS
More informationChapter 1 Applications and Consequences of Psychological Testing
Chapter 1 Applications and Consequences of Psychological Testing Topic 1A The Nature and Uses of Psychological Testing The Consequences of Testing From birth to old age, people encounter tests at all most
More informationProject: Date: Presented by: Siegel HR
Personal Behavioral Style Project: Focusperson: JB Max Smith Date: 05.09.2016 Presented by: Siegel HR Introduction This profile provides a picture of a person's behavior based on four tendencies. All people
More informationMeasurement of Constructs in Psychosocial Models of Health Behavior. March 26, 2012 Neil Steers, Ph.D.
Measurement of Constructs in Psychosocial Models of Health Behavior March 26, 2012 Neil Steers, Ph.D. Importance of measurement in research testing psychosocial models Issues in measurement of psychosocial
More informationAssignment 2: Experimental Design
Assignment 2: Experimental Design Description In this assignment, you will follow the steps described in the Step-by-Step Experimental Design lecture to design an experiment. These steps will provide you
More informationPsychological testing
Psychological testing Lecture 12 Mikołaj Winiewski, PhD Test Construction Strategies Content validation Empirical Criterion Factor Analysis Mixed approach (all of the above) Content Validation Defining
More informationORIGINS AND DISCUSSION OF EMERGENETICS RESEARCH
ORIGINS AND DISCUSSION OF EMERGENETICS RESEARCH The following document provides background information on the research and development of the Emergenetics Profile instrument. Emergenetics Defined 1. Emergenetics
More informationImportance of Good Measurement
Importance of Good Measurement Technical Adequacy of Assessments: Validity and Reliability Dr. K. A. Korb University of Jos The conclusions in a study are only as good as the data that is collected. The
More informationBy Hui Bian Office for Faculty Excellence
By Hui Bian Office for Faculty Excellence 1 Email: bianh@ecu.edu Phone: 328-5428 Location: 1001 Joyner Library, room 1006 Office hours: 8:00am-5:00pm, Monday-Friday 2 Educational tests and regular surveys
More informationEndler Multidimensional Anxiety Scales (EMAS)
Endler Multidimensional Anxiety Scales (EMAS) A WPS TEST REPORT by Western Psychological Services 12031 Wilshire Boulevard, Los Angeles, California 90025-1251 A Computerized Scoring and Interpretation
More informationValidity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)
Ch. 5: Validity Validity History Griggs v. Duke Power Ricci vs. DeStefano Defining Validity Aspects of Validity Face Validity Content Validity Criterion Validity Construct Validity Reliability vs. Validity
More informationUnderstanding and serving users
Understanding and serving users Surveys, interviews and protocols Intro to data analysis Asking users questions: Questionnaires are probably the most frequently used method of summative evaluation of user
More information5/6/2008. Psy 427 Cal State Northridge Andrew Ainsworth PhD
Psy 427 Cal State Northridge Andrew Ainsworth PhD Some Definitions Personality the relatively stable and distinctive patterns of behavior that characterize an individual and his or her reactions to the
More informationOrganizational Behaviour
Bachelor of Commerce Programme Organizational Behaviour Individual Behaviour Perception The Da Vinci Institute for Technology Management (Pty) Ltd Registered with the Department of Education as a private
More informationCIRCLE 2.3. Why software?
CIRCLE 2.3 This software is a computerised implementation of Blackburn s interpersonal Circle. CIRCLE stands for Circumplex of Interpersonal Relationships in Closed Living Environments. Circle is based
More informationAN ANALYSIS ON VALIDITY AND RELIABILITY OF TEST ITEMS IN PRE-NATIONAL EXAMINATION TEST SMPN 14 PONTIANAK
AN ANALYSIS ON VALIDITY AND RELIABILITY OF TEST ITEMS IN PRE-NATIONAL EXAMINATION TEST SMPN 14 PONTIANAK Hanny Pradana, Gatot Sutapa, Luwandi Suhartono Sarjana Degree of English Language Education, Teacher
More informationDiagnosis of Mental Disorders. Historical Background. Rise of the Nomenclatures. History and Clinical Assessment
Diagnosis of Mental Disorders History and Clinical Assessment Historical Background For a long time confusion reigned. Every selfrespecting alienist, and certainly every professor, had his own classification.
More informationValidity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)
Ch. 5: Validity Validity History Griggs v. Duke Power Ricci vs. DeStefano Defining Validity Aspects of Validity Face Validity Content Validity Criterion Validity Construct Validity Reliability vs. Validity
More informationINTRODUCTION TO ASSESSMENT OPTIONS
DEPRESSION A brief guide to the PROMIS Depression instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS-Ca Bank v1.0 Depression PROMIS Pediatric Item Bank v2.0 Depressive Symptoms PROMIS Pediatric
More informationIssues That Should Not Be Overlooked in the Dominance Versus Ideal Point Controversy
Industrial and Organizational Psychology, 3 (2010), 489 493. Copyright 2010 Society for Industrial and Organizational Psychology. 1754-9426/10 Issues That Should Not Be Overlooked in the Dominance Versus
More informationManual Supplement. Posttraumatic Stress Disorder Checklist (PCL)
Manual Supplement V OLUME 1, I SSUE 1 N OVEMBER 18, 2014 Posttraumatic Stress Disorder Checklist (PCL) The Posttraumatic Stress Disorder Checklist (PCL) is one of the most frequently used standardized
More informationSelecting Research Participants. Conducting Experiments, Survey Construction and Data Collection. Practical Considerations of Research
Conducting Experiments, Survey Construction and Data Collection RCS 6740 6/28/04 Practical Considerations of Research This lecture will focus on some of the practical aspects of conducting research studies
More informationSLEEP DISTURBANCE ABOUT SLEEP DISTURBANCE INTRODUCTION TO ASSESSMENT OPTIONS. 6/27/2018 PROMIS Sleep Disturbance Page 1
SLEEP DISTURBANCE A brief guide to the PROMIS Sleep Disturbance instruments: ADULT PROMIS Item Bank v1.0 Sleep Disturbance PROMIS Short Form v1.0 Sleep Disturbance 4a PROMIS Short Form v1.0 Sleep Disturbance
More informationBest on the Left or on the Right in a Likert Scale
Best on the Left or on the Right in a Likert Scale Overview In an informal poll of 150 educated research professionals attending the 2009 Sawtooth Conference, 100% of those who voted raised their hands
More informationAn introduction to personality assessments in the workplace. Getting more from your people.
An introduction to personality assessments in the workplace. Getting more from your people. www.themyersbriggs.com Who are we? We use labels all the time to describe people the strong, silent type, the
More informationPEDIATRIC SLEEP AND AUTISM CLINICAL GLOBAL IMPRESSIONS SCALE
PEDIATRIC SLEEP AND AUTISM CLINICAL GLOBAL IMPRESSIONS SCALE Part I. SLEEP AND AUTISM CLINICAL GLOBAL IMPRESSIONS SCALE SEVERITY (Sleep CGI S) INSTRUCTIONS: Mark the following items for specific symptoms
More informationResults & Statistics: Description and Correlation. I. Scales of Measurement A Review
Results & Statistics: Description and Correlation The description and presentation of results involves a number of topics. These include scales of measurement, descriptive statistics used to summarize
More informationby Peter K. Isquith, PhD, Robert M. Roth, PhD, Gerard A. Gioia, PhD, and PAR Staff
by Peter K. Isquith, PhD, Robert M. Roth, PhD, Gerard A. Gioia, PhD, and PAR Staff Client name : Sample Client Client ID : 321 Gender : Female Age : 27 Test date : Test form : BRIEF-A Informant Report
More informationCHAPTER 2. RESEARCH METHODS AND PERSONALITY ASSESSMENT (64 items)
CHAPTER 2. RESEARCH METHODS AND PERSONALITY ASSESSMENT (64 items) 1. Darwin s point of view about empirical research can be accurately summarized as... a. Any observation is better than no observation
More information5. is the process of moving from the specific to the general. a. Deduction
Applied Social Psychology Understanding and Addressing Social and Practical Problems 3rd Edition Gruman Test Bank Full Download: https://testbanklive.com/download/applied-social-psychology-understanding-and-addressing-social-and-practical-p
More informationPAIN INTERFERENCE. ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS-Ca Bank v1.1 Pain Interference PROMIS-Ca Bank v1.0 Pain Interference*
PROMIS Item Bank v1.1 Pain Interference PROMIS Item Bank v1.0 Pain Interference* PROMIS Short Form v1.0 Pain Interference 4a PROMIS Short Form v1.0 Pain Interference 6a PROMIS Short Form v1.0 Pain Interference
More informationBasic SPSS for Postgraduate
Basic SPSS for Postgraduate Dr. Shamshuritawati Sharif School of Quantitative Science Email : shamshurita@uum.edu.my Office : +6049286336 Mobile :+60194248001 In the process of carrying out the research,
More informationSaville Consulting Wave Professional Styles Handbook
Saville Consulting Wave Professional Styles Handbook PART 4: TECHNICAL Chapter 19: Reliability This manual has been generated electronically. Saville Consulting do not guarantee that it has not been changed
More informationMEASUREMENT THEORY 8/15/17. Latent Variables. Measurement Theory. How do we measure things that aren t material?
MEASUREMENT THEORY Measurement Theory How do we measure things that aren t material? Affect, behavior, cognition Thoughts, feelings, personality, intelligence, etc? Measurement theory: Turning the into
More informationPSYC2600 Lecture One Attitudes
PSYC2600 Lecture One Attitudes 16/07/14 7:01 AM Motivation (Lei, 2010) Intrinsic motivation have an internal motivation, you are interested. Extrinsic motivation have no specific interest, but are motivated
More informationFATIGUE. A brief guide to the PROMIS Fatigue instruments:
FATIGUE A brief guide to the PROMIS Fatigue instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS Ca Bank v1.0 Fatigue PROMIS Pediatric Bank v2.0 Fatigue PROMIS Pediatric Bank v1.0 Fatigue* PROMIS
More informationSURVEY RESEARCH. Topic #9. Measurement and assessment of opinions, attitudes, etc. Usually by means of questionnaires and sampling methods.
ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 15A LECTURE NOTES [04/05/15] SURVEY RESEARCH AGE 1 Topic #9 SURVEY RESEARCH Measurement and assessment of opinions, attitudes, etc. Usually by means of questionnaires
More informationMULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.
381 Exam #2 E Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) An approach to qualitative research that focuses on building theories is known
More informationEffects of Food Labels on Consumer Buying Behaviour of Packaged food Products: a Comparative Study of Male-Female in NCR, India
Effects of Food Labels on Consumer Buying Behaviour of Packaged food Products: a Comparative Study of Male-Female in NCR, India Nivi Srivastava Senior Research Fellow, Department of Applied Economics,
More informationCómo se dice...? An analysis of patient-provider communication through bilingual providers, blue phones and live translators
Rowan University Rowan Digital Works Cooper Medical School of Rowan University Capstone Projects Cooper Medical School of Rowan University 2018 Cómo se dice...? An analysis of patient-provider communication
More information10/9/2018. Ways to Measure Variables. Three Common Types of Measures. Scales of Measurement
Ways to Measure Variables Three Common Types of Measures 1. Self-report measure 2. Observational measure 3. Physiological measure Which operationalization is best? Scales of Measurement Categorical vs.
More informationANXIETY. A brief guide to the PROMIS Anxiety instruments:
ANXIETY A brief guide to the PROMIS Anxiety instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS Bank v1.0 Anxiety PROMIS Short Form v1.0 Anxiety 4a PROMIS Short Form v1.0 Anxiety 6a PROMIS Short
More informationAnimals in Translation TDQs pages 1 8
Animals in Translation TDQs pages 1 8 Reread paragraphs 1 and 2 on page 1 (from People who aren t autistic always ask me about the moment I realized I could understand the way animals think to Autism made
More informationItem Analysis for Beginners
Item Analysis for Beginners John Kleeman Questionmark Executive Director and Founder All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks
More informationTest Validity. What is validity? Types of validity IOP 301-T. Content validity. Content-description Criterion-description Construct-identification
What is? IOP 301-T Test Validity It is the accuracy of the measure in reflecting the concept it is supposed to measure. In simple English, the of a test concerns what the test measures and how well it
More informationDeciding whether a person has the capacity to make a decision the Mental Capacity Act 2005
Deciding whether a person has the capacity to make a decision the Mental Capacity Act 2005 April 2015 Deciding whether a person has the capacity to make a decision the Mental Capacity Act 2005 The RMBI,
More informationConstructing a Three-Part Instrument for Emotional Intelligence, Social Intelligence and Learning Behavior
Constructing a Three-Part Instrument for Emotional Intelligence, Social Intelligence and Learning Behavior Mali Praditsang School of Education & Modern Language, College of Art & Sciences, Universiti Utara
More informationOn the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA
On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA MASARY K UNIVERSITY, CZECH REPUBLIC Overview Background and research aims Focus on RQ2 Introduction
More informationINTRODUCTION TO ASSESSMENT OPTIONS
ASTHMA IMPACT A brief guide to the PROMIS Asthma Impact instruments: PEDIATRIC PROMIS Pediatric Item Bank v2.0 Asthma Impact PROMIS Pediatric Item Bank v1.0 Asthma Impact* PROMIS Pediatric Short Form v2.0
More informationINVESTIGATING FIT WITH THE RASCH MODEL. Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form
INVESTIGATING FIT WITH THE RASCH MODEL Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form of multidimensionality. The settings in which measurement
More informationComparison of Male and Female Response Behaviour on Minnesota Multiphasic Personality Inventory-2
Comparison of Male and Female Response Behaviour on Minnesota Multiphasic Personality Inventory-2 Dr. Hayfa Tayseer Elbokai & Dr. Aziz Ahmad Alrhamneh Special Education Dep., Al- Balqa' Applied University,
More informationThe Psychometric Principles Maximizing the quality of assessment
Summer School 2009 Psychometric Principles Professor John Rust University of Cambridge The Psychometric Principles Maximizing the quality of assessment Reliability Validity Standardisation Equivalence
More informationMaking a psychometric. Dr Benjamin Cowan- Lecture 9
Making a psychometric Dr Benjamin Cowan- Lecture 9 What this lecture will cover What is a questionnaire? Development of questionnaires Item development Scale options Scale reliability & validity Factor
More informationPHYSICAL FUNCTION A brief guide to the PROMIS Physical Function instruments:
PROMIS Bank v1.0 - Physical Function* PROMIS Short Form v1.0 Physical Function 4a* PROMIS Short Form v1.0-physical Function 6a* PROMIS Short Form v1.0-physical Function 8a* PROMIS Short Form v1.0 Physical
More information26:010:557 / 26:620:557 Social Science Research Methods
26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview
More informationPsych 1Chapter 2 Overview
Psych 1Chapter 2 Overview After studying this chapter, you should be able to answer the following questions: 1) What are five characteristics of an ideal scientist? 2) What are the defining elements of
More informationCareer Counseling and Services: A Cognitive Information Processing Approach
Career Counseling and Services: A Cognitive Information Processing Approach James P. Sampson, Jr., Robert C. Reardon, Gary W. Peterson, and Janet G. Lenz Florida State University Copyright 2003 by James
More informationSURVEY TOPIC INVOLVEMENT AND NONRESPONSE BIAS 1
SURVEY TOPIC INVOLVEMENT AND NONRESPONSE BIAS 1 Brian A. Kojetin (BLS), Eugene Borgida and Mark Snyder (University of Minnesota) Brian A. Kojetin, Bureau of Labor Statistics, 2 Massachusetts Ave. N.E.,
More informationABOUT PHYSICAL ACTIVITY
PHYSICAL ACTIVITY A brief guide to the PROMIS Physical Activity instruments: PEDIATRIC PROMIS Pediatric Item Bank v1.0 Physical Activity PROMIS Pediatric Short Form v1.0 Physical Activity 4a PROMIS Pediatric
More informationMarc J. Tassé, PhD Nisonger Center UCEDD
FINALLY... AN ADAPTIVE BEHAVIOR SCALE FOCUSED ON PROVIDING PRECISION AT THE DIAGNOSTIC CUT-OFF. How Item Response Theory Contributed to the Development of the DABS Marc J. Tassé, PhD UCEDD The Ohio State
More informationBiology 321 Lab 1 Measuring behaviour Sept , 2011
1 Goals To introduce the act of observing To examine the types of information collected when observation is unplanned and unstructured To discuss the biases each researcher brings to an observational study
More informationPHYSICAL STRESS EXPERIENCES
PHYSICAL STRESS EXPERIENCES A brief guide to the PROMIS Physical Stress Experiences instruments: PEDIATRIC PROMIS Pediatric Bank v1.0 - Physical Stress Experiences PROMIS Pediatric Short Form v1.0 - Physical
More informationIntroduction to SOCIAL STYLE sm
Introduction to SOCIAL STYLE sm 11 The TRACOM Corporation All Rights Reserved Disconnect -to interrupt; detach Noun; a lack of communication or agreement The TRACOM Corporation All Rights Reserved Reconnect
More informationPsychometric Instrument Development
Psychometric Instrument Development Lecture 6 Survey Research & Design in Psychology James Neill, 2012 Readings: Psychometrics 1. Bryman & Cramer (1997). Concepts and their measurement. [chapter - ereserve]
More informationEVALUATING AND IMPROVING MULTIPLE CHOICE QUESTIONS
DePaul University INTRODUCTION TO ITEM ANALYSIS: EVALUATING AND IMPROVING MULTIPLE CHOICE QUESTIONS Ivan Hernandez, PhD OVERVIEW What is Item Analysis? Overview Benefits of Item Analysis Applications Main
More information7 Mistakes HR Professionals Make When Accommodating Employees Living on the Autism Spectrum By Sarah Taylor
7 Mistakes HR Professionals Make When Accommodating Employees Living on the Autism Spectrum By Sarah Taylor Sarah Taylor - Next Level ASD Consulting - www.nextleveasdconsult.com 1 7 Mistakes HR Professionals
More informationHUMAN-COMPUTER INTERACTION EXPERIMENTAL DESIGN
HUMAN-COMPUTER INTERACTION EXPERIMENTAL DESIGN Professor Bilge Mutlu Computer Sciences, Psychology, & Industrial and Systems Engineering University of Wisconsin Madison CS/Psych-770 Human-Computer Interaction
More informationMEANING AND PURPOSE. ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Meaning and Purpose PROMIS Short Form v1.0 Meaning and Purpose 4a
MEANING AND PURPOSE A brief guide to the PROMIS Meaning and Purpose instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Meaning and Purpose PROMIS Short Form v1.0 Meaning and Purpose 4a PROMIS
More informationTopics for today Ethics Bias
HCI and Design Topics for today Ethics Bias What are ethics? The study of moral standards and how they affect conduct Moral standards are A system of principles governing the appropriate conduct of an
More informationChapter 6: Attribution Processes
Chapter 6: Attribution Processes 1. Which of the following is an example of an attributional process in social cognition? a. The act of planning the actions to take given a social situation b. The act
More informationEVMS Authorship Guidelines
EVMS Authorship Guidelines Many medical schools, including Eastern Virginia Medical School, encourage the publication and dissemination of results from research and other scholarly activities in a manner
More informationDFCI IRB RECOMMENDED CONSENT LANGUAGE RELATING TO RETURN OF RESEARCH RESULTS
Consent Language Office for Human Research Studies DANA-FARBER / HARVARD CANCER CENTER DFCI IRB RECOMMENDED CONSENT LANGUAGE RELATING TO RETURN OF RESEARCH RESULTS This Information Sheet provides investigators
More informationUrsuline College Accelerated Program
Ursuline College Accelerated Program CRITICAL INFORMATION! DO NOT SKIP THIS LINK BELOW... BEFORE PROCEEDING TO READ THE UCAP MODULE, YOU ARE EXPECTED TO READ AND ADHERE TO ALL UCAP POLICY INFORMATION CONTAINED
More informationTechnical Specifications
Technical Specifications In order to provide summary information across a set of exercises, all tests must employ some form of scoring models. The most familiar of these scoring models is the one typically
More informationInterviewing, Structured and Unstructured
Interviewing, Structured and Unstructured Department of Government London School of Economics and Political Science 1 Participant Observation 2 Questionnaire Methods Recall-type Questions Evaluative Questions
More informationUnconscious Bias: From Awareness to Action!
Unconscious Bias: From Awareness to Action! Did you know that we all have unconscious bias, and that we each have a responsibility to prevent its unintended consequences? In this course, we will explore
More informationSurvey Question. What are appropriate methods to reaffirm the fairness, validity reliability and general performance of examinations?
Clause 9.3.5 Appropriate methodology and procedures (e.g. collecting and maintaining statistical data) shall be documented and implemented in order to affirm, at justified defined intervals, the fairness,
More informationModes of Measurement. Outline. Modes of Measurement. PSY 395 Oswald
Modes of Measurement PSY 395 Oswald Outline Modes of Measurement Direct questioning Paper-and-pencil Face-to-face Telephone Interviews Newer Modes Internet Experience Sampling Implicit measures Third-party
More informationChapter 13. Social Psychology
Social Psychology Psychology, Fifth Edition, James S. Nairne What s It For? Social Psychology Interpreting the Behavior of Others Behaving in the Presence of Others Establishing Relations With Others Social
More informationGENERALIZABILITY AND RELIABILITY: APPROACHES FOR THROUGH-COURSE ASSESSMENTS
GENERALIZABILITY AND RELIABILITY: APPROACHES FOR THROUGH-COURSE ASSESSMENTS Michael J. Kolen The University of Iowa March 2011 Commissioned by the Center for K 12 Assessment & Performance Management at
More informationGENERAL SELF-EFFICACY AND SELF-EFFICACY FOR MANAGING CHRONIC CONDITIONS
GENERAL SELF-EFFICACY AND SELF-EFFICACY FOR MANAGING CHRONIC CONDITIONS A brief guide to the PROMIS Self-Efficacy Instruments ADULT PROMIS Item Bank v1.0 General Self-Efficacy PROMIS Short Form v1.0 General
More informationReliability of feedback fechanism based on root cause defect analysis - case study
Annales UMCS Informatica AI XI, 4 (2011) 21 32 DOI: 10.2478/v10065-011-0037-0 Reliability of feedback fechanism based on root cause defect analysis - case study Marek G. Stochel 1 1 Motorola Solutions
More informationQuestionnaires and Surveys
Questionnaires and Surveys What are Questionnaires and Surveys? Structured set of questions delivered either: Orally Pen and paper Mail Online Not strictly qualitative - More structured than many qualitative
More informationCOGNITIVE FUNCTION. PROMIS Pediatric Item Bank v1.0 Cognitive Function PROMIS Pediatric Short Form v1.0 Cognitive Function 7a
COGNITIVE FUNCTION A brief guide to the PROMIS Cognitive Function instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Applied Cognition - Abilities* PROMIS Item Bank v1.0 Applied Cognition
More informationInternal Consistency and Reliability of the Networked Minds Measure of Social Presence
Internal Consistency and Reliability of the Networked Minds Measure of Social Presence Chad Harms Iowa State University Frank Biocca Michigan State University Abstract This study sought to develop and
More information