Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Similar documents
Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Survey Question. What are appropriate methods to reaffirm the fairness, validity reliability and general performance of examinations?

ADMS Sampling Technique and Survey Studies

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics 1-7. EDCI Intro to Research Dr. A.J. Herrera

THE APPLICATION OF ORDINAL LOGISTIC HEIRARCHICAL LINEAR MODELING IN ITEM RESPONSE THEORY FOR THE PURPOSES OF DIFFERENTIAL ITEM FUNCTIONING DETECTION

Empirical Knowledge: based on observations. Answer questions why, whom, how, and when.

Empowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison

Statistics for Psychosocial Research Session 1: September 1 Bill

LANGUAGE TEST RELIABILITY On defining reliability Sources of unreliability Methods of estimating reliability Standard error of measurement Factors

Chapter 6. Methods of Measuring Behavior Pearson Prentice Hall, Salkind. 1

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

Reliability and Validity checks S-005

Lecture Week 3 Quality of Measurement Instruments; Introduction SPSS

Ursuline College Accelerated Program

Reliability AND Validity. Fact checking your instrument

Measurement and Descriptive Statistics. Katie Rommel-Esham Education 604


CHAPTER III RESEARCH METHOD. method the major components include: Research Design, Research Site and

and Screening Methodological Quality (Part 2: Data Collection, Interventions, Analysis, Results, and Conclusions A Reader s Guide

TESTING AND MEASUREMENT. MERVE DENİZCİ NAZLIGÜL, M.S. Çankaya University

Types of Tests. Measurement Reliability. Most self-report tests used in Psychology and Education are objective tests :

Introduction to Reliability

Developmental Assessment of Young Children Second Edition (DAYC-2) Summary Report

Measurement of Constructs in Psychosocial Models of Health Behavior. March 26, 2012 Neil Steers, Ph.D.

AQ Intervention for Assessing and Counseling Students of Color

Validity, Reliability, and Defensibility of Assessments in Veterinary Education

Construct Reliability and Validity Update Report

Testing and Intelligence. What We Will Cover in This Section. Psychological Testing. Intelligence. Reliability Validity Types of tests.

Chapter 3. Psychometric Properties

AP PSYCH Unit 11.2 Assessing Intelligence

Examining the Psychometric Properties of The McQuaig Occupational Test

Psychological testing


Reliability Theory for Total Test Scores. Measurement Methods Lecture 7 2/27/2007

Chapter 3 Psychometrics: Reliability and Validity

ESTABLISHING VALIDITY AND RELIABILITY OF ACHIEVEMENT TEST IN BIOLOGY FOR STD. IX STUDENTS

Estimates of the Reliability and Criterion Validity of the Adolescent SASSI-A2

CHAPTER 3 METHOD AND PROCEDURE

TESTING AND INDIVIDUAL DIFFERENCES. AP Psychology

METHOD. The following psychological measures/ tests were used in this study:

Validity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)

Chapter 15 PSYCHOLOGICAL TESTS

Sociodemographic Effects on the Test-Retest Reliability of the Big Five Inventory. Timo Gnambs. Osnabrück University. Author Note

Validation of Scales

Importance of Good Measurement

Abstract Reasoning Test 1

Validity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)

RELIABILITY AND VALIDITY (EXTERNAL AND INTERNAL)

Overview of Experimentation

Reliability & Validity Dr. Sudip Chaudhuri

No part of this page may be reproduced without written permission from the publisher. (

5/6/2008. Psy 427 Cal State Northridge Andrew Ainsworth PhD

ORIGINS AND DISCUSSION OF EMERGENETICS RESEARCH

Self Report Measures

English 10 Writing Assessment Results and Analysis

Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that

Myers Psychology for AP, 2e

DATA is derived either through. Self-Report Observation Measurement

Test Validity. What is validity? Types of validity IOP 301-T. Content validity. Content-description Criterion-description Construct-identification

CHAPTER 3. Research Methodology

NEUROPSYCHOLOGICAL ASSESSMENT S A R A H R A S K I N, P H D, A B P P S A R A H B U L L A R D, P H D, A B P P

Answer Key to Problem Set #1

Comparability Study of Online and Paper and Pencil Tests Using Modified Internally and Externally Matched Criteria

Does the Use of Personality Inventory Cause Bias on Assessment Center Results Because of Social Desirability? Yasin Rofcanin Levent Sevinç

Ch. 11 Measurement. Paul I-Hai Lin, Professor A Core Course for M.S. Technology Purdue University Fort Wayne Campus

Empirical Demonstration of Techniques for Computing the Discrimination Power of a Dichotomous Item Response Test

The relationship of five personality factors with the feeling of happiness among students

Testing and Individual Differences

Construction of an Attitude Scale towards Teaching Profession: A Study among Secondary School Teachers in Mizoram

How to Measure Attitudes. From: Simonson, M.R. (1979). Attitude measurement: Why and how. Educational Technology, 19,

Reliability and Validity

Excellence in Prevention descriptions of the prevention

The Discovering Diversity Profile Research Report

On the purpose of testing:

Making a psychometric. Dr Benjamin Cowan- Lecture 9

Chapter 9: Intelligence and Psychological Testing

11-3. Learning Objectives

GO TO TEACHER TRAINING REPORT FOR NEWFOUNDLAND

Psychometrics for Beginners. Lawrence J. Fabrey, PhD Applied Measurement Professionals

THE USE OF CRONBACH ALPHA RELIABILITY ESTIMATE IN RESEARCH AMONG STUDENTS IN PUBLIC UNIVERSITIES IN GHANA.

Class 7 Everything is Related

Manfred M. Straehle, Ph.D. Prometric, Inc. Rory McCorkle, MBA Project Management Institute (PMI)

Ch. 11 Measurement. Measurement

What Works Clearinghouse

Chronicles of Dental Research

Separation Anxiety Inventory: Validity and Reliability Study

Cognitive-Behavioral Assessment of Depression: Clinical Validation of the Automatic Thoughts Questionnaire

Doctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, The Scientific Method of Problem Solving

Tech Talk: Using the Lafayette ESS Report Generator

Measurement of Resilience Barbara Resnick, PHD,CRNP

Supplementary Online Content

UNIT 2 SCALES AND TESTS

6. Assessment. 3. Skew This is the degree to which a distribution of scores is not normally distributed. Positive skew

Testing & Assessment Techniques

Key words: State-Trait Anger, Anger Expression, Anger Control, FSTAXI-2, reliability, validity.

Psychological testing

DATA GATHERING. Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings.

Transcription:

Homework assignment topics 32-36 Georgina Salas Topics 32-36 EDCI Intro to Research 6300.62 Dr. A.J. Herrera

Topic 32 1. Researchers need to use at least how many observers to determine interobserver reliability? Researchers need to use at least 2 observers. 2. When there are two quantitative scores per participant, researchers can compute what statistic to describe reliability? Researchers can compute correlation coefficient 3. Do researchers usually measure at two different points in the same time to estimate interobserver reliability? Researchers measure at the same time. 4. Do researchers usually measure at two different points in the same time to estimate test-retest reliability? Yes, they do. 5. According to this topic, most published tests have reliability coefficients that are about how high?.80 or higher 6. According to this topic, serviceable reliability coefficients may be how low if researchers are examining group averages?.50 to be serviceable

Topic 33 1. Which two methods for estimating reliability require two testing sessions? Test-retest reliability and parallel-forms reliability 2. Does the split-half method require one or two administrations of a test? One administration of a test. 3. What is meant by an odd-even split? Researchers score all the odd numbered items and obtain a score. Then they score all the even numbered items and obtain a second score. 4. If a split-half reliability coefficient equals 0.00, what does this indicate? 0.00 indicates a complete absence of reliability. 5. What is the highest possible value for a split-half reliability coefficient? The highest possible value is 1.0. 6. To obtain alpha, mathematical procedures are used to obtain the equivalent of what? It obtains the equivalent of the average of all possible split-half reliability coefficients. 7. Does alpha estimate the consistency of scores over time? No, it does not.

Topic 34 1. A norm-referenced test is designed to facilitate a comparison of an individual s performance with what? A norm group. 2. Are norm groups always national samples? Yes, they are. 3. What is the definition of a criterion-referenced test? Criterion-referenced test is when tests are designed to measure the extent to which individual examinees have met performance standards. 4. In which type of test are items answered correctly by about 50% of the participants favored in item selections? Norm-referenced tests 5. In which type of test are items typically selected on the basis of content they cover without regard to item difficulty? Criterion-referenced test 6. Which type of test should be used in research where the purpose is to describe specifically what examinees can and cannot do? Criterion-referenced test

Topic 35 1. Which type of test is designed to predict achievement in general? Intelligence test 2. An algebra prognosis test is an example of what type of test? Aptitude test 3. A test designed to measure how much students learn in a particular course in school is what type of test? Achievement test 4. A test designed to predict success in learning a new set of skills is what type of test? Aptitude test 5. A list of desirable characteristics of a product or performance is known as what? Checklist 6. How can researchers increase the reliability of scoring essays, products, and performance? Create a checklist and rating scale 7. According to this topic, are intelligence tests good measures of innate ability? No 8. According to this topic, how valid are commercially published aptitude tests? Low to modest validity

Topic 36 1. Do researchers usually want participants to show their best when measuring personality traits? Yes, they do. 2. In this topic, what is the main reason for administering personality measures anonymously? Reduce social desirability 3. What do researchers reduce by observing behavior unobtrusively? Social desirability 4. Loosely structured stimuli are used in which type of personality measure? Projective techniques 5. According to this topic, which type of personality measure is seldom used in personality research? Projective techniques 6. What is the range of choice in a Likert-type scale? Strongly agree to strongly disagree 7. Is content validity a relevant concern when assessing the validity of a Likerttype scale for measuring attitudes? Yes, it is.