ADMS Sampling Technique and Survey Studies

Size: px
Start display at page:

Download "ADMS Sampling Technique and Survey Studies"

Transcription

1 Principles of Measurement Measurement As a way of understanding, evaluating, and differentiating characteristics Provides a mechanism to achieve precision in this understanding, the extent or quality As a basis for setting standard, making decision or making conclusion The ability to measure a variable, no matter how indirectly, is dependent on the definition Criteria for assigning values and units to variables must be systematic, objectivity Some rules of measurements are obvious and easy to learn. Others require rigorous training and practice for the instruments to be applied efficiently The exactness of a measure is referred to as the precision Directness of Measurement Direct measurement Few measurements (variables) are measured directly Do you think temperature is measured directly? We do not observe temperature! Indirect measurement Direct observation to infer a value for a more abstract phenomenon Sensitivity Simply not available: abstract constructs which are defined as a function of many interrelated concepts 1

2 Levels of Measurement Nominal: discrete categories, mutually exclusive, Gender, ethnic background Ordinal: rank ordering of the values, not equal distance between values e.g. Income range, disease stage, likert scales Interval: continuous, equal numeric distance between equal length intervals Does not provide the absolute amount of attribute because of the absence of zero on the interval e.g. A temperature of 0 degree does not represent an absence of temperature Ratio: continuous measurement, has an absolute zero point that has empirical meaning e.g. weight (because of the existence of absolute zero, justify to say 50 kg doubles 100 kg), age, force Multiple Measures of an Abstract Concept Locating existing instruments Evaluate existing instruments Assess readability and levels of measurements Reliability Concern with how consistently the measurement technique measures the concept of interest and free from error Many reliability coefficients are based on measures of correlation Correlation indicates how sets of measurements vary together, but does not tell the extent of the agreement between them 2

3 Measurement Error The difference between the true value and the observed value Systematic error: Predictable errors of measurements Source of bias, Constant and therefore do not present a problem for reliability regression towards the mean: extreme values tend to move closer to the average Random error: Error due to chance Affects accuracy of measurement Many sources of error can be attributed to inaccuracy of instruments, variability of the characteristic being measured, rater differences, Can be minimized by careful planning, clear operational definitions, and inspection of instruments / equipment Stability: concerned with the consistency of repeated measures or testretest reliability Test-retest reliability: testing effects, rater bias, test-retest intervals, intra-rater reliability Equivalence: consistency between two versions of the same instrument (alternate form reliability) or two observers (inter-rater reliability) Homogeneity: correlation among items within an instrument, internal consistency, determined by Cronbach s alpha coefficient, split-half reliability 3

4 Validity The extent to which an instrument reflects the concept being examined Face validity: appears valid Content validity: Adequacy with which the universe is sampled by a test, representative of the whole, no statistical index to assess content validity (Waltz and Bausell s Index of content validity CVI, 1981) Readibility (The Fog Index of readibility) Validity from contrasting groups (Hagerty and Patusky s sense of belonging instrument tested among community college, patients with major depression, and retired Roman catholic nun) Criterion-related validity: validity from examining convergence (correlation with established instruments/gold standard); concurrent (two tests implement at the same time / predicting concurrent event) and predictive validity (establish a measure which will be a valid predictor of some future criterion score / event) Validity from examining divergence (negative correlation with an instrument measuring a totally opposite construct) Known group method: test the instrument and compare with the expected results Validity from discriminant analysis (test the discriminant power of the instrument) Successive verification of validity / cross validation Multitrait-Multimethod correlation: Measures reflect similar underlying phenomenon as the one under test will yield similar results and hence highly correlated. Those measure different traits produce low or negative correlations 4

5 Screening Many measuring instruments are designed as screening tools Sensitivity: The test s ability to detect the true positive (detect the disease correctly) Specificity: The test s ability to detect the true negative (conclude the absence of disease correctly) A highly specific instrument rarely tests positive if a person does not have the disease. Measurement Strategies Physiologic measures: e.g. blood pressure, ECG, blood glucose, creatinine clearance, Objective direct measurements Observations: unstructured observations or structured (checklist, categorization, rating); Direct or indirect Interviews: unstructured or structured, need training or pilot testing, probing and recording Questionnaires: open-ended, closed-ended, do it in person/ phone/ mail/ selfadministered 5

6 Scales: Verbal (mild, moderate, severe, very severe) Numeric (no pain a great deal of pain) Likert scale (disagree strongly agree strongly) Semantic differential e.g. men with tattoos are: traditional progressive wise foolish Visual analog scale (worst possible pain No pain) 5 cm Development: Define concepts, design scales, item review, preliminary test, item analyses, refine instrument, validity check, reliability check, compile norms on scale, publish result, further test in fields, refine if necessary Delphi technique 1. To measure judgement of experts, assess priority or making forecasts 2. Questionnaires were sent and results were summarized for another round of opinion 3. Feedback on the consensus of the group tends to centralize opinion Conclusion could be misleading. Projective techniques Assumption: Response under unstructured and ambiguous situations reflects attitude, desires, personality, and motives. Inferences are made on the meaning of activities or behaviours under the mentioned situations. E.g Interpreting children s painting Diaries 6

7 7

11-3. Learning Objectives

11-3. Learning Objectives 11-1 Measurement Learning Objectives 11-3 Understand... The distinction between measuring objects, properties, and indicants of properties. The similarities and differences between the four scale types

More information

N Utilization of Nursing Research in Advanced Practice, Summer 2008

N Utilization of Nursing Research in Advanced Practice, Summer 2008 University of Michigan Deep Blue deepblue.lib.umich.edu 2008-07 N 536 - Utilization of Nursing Research in Advanced Practice, Summer 2008 Tzeng, Huey-Ming Tzeng, H. (2008, October 1). Utilization of Nursing

More information

VARIABLES AND MEASUREMENT

VARIABLES AND MEASUREMENT ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 16A LECTURE NOTES [01/29/16] VARIABLES AND MEASUREMENT AGE 1 Topic #3 VARIABLES AND MEASUREMENT VARIABLES Some definitions of variables include the following: 1.

More information

DATA is derived either through. Self-Report Observation Measurement

DATA is derived either through. Self-Report Observation Measurement Data Management DATA is derived either through Self-Report Observation Measurement QUESTION ANSWER DATA DATA may be from Structured or Unstructured questions? Quantitative or Qualitative? Numerical or

More information

alternate-form reliability The degree to which two or more versions of the same test correlate with one another. In clinical studies in which a given function is going to be tested more than once over

More information

PÄIVI KARHU THE THEORY OF MEASUREMENT

PÄIVI KARHU THE THEORY OF MEASUREMENT PÄIVI KARHU THE THEORY OF MEASUREMENT AGENDA 1. Quality of Measurement a) Validity Definition and Types of validity Assessment of validity Threats of Validity b) Reliability True Score Theory Definition

More information

CHAPTER VI RESEARCH METHODOLOGY

CHAPTER VI RESEARCH METHODOLOGY CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the

More information

Reliability and Validity checks S-005

Reliability and Validity checks S-005 Reliability and Validity checks S-005 Checking on reliability of the data we collect Compare over time (test-retest) Item analysis Internal consistency Inter-rater agreement Compare over time Test-Retest

More information

Collecting & Making Sense of

Collecting & Making Sense of Collecting & Making Sense of Quantitative Data Deborah Eldredge, PhD, RN Director, Quality, Research & Magnet Recognition i Oregon Health & Science University Margo A. Halm, RN, PhD, ACNS-BC, FAHA Director,

More information

MEASUREMENT, SCALING AND SAMPLING. Variables

MEASUREMENT, SCALING AND SAMPLING. Variables MEASUREMENT, SCALING AND SAMPLING Variables Variables can be explained in different ways: Variable simply denotes a characteristic, item, or the dimensions of the concept that increases or decreases over

More information

Ch. 11 Measurement. Measurement

Ch. 11 Measurement. Measurement TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture

More information

Measurement and Descriptive Statistics. Katie Rommel-Esham Education 604

Measurement and Descriptive Statistics. Katie Rommel-Esham Education 604 Measurement and Descriptive Statistics Katie Rommel-Esham Education 604 Frequency Distributions Frequency table # grad courses taken f 3 or fewer 5 4-6 3 7-9 2 10 or more 4 Pictorial Representations Frequency

More information

Ch. 11 Measurement. Paul I-Hai Lin, Professor A Core Course for M.S. Technology Purdue University Fort Wayne Campus

Ch. 11 Measurement. Paul I-Hai Lin, Professor  A Core Course for M.S. Technology Purdue University Fort Wayne Campus TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture

More information

Test Validity. What is validity? Types of validity IOP 301-T. Content validity. Content-description Criterion-description Construct-identification

Test Validity. What is validity? Types of validity IOP 301-T. Content validity. Content-description Criterion-description Construct-identification What is? IOP 301-T Test Validity It is the accuracy of the measure in reflecting the concept it is supposed to measure. In simple English, the of a test concerns what the test measures and how well it

More information

32.5. percent of U.S. manufacturers experiencing unfair currency manipulation in the trade practices of other countries.

32.5. percent of U.S. manufacturers experiencing unfair currency manipulation in the trade practices of other countries. TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture

More information

Collecting & Making Sense of

Collecting & Making Sense of Collecting & Making Sense of Quantitative Data Deborah Eldredge, PhD, RN Director, Quality, Research & Magnet Recognition i Oregon Health & Science University Margo A. Halm, RN, PhD, ACNS-BC, FAHA Director,

More information

Variable Measurement, Norms & Differences

Variable Measurement, Norms & Differences Variable Measurement, Norms & Differences 1 Expectations Begins with hypothesis (general concept) or question Create specific, testable prediction Prediction can specify relation or group differences Different

More information

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera Homework assignment topics 32-36 Georgina Salas Topics 32-36 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 32 1. Researchers need to use at least how many observers to determine interobserver reliability?

More information

PTHP 7101 Research 1 Chapter Assignments

PTHP 7101 Research 1 Chapter Assignments PTHP 7101 Research 1 Chapter Assignments INSTRUCTIONS: Go over the questions/pointers pertaining to the chapters and turn in a hard copy of your answers at the beginning of class (on the day that it is

More information

2 Types of psychological tests and their validity, precision and standards

2 Types of psychological tests and their validity, precision and standards 2 Types of psychological tests and their validity, precision and standards Tests are usually classified in objective or projective, according to Pasquali (2008). In case of projective tests, a person is

More information

Measurement. 500 Research Methods Mike Kroelinger

Measurement. 500 Research Methods Mike Kroelinger Measurement 500 Research Methods Mike Kroelinger Levels of Measurement Nominal Lowest level -- used to classify variables into two or more categories. Cases placed in the same category must be equivalent.

More information

Measurement is the process of observing and recording the observations. Two important issues:

Measurement is the process of observing and recording the observations. Two important issues: Farzad Eskandanian Measurement is the process of observing and recording the observations. Two important issues: 1. Understanding the fundamental ideas: Levels of measurement: nominal, ordinal, interval

More information

Basic SPSS for Postgraduate

Basic SPSS for Postgraduate Basic SPSS for Postgraduate Dr. Shamshuritawati Sharif School of Quantitative Science Email : shamshurita@uum.edu.my Office : +6049286336 Mobile :+60194248001 In the process of carrying out the research,

More information

Introduction to Reliability

Introduction to Reliability Reliability Thought Questions: How does/will reliability affect what you do/will do in your future job? Which method of reliability analysis do you find most confusing? Introduction to Reliability What

More information

Reliability. Internal Reliability

Reliability. Internal Reliability 32 Reliability T he reliability of assessments like the DECA-I/T is defined as, the consistency of scores obtained by the same person when reexamined with the same test on different occasions, or with

More information

CHAPTER 4 THE QUESTIONNAIRE DESIGN /SOLUTION DESIGN. This chapter contains explanations that become a basic knowledge to create a good

CHAPTER 4 THE QUESTIONNAIRE DESIGN /SOLUTION DESIGN. This chapter contains explanations that become a basic knowledge to create a good CHAPTER 4 THE QUESTIONNAIRE DESIGN /SOLUTION DESIGN This chapter contains explanations that become a basic knowledge to create a good questionnaire which is able to meet its objective. Just like the thesis

More information

Lecture (chapter 1): Introduction

Lecture (chapter 1): Introduction Lecture (chapter 1): Introduction Ernesto F. L. Amaral January 17, 2018 Advanced Methods of Social Research (SOCI 420) Source: Healey, Joseph F. 2015. Statistics: A Tool for Social Research. Stamford:

More information

Reliability AND Validity. Fact checking your instrument

Reliability AND Validity. Fact checking your instrument Reliability AND Validity Fact checking your instrument General Principles Clearly Identify the Construct of Interest Use Multiple Items Use One or More Reverse Scored Items Use a Consistent Response Format

More information

Title: The Theory of Planned Behavior (TPB) and Texting While Driving Behavior in College Students MS # Manuscript ID GCPI

Title: The Theory of Planned Behavior (TPB) and Texting While Driving Behavior in College Students MS # Manuscript ID GCPI Title: The Theory of Planned Behavior (TPB) and Texting While Driving Behavior in College Students MS # Manuscript ID GCPI-2015-02298 Appendix 1 Role of TPB in changing other behaviors TPB has been applied

More information

EPIDEMIOLOGY. Training module

EPIDEMIOLOGY. Training module 1. Scope of Epidemiology Definitions Clinical epidemiology Epidemiology research methods Difficulties in studying epidemiology of Pain 2. Measures used in Epidemiology Disease frequency Disease risk Disease

More information

DEVELOPING INSTRUMENT - IDENTIFYING VARIABLES

DEVELOPING INSTRUMENT - IDENTIFYING VARIABLES DCE 3002 Metodologi Penyelidikan KULIAH/AMALI DEVELOPING INSTRUMENT - IDENTIFYING VARIABLES Dr. Zoharah Omar 1 Data collection Gather information about one s study Method of data collection: Qualitative

More information

Chronicles of Dental Research

Chronicles of Dental Research REVIEW ARTICLE Validity and reliability of a questionnaire: a literature review Shyamalima Bhattacharyya 1 Ramneek Kaur 1 Sukirat Kaur 1 Syed Amaan Ali 1 Abstarct Questionnaires form an important part

More information

Variables in Research. What We Will Cover in This Section. What Does Variable Mean?

Variables in Research. What We Will Cover in This Section. What Does Variable Mean? Variables in Research 9/20/2005 P767 Variables in Research 1 What We Will Cover in This Section Nature of variables. Measuring variables. Reliability. Validity. Measurement Modes. Issues. 9/20/2005 P767

More information

Making a psychometric. Dr Benjamin Cowan- Lecture 9

Making a psychometric. Dr Benjamin Cowan- Lecture 9 Making a psychometric Dr Benjamin Cowan- Lecture 9 What this lecture will cover What is a questionnaire? Development of questionnaires Item development Scale options Scale reliability & validity Factor

More information

Empowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison

Empowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison Empowered by Psychometrics The Fundamentals of Psychometrics Jim Wollack University of Wisconsin Madison Psycho-what? Psychometrics is the field of study concerned with the measurement of mental and psychological

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

Bijay Lal Pradhan, M Sc Statistics, FDPM (IIMA) 2

Bijay Lal Pradhan, M Sc Statistics, FDPM (IIMA) 2 Bijay Lal Pradhan Measurement and Scaling 1) Definition of measurement and scale 2) Type of Physical scale i. Nominal Scale iii. Interval scale ii. Ordinal Scale iv. Ratio Scale 3) Need of scaling 4) Criteria

More information

and Screening Methodological Quality (Part 2: Data Collection, Interventions, Analysis, Results, and Conclusions A Reader s Guide

and Screening Methodological Quality (Part 2: Data Collection, Interventions, Analysis, Results, and Conclusions A Reader s Guide 03-Fink Research.qxd 11/1/2004 10:57 AM Page 103 3 Searching and Screening Methodological Quality (Part 2: Data Collection, Interventions, Analysis, Results, and Conclusions A Reader s Guide Purpose of

More information

Survey Research. We can learn a lot simply by asking people what we want to know... THE PREVALENCE OF SURVEYS IN COMMUNICATION RESEARCH

Survey Research. We can learn a lot simply by asking people what we want to know... THE PREVALENCE OF SURVEYS IN COMMUNICATION RESEARCH Survey Research From surveys we can learn how large groups of people think and act. To trust generalizations made on the basis of surveys, however, the sample must be representative, the response rate

More information

Measures. David Black, Ph.D. Pediatric and Developmental. Introduction to the Principles and Practice of Clinical Research

Measures. David Black, Ph.D. Pediatric and Developmental. Introduction to the Principles and Practice of Clinical Research Introduction to the Principles and Practice of Clinical Research Measures David Black, Ph.D. Pediatric and Developmental Neuroscience, NIMH With thanks to Audrey Thurm Daniel Pine With thanks to Audrey

More information

Research Questions and Survey Development

Research Questions and Survey Development Research Questions and Survey Development R. Eric Heidel, PhD Associate Professor of Biostatistics Department of Surgery University of Tennessee Graduate School of Medicine Research Questions 1 Research

More information

Chapter 4: Defining and Measuring Variables

Chapter 4: Defining and Measuring Variables Chapter 4: Defining and Measuring Variables A. LEARNING OUTCOMES. After studying this chapter students should be able to: Distinguish between qualitative and quantitative, discrete and continuous, and

More information

Lecture Week 3 Quality of Measurement Instruments; Introduction SPSS

Lecture Week 3 Quality of Measurement Instruments; Introduction SPSS Lecture Week 3 Quality of Measurement Instruments; Introduction SPSS Introduction to Research Methods & Statistics 2013 2014 Hemmo Smit Overview Quality of Measurement Instruments Introduction SPSS Read:

More information

Readings: Textbook readings: OpenStax - Chapters 1 4 Online readings: Appendix D, E & F Online readings: Plous - Chapters 1, 5, 6, 13

Readings: Textbook readings: OpenStax - Chapters 1 4 Online readings: Appendix D, E & F Online readings: Plous - Chapters 1, 5, 6, 13 Readings: Textbook readings: OpenStax - Chapters 1 4 Online readings: Appendix D, E & F Online readings: Plous - Chapters 1, 5, 6, 13 Introductory comments Describe how familiarity with statistical methods

More information

Validity and reliability of measurements

Validity and reliability of measurements Validity and reliability of measurements 2 Validity and reliability of measurements 4 5 Components in a dataset Why bother (examples from research) What is reliability? What is validity? How should I treat

More information

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions Readings: OpenStax Textbook - Chapters 1 5 (online) Appendix D & E (online) Plous - Chapters 1, 5, 6, 13 (online) Introductory comments Describe how familiarity with statistical methods can - be associated

More information

Empirical Knowledge: based on observations. Answer questions why, whom, how, and when.

Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. INTRO TO RESEARCH METHODS: Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. Experimental research: treatments are given for the purpose of research. Experimental group

More information

CHAPTER 3 METHOD AND PROCEDURE

CHAPTER 3 METHOD AND PROCEDURE CHAPTER 3 METHOD AND PROCEDURE Previous chapter namely Review of the Literature was concerned with the review of the research studies conducted in the field of teacher education, with special reference

More information

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions Readings: OpenStax Textbook - Chapters 1 5 (online) Appendix D & E (online) Plous - Chapters 1, 5, 6, 13 (online) Introductory comments Describe how familiarity with statistical methods can - be associated

More information

Importance of Good Measurement

Importance of Good Measurement Importance of Good Measurement Technical Adequacy of Assessments: Validity and Reliability Dr. K. A. Korb University of Jos The conclusions in a study are only as good as the data that is collected. The

More information

DATA GATHERING. Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings.

DATA GATHERING. Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings. DATA GATHERING Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings. 2012 John Wiley & Sons Ltd. Measurement Measurement: the assignment

More information

Validity and reliability of measurements

Validity and reliability of measurements Validity and reliability of measurements 2 3 Request: Intention to treat Intention to treat and per protocol dealing with cross-overs (ref Hulley 2013) For example: Patients who did not take/get the medication

More information

Validity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)

Validity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971) Ch. 5: Validity Validity History Griggs v. Duke Power Ricci vs. DeStefano Defining Validity Aspects of Validity Face Validity Content Validity Criterion Validity Construct Validity Reliability vs. Validity

More information

Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that

Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that it purports to perform. Does an indicator accurately

More information

Validity and Reliability. PDF Created with deskpdf PDF Writer - Trial ::

Validity and Reliability. PDF Created with deskpdf PDF Writer - Trial :: Validity and Reliability PDF Created with deskpdf PDF Writer - Trial :: http://www.docudesk.com Validity Is the translation from concept to operationalization accurately representing the underlying concept.

More information

Reliability and Validity

Reliability and Validity Reliability and Today s Objectives Understand the difference between reliability and validity Understand how to develop valid indicators of a concept Reliability and Reliability How accurate or consistent

More information

On the purpose of testing:

On the purpose of testing: Why Evaluation & Assessment is Important Feedback to students Feedback to teachers Information to parents Information for selection and certification Information for accountability Incentives to increase

More information

AXIS critical Appraisal of cross sectional Studies

AXIS critical Appraisal of cross sectional Studies AXIS critical Appraisal of cross sectional Studies Dr. Martin Downes @mjdepi Critical appraisal Systematic evaluation of clinical research to examine Trustworthiness. Valid methods and reporting Clear

More information

how good is the Instrument? Dr Dean McKenzie

how good is the Instrument? Dr Dean McKenzie how good is the Instrument? Dr Dean McKenzie BA(Hons) (Psychology) PhD (Psych Epidemiology) Senior Research Fellow (Abridged Version) Full version to be presented July 2014 1 Goals To briefly summarize

More information

Chapter 6. Methods of Measuring Behavior Pearson Prentice Hall, Salkind. 1

Chapter 6. Methods of Measuring Behavior Pearson Prentice Hall, Salkind. 1 Chapter 6 Methods of Measuring Behavior 2009 Pearson Prentice Hall, Salkind. 1 CHAPTER OVERVIEW Tests and Their Development Types of Tests Observational Techniques Questionnaires 2009 Pearson Prentice

More information

Validation of Scales

Validation of Scales Validation of Scales ἀγεωμέτρητος μηδεὶς εἰσίτω (Let none enter without a knowledge of mathematics) D R D I N E S H R A M O O Introduction Validity and validation are crucial to understanding psychological

More information

DATA GATHERING METHOD

DATA GATHERING METHOD DATA GATHERING METHOD Dr. Sevil Hakimi Msm. PhD. THE NECESSITY OF INSTRUMENTS DEVELOPMENT Good researches in health sciences depends on good measurement. The foundation of all rigorous research designs

More information

Measurement page 1. Measurement

Measurement page 1. Measurement Measurement page 1 Measurement In every study, researchers will measure behavior. The behavior could be overt (obvious, easily visible) such as bumping into someone or saying something, or it could be

More information

Measurement. Different terminology. Marketing managers work with abstractions. Different terminology. Different terminology.

Measurement. Different terminology. Marketing managers work with abstractions. Different terminology. Different terminology. Different terminology Managerial view Marketing managers work with abstractions Concepts A generalized idea about a class of objects, attributes, occurrences or processes Propositions A set of concepts

More information

The knowledge and skills involved in clinical audit

The knowledge and skills involved in clinical audit The knowledge and skills involved in clinical A list of possible knowledge and skills related to clinical is in the box. Knowledge and skills involved in clinical Knowledge Skills The clinical process

More information

What are Indexes and Scales

What are Indexes and Scales ISSUES Exam results are on the web No student handbook, will have discussion questions soon Next exam will be easier but want everyone to study hard Biggest problem was question on Research Design Next

More information

UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2

UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2 UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2 DATE: 3 May 2017 MARKS: 75 ASSESSOR: Prof PJ Blignaut MODERATOR: Prof C de Villiers (UP) TIME: 2 hours

More information

CHAPTER 3 RESEARCH METHODOLOGY

CHAPTER 3 RESEARCH METHODOLOGY CHAPTER 3 RESEARCH METHODOLOGY 3.1 Introduction 3.1 Methodology 3.1.1 Research Design 3.1. Research Framework Design 3.1.3 Research Instrument 3.1.4 Validity of Questionnaire 3.1.5 Statistical Measurement

More information

Keywords: consultation, drug-related problems, pharmacists, Theory of Planned Behavior

Keywords: consultation, drug-related problems, pharmacists, Theory of Planned Behavior DEVELOPMENT OF A QUESTIONNAIRE BASED ON THE THEORY OF PLANNED BEHAVIOR TO IDENTIFY FACTORS AFFECTING PHARMACISTS INTENTION TO CONSULT PHYSICIANS ON DRUG-RELATED PROBLEMS Teeranan Charoenung 1, Piyarat

More information

CHAPTER III RESEARCH METHOD. method the major components include: Research Design, Research Site and

CHAPTER III RESEARCH METHOD. method the major components include: Research Design, Research Site and CHAPTER III RESEARCH METHOD This chapter presents the research method and design. In this research method the major components include: Research Design, Research Site and Access, Population and Sample,

More information

SOME NOTES ON STATISTICAL INTERPRETATION

SOME NOTES ON STATISTICAL INTERPRETATION 1 SOME NOTES ON STATISTICAL INTERPRETATION Below I provide some basic notes on statistical interpretation. These are intended to serve as a resource for the Soci 380 data analysis. The information provided

More information

Reliability & Validity Dr. Sudip Chaudhuri

Reliability & Validity Dr. Sudip Chaudhuri Reliability & Validity Dr. Sudip Chaudhuri M. Sc., M. Tech., Ph.D., M. Ed. Assistant Professor, G.C.B.T. College, Habra, India, Honorary Researcher, Saha Institute of Nuclear Physics, Life Member, Indian

More information

HPS301 Exam Notes- Contents

HPS301 Exam Notes- Contents HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats

More information

Chapter 14: More Powerful Statistical Methods

Chapter 14: More Powerful Statistical Methods Chapter 14: More Powerful Statistical Methods Most questions will be on correlation and regression analysis, but I would like you to know just basically what cluster analysis, factor analysis, and conjoint

More information

Results & Statistics: Description and Correlation. I. Scales of Measurement A Review

Results & Statistics: Description and Correlation. I. Scales of Measurement A Review Results & Statistics: Description and Correlation The description and presentation of results involves a number of topics. These include scales of measurement, descriptive statistics used to summarize

More information

02a: Test-Retest and Parallel Forms Reliability

02a: Test-Retest and Parallel Forms Reliability 1 02a: Test-Retest and Parallel Forms Reliability Quantitative Variables 1. Classic Test Theory (CTT) 2. Correlation for Test-retest (or Parallel Forms): Stability and Equivalence for Quantitative Measures

More information

Design and Preliminary Validation of an Instrument to Measure Medical Student Attitudes Toward the Homeless

Design and Preliminary Validation of an Instrument to Measure Medical Student Attitudes Toward the Homeless Design and Preliminary Validation of an Instrument to Measure Medical Student Attitudes Toward the Homeless David S. Buck, MD, MPH F. Marconi Monteiro, EdD Suzanne Kneuper, MA Dana L. Clark, MD Allegra

More information

Meeting-5 MEASUREMENT 8-1

Meeting-5 MEASUREMENT 8-1 Meeting-5 MEASUREMENT 8-1 Measurement Measurement Process: 1. Selecting observable empirical events 2. Using numbers or symbols to represent aspects of the events being measured 3. Applying a mapping rule

More information

Page 1 of 11 Glossary of Terms Terms Clinical Cut-off Score: A test score that is used to classify test-takers who are likely to possess the attribute being measured to a clinically significant degree

More information

LANGUAGE TEST RELIABILITY On defining reliability Sources of unreliability Methods of estimating reliability Standard error of measurement Factors

LANGUAGE TEST RELIABILITY On defining reliability Sources of unreliability Methods of estimating reliability Standard error of measurement Factors LANGUAGE TEST RELIABILITY On defining reliability Sources of unreliability Methods of estimating reliability Standard error of measurement Factors affecting reliability ON DEFINING RELIABILITY Non-technical

More information

Group Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search.

Group Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search. Group Assignment #1: Concept Explication 1. Preliminary identification of the concept. Identify and name each concept your group is interested in examining. Questions to asked and answered: Is each concept

More information

Variables in Research. What We Will Cover in This Section. What Does Variable Mean? Any object or event that can take on more than one form or value.

Variables in Research. What We Will Cover in This Section. What Does Variable Mean? Any object or event that can take on more than one form or value. Variables in Research 1/1/2003 P365 Variables in Research 1 What We Will Cover in This Section Nature of variables. Measuring variables. Reliability. Validity. Measurement Modes. Issues. 1/1/2003 P365

More information

DESIGNING AND VALIDATION OF SOCIO- PSYCHOLOGICAL AND SEXUAL CONSTRAINTS QUESTIONNAIRE FOR FEMALE ATHLETES

DESIGNING AND VALIDATION OF SOCIO- PSYCHOLOGICAL AND SEXUAL CONSTRAINTS QUESTIONNAIRE FOR FEMALE ATHLETES DESIGNING AND VALIDATION OF SOCIO- PSYCHOLOGICAL AND SEXUAL CONSTRAINTS QUESTIONNAIRE FOR FEMALE ATHLETES Dr. G.S. Brar Professor Department of Physical Education, Panjab University Chandigarh Veena Rani

More information

On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA

On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA MASARY K UNIVERSITY, CZECH REPUBLIC Overview Background and research aims Focus on RQ2 Introduction

More information

An Introduction to Research Statistics

An Introduction to Research Statistics An Introduction to Research Statistics An Introduction to Research Statistics Cris Burgess Statistics are like a lamppost to a drunken man - more for leaning on than illumination David Brent (alias Ricky

More information

HOW TO DESIGN AND VALIDATE MY PAIN QUESTIONNAIRE?

HOW TO DESIGN AND VALIDATE MY PAIN QUESTIONNAIRE? DEPARTMENT RESEARCH GROUP HOW TO DESIGN AND VALIDATE MY PAIN QUESTIONNAIRE? Geert Crombez SELF-REPORT INSTRUMENTS What? Outcomes: Pain, Distress,

More information

The Psychometric Principles Maximizing the quality of assessment

The Psychometric Principles Maximizing the quality of assessment Summer School 2009 Psychometric Principles Professor John Rust University of Cambridge The Psychometric Principles Maximizing the quality of assessment Reliability Validity Standardisation Equivalence

More information

CHAPTER III RESEARCH METHODOLOGY

CHAPTER III RESEARCH METHODOLOGY CHAPTER III RESEARCH METHODOLOGY In this chapter, the researcher will elaborate the methodology of the measurements. This chapter emphasize about the research methodology, data source, population and sampling,

More information

Construct Validation of Direct Behavior Ratings: A Multitrait Multimethod Analysis

Construct Validation of Direct Behavior Ratings: A Multitrait Multimethod Analysis Construct Validation of Direct Behavior Ratings: A Multitrait Multimethod Analysis NASP Annual Convention 2014 Presenters: Dr. Faith Miller, NCSP Research Associate, University of Connecticut Daniel Cohen,

More information

Statistics for Psychosocial Research Session 1: September 1 Bill

Statistics for Psychosocial Research Session 1: September 1 Bill Statistics for Psychosocial Research Session 1: September 1 Bill Introduction to Staff Purpose of the Course Administration Introduction to Test Theory Statistics for Psychosocial Research Overview: a)

More information

Verbal Reasoning: Technical information

Verbal Reasoning: Technical information Verbal Reasoning: Technical information Issues in test construction In constructing the Verbal Reasoning tests, a number of important technical features were carefully considered by the test constructors.

More information

CHAPTER 3 RESEARCH METHODOLOGY. In this chapter, research design, data collection, sampling frame and analysis

CHAPTER 3 RESEARCH METHODOLOGY. In this chapter, research design, data collection, sampling frame and analysis CHAPTER 3 RESEARCH METHODOLOGY 3.1 Introduction In this chapter, research design, data collection, sampling frame and analysis procedure will be discussed in order to meet the objectives of the study.

More information

CHAPTER 3 DATA ANALYSIS: DESCRIBING DATA

CHAPTER 3 DATA ANALYSIS: DESCRIBING DATA Data Analysis: Describing Data CHAPTER 3 DATA ANALYSIS: DESCRIBING DATA In the analysis process, the researcher tries to evaluate the data collected both from written documents and from other sources such

More information

Psychological testing

Psychological testing Psychological testing Lecture 11 Mikołaj Winiewski, PhD Marcin Zajenkowski, PhD Strategies for test development and test item considerations The procedures involved in item generation, item selection,

More information

Sample Exam Questions Psychology 3201 Exam 1

Sample Exam Questions Psychology 3201 Exam 1 Scientific Method Scientific Researcher Scientific Practitioner Authority External Explanations (Metaphysical Systems) Unreliable Senses Determinism Lawfulness Discoverability Empiricism Control Objectivity

More information

EXPLORING CASINO GAMBLING IMPACT PERCEPTIONS: A GENDERED SOCIAL EXCHANGE THEORY APPROACH

EXPLORING CASINO GAMBLING IMPACT PERCEPTIONS: A GENDERED SOCIAL EXCHANGE THEORY APPROACH University of Massachusetts Amherst ScholarWorks@UMass Amherst Tourism Travel and Research Association: Advancing Tourism Research Globally 2007 ttra International Conference EXPLORING CASINO GAMBLING

More information

Validity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)

Validity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971) Ch. 5: Validity Validity History Griggs v. Duke Power Ricci vs. DeStefano Defining Validity Aspects of Validity Face Validity Content Validity Criterion Validity Construct Validity Reliability vs. Validity

More information

CHAPTER III RESEARCH METHODOLOGY

CHAPTER III RESEARCH METHODOLOGY CHAPTER III RESEARCH METHODOLOGY Research methodology explains the activity of research that pursuit, how it progress, estimate process and represents the success. The methodological decision covers the

More information

Types of Tests. Measurement Reliability. Most self-report tests used in Psychology and Education are objective tests :

Types of Tests. Measurement Reliability. Most self-report tests used in Psychology and Education are objective tests : Measurement Reliability Objective & Subjective tests Standardization & Inter-rater reliability Properties of a good item Item Analysis Internal Reliability Spearman-Brown Prophesy Formla -- α & # items

More information