Validity and Reliability. PDF Created with deskpdf PDF Writer - Trial ::
|
|
- Derek West
- 6 years ago
- Views:
Transcription
1 Validity and Reliability PDF Created with deskpdf PDF Writer - Trial ::
2 Validity Is the translation from concept to operationalization accurately representing the underlying concept. Does your variables measure what you think in abstract concepts. This is more familiarly called Construct Validity. empirical study with high construct validity would ensure the studied parameters are relevant to the research questions. Without a valid design, valid scientific conclusions cannot be drawn
3 Types of construct validity Translation validity (Trochims term) Face validity Content validity Criterion-related validity Predictive validity Concurrent validity Convergent validity Discriminant validity
4 Translation validity Is the operationalization a good reflection of the construct? This approach is definitional in nature assumes you have a good detailed definition of the construct and you can check the operationalization against it. Example software success. Does your definition representative of SW success construct? E.g. Application software is a software used to assist end users.
5 Face Validity On its face" does it seems like a good translation of the construct. If the respondent knows what information we are looking for, they can use that context to help interpret the questions and provide more useful, accurate answers
6 Content Validity Check the operationalization against the relevant content domain for the construct. For example, a depression measure should cover the checklist of depression symptoms World history its content must include major histories from all continents or countries Interface Usability should include all valid usability measures: learnability, efficiency, memorability (low cognitive overload), error recovery and the like
7 Criteria-Related Validity Check the performance of operationalization against some criterion. it compares the test with other measures or outcomes (the criteria) already held to be valid. For example, employee selection tests are often validated against measures of job performance (the criterion), and IQ tests are often validated against measures of academic performance (the criterion).
8 Predictive Validity Assess the operationalization's ability to predict something it should theoretically be able to predict. A high correlation would provide evidence for predictive validity Examples Measures of job applicant is supposed to measure the new applicant performance at work. If the applicant performs well at his job when measured after one year, our applicant measurement is a good predictive measure. Measures of Interface Usability can predict later SW utilization. High correlation is an indication of measures of predictive validity
9 Concurrent Validity Assess the operationalization's ability to distinguish between groups that it should theoretically be able to distinguish between. It is similar to predictive validity but the measures are taken at the same time. If measure of subordinate rating and supervisor rating positively correlate on job performance, it has high concurrent validity Compares the results of two measures
10 Convergent Validity Examine the degree to which the operationalization is similar to (converges on) other operationalizations that it theoretically should be similar to. This compares two or more attributes of the same construct To show the convergent validity of a test of arithmetic skills, one might correlate the scores on a Math test with scores on other tests (e.g problem solving ability) that support to measure basic math ability, The measure learnability should have high correction with efficiency, memorability, errors and satisfaction All measures measure the same construct There is also instrument measure convergence If measure of Interview and questionnaire produce the same result to say the instruments are convergent
11 Discriminant Validity Examine the degree to which the operationalization is not similar to (diverges from) other operationalizations that it theoretically should be not similar to. A test of a concept is not highly correlated with other tests designed to measure theoretically different concepts.
12 Discriminate where r xy is correlation between x and y, r xx is the reliability of x, and r yy is the reliability of y: a result less than.85 tells us existence of discriminant validity >.85, the two constructs overlap greatly and they are likely measuring the same thing.
13 Discriminate Measuring the concept of arcissism and Self-esteem arcissism is a term with a wide range of meanings, usually is used to describe some kind of problem in a person or group's relationships with self and others. Self-esteem is a term in psychology to reflect a person's overall evaluation or appraisal of her or his own worth. Self-esteem encompasses beliefs (for example, "I am competent", "I am worthy") and emotions such as triumph, despair, pride and shame The Researchers show that their new scale measures arcissism and not simply Self-esteem.
14 Internal and External Validity PDF Created with deskpdf PDF Writer - Trial ::
15 Internal Validity Inferences are said to possess internal validity if a causal relation between two variables is properly demonstrated. A causal inference may be based on a relation when three criteria are satisfied: 1. the "cause" precedes the "effect" in time (temporal precedence), 2. the "cause" and the "effect" are related (covariation), and 3. there are no plausible alternative explanations for the observed covariation
16 Example - Internal The researcher hypothesized that computer training will increase software usability Training (IV) and usability (DV) Positive correlation between the two indicates high internal validity. This can be done with Spearman Rank Correlation or Pearson Correlation Can be easily done with SPSS software
17 Internal In many cases, however, the magnitude of effects found in the dependent variable may not just depend on variations in the independent variable, the power of the instruments and statistical procedures used to measure and detect the effects, and the choice of statistical methods Other variables or circumstances uncontrolled for (or uncontrollable) may lead to additional or alternative explanations (a) for the effects found and/or (b) for the magnitude of the effects found.
18 Internal highly controlled true experimental designs, i.e random selection, random assignment to either the control or experimental groups, reliable instruments, reliable manipulation processes, and safeguards against confounding factors may be the "gold standard" of scientific research. the very strategies employed to control these factors may also limit the generalizability or External Validity of the findings.
19 External validity external validity refers to the applicability of study or experimental results to realms beyond those under immediate observation. Refers to generalizability of the research finding to other similar cases Does the software solution for one case is also applicable to other similar cases in other organization or country. Does the solution has wider application and audience or acceptance. We need that solution! Researchers prize studies with external validity, since the results can be widely applied to other scenarios.
20 External External validity for a given study has several aspects: 1. whether the study generalizes to other subjects in the domain 2. whether there exist enough evidence and arguments to support the claimed generalizability 3. whether the study outcomes validate predicted theories
21 Reliability Means "repeatability" or "consistency". A measure is considered reliable if it would give us the same result over and over again (assuming that what we are measuring isn't changing!). Measuring the same distance at different times should give the same result if the instrument (e.g. meter) is reliable. There are four general classes of reliability estimates, each of which estimates reliability in a different way.
22 22 Types of Reliability Estimation There are four measures of reliability 1. Inter-rater or inter-observer reliability 2. Test-retest reliability 3. Parallel-forms reliability 4. Internal consistency (Split Half) reliability
23 Inter-Rater or Inter-Observer PDF Created with deskpdf PDF Writer - Trial :: Reliability Used to assess the degree to which different raters/observers give consistent estimates of the same phenomenon. Establish reliability on pilot data or a subsample of data and retest often throughout. For categorical data, X 2 (Chai sqaure) can be used and For continuous data, a R (such as linear regression) can be used
24 Test-Retest Reliability Used to assess the consistency of a measure from one time to another. This approach assumes that there is no substantial change in the construct being measured between the two occasions. The amount of time allowed between measures is critical. The shorter the time gap, the higher the correlation; the longer the time gap, the lower the correlation
25 Parallel-Forms Reliability Used to assess the consistency of the results of two tests constructed in the same way from the same content domain. Create a large set of questions that address the same construct and then randomly divide the questions into two sets and administer both instruments to the same sample of people. The correlation between the two parallel forms is the estimate of reliability. One major limitation of this approach is that you generate lots of items that reflect the same construct.
26 Split Half Reliability Collect your data with the instrument to measure your construct. Split the data into halve and do correlation between the two data sets Positive correlation indicates high reliability
27 27 Reliability and Validity PDF Created with deskpdf PDF Writer - Trial ::
28 Research Ethics PDF Created with deskpdf PDF Writer - Trial ::
29 29 Ethics a definition Research should avoid causing harm, distress, anxiety, pain or any other negative feeling to participants. Participants should be fully informed about all relevant aspects of the research, before they agree to take part [1]
30 30 THIS IS A HYPOTHETICAL QUESTION - DO NOT ANSWER THIS ARE YOU Corrupted Person? Research Methodology 24 Nov 2008 PDF Created with deskpdf PDF Writer - Trial ::
31 31 Research questions ethical or not? Research may ask a taboo or personal question What if you were asked if you are asked are corrupted person? How would you feel if you were asked this? Would you feel awkward? Would you lie? Would you answer truthfully? Why are we asking this question anyway? Could we rephrase the question better?
32 32 Pause for thought Is it morally correct to carry out research by any means whatsoever providing that the end result increases the sum of human knowledge or provides some tangible benefit to mankind? Does the end justify the means? DISCUSS
33 33 Ethics before Research begins Inform all participants fully What about children Mentally deficient people Those with poor language skills Obtain consent Craft your research methods carefully No distortion of the data
34 34 Ethics during Research Field notes what are they? Do we need these? DISCUSS Can we use these in our research? Consent issues Content issues Moral issues You have heard about a crime do you report it? Research Methodoogy
35 35 Confidentiality of respondent data How do we keep track of respondents? Should we keep track of respondents? How do we de-personalise gathered data? If data are depersonalised, is it morally correct to reuse this data for a new research project? DISCUSS
36 36 Ethics after Research Disposal of data paper or digital? Freedom of Information Act Reuse of data is this ethical? Are there occasions where reuse of gathered data for another purpose is ok? Requesting permission from respondents Difficulty of contacting original respondents
37 37 Engineering and Ethics Confidentiality of data Ownership of research results Consider research results Is a cure for a disease as the direct result of research good? Is the creation of a powerful bomb as the direct result of research good? e.g. the atom bomb DISCUSS
38 38 Research Ethics Committees Monitor ethical issues in research programmes Before during and after research Makes decisions and enforces these Gives researchers organisational support Reassurance to researchers about moral issues related to a particular research project
39 39 Plagiarism What is plagiarism? How do we avoid plagiarism? What are the dangers that plagiarism causes? State some examples of plagiarism. DISCUSS
40 Responsibilities of Actors Researchers Ethics Respondents Sponsors PDF Created with deskpdf PDF Writer - Trial ::
41 41 Ethical Considerations: Respondents Truthfulness in giving information to the researcher if a research subject or respondent gives his or her consent to participate in a research study Sustained cooperativeness with the researcher throughout the course of the research study Adhere to responsibility if informed consent is given to the researcher State any constraints or limitations in advance MBA III (Research Methodology) Course Instructor: Dr. Aurangzeb Z. Khan 29 August 2005
42 Ethical Considerations: Researchers 42 No deception, be forthright and do not conceal the true purpose of the research Maintain objectivity, courtesy and high professional standards through scientific process No falsification, alteration or misrepresentation of data for political or other purposes Protect the confidentiality of the research subjects and research sponsors No faulty conclusions No inclusion or use of information or ideas contained in competing research proposals MBA III (Research Methodology) Course Instructor: Dr. Aurangzeb Z. Khan 29 August 2005
43 43 Ethical Considerations: Research Sponsors No request for submission of competitive bids by researchers if selection of the researcher has already been made Avoid manipulation and influencing of the researcher with a view to discrediting individuals or organizations The conclusions drawn from research work should be consistent with the data and not influenced by other undesirable conditions or motives Observe the confidentiality of the research subjects and researcher Avoid Advocacy Research MBA III (Research Methodology) Course Instructor: Dr. Aurangzeb Z. Khan 29 August 2005
44 End! PDF Created with deskpdf PDF Writer - Trial ::
Measurement is the process of observing and recording the observations. Two important issues:
Farzad Eskandanian Measurement is the process of observing and recording the observations. Two important issues: 1. Understanding the fundamental ideas: Levels of measurement: nominal, ordinal, interval
More informationImportance of Good Measurement
Importance of Good Measurement Technical Adequacy of Assessments: Validity and Reliability Dr. K. A. Korb University of Jos The conclusions in a study are only as good as the data that is collected. The
More informationVARIABLES AND MEASUREMENT
ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 16A LECTURE NOTES [01/29/16] VARIABLES AND MEASUREMENT AGE 1 Topic #3 VARIABLES AND MEASUREMENT VARIABLES Some definitions of variables include the following: 1.
More informationPÄIVI KARHU THE THEORY OF MEASUREMENT
PÄIVI KARHU THE THEORY OF MEASUREMENT AGENDA 1. Quality of Measurement a) Validity Definition and Types of validity Assessment of validity Threats of Validity b) Reliability True Score Theory Definition
More information11/18/2013. Correlational Research. Correlational Designs. Why Use a Correlational Design? CORRELATIONAL RESEARCH STUDIES
Correlational Research Correlational Designs Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are
More informationSTA630 Research Methods Solved MCQs By
STA630 Research Methods Solved MCQs By http://vustudents.ning.com 31-07-2010 Quiz # 1: Question # 1 of 10: A one tailed hypothesis predicts----------- The future The lottery result The frequency of the
More informationValidation of Scales
Validation of Scales ἀγεωμέτρητος μηδεὶς εἰσίτω (Let none enter without a knowledge of mathematics) D R D I N E S H R A M O O Introduction Validity and validation are crucial to understanding psychological
More informationUnderlying Theory & Basic Issues
Underlying Theory & Basic Issues Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 All Too True 2 Validity In software engineering, we worry about various issues: E-Type systems: Usefulness is it doing what
More information11-3. Learning Objectives
11-1 Measurement Learning Objectives 11-3 Understand... The distinction between measuring objects, properties, and indicants of properties. The similarities and differences between the four scale types
More informationValidity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that
Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that it purports to perform. Does an indicator accurately
More informationResearch Questions and Survey Development
Research Questions and Survey Development R. Eric Heidel, PhD Associate Professor of Biostatistics Department of Surgery University of Tennessee Graduate School of Medicine Research Questions 1 Research
More informationExperimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design
Experimental Research in HCI Alma Leora Culén University of Oslo, Department of Informatics, Design almira@ifi.uio.no INF2260/4060 1 Oslo, 15/09/16 Review Method Methodology Research methods are simply
More informationChapter 4: Defining and Measuring Variables
Chapter 4: Defining and Measuring Variables A. LEARNING OUTCOMES. After studying this chapter students should be able to: Distinguish between qualitative and quantitative, discrete and continuous, and
More informationalternate-form reliability The degree to which two or more versions of the same test correlate with one another. In clinical studies in which a given function is going to be tested more than once over
More informationConducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC
Conducting Research in the Social Sciences Rick Balkin, Ph.D., LPC-S, NCC 1 Why we do research Improvement Description Explanation Prediction R. S. Balkin, 2008 2 Theory Explanation of an observed phenomena
More informationADMS Sampling Technique and Survey Studies
Principles of Measurement Measurement As a way of understanding, evaluating, and differentiating characteristics Provides a mechanism to achieve precision in this understanding, the extent or quality As
More informationAP Psychology -- Chapter 02 Review Research Methods in Psychology
AP Psychology -- Chapter 02 Review Research Methods in Psychology 1. In the opening vignette, to what was Alicia's condition linked? The death of her parents and only brother 2. What did Pennebaker s study
More informationExperimental Psychology
Title Experimental Psychology Type Individual Document Map Authors Aristea Theodoropoulos, Patricia Sikorski Subject Social Studies Course None Selected Grade(s) 11, 12 Location Roxbury High School Curriculum
More informationDo not write your name on this examination all 40 best
Student #: Do not write your name on this examination Research in Psychology I; Final Exam Fall 200 Instructor: Jeff Aspelmeier NOTE: THIS EXAMINATION MAY NOT BE RETAINED BY STUDENTS This exam is worth
More informationLecture 4: Research Approaches
Lecture 4: Research Approaches Lecture Objectives Theories in research Research design approaches ú Experimental vs. non-experimental ú Cross-sectional and longitudinal ú Descriptive approaches How to
More informationRESEARCH METHODOLOGY-NET/JRF EXAMINATION DECEMBER 2013 prepared by Lakshmanan.MP, Asst Professor, Govt College Chittur
RESEARCH METHODOLOGY-NET/JRF EXAMINATION DECEMBER 2013 prepared by Lakshmanan.MP, Asst Professor, Govt College Chittur For answer key mail request to mpl77lic@gmail.com 1 The research process is best described
More informationChapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research
Chapter 11 Nonexperimental Quantitative Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) Nonexperimental research is needed because
More informationPLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity
PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with
More informationISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology
ISC- GRADE XI HUMANITIES (2018-19) PSYCHOLOGY Chapter 2- Methods of Psychology OUTLINE OF THE CHAPTER (i) Scientific Methods in Psychology -observation, case study, surveys, psychological tests, experimentation
More informationThe Current State of Our Education
1 The Current State of Our Education 2 Quantitative Research School of Management www.ramayah.com Mental Challenge A man and his son are involved in an automobile accident. The man is killed and the boy,
More informationHPS301 Exam Notes- Contents
HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats
More informationUNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2
UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2 DATE: 3 May 2017 MARKS: 75 ASSESSOR: Prof PJ Blignaut MODERATOR: Prof C de Villiers (UP) TIME: 2 hours
More information9 research designs likely for PSYC 2100
9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one
More informationDoctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, The Scientific Method of Problem Solving
Doctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, 2018 The Scientific Method of Problem Solving The conceptual phase Reviewing the literature, stating the problem,
More informationMEASUREMENT THEORY 8/15/17. Latent Variables. Measurement Theory. How do we measure things that aren t material?
MEASUREMENT THEORY Measurement Theory How do we measure things that aren t material? Affect, behavior, cognition Thoughts, feelings, personality, intelligence, etc? Measurement theory: Turning the into
More informationTest Validity. What is validity? Types of validity IOP 301-T. Content validity. Content-description Criterion-description Construct-identification
What is? IOP 301-T Test Validity It is the accuracy of the measure in reflecting the concept it is supposed to measure. In simple English, the of a test concerns what the test measures and how well it
More informationCHAPTER III RESEARCH METHODOLOGY
CHAPTER III RESEARCH METHODOLOGY Research methodology explains the activity of research that pursuit, how it progress, estimate process and represents the success. The methodological decision covers the
More informationCommunication Research Practice Questions
Communication Research Practice Questions For each of the following questions, select the best answer from the given alternative choices. Additional instructions are given as necessary. Read each question
More informationGoal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment
Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Scientific Study of Causation and Treatment Methods for studying causation Case
More informationSample Exam Questions Psychology 3201 Exam 1
Scientific Method Scientific Researcher Scientific Practitioner Authority External Explanations (Metaphysical Systems) Unreliable Senses Determinism Lawfulness Discoverability Empiricism Control Objectivity
More informationOverview of Experimentation
The Basics of Experimentation Overview of Experiments. IVs & DVs. Operational Definitions. Reliability. Validity. Internal vs. External Validity. Classic Threats to Internal Validity. Lab: FP Overview;
More informationBasic Concepts in Research and DATA Analysis
Basic Concepts in Research and DATA Analysis 1 Introduction: A Common Language for Researchers...2 Steps to Follow When Conducting Research...2 The Research Question...3 The Hypothesis...3 Defining the
More informationWho? What? What do you want to know? What scope of the product will you evaluate?
Usability Evaluation Why? Organizational perspective: To make a better product Is it usable and useful? Does it improve productivity? Reduce development and support costs Designer & developer perspective:
More informationMaking a psychometric. Dr Benjamin Cowan- Lecture 9
Making a psychometric Dr Benjamin Cowan- Lecture 9 What this lecture will cover What is a questionnaire? Development of questionnaires Item development Scale options Scale reliability & validity Factor
More informationReliability AND Validity. Fact checking your instrument
Reliability AND Validity Fact checking your instrument General Principles Clearly Identify the Construct of Interest Use Multiple Items Use One or More Reverse Scored Items Use a Consistent Response Format
More information11/24/2017. Do not imply a cause-and-effect relationship
Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection
More informationDesigning Experiments... Or how many times and ways can I screw that up?!?
www.geo.uzh.ch/microsite/icacogvis/ Designing Experiments... Or how many times and ways can I screw that up?!? Amy L. Griffin AutoCarto 2012, Columbus, OH Outline When do I need to run an experiment and
More informationGlossary of Research Terms Compiled by Dr Emma Rowden and David Litting (UTS Library)
Glossary of Research Terms Compiled by Dr Emma Rowden and David Litting (UTS Library) Applied Research Applied research refers to the use of social science inquiry methods to solve concrete and practical
More informationGoal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment
Key Dates TU Mar 28 Unit 18 Loss of control drinking in alcoholics (on course website); Marlatt assignment TH Mar 30 Unit 19; Term Paper Step 2 TU Apr 4 Begin Biological Perspectives, Unit IIIA and 20;
More informationStatistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN
Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN Vs. 2 Background 3 There are different types of research methods to study behaviour: Descriptive: observations,
More informationFinal Exam: PSYC 300. Multiple Choice Items (1 point each)
Final Exam: PSYC 300 Multiple Choice Items (1 point each) 1. Which of the following is NOT one of the three fundamental features of science? a. empirical questions b. public knowledge c. mathematical equations
More informationChapter 2 Research Approaches and Methods of Data Collection
Chapter 2 Research Approaches and Methods of Data Collection Learning objectives To be able to Describe the different types of variables used in quantitative research Explain the nature of causation and
More informationThe Science of Psychology
The Science of Psychology Module 2 Psychology s Scientific Method Module Objectives Why is Psychology a Science? What is the scientific method? Why should I believe what researchers say? How do Psychologist
More informationRESEARCH METHODS. Winfred, research methods, ; rv ; rv
RESEARCH METHODS 1 Research Methods means of discovering truth 2 Research Methods means of discovering truth what is truth? 3 Research Methods means of discovering truth what is truth? Riveda Sandhyavandanam
More informationClever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time.
Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time. While a team of scientists, veterinarians, zoologists and
More informationand Screening Methodological Quality (Part 2: Data Collection, Interventions, Analysis, Results, and Conclusions A Reader s Guide
03-Fink Research.qxd 11/1/2004 10:57 AM Page 103 3 Searching and Screening Methodological Quality (Part 2: Data Collection, Interventions, Analysis, Results, and Conclusions A Reader s Guide Purpose of
More information26:010:557 / 26:620:557 Social Science Research Methods
26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview
More informationPsychology Research Process
Psychology Research Process Logical Processes Induction Observation/Association/Using Correlation Trying to assess, through observation of a large group/sample, what is associated with what? Examples:
More informationRESEARCH METHODS. Winfred, research methods,
RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,
More informationStatistics for Psychosocial Research Session 1: September 1 Bill
Statistics for Psychosocial Research Session 1: September 1 Bill Introduction to Staff Purpose of the Course Administration Introduction to Test Theory Statistics for Psychosocial Research Overview: a)
More informationChapter 2: Research Methods in I/O Psychology Research a formal process by which knowledge is produced and understood Generalizability the extent to
Chapter 2: Research Methods in I/O Psychology Research a formal process by which knowledge is produced and understood Generalizability the extent to which conclusions drawn from one research study spread
More informationAssociate Prof. Dr Anne Yee. Dr Mahmoud Danaee
Associate Prof. Dr Anne Yee Dr Mahmoud Danaee 1 2 What does this resemble? Rorschach test At the end of the test, the tester says you need therapy or you can't work for this company 3 Psychological Testing
More informationEmpowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison
Empowered by Psychometrics The Fundamentals of Psychometrics Jim Wollack University of Wisconsin Madison Psycho-what? Psychometrics is the field of study concerned with the measurement of mental and psychological
More informationPsychopathy. Phil408P
Psychopathy Phil408P Antisocial Personality Disorder (APD) "A pattern of irresponsible and antisocial behaviour beginning in childhood or early adolescence and continuing into adulthood." Psychopathy is
More informationValidity of measurement instruments used in PT research
Validity of measurement instruments used in PT research Mohammed TA, Omar Ph.D. PT, PGDCR-CLT Rehabilitation Health Science Department Momarar@ksu.edu.sa A Word on Embedded Assessment Discusses ways of
More informationEngineering Science & VALIDITY
Engineering Science & VALIDITY Today we will look at: 1. Scientific foundations 2. Validation 3. Reliability 4. Logic 5. Industrial validation 6. MSc relevance February 24, 2014 1 The linked image cannot
More informationChapter 1: Explaining Behavior
Chapter 1: Explaining Behavior GOAL OF SCIENCE is to generate explanations for various puzzling natural phenomenon. - Generate general laws of behavior (psychology) RESEARCH: principle method for acquiring
More informationHOW TO IDENTIFY A RESEARCH QUESTION? How to Extract a Question from a Topic that Interests You?
Stefan Götze, M.A., M.Sc. LMU HOW TO IDENTIFY A RESEARCH QUESTION? I How to Extract a Question from a Topic that Interests You? I assume you currently have only a vague notion about the content of your
More informationHandout 5: Establishing the Validity of a Survey Instrument
In this handout, we will discuss different types of and methods for establishing validity. Recall that this concept was defined in Handout 3 as follows. Definition Validity This is the extent to which
More information9.63 Laboratory in Cognitive Science
9.63 Laboratory in Cognitive Science Fall 2005 Course 2b Variables, Controls Aude Oliva Ben Balas, Charles Kemp Science is: Scientific Thinking 1. Empirical Based on observations 2. Objective Observations
More information32.5. percent of U.S. manufacturers experiencing unfair currency manipulation in the trade practices of other countries.
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture
More informationBijay Lal Pradhan, M Sc Statistics, FDPM (IIMA) 2
Bijay Lal Pradhan Measurement and Scaling 1) Definition of measurement and scale 2) Type of Physical scale i. Nominal Scale iii. Interval scale ii. Ordinal Scale iv. Ratio Scale 3) Need of scaling 4) Criteria
More informationCHAPTER ONE CORRELATION
CHAPTER ONE CORRELATION 1.0 Introduction The first chapter focuses on the nature of statistical data of correlation. The aim of the series of exercises is to ensure the students are able to use SPSS to
More informationPsychology Research Process
Psychology Research Process Logical Processes Induction Observation/Association/Using Correlation Trying to assess, through observation of a large group/sample, what is associated with what? Examples:
More informationWho, among the following, is the writer of Business Research Methods? Which of the folowing is the basis of the Scientific Method?
MIDTERM EXAMINATION Spring 2010 STA630- Research Methods (Session - 3) Asslam O Alikum STA630- Research Methods Spring 2010 Session 3 solved with reference By Afaaq Remember Me In Your Prayers Best regard
More informationReliability and Validity
Reliability and Today s Objectives Understand the difference between reliability and validity Understand how to develop valid indicators of a concept Reliability and Reliability How accurate or consistent
More information11 questions to help you make sense of a case control study
Critical Appraisal Skills Programme (CASP) making sense of evidence 11 questions to help you make sense of a case control study How to use this appraisal tool Three broad issues need to be considered when
More informationMEASUREMENT, SCALING AND SAMPLING. Variables
MEASUREMENT, SCALING AND SAMPLING Variables Variables can be explained in different ways: Variable simply denotes a characteristic, item, or the dimensions of the concept that increases or decreases over
More informationIn this chapter we discuss validity issues for quantitative research and for qualitative research.
Chapter 8 Validity of Research Results (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we discuss validity issues for
More informationReliability and Validity checks S-005
Reliability and Validity checks S-005 Checking on reliability of the data we collect Compare over time (test-retest) Item analysis Internal consistency Inter-rater agreement Compare over time Test-Retest
More informationVariables in Research. What We Will Cover in This Section. What Does Variable Mean?
Variables in Research 9/20/2005 P767 Variables in Research 1 What We Will Cover in This Section Nature of variables. Measuring variables. Reliability. Validity. Measurement Modes. Issues. 9/20/2005 P767
More informationMeasurement. 500 Research Methods Mike Kroelinger
Measurement 500 Research Methods Mike Kroelinger Levels of Measurement Nominal Lowest level -- used to classify variables into two or more categories. Cases placed in the same category must be equivalent.
More informationCausal Research Design- Experimentation
In a social science (such as marketing) it is very important to understand that effects (e.g., consumers responding favorably to a new buzz marketing campaign) are caused by multiple variables. The relationships
More information(CORRELATIONAL DESIGN AND COMPARATIVE DESIGN)
UNIT 4 OTHER DESIGNS (CORRELATIONAL DESIGN AND COMPARATIVE DESIGN) Quasi Experimental Design Structure 4.0 Introduction 4.1 Objectives 4.2 Definition of Correlational Research Design 4.3 Types of Correlational
More informationLecture 11: Measurement to Hypotheses. Benjamin Graham
Lecture 11: Measurement to Hypotheses Benjamin Graham Today s Schedule Homework #2 will be posted Friday. It is due October 2. Finish up validity and reliability Levels of Analysis Direction of Causation
More informationCh. 11 Measurement. Measurement
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture
More informationCritical Thinking Assessment at MCC. How are we doing?
Critical Thinking Assessment at MCC How are we doing? Prepared by Maura McCool, M.S. Office of Research, Evaluation and Assessment Metropolitan Community Colleges Fall 2003 1 General Education Assessment
More informationOn the purpose of testing:
Why Evaluation & Assessment is Important Feedback to students Feedback to teachers Information to parents Information for selection and certification Information for accountability Incentives to increase
More informationResearch Services Research integrity
Research integrity Department of Materials induction session Kathryn Dally Assistant Registrar () 22 January 2014 What is research integrity? Also known as research ethics, good practice in research or
More informationExperimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8
Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to
More informationUnderstanding and serving users
Understanding and serving users Surveys, interviews and protocols Intro to data analysis Asking users questions: Questionnaires are probably the most frequently used method of summative evaluation of user
More informationCHAPTER VI RESEARCH METHODOLOGY
CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the
More information04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing
Research Methods in Psychology Chapter 6: Independent Groups Designs 1 Why Psychologists Conduct Experiments? What is your ideas? 2 Why Psychologists Conduct Experiments? Testing Hypotheses derived from
More informationValidity. Ch. 5: Validity. Griggs v. Duke Power - 2. Griggs v. Duke Power (1971)
Ch. 5: Validity Validity History Griggs v. Duke Power Ricci vs. DeStefano Defining Validity Aspects of Validity Face Validity Content Validity Criterion Validity Construct Validity Reliability vs. Validity
More informationUse of the Quantitative-Methods Approach in Scientific Inquiry. Du Feng, Ph.D. Professor School of Nursing University of Nevada, Las Vegas
Use of the Quantitative-Methods Approach in Scientific Inquiry Du Feng, Ph.D. Professor School of Nursing University of Nevada, Las Vegas The Scientific Approach to Knowledge Two Criteria of the Scientific
More informationChapter 3 Psychometrics: Reliability and Validity
34 Chapter 3 Psychometrics: Reliability and Validity Every classroom assessment measure must be appropriately reliable and valid, be it the classic classroom achievement test, attitudinal measure, or performance
More informationSOCIOLOGICAL RESEARCH
SOCIOLOGICAL RESEARCH SOCIOLOGY Is a scientific discipline rooted in Positivism As such it makes use of a number of scientific techniques Including: The experimental method, the survey and questionnaire
More informationPearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world
Pearson Education Limited Edinburgh Gate Harlow Essex CM20 2JE England and Associated Companies throughout the world Visit us on the World Wide Web at: www.pearsoned.co.uk Pearson Education Limited 2014
More informationReliability & Validity Dr. Sudip Chaudhuri
Reliability & Validity Dr. Sudip Chaudhuri M. Sc., M. Tech., Ph.D., M. Ed. Assistant Professor, G.C.B.T. College, Habra, India, Honorary Researcher, Saha Institute of Nuclear Physics, Life Member, Indian
More informationThe Regression-Discontinuity Design
Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations
More informationConstructing Indices and Scales. Hsueh-Sheng Wu CFDR Workshop Series June 8, 2015
Constructing Indices and Scales Hsueh-Sheng Wu CFDR Workshop Series June 8, 2015 1 Outline What are scales and indices? Graphical presentation of relations between items and constructs for scales and indices
More informationCh. 11 Measurement. Paul I-Hai Lin, Professor A Core Course for M.S. Technology Purdue University Fort Wayne Campus
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement, Measurement Scales, Questionnaires & Instruments, Sampling Ch. 11 Measurement Lecture
More informationDEVELOPING THE RESEARCH FRAMEWORK Dr. Noly M. Mascariñas
DEVELOPING THE RESEARCH FRAMEWORK Dr. Noly M. Mascariñas Director, BU-CHED Zonal Research Center Bicol University Research and Development Center Legazpi City Research Proposal Preparation Seminar-Writeshop
More informationAnalysis A step in the research process that involves describing and then making inferences based on a set of data.
1 Appendix 1:. Definitions of important terms. Additionality The difference between the value of an outcome after the implementation of a policy, and its value in a counterfactual scenario in which the
More information