PM12 Validity P R O F. D R. P A S Q U A L E R U G G I E R O D E P A R T M E N T O F B U S I N E S S A N D L A W
|
|
- Dylan Cooper
- 5 years ago
- Views:
Transcription
1 PM12 Validity P R O F. D R. P A S Q U A L E R U G G I E R O D E P A R T M E N T O F B U S I N E S S A N D L A W
2 Internal and External Validity The concept of validity is very important in PE. To make PE useful it must be believable. Validity is usually focused on data collection, procedures, design and analysis. Here we refer more specifically to the validity of the design. In judging the quality of a design the main criteria are: internal validity; external validity.
3 Internal validity Internal validity refers to the certainty about cause and effect relationships. Did the program cause the observed outcome? To use the words of Cronbach internal validity refers to the trustworthiness of an inference. Internal validity refers to the conclusions regarding the subjects, time and context of the implemented PE.
4 Internal validity A threat to internal validity refers to precisely those conclusions, that is conclusions regarding the subjects, the time and context of the implemented research. A threat to internal validity is an objection that the design employed allows the casual link between treatment and outcome to remain uncertain; The design is weak in some way and does not enable one to have confidence in one s conclusions about what the program actually did accomplish regarding the subjects, time and context observed (Mohr, 1995).
5 Internal validity To sum up, evaluators and stakeholders wish to have confidence that when a PE shows significant results, the findings have been caused by the program itself and not by other activities and factors (alternative explanations).
6 Counterfactual situation To understand the importance of the internal validity of the evaluation design, is fundamental to introduce the concept of counterfactual situation. In theory, to exclude alternative explanations when evaluating the impact of a program it would be necessary to compare the observed outcome measure after the program (gross effect) with what would have appeared if the program had not been implemented (counterfactual situation).
7 Counterfactual situation Since counterfactual situation did not happen ( the darkness of unfulfilled ) the only alternative possible is to come to an estimation of it. There can be no design in quantitative program evaluation if there is no estimate of the counterfactual. When made empirically, this estimate always comes from (a) one or more previous time periods or (b) a group of comparable subjects
8 Counterfactual situation If the measure after the program is P (normally a mean) and the counterfactual situation is C (normally a mean), P-C is, essentially, what we need to know. P-C, as a difference of means (a difference of proportion or a regression coefficient) has to be compared to some standard to become an understandable and useful number to make judgment and decisions.
9 P-C P-C could be - at first - compared to program s objective (planned outcome Pp). Of course even planned objective should consider the counterfactual situation (the one estimated during the planning phase Cp). (P - C ) : (Pp Cp) To estimate the counterfactual situation in advance is very difficult, but we could use a before measure.
10 Example (Mohr, 1995) Objective: to reduce average travel time along a stretch of road from 15 minutes to 10 minutes by widening the road to three lanes. Suppose to measure the average travel time 10.5 minutes after the program. 15 minutes is our before measure, that is our Cp (P - C) : (Pp - Cp) = ( ) : (10-15) = -4.5 : - 5 = 0.9 or 90% The hoped result was not achieved. Why?
11 Example (Mohr, 1995) We could use - alternatively - the adequacy ratio (the proportion of the problem eliminated by the program) as a standard for evaluating the accomplishment. Adequacy = 1 - (P : C). 1 - (10.5 : 15) = = 0.3 or 30% Looking at the data used in our case, it is clear that to say that the program was only 30% adequate is unfair. As a matter of fact the elimination of the problem is impossible (unrealistic)!
12 Example (Mohr, 1995) In such cases it is necessary to establish the travel time that we consider as the elimination of the problem (say 9 minutes) and express P and C as gaps from this standard. C = 15-9 = 6 (the real problem without the program) P = = 1.5 (the remaining true problem) Adequacy = 1 - (1.5 : 6.0) = = 0.75 or 75% Adequacy is not 30% but 75%
13 Threats to internal validity Threats to internal validity are threats to the validity of the conclusions (inference) about a program effectiveness (impact) drawn on the basis of a specific design. Using quantitative methods, in order to come to a conclusion about program s impact we need to estimate a counterfactual situation. Counterfactual situation comes from: the same subjects at one or more previous time periods; a group of comparable subjects.
14 Threats to internal validity History In general, history is the possibility that something besides program accounts for all or part of the observed change over time. The importance of history can be better understood if we take into consideration important events (an economic recession; a terroristic attack,..) that can influence persons behaviour. Please note that even though the change is zero, this could be accounted for by some change-producing force of history that was counteracted by a true impact of the program. If the event affected a program group, the effect is called local history.
15 In August 1987, 27 children were killed outside of Cincinnati where a drunk driver crashed into a bus returning from a weekend outing. Assume that prior to this you had been asked to evaluate a public education program designed to reduce the number of DUIs and planned on using a relatively weak evaluation design to monitor the number of arrests for driving under the influence. Some months after the accident, you conclude that the decrease in DUI arrest was due to the intervention, when it probably was the tragedy that resulted in fewer drivers driving while intoxicated.
16 Threats to internal validity Maturation It can happen the problems improve autonomously as a consequence of the passage of time. An evaluator can attribute to the program the merit of having improved or solved a problem while, as a matter of fact, an important contribution could be given by the simple circumstance that persons naturally change over time. This specific threat is particularly important when the program is devoted to young persons whose attitude toward specific social problems can change fast (process of aging).
17 The evaluator may well have found that real changes have occurred during the course of the program; however, the reasons for the changes could be that the program lasted six moths and thus the participants are six months older and more experienced - not that the participants gained anything from the program.
18 Threats to internal validity Selection It is a powerful alternative explanation when the participation is on a voluntary basis (Pre test/post test helps). It can have several meanings. Let s consider the more common: potential difference on outcome between two observed groups is due to a difference that existed between them when they have been selected; you have selected persons who would have changed even without the treatment; are particularly likely to be changed by the treatment.
19 College teachers most likely to join faculty development programs are often already good teachers. After a faculty development program, most of these teachers will continue to be good teachers. Their competence tells us nothing about the quality of the program - these teachers were better than the typical teachers from the beginning
20 Threats to internal validity Attrition (Mortality) It concerns the possibility that subjects may leave the group after the beginning and before the end of the program. This means that the outcome measures on these subjects become unavailable. Since we cannot know if the subjects who left are average or mutually cancelling in their outcome performance, attrition introduces bias (Pre test/post test helps). The probability of attrition is correlated to the length of the program.
21 In a juvenile crime prevention program in which Y is measured by numbers of offenses over an extended period, those who are incarcerated because of a serious offense will have Y scores that are artificially low, and therefore irrelevant. Suppose you were running a program for parents of adolescents. Twelve parents sign up to learn how to better communicate with their adolescents. A few parents drop out during the 9-week program, but this does not concern you because you can objectively show that the program is working However, as you begin to examine your data, you realize that the parents who remained in the program were all college graduates. the parents who dropped out were high school graduates. Although the intervention may have worked, it did so only for parents who were college graduates
22 Threats to internal validity Regression (toward the mean) While maturation is referred to a sort of development, regression involves cyclical or episodic change. For many phenomena, subjects scoring toward an extreme are likely to drift naturally toward a less extreme norm over time. In a test taking, for example, many extreme high and low scores are due to transient conditions rather than innate ability, and a retest after some time passes is likely to produce scores that are less extreme
23 Threats to internal validity Testing This term is referred to pretest. We refer to the possibility that the scores of the posttest may be different from those otherwise would have been, not because of the treatment, but because the persons have been subjected to previous measurement (pretest) [familiarity; reactivity;] IQ tests: subsequent tests are usually better than the first ones
24 Threats to internal validity Instrumentation Just as those enrolled in a program can become bored by taking the same test on numerous occasions, the evaluator or other persons making observations might subtly or unconsciously modify the procedures Instead of counting every time a hyperactive child got out of his seat in the classroom, the weary observer by the end of the study may be counting only the incidents when the child got out of his seat and was corrected by the teacher; Observations ought to be made in the same way throughout the course of the evaluation. Tests should be administered the same way (e.g., in the same setting, at the same time of day, using the same rules or set of instructions) each time. a teacher gave more than the allowed time to a class to finish the posttest and less to the control group
25 Placebo factors Threats to internal validity refer to the generally mild and positive effects experienced by people as a result of their exposure to an innocuous intervention. Why placebo effects exist: Any form of health or psychosocial care delivered by a caring and sensitive service provider is capable of producing some generalized sense of wellbeing or even symptomatic improvements. Spending time in a treatment program, making a personal investment of energy, hope, and thought, tends to produce expectations so that the natural positive fluctuations of labile conditions (i.e., pain, depression, stress, anxiety, mobility, etc.) are attributed to the innovative treatment. If the service provider possesses great credibility and a favorable reputation in the community, etc., the stage is set for even greater placebo effects. How to recognise placebo effects: a comparison group of clients needs to receive some sort of benign but credible intervention, and their outcomes in effect subtracted from the outcomes of those who received the legitimate, experimental treatment.
26 External validity External validity concerns the extent to which one may safely generalize the conclusions derived from an evaluation. It is like to say that the program can be replicated with the same success in different situations (other subjects, other times, other settings). External validity concerns generalization and makes PE closer to research.
27 External validity There is always sound doubt that a program can be replicated with the same results in different time/space/culture situations even though experimental designs have been used (also with large samples). Social, political, demographic, economic conditions normally interact with the program. External validity is achievable in the extent to which the evaluation design allows the subjects, setting and time observed to be equivalent to those of which we would like to generalize.
28 External validity Experimental designs are not the best in this case since random assignment makes difficult to include typical subjects and natural settings. Both internal validity (to know if the program - as implemented - was effective) and external validity (how effective the program would be if continued or repeated) are important. Internal validity and external validity look a little contradictory since the first one concerns the past and the second one concerns the future.
In this chapter we discuss validity issues for quantitative research and for qualitative research.
Chapter 8 Validity of Research Results (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we discuss validity issues for
More informationOBSERVATION METHODS: EXPERIMENTS
OBSERVATION METHODS: EXPERIMENTS Sociological Research Methods Experiments Independent variable is manipulated, and the dependent variable respond to the manipulation. e.g. Eating a chocolate bar prior
More informationFormative and Impact Evaluation. Formative Evaluation. Impact Evaluation
Formative and Impact Evaluation Formative Evaluation 2 An evaluation designed to produce qualitative and quantitative data and insight during the early developmental phase of an intervention, including
More informationPLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity
PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with
More informationExperimental Design and the struggle to control threats to validity
EXPERIMENTAL DESIGN Experimental Design and the struggle to control threats to validity INCREASINGLY CONSTRAINED LOW NATURALISTIC CASE-STUDY CORRELATIONAL DIFFERENTIAL EXPERIMENTAL HIGH Experimental design
More informationChapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.
Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we talk about what experiments are, we
More informationLecture 4: Research Approaches
Lecture 4: Research Approaches Lecture Objectives Theories in research Research design approaches ú Experimental vs. non-experimental ú Cross-sectional and longitudinal ú Descriptive approaches How to
More information3 CONCEPTUAL FOUNDATIONS OF STATISTICS
3 CONCEPTUAL FOUNDATIONS OF STATISTICS In this chapter, we examine the conceptual foundations of statistics. The goal is to give you an appreciation and conceptual understanding of some basic statistical
More informationThe following are questions that students had difficulty with on the first three exams.
The following are questions that students had difficulty with on the first three exams. Exam 1 1. A measure has construct validity if it: a) really measures what it is supposed to measure b) appears, on
More informationChapter Three Research Methodology
Chapter Three Research Methodology Research Methods is a systematic and principled way of obtaining evidence (data, information) for solving health care problems. 1 Dr. Mohammed ALnaif METHODS AND KNOWLEDGE
More informationMore on Experiments: Confounding and Obscuring Variables (Part 1) Dr. Stefanie Drew
1 More on Experiments: Confounding and Obscuring Variables (Part 1) Dr. Stefanie Drew stefanie.drew@csun.edu 2 Previously, On Research Methods Basic structure of an experiment Now in more detail Internal
More informationStudy Design. Svetlana Yampolskaya, Ph.D. Summer 2013
Study Design Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Single point in time Cross-Sectional Research Multiple points in time Study only exists in this point in time Longitudinal Research Study
More informationQuasi-Experimental and Single Case Experimental Designs. Experimental Designs vs. Quasi-Experimental Designs
1 Quasi-Experimental and Single Case Experimental Designs RCS 6740 6/30/04 Experimental Designs vs. Quasi-Experimental Designs Experimental Designs include: Random Assignment of Participants to groups
More informationValidity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that
Validity refers to the accuracy of a measure. A measurement is valid when it measures what it is suppose to measure and performs the functions that it purports to perform. Does an indicator accurately
More informationResearch Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section
Research Approach & Design Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Content: Introduction Definition of research design Process of designing & conducting
More informationImpact Evaluation Methods: Why Randomize? Meghan Mahoney Policy Manager, J-PAL Global
Impact Evaluation Methods: Why Randomize? Meghan Mahoney Policy Manager, J-PAL Global Course Overview 1. What is Evaluation? 2. Outcomes, Impact, and Indicators 3. Why Randomize? 4. How to Randomize? 5.
More informationCHAPTER LEARNING OUTCOMES
EXPERIIMENTAL METHODOLOGY CHAPTER LEARNING OUTCOMES When you have completed reading this article you will be able to: Define what is an experiment Explain the role of theory in educational research Justify
More informationChapter 4: Understanding Others
4A Understanding Others 1 Chapter 4: Understanding Others From Physical Appearance to Inferences about Personality Traits The Accuracy of Snap Judgments From Acts to Dispositions: The Importance of Causal
More informationCOUNSELING INTERVIEW GUIDELINES
Dr. Moshe ben Asher SOC 356, Introduction to Social Welfare CSUN, Sociology Department COUNSELING INTERVIEW GUIDELINES WHAT DISTINGUISHES A PROFESSIONAL FROM OTHER KINDS OF WORKERS? Education and training
More informationCHAPTER 8 EXPERIMENTAL DESIGN
CHAPTER 8 1 EXPERIMENTAL DESIGN LEARNING OBJECTIVES 2 Define confounding variable, and describe how confounding variables are related to internal validity Describe the posttest-only design and the pretestposttest
More informationExperimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.
Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).
More informationPolitical Science 15, Winter 2014 Final Review
Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically
More informationLevels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended?
Program Evaluation Jonathan Howland, PhD, MPH 1 Formative Process Level Outcome Levels of Evaluation Question Example of Method Does the program Focus groups with make sense? target population. Was the
More informationCausal inference: Nuts and bolts
DAVIDSON CONSULTING LIMITED http://davidsonconsulting.co.nz World-class evaluation & organisational consulting Causal inference: Nuts and bolts A Mini Workshop for the anzea Wellington branch E. Jane Davidson,
More informationPYSC 224 Introduction to Experimental Psychology
PYSC 224 Introduction to Experimental Psychology Session 7 Extraneous Variables Lecturer: Dr. Margaret Amankwah-Poku, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh College of Education
More informationVARIABLES AND MEASUREMENT
ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 16A LECTURE NOTES [01/29/16] VARIABLES AND MEASUREMENT AGE 1 Topic #3 VARIABLES AND MEASUREMENT VARIABLES Some definitions of variables include the following: 1.
More informationTRANSLATING RESEARCH INTO ACTION. Why randomize? Dan Levy. Harvard Kennedy School
TRANSLATING RESEARCH INTO ACTION Why randomize? Dan Levy Harvard Kennedy School Your background Course Overview 1. What is evaluation? 2. Measuring impacts (outcomes, indicators) 3. Why randomize? 4. How
More informationThe degree to which a measure is free from error. (See page 65) Accuracy
Accuracy The degree to which a measure is free from error. (See page 65) Case studies A descriptive research method that involves the intensive examination of unusual people or organizations. (See page
More information9 research designs likely for PSYC 2100
9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one
More informationClass 1: Introduction, Causality, Self-selection Bias, Regression
Class 1: Introduction, Causality, Self-selection Bias, Regression Ricardo A Pasquini April 2011 Ricardo A Pasquini () April 2011 1 / 23 Introduction I Angrist s what should be the FAQs of a researcher:
More informationThreats to validity in intervention studies. Potential problems Issues to consider in planning
Threats to validity in intervention studies Potential problems Issues to consider in planning An important distinction Credited to Campbell & Stanley (1963) Threats to Internal validity Threats to External
More information9/30/2017. personality traits: Sheltered, Confident, Team- Oriented, Conventional, Pressured, Achieving
Addresses the extent to which the research design ensures that the only possible explanation for the results (dependent variable) is the effect of the independent variable Rules out confounding variables
More informationMental Health Strategy. Easy Read
Mental Health Strategy Easy Read Mental Health Strategy Easy Read The Scottish Government, Edinburgh 2012 Crown copyright 2012 You may re-use this information (excluding logos and images) free of charge
More informationAsking & Answering Sociological Questions
Chapter 2 Asking & Answering Sociological Questions 1 Scientific Method (p. 36) Sociology is a science because it requires a systematic method of investigation The scientific method is organized around
More informationRESEARCH METHODS. Winfred, research methods, ; rv ; rv
RESEARCH METHODS 1 Research Methods means of discovering truth 2 Research Methods means of discovering truth what is truth? 3 Research Methods means of discovering truth what is truth? Riveda Sandhyavandanam
More informationStrategies to Promote Emotional Resilience
UAS Conference Series 2013/14 Strategies to Promote Emotional Resilience Dr Ruth Collins and Alan Percy Counselling Service Student Welfare and Support Services 14 September 2010 Page 1 What is stress?
More informationImportance of Good Measurement
Importance of Good Measurement Technical Adequacy of Assessments: Validity and Reliability Dr. K. A. Korb University of Jos The conclusions in a study are only as good as the data that is collected. The
More informationTopic #2. A key criterion in evaluating any test, measure, or piece of research is validity.
ARTHUR SYC 302 (EXERIMENTAL SYCHOLOGY) 18C LECTURE NOTES [08/23/18] RESEARCH VALIDITY AGE 1 Topic #2 RESEARCH VALIDITY A key criterion in evaluating any test, measure, or piece of research is validity.
More informationSelecting a Study Design
CHAPTER 8 Selecting a Study Design In this chapter you will learn about: The differences between quantitative and qualitative study designs Common study designs in quantitative research and when to use
More informationGeorgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera
Homework assignment topics 37-42 Georgina Salas Topics 37-42 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 37 1. What is the purpose of an experiment? The purpose of an experiment is to explore
More informationUNIT 1. THE DIGNITY OF THE PERSON
Ethical Values 3ºESO Department of Philosophy IES Nicolás Copérnico UNIT 1. THE DIGNITY OF THE PERSON 1. What is a person? The Universal Declaration of Human Rights concedes the status of person to every
More informationExperimental and Quasi-Experimental designs
External Validity Internal Validity NSG 687 Experimental and Quasi-Experimental designs True experimental designs are characterized by three "criteria for causality." These are: 1) The cause (independent
More informationRESEARCH METHODS. Winfred, research methods,
RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,
More informationVALIDITY OF QUANTITATIVE RESEARCH
Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees
More informationSelf-Handicapping Variables and Students' Performance
Georgia Southern University Digital Commons@Georgia Southern SoTL Commons Conference SoTL Commons Conference Mar 12th, 4:00 PM - 5:45 PM Self-Handicapping Variables and Students' Performance Lugenia Dixon
More informationCausal inference nuts and bolts
DAVIDSON CONSULTING LIMITED http://davidsonconsulting.co.nz World-class evaluation & organisational consulting Causal inference nuts and bolts Demonstration Session American Evaluation Association conference
More informationBarriers to concussion reporting. Qualitative Study of Barriers to Concussive Symptom Reporting in High School Athletics
Barriers to concussion reporting Qualitative Study of Barriers to Concussive Symptom Reporting in High School Athletics Male soccer player: Well, like if you get a concussion. you bruised your brain and
More informationGUIDE 4: COUNSELING THE UNEMPLOYED
GUIDE 4: COUNSELING THE UNEMPLOYED Addressing threats to experimental integrity This case study is based on Sample Attrition Bias in Randomized Experiments: A Tale of Two Surveys By Luc Behaghel, Bruno
More informationEmpirical Knowledge: based on observations. Answer questions why, whom, how, and when.
INTRO TO RESEARCH METHODS: Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. Experimental research: treatments are given for the purpose of research. Experimental group
More informationWe re going to talk about a class of designs which generally are known as quasiexperiments. They re very important in evaluating educational programs
We re going to talk about a class of designs which generally are known as quasiexperiments. They re very important in evaluating educational programs and policies because often we might not have the right
More informationThe Regression-Discontinuity Design
Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations
More informationPsych 1Chapter 2 Overview
Psych 1Chapter 2 Overview After studying this chapter, you should be able to answer the following questions: 1) What are five characteristics of an ideal scientist? 2) What are the defining elements of
More informationADMS Sampling Technique and Survey Studies
Principles of Measurement Measurement As a way of understanding, evaluating, and differentiating characteristics Provides a mechanism to achieve precision in this understanding, the extent or quality As
More informationWhat Constitutes a Good Contribution to the Literature (Body of Knowledge)?
What Constitutes a Good Contribution to the Literature (Body of Knowledge)? Read things that make good contributions to the body of knowledge. The purpose of scientific research is to add to the body of
More information26:010:557 / 26:620:557 Social Science Research Methods
26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview
More informationEducational Research. S.Shafiee. Expert PDF Trial
Educational Research: Experimental Studies Educational Research S.Shafiee Research... The systematic application of a family of methods employed to provide trustworthy information about problems an ongoing
More informationTHE QUALITATIVE TRADITION: A COMPLIMENTARY PARADIGM FOR RESEARCH IN ECONOMIC EDUCATION
23 THE QUALITATIVE TRADITION: A COMPLIMENTARY PARADIGM FOR RESEARCH IN ECONOMIC EDUCATION George Langelett, South Dakota State University ABSTRACT The qualitative tradition provides an alternative approach
More informationFear messages in marketing
Fear messages in marketing Given what we have agreed about the two-way nature of communication and the need for empathy and shared understanding, it seems inappropriate to ask generic questions about whether
More information11-3. Learning Objectives
11-1 Measurement Learning Objectives 11-3 Understand... The distinction between measuring objects, properties, and indicants of properties. The similarities and differences between the four scale types
More informationThe Human Side of Science: I ll Take That Bet! Balancing Risk and Benefit. Uncertainty, Risk and Probability: Fundamental Definitions and Concepts
The Human Side of Science: I ll Take That Bet! Balancing Risk and Benefit Uncertainty, Risk and Probability: Fundamental Definitions and Concepts What Is Uncertainty? A state of having limited knowledge
More informationPatrick Breheny. January 28
Confidence intervals Patrick Breheny January 28 Patrick Breheny Introduction to Biostatistics (171:161) 1/19 Recap Introduction In our last lecture, we discussed at some length the Public Health Service
More informationOverview of the Logic and Language of Psychology Research
CHAPTER W1 Overview of the Logic and Language of Psychology Research Chapter Outline The Traditionally Ideal Research Approach Equivalence of Participants in Experimental and Control Groups Equivalence
More informationDoes anxiety cause some difficulty for a young person you know well? What challenges does this cause for the young person in the family or school?
John Walker, Ph.D. Department of Clinical Health Psychology University of Manitoba Everyone has the emotions at times. Signal us to be careful. Help us to stay safe. Most children and adults have mild
More informationVocabulary. Bias. Blinding. Block. Cluster sample
Bias Blinding Block Census Cluster sample Confounding Control group Convenience sample Designs Experiment Experimental units Factor Level Any systematic failure of a sampling method to represent its population
More informationThe Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016
The Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016 This course does not cover how to perform statistical tests on SPSS or any other computer program. There are several courses
More informationEXPERIMENTAL RESEARCH DESIGNS
ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study
More informationMatching: Observational research
Matching: Observational research 1 When is it deemed acceptable to observe without consent? In a public place where participants would normally expect to be observed by strangers These factors should always
More informationSemester: Semester 3, 2014 Program: Credit Points: 10 Course Coordinator: Document modified: 07 Oct :28:38
Course Code: Course Name: 1014CCJ Homicide Semester: Semester 3, 2014 Program: Diploma of Criminology & Criminal Justice Credit Points: 10 Course Coordinator: Greg Stevenson Document modified: 07 Oct 2014
More informationThe Practice of Statistics 1 Week 2: Relationships and Data Collection
The Practice of Statistics 1 Week 2: Relationships and Data Collection Video 12: Data Collection - Experiments Experiments are the gold standard since they allow us to make causal conclusions. example,
More informationConducting Strong Quasi-experiments
Analytic Technical Assistance and Development Conducting Strong Quasi-experiments Version 1 May 2015 This report was prepared for the Institute of Education Sciences (IES) by Decision Information Resources,
More informationThe Scientific Approach: A Search for Laws Basic assumption of science: Events are governed by some lawful order. Goals of psychology: Measure and
The Scientific Approach: A Search for Laws Basic assumption of science: Events are governed by some lawful order. Goals of psychology: Measure and describe Understand and predict Apply and control Explain
More informationQ: What can you tell us about the work you do and your involvement with children with autism?
If you know one person with autism, you know one person with autism April is Autism Awareness & Acceptance month and in an attempt to further educate the public about autism, Catriona Monthy, a registered
More informationThe Scientific Method
Course "Empirical Evaluation in Informatics" The Scientific Method Prof. Dr. Lutz Prechelt Freie Universität Berlin, Institut für Informatik http://www.inf.fu-berlin.de/inst/ag-se/ Science and insight
More informationOver the Limit: New report aims to reduce DUI deaths
Over the Limit: New report aims to reduce DUI deaths Joshua Vaughn The Sentinel Jan 26, 2018 Volunteer John Breeding Of The East Pennsboro Fire Police, Right, Is Administered A Breathalyzer Test by Sgt.
More informationWhat We Will Cover in This Section
Pre and Quasi-Experimental Design 9/2/2006 P767Intro.ppt 1 What We Will Cover in This Section What are they? Threats to internal validity. Pre-Experimental Designs Quasi- Experimental Designs. Summary
More informationMeeting a Kid with Autism
What s up with Nick? When school started, we had a new kid named Nick. He seemed a little different. My friends and I wondered, What's up with Nick? Turns out, Nick has autism. What is Autism This year,
More informationPREVENTING DISTRACTED DRIVING. Maintaining Focus Behind the Wheel of a School Bus
PREVENTING DISTRACTED DRIVING Maintaining Focus Behind the Wheel of a School Bus OUR THANKS! This educational program was funded by the National Highway Traffic Safety Administration with a grant from
More informationUNIT II: RESEARCH METHODS
THINKING CRITICALLY WITH PSYCHOLOGICAL SCIENCE UNIT II: RESEARCH METHODS Module 4: The Need for Psychological Science Module 5: Scientific Method and Description Module 6: Correlation and Experimentation
More informationUNDERSTANDING and LEADING CHANGE A workshop presented to the Archdiocesan Development Council by the SGC Consulting Group March 12, 2008
UNDERSTANDING and LEADING CHANGE A workshop presented to the Archdiocesan Development Council by the SGC Consulting Group March 12, 2008 Three Dimensions of Change The What and the Why The How The Who
More informationSTATISTICAL CONCLUSION VALIDITY
Validity 1 The attached checklist can help when one is evaluating the threats to validity of a study. VALIDITY CHECKLIST Recall that these types are only illustrative. There are many more. INTERNAL VALIDITY
More informationCommunication Research Practice Questions
Communication Research Practice Questions For each of the following questions, select the best answer from the given alternative choices. Additional instructions are given as necessary. Read each question
More informationWhy do Psychologists Perform Research?
PSY 102 1 PSY 102 Understanding and Thinking Critically About Psychological Research Thinking critically about research means knowing the right questions to ask to assess the validity or accuracy of a
More informationThe Invisible Driver of Chronic Pain
1 The Invisible Driver of Chronic Pain This guide is for people who ve tried many different treatments for chronic pain - and are still in pain. www.lifeafterpain.com 2 How would you like to get to the
More informationalternate-form reliability The degree to which two or more versions of the same test correlate with one another. In clinical studies in which a given function is going to be tested more than once over
More informationReliability, validity, and all that jazz
Reliability, validity, and all that jazz Dylan Wiliam King s College London Introduction No measuring instrument is perfect. The most obvious problems relate to reliability. If we use a thermometer to
More informationQUASI EXPERIMENTAL DESIGN
UNIT 3 QUASI EXPERIMENTAL DESIGN Factorial Design Structure 3. Introduction 3.1 Objectives 3.2 Meaning of Quasi Experimental Design 3.3 Difference Between Quasi Experimental Design and True Experimental
More informationThis exam consists of three parts. Provide answers to ALL THREE sections.
Empirical Analysis and Research Methodology Examination Yale University Department of Political Science January 2008 This exam consists of three parts. Provide answers to ALL THREE sections. Your answers
More informationExperimental Design (7)
Experimental Design (7) Kerry Kilborn Department of Psychology Overview Confounding variables Experiment vs. Correlational Study Between-Subjects Design Equivalent Groups Quasi-Experiments Summary Experimental
More informationMATH& 146 Lesson 6. Section 1.5 Experiments
MATH& 146 Lesson 6 Section 1.5 Experiments 1 Experiments Studies where the researchers assign treatments to cases are called experiments. When this assignment includes randomization (such as coin flips)
More information1. Which of the following functions is affected by alcohol consumption? A. Vision B. Steering C. Attention D. All of the above
Test review 1. Which of the following functions is affected by alcohol consumption? A. Vision B. Steering C. Attention D. All of the above 2.Alcohol use is involved in what fraction of the deaths on Minnesota
More informationOverview of Experimentation
The Basics of Experimentation Overview of Experiments. IVs & DVs. Operational Definitions. Reliability. Validity. Internal vs. External Validity. Classic Threats to Internal Validity. Lab: FP Overview;
More informationUNIT 7 EXPERIMENTAL RESEARCH-I1
UNIT 7 EXPERIMENTAL RESEARCH-I1 Structure 7.1 Introduction 7.2 Objectives 7.3 Types of Experimental Design 7.4 Pre-experimental Designs 7.4.1 One Shot Case Study Design 7.4.2 One Group Pre-test Post-test
More informationAs a law enforcement official you
Toolkit for Law Enforcement Impaired Driving is a Crime That Kills As a law enforcement official you understand that impaired driving is no accident. It s a serious crime that kills more than 16,000 people
More informationINSTRUCTION NO. which renders him/her incapable of safely operating a motor vehicle. Under the law, a person
INSTRUCTION NO. The mere consumption of alcohol combined with the driving of a vehicle is not unlawful. It is only unlawful for someone to drive a vehicle while under the influence of alcohol to a degree
More informationCHAPTER. Experimental Research
OVERVIEW CHAPTER 6 Experimental Research That [continuity and progress] have been tied to careful experimental and theoretical work indicates that there is validity in a method which at times feels unproductive
More informationGoal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment
Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Scientific Study of Causation and Treatment Methods for studying causation Case
More information2 Critical thinking guidelines
What makes psychological research scientific? Precision How psychologists do research? Skepticism Reliance on empirical evidence Willingness to make risky predictions Openness Precision Begin with a Theory
More informationORIGINS AND DISCUSSION OF EMERGENETICS RESEARCH
ORIGINS AND DISCUSSION OF EMERGENETICS RESEARCH The following document provides background information on the research and development of the Emergenetics Profile instrument. Emergenetics Defined 1. Emergenetics
More informationAn Understanding of Role of Heuristic on Investment Decisions
International Review of Business and Finance ISSN 0976-5891 Volume 9, Number 1 (2017), pp. 57-61 Research India Publications http://www.ripublication.com An Understanding of Role of Heuristic on Investment
More information