What We Will Cover in This Section

Size: px
Start display at page:

Download "What We Will Cover in This Section"

Transcription

1 Pre and Quasi-Experimental 1 What We Will Cover in This Section Pre-Experimental Quasi- Experimental. Summary 2 Internal Validity Revisited 3

2 Common Threats to Internal Validity 1. History. 2. Maturation. 3. Testing. 4. Instrument Decay. 5. Statistical Regression History ny event that occurs between the first and second dependent measures that is not manipulated by the experimenter. Delay 5 2. Testing Participation in the pre-test may cause changes in the person. - Reactivity - Memory Delay 6

3 3. Maturation Changes in the individual over time that are not associated with the independent variable. Placebo Delay Delay 7 4. Instrument Decay Changes in the measuring instrument over time. Observer gets bored. Test becomes obsolete. Machine wears out Statistical Regression Occurs when participants are placed into groups based on extreme scores. Extreme scores tend to move(regress) toward the mean. Delay 9

4 Pre-Experimental 10 One-Shot Case Study Group Independent (s) controlled by the experimenter Dependent ment(s) made after the treatments are applied. What is missing from this design? 11 Benefits and Issues Benefits. 1. OK for preliminary research. Issues. 1. History. 2. Maturation. 3. Regression. 12

5 One-group Independent Group 1 What is missing from this design? 13 Benefits and Issues Benefits. 1. OK for preliminary research. Issues. 1. History. 2. Maturation. 3. Regression. 4. Testing. 5. Instrument decay. 14 Quasi-Experimental 15

6 Definition that have all of the controls of a true experiment but do not duplicate the true experimental design. Weakness in one or more areas. Weakness leads to confounding. Gives more information than nothing at all. 16 Ex Post Facto pproach Independent Dependent Group 1 Group 2 Groups divided based on some pre-existing condition. ment(s) made after the assignment to groups 17 Benefits and Issues Benefits. 1. May be the only way to study some influences. 2. May be OK for preliminary research. Issues. 1. Ss not randomly assigned to treatment conditions. 2. If a person is unusual on one characteristic he may be unusual on others. 18

7 Non-Equivalent Control Group, Pretest: Independent SS 1 SS 2 SS 3 1 SS 4 SS 5 SS When Used When participants cannot be assigned at random. When you have to use pre-existing groups. 20 Issue and nswer Issue. The groups may differ on the dependent variable at the beginning of the experiment. nswer. Compare groups on the pre-test to see if there are differences. 21

8 Other Issues and Fixes 1. Replicate the study. 2. ssign multiple groups to treatment conditions. 22 Time Series Similar to single subject design but with one group. Usually have Baseline measurement on dependent variable. Some manipulation or event. Second measurement on the dependent variable. 23 Interrupted Time Series Design Baseline () Event Post Test 24

9 Number of Fatalities Connecticut Traffic Fatalities Speeding Crackdown Year 25 When Used ssess the impact of some naturally occurring event. ssess the impact of some broad treatment within an existing group. 26 Control Series Design Uses existing groups but attempts to match the treatment group with an equivalent control group. 27

10 Control Series Design Baseline Baseline Event Event Post Test Post Test 28 Issues Potential confounding from History Maturation Instrumentation changes. 29 Connecticut Traffic Fatalities 15 Fatality Rate Year Connecticut Control 30

11 Thought Problem Petal D. Stamen was interested in the influence that flowers would have on women s affection toward men. Petal sent a dozen roses to a random sample of women then asked them to fill out a well researched affection survey. 1. What kind of design is this? 2. Is this a good or bad design? Why? 3. How could this study be improved? 31 32

What We Will Cover in This Section

What We Will Cover in This Section Pre and Quasi-Experimental Design 9/2/2006 P767Intro.ppt 1 What We Will Cover in This Section What are they? Threats to internal validity. Pre-Experimental Designs Quasi- Experimental Designs. Summary

More information

Experimental Design. What We Will Cover in This Section. Basic Requirements

Experimental Design. What We Will Cover in This Section. Basic Requirements Experimental Design 3/29/2004 P365 Experimental Design 1 What We Will Cover in This Section Overview. Basic requirements. Between subjects designs. Within subjects designs. Factorial designs. Pre-experimental

More information

Experimental Validity

Experimental Validity Experimental Validity 2/16/2003 P365 Experimental Validity 1 What We Will Cover in This Section Overview Internal Validity. External Validity. Key Learning Points. 2/16/2003 P365 Experimental Validity

More information

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGN To strongly identify cause-and-effect relationships Experimental Design EXPERIMENTAL AND EX POST FACTO DESIGN

More information

Educational Research. S.Shafiee. Expert PDF Trial

Educational Research. S.Shafiee. Expert PDF Trial Educational Research: Experimental Studies Educational Research S.Shafiee Research... The systematic application of a family of methods employed to provide trustworthy information about problems an ongoing

More information

Rival Plausible Explanations

Rival Plausible Explanations Ci Criminology i 860 Quasi-Experimentation and Evaluation Research Remember John Stuart Mill s 3 Criteria for inferring the existence of a causal relation: 1. Temporal precedence 2. Existence of a relationship

More information

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D. Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).

More information

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs Nonexperimental vs. Quasi- Experimental Strategies PSY 250 Quasi and Non-experimental designs Chapter 10 Resemble experiments but contain some threat such as a confounding variable that can not be completely

More information

Design of Experiments & Introduction to Research

Design of Experiments & Introduction to Research Design of Experiments & Introduction to Research 1 Design of Experiments Introduction to Research Definition and Purpose Scientific Method Research Project Paradigm Structure of a Research Project Types

More information

11/2/2017. Often, we cannot manipulate a variable of interest

11/2/2017. Often, we cannot manipulate a variable of interest Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the

More information

UNIT III: Research Design. In designing a needs assessment the first thing to consider is level for the assessment

UNIT III: Research Design. In designing a needs assessment the first thing to consider is level for the assessment UNIT III: Research Design SWK 330 Kimberly Baker-Abrams What is a needs assessment? Why is it helpful? an assessment to determine the existence of services, client population, client access to services,

More information

PYSC 224 Introduction to Experimental Psychology

PYSC 224 Introduction to Experimental Psychology PYSC 224 Introduction to Experimental Psychology Session 6 Quasi Experiments and Faulty Experimental Designs Part 1 & 2 Lecturer: Dr. Margaret Amankwah-Poku, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh

More information

The following are questions that students had difficulty with on the first three exams.

The following are questions that students had difficulty with on the first three exams. The following are questions that students had difficulty with on the first three exams. Exam 1 1. A measure has construct validity if it: a) really measures what it is supposed to measure b) appears, on

More information

10/23/2017. Often, we cannot manipulate a variable of interest

10/23/2017. Often, we cannot manipulate a variable of interest Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the

More information

More on Experiments: Confounding and Obscuring Variables (Part 1) Dr. Stefanie Drew

More on Experiments: Confounding and Obscuring Variables (Part 1) Dr. Stefanie Drew 1 More on Experiments: Confounding and Obscuring Variables (Part 1) Dr. Stefanie Drew stefanie.drew@csun.edu 2 Previously, On Research Methods Basic structure of an experiment Now in more detail Internal

More information

Formative and Impact Evaluation. Formative Evaluation. Impact Evaluation

Formative and Impact Evaluation. Formative Evaluation. Impact Evaluation Formative and Impact Evaluation Formative Evaluation 2 An evaluation designed to produce qualitative and quantitative data and insight during the early developmental phase of an intervention, including

More information

Threats to validity in intervention studies. Potential problems Issues to consider in planning

Threats to validity in intervention studies. Potential problems Issues to consider in planning Threats to validity in intervention studies Potential problems Issues to consider in planning An important distinction Credited to Campbell & Stanley (1963) Threats to Internal validity Threats to External

More information

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Single point in time Cross-Sectional Research Multiple points in time Study only exists in this point in time Longitudinal Research Study

More information

Define the population Determine appropriate sample size Choose a sampling design Choose an appropriate research design

Define the population Determine appropriate sample size Choose a sampling design Choose an appropriate research design Numbers! Observation Study: observing individuals and measuring variables of interest without attempting to influence the responses Correlational Research: examining the relationship between two variables

More information

Experimental and Quasi-Experimental designs

Experimental and Quasi-Experimental designs External Validity Internal Validity NSG 687 Experimental and Quasi-Experimental designs True experimental designs are characterized by three "criteria for causality." These are: 1) The cause (independent

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

Chapter 10 Quasi-Experimental and Single-Case Designs

Chapter 10 Quasi-Experimental and Single-Case Designs Chapter 10 Quasi-Experimental and Single-Case Designs (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) The experimental research designs

More information

Quasi-Experimental and Single Case Experimental Designs. Experimental Designs vs. Quasi-Experimental Designs

Quasi-Experimental and Single Case Experimental Designs. Experimental Designs vs. Quasi-Experimental Designs 1 Quasi-Experimental and Single Case Experimental Designs RCS 6740 6/30/04 Experimental Designs vs. Quasi-Experimental Designs Experimental Designs include: Random Assignment of Participants to groups

More information

investigate. educate. inform.

investigate. educate. inform. investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced

More information

26:010:557 / 26:620:557 Social Science Research Methods

26:010:557 / 26:620:557 Social Science Research Methods 26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview

More information

Overview of Experimentation

Overview of Experimentation The Basics of Experimentation Overview of Experiments. IVs & DVs. Operational Definitions. Reliability. Validity. Internal vs. External Validity. Classic Threats to Internal Validity. Lab: FP Overview;

More information

Levels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended?

Levels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended? Program Evaluation Jonathan Howland, PhD, MPH 1 Formative Process Level Outcome Levels of Evaluation Question Example of Method Does the program Focus groups with make sense? target population. Was the

More information

Experimental Design (7)

Experimental Design (7) Experimental Design (7) Kerry Kilborn Department of Psychology Overview Confounding variables Experiment vs. Correlational Study Between-Subjects Design Equivalent Groups Quasi-Experiments Summary Experimental

More information

Experimental Design and the struggle to control threats to validity

Experimental Design and the struggle to control threats to validity EXPERIMENTAL DESIGN Experimental Design and the struggle to control threats to validity INCREASINGLY CONSTRAINED LOW NATURALISTIC CASE-STUDY CORRELATIONAL DIFFERENTIAL EXPERIMENTAL HIGH Experimental design

More information

Experimental Design Part II

Experimental Design Part II Experimental Design Part II Keith Smolkowski April 30, 2008 Where Are We Now? esearch eview esearch Design: The Plan Internal Validity Statements of Causality External Validity Statements of Generalizability

More information

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera Homework assignment topics 37-42 Georgina Salas Topics 37-42 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 37 1. What is the purpose of an experiment? The purpose of an experiment is to explore

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups. ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 17A LECTURE NOTES [03/08/17] QUASI-EXPERIMENTAL DESIGNS PAGE 1 Topic #6 QUASI-EXPERIMENTAL DESIGNS Again, central issue is one of research validity. Quasi-experimental

More information

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters. Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we talk about what experiments are, we

More information

Threats to Validity in Experiments. The John Henry Effect

Threats to Validity in Experiments. The John Henry Effect Threats to Validity in Experiments Office Hours: M 11:30-12:30, W 10:30-12:30 SSB 447 The John Henry Effect Housekeeping Homework 3, due Tuesday A great paper, but far from an experiment Midterm review

More information

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN RESEARCH METHODS A Process of Inquiry ANTHONY M. GRAZIANO MICHAEL L RAULIN STA TE UNIVERSITY OF NEW YORK A T BUFFALO tm HarperCollinsPublishers CONTENTS Instructor's Preface xv Student's Preface xix 1

More information

2013/4/28. Experimental Research

2013/4/28. Experimental Research 2013/4/28 Experimental Research Definitions According to Stone (Research methods in organizational behavior, 1978, pp 118), a laboratory experiment is a research method characterized by the following:

More information

QUASI EXPERIMENTAL DESIGN

QUASI EXPERIMENTAL DESIGN UNIT 3 QUASI EXPERIMENTAL DESIGN Factorial Design Structure 3. Introduction 3.1 Objectives 3.2 Meaning of Quasi Experimental Design 3.3 Difference Between Quasi Experimental Design and True Experimental

More information

04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing

04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing Research Methods in Psychology Chapter 6: Independent Groups Designs 1 Why Psychologists Conduct Experiments? What is your ideas? 2 Why Psychologists Conduct Experiments? Testing Hypotheses derived from

More information

Lecture 4: Research Approaches

Lecture 4: Research Approaches Lecture 4: Research Approaches Lecture Objectives Theories in research Research design approaches ú Experimental vs. non-experimental ú Cross-sectional and longitudinal ú Descriptive approaches How to

More information

Previous Example. New. Tradition

Previous Example. New. Tradition Experimental Design Previous Example New Tradition Goal? New Tradition =? Challenges Internal validity How to guarantee what you have observed is true? External validity How to guarantee what you have

More information

HPS301 Exam Notes- Contents

HPS301 Exam Notes- Contents HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats

More information

Experiments. ESP178 Research Methods Dillon Fitch 1/26/16. Adapted from lecture by Professor Susan Handy

Experiments. ESP178 Research Methods Dillon Fitch 1/26/16. Adapted from lecture by Professor Susan Handy Experiments ESP178 Research Methods Dillon Fitch 1/26/16 Adapted from lecture by Professor Susan Handy Recap Causal Validity Criterion Association Non-spurious Time order Causal Mechanism Context Explanation

More information

Research Approaches Quantitative Approach. Research Methods vs Research Design

Research Approaches Quantitative Approach. Research Methods vs Research Design Research Approaches Quantitative Approach DCE3002 Research Methodology Research Methods vs Research Design Both research methods as well as research design are crucial for successful completion of any

More information

From Description to Causation

From Description to Causation From Description to Causation Department of Government London School of Economics and Political Science 1 Correlation vs. Causation 2 Over-Time Changes 3 Getting Systematic about Causality What makes something

More information

OBSERVATION METHODS: EXPERIMENTS

OBSERVATION METHODS: EXPERIMENTS OBSERVATION METHODS: EXPERIMENTS Sociological Research Methods Experiments Independent variable is manipulated, and the dependent variable respond to the manipulation. e.g. Eating a chocolate bar prior

More information

Experimental Research I. Quiz/Review 7/6/2011

Experimental Research I. Quiz/Review 7/6/2011 Experimental Research I Day 3 Quiz/Review Quiz Review Normal Curve z scores & T scores More on the normal curve and variability... Theoretical perfect curve. Never happens in actual research Mean, median,

More information

Research Design & Protocol Development

Research Design & Protocol Development Research Design & Protocol Development Paul J Kim, DPM, MS, FACFAS Associate Professor Director of Research Definitions Randomization Sampling Allocation Variables Independent Variable Treatment, intervention,

More information

STATISTICAL CONCLUSION VALIDITY

STATISTICAL CONCLUSION VALIDITY Validity 1 The attached checklist can help when one is evaluating the threats to validity of a study. VALIDITY CHECKLIST Recall that these types are only illustrative. There are many more. INTERNAL VALIDITY

More information

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC Conducting Research in the Social Sciences Rick Balkin, Ph.D., LPC-S, NCC 1 Why we do research Improvement Description Explanation Prediction R. S. Balkin, 2008 2 Theory Explanation of an observed phenomena

More information

Skills Center Psychology Practice Exam II

Skills Center Psychology Practice Exam II 1.) The scientific method always a. begins with observation and ends with generation of a hypothesis. b. begins with generation of a hypothesis and ends with systematic observation. c. begins and ends

More information

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8 Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to

More information

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Research Approach & Design Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Content: Introduction Definition of research design Process of designing & conducting

More information

MBACATÓLICA JAN/APRIL Marketing Research. Fernando S. Machado. Experimentation

MBACATÓLICA JAN/APRIL Marketing Research. Fernando S. Machado. Experimentation MBACATÓLICA JAN/APRIL 2006 Marketing Research Fernando S. Machado Week 5 Experimentation 1 Experimentation Experimental Research and Causality Experimental Designs Lab versus Field Experiments Test Marketing

More information

VALIDITY OF QUANTITATIVE RESEARCH

VALIDITY OF QUANTITATIVE RESEARCH Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees

More information

Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010

Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010 Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010 CAPE Student evaluations now done online Please check your UCSD email for link to evaluations for your

More information

Measurement. Reliability vs. Validity. Reliability vs. Validity

Measurement. Reliability vs. Validity. Reliability vs. Validity MEASUREMENT Outline 1. Measurement - Reliability vs. Validity - Validity - Threats to Internal Validity - Construct Validity (measurement validity) - Face validity - Content validity - Predictive validity

More information

Sample Exam Questions Psychology 3201 Exam 1

Sample Exam Questions Psychology 3201 Exam 1 Scientific Method Scientific Researcher Scientific Practitioner Authority External Explanations (Metaphysical Systems) Unreliable Senses Determinism Lawfulness Discoverability Empiricism Control Objectivity

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

Experimental and quasi-experimental designs:

Experimental and quasi-experimental designs: C82MST: Practical and statistical methods Experimental and quasi-experimental designs: Establishing causal effects of independent variables Tobias Bast School of Psychology, University of Nottingham Feynman

More information

Research Design. Beyond Randomized Control Trials. Jody Worley, Ph.D. College of Arts & Sciences Human Relations

Research Design. Beyond Randomized Control Trials. Jody Worley, Ph.D. College of Arts & Sciences Human Relations Research Design Beyond Randomized Control Trials Jody Worley, Ph.D. College of Arts & Sciences Human Relations Introduction to the series Day 1: Nonrandomized Designs Day 2: Sampling Strategies Day 3:

More information

CHAPTER 8 EXPERIMENTAL DESIGN

CHAPTER 8 EXPERIMENTAL DESIGN CHAPTER 8 1 EXPERIMENTAL DESIGN LEARNING OBJECTIVES 2 Define confounding variable, and describe how confounding variables are related to internal validity Describe the posttest-only design and the pretestposttest

More information

UNIT 7 EXPERIMENTAL RESEARCH-I1

UNIT 7 EXPERIMENTAL RESEARCH-I1 UNIT 7 EXPERIMENTAL RESEARCH-I1 Structure 7.1 Introduction 7.2 Objectives 7.3 Types of Experimental Design 7.4 Pre-experimental Designs 7.4.1 One Shot Case Study Design 7.4.2 One Group Pre-test Post-test

More information

One slide on research question Literature review: structured; holes you will fill in Your research design

One slide on research question Literature review: structured; holes you will fill in Your research design Topics Ahead Week 10-11: Experimental design; Running experiment Week 12: Survey Design; ANOVA Week 13: Correlation and Regression; Non Parametric Statistics Week 14: Computational Methods; Simulation;

More information

PM12 Validity P R O F. D R. P A S Q U A L E R U G G I E R O D E P A R T M E N T O F B U S I N E S S A N D L A W

PM12 Validity P R O F. D R. P A S Q U A L E R U G G I E R O D E P A R T M E N T O F B U S I N E S S A N D L A W PM12 Validity P R O F. D R. P A S Q U A L E R U G G I E R O D E P A R T M E N T O F B U S I N E S S A N D L A W Internal and External Validity The concept of validity is very important in PE. To make PE

More information

Psychology of Dysfunctional Behaviour RESEARCH METHODS

Psychology of Dysfunctional Behaviour RESEARCH METHODS Psychology of Dysfunctional Behaviour RESEARCH METHODS The history of abnormal psychology shows that theories and treatment procedures may seem effective in some cases but prove useless and even harmful

More information

QUASI-EXPERIMENTAL HEALTH SERVICE EVALUATION COMPASS 1 APRIL 2016

QUASI-EXPERIMENTAL HEALTH SERVICE EVALUATION COMPASS 1 APRIL 2016 QUASI-EXPERIMENTAL HEALTH SERVICE EVALUATION COMPASS 1 APRIL 2016 AIM & CONTENTS Aim to explore what a quasi-experimental study is and some issues around how they are done Context and Framework Review

More information

How to craft the Approach section of an R grant application

How to craft the Approach section of an R grant application How to craft the Approach section of an R grant application David Elashoff, PhD Professor of Medicine and Biostatistics Director, Department of Medicine Statistics Core Leader, CTSI Biostatistics Program

More information

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany Overview of Perspectives on Causal Inference: Campbell and Rubin Stephen G. West Arizona State University Freie Universität Berlin, Germany 1 Randomized Experiment (RE) Sir Ronald Fisher E(X Treatment

More information

Methodology & Research

Methodology & Research Methodology & Research Scientific Methods Psychologists conduct studies to determine why people behave the way they do in different situations under different circumstances Psychological studies provide

More information

Correlational Research. The Correlation Coefficient. Correlational Research

Correlational Research. The Correlation Coefficient. Correlational Research Correlational Research Correlational research: Assess relationships among naturally occurring variables. Attitudes, preferences, intelligence, personality traits, feelings, age, sex The Correlation Coefficient

More information

M6728. Goals. Depression Scores. Research Designs

M6728. Goals. Depression Scores. Research Designs M6728 Research Designs Goals Match appropriate research designs to the study purpose and questions Differentiate between experimental and non-experimental studies Discuss epidemiologic designs Evaluate

More information

RESEARCH METHODS. Winfred, research methods, ; rv ; rv

RESEARCH METHODS. Winfred, research methods, ; rv ; rv RESEARCH METHODS 1 Research Methods means of discovering truth 2 Research Methods means of discovering truth what is truth? 3 Research Methods means of discovering truth what is truth? Riveda Sandhyavandanam

More information

Lecture 23: Observational Research. Outline. Review. Review Finish Applied Research Start Observational Research

Lecture 23: Observational Research. Outline. Review. Review Finish Applied Research Start Observational Research Lecture 23: Observational Research Outline Review Finish Applied Research Start Observational Research Review When Interventions Harm Study Dishion et al. (1999) Abstinence Education Palmgreen et al. Example

More information

Introduction Can we improve memory for nonsense pics w/ cue? Method Study: See 28 pics (w/ or w/o label) Test: Immediate recall (draw)

Introduction Can we improve memory for nonsense pics w/ cue? Method Study: See 28 pics (w/ or w/o label) Test: Immediate recall (draw) Chapter 9 Between-subject design (Bet-Ss) aka Between-participant design Experimental design and vocabulary Threats to internal validity Threats to external validity Within-subject design (W/in-Ss) aka

More information

Chapter 13 Summary Experiments and Observational Studies

Chapter 13 Summary Experiments and Observational Studies Chapter 13 Summary Experiments and Observational Studies What have we learned? We can recognize sample surveys, observational studies, and randomized comparative experiments. o These methods collect data

More information

RESEARCH METHODS. Winfred, research methods,

RESEARCH METHODS. Winfred, research methods, RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,

More information

CHAPTER LEARNING OUTCOMES

CHAPTER LEARNING OUTCOMES EXPERIIMENTAL METHODOLOGY CHAPTER LEARNING OUTCOMES When you have completed reading this article you will be able to: Define what is an experiment Explain the role of theory in educational research Justify

More information

Scientific Research. The Scientific Method. Scientific Explanation

Scientific Research. The Scientific Method. Scientific Explanation Scientific Research The Scientific Method Make systematic observations. Develop a testable explanation. Submit the explanation to empirical test. If explanation fails the test, then Revise the explanation

More information

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies Copyright 2012, 2008, 2005 Pearson Education, Inc. Observational Studies In an observational study, researchers don t assign choices; they simply observe

More information

How to Do Experiments

How to Do Experiments How to Do Experiments Goals Understand and discuss hypothesis testing Discuss random variables, statistical significance, and statistical regression Design an experiment as a class Testing a Hypothesis

More information

Can Quasi Experiments Yield Causal Inferences? Sample. Intervention 2/20/2012. Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University

Can Quasi Experiments Yield Causal Inferences? Sample. Intervention 2/20/2012. Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University Can Quasi Experiments Yield Causal Inferences? Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University Sample Study 1 Study 2 Year Age Race SES Health status Intervention Study 1 Study 2 Intervention

More information

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality Lecture 3 Empirical Research Methods IN4304 design (fixed design) Previous lecture A research plan Consider: purpose, theory, research question, mode inquiry, sampling method Research question Descriptive/

More information

Testing the ABC floral-organ identity model: expression of A and C function genes

Testing the ABC floral-organ identity model: expression of A and C function genes Objectives: Testing the ABC floral-organ identity model: expression of A and C function genes To test the validity of the ABC model for floral organ identity we will: 1. Use the model to make predictions

More information

EXPERIMENTAL RESEARCH DESIGNS

EXPERIMENTAL RESEARCH DESIGNS ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study

More information

Outline defining principles and give research examples.

Outline defining principles and give research examples. Outline defining principles and give research examples. Our thoughts, feelings, and behaviors are influenced by cognitive factors. Principle Research Examples Sample Conclusion Mental representations guide

More information

Research Methods and Analysis

Research Methods and Analysis Research Methods and Analysis Lecture 10 Analytic Experimental Studies Quasi Design Dr. Sayed Bahawaddin Hashemi, MD, MPH, ASCP Analytic Observational Experimental Cohort Cross-Sectional Case Control Randomize

More information

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie Research Methods for Business A Skill'Building Approach SEVENTH EDITION Uma Sekaran and Roger Bougie WILEY CONTENTS About the Authors Preface Acknowledgments xix xxi xxiii 1 Introduction to research 1

More information

Experimental Methods in Health Research A. Niroshan Siriwardena

Experimental Methods in Health Research A. Niroshan Siriwardena Experimental Methods in Health Research A. Niroshan Siriwardena Community and Health Research Group: Improvement science and methods 2012 Introduction What is an experiment? Components of an experiment

More information

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation.

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation. Measures of Dispersion Range Variance Standard deviation Range The numerical difference between the highest and lowest scores in a distribution It describes the overall spread between the highest and lowest

More information

Variables Research involves trying to determine the relationship between two or more variables.

Variables Research involves trying to determine the relationship between two or more variables. 1 2 Research Methodology Week 4 Characteristics of Observations 1. Most important know what is being observed. 2. Assign behaviors to categories. 3. Know how to Measure. 4. Degree of Observer inference.

More information

Name: Experimental Design

Name: Experimental Design Name: Experimental Design Period: 2001 Number 4 1. Students are designing an experiment to compare the productivity of two varieties of dwarf fruit trees. The site for the experiment is a field that is

More information

WWC Standards for Regression Discontinuity and Single Case Study Designs

WWC Standards for Regression Discontinuity and Single Case Study Designs WWC Standards for Regression Discontinuity and Single Case Study Designs March 2011 Presentation to the Society for Research on Educational Effectiveness John Deke Shannon Monahan Jill Constantine 1 What

More information

Research Designs. Inferential Statistics. Two Samples from Two Distinct Populations. Sampling Error (Figure 11.2) Sampling Error

Research Designs. Inferential Statistics. Two Samples from Two Distinct Populations. Sampling Error (Figure 11.2) Sampling Error Research Designs Inferential Statistics Note: Bring Green Folder of Readings Chapter Eleven What are Inferential Statistics? Refer to certain procedures that allow researchers to make inferences about

More information

Research Strategies. What We Will Cover in This Section. Research Purposes. Overview. Research techniques. Literature Reviews. Basic research.

Research Strategies. What We Will Cover in This Section. Research Purposes. Overview. Research techniques. Literature Reviews. Basic research. Research Strategies 9/2/2006 P767 Research Strategies.ppt 1 What We Will Cover in This Section Overview. Research techniques. Literature Reviews. 9/2/2006 P767 Research Strategies.ppt 2 Research Purposes

More information

Research Methodology. Characteristics of Observations. Variables 10/18/2016. Week Most important know what is being observed.

Research Methodology. Characteristics of Observations. Variables 10/18/2016. Week Most important know what is being observed. Research Methodology 1 Characteristics of Observations 1. Most important know what is being observed. 2. Assign behaviors to categories. 3. Know how to Measure. 4. Degree of Observer inference. 2 Variables

More information

Designing evaluations that work:

Designing evaluations that work: Designing evaluations that work: Deciding where you want to go and how to get there December 11, 2012 Housekeeping Notes This webinar will be recorded, and will be available on the Centre s website as

More information

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment Key Dates TU Mar 28 Unit 18 Loss of control drinking in alcoholics (on course website); Marlatt assignment TH Mar 30 Unit 19; Term Paper Step 2 TU Apr 4 Begin Biological Perspectives, Unit IIIA and 20;

More information

DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable

DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable EXPERIMENT Experimental Research A RESEARCH INVESTIGATION IN WHICH CONDITIONS ARE CONTROLLED ONE INDEPENDENT VARIABLE IS MANIPULATED (SOMETIMES MORE THAN ONE) ITS EFFECT ON A DEPENDENT VARIABLE IS MEASURED

More information

CHAPTER EIGHT EXPERIMENTAL RESEARCH: THE BASICS of BETWEEN GROUP DESIGNS

CHAPTER EIGHT EXPERIMENTAL RESEARCH: THE BASICS of BETWEEN GROUP DESIGNS CHAPTER EIGHT EXPERIMENTAL RESEARCH: THE BASICS of BETWEEN GROUP DESIGNS Chapter Objectives: Understand that the purpose of experiments and group quasi-experiments is to investigate differences between

More information