What We Will Cover in This Section

Similar documents
What We Will Cover in This Section

Experimental Design. What We Will Cover in This Section. Basic Requirements

Experimental Validity

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I

Educational Research. S.Shafiee. Expert PDF Trial

Rival Plausible Explanations

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs

Design of Experiments & Introduction to Research

11/2/2017. Often, we cannot manipulate a variable of interest

UNIT III: Research Design. In designing a needs assessment the first thing to consider is level for the assessment

PYSC 224 Introduction to Experimental Psychology

The following are questions that students had difficulty with on the first three exams.

10/23/2017. Often, we cannot manipulate a variable of interest

More on Experiments: Confounding and Obscuring Variables (Part 1) Dr. Stefanie Drew

Formative and Impact Evaluation. Formative Evaluation. Impact Evaluation

Threats to validity in intervention studies. Potential problems Issues to consider in planning

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013

Define the population Determine appropriate sample size Choose a sampling design Choose an appropriate research design

Experimental and Quasi-Experimental designs

TECH 646 Analysis of Research in Industry and Technology. Experiments

Chapter 10 Quasi-Experimental and Single-Case Designs

Quasi-Experimental and Single Case Experimental Designs. Experimental Designs vs. Quasi-Experimental Designs

investigate. educate. inform.

26:010:557 / 26:620:557 Social Science Research Methods

Overview of Experimentation

Levels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended?

Experimental Design (7)

Experimental Design and the struggle to control threats to validity

Experimental Design Part II

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Threats to Validity in Experiments. The John Henry Effect

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN

2013/4/28. Experimental Research

QUASI EXPERIMENTAL DESIGN

04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing

Lecture 4: Research Approaches

Previous Example. New. Tradition

HPS301 Exam Notes- Contents

Experiments. ESP178 Research Methods Dillon Fitch 1/26/16. Adapted from lecture by Professor Susan Handy

Research Approaches Quantitative Approach. Research Methods vs Research Design

From Description to Causation

OBSERVATION METHODS: EXPERIMENTS

Experimental Research I. Quiz/Review 7/6/2011

Research Design & Protocol Development

STATISTICAL CONCLUSION VALIDITY

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC

Skills Center Psychology Practice Exam II

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section

MBACATÓLICA JAN/APRIL Marketing Research. Fernando S. Machado. Experimentation

VALIDITY OF QUANTITATIVE RESEARCH

Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010

Measurement. Reliability vs. Validity. Reliability vs. Validity

Sample Exam Questions Psychology 3201 Exam 1

TECH 646 Analysis of Research in Industry and Technology. Experiments

Experimental and quasi-experimental designs:

Research Design. Beyond Randomized Control Trials. Jody Worley, Ph.D. College of Arts & Sciences Human Relations

CHAPTER 8 EXPERIMENTAL DESIGN

UNIT 7 EXPERIMENTAL RESEARCH-I1

One slide on research question Literature review: structured; holes you will fill in Your research design

PM12 Validity P R O F. D R. P A S Q U A L E R U G G I E R O D E P A R T M E N T O F B U S I N E S S A N D L A W

Psychology of Dysfunctional Behaviour RESEARCH METHODS

QUASI-EXPERIMENTAL HEALTH SERVICE EVALUATION COMPASS 1 APRIL 2016

How to craft the Approach section of an R grant application

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany

Methodology & Research

Correlational Research. The Correlation Coefficient. Correlational Research

M6728. Goals. Depression Scores. Research Designs

RESEARCH METHODS. Winfred, research methods, ; rv ; rv

Lecture 23: Observational Research. Outline. Review. Review Finish Applied Research Start Observational Research

Introduction Can we improve memory for nonsense pics w/ cue? Method Study: See 28 pics (w/ or w/o label) Test: Immediate recall (draw)

Chapter 13 Summary Experiments and Observational Studies

RESEARCH METHODS. Winfred, research methods,

CHAPTER LEARNING OUTCOMES

Scientific Research. The Scientific Method. Scientific Explanation

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc.

How to Do Experiments

Can Quasi Experiments Yield Causal Inferences? Sample. Intervention 2/20/2012. Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality

Testing the ABC floral-organ identity model: expression of A and C function genes

EXPERIMENTAL RESEARCH DESIGNS

Outline defining principles and give research examples.

Research Methods and Analysis

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie

Experimental Methods in Health Research A. Niroshan Siriwardena

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation.

Variables Research involves trying to determine the relationship between two or more variables.

Name: Experimental Design

WWC Standards for Regression Discontinuity and Single Case Study Designs

Research Designs. Inferential Statistics. Two Samples from Two Distinct Populations. Sampling Error (Figure 11.2) Sampling Error

Research Strategies. What We Will Cover in This Section. Research Purposes. Overview. Research techniques. Literature Reviews. Basic research.

Research Methodology. Characteristics of Observations. Variables 10/18/2016. Week Most important know what is being observed.

Designing evaluations that work:

Goal: To become familiar with the methods that researchers use to investigate aspects of causation and methods of treatment

DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable

CHAPTER EIGHT EXPERIMENTAL RESEARCH: THE BASICS of BETWEEN GROUP DESIGNS

Transcription:

Pre and Quasi-Experimental 1 What We Will Cover in This Section Pre-Experimental Quasi- Experimental. Summary 2 Internal Validity Revisited 3

Common Threats to Internal Validity 1. History. 2. Maturation. 3. Testing. 4. Instrument Decay. 5. Statistical Regression. 4 1. History ny event that occurs between the first and second dependent measures that is not manipulated by the experimenter. Delay 5 2. Testing Participation in the pre-test may cause changes in the person. - Reactivity - Memory Delay 6

3. Maturation Changes in the individual over time that are not associated with the independent variable. Placebo Delay Delay 7 4. Instrument Decay Changes in the measuring instrument over time. Observer gets bored. Test becomes obsolete. Machine wears out. 8 5. Statistical Regression Occurs when participants are placed into groups based on extreme scores. Extreme scores tend to move(regress) toward the mean. Delay 9

Pre-Experimental 10 One-Shot Case Study Group Independent (s) controlled by the experimenter Dependent ment(s) made after the treatments are applied. What is missing from this design? 11 Benefits and Issues Benefits. 1. OK for preliminary research. Issues. 1. History. 2. Maturation. 3. Regression. 12

One-group Independent Group 1 What is missing from this design? 13 Benefits and Issues Benefits. 1. OK for preliminary research. Issues. 1. History. 2. Maturation. 3. Regression. 4. Testing. 5. Instrument decay. 14 Quasi-Experimental 15

Definition that have all of the controls of a true experiment but do not duplicate the true experimental design. Weakness in one or more areas. Weakness leads to confounding. Gives more information than nothing at all. 16 Ex Post Facto pproach Independent Dependent Group 1 Group 2 Groups divided based on some pre-existing condition. ment(s) made after the assignment to groups 17 Benefits and Issues Benefits. 1. May be the only way to study some influences. 2. May be OK for preliminary research. Issues. 1. Ss not randomly assigned to treatment conditions. 2. If a person is unusual on one characteristic he may be unusual on others. 18

Non-Equivalent Control Group, Pretest: Independent SS 1 SS 2 SS 3 1 SS 4 SS 5 SS 6 2 19 When Used When participants cannot be assigned at random. When you have to use pre-existing groups. 20 Issue and nswer Issue. The groups may differ on the dependent variable at the beginning of the experiment. nswer. Compare groups on the pre-test to see if there are differences. 21

Other Issues and Fixes 1. Replicate the study. 2. ssign multiple groups to treatment conditions. 22 Time Series Similar to single subject design but with one group. Usually have Baseline measurement on dependent variable. Some manipulation or event. Second measurement on the dependent variable. 23 Interrupted Time Series Design Baseline () Event Post Test 24

Number of Fatalities 290 280 270 260 250 240 230 220 210 200 Connecticut Traffic Fatalities Speeding Crackdown 1951 1952 1953 1954 1955 1956 1957 1958 1959 Year 25 When Used ssess the impact of some naturally occurring event. ssess the impact of some broad treatment within an existing group. 26 Control Series Design Uses existing groups but attempts to match the treatment group with an equivalent control group. 27

Control Series Design Baseline Baseline Event Event Post Test Post Test 28 Issues Potential confounding from History Maturation Instrumentation changes. 29 Connecticut Traffic Fatalities 15 Fatality Rate 12 9 6 1951 1952 1953 1954 1955 1956 1957 1958 1959 Year Connecticut Control 30

Thought Problem Petal D. Stamen was interested in the influence that flowers would have on women s affection toward men. Petal sent a dozen roses to a random sample of women then asked them to fill out a well researched affection survey. 1. What kind of design is this? 2. Is this a good or bad design? Why? 3. How could this study be improved? 31 32