DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable

Size: px
Start display at page:

Download "DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable"

Transcription

1 EXPERIMENT Experimental Research A RESEARCH INVESTIGATION IN WHICH CONDITIONS ARE CONTROLLED ONE INDEPENDENT VARIABLE IS MANIPULATED (SOMETIMES MORE THAN ONE) ITS EFFECT ON A DEPENDENT VARIABLE IS MEASURED TO TEST A HYPOTHESIS Basic Issues of Experimental Design Manipulation of Independent Variables Manipulation of the Independent Variable Selection of Dependent Variable Assignment of Subjects (or other Test Units) Control Over Extraneous Variables Classificatory Vs. Continuous Variables Experimental and Control Groups Treatment Levels More Than One Independent Variable

2 DEPENDENT VARIABLE Experimental treatments are the alternative manipulations of the independent variable being investigated. Its value is expected to be dependent on the experimenter s manipulation Criterion or standard by which the results are judged Dependent Variable Selection - e.g., sales volume, awareness, recall TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Measurement

3 Two Types of Experimental Error Controlling Extraneous Variables Constant Error Random Errors Elimination of Extraneous Variables Constancy of Conditions Order of Presentation Blinding Random Assignment DEMAND CHARACTERISTICS Demand Characteristics EXPERIMENTAL PROCEDURES THAT INTENTIONALLY HINT TO SUBJECTS SOMETHING ABOUT THE EXPERIMENTER S HYPOTHESIS Guinea Pigs Hawthorne Effect

4 Field vs. Laboratory Experiment Laboratory Experiment Artificial-Low Realism Few Extraneous Variables High control Low Cost Short Duration Subjects Aware of Participation Field Experiment Natural-High Realism Many Extraneous Variables Low control High Cost Long Duration Subjects Unaware of Participation WHEN IS AN EXPERIMENT INTERNAL VALIDITY? Factors Influencing Internal Validity INTERNAL VALIDITY Confidence that the only cause of change in the dependent variable came because of a change in the independent variable. Did the manipulation do what it was supposed to do? History Maturation Testing Instrumentation Selection Mortality

5 Type of Extraneous Variable History - specific events in the Environment between the Before and After Measurement That Are beyond the Experimenter s Control Example A Major Employer Closes Its Plant in Test Market Area Other Factors Instrument - Changes in Instrument Result in Response Bias Example New Questions about Women are Interpreted Differently from Earlier Questions. Maturation - subjects Change during the Course of the Experiment Testing - The Before Measure Alerts or Sensitizes Subject to Nature of Experiment or Second Measure. Subjects Become Tired Questionnaire about the Traditional Role of Women Triggers Enhanced Awareness of Women in an Experiment. Selection - Sample Selection Error Because of Differential Selection Comparison Groups Mortality - Sample Attrition; some Subjects Withdraw from Experiment Control Group and Experimental Group Is Self-Selected Group Based on Preference for Soft Drinks Subjects in One Group of a Hair Dying Study Marry Rich Widows and move to Florida Increasing Internal Validity HOW CAN INTERNAL VALIDITY BE INCREASE? Control Group Random Assignment Pretesting and Posttesting Posttest Only

6 Quasi-Experimental Designs WHAT ARE THE DIFFERENT BASIC EXPERIMENTAL DESIGNS? One Shot Design (After Only) One Group Pretest-Posttest Static Group Design ONE SHOT DESIGN (AFTER ONLY) X O 1 One Group Pretest -Posttest O 1 X O 2

7 Three Good Experimental Designs Static Group Design Experimental Group X O 1 Control Group O 2 Pretest - Posttest Control Group Design Posttest Only Control Group Solomon Four Group Design Pretest -Posttest Control Group Design Experimental Group R O 1 X O 2 Control Group R O 3 X O 4 Posttest Only Control Group Experimental Group R X O 1 Control Group R O 2

8 TEST MARKETING Solomon Four Group Design Experimental Group 1: R O 1 X O 2 Control Group 1: R O 3 O 4 Experimental Group 2: R X O 5 Control Group 2: R X O 6 EXPERIMENTAL PROCEDURE OPPORTUNITY TO TEST A NEW PRODUCT NEW MARKETING PLAN UNDER REALISTIC MARKET CONDITIONS MEASURE SALES OR PROFIT POTENTIAL. SELECTING A TEST MARKET CONTROL METHOD OF TEST MARKETING POPULATION SIZE DEMOGRAPHIC COMPOSITION LIFESTYLE CONSIDERATIONS COMPETITIVE SITUATION MEDIA SELF -CONTAINED TRADING AREA SECRECY SMALL CITY LOW CHANCE OF BEING DETECTED DISTRIBUTION IS FORCED (GUARANTEED)

9 ADVANCED EXPERIMENTAL DESIGNS ARE MORE COMPLEX COMPLETELY RANDOMIZED RANDOMIZED BLOCK DESIGN LATIN SQUARE FACTORIAL

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D. Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).

More information

Educational Research. S.Shafiee. Expert PDF Trial

Educational Research. S.Shafiee. Expert PDF Trial Educational Research: Experimental Studies Educational Research S.Shafiee Research... The systematic application of a family of methods employed to provide trustworthy information about problems an ongoing

More information

MBACATÓLICA JAN/APRIL Marketing Research. Fernando S. Machado. Experimentation

MBACATÓLICA JAN/APRIL Marketing Research. Fernando S. Machado. Experimentation MBACATÓLICA JAN/APRIL 2006 Marketing Research Fernando S. Machado Week 5 Experimentation 1 Experimentation Experimental Research and Causality Experimental Designs Lab versus Field Experiments Test Marketing

More information

MN 400: Research Methods. PART II The Design of Research

MN 400: Research Methods. PART II The Design of Research MN 400: Research Methods PART II The Design of Research 1 MN 400: Research Methods CHAPTER 6 Research Design 2 What is Research Design? A plan for selecting the sources and types of information used to

More information

Experimental Design and the struggle to control threats to validity

Experimental Design and the struggle to control threats to validity EXPERIMENTAL DESIGN Experimental Design and the struggle to control threats to validity INCREASINGLY CONSTRAINED LOW NATURALISTIC CASE-STUDY CORRELATIONAL DIFFERENTIAL EXPERIMENTAL HIGH Experimental design

More information

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGN To strongly identify cause-and-effect relationships Experimental Design EXPERIMENTAL AND EX POST FACTO DESIGN

More information

Experimental Research I. Quiz/Review 7/6/2011

Experimental Research I. Quiz/Review 7/6/2011 Experimental Research I Day 3 Quiz/Review Quiz Review Normal Curve z scores & T scores More on the normal curve and variability... Theoretical perfect curve. Never happens in actual research Mean, median,

More information

Chapter 7. Marketing Experimental Research. Business Research Methods Verónica Rosendo Ríos Enrique Pérez del Campo Marketing Research

Chapter 7. Marketing Experimental Research. Business Research Methods Verónica Rosendo Ríos Enrique Pérez del Campo Marketing Research Chapter 7 Marketing Experimental Research Business Research Methods Verónica Rosendo Ríos Enrique Pérez del Campo CHAPTER 7. MARKETING EXPERIMENTAL RESEARCH No great marketing decisions have ever been

More information

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Single point in time Cross-Sectional Research Multiple points in time Study only exists in this point in time Longitudinal Research Study

More information

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation.

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation. Measures of Dispersion Range Variance Standard deviation Range The numerical difference between the highest and lowest scores in a distribution It describes the overall spread between the highest and lowest

More information

CHAPTER 8 EXPERIMENTAL DESIGN

CHAPTER 8 EXPERIMENTAL DESIGN CHAPTER 8 1 EXPERIMENTAL DESIGN LEARNING OBJECTIVES 2 Define confounding variable, and describe how confounding variables are related to internal validity Describe the posttest-only design and the pretestposttest

More information

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera Homework assignment topics 37-42 Georgina Salas Topics 37-42 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 37 1. What is the purpose of an experiment? The purpose of an experiment is to explore

More information

Experimental and Quasi-Experimental designs

Experimental and Quasi-Experimental designs External Validity Internal Validity NSG 687 Experimental and Quasi-Experimental designs True experimental designs are characterized by three "criteria for causality." These are: 1) The cause (independent

More information

RESEARCH METHODS. Winfred, research methods, ; rv ; rv

RESEARCH METHODS. Winfred, research methods, ; rv ; rv RESEARCH METHODS 1 Research Methods means of discovering truth 2 Research Methods means of discovering truth what is truth? 3 Research Methods means of discovering truth what is truth? Riveda Sandhyavandanam

More information

RESEARCH METHODS. Winfred, research methods,

RESEARCH METHODS. Winfred, research methods, RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,

More information

EXPERIMENTAL RESEARCH DESIGNS

EXPERIMENTAL RESEARCH DESIGNS ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study

More information

Define the population Determine appropriate sample size Choose a sampling design Choose an appropriate research design

Define the population Determine appropriate sample size Choose a sampling design Choose an appropriate research design Numbers! Observation Study: observing individuals and measuring variables of interest without attempting to influence the responses Correlational Research: examining the relationship between two variables

More information

26:010:557 / 26:620:557 Social Science Research Methods

26:010:557 / 26:620:557 Social Science Research Methods 26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview

More information

The essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV.

The essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV. EXPERIMENTAL DESIGNS I: Between-Groups Designs There are many experimental designs. We begin this week with the most basic, where there is a single IV and where participants are divided into two or more

More information

Overview of the Logic and Language of Psychology Research

Overview of the Logic and Language of Psychology Research CHAPTER W1 Overview of the Logic and Language of Psychology Research Chapter Outline The Traditionally Ideal Research Approach Equivalence of Participants in Experimental and Control Groups Equivalence

More information

Formative and Impact Evaluation. Formative Evaluation. Impact Evaluation

Formative and Impact Evaluation. Formative Evaluation. Impact Evaluation Formative and Impact Evaluation Formative Evaluation 2 An evaluation designed to produce qualitative and quantitative data and insight during the early developmental phase of an intervention, including

More information

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters. Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we talk about what experiments are, we

More information

OBSERVATION METHODS: EXPERIMENTS

OBSERVATION METHODS: EXPERIMENTS OBSERVATION METHODS: EXPERIMENTS Sociological Research Methods Experiments Independent variable is manipulated, and the dependent variable respond to the manipulation. e.g. Eating a chocolate bar prior

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality Lecture 3 Empirical Research Methods IN4304 design (fixed design) Previous lecture A research plan Consider: purpose, theory, research question, mode inquiry, sampling method Research question Descriptive/

More information

Causal Research Design- Experimentation

Causal Research Design- Experimentation In a social science (such as marketing) it is very important to understand that effects (e.g., consumers responding favorably to a new buzz marketing campaign) are caused by multiple variables. The relationships

More information

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN RESEARCH METHODS A Process of Inquiry ANTHONY M. GRAZIANO MICHAEL L RAULIN STA TE UNIVERSITY OF NEW YORK A T BUFFALO tm HarperCollinsPublishers CONTENTS Instructor's Preface xv Student's Preface xix 1

More information

1. What is the difference between positive and negative correlations?

1. What is the difference between positive and negative correlations? 1. What is the difference between positive and negative correlations? 2. Can correlations make predictions? 3. Can correlations prove causation? 4. What are illusory correlations? We can take data from

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

FCE 3900 EDUCATIONAL RESEARCH E X P E R I M E N T A L A N D Q U A S I E X P E R I M E N T A L R E S E A R C H

FCE 3900 EDUCATIONAL RESEARCH E X P E R I M E N T A L A N D Q U A S I E X P E R I M E N T A L R E S E A R C H FCE 3900 EDUCATIONAL RESEARCH E X P E R I M E N T A L A N D Q U A S I E X P E R I M E N T A L R E S E A R C H 1 Research Design: Causal Research Causality may be thought of as understanding a phenomenon

More information

Topic #2. A key criterion in evaluating any test, measure, or piece of research is validity.

Topic #2. A key criterion in evaluating any test, measure, or piece of research is validity. ARTHUR SYC 302 (EXERIMENTAL SYCHOLOGY) 18C LECTURE NOTES [08/23/18] RESEARCH VALIDITY AGE 1 Topic #2 RESEARCH VALIDITY A key criterion in evaluating any test, measure, or piece of research is validity.

More information

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups. ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 17A LECTURE NOTES [03/08/17] QUASI-EXPERIMENTAL DESIGNS PAGE 1 Topic #6 QUASI-EXPERIMENTAL DESIGNS Again, central issue is one of research validity. Quasi-experimental

More information

UNIT 7 EXPERIMENTAL RESEARCH-I1

UNIT 7 EXPERIMENTAL RESEARCH-I1 UNIT 7 EXPERIMENTAL RESEARCH-I1 Structure 7.1 Introduction 7.2 Objectives 7.3 Types of Experimental Design 7.4 Pre-experimental Designs 7.4.1 One Shot Case Study Design 7.4.2 One Group Pre-test Post-test

More information

AP Psychology -- Chapter 02 Review Research Methods in Psychology

AP Psychology -- Chapter 02 Review Research Methods in Psychology AP Psychology -- Chapter 02 Review Research Methods in Psychology 1. In the opening vignette, to what was Alicia's condition linked? The death of her parents and only brother 2. What did Pennebaker s study

More information

M6728. Goals. Depression Scores. Research Designs

M6728. Goals. Depression Scores. Research Designs M6728 Research Designs Goals Match appropriate research designs to the study purpose and questions Differentiate between experimental and non-experimental studies Discuss epidemiologic designs Evaluate

More information

HPS301 Exam Notes- Contents

HPS301 Exam Notes- Contents HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats

More information

MILLENNIALS AND ORANGE JUICE CONSUMPTION

MILLENNIALS AND ORANGE JUICE CONSUMPTION MILLENNIALS AND ORANGE JUICE CONSUMPTION Yan Heng, PhD and Lisa House, PhD Presented to the International Citrus Beverage Conference Florida Agricultural Market Research Center Food and Resource Economics

More information

Lecture 4: Research Approaches

Lecture 4: Research Approaches Lecture 4: Research Approaches Lecture Objectives Theories in research Research design approaches ú Experimental vs. non-experimental ú Cross-sectional and longitudinal ú Descriptive approaches How to

More information

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Research Approach & Design Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Content: Introduction Definition of research design Process of designing & conducting

More information

CHAPTER LEARNING OUTCOMES

CHAPTER LEARNING OUTCOMES EXPERIIMENTAL METHODOLOGY CHAPTER LEARNING OUTCOMES When you have completed reading this article you will be able to: Define what is an experiment Explain the role of theory in educational research Justify

More information

PYSC 224 Introduction to Experimental Psychology

PYSC 224 Introduction to Experimental Psychology PYSC 224 Introduction to Experimental Psychology Session 6 Quasi Experiments and Faulty Experimental Designs Part 1 & 2 Lecturer: Dr. Margaret Amankwah-Poku, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh

More information

Chapter Three Research Methodology

Chapter Three Research Methodology Chapter Three Research Methodology Research Methods is a systematic and principled way of obtaining evidence (data, information) for solving health care problems. 1 Dr. Mohammed ALnaif METHODS AND KNOWLEDGE

More information

The Basics of Experimental Design [A Quick and Non-Technical Guide]

The Basics of Experimental Design [A Quick and Non-Technical Guide] The Basics of Experimental Design [A Quick and Non-Technical Guide] Sid Sytsma Website Administrator's Note: I have always considered Sid Sytsma's short article on experimental design one of the best short

More information

The Practice of Statistics 1 Week 2: Relationships and Data Collection

The Practice of Statistics 1 Week 2: Relationships and Data Collection The Practice of Statistics 1 Week 2: Relationships and Data Collection Video 12: Data Collection - Experiments Experiments are the gold standard since they allow us to make causal conclusions. example,

More information

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie Research Methods for Business A Skill'Building Approach SEVENTH EDITION Uma Sekaran and Roger Bougie WILEY CONTENTS About the Authors Preface Acknowledgments xix xxi xxiii 1 Introduction to research 1

More information

UNIT III: Research Design. In designing a needs assessment the first thing to consider is level for the assessment

UNIT III: Research Design. In designing a needs assessment the first thing to consider is level for the assessment UNIT III: Research Design SWK 330 Kimberly Baker-Abrams What is a needs assessment? Why is it helpful? an assessment to determine the existence of services, client population, client access to services,

More information

Research Landscape. Qualitative = Constructivist approach. Quantitative = Positivist/post-positivist approach Mixed methods = Pragmatist approach

Research Landscape. Qualitative = Constructivist approach. Quantitative = Positivist/post-positivist approach Mixed methods = Pragmatist approach Empirical Methods Research Landscape Qualitative = Constructivist approach Build theory from data Quantitative = Positivist/post-positivist approach Mixed methods = Pragmatist approach Experimental Analysis

More information

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04 Validity and Quantitative Research RCS 6740 6/16/04 What is Validity? Valid Definition (Dictionary.com): Well grounded; just: a valid objection. Producing the desired results; efficacious: valid methods.

More information

Research Approaches Quantitative Approach. Research Methods vs Research Design

Research Approaches Quantitative Approach. Research Methods vs Research Design Research Approaches Quantitative Approach DCE3002 Research Methodology Research Methods vs Research Design Both research methods as well as research design are crucial for successful completion of any

More information

STATISTICAL CONCLUSION VALIDITY

STATISTICAL CONCLUSION VALIDITY Validity 1 The attached checklist can help when one is evaluating the threats to validity of a study. VALIDITY CHECKLIST Recall that these types are only illustrative. There are many more. INTERNAL VALIDITY

More information

Causality and Experiments

Causality and Experiments Causality and http://philosophy.ucsd.edu/faculty/wuthrich/ 12 Scientific Reasoning Acknowledgements: Bill Bechtel The basic idea of an experiment If the independent variable is the cause of the dependent

More information

Introduction to Experiments

Introduction to Experiments Experimental Methods in the Social Sciences Introduction to Experiments August 5, 2013 Experiments Increasingly Important in the Social Sciences Field experiments in political science as early as 1920s

More information

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs Nonexperimental vs. Quasi- Experimental Strategies PSY 250 Quasi and Non-experimental designs Chapter 10 Resemble experiments but contain some threat such as a confounding variable that can not be completely

More information

CHAPTER. Experimental Research

CHAPTER. Experimental Research OVERVIEW CHAPTER 6 Experimental Research That [continuity and progress] have been tied to careful experimental and theoretical work indicates that there is validity in a method which at times feels unproductive

More information

Just what research design am I using? Shona J. Kelly Professor of Interdisciplinary Research

Just what research design am I using? Shona J. Kelly Professor of Interdisciplinary Research Just what research design am I using? Shona J. Kelly Professor of Interdisciplinary Research 1 Presentation Plan O an introduction to the basics of research study design O a brief overview of the most

More information

CogSysIII Lecture 4/5: Empirical Evaluation of Software-Systems

CogSysIII Lecture 4/5: Empirical Evaluation of Software-Systems CogSysIII Lecture 4/5: Empirical Evaluation of Software-Systems Human Computer Interaction Ute Schmid Applied Computer Science, Bamberg University last change October 30, 2007 CogSysIII Lecture 4/5: Empirical

More information

Research Methods & Design Outline. Types of research design How to choose a research design Issues in research design

Research Methods & Design Outline. Types of research design How to choose a research design Issues in research design Research Methods & Design Outline Types of research design How to choose a research design Issues in research design Types of Research Design Correlational Field (survey) Experimental Qualitative Meta-analysis

More information

Threats to validity in intervention studies. Potential problems Issues to consider in planning

Threats to validity in intervention studies. Potential problems Issues to consider in planning Threats to validity in intervention studies Potential problems Issues to consider in planning An important distinction Credited to Campbell & Stanley (1963) Threats to Internal validity Threats to External

More information

QUASI EXPERIMENTAL DESIGN

QUASI EXPERIMENTAL DESIGN UNIT 3 QUASI EXPERIMENTAL DESIGN Factorial Design Structure 3. Introduction 3.1 Objectives 3.2 Meaning of Quasi Experimental Design 3.3 Difference Between Quasi Experimental Design and True Experimental

More information

AP Statistics Unit 4.2 Day 3 Notes: Experimental Design. Expt1:

AP Statistics Unit 4.2 Day 3 Notes: Experimental Design. Expt1: AP Statistics Unit 4.2 Day 3 Notes: Experimental Design OBSERVATION -observe outcomes without imposing any treatment EXPERIMENT -actively impose some treatment in order to observe the response I ve developed

More information

UNIT 4 DESCRIPTIVE, EXPERIMENTAL AND ACTION RESEARCH

UNIT 4 DESCRIPTIVE, EXPERIMENTAL AND ACTION RESEARCH UNIT 4 DESCRIPTIVE, EXPERIMENTAL AND ACTION RESEARCH Structure 4.0 Introduction 4.1 Objectives 4.2 Descriptive Research 4.2.1 Descriptive Research: Main Steps 4.2.2 Types of Descriptive Research 4.3 Experimental

More information

The following are questions that students had difficulty with on the first three exams.

The following are questions that students had difficulty with on the first three exams. The following are questions that students had difficulty with on the first three exams. Exam 1 1. A measure has construct validity if it: a) really measures what it is supposed to measure b) appears, on

More information

Threats to Validity in Experiments. The John Henry Effect

Threats to Validity in Experiments. The John Henry Effect Threats to Validity in Experiments Office Hours: M 11:30-12:30, W 10:30-12:30 SSB 447 The John Henry Effect Housekeeping Homework 3, due Tuesday A great paper, but far from an experiment Midterm review

More information

The Effective Public Health Practice Project Tool

The Effective Public Health Practice Project Tool The Effective Public Health Practice Project Tool International Workshop on Evidence-Based Public Health: Concepts and Methods Munich, 17th and 18th November 2010 Dr. Eva Rehfuess Institute for Medical

More information

Selecting a Study Design

Selecting a Study Design CHAPTER 8 Selecting a Study Design In this chapter you will learn about: The differences between quantitative and qualitative study designs Common study designs in quantitative research and when to use

More information

Lecture 4: Chapter 3, Section 4 Designing Studies (Focus on Experiments)

Lecture 4: Chapter 3, Section 4 Designing Studies (Focus on Experiments) ecture 4: Chapter 3, Section 4 Designing Studies (Focus on Experiments) Definitions Randomization Control Blind Experiment Pitfalls Specific Experimental Designs Cengage earning Elementary Statistics:

More information

Variables Research involves trying to determine the relationship between two or more variables.

Variables Research involves trying to determine the relationship between two or more variables. 1 2 Research Methodology Week 4 Characteristics of Observations 1. Most important know what is being observed. 2. Assign behaviors to categories. 3. Know how to Measure. 4. Degree of Observer inference.

More information

10/23/2017. Often, we cannot manipulate a variable of interest

10/23/2017. Often, we cannot manipulate a variable of interest Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the

More information

Some Potential Confounds: All Experimental & Quasi-Experimental Designs (QEDs) 1. Experimenter Bias (i.e., E expectancy effects)

Some Potential Confounds: All Experimental & Quasi-Experimental Designs (QEDs) 1. Experimenter Bias (i.e., E expectancy effects) Some Potential Confounds: All Experimental & Quasi-Experimental Designs (QEDs) 1. Experimenter Bias (i.e., E expectancy effects) 2. Demand Characteristics 3. Hawthorne Effect 4. Uncontrolled Extraneous

More information

Experimental Design Part II

Experimental Design Part II Experimental Design Part II Keith Smolkowski April 30, 2008 Where Are We Now? esearch eview esearch Design: The Plan Internal Validity Statements of Causality External Validity Statements of Generalizability

More information

Research Methodology. Characteristics of Observations. Variables 10/18/2016. Week Most important know what is being observed.

Research Methodology. Characteristics of Observations. Variables 10/18/2016. Week Most important know what is being observed. Research Methodology 1 Characteristics of Observations 1. Most important know what is being observed. 2. Assign behaviors to categories. 3. Know how to Measure. 4. Degree of Observer inference. 2 Variables

More information

Wissenschftlichen Arbeiten. Research methods (II) Zhuanghua Shi

Wissenschftlichen Arbeiten. Research methods (II) Zhuanghua Shi Wissenschftlichen Arbeiten Research methods (II) Zhuanghua Shi!1 Last week Descriptive method case studies, survey, developmental study, follow-up study, documentary analysis, correlation analysis Experimental

More information

Design of Experiments & Introduction to Research

Design of Experiments & Introduction to Research Design of Experiments & Introduction to Research 1 Design of Experiments Introduction to Research Definition and Purpose Scientific Method Research Project Paradigm Structure of a Research Project Types

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

Empirical Knowledge: based on observations. Answer questions why, whom, how, and when.

Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. INTRO TO RESEARCH METHODS: Empirical Knowledge: based on observations. Answer questions why, whom, how, and when. Experimental research: treatments are given for the purpose of research. Experimental group

More information

Higher Psychology RESEARCH REVISION

Higher Psychology RESEARCH REVISION Higher Psychology RESEARCH REVISION 1 The biggest change from the old Higher course (up to 2014) is the possibility of an analysis and evaluation question (8-10) marks asking you to comment on aspects

More information

2013/4/28. Experimental Research

2013/4/28. Experimental Research 2013/4/28 Experimental Research Definitions According to Stone (Research methods in organizational behavior, 1978, pp 118), a laboratory experiment is a research method characterized by the following:

More information

Causation and experiments. Phil 12: Logic and Decision Making Spring 2011 UC San Diego 5/24/2011

Causation and experiments. Phil 12: Logic and Decision Making Spring 2011 UC San Diego 5/24/2011 Causation and experiments Phil 12: Logic and Decision Making Spring 2011 UC San Diego 5/24/2011 Review Diagramming causal relations Variables as nodes (boxes) Causal relations as arrows Not tracing the

More information

VALIDITY OF QUANTITATIVE RESEARCH

VALIDITY OF QUANTITATIVE RESEARCH Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees

More information

Psychological Science Handout 2 Research Designs Page 2.1 HANDOUT 2 RESEARCH DESIGNS

Psychological Science Handout 2 Research Designs Page 2.1 HANDOUT 2 RESEARCH DESIGNS Psychological Science Handout 2 Research Designs Page 2.1 HANDOUT 2 RESEARCH DESIGNS The Whole Picture Principle: Research scientists are so caught up in their own narrow endeavors that they have difficulty

More information

Sample Exam Questions Psychology 3201 Exam 1

Sample Exam Questions Psychology 3201 Exam 1 Scientific Method Scientific Researcher Scientific Practitioner Authority External Explanations (Metaphysical Systems) Unreliable Senses Determinism Lawfulness Discoverability Empiricism Control Objectivity

More information

In this chapter we discuss validity issues for quantitative research and for qualitative research.

In this chapter we discuss validity issues for quantitative research and for qualitative research. Chapter 8 Validity of Research Results (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we discuss validity issues for

More information

UNIT 1: Fundamentals of research design and variables

UNIT 1: Fundamentals of research design and variables UNIT 1: Fundamentals of research design and s Reading Assignment: Aron Reading on website: Logic & Language of Psychology Research 1. What are the goals of science and how do the types of statistics relate

More information

Chapter 8 Experimental Design

Chapter 8 Experimental Design Chapter 8 Experimental Design Causality Review Remember from Chapter 4 that in order to make a causal inference, you need to satisfy three requirements: 1. Covariation 2. Temporal order 3. Eliminate alternative

More information

Lecture 2B: Chapter 3, Section 4 Designing Studies (Focus on Experiments)

Lecture 2B: Chapter 3, Section 4 Designing Studies (Focus on Experiments) ooking Back: Review ecture 2B: Chapter 3, Section 4 Designing Studies (Focus on Experiments)! Definitions! Randomization! Control! Blind Experiment! Pitfalls! 2 Types of Study Design " Observational study:

More information

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 381 Exam #2 E Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) An approach to qualitative research that focuses on building theories is known

More information

Threats to Validity in Evaluating CME Activities

Threats to Validity in Evaluating CME Activities Threats to Validity in Evaluating CME Activities Jason King Baylor College of Medicine Citation: King, J. E. (2008, January). Threats to Validity in Evaluating CME Activities. Presented at the annual meeting

More information

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8 Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to

More information

PTHP 7101 Research 1 Chapter Assignments

PTHP 7101 Research 1 Chapter Assignments PTHP 7101 Research 1 Chapter Assignments INSTRUCTIONS: Go over the questions/pointers pertaining to the chapters and turn in a hard copy of your answers at the beginning of class (on the day that it is

More information

Biostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras

Biostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras Biostatistics and Design of Experiments Prof Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras Lecture 02 Experimental Design Strategy Welcome back to the course on Biostatistics

More information

Identify a problem. Determine an area of interest. Review the literature. Identify new ideas in your area of interest. Develop a research hypothesis.

Identify a problem. Determine an area of interest. Review the literature. Identify new ideas in your area of interest. Develop a research hypothesis. Generate more new ideas Results support your hypothesis refine or expand on your ideas. Results do not support your hypothesis reformulate a new idea or start over. Communicate the results Method of communication:

More information

11/2/2017. Often, we cannot manipulate a variable of interest

11/2/2017. Often, we cannot manipulate a variable of interest Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the

More information

Research Designs. Inferential Statistics. Two Samples from Two Distinct Populations. Sampling Error (Figure 11.2) Sampling Error

Research Designs. Inferential Statistics. Two Samples from Two Distinct Populations. Sampling Error (Figure 11.2) Sampling Error Research Designs Inferential Statistics Note: Bring Green Folder of Readings Chapter Eleven What are Inferential Statistics? Refer to certain procedures that allow researchers to make inferences about

More information

Designing Experiments... Or how many times and ways can I screw that up?!?

Designing Experiments... Or how many times and ways can I screw that up?!? www.geo.uzh.ch/microsite/icacogvis/ Designing Experiments... Or how many times and ways can I screw that up?!? Amy L. Griffin AutoCarto 2012, Columbus, OH Outline When do I need to run an experiment and

More information

CAUTIONS ABOUT THE PRACTICE EXAM

CAUTIONS ABOUT THE PRACTICE EXAM Dr. Michael Passer Psych 209, U. of Washington CAUTIONS ABOUT THE PRACTICE EXAM DEAR STUDENT: This practice tests consists of questions from past exams. By taking this practice test, you should gain an

More information

investigate. educate. inform.

investigate. educate. inform. investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced

More information

9.0 L '- ---'- ---'- --' X

9.0 L '- ---'- ---'- --' X 352 C hap te r Ten 11.0 10.5 Y 10.0 9.5 9.0 L...- ----'- ---'- ---'- --' 0.0 0.5 1.0 X 1.5 2.0 FIGURE 10.23 Interpreting r = 0 for curvilinear data. Establishing causation requires solid scientific understanding.

More information

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two lab exam when: Nov 27 - Dec 1 length = 1 hour each lab section divided in two register for the exam in your section so there is a computer reserved for you If you write in the 1st hour, you can t leave

More information

Behavioral Intervention Rating Rubric. Group Design

Behavioral Intervention Rating Rubric. Group Design Behavioral Intervention Rating Rubric Group Design Participants Do the students in the study exhibit intensive social, emotional, or behavioral challenges? Evidence is convincing that all participants

More information

Research in the Social Sciences. Saturday, February 3, 18

Research in the Social Sciences. Saturday, February 3, 18 Research in the Social Sciences All sciences (including social sciences) rely on empirical evidence (information we can verify with our senses Write this Down Common Sense vs. Evidence Poor people are

More information