Conducting a Good Experiment I: Variables and Control

Similar documents
Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation.

04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

Topic #4 CONTROL. 1. What are the threats to the validity of a contemplated piece of research?

Topic #4 CONTROL. 1. What are the threats to the validity of a contemplated piece of research?

CHAPTER 8 EXPERIMENTAL DESIGN

Using The Scientific method in Psychology

FORM C Dr. Sanocki, PSY 3204 EXAM 1 NAME

Psychology Research Process

Designing Experiments... Or how many times and ways can I screw that up?!?

Chapter 9: Experiments

Scientific Research. The Scientific Method. Scientific Explanation

PYSC 224 Introduction to Experimental Psychology

Chapter 13 Summary Experiments and Observational Studies

Experiment Design 9/17/2015. Mini summary of Green & Bavelier

Chapter 11: Experiments and Observational Studies p 318

2-Group Multivariate Research & Analyses

Chapter 2. The Research Process: Coming to Terms Pearson Prentice Hall, Salkind. 1

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Villarreal Rm. 170 Handout (4.3)/(4.4) - 1 Designing Experiments I

The Research Process: Coming to Terms

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.

Psychology Research Process

VARIABLES AND MEASUREMENT

Chapter 2. The Data Analysis Process and Collecting Data Sensibly. Copyright 2005 Brooks/Cole, a division of Thomson Learning, Inc.

Chapter 1: Review of Basic Concepts

Research Methods in Psychology UNIT 3 PSYCHOLOGY 2013

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.

Chapter 8: Estimating with Confidence

Research Methods & Design Outline. Types of research design How to choose a research design Issues in research design

Educational Psychology

Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time.

Designing Psychology Experiments: Data Analysis and Presentation

Chapter 2 Methodology: How Social Psychologists Do Research

Research in the Social Sciences. Saturday, February 3, 18

Wissenschftlichen Arbeiten. Research methods (II) Zhuanghua Shi

Experimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design

Underlying Theory & Basic Issues

26:010:557 / 26:620:557 Social Science Research Methods

The essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV.

SINGLE-CASE RESEARCH. Relevant History. Relevant History 1/9/2018

RNA-seq. Design of experiments

PSYCHOLOGY Vol. II - Experimentation in Psychology-Rationale, Concepts and Issues - Siu L. Chow

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research

Experimental and Quasi-Experimental designs

Experimental and quasi-experimental designs:

Single-Factor, Dependent-Groups Designs

PSY 250. Experimental Design: The Basic Building Blocks. Simple between subjects design. The Two-Group Design 7/25/2015. Experimental design

Introduction to Statistics and Research Design. Arlo Clark-Foos

Chapter 8 Experimental Design

Chapter 1. Understanding Social Behavior

Chapter 13. Experiments and Observational Studies

Chapter 5: Research Language. Published Examples of Research Concepts

Design of Experiments & Introduction to Research

SOCI 323 Social Psychology

Causal Research Design- Experimentation

Lesson 3 Experimental Design and Control of Variables

Limitations of 2-cond Designs

Psy201 Module 3 Study and Assignment Guide. Using Excel to Calculate Descriptive and Inferential Statistics

PYSC 224 Introduction to Experimental Psychology

HPS301 Exam Notes- Contents

The Research Enterprise in Psychology Chapter 2

ANS: c Objective=2.2: Recognize new words and phrases that form the basis for much of the communication in research, Topic=The Language of Research

Vocabulary. Bias. Blinding. Block. Cluster sample

Introduction to Experiment Design

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two

EXPERIMENTAL METHODS IN PSYCHOLINGUISTIC RESEARCH SUMMER SEMESTER 2015

Research Landscape. Qualitative = Constructivist approach. Quantitative = Positivist/post-positivist approach Mixed methods = Pragmatist approach

Overview of Clinical Study Design Laura Lee Johnson, Ph.D. Statistician National Center for Complementary and Alternative Medicine US National

Objectives. Quantifying the quality of hypothesis tests. Type I and II errors. Power of a test. Cautions about significance tests

Student Lecture Guide YOLO Learning Solutions

Experimental Design (7)

Chapter 11. Experimental Design: One-Way Independent Samples Design

2 Critical thinking guidelines


RESEARCH METHODS. Winfred, research methods, ; rv ; rv

LEARNING. Learning. Type of Learning Experiences Related Factors

9 research designs likely for PSYC 2100

THE RESEARCH ENTERPRISE IN PSYCHOLOGY

In this chapter we discuss validity issues for quantitative research and for qualitative research.

CAUTIONS ABOUT THE PRACTICE EXAM

RESEARCH METHODS. Winfred, research methods,

Variable Data univariate data set bivariate data set multivariate data set categorical qualitative numerical quantitative

UNIT 1: Fundamentals of research design and variables

EXPERIMENTAL DESIGN Page 1 of 11. relationships between certain events in the environment and the occurrence of particular

EXPERIMENTAL RESEARCH DESIGNS

Lecture 21. RNA-seq: Advanced analysis

Chapter 1: Explaining Behavior

Educational Research. S.Shafiee. Expert PDF Trial

Lecture 4: Research Approaches

Collecting Data Example: Does aspirin prevent heart attacks?

Chapter 4: Defining and Measuring Variables

Empirical Research Methods for Human-Computer Interaction. I. Scott MacKenzie Steven J. Castellucci

Treatment Effects: Experimental Artifacts and Their Impact

Inferential Statistics

investigate. educate. inform.

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04

Transcription:

CHAPTER SIX Conducting a Good Experiment I: Variables and Control 1 The Nature of Variables! Variable! A variable is an event or behavior that can assume at least two values.! Bridgman (1927) suggested that researchers should define their variables in terms of the operations needed to produce them. " Such definitions allow others to replicate your research and are called operational definitions. 2 Independent Variables! Independent Variables (IV s)! IV s are those variables that the experimenter purposely manipulates.! The IV constitutes the reason the research is being conducted; the experimenter is interested in determining what effect the IV has. 3 1

Types of Independent Variables! Physiological IV! The physiological state of the participant that the experimenter manipulates.! Experience IV! Manipulation of the amount or type of training or learning.! Stimulus or environmental IV! An aspect of the environment that the experimenter manipulates. 4 Participant Characteristics! Participant characteristics are aspects of the participant, such as age, sex or personality traits, that are treated as if they are IVs.! But they are not IV s because they cannot be manipulated by the experimenter. 5 Extraneous Variables (Confounders)! Extraneous variables! Uncontrolled variables that can cause unintended changes between groups.! Confounding! A situation in which the results of an experiment can be attributed to either the operation of an IV or to an extraneous variable.! When a study is confounded, there is no way to determine which variable is responsible for any observed differences.! Researchers learn from mistakes and control the extraneous variable in the next experiment. 6 2

Extraneous Variables (Confounders) A. Difference between two groups with no confounder operating. B. Difference between two groups when a confounder is present and has moved the groups closer together. C. Difference between two groups when a confounder is present and has moved the groups farther apart. 7 Dependent Variables! Dependent Variable (DV)! A response or behavior that is measured; the data or results of an experiment.! It is desired that any changes in the DV are directly related to the manipulation of the IV.! The literature review provides valuable guidelines as to which behavior or response should be measured.! Once the DV has been selected, method of measuring or recording it must be determined. 8 Recording or Measuring the DV! Correctness! Only the correct responses are counted.! Rate or Frequency! Rate of responding determines how rapidly responses are made during a specified time period.! The number of responses or events that occur within a specified time period is the frequency.! Degree or Amount! Latency of Duration 9 3

Different Rates of Responding. Recording More than One DV! If you have the measurement capabilities, there is nothing to prohibit the recording of more than one DV.! If recording an additional DV makes a meaningful contribution to your understanding of the phenomenon under study, then you should give it serious consideration. 11 Characteristics of a Good DV! A DV is valid when it measures what the experimental hypothesis says it should measure.! A good DV must be directly related to the IV and must measure the effects of the IV manipulation as the experimental hypothesis predicts it will.! A good DV is also reliable. 12 4

Nuisance Variables! Nuisance Variables! Unwanted variables that can cause the variability of scores within the experimental groups to increase.! Nuisance variables only increase the spread of scores within a distribution; they do not cause a distribution to change its location. 13 Nuisance Variables A. Spread of scores within a group when a nuisance variable is not operating. B. Spread of scores when a nuisance variable is operating. A. A comparison of two groups when a nuisance variable is not operating. B. A comparison of the same two groups when a nuisance variable is operating. 14 Controlling Extraneous Variables! The experimenter must exercise control over both extraneous variables and nuisance variables so the results of the experiment are as meaningful (no extraneous variables present) and clear (minimal influence of nuisance variables) as possible. 15 5

Basic Control Techniques! Randomization! A control technique that ensures that each participant has an equal chance of being assigned to any group in an experiment! Elimination! A control technique whereby extraneous variables are completely removed from an experiment.! Constancy! A control technique by which an extraneous variable is reduced to a single value that is experienced by all participants.! Balancing! A control procedure that achieves group equality by distributing extraneous variables equally to all groups.! Counterbalancing! A procedure for controlling order effects by presenting different treatment sequences. 16 Counterbalancing! Within-Subject counterbalancing! Presentation of different treatment sequences to the same participant. 17 Counterbalancing! Within-Group counterbalancing! Presentation of different treatment sequences to different participants. " Three basic requirements: " Each treatment must be presented to each participant an equal number of times. " Each treatment must occur an equal number of times at each testing or practice session. " Each treatment must precede and follow each of the other treatments an equal number of times. 18 6

Table 6-3 Within-Group Counterbalancing for the Two-Cola Challenge When Six Participants Are Tested Counterbalancing! Complete counterbalancing! All possible treatment sequences are presented.! You can calculate the number of sequences by using the formula n! (n factorial).! Incomplete counterbalancing! Only a portion of all possible sequences are presented. 20 Table 6-6 An Incomplete Counterbalancing Approach 7

Counterbalancing! Sequence or Order Effects! Sequence or order effects are produced by the participant s being exposed to the sequential presentation of the treatments. " The sequence or order effect depends on where in the sequential presentation of treatments the participant s performance is evaluated, not which treatment is experienced.! Carryover Effects! The effects of one treatment persist or carry over and influence responses to the next treatment. 22 8