Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010

Size: px
Start display at page:

Download "Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010"

Transcription

1 Causation & Experiments (cont.) Phil 12: Logic and Decision Making Winter 2010 UC San Diego 3/1/2010

2 CAPE Student evaluations now done online Please check your UCSD for link to evaluations for your courses Deadline: midnight before first day of finals

3 Review Experiments manipulate the independent variable and measure changes in the dependent variable - IVs sometimes called factors, values of each IV called levels Major concern is confounding variables: variables correlated with the independent variable that may be causes of the dependent variable - Subject confounds: differences between subjects - Procedural confounds: differences in way experimental and non-experimental groups are treated

4 Review Strategies for removing risk of confounds: - Randomization: attempt to neutralize effects of confounds, known and unknown - Locking: fixing a value of a variable - Matching: render experimental conditions equivalent in terms of possible known confounds - Measuring: treat as additional independent variable and then measure for correlations

5 Procedural variable confounds When you conduct a manipulation, generally more than one thing will be changed - These variables will then be correlated with the independent variable extraneous - If one of the other variables is causally related to the effect of interest, it rather than the variable you are considering may be the cause confound

6 Confounding Procedural Variables The president of the AGL corporation wanted to get his workers to be more productive - She found that when each employee was presented with a jar of jellybeans, productivity increased Was it the jellybeans that caused the increased productivity? Or was it: Novelty of the situation Attention from the president Desire to reciprocate

7 Controlling confounding procedural variables Manipulation Correlation or causation X Procedural variable X Independent variable [values]? Dependent variable [values] Strategy: break the correlation thereby breaking the effect of the confounding variable

8 Subject variable confounds Subjects in an experiment may be differently affected by different values of other variables - People of different ages sleep different amounts - Women might be affected differently than men These variables are extraneous If there is a correlation between these variables and the independent variable: - they, rather than the variable you are focusing on, may be what produce the change in the dependent variable Such variables are confounds

9 Controlling confounding subject variables Manipulation Independent variable [values] X Correlation or causation Dependent variable [values] Strategy: break the correlation thereby breaking the effect of the confounding variable Random assignment of subjects is a main strategy for breaking the correlation? X Subject variable

10 Controlling subject confounds: Between subjects randomization

11 Manipulate independent variable Task Key Behavior IV Task Key Behavior Statistically Significant DV Difference?

12 Controlling subject confounds: Within subjects design

13 Subjects serving as own control Task Task Key Behavior Key Behavior Statistically Significant DV Difference?

14 Between-subject design GOOD NEWS: - Participants are not contaminated in one condition as a result of having participated in the other BAD NEWS: - Requires a larger number of participants - Runs the risk of non-equivalence of subject groups

15 Within-subjects designs GOOD NEWS: - - Requires a smaller number of participants Rules out any differences between subjects BAD NEWS: - Potential contamination of participants behavior from previous trial: carryover effect Subjects might learn from one condition and that could alter their behavior in the second condition - Practice effect - Fatigue effect

16 Pretest Posttest Design There is always a danger in an experiment that the members of the two (or more) groups being studied already differ on the dependent variable Best control is to focus on change, not raw value of the dependent variable - Pretest: measure the dependent variable before the intervention - Posttest: measure the dependent variable after the intervention - Change = Posttest Pretest Manipulation Independent variable [values]? Dependent variable [change] [values]

17 Limitations of pretest-posttest design Just measuring change in one group using a pretest and a posttest allows for confounds Time has elapsed and subjects have gotten older (maturation) Events occurring between the pretest and posttest could affect the dependent variable (history) Experience with previous test may change performance Pretest and posttest may vary in difficulty Use of pretest-posttest does not obviate the need for a control group

18 Example: Exercise and sleep Is there a causal relation between exercise and sleep? Manipulation (instruct subjects to exercise little or much) Exercise [little, much] X Correlation or causation? X Job stress Sleep [<8 hours, >8 hours]

19 Example: alcohol and running speed Alcohol [no, yes]? 100 yard dash speed [seconds]

20 Between subjects or within subjects Between-subjects design - Different subjects would be used for the no-alcohol and alcohol conditions, and each would be tested only once Within-subjects design - Each subject would be tested under both the no-alcohol condition and the alcohol condition

21 Between subjects Jim Angela Megan Peter Roger Shane Sara Jessica

22 Within subjects Jim Angela Megan Peter Jim Angela Megan Peter

23 Counterbalance Alcohol condition rest No-alcohol condition Jim Angela Jim Angela No-alcohol condition rest Alcohol condition Megan Peter Megan Peter

24 Clicker question 1 A researcher thinks posting status messages on Facebook causes narcissism. She finds a sample of 50 college students who have never used Facebook, and gives them the Narcissism Personality Inventory, a self-administered multiple-choice test of how narcissistic a person is, on a scale of The students are instructed to open Facebook accounts and post at least once daily for 8 weeks. At the end of the two weeks, the students again take the Narcissism Inventory. Students scores on the Narcissism Inventory increased an average of 3 points. Identify the experimental design: A. no factors B. one factor with two levels, between-subjects C. one factor with two levels, within-subjects D. one factor with more than two levels, between-subjects E. one factor with more than two levels, within-subjects F. more than one factor

Causation and experiments. Phil 12: Logic and Decision Making Spring 2011 UC San Diego 5/24/2011

Causation and experiments. Phil 12: Logic and Decision Making Spring 2011 UC San Diego 5/24/2011 Causation and experiments Phil 12: Logic and Decision Making Spring 2011 UC San Diego 5/24/2011 Review Diagramming causal relations Variables as nodes (boxes) Causal relations as arrows Not tracing the

More information

Causality and experiments

Causality and experiments Causality and experiments The following need to send me their clicker numbers: Miquel Mijia Isaiah Weiss Review Diagramming causal relations Variables as nodes (boxes) Causal relations as arrows Not tracing

More information

Causality and Experiments

Causality and Experiments Causality and http://philosophy.ucsd.edu/faculty/wuthrich/ 12 Scientific Reasoning Acknowledgements: Bill Bechtel The basic idea of an experiment If the independent variable is the cause of the dependent

More information

Agenda 2/28/08. Warming up

Agenda 2/28/08. Warming up Agenda 2/28/08 Review of key concepts from recent material New lecture material: Causality and experiments 2/28/08 1 Warming up What if I told you that studying with a partner would help you do better

More information

Review of causal research. Phil 12: Logic and Decision Making Fall 2010 UC San Diego 11/22/2010

Review of causal research. Phil 12: Logic and Decision Making Fall 2010 UC San Diego 11/22/2010 Review of causal research Phil 12: Logic and Decision Making Fall 2010 UC San Diego 11/22/2010 Announcements Trying to answer paper topics for other sections a good way to study Sample final exam questions

More information

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation.

Measures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation. Measures of Dispersion Range Variance Standard deviation Range The numerical difference between the highest and lowest scores in a distribution It describes the overall spread between the highest and lowest

More information

The essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV.

The essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV. EXPERIMENTAL DESIGNS I: Between-Groups Designs There are many experimental designs. We begin this week with the most basic, where there is a single IV and where participants are divided into two or more

More information

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.

Topic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups. ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 17A LECTURE NOTES [03/08/17] QUASI-EXPERIMENTAL DESIGNS PAGE 1 Topic #6 QUASI-EXPERIMENTAL DESIGNS Again, central issue is one of research validity. Quasi-experimental

More information

Evaluating Experiments; Studies of causation when experiments are not possible. Phil 12: Logic and Decision Making Fall 2010 UC San Diego 11/19/2010

Evaluating Experiments; Studies of causation when experiments are not possible. Phil 12: Logic and Decision Making Fall 2010 UC San Diego 11/19/2010 Evaluating Experiments; Studies of causation when experiments are not possible Phil 12: Logic and Decision Making Fall 2010 UC San Diego 11/19/2010 Announcements Nanhee s office hours cancelled today But

More information

Previous Example. New. Tradition

Previous Example. New. Tradition Experimental Design Previous Example New Tradition Goal? New Tradition =? Challenges Internal validity How to guarantee what you have observed is true? External validity How to guarantee what you have

More information

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs

PSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs Nonexperimental vs. Quasi- Experimental Strategies PSY 250 Quasi and Non-experimental designs Chapter 10 Resemble experiments but contain some threat such as a confounding variable that can not be completely

More information

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters. Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we talk about what experiments are, we

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

Scientific Research. The Scientific Method. Scientific Explanation

Scientific Research. The Scientific Method. Scientific Explanation Scientific Research The Scientific Method Make systematic observations. Develop a testable explanation. Submit the explanation to empirical test. If explanation fails the test, then Revise the explanation

More information

Topic #2. A key criterion in evaluating any test, measure, or piece of research is validity.

Topic #2. A key criterion in evaluating any test, measure, or piece of research is validity. ARTHUR SYC 302 (EXERIMENTAL SYCHOLOGY) 18C LECTURE NOTES [08/23/18] RESEARCH VALIDITY AGE 1 Topic #2 RESEARCH VALIDITY A key criterion in evaluating any test, measure, or piece of research is validity.

More information

UNIT 1: Fundamentals of research design and variables

UNIT 1: Fundamentals of research design and variables UNIT 1: Fundamentals of research design and s Reading Assignment: Aron Reading on website: Logic & Language of Psychology Research 1. What are the goals of science and how do the types of statistics relate

More information

HPS301 Exam Notes- Contents

HPS301 Exam Notes- Contents HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

Correlation and Causation. Phil 12: Logic and Decision Making Winter 2010 UC San Diego 2/17/2010

Correlation and Causation. Phil 12: Logic and Decision Making Winter 2010 UC San Diego 2/17/2010 Correlation and Causation Phil 12: Logic and Decision Making Winter 2010 UC San Diego 2/17/2010 First paper Due Friday 2/19 by noon (beginning of lecture) If you want to turn it in early: put in envelope

More information

Diagramming and reasoning about causes. Phil 12: Logic and Decision Making Winter 2010 UC San Diego 2/24/2010

Diagramming and reasoning about causes. Phil 12: Logic and Decision Making Winter 2010 UC San Diego 2/24/2010 Diagramming and reasoning about causes Phil 12: Logic and Decision Making Winter 2010 UC San Diego 2/24/2010 Review Mill s methods: designed to identify the likely cause from amongst possible causes Method

More information

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D. Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).

More information

PYSC 224 Introduction to Experimental Psychology

PYSC 224 Introduction to Experimental Psychology PYSC 224 Introduction to Experimental Psychology Session 6 Quasi Experiments and Faulty Experimental Designs Part 1 & 2 Lecturer: Dr. Margaret Amankwah-Poku, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh

More information

One slide on research question Literature review: structured; holes you will fill in Your research design

One slide on research question Literature review: structured; holes you will fill in Your research design Topics Ahead Week 10-11: Experimental design; Running experiment Week 12: Survey Design; ANOVA Week 13: Correlation and Regression; Non Parametric Statistics Week 14: Computational Methods; Simulation;

More information

Educational Research. S.Shafiee. Expert PDF Trial

Educational Research. S.Shafiee. Expert PDF Trial Educational Research: Experimental Studies Educational Research S.Shafiee Research... The systematic application of a family of methods employed to provide trustworthy information about problems an ongoing

More information

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04 Validity and Quantitative Research RCS 6740 6/16/04 What is Validity? Valid Definition (Dictionary.com): Well grounded; just: a valid objection. Producing the desired results; efficacious: valid methods.

More information

Educational Psychology

Educational Psychology What are the Goals of Scientific Study? Unit 1 Scientific Study of Educational Psychology Prediction makes the theory Testable Describe Understand Predict Control That s just a theory. Give me the facts!

More information

CHAPTER 8 EXPERIMENTAL DESIGN

CHAPTER 8 EXPERIMENTAL DESIGN CHAPTER 8 1 EXPERIMENTAL DESIGN LEARNING OBJECTIVES 2 Define confounding variable, and describe how confounding variables are related to internal validity Describe the posttest-only design and the pretestposttest

More information

EXPERIMENTAL METHODS IN PSYCHOLINGUISTIC RESEARCH SUMMER SEMESTER 2015

EXPERIMENTAL METHODS IN PSYCHOLINGUISTIC RESEARCH SUMMER SEMESTER 2015 EXPERIMENTAL METHODS IN PSYCHOLINGUISTIC RESEARCH SUMMER SEMESTER 2015 RESEARCH CYCLE Course content WHAT IS AN EXPERIMENT? A systematic research study in which the researcher: 1) directly varies (manipulates)

More information

PSY 250. Experimental Design: The Basic Building Blocks. Simple between subjects design. The Two-Group Design 7/25/2015. Experimental design

PSY 250. Experimental Design: The Basic Building Blocks. Simple between subjects design. The Two-Group Design 7/25/2015. Experimental design Experimental Design: The Basic Building Blocks PSY 250 Experimental design The general plan for selecting participants, assigning participants to experimental conditions, controlling extraneous variables,

More information

Lecture 4: Research Approaches

Lecture 4: Research Approaches Lecture 4: Research Approaches Lecture Objectives Theories in research Research design approaches ú Experimental vs. non-experimental ú Cross-sectional and longitudinal ú Descriptive approaches How to

More information

Chapter 8 Experimental Design

Chapter 8 Experimental Design Chapter 8 Experimental Design Causality Review Remember from Chapter 4 that in order to make a causal inference, you need to satisfy three requirements: 1. Covariation 2. Temporal order 3. Eliminate alternative

More information

Experimental Design Part II

Experimental Design Part II Experimental Design Part II Keith Smolkowski April 30, 2008 Where Are We Now? esearch eview esearch Design: The Plan Internal Validity Statements of Causality External Validity Statements of Generalizability

More information

10/23/2017. Often, we cannot manipulate a variable of interest

10/23/2017. Often, we cannot manipulate a variable of interest Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the

More information

Design of Experiments & Introduction to Research

Design of Experiments & Introduction to Research Design of Experiments & Introduction to Research 1 Design of Experiments Introduction to Research Definition and Purpose Scientific Method Research Project Paradigm Structure of a Research Project Types

More information

Experimental Design. What We Will Cover in This Section. Basic Requirements

Experimental Design. What We Will Cover in This Section. Basic Requirements Experimental Design 3/29/2004 P365 Experimental Design 1 What We Will Cover in This Section Overview. Basic requirements. Between subjects designs. Within subjects designs. Factorial designs. Pre-experimental

More information

11/2/2017. Often, we cannot manipulate a variable of interest

11/2/2017. Often, we cannot manipulate a variable of interest Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the

More information

Causation when Experiments are Not Possible

Causation when Experiments are Not Possible Causation when Experiments are Not Possible The search for truth is like looking for Elvis on any given day there will be many sightings --- most will be impersonators! Review Experiments manipulate the

More information

Experiments. Outline. Experiment. Independent samples designs. Experiment Independent variable

Experiments. Outline. Experiment. Independent samples designs. Experiment Independent variable Experiments 1 Outline Experiment Independent variable Factor Levels Condition Dependent variable Control variable Internal vs external validity Independent samples designs Why / Why not? Carry-over effects

More information

Rival Plausible Explanations

Rival Plausible Explanations Ci Criminology i 860 Quasi-Experimentation and Evaluation Research Remember John Stuart Mill s 3 Criteria for inferring the existence of a causal relation: 1. Temporal precedence 2. Existence of a relationship

More information

EXPERIMENTAL RESEARCH DESIGNS

EXPERIMENTAL RESEARCH DESIGNS ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study

More information

A. Indicate the best answer to each the following multiple-choice questions (20 points)

A. Indicate the best answer to each the following multiple-choice questions (20 points) Phil 12 Fall 2012 Directions and Sample Questions for Final Exam Part I: Correlation A. Indicate the best answer to each the following multiple-choice questions (20 points) 1. Correlations are a) useful

More information

The following are questions that students had difficulty with on the first three exams.

The following are questions that students had difficulty with on the first three exams. The following are questions that students had difficulty with on the first three exams. Exam 1 1. A measure has construct validity if it: a) really measures what it is supposed to measure b) appears, on

More information

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality Lecture 3 Empirical Research Methods IN4304 design (fixed design) Previous lecture A research plan Consider: purpose, theory, research question, mode inquiry, sampling method Research question Descriptive/

More information

What We Will Cover in This Section

What We Will Cover in This Section Pre and Quasi-Experimental 1 What We Will Cover in This Section Pre-Experimental Quasi- Experimental. Summary 2 Internal Validity Revisited 3 Common Threats to Internal Validity 1. History. 2. Maturation.

More information

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8

Experimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8 Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to

More information

Experimental Research

Experimental Research Experimental Research Experimental Research Experimental research is an attempt by the researcher to maintain control over all factors that may affect the result of an experiment. In doing this, the researcher

More information

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013

Study Design. Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Single point in time Cross-Sectional Research Multiple points in time Study only exists in this point in time Longitudinal Research Study

More information

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera Homework assignment topics 37-42 Georgina Salas Topics 37-42 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 37 1. What is the purpose of an experiment? The purpose of an experiment is to explore

More information

Threats to Validity in Experiments. The John Henry Effect

Threats to Validity in Experiments. The John Henry Effect Threats to Validity in Experiments Office Hours: M 11:30-12:30, W 10:30-12:30 SSB 447 The John Henry Effect Housekeeping Homework 3, due Tuesday A great paper, but far from an experiment Midterm review

More information

Conducting a Good Experiment I: Variables and Control

Conducting a Good Experiment I: Variables and Control CHAPTER SIX Conducting a Good Experiment I: Variables and Control 1 The Nature of Variables! Variable! A variable is an event or behavior that can assume at least two values.! Bridgman (1927) suggested

More information

04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing

04/12/2014. Research Methods in Psychology. Chapter 6: Independent Groups Designs. What is your ideas? Testing Research Methods in Psychology Chapter 6: Independent Groups Designs 1 Why Psychologists Conduct Experiments? What is your ideas? 2 Why Psychologists Conduct Experiments? Testing Hypotheses derived from

More information

Today s reading concerned what method? A. Randomized control trials. B. Regression discontinuity. C. Latent variable analysis. D.

Today s reading concerned what method? A. Randomized control trials. B. Regression discontinuity. C. Latent variable analysis. D. Quasi-Experiments Today s reading concerned what method? A. Randomized control trials. B. Regression discontinuity. C. Latent variable analysis. D. Distribution plotting.. What visual cue on a graph indicates

More information

Experimental Design (7)

Experimental Design (7) Experimental Design (7) Kerry Kilborn Department of Psychology Overview Confounding variables Experiment vs. Correlational Study Between-Subjects Design Equivalent Groups Quasi-Experiments Summary Experimental

More information

Experimental Research I. Quiz/Review 7/6/2011

Experimental Research I. Quiz/Review 7/6/2011 Experimental Research I Day 3 Quiz/Review Quiz Review Normal Curve z scores & T scores More on the normal curve and variability... Theoretical perfect curve. Never happens in actual research Mean, median,

More information

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany

Overview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany Overview of Perspectives on Causal Inference: Campbell and Rubin Stephen G. West Arizona State University Freie Universität Berlin, Germany 1 Randomized Experiment (RE) Sir Ronald Fisher E(X Treatment

More information

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 381 Exam #2 E Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) An approach to qualitative research that focuses on building theories is known

More information

In this chapter we discuss validity issues for quantitative research and for qualitative research.

In this chapter we discuss validity issues for quantitative research and for qualitative research. Chapter 8 Validity of Research Results (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we discuss validity issues for

More information

Stress and Psychosocial Risks at Work. Jessica M Smyrl, YSM Solutions IIRSM West Scotland Branch Meeting 27 March 2018

Stress and Psychosocial Risks at Work. Jessica M Smyrl, YSM Solutions IIRSM West Scotland Branch Meeting 27 March 2018 Stress and Psychosocial Risks at Work Jessica M Smyrl, YSM Solutions IIRSM West Scotland Branch Meeting 27 March 2018 1 2 Legal and HSE A duty exists for all employers to undertake an adequate risk assessment

More information

Foundations of experimental research

Foundations of experimental research Foundations of experimental research 707.031: Evaluation Methodology Winter 2014/15 Eduardo Veas THEOC, the scientific method Theory Hypothesis Experiment Observation Conclusion 2 Source of variability

More information

STATISTICAL CONCLUSION VALIDITY

STATISTICAL CONCLUSION VALIDITY Validity 1 The attached checklist can help when one is evaluating the threats to validity of a study. VALIDITY CHECKLIST Recall that these types are only illustrative. There are many more. INTERNAL VALIDITY

More information

Phil 12: Logic and Decision Making (Winter 2010) Directions and Sample Questions for Final Exam. Part I: Correlation

Phil 12: Logic and Decision Making (Winter 2010) Directions and Sample Questions for Final Exam. Part I: Correlation Phil 12: Logic and Decision Making (Winter 2010) Directions and Sample Questions for Final Exam Part I: Correlation A. Answer the following multiple-choice questions 1. To make a prediction from a new

More information

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Research Approach & Design Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Content: Introduction Definition of research design Process of designing & conducting

More information

GUIDE 4: COUNSELING THE UNEMPLOYED

GUIDE 4: COUNSELING THE UNEMPLOYED GUIDE 4: COUNSELING THE UNEMPLOYED Addressing threats to experimental integrity This case study is based on Sample Attrition Bias in Randomized Experiments: A Tale of Two Surveys By Luc Behaghel, Bruno

More information

SINGLE-CASE RESEARCH. Relevant History. Relevant History 1/9/2018

SINGLE-CASE RESEARCH. Relevant History. Relevant History 1/9/2018 SINGLE-CASE RESEARCH And Small N Designs Relevant History In last half of nineteenth century, researchers more often looked at individual behavior (idiographic approach) Founders of psychological research

More information

Chapter 9: Experiments

Chapter 9: Experiments Chapter 9: Experiments WHAT IS EXPERIMENTATION? Experiments are studies involving intervention by the researcher beyond that required for measurement. The usual intervention is to manipulate some variable

More information

Causal inference nuts and bolts

Causal inference nuts and bolts DAVIDSON CONSULTING LIMITED http://davidsonconsulting.co.nz World-class evaluation & organisational consulting Causal inference nuts and bolts Demonstration Session American Evaluation Association conference

More information

Research Plan And Design

Research Plan And Design Research Plan And Design By Dr. Achmad Nizar Hidayanto Information Management Lab Faculty of Computer Science Universitas Indonesia Salemba, 1 Agustus 2017 Research - Defined The process of gathering information

More information

Human Error Causes of Workplace Accidents

Human Error Causes of Workplace Accidents Human Error Causes of Workplace Accidents October 7, 2015 Glyn Jones, M.A.Sc, P.Eng, CIH, CRSP EHS Partnerships Ltd. gjones@ehsp.ca Human Error 2015 EHS Partnerships Ltd. Introduction To say accidents

More information

Wissenschftlichen Arbeiten. Research methods (II) Zhuanghua Shi

Wissenschftlichen Arbeiten. Research methods (II) Zhuanghua Shi Wissenschftlichen Arbeiten Research methods (II) Zhuanghua Shi!1 Last week Descriptive method case studies, survey, developmental study, follow-up study, documentary analysis, correlation analysis Experimental

More information

26:010:557 / 26:620:557 Social Science Research Methods

26:010:557 / 26:620:557 Social Science Research Methods 26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview

More information

What We Will Cover in This Section

What We Will Cover in This Section Pre and Quasi-Experimental Design 9/2/2006 P767Intro.ppt 1 What We Will Cover in This Section What are they? Threats to internal validity. Pre-Experimental Designs Quasi- Experimental Designs. Summary

More information

Human Capabilities & Work Physiology II

Human Capabilities & Work Physiology II Human Capabilities & Work Physiology II Vision Circadian rhythms Musculoskeletal system 19.525 Recognition of Work Environment Hazards: Introduction to Industrial Hygiene and Ergonomics Visual Capabilities

More information

ZNA Potomac News. Presidents Message. has done an excellent. We are beginning. committee to help address questions and requests for assistance

ZNA Potomac News. Presidents Message. has done an excellent. We are beginning. committee to help address questions and requests for assistance 10/4/2006 Volume Issue ZNA Potomac News Inside this issue: How to kill your fish with DDT How to kill your fish with DDT cont Can water lilies be more then salad for koi ZNA Potomac Website now online!!

More information

Research Design. Beyond Randomized Control Trials. Jody Worley, Ph.D. College of Arts & Sciences Human Relations

Research Design. Beyond Randomized Control Trials. Jody Worley, Ph.D. College of Arts & Sciences Human Relations Research Design Beyond Randomized Control Trials Jody Worley, Ph.D. College of Arts & Sciences Human Relations Introduction to the series Day 1: Nonrandomized Designs Day 2: Sampling Strategies Day 3:

More information

Thank you very much for your guidance on this revision. We look forward to hearing from you.

Thank you very much for your guidance on this revision. We look forward to hearing from you. 1 PAINTED BUNTING MANUSCRIPT REVIEW HISTORY REVISION NOTES FROM AUTHORS (ROUND 2) We would like to submit a revision of our manuscript. As you requested, we have run new studies that employ additional

More information

QUASI EXPERIMENTAL DESIGN

QUASI EXPERIMENTAL DESIGN UNIT 3 QUASI EXPERIMENTAL DESIGN Factorial Design Structure 3. Introduction 3.1 Objectives 3.2 Meaning of Quasi Experimental Design 3.3 Difference Between Quasi Experimental Design and True Experimental

More information

Attitude Measurement

Attitude Measurement Business Research Methods 9e Zikmund Babin Carr Griffin Attitude Measurement 14 Chapter 14 Attitude Measurement 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or

More information

Experimental Design and the struggle to control threats to validity

Experimental Design and the struggle to control threats to validity EXPERIMENTAL DESIGN Experimental Design and the struggle to control threats to validity INCREASINGLY CONSTRAINED LOW NATURALISTIC CASE-STUDY CORRELATIONAL DIFFERENTIAL EXPERIMENTAL HIGH Experimental design

More information

CHAPTER LEARNING OUTCOMES

CHAPTER LEARNING OUTCOMES EXPERIIMENTAL METHODOLOGY CHAPTER LEARNING OUTCOMES When you have completed reading this article you will be able to: Define what is an experiment Explain the role of theory in educational research Justify

More information

Overview of Experimentation

Overview of Experimentation The Basics of Experimentation Overview of Experiments. IVs & DVs. Operational Definitions. Reliability. Validity. Internal vs. External Validity. Classic Threats to Internal Validity. Lab: FP Overview;

More information

VALIDITY OF QUANTITATIVE RESEARCH

VALIDITY OF QUANTITATIVE RESEARCH Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees

More information

Experimental and Quasi-Experimental designs

Experimental and Quasi-Experimental designs External Validity Internal Validity NSG 687 Experimental and Quasi-Experimental designs True experimental designs are characterized by three "criteria for causality." These are: 1) The cause (independent

More information

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I

EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGN To strongly identify cause-and-effect relationships Experimental Design EXPERIMENTAL AND EX POST FACTO DESIGN

More information

Section 6.1 Sampling. Population each element (or person) from the set of observations that can be made (entire group)

Section 6.1 Sampling. Population each element (or person) from the set of observations that can be made (entire group) Section 6.1 Sampling Population each element (or person) from the set of observations that can be made (entire group) Sample a subset of the population Census systematically getting information about an

More information

Other Designs. What Aids Our Causal Arguments? Time Designs Cohort. Time Designs Cross-Sectional

Other Designs. What Aids Our Causal Arguments? Time Designs Cohort. Time Designs Cross-Sectional Statistics in & Things to Consider Your Proposal Bring green folder of readings and copies of your proposal rough draft (one to turn in) Other Designs November 26, 2007 1 2 What Aids Our Causal Arguments?

More information

SHIFT WORK AND CIRCADIAN RHYTHMS Presented by: Dile V. Brooks, Jr. Alabama Power Company EPRI POWER SWITCHING SAFETY & RELIABILITY CONFERENCE

SHIFT WORK AND CIRCADIAN RHYTHMS Presented by: Dile V. Brooks, Jr. Alabama Power Company EPRI POWER SWITCHING SAFETY & RELIABILITY CONFERENCE SHIFT WORK AND CIRCADIAN RHYTHMS Presented by: Dile V. Brooks, Jr. Alabama Power Company EPRI POWER SWITCHING SAFETY & RELIABILITY CONFERENCE Quincy, Ma October 14-15, 2009 Effects of Shiftwork on Performance

More information

So You Want to do a Survey?

So You Want to do a Survey? Institute of Nuclear Power Operations So You Want to do a Survey? G. Kenneth Koves Ph.D. NAECP Conference, Austin TX 2015 September 29 1 Who am I? Ph.D. in Industrial/Organizational Psychology from Georgia

More information

Quasi-Experimental and Single Case Experimental Designs. Experimental Designs vs. Quasi-Experimental Designs

Quasi-Experimental and Single Case Experimental Designs. Experimental Designs vs. Quasi-Experimental Designs 1 Quasi-Experimental and Single Case Experimental Designs RCS 6740 6/30/04 Experimental Designs vs. Quasi-Experimental Designs Experimental Designs include: Random Assignment of Participants to groups

More information

LIFESPAN DEVELOPMENT. An Introduction

LIFESPAN DEVELOPMENT. An Introduction LIFESPAN DEVELOPMENT An Introduction What is Lifespan Development? Def; patterns of changes that occur between conception and death. from the Womb to the Tomb Why study Lifespan Development? Early pioneers

More information

Experiment Design 9/17/2015. Mini summary of Green & Bavelier

Experiment Design 9/17/2015. Mini summary of Green & Bavelier Experiment Design Main Parameters Experimental design is not a linear Independent Variable planning process What will you manipulate either between subjects or within subjects? Task What will subjects

More information

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research Chapter 11 Nonexperimental Quantitative Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) Nonexperimental research is needed because

More information

DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable

DEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable EXPERIMENT Experimental Research A RESEARCH INVESTIGATION IN WHICH CONDITIONS ARE CONTROLLED ONE INDEPENDENT VARIABLE IS MANIPULATED (SOMETIMES MORE THAN ONE) ITS EFFECT ON A DEPENDENT VARIABLE IS MEASURED

More information

Lean and Environment Training Modules Version 1.0 January 2006

Lean and Environment Training Modules Version 1.0 January 2006 Lean and Environment Training Modules Version 1.0 January 2006 Next Page Lean and Environment Training Module 5 6S (5S+Safety) Previous Page Next Page Purpose of This Module» Learn why Environment, Health,

More information

Levels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended?

Levels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended? Program Evaluation Jonathan Howland, PhD, MPH 1 Formative Process Level Outcome Levels of Evaluation Question Example of Method Does the program Focus groups with make sense? target population. Was the

More information

A study of effects of circuit training on selected physical fitness variables of sports persons

A study of effects of circuit training on selected physical fitness variables of sports persons 2017; 2(2): 10-14 ISSN: 2456-4419 Impact Factor: (RJIF): 5.18 Yoga 2017; 2(2): 10-14 2017 Yoga www.theyogicjournal.com Received: 01-05-2017 Accepted: 02-06-2017 Sunita Rani Research Scholar, C.D.L.U, Dr.

More information

Reasoning about probabilities (cont.); Correlational studies of differences between means

Reasoning about probabilities (cont.); Correlational studies of differences between means Reasoning about probabilities (cont.); Correlational studies of differences between means Phil 12: Logic and Decision Making Fall 2010 UC San Diego 10/29/2010 Review You have found a correlation in a sample

More information

The Practice and Problems of Social Research

The Practice and Problems of Social Research The Practice and Problems of Social Research Office Hours: M 11:30-12:30, W 10:30-12:30 SSB 447 Randall Munroe, xkcd.com Correlation doesn t imply causation, but it does waggle its eyebrows suggestively

More information

Causal inference: Nuts and bolts

Causal inference: Nuts and bolts DAVIDSON CONSULTING LIMITED http://davidsonconsulting.co.nz World-class evaluation & organisational consulting Causal inference: Nuts and bolts A Mini Workshop for the anzea Wellington branch E. Jane Davidson,

More information

Research Methods. It is actually way more exciting than it sounds!!!!

Research Methods. It is actually way more exciting than it sounds!!!! Research Methods It is actually way more exciting than it sounds!!!! Why do we have to learn this stuff? Psychology is first and foremost a science. Thus it is based in research. Before we delve into how

More information