Foundations of experimental research

Size: px
Start display at page:

Download "Foundations of experimental research"

Transcription

1 Foundations of experimental research : Evaluation Methodology Winter 2014/15 Eduardo Veas

2 THEOC, the scientific method Theory Hypothesis Experiment Observation Conclusion 2

3 Source of variability Source: Card et al

4 Curiosity foundation of experimental research Human behaviour 4

5 Ideas, Theories and Hypothesis Curiosity in motion 5

6 Experimental research Establish relationships between circumstances and behaviors Fit these relationships into an orderly body of knowledge 6

7 FEAR OF IDEAS 7

8 Fear your ideas Anyone doing research is a genius, I don t come even close GENIEPHOBIA 8

9 Fear your ideas I am having a hard time coming with original ideas IMITATOPHOBIA 9

10 Fear your ideas Having to use complex hardware I got a headache PARAPHERNALIO-PHOBIA If there is complex equipment involved, it must be good research MANUPHOBIA 10

11 Fear your ideas If it is simple it can t be science FEAR OF SIMPLICITY 11

12 Fear your ideas numbers! numbers! FEAR OF STATISTICS 12

13 Fear your ideas Something is missing here, I just know it IMPERFECTAPHOBIA 13

14 Fear your ideas Lorem ipsum FEAR OF NOT SOUNDING SCIENTIFIC 14

15 Fear your ideas FEAR OF WORK 15

16 Fear your own ideas Geniephobia Imitatophobia Paraphernalio-phobia / Manuphobia Fear of simplicity Fear of math Imperfectaphobia Fear of not sounding scientific Fear of work 16

17 Generating ideas Systematic reduction of idea-phobia 17

18 Experimental research Establish relationships between circumstances and behaviors Fit these relationships into an orderly body of knowledge 18

19 Observation Sit in your computer and stare at your keyboard until your eyes start to bleed 19

20 Observation Sit in your computer and stare at your keyboard until your eyes start to bleed We are interested in human, rather than keyboard behavior 20

21 Public observation write up ideas that come up as you stroll through campus. 21

22 Public observation write up ideas that come up as you stroll through campus. you got 7 minutes. statements in the form circumstance => behavior 22

23 ROT test Experimental ideas must be: R epeatable O bservable T estable 23

24 Correlational or observational? Label your ideas now 24

25 Theories Title Text 25

26 induction Theory choose one idea and convert it into a theory deduction use that theory to make predictions each prediction forms a hypothesis 26

27 Relationship Theory-Hypothesis-Experiment Observation induction Theory deduction Predicted Observation EXPERIMENT Confirmed Observation induction Theory supported Disconfirmed Observation deduction Theory false 27

28 Expected results of experiment proving a prediction: does not prove but supports a hypothesis, thus the theory. disproving a prediction: not enough evidence was found to prove the hypotheses/theory 28

29 Does theory precede data? OBSERVATION EXPERIMENT THEORY HYPOTHESES 29

30 Experimental Methodology Formal Curiosity 30

31 Experimental research Establish relationships between circumstances and behaviors Fit these relationships into an orderly body of knowledge 31

32 Experimental research Behavior Circumstances 32

33 Experimental research heavy breakfast bad coffee rainy day birthday party last night smelly office hot office bright office increase light intensity loud pitch sound press button grab more coffee read text girlfriend text boyfriend sunny day Circumstances Behavior 33

34 Experimental research bad coffee heavy breakfast rainy day birthday party last night smelly office hot office bright office increase light intensity loud pitch sound press button grab more coffee read text girlfriend text boyfriend sunny day Circumstances Behavior 34

35 Experimental research: causal statements Increase in light intensity press button WHEN DONE CORRECTLY change in measured behavior is due to manipulation of circumstance 35

36 Variables in experimental research Title Text 36

37 Experimental research: variables INDEPENDENT press button increase light intensity Circumstances Behavior 37

38 Experimental research: variables INDEPENDENT DEPENDENT press button increase light intensity Circumstances Behavior 38

39 Experimental research: hypothesis INDEPENDENT DEPENDENT press button increase light intensity the hypothesis is a statement about the expected outcome Circumstances Behavior 39

40 Experimental research: hypothesis INDEPENDENT DEPENDENT press button increase light intensity H1: Participants will be significantly faster in pressing a button in the 100 Lux condition. Circumstances Behavior 40

41 Experimental research: variables bad coffee INDEPENDENT heavy breakfast rainy day birthday party last night smelly office hot office bright office increase light intensity loud pitch sound sunny day -?- DEPENDENT press button Circumstances Behavior 41

42 Experimental research: variables bad coffee INDEPENDENT heavy breakfast rainy day birthday party last night smelly office hot office bright office increase light intensity loud pitch sound sunny day -control variables- DEPENDENT press button Circumstances Behavior 42

43 Experimental research: external validity validity of experimental method: is drawing conclusions about cause justifiable? the more highly controlled the experiment, the less generalizable its results. 43

44 Experimental research: variables bad coffee INDEPENDENT heavy breakfast rainy day birthday party last night smelly office hot office bright office increase light intensity loud pitch sound sunny day -control variableslearning DEPENDENT press button Circumstances Behavior 44

45 Experimental research: variables INDEPENDENT heavy breakfast DEPENDENT bad coffee rainy day birthday party last night smelly office hot office bright office increase light intensity loud pitch sound sunny day -control variableslearning -random variables- press button Circumstances Behavior 45

46 Experimental research: random variables random selection of participants. random assignment of circumstances to levels of the independent variable 46

47 Experimental research: variables generalizable CONTROL RANDOM WITHIN CONSTRAINTS RANDOM 47

48 Experimental research: variables circumstance that changes systematically as the experimenter manipulates the independent variable CONFOUNDING VARIABLES 48

49 VALIDITY Where we see it all fail 49

50 Experimental Method: validity External: is it justifiable to generalize causation from the results Internal: are there confounding variables which have not been taken into account? are there unconsidered threats? 50

51 Threats to internal validity History Maturation Selection Differential mortality Testing Statistical regression Interactions with selection 51

52 Experimental Design Blueprint of a proof 52

53 Experimental design questions HOW MANY INDEPENDENT VARIABLES? HOW MANY DIFFERENT VALUES DOES EACH VARIABLE HAVE? 53

54 Experimental design: Decision Design study Number of independent variables >1? NO YES Basic design Number of values per independent variable Factorial design Between groups Within groups Between groups Within groups Split plot 54

55 Between participant design Each participant is exposed to one level only Divide participants in groups (one per condition) Compare measurements between groups 55

56 Between participants design: advantages Rules out learning effects. Cannot contaminate behavior in other levels Can collect more data per level / more participant time per level. 56

57 Between participant design: disadvantages differences between groups of participants = differences between conditions 57

58 Within participants design Each participant is exposed to every condition 58

59 Within participant design: advantages requires fewer participants minimizes individual differences between levels of the independent variable 59

60 Within participant design: disadvantages Needs to account for learning effects Needs to account for ordering effects Combinatorial explosion limits number of conditions 60

61 Number of participants Depends on effect size study design Calculated through power analysis (statistical power) 61

62 Experimental design: overview Trial: independent unit of measurement Measurement: quantitative: measurable indicators (task completing time, error rates, mouse movement) qualitative: subjective feedback (satisfaction, preference) observations 62

63 Experimental design: am I ready? Ethical constraints? Number of participants? How long will it take? Should I set participant restrictions? Should I set criteria for eliminating participants? Can I operationally define all my variables? Have I organized equipment? Do I know how I will analyze my data? 63 How will I interpret results?

64 Experimental design: Pilot test rule out planning errors get acquainted with methodology test analysis tools (if pilot big enough) 64

65 Experiment execution Repeat: all participants in a group are expected to receive the same stimuli for each participant repeat instructions exactly respect execution plan breaks DO NOT CHANGE THE RULES!!! 65

66 Reporting 101 if you live to tell the story 66

67 Assignment: Experimental protocol Introduction: observation statement of purpose hypotheses Method procedure: design (within-between) combinations of conditions 67 one experiment session

68 Introduction: statement of purpose hypotheses Method participants apparatus/materials procedure Results descriptive statistics statistical tests used results in standard way 68 Discussion Outline of report

69 R Title Text 69

70 set work directory setwd("/new/work/directory") getwd() 70

71 packages #installing packages install.packages("package.name") # loading a package library(package.name) # disambiguating functions 71 package::function()

72 Readings Doing Psychological Experiments (Martin): Ch2- Ch3-Ch8 72

Designing Experiments... Or how many times and ways can I screw that up?!?

Designing Experiments... Or how many times and ways can I screw that up?!? www.geo.uzh.ch/microsite/icacogvis/ Designing Experiments... Or how many times and ways can I screw that up?!? Amy L. Griffin AutoCarto 2012, Columbus, OH Outline When do I need to run an experiment and

More information

Design of Experiments & Introduction to Research

Design of Experiments & Introduction to Research Design of Experiments & Introduction to Research 1 Design of Experiments Introduction to Research Definition and Purpose Scientific Method Research Project Paradigm Structure of a Research Project Types

More information

Designing A User Study

Designing A User Study EECS4443 Mobile User Interfaces Designing A User Study Scott MacKenzie York University EECS4443 Mobile User Interfaces Designing A User Study 1 Scott MacKenzie York University 1 Executive summary The Complete

More information

Graphic Organizers. Compare/Contrast. 1. Different. 2. Different. Alike

Graphic Organizers. Compare/Contrast. 1. Different. 2. Different. Alike 1 Compare/Contrast When you compare and contrast people, places, objects, or ideas, you are looking for how they are alike and how they are different. One way to organize your information is to use a Venn

More information

One slide on research question Literature review: structured; holes you will fill in Your research design

One slide on research question Literature review: structured; holes you will fill in Your research design Topics Ahead Week 10-11: Experimental design; Running experiment Week 12: Survey Design; ANOVA Week 13: Correlation and Regression; Non Parametric Statistics Week 14: Computational Methods; Simulation;

More information

GCSE. Psychology. Mark Scheme for June General Certificate of Secondary Education Unit B543: Research in Psychology

GCSE. Psychology. Mark Scheme for June General Certificate of Secondary Education Unit B543: Research in Psychology GCSE Psychology General Certificate of Secondary Education Unit B543: Research in Psychology Mark Scheme for June 2011 Oxford Cambridge and RSA Examinations OCR (Oxford Cambridge and RSA) is a leading

More information

PYSC 224 Introduction to Experimental Psychology

PYSC 224 Introduction to Experimental Psychology PYSC 224 Introduction to Experimental Psychology Session 3 Nature of scientific methodology Lecturer:, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh College of Education School of Continuing

More information

Previous Example. New. Tradition

Previous Example. New. Tradition Experimental Design Previous Example New Tradition Goal? New Tradition =? Challenges Internal validity How to guarantee what you have observed is true? External validity How to guarantee what you have

More information

Selecting a research method

Selecting a research method Selecting a research method Tomi Männistö 13.10.2005 Overview Theme Maturity of research (on a particular topic) and its reflection on appropriate method Validity level of research evidence Part I Story

More information

Empirical Research Methods for Human-Computer Interaction. I. Scott MacKenzie Steven J. Castellucci

Empirical Research Methods for Human-Computer Interaction. I. Scott MacKenzie Steven J. Castellucci Empirical Research Methods for Human-Computer Interaction I. Scott MacKenzie Steven J. Castellucci 1 Topics The what, why, and how of empirical research Group participation in a real experiment Observations

More information

Psychology: The Science

Psychology: The Science Psychology: The Science How Psychologists Do Research Ex: While biking, it seems to me that drivers of pick up trucks aren t as nice as car drivers. I make a hypothesis or even develop a theory that p/u

More information

Topics. Experiment Terminology (Part 1)

Topics. Experiment Terminology (Part 1) Topics The what, why, and how of empirical research Group participation in a real experiment Observations and measurements Research questions Experiment terminology Experiment design Hypothesis testing

More information

PYSC 224 Introduction to Experimental Psychology

PYSC 224 Introduction to Experimental Psychology PYSC 224 Introduction to Experimental Psychology Session 4 Variables and terms in Experimentation Part 1 & 2 Lecturer: Dr. Margaret Amankwah-Poku, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh

More information

In this chapter we discuss validity issues for quantitative research and for qualitative research.

In this chapter we discuss validity issues for quantitative research and for qualitative research. Chapter 8 Validity of Research Results (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we discuss validity issues for

More information

Communication Research Practice Questions

Communication Research Practice Questions Communication Research Practice Questions For each of the following questions, select the best answer from the given alternative choices. Additional instructions are given as necessary. Read each question

More information

Research Approaches Quantitative Approach. Research Methods vs Research Design

Research Approaches Quantitative Approach. Research Methods vs Research Design Research Approaches Quantitative Approach DCE3002 Research Methodology Research Methods vs Research Design Both research methods as well as research design are crucial for successful completion of any

More information

VALIDITY OF QUANTITATIVE RESEARCH

VALIDITY OF QUANTITATIVE RESEARCH Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees

More information

Chapter 9: Experiments

Chapter 9: Experiments Chapter 9: Experiments WHAT IS EXPERIMENTATION? Experiments are studies involving intervention by the researcher beyond that required for measurement. The usual intervention is to manipulate some variable

More information

Regulation of Human Heart Rate

Regulation of Human Heart Rate Name: Date: Period: Regulation of Human Heart Rate Pre-Lab 1. List some activities or stimuli that you think may increase a person s heart rate. An activity is something a person does, and a stimulus is

More information

Evaluation: Scientific Studies. Title Text

Evaluation: Scientific Studies. Title Text Evaluation: Scientific Studies Title Text 1 Evaluation Beyond Usability Tests 2 Usability Evaluation (last week) Expert tests / walkthroughs Usability Tests with users Main goal: formative identify usability

More information

Educational Research. S.Shafiee. Expert PDF Trial

Educational Research. S.Shafiee. Expert PDF Trial Educational Research: Experimental Studies Educational Research S.Shafiee Research... The systematic application of a family of methods employed to provide trustworthy information about problems an ongoing

More information

What Is Science? Lesson Overview. Lesson Overview. 1.1 What Is Science?

What Is Science? Lesson Overview. Lesson Overview. 1.1 What Is Science? Lesson Overview 1.1 What Science Is and Is Not What are the goals of science? One goal of science is to provide natural explanations for events in the natural world. Science also aims to use those explanations

More information

Analysis A step in the research process that involves describing and then making inferences based on a set of data.

Analysis A step in the research process that involves describing and then making inferences based on a set of data. 1 Appendix 1:. Definitions of important terms. Additionality The difference between the value of an outcome after the implementation of a policy, and its value in a counterfactual scenario in which the

More information

Experimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design

Experimental Research in HCI. Alma Leora Culén University of Oslo, Department of Informatics, Design Experimental Research in HCI Alma Leora Culén University of Oslo, Department of Informatics, Design almira@ifi.uio.no INF2260/4060 1 Oslo, 15/09/16 Review Method Methodology Research methods are simply

More information

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04

Validity and Quantitative Research. What is Validity? What is Validity Cont. RCS /16/04 Validity and Quantitative Research RCS 6740 6/16/04 What is Validity? Valid Definition (Dictionary.com): Well grounded; just: a valid objection. Producing the desired results; efficacious: valid methods.

More information

Evaluation: Controlled Experiments. Title Text

Evaluation: Controlled Experiments. Title Text Evaluation: Controlled Experiments Title Text 1 Outline Evaluation beyond usability tests Controlled Experiments Other Evaluation Methods 2 Evaluation Beyond Usability Tests 3 Usability Evaluation (last

More information

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC Conducting Research in the Social Sciences Rick Balkin, Ph.D., LPC-S, NCC 1 Why we do research Improvement Description Explanation Prediction R. S. Balkin, 2008 2 Theory Explanation of an observed phenomena

More information

Disposition. Quantitative Research Methods. Science what it is. Basic assumptions of science. Inductive and deductive logic

Disposition. Quantitative Research Methods. Science what it is. Basic assumptions of science. Inductive and deductive logic Quantitative Research Methods Sofia Ramström Medicinska vetenskaper, Örebro Universitet Diagnostikcentrum, klinisk kemi, Region Östergötland Disposition I. What is science and what is quantitative science?

More information

Quantitative research Methods. Tiny Jaarsma

Quantitative research Methods. Tiny Jaarsma Quantitative research Methods Tiny Jaarsma 2018-02-26 2 The scientific method A few specific reflection on quantitative issues Randomization Intervention Blinding Sampling The scientific method: fundamentals

More information

HOW TO INSTANTLY DESTROY NEGATIVE THOUGHTS

HOW TO INSTANTLY DESTROY NEGATIVE THOUGHTS HOW TO INSTANTLY DESTROY NEGATIVE THOUGHTS Groundbreaking Technique Revealed Author Dian Winter YES!! You Can Become a Positive, Confident Person This is a FREE report brought to you by: Dian Winter http://www.destroythedemonwithin.com

More information

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN

RESEARCH METHODS. A Process of Inquiry. tm HarperCollinsPublishers ANTHONY M. GRAZIANO MICHAEL L RAULIN RESEARCH METHODS A Process of Inquiry ANTHONY M. GRAZIANO MICHAEL L RAULIN STA TE UNIVERSITY OF NEW YORK A T BUFFALO tm HarperCollinsPublishers CONTENTS Instructor's Preface xv Student's Preface xix 1

More information

9 research designs likely for PSYC 2100

9 research designs likely for PSYC 2100 9 research designs likely for PSYC 2100 1) 1 factor, 2 levels, 1 group (one group gets both treatment levels) related samples t-test (compare means of 2 levels only) 2) 1 factor, 2 levels, 2 groups (one

More information

Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time.

Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time. Clever Hans the horse could do simple math and spell out the answers to simple questions. He wasn t always correct, but he was most of the time. While a team of scientists, veterinarians, zoologists and

More information

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two

lab exam lab exam Experimental Design Experimental Design when: Nov 27 - Dec 1 format: length = 1 hour each lab section divided in two lab exam when: Nov 27 - Dec 1 length = 1 hour each lab section divided in two register for the exam in your section so there is a computer reserved for you If you write in the 1st hour, you can t leave

More information

CHAPTER NINE DATA ANALYSIS / EVALUATING QUALITY (VALIDITY) OF BETWEEN GROUP EXPERIMENTS

CHAPTER NINE DATA ANALYSIS / EVALUATING QUALITY (VALIDITY) OF BETWEEN GROUP EXPERIMENTS CHAPTER NINE DATA ANALYSIS / EVALUATING QUALITY (VALIDITY) OF BETWEEN GROUP EXPERIMENTS Chapter Objectives: Understand Null Hypothesis Significance Testing (NHST) Understand statistical significance and

More information

Communication. Jess Walsh

Communication. Jess Walsh Communication Jess Walsh Introduction. Douglas Bank is a home for young adults with severe learning disabilities. Good communication is important for the service users because it s easy to understand the

More information

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality

Lecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality Lecture 3 Empirical Research Methods IN4304 design (fixed design) Previous lecture A research plan Consider: purpose, theory, research question, mode inquiry, sampling method Research question Descriptive/

More information

Goal: To understand the methods that scientists use to study abnormal behavior

Goal: To understand the methods that scientists use to study abnormal behavior Key Dates TH Jan 26 Unit 4 TU Jan 31 Begin Dimensions-Emotion, Units IIA, 5; MW Ch 3 Paul TH Feb 2 Unit 6; MW Ch 3 Agnes, Bess TU Feb 7 Unit 7; MW Ch 7 Joseph, Virginia 1 Goal: To understand the methods

More information

Early Intervention Guidelines for Supporting School Anxiety. Information for Schools, Professionals and Parents/Carers

Early Intervention Guidelines for Supporting School Anxiety. Information for Schools, Professionals and Parents/Carers Early Intervention Guidelines for Supporting School Anxiety Information for Schools, Professionals and Parents/Carers Aims To outline what anxiety is and when it becomes problematic for children and young

More information

I think. I infer I predict My guess is Perhaps This could mean It could be that My conclusion is.

I think. I infer I predict My guess is Perhaps This could mean It could be that My conclusion is. I think Maybe I infer I predict My guess is Perhaps This could mean It could be that My conclusion is Inferencing at a Glance The title is: Clues on the cover 1. 2. 3. What I can infer after looking at

More information

Title:Mixed-strain Housing for Female C57BL/6, DBA/2, and BALB/c Mice: Validating a Split-plot Design that promotes Refinement and Reduction

Title:Mixed-strain Housing for Female C57BL/6, DBA/2, and BALB/c Mice: Validating a Split-plot Design that promotes Refinement and Reduction Author's response to reviews Title:Mixed-strain Housing for Female C57BL/6, DBA/2, and BALB/c Mice: Validating a Split-plot Design that promotes Refinement and Reduction Authors: Michael Walker Mr (mwalk04@uoguelph.ca)

More information

EXPERIMENTAL RESEARCH DESIGNS

EXPERIMENTAL RESEARCH DESIGNS ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study

More information

TRACKS Lesson Plan. Breakfast Fuel Up with Breakfast Grades 5-8

TRACKS Lesson Plan. Breakfast Fuel Up with Breakfast Grades 5-8 TRACKS Lesson Plan Breakfast Fuel Up with Breakfast Grades 5-8 I. Lesson Objectives: A. Students will recognize characteristics of a well-balanced breakfast. B. Students will describe the importance of

More information

26:010:557 / 26:620:557 Social Science Research Methods

26:010:557 / 26:620:557 Social Science Research Methods 26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview

More information

PSY 3393 Experimental Projects Spring 2008

PSY 3393 Experimental Projects Spring 2008 PSY 3393 Experimental Projects Spring 2008 Dr. Peter Assmann Assignment: journal article report Find an article on a topic of special interest to you from any peer-reviewed journal in Psychology, Neuroscience

More information

Psychology Research Process

Psychology Research Process Psychology Research Process Logical Processes Induction Observation/Association/Using Correlation Trying to assess, through observation of a large group/sample, what is associated with what? Examples:

More information

Research Methodology

Research Methodology Research Methodology Overview of Research and its Methodologies Course Objectives At the end of this course, the students should be able to: understand some basic concepts of research and its Methodologies

More information

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters. Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we talk about what experiments are, we

More information

Assignment 4: True or Quasi-Experiment

Assignment 4: True or Quasi-Experiment Assignment 4: True or Quasi-Experiment Objectives: After completing this assignment, you will be able to Evaluate when you must use an experiment to answer a research question Develop statistical hypotheses

More information

Personality Testing. Outline. In Search of Personality. Kimberley A. Clow. Types of Questions Forced Choice Free Response

Personality Testing. Outline. In Search of Personality. Kimberley A. Clow. Types of Questions Forced Choice Free Response Personality Testing Kimberley A. Clow kclow2@uwo.ca http://instruct.uwo.ca/psychology/257e-570 Outline Types of Questions Forced Choice Free Response Types of Personality Tests Maximal Performance Achievement

More information

Overview of the Scientific Process

Overview of the Scientific Process The purposes of this lab exercise are to: Overview of the Scientific Process 1. Introduce you to the LabPro3 system, one of the tools we will use in future lab exercises, and which you may choose to use

More information

From Codes to Conclusions: Strategies for Analyzing Qualitative Data

From Codes to Conclusions: Strategies for Analyzing Qualitative Data From Codes to Conclusions: Strategies for Analyzing Qualitative Data Lindsay Bayham Department of Sociology, UC Berkeley October 18 th, 2017? Lindsay Bayham 1 Existing theory / knowledge The Research Process

More information

Chapter 13 Summary Experiments and Observational Studies

Chapter 13 Summary Experiments and Observational Studies Chapter 13 Summary Experiments and Observational Studies What have we learned? We can recognize sample surveys, observational studies, and randomized comparative experiments. o These methods collect data

More information

The Clean Environment Commission. Public Participation in the Environmental Review Process

The Clean Environment Commission. Public Participation in the Environmental Review Process The Clean Environment Commission Public Participation in the Environmental Review Process Manitoba Clean Environment Commission Who are we? The Manitoba Clean Environment Commission is an arms-length agency

More information

Quantitative research Methods. Tiny Jaarsma

Quantitative research Methods. Tiny Jaarsma Quantitative research Methods Tiny Jaarsma 2018-10-01 2 Content today The scientific method A few specific reflection on quantitative issues Randomization Intervention Blinding Sampling Groups of quantitative

More information

Chapter 9: Comparing two means

Chapter 9: Comparing two means Chapter 9: Comparing two means Smart Alex s Solutions Task 1 Is arachnophobia (fear of spiders) specific to real spiders or will pictures of spiders evoke similar levels of anxiety? Twelve arachnophobes

More information

Research Questions and Survey Development

Research Questions and Survey Development Research Questions and Survey Development R. Eric Heidel, PhD Associate Professor of Biostatistics Department of Surgery University of Tennessee Graduate School of Medicine Research Questions 1 Research

More information

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 13. Experiments and Observational Studies. Copyright 2012, 2008, 2005 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies Copyright 2012, 2008, 2005 Pearson Education, Inc. Observational Studies In an observational study, researchers don t assign choices; they simply observe

More information

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie

Research Methods. for Business. A Skill'Building Approach SEVENTH EDITION. Uma Sekaran. and. Roger Bougie Research Methods for Business A Skill'Building Approach SEVENTH EDITION Uma Sekaran and Roger Bougie WILEY CONTENTS About the Authors Preface Acknowledgments xix xxi xxiii 1 Introduction to research 1

More information

Icebreaker Outbreak investigation with the disease detectives

Icebreaker Outbreak investigation with the disease detectives The card game Disease detectives can be used as an icebreaker exercise to get to know the epidemiological methods of relative risk, epidemic curve and food item-specific risk of illness in a playful way.

More information

Autism and support strategies

Autism and support strategies Trainee Assessment Autism and support strategies Unit standard Version Level Credits 23374 Describe autism and support strategies to assist a person with autism 4 3 3 Your name: Your workplace: Your date

More information

UCSD EXPERIENCE, DESIGNING AND IMPLEMENTING CORRECTIVE ACTIONS. Derek Brown

UCSD EXPERIENCE, DESIGNING AND IMPLEMENTING CORRECTIVE ACTIONS. Derek Brown UCSD EXPERIENCE, DESIGNING AND IMPLEMENTING CORRECTIVE ACTIONS Derek Brown 2 Design and implementation of corrective actions Outline 1. Designing corrective actions Something has gone wrong, what are you

More information

ELA Performance Task Guidance Document and FAQs

ELA Performance Task Guidance Document and FAQs Page 1 ELA Performance Task Guidance Document and FAQs 1. What is a performance task? Performance tasks (PT) are extended activities that measure a student s ability to integrate knowledge and skills across

More information

How to Use Fellowes Sit-Stand Solutions

How to Use Fellowes Sit-Stand Solutions How to Use Fellowes Sit-Stand Solutions Welcome to the sit-stand way of working We re delighted you ve chosen a Fellowes sit-stand solution to add movement to your working day. These guidelines will help

More information

Generalized Anxiety Disorder (GAD)

Generalized Anxiety Disorder (GAD) Do you worry all the time? A R E A L I L L N E S S Generalized Anxiety Disorder (GAD) GAD NIH Publication No. 00-4677 Does This Sound Like You? Do you worry all the time? Please put a check in the box

More information

Autism, my sibling, and me

Autism, my sibling, and me ORGANIZATION FOR AUTISM RESEARCH Autism, my sibling, and me Brothers and sisters come in all shapes and sizes. They have a lot in common, and they can be really different from each other. Some kids even

More information

OVERVIEW OF RESEARCH METHODS I. Lecturer: Dr. Paul Narh Doku Contact: Department of Psychology, University of Ghana

OVERVIEW OF RESEARCH METHODS I. Lecturer: Dr. Paul Narh Doku Contact: Department of Psychology, University of Ghana OVERVIEW OF RESEARCH METHODS I Lecturer: Dr. Paul Narh Doku Contact: pndoku@ug.edu.gh Department of Psychology, University of Ghana Session Overview This session seeks to introduce students to the purpose

More information

The Research Roadmap Checklist

The Research Roadmap Checklist 1/5 The Research Roadmap Checklist Version: December 1, 2007 All enquires to bwhitworth@acm.org This checklist is at http://brianwhitworth.com/researchchecklist.pdf The element details are explained at

More information

Internal Validity and Experimental Design

Internal Validity and Experimental Design Internal Validity and Experimental Design February 18 1 / 24 Outline 1. Share examples from TESS 2. Talk about how to write experimental designs 3. Internal validity Why randomization works Threats to

More information

The Practice of Statistics 1 Week 2: Relationships and Data Collection

The Practice of Statistics 1 Week 2: Relationships and Data Collection The Practice of Statistics 1 Week 2: Relationships and Data Collection Video 12: Data Collection - Experiments Experiments are the gold standard since they allow us to make causal conclusions. example,

More information

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section

Research Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Research Approach & Design Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Content: Introduction Definition of research design Process of designing & conducting

More information

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.

Experimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D. Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).

More information

Test Code: SCA/SCB (Short Answer type) Junior Research Fellowship in Psychology

Test Code: SCA/SCB (Short Answer type) Junior Research Fellowship in Psychology Test Code: SCA/SCB (Short Answer type) 2013 Junior Research Fellowship in Psychology The candidates for Junior Research Fellowship in Psychology are required to take short answer type tests Research methodology

More information

Topic #2. A key criterion in evaluating any test, measure, or piece of research is validity.

Topic #2. A key criterion in evaluating any test, measure, or piece of research is validity. ARTHUR SYC 302 (EXERIMENTAL SYCHOLOGY) 18C LECTURE NOTES [08/23/18] RESEARCH VALIDITY AGE 1 Topic #2 RESEARCH VALIDITY A key criterion in evaluating any test, measure, or piece of research is validity.

More information

Psychology 205, Revelle, Fall 2014 Research Methods in Psychology Mid-Term. Name:

Psychology 205, Revelle, Fall 2014 Research Methods in Psychology Mid-Term. Name: Name: 1. (2 points) What is the primary advantage of using the median instead of the mean as a measure of central tendency? It is less affected by outliers. 2. (2 points) Why is counterbalancing important

More information

TECH 646 Analysis of Research in Industry and Technology. Experiments

TECH 646 Analysis of Research in Industry and Technology. Experiments TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods

More information

Exam 3 PS 306, Spring 2005

Exam 3 PS 306, Spring 2005 Exam 3 PS 306, Spring 2005 1. In a classic study, Tulving and Gold (1963) studied word identification under conditions of amounts of relevant and irrelevant context. Let s conceive of their study as a

More information

2-Group Multivariate Research & Analyses

2-Group Multivariate Research & Analyses 2-Group Multivariate Research & Analyses Research Designs Research hypotheses Outcome & Research Hypotheses Outcomes & Truth Significance Tests & Effect Sizes Multivariate designs Increased effects Increased

More information

Lecturer: Dr. Emmanuel Adjei Department of Information Studies Contact Information:

Lecturer: Dr. Emmanuel Adjei Department of Information Studies Contact Information: Lecturer: Dr. Emmanuel Adjei Department of Information Studies Contact Information: eadjei@ug.edu.gh College of Education School of Continuing and Distance Education 2014/2015 2016/2017 Session Overview

More information

PSYC1024 Clinical Perspectives on Anxiety, Mood and Stress

PSYC1024 Clinical Perspectives on Anxiety, Mood and Stress PSYC1024 Clinical Perspectives on Anxiety, Mood and Stress LECTURE 1 WHAT IS SCIENCE? SCIENCE is a standardised approach of collecting and gathering information and answering simple and complex questions

More information

Managing conversations around mental health. Blue Light Programme mind.org.uk/bluelight

Managing conversations around mental health. Blue Light Programme mind.org.uk/bluelight Managing conversations around mental health Blue Light Programme 1 Managing conversations around mental health Managing conversations about mental wellbeing Find a quiet place with an informal atmosphere,

More information

With Marie-Claire Ross The SELLSAFE Communication Mentor

With Marie-Claire Ross The SELLSAFE Communication Mentor SELLSAFE Communication System with Marie-Claire Ross Module 2 Guidebook Attention With Marie-Claire Ross The SELLSAFE Communication Mentor 2014 Marie-Claire Ross & Digicast Productions. All rights reserved.

More information

Hypothesis-Driven Research

Hypothesis-Driven Research Hypothesis-Driven Research Research types Descriptive science: observe, describe and categorize the facts Discovery science: measure variables to decide general patterns based on inductive reasoning Hypothesis-driven

More information

Practice Test Questions

Practice Test Questions Practice Test Questions Multiple Choice 1. Which term is most descriptive of the process of sensation? a. transportation c. selection b. interpretation d. transduction 2. Which terms are most descriptive

More information

Experimental design (continued)

Experimental design (continued) Experimental design (continued) Spring 2017 Michelle Mazurek Some content adapted from Bilge Mutlu, Vibha Sazawal, Howard Seltman 1 Administrative No class Tuesday Homework 1 Plug for Tanu Mitra grad student

More information

Participatory Design

Participatory Design COMS W4170 UI Design and Evaluation 2 Steven Feiner Department of Computer Science Columbia University New York, NY 10027 September 27, 2018 1 Participatory Design Involve users in design process as fully

More information

Introduction to Research Methods

Introduction to Research Methods Introduction to Research Methods 8-10% of the AP Exam Psychology is an empirical discipline. Psychologists develop knowledge by doing research. Research provides guidance for psychologists who develop

More information

Does anxiety cause some difficulty for a young person you know well? What challenges does this cause for the young person in the family or school?

Does anxiety cause some difficulty for a young person you know well? What challenges does this cause for the young person in the family or school? John Walker, Ph.D. Department of Clinical Health Psychology University of Manitoba Everyone has the emotions at times. Signal us to be careful. Help us to stay safe. Most children and adults have mild

More information

Fundamentals of Psychophysics

Fundamentals of Psychophysics Fundamentals of Psychophysics John Greenwood Department of Experimental Psychology!! NEUR3045! Contact: john.greenwood@ucl.ac.uk 1 Visual neuroscience physiology stimulus How do we see the world? neuroimaging

More information

Cognitive Restructuring

Cognitive Restructuring Cognitive Restructuring Cognitive Restructuring Cognitive Restructuring is an evidence based intervention for the treatment of low mood or anxiety, recommended by the National Institute for Health and

More information

We ve seen that organisms have to work hard to maintain optimal conditions for their cells. But how exactly does that work?? What happens if something changes? http://galeri12.uludagsozluk.com/511/ekg_730911.jpg

More information

Dosimeter Setting Device

Dosimeter Setting Device Instruction Manual Dosimeter Setting Device For Electronic Personal Dosimeter Dose-i (Unit:Sv, Version:1.05 English) WTA529748 a 1 / 38 Foreword Thank you for purchasing the Dosimeter Setting Device; a

More information

FROM CARE TO INDEPENDENCE

FROM CARE TO INDEPENDENCE RESEARCH SUMMARY: FROM CARE TO INDEPENDENCE FINAL FINDINGS MAY 2017 This summary by the National Children s Bureau (NCB) presents key findings of the final phase of From Care to Independence (FC2I), a

More information

SOLVING THE MYSTERY OF JOURNAL ARTICLES: THE WORKSHEET*

SOLVING THE MYSTERY OF JOURNAL ARTICLES: THE WORKSHEET* SOLVING THE MYSTERY OF JOURNAL ARTICLES: THE WORKSHEET* To really understand how consumers behave, it s important to learn how to read and critique academic journal articles. This worksheet is a quick

More information

BIOLOGY. The range and suitability of the work submitted

BIOLOGY. The range and suitability of the work submitted Overall grade boundaries BIOLOGY Grade: E D C B A Mark range: 0-7 8-15 16-22 23-28 29-36 The range and suitability of the work submitted In this session essays were submitted in a wide range of appropriate

More information

ABSTINENCE. first edition

ABSTINENCE. first edition ABSTINENCE first edition Abstinence Session Objective Session Overview Key Message Expected Learning Outcomes Time To help participants understand that abstinence is a choice and should be made within

More information

Who? What? What do you want to know? What scope of the product will you evaluate?

Who? What? What do you want to know? What scope of the product will you evaluate? Usability Evaluation Why? Organizational perspective: To make a better product Is it usable and useful? Does it improve productivity? Reduce development and support costs Designer & developer perspective:

More information

The Impact of Physical Activity Motivators (PAMS) on the Physical Activity and Leisure Scheme (PALS) Kirklees MBC

The Impact of Physical Activity Motivators (PAMS) on the Physical Activity and Leisure Scheme (PALS) Kirklees MBC The Impact of Physical Activity Motivators (PAMS) on the Physical Activity and Leisure Scheme (PALS) Executive summary Kirklees MBC Aims and background information The PAM Scheme runs along side the PAL

More information

BRISTOL CHURCHES WINTER NIGHT SHELTER

BRISTOL CHURCHES WINTER NIGHT SHELTER BRISTOL CHURCHES WINTER NIGHT SHELTER Truly I tell you, whatever you did for one of the least of these brothers and sisters of mine, you did for me. Matthew 25:40 Photo: Adrian Sherratt Introduction The

More information