MBACATÓLICA JAN/APRIL Marketing Research. Fernando S. Machado. Experimentation
|
|
- Ada Patience Parker
- 5 years ago
- Views:
Transcription
1 MBACATÓLICA JAN/APRIL 2006 Marketing Research Fernando S. Machado Week 5 Experimentation 1 Experimentation Experimental Research and Causality Experimental Designs Lab versus Field Experiments Test Marketing 2 1
2 Experimental Research Experiment: Manipulation of a treatment (independent) variable (x), followed by observation of response (dependent) variable (y) Test units: individuals, organizations or other entities, whose response to treatments is being studied. Experiment must be designed to control for other (extraneous) variables to establish causal relationship 3 What Constitutes Causality? A change in variable will produce a change in another variable The occurrence of X increases the probability of the occurrence of Y Conditions for valid Causal Inference Condition of concomitant variation: evidence that a strong association exists between an action and an observed outcome Condition of time order of occurrence: evidence that the action preceded the outcome Absence of competing causal explanations: evidence that there is no strong competing explanation for the relationship that a high level of internal validity exists 4 2
3 A Classification of Experimental Designs Experimental Designs Pre-experimental True Experimental Quasi Experimental Statistical One Group After-Only Two Group After-Only Time Series Randomized Blocks One Group Before-After Two Group Before-After Multiple Time Series Latin Square Non-matched Control Group Solomon Four- Group Factorial Design 5 Basic Symbols and Notations O denotes a formal observation or measurement. X denotes exposure of test units participating in the study to the experimental manipulation of treatment. EG denotes an experimental group of test units that are exposed to the experimental treatment. CG denotes a control group of test units participating in the experiment but not exposed to the experimental treatment. R M denotes random assignment of test units and experimental treatments to groups. denotes that both the experimental group and the control group are matched on the basis of some relevant characteristics. 6 3
4 Pre-experimental experimental Designs One Group, After-only Design (One shot case study) Apply the experimental treatment to a subject or group and measure the results EG: X O Problems: Leaves open the possibility that the results could be explained by events external to the design (history effects) Maturation and selection effects may also be present It does not provide the basis of comparing the level of O to what would happen when X was absent. 7 Extraneous variables History specific events that are external to the experiment but occur at the same time as the experiment. Maturation extraneous variable attributable to changes in the test units themselves that occur with the passage of time. Mortality extraneous variable attributable to the loss of test units while the experiment is in progress. ME normally is not uniform across the sample. 8 4
5 Extraneous variables Main testing effect effect of testing that occurs when a prior observation affects a later observation. Interactive testing effect effect in which a prior measurement affects the test unit s response to the independent variable. Selection extraneous variable attributable to the improper assignement of test units to treatment conditions. Instrumentation extraneous variable involving changes in the measuring instrument or in the observers themselves. 9 Pre-experimental experimental Designs (Contd.) One-group, Before - After Design (One group pretest-posttest) Improve control by adding before measure EG: O 1 X O 2 Before measure adds sensitivity by adding another method to control for confounding variables Treatment effect is measured as TE=O 2 -O
6 Pre-experimental experimental Designs (Contd.) Threats to Experiment Validity: History, Maturation and Selection Effects Before Measure (Testing) Effect May alert respondents to the fact that they are being studied, causing: Main testing effect (O1 O2) Interactive testing effect (O1 X) Mortality Effect Some subjects may stop participating in the experiment Instrumentation Effect Results from a change in the measuring instrument 11 Pre-experimental experimental Designs (Contd.) Nonmatched Control Group Design (static group design) Introduce a control group to control for history and maturation EG: X O CG: O 2 History, maturation, testing (main and interactive) and instrumentation effects have been eliminated. Problems Potential selection bias remains (and possibly also mortality bias) 12 6
7 Pre-experimental experimental Designs (Contd.) Matched Control Group Design Matches experimental and control groups to reduce selection bias EG: M X O CG: M O 2 Problem Test units can be matched on only a few characteristics, so they may be similar on the variables selected but unequal on others. 13 True-experimental experimental Designs True experimental designs adopt random assignment procedure and use one or more control groups Random Assignment For any given assignment to a treatment, every member of the universe has an equal probability of being chosen for that assignment 14 7
8 True-experimental experimental Designs (Contd.) Two Group, After-only Design Randomization can match test and control groups on all dimensions simultaneously, given a sufficient sample size EG: R X O CG: R O 2 There is no interaction effect of testing as there are no pretest requirements. Problems Elimination of selection bias can not be tested for, as there is no pre-treatment measurement Potential mortality effects 15 True-experimental experimental Designs (Contd.) Two-group, Before-after Design Adds a control group to one-group, before - after design Helps control for history and maturation Controls for reactive effect of O 1 on O 2 (main test effect) EG: R O 1 X O CG: R O 3 O 4 Problems Does not control for interactive test effect, as prior measurement O 1 may affect the reaction of the EG to the treatment. Potential mortality effect remains 16 8
9 True-experimental experimental Designs (Contd.) Solomon Four - Group Design EG: R O 1 X O CG: R O 3 O 4 EG: R X O CG: R O 6 Provides power to control for before measure effect of O 1 on both X and O 2 This design is often prohibitively expensive 17 Quasi-experimental Designs Provide more measurements and more information than pre-experimental design Offer some degree of control but they are not true experimental designs due to: there is no random assignment of subjects (the researcher is unable to expose test units to the treatment randomly). the researcher may lack control over the schedule of the treatments. the researcher may lack control over when and whether the test units are exposed to the treatment. 18 9
10 Quasi-experimental Designs (Contd.) Time Series Designs Series of measurements are employed during which an experimental treatment occurs EG: O 1 O 2 O 3 O 4 X O 5 O 6 O 7 O 8 Trend Studies Measures over time come from succession of separate random samples from the same population Continuous Panel Studies Collect a series of measurements on the same sample of test units over an extended period of time 19 Classical Types of Experimental Designs Considers only one treatment level of an independent variable at a time Statistical Allows for examining the impact of different treatment levels of an independent variable (eg. Low, medium and high price levels). Allows for examining the impact of two or more independent variables (eg. price and advertising) Specific extraneous variables can be statistically controlled (for example by using ANCOVA) In general SD are after-only designs 20 10
11 Statistical Designs (contd) Completely Randomized Design Any number of treatments can be assigned to test units on a random basis Example: A cultural centre wants to test 3 different promotion pieces for a series of plays. The question is which will deliver the most orders. A mailing list with 20 thousand people is available. A random sample of is selected and divided randomly into three groups of 400. EG 1 R X 1 O EG 2 R X 2 O EG 3 R X 3 O 3 21 Randomized Block Design Employs the randomization process for all variables Matching ensures that there are no differences between test samples on matched variables Matching and randomization are combined Ex: Management believes that urban respondents react diferently from from suburban respondents to promotion for subscriptions to a series of plays. EG1: R X 1 O 1 Urban EG2: R X 2 O 2 EG3: R X 3 O 3 EG1: R X 1 O 1 Suburban EG2: R X 2 O 2 EG3: R X 3 O
12 % who ordered tickets Treatment Urban Suburb. Average A B C Averages Can we conclude that promotion C is more effective than promotion B (see hypothesis testing)? Is it possible that most effective promotion for urban area is different from most effective promotion for suburban areas (interactions)? 23 Statistical Designs (Contd.) Latin Square Design A project s research goal was to determine the effect of variations on nutritional information on canned peas labels on shopper perceptions and preferences. Four levels of information were tested: Simple quality statement (I). List of major nutrient components and indication of whether the product is high or low on them (II). List and exact amount of major nutrient component (III) List and exact amount of all nutrient components (IV). There are two control or block variables: the store and the brand. Four brands ofcanned peas (eachwitha associated price) and four different supermarkets were selected. A sample of 50 shoppers was interviewd in each supermarket
13 Statistical Designs (Contd.) Stores Private Brand A 21 cents III IV I II Private Brand B 22 cents II III IV I Major Brand A 25 cents I II III IV Major Brand B 26 cents IV I II III In a Randomized Block Design each cell would have 4 groups, one for each treatment level. Latin Square Design is more economical. 25 Results Average levels of preference levels are higher for treatment IV, but: The relationship between nutritional information and preference may not be statistically significant. This relationship is not monotonic. This design does not allow for analysis of interaction effects between treatment variable and control variables
14 Statistical Designs (Contd.) Latin Square Design Reduces number of groups involved when interaction between the treatment levels and control variables are unimportant Requires same number of rows, columns, and treatment levels Cannot be used to determine interaction effects 27 Factorial Designs Statistical Designs (Contd.) Two or more experimental variables are considered simultaneously Each combination of the experimental treatment levels applies to randomly selected groups EG 1 X 1 (A1, P1) O 1 EG 2 X 2 (A1, P2) O 2. EG n X n (Ap, Pm) O n (p*m=n) Provides the ability to determine interactive effects of pairs of experimental variables and the main effect 28 14
15 Further Issues in Experimental Research What are the internal and external threats to the validity of the experiment? Internal validity: The extent to which competing explanations for the experimental results observed can be ruled-out. External validity: The extent to which causal relationships measured in an experiment can be generalized to outside people, settings, and time. Should the experiment be performed in a "laboratory" setting or in the "field"? Lab Experiments Experimental treatment introduced in an artificial or laboratory setting Least costly and allow greater control over the experiment Alternative explanations of results are reduced, increasing internal validity Artificiality of the environment may cause reactive error Results may not have external validity Field Experiments Experimental treatment introduced in a natural setting (actual market conditions) Response tends to be natural Tend to have much greater external validity Difficult to control Competing explanations for results exist 30 15
16 Application of Causal Research: Test Marketing Test Marketing: An application of a controlled experiment done in limited, but carefully selected, parts of the marketplace, called test markets. In test marketing, the marketing mix variables (independent variables) are varied and the sales (dependent variable) are monitored so that an appropriate national marketing strategy can be identified. The two major objectives of test marketing are: To determine market acceptance of new products. To test alternative levels of marketing mix variables (retail prices, shelf space and display, etc.) 31 Simulated Test /Pretest Markets Use of survey data and mathematical models to simulate test market results ASSESSOR 1. Premeasurement for established brands (SAQ): composition of relevant set of established brands, attribute weights and ratings, preferences. 2. Respondents are exposed to advertisement of the new brand. 3. Respondents proceed to mock store setup. They are given a small amount of money and may purchase whatever brands they wish. 4. Respondents who bought the new product are called after 2-3 weeks and measured on postusage variables (new brand usage rate, satisfaction ratings and repeat purchase propensity; attribute ratings and preferences for relevant set of established brands plus new brand.) BASES 1. Shopping mall intercept interviews are done at 4 or more geographically dispersed cities (respondents not screened for category use) 2. Respondents are exposed to a concept and asked a standard set of questions, e.g. like/dislike, perceived value for money, purchase intention. 3. Those expressing a positive purchase intention are given some product to use at home. 4. After several weeks, users are called on the telephone to obtain after-use measures similar to before-use measures obtained in stage
17 Cost Involved Limitations of Experiments Time Considerations Security Field experiment exposes marketing program in the marketplace Difficult to hide from competitors Implementation Problems Difficult to gain cooperation within the organization Contamination may occur in experiments involving market areas due to inability to confine the treatment to designated experimental area 33 17
Chapter 7. Marketing Experimental Research. Business Research Methods Verónica Rosendo Ríos Enrique Pérez del Campo Marketing Research
Chapter 7 Marketing Experimental Research Business Research Methods Verónica Rosendo Ríos Enrique Pérez del Campo CHAPTER 7. MARKETING EXPERIMENTAL RESEARCH No great marketing decisions have ever been
More informationDEPENDENT VARIABLE. TEST UNITS - subjects or entities whose response to the experimental treatment are measured or observed. Dependent Variable
EXPERIMENT Experimental Research A RESEARCH INVESTIGATION IN WHICH CONDITIONS ARE CONTROLLED ONE INDEPENDENT VARIABLE IS MANIPULATED (SOMETIMES MORE THAN ONE) ITS EFFECT ON A DEPENDENT VARIABLE IS MEASURED
More informationExperimental Research. Types of Group Comparison Research. Types of Group Comparison Research. Stephen E. Brock, Ph.D.
Experimental Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Types of Group Comparison Research Review Causal-comparative AKA Ex Post Facto (Latin for after the fact).
More informationCausal Research Design- Experimentation
In a social science (such as marketing) it is very important to understand that effects (e.g., consumers responding favorably to a new buzz marketing campaign) are caused by multiple variables. The relationships
More informationMN 400: Research Methods. PART II The Design of Research
MN 400: Research Methods PART II The Design of Research 1 MN 400: Research Methods CHAPTER 6 Research Design 2 What is Research Design? A plan for selecting the sources and types of information used to
More informationEXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I
EXPERIMENTAL AND EX POST FACTO DESIGNS M O N A R A H I M I EXPERIMENTAL AND EX POST FACTO DESIGN To strongly identify cause-and-effect relationships Experimental Design EXPERIMENTAL AND EX POST FACTO DESIGN
More informationThe essential focus of an experiment is to show that variance can be produced in a DV by manipulation of an IV.
EXPERIMENTAL DESIGNS I: Between-Groups Designs There are many experimental designs. We begin this week with the most basic, where there is a single IV and where participants are divided into two or more
More informationCHAPTER 8 EXPERIMENTAL DESIGN
CHAPTER 8 1 EXPERIMENTAL DESIGN LEARNING OBJECTIVES 2 Define confounding variable, and describe how confounding variables are related to internal validity Describe the posttest-only design and the pretestposttest
More informationExperimental and Quasi-Experimental designs
External Validity Internal Validity NSG 687 Experimental and Quasi-Experimental designs True experimental designs are characterized by three "criteria for causality." These are: 1) The cause (independent
More informationEducational Research. S.Shafiee. Expert PDF Trial
Educational Research: Experimental Studies Educational Research S.Shafiee Research... The systematic application of a family of methods employed to provide trustworthy information about problems an ongoing
More information2013/4/28. Experimental Research
2013/4/28 Experimental Research Definitions According to Stone (Research methods in organizational behavior, 1978, pp 118), a laboratory experiment is a research method characterized by the following:
More informationEXPERIMENTAL RESEARCH DESIGNS
ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 14A LECTURE NOTES [02/28/14] EXPERIMENTAL RESEARCH DESIGNS PAGE 1 Topic #5 EXPERIMENTAL RESEARCH DESIGNS As a strict technical definition, an experiment is a study
More informationTECH 646 Analysis of Research in Industry and Technology. Experiments
TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods
More information26:010:557 / 26:620:557 Social Science Research Methods
26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview
More informationLecture 4: Research Approaches
Lecture 4: Research Approaches Lecture Objectives Theories in research Research design approaches ú Experimental vs. non-experimental ú Cross-sectional and longitudinal ú Descriptive approaches How to
More informationFormative and Impact Evaluation. Formative Evaluation. Impact Evaluation
Formative and Impact Evaluation Formative Evaluation 2 An evaluation designed to produce qualitative and quantitative data and insight during the early developmental phase of an intervention, including
More informationExperimental Research I. Quiz/Review 7/6/2011
Experimental Research I Day 3 Quiz/Review Quiz Review Normal Curve z scores & T scores More on the normal curve and variability... Theoretical perfect curve. Never happens in actual research Mean, median,
More informationStudy Design. Svetlana Yampolskaya, Ph.D. Summer 2013
Study Design Svetlana Yampolskaya, Ph.D. Summer 2013 Study Design Single point in time Cross-Sectional Research Multiple points in time Study only exists in this point in time Longitudinal Research Study
More informationQUASI EXPERIMENTAL DESIGN
UNIT 3 QUASI EXPERIMENTAL DESIGN Factorial Design Structure 3. Introduction 3.1 Objectives 3.2 Meaning of Quasi Experimental Design 3.3 Difference Between Quasi Experimental Design and True Experimental
More informationUNIT 7 EXPERIMENTAL RESEARCH-I1
UNIT 7 EXPERIMENTAL RESEARCH-I1 Structure 7.1 Introduction 7.2 Objectives 7.3 Types of Experimental Design 7.4 Pre-experimental Designs 7.4.1 One Shot Case Study Design 7.4.2 One Group Pre-test Post-test
More informationSTATISTICAL CONCLUSION VALIDITY
Validity 1 The attached checklist can help when one is evaluating the threats to validity of a study. VALIDITY CHECKLIST Recall that these types are only illustrative. There are many more. INTERNAL VALIDITY
More informationMeasures of Dispersion. Range. Variance. Standard deviation. Measures of Relationship. Range. Variance. Standard deviation.
Measures of Dispersion Range Variance Standard deviation Range The numerical difference between the highest and lowest scores in a distribution It describes the overall spread between the highest and lowest
More informationPYSC 224 Introduction to Experimental Psychology
PYSC 224 Introduction to Experimental Psychology Session 6 Quasi Experiments and Faulty Experimental Designs Part 1 & 2 Lecturer: Dr. Margaret Amankwah-Poku, Dept. of Psychology Contact Information: mamankwah-poku@ug.edu.gh
More informationExperimental Design and the struggle to control threats to validity
EXPERIMENTAL DESIGN Experimental Design and the struggle to control threats to validity INCREASINGLY CONSTRAINED LOW NATURALISTIC CASE-STUDY CORRELATIONAL DIFFERENTIAL EXPERIMENTAL HIGH Experimental design
More informationResearch Design. Beyond Randomized Control Trials. Jody Worley, Ph.D. College of Arts & Sciences Human Relations
Research Design Beyond Randomized Control Trials Jody Worley, Ph.D. College of Arts & Sciences Human Relations Introduction to the series Day 1: Nonrandomized Designs Day 2: Sampling Strategies Day 3:
More information10/23/2017. Often, we cannot manipulate a variable of interest
Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the
More information(CORRELATIONAL DESIGN AND COMPARATIVE DESIGN)
UNIT 4 OTHER DESIGNS (CORRELATIONAL DESIGN AND COMPARATIVE DESIGN) Quasi Experimental Design Structure 4.0 Introduction 4.1 Objectives 4.2 Definition of Correlational Research Design 4.3 Types of Correlational
More informationFCE 3900 EDUCATIONAL RESEARCH E X P E R I M E N T A L A N D Q U A S I E X P E R I M E N T A L R E S E A R C H
FCE 3900 EDUCATIONAL RESEARCH E X P E R I M E N T A L A N D Q U A S I E X P E R I M E N T A L R E S E A R C H 1 Research Design: Causal Research Causality may be thought of as understanding a phenomenon
More informationTECH 646 Analysis of Research in Industry and Technology. Experiments
TECH 646 Analysis of Research in Industry and Technology Experiments Lecture note based on the Ch. 9 of the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods
More informationRESEARCH METHODS. Winfred, research methods, ; rv ; rv
RESEARCH METHODS 1 Research Methods means of discovering truth 2 Research Methods means of discovering truth what is truth? 3 Research Methods means of discovering truth what is truth? Riveda Sandhyavandanam
More informationRESEARCH METHODS. Winfred, research methods,
RESEARCH METHODS Winfred, research methods, 04-23-10 1 Research Methods means of discovering truth Winfred, research methods, 04-23-10 2 Research Methods means of discovering truth what is truth? Winfred,
More informationChapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.
Chapter 9 Experimental Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we talk about what experiments are, we
More informationIn this chapter we discuss validity issues for quantitative research and for qualitative research.
Chapter 8 Validity of Research Results (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) In this chapter we discuss validity issues for
More informationHPS301 Exam Notes- Contents
HPS301 Exam Notes- Contents Week 1 Research Design: What characterises different approaches 1 Experimental Design 1 Key Features 1 Criteria for establishing causality 2 Validity Internal Validity 2 Threats
More informationLecture 3. Previous lecture. Learning outcomes of lecture 3. Today. Trustworthiness in Fixed Design Research. Class question - Causality
Lecture 3 Empirical Research Methods IN4304 design (fixed design) Previous lecture A research plan Consider: purpose, theory, research question, mode inquiry, sampling method Research question Descriptive/
More informationTopic #6. Quasi-experimental designs are research studies in which participants are selected for different conditions from pre-existing groups.
ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 17A LECTURE NOTES [03/08/17] QUASI-EXPERIMENTAL DESIGNS PAGE 1 Topic #6 QUASI-EXPERIMENTAL DESIGNS Again, central issue is one of research validity. Quasi-experimental
More informationPLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity
PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with
More informationCHAPTER LEARNING OUTCOMES
EXPERIIMENTAL METHODOLOGY CHAPTER LEARNING OUTCOMES When you have completed reading this article you will be able to: Define what is an experiment Explain the role of theory in educational research Justify
More information11/2/2017. Often, we cannot manipulate a variable of interest
Often, we cannot manipulate a variable of interest Quasi-independent variables: Participant variable = individual characteristic used to select participants to groups Natural treatment = exposure in the
More informationDefine the population Determine appropriate sample size Choose a sampling design Choose an appropriate research design
Numbers! Observation Study: observing individuals and measuring variables of interest without attempting to influence the responses Correlational Research: examining the relationship between two variables
More informationVALIDITY OF QUANTITATIVE RESEARCH
Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees
More informationThe Basics of Experimental Design [A Quick and Non-Technical Guide]
The Basics of Experimental Design [A Quick and Non-Technical Guide] Sid Sytsma Website Administrator's Note: I have always considered Sid Sytsma's short article on experimental design one of the best short
More information9.0 L '- ---'- ---'- --' X
352 C hap te r Ten 11.0 10.5 Y 10.0 9.5 9.0 L...- ----'- ---'- ---'- --' 0.0 0.5 1.0 X 1.5 2.0 FIGURE 10.23 Interpreting r = 0 for curvilinear data. Establishing causation requires solid scientific understanding.
More informationSawtooth Software. The Number of Levels Effect in Conjoint: Where Does It Come From and Can It Be Eliminated? RESEARCH PAPER SERIES
Sawtooth Software RESEARCH PAPER SERIES The Number of Levels Effect in Conjoint: Where Does It Come From and Can It Be Eliminated? Dick Wittink, Yale University Joel Huber, Duke University Peter Zandan,
More informationTECH 646 Analysis of Research in Industry and Technology
TECH 646 Analysis of Research in Industry and Technology Ch 6. Research Design: An Overview Based on the text book and supplemental materials from the text book: Cooper, D.R., & Schindler, P.S., Business
More informationUnit 3: Collecting Data. Observational Study Experimental Study Sampling Bias Types of Sampling
Unit 3: Collecting Data Observational Study Experimental Study Sampling Bias Types of Sampling Feb 7 10:12 AM The step of data collection is critical to obtain reliable information for your study. 2 Types
More informationExperimental Design. Dewayne E Perry ENS C Empirical Studies in Software Engineering Lecture 8
Experimental Design Dewayne E Perry ENS 623 Perry@ece.utexas.edu 1 Problems in Experimental Design 2 True Experimental Design Goal: uncover causal mechanisms Primary characteristic: random assignment to
More informationUNIT III: Research Design. In designing a needs assessment the first thing to consider is level for the assessment
UNIT III: Research Design SWK 330 Kimberly Baker-Abrams What is a needs assessment? Why is it helpful? an assessment to determine the existence of services, client population, client access to services,
More informationWhat We Will Cover in This Section
Pre and Quasi-Experimental Design 9/2/2006 P767Intro.ppt 1 What We Will Cover in This Section What are they? Threats to internal validity. Pre-Experimental Designs Quasi- Experimental Designs. Summary
More informationCASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH
CASE STUDY 2: VOCATIONAL TRAINING FOR DISADVANTAGED YOUTH Why Randomize? This case study is based on Training Disadvantaged Youth in Latin America: Evidence from a Randomized Trial by Orazio Attanasio,
More informationTypes of Group Comparison Research. Stephen E. Brock, Ph.D., NCSP EDS 250. Causal-Comparative Research 1
Causal-Comparative Research & Single Subject Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Correlation vs. Group Comparison Correlational Group Comparison 1 group 2 or
More informationHomework Answers. 1.3 Data Collection and Experimental Design
Homework Answers 2. Ordinal, Interval, Ratio 4. False. You can calculate meaningful differences. 6. False. Data at the ratio level can be put in order. Sep 7 1:51 PM 1.3 Data Collection and Experimental
More informationResearch Design & Protocol Development
Research Design & Protocol Development Paul J Kim, DPM, MS, FACFAS Associate Professor Director of Research Definitions Randomization Sampling Allocation Variables Independent Variable Treatment, intervention,
More informationThe following are questions that students had difficulty with on the first three exams.
The following are questions that students had difficulty with on the first three exams. Exam 1 1. A measure has construct validity if it: a) really measures what it is supposed to measure b) appears, on
More informationGlossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha
Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha attrition: When data are missing because we are unable to measure the outcomes of some of the
More informationLecturer: Dr. Emmanuel Adjei Department of Information Studies Contact Information:
Lecturer: Dr. Emmanuel Adjei Department of Information Studies Contact Information: eadjei@ug.edu.gh College of Education School of Continuing and Distance Education 2014/2015 2016/2017 Session Overview
More informationThe Regression-Discontinuity Design
Page 1 of 10 Home» Design» Quasi-Experimental Design» The Regression-Discontinuity Design The regression-discontinuity design. What a terrible name! In everyday language both parts of the term have connotations
More informationExperimental Design (7)
Experimental Design (7) Kerry Kilborn Department of Psychology Overview Confounding variables Experiment vs. Correlational Study Between-Subjects Design Equivalent Groups Quasi-Experiments Summary Experimental
More informationChapter 9: Experiments
Chapter 9: Experiments WHAT IS EXPERIMENTATION? Experiments are studies involving intervention by the researcher beyond that required for measurement. The usual intervention is to manipulate some variable
More informationExperimental Design Part II
Experimental Design Part II Keith Smolkowski April 30, 2008 Where Are We Now? esearch eview esearch Design: The Plan Internal Validity Statements of Causality External Validity Statements of Generalizability
More informationLAB 4 Experimental Design
LAB 4 Experimental Design Generally speaking, the research design that is used and the properties of the variables combine to determine what statistical tests we use to analyze the data and draw our conclusions.
More informationResearch Approach & Design. Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section
Research Approach & Design Awatif Alam MBBS, Msc (Toronto),ABCM Professor Community Medicine Vice Provost Girls Section Content: Introduction Definition of research design Process of designing & conducting
More informationinvestigate. educate. inform.
investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced
More informationGeorgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera
Homework assignment topics 37-42 Georgina Salas Topics 37-42 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 37 1. What is the purpose of an experiment? The purpose of an experiment is to explore
More informationThreats to Validity in Experiments. The John Henry Effect
Threats to Validity in Experiments Office Hours: M 11:30-12:30, W 10:30-12:30 SSB 447 The John Henry Effect Housekeeping Homework 3, due Tuesday A great paper, but far from an experiment Midterm review
More informationExperiments. ESP178 Research Methods Dillon Fitch 1/26/16. Adapted from lecture by Professor Susan Handy
Experiments ESP178 Research Methods Dillon Fitch 1/26/16 Adapted from lecture by Professor Susan Handy Recap Causal Validity Criterion Association Non-spurious Time order Causal Mechanism Context Explanation
More informationChapter 1. Understanding Social Behavior
Chapter 1 Understanding Social Behavior Social psychology is the scientific study of how individuals think and feel about, interact with, and influence each other individually and in groups. Model for
More informationHandout 1: Introduction to the Research Process and Study Design STAT 335 Fall 2016
DESIGNING OBSERVATIONAL STUDIES As we have discussed, for the purpose of establishing cause-and-effect relationships, observational studies have a distinct disadvantage in comparison to randomized comparative
More informationConsumer Motivation. Week 4
Consumer Motivation Week 4 1 Learning Objectives 1. Understand the motivation process and the dynamics of motivation. 2. Learn the types of needs and the Maslow s hierarchy of needs. 3. Understand selection
More informationPSY 250. Designs 8/11/2015. Nonexperimental vs. Quasi- Experimental Strategies. Nonequivalent Between Group Designs
Nonexperimental vs. Quasi- Experimental Strategies PSY 250 Quasi and Non-experimental designs Chapter 10 Resemble experiments but contain some threat such as a confounding variable that can not be completely
More informationUnderstanding Consumers Processing of Online Review Information
Understanding Consumers Processing of Online Review Information Matthew McNeill mmcneil@clemson.edu Nomula Siddarth-Reddy snomula@clemson.edu Dr. Tom T. Baker Clemson University School of Marketing 234
More informationThinking Like a Researcher
3-1 Thinking Like a Researcher 3-3 Learning Objectives Understand... The terminology used by professional researchers employing scientific thinking. What you need to formulate a solid research hypothesis.
More informationEXPERIMENTS IN RESEARCH
EXPERIMENTS IN RESEARCH PRESENTED BY ANNAPOORNA SHANKAR NITHYA RACHEL PREETHI CUNHA What is an experiment? Taking action and observing consequences of that action EXPERIMENTS - Controlled observation possible
More informationLevels of Evaluation. Question. Example of Method Does the program. Focus groups with make sense? target population. implemented as intended?
Program Evaluation Jonathan Howland, PhD, MPH 1 Formative Process Level Outcome Levels of Evaluation Question Example of Method Does the program Focus groups with make sense? target population. Was the
More informationPriming Effects by Visual Image Information in On-Line Shopping Malls
Priming Effects by Visual Image Information in On-Line Shopping Malls Eun-young Kim*, Si-cheon You**, Jin-ryeol Lee*** *Chosun University Division of Design 375 Seosukdong Dong-gu Gwangju Korea, key1018@hanmail.net
More informationArtificial Intelligence
Artificial Intelligence Intelligent Agents Chapter 2 & 27 What is an Agent? An intelligent agent perceives its environment with sensors and acts upon that environment through actuators 2 Examples of Agents
More informationVersion No. 7 Date: July Please send comments or suggestions on this glossary to
Impact Evaluation Glossary Version No. 7 Date: July 2012 Please send comments or suggestions on this glossary to 3ie@3ieimpact.org. Recommended citation: 3ie (2012) 3ie impact evaluation glossary. International
More informationSection 6.1 Sampling. Population each element (or person) from the set of observations that can be made (entire group)
Section 6.1 Sampling Population each element (or person) from the set of observations that can be made (entire group) Sample a subset of the population Census systematically getting information about an
More informationWrite your identification number on each paper and cover sheet (the number stated in the upper right hand corner on your exam cover).
STOCKHOLM UNIVERSITY Department of Economics Course name: Empirical methods 2 Course code: EC2402 Examiner: Per Pettersson-Lidbom Number of credits: 7,5 credits Date of exam: Sunday 21 February 2010 Examination
More informationThe validity of inferences about the correlation (covariation) between treatment and outcome.
Threats Summary (MGS 9940, Fall, 2004-Courtesy of Amit Mehta) Statistical Conclusion Validity The validity of inferences about the correlation (covariation) between treatment and outcome. Threats to Statistical
More informationChapter 8 Experimental Design
Chapter 8 Experimental Design Causality Review Remember from Chapter 4 that in order to make a causal inference, you need to satisfy three requirements: 1. Covariation 2. Temporal order 3. Eliminate alternative
More informationDoctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, The Scientific Method of Problem Solving
Doctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, 2018 The Scientific Method of Problem Solving The conceptual phase Reviewing the literature, stating the problem,
More informationCan Quasi Experiments Yield Causal Inferences? Sample. Intervention 2/20/2012. Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University
Can Quasi Experiments Yield Causal Inferences? Matthew L. Maciejewski, PhD Durham VA HSR&D and Duke University Sample Study 1 Study 2 Year Age Race SES Health status Intervention Study 1 Study 2 Intervention
More informationChapter 3. Producing Data
Chapter 3. Producing Data Introduction Mostly data are collected for a specific purpose of answering certain questions. For example, Is smoking related to lung cancer? Is use of hand-held cell phones associated
More informationWhat We Will Cover in This Section
Pre and Quasi-Experimental 1 What We Will Cover in This Section Pre-Experimental Quasi- Experimental. Summary 2 Internal Validity Revisited 3 Common Threats to Internal Validity 1. History. 2. Maturation.
More informationEvaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank)
Evaluating Social Programs Course: Evaluation Glossary (Sources: 3ie and The World Bank) Attribution The extent to which the observed change in outcome is the result of the intervention, having allowed
More informationOne slide on research question Literature review: structured; holes you will fill in Your research design
Topics Ahead Week 10-11: Experimental design; Running experiment Week 12: Survey Design; ANOVA Week 13: Correlation and Regression; Non Parametric Statistics Week 14: Computational Methods; Simulation;
More informationDesign of Experiments & Introduction to Research
Design of Experiments & Introduction to Research 1 Design of Experiments Introduction to Research Definition and Purpose Scientific Method Research Project Paradigm Structure of a Research Project Types
More informationLecture (chapter 1): Introduction
Lecture (chapter 1): Introduction Ernesto F. L. Amaral January 17, 2018 Advanced Methods of Social Research (SOCI 420) Source: Healey, Joseph F. 2015. Statistics: A Tool for Social Research. Stamford:
More informationSingle-Factor Experimental Designs. Chapter 8
Single-Factor Experimental Designs Chapter 8 Experimental Control manipulation of one or more IVs measured DV(s) everything else held constant Causality and Confounds What are the three criteria that must
More informationNon experimental. Cross sectional studies Panel (somewhat rare) Longitudinal (pooled time series) Case (s) study
RESEARCH DESIGN TOPICS Non experimental research design Experimental vs. quasi-experimental (natural) research designs Research designs with limited power to assess cause and effect Research design with
More informationResearch Designs. Inferential Statistics. Two Samples from Two Distinct Populations. Sampling Error (Figure 11.2) Sampling Error
Research Designs Inferential Statistics Note: Bring Green Folder of Readings Chapter Eleven What are Inferential Statistics? Refer to certain procedures that allow researchers to make inferences about
More informationE-cigarette reforms. Supplement to the Tobacco retailer guide about reforms commencing 1 August 2017
E-cigarette reforms Supplement to the Tobacco retailer guide about reforms commencing 1 August 2017 E-cigarette reforms: supplement to the Tobacco retailer guide Page 1 E-cigarette reforms Supplement
More informationOVERVIEW OF RESEARCH METHODS II. Lecturer: Dr. Paul Narh Doku Contact: Department of Psychology, University of Ghana
OVERVIEW OF RESEARCH METHODS II Lecturer: Dr. Paul Narh Doku Contact: pndoku@ug.edu.gh Department of Psychology, University of Ghana Session Overview This session will present an overview of several non-experimental
More informationTopic #4 CONTROL. 1. What are the threats to the validity of a contemplated piece of research?
ARTHUR PSYC 204 (EXPERIMENTAL PSYCHOLOGY) 15A LECTURE NOTES [02/22/15] CONTROL PAGE 1 Topic #4 CONTROL Central issue is, of course, one of research validity. Key questions in research: 1. What are the
More informationAP Psychology -- Chapter 02 Review Research Methods in Psychology
AP Psychology -- Chapter 02 Review Research Methods in Psychology 1. In the opening vignette, to what was Alicia's condition linked? The death of her parents and only brother 2. What did Pennebaker s study
More informationHigher Psychology RESEARCH REVISION
Higher Psychology RESEARCH REVISION 1 The biggest change from the old Higher course (up to 2014) is the possibility of an analysis and evaluation question (8-10) marks asking you to comment on aspects
More informationEvaluation Models STUDIES OF DIAGNOSTIC EFFICIENCY
2. Evaluation Model 2 Evaluation Models To understand the strengths and weaknesses of evaluation, one must keep in mind its fundamental purpose: to inform those who make decisions. The inferences drawn
More informationTopic #4 CONTROL. 1. What are the threats to the validity of a contemplated piece of research?
ARTHUR PSYC 302 (EXPERIMENTAL PSYCHOLOGY) 18C LECTURE NOTES [10/03/18] CONTROL PAGE 1 Topic #4 CONTROL Central issue is, of course, one of research validity. Key questions in research: 1. What are the
More information