Theory Building and Hypothesis Testing. POLI 205 Doing Research in Politics. Theory. Building. Hypotheses. Testing. Fall 2015

Similar documents
Group Assignment #1: Concept Explication. For each concept, ask and answer the questions before your literature search.

Quantitative Analysis and Empirical Methods

Introduction to the Scientific Method. Knowledge and Methods. Methods for gathering knowledge. method of obstinacy

III. WHAT ANSWERS DO YOU EXPECT?

Conducting Research in the Social Sciences. Rick Balkin, Ph.D., LPC-S, NCC

Critical Thinking and Reading Lecture 15

Political Science 15, Winter 2014 Final Review

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research

Audio: In this lecture we are going to address psychology as a science. Slide #2

What Causes war? C h. 1 : T e r m i n o l o g y & Methodology. Notes by Denis Bašić

University of Oxford Intermediate Social Statistics: Lecture One

Nature of Science and Scientific Method Guided Notes

Hypothesis-Driven Research

What is the Scientific Method?

Quantitative research Methods. Tiny Jaarsma

Political Science 30: Political Inquiry Section 1

POLI 343 Introduction to Political Research

9/5/ Research Hazards Awareness Training

MBA SEMESTER III. MB0050 Research Methodology- 4 Credits. (Book ID: B1206 ) Assignment Set- 1 (60 Marks)

How was your experience working in a group on the Literature Review?

A to Z OF RESEARCH METHODS AND TERMS APPLICABLE WITHIN SOCIAL SCIENCE RESEARCH

CHAPTER 2 APPLYING SCIENTIFIC THINKING TO MANAGEMENT PROBLEMS

HOW TO IDENTIFY A RESEARCH QUESTION? How to Extract a Question from a Topic that Interests You?

Quantitative research Methods. Tiny Jaarsma

Constructing a Bivariate Table:

Chapter 1 Introduction to Educational Research

UNDERSTANDING THEORETICAL & CONCEPTUAL FRAMEWORKS

Introduction to Agent-Based Modeling

Science, Society, and Social Research (1) Benjamin Graham

Practical Research: Planning and Design, Ninth Edition

Lab 2: The Scientific Method. Summary

(CORRELATIONAL DESIGN AND COMPARATIVE DESIGN)

FORMULATION OF HYPOTHESIS N S VISWANATH

Constructing a Bivariate Table: Introduction. Chapter 10: Relationships Between Two Variables. Constructing a Bivariate Table. Column Percentages

LEARNING. Learning. Type of Learning Experiences Related Factors

Introduction to Research Methods

Theory, Models, Variables

Definition of Scientific Research RESEARCH METHODOLOGY CHAPTER 2 SCIENTIFIC INVESTIGATION. The Hallmarks of Scientific Research

DEVELOPING THE RESEARCH FRAMEWORK Dr. Noly M. Mascariñas

Cognitive domain: Comprehension Answer location: Elements of Empiricism Question type: MC

Daniel Little University of Michigan-Dearborn www-personal.umd.umich.edu/~delittle/

Thinking Like a Researcher

The Scientific Method

Choosing and Using Quantitative Research Methods and Tools

Lecture 4: Research Approaches

The Good, the Bad and the Blameworthy: Understanding the Role of Evaluative Reasoning in Folk Psychology. Princeton University

What is Science 2009 What is science?

Formulation of Research Design

CHAPTER 2. MEASURING AND DESCRIBING VARIABLES

Econ 270: Theoretical Modeling 1

DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Research Methods Posc 302 ANALYSIS OF SURVEY DATA

Disposition. Quantitative Research Methods. Science what it is. Basic assumptions of science. Inductive and deductive logic

Survival Skills for Researchers. Study Design

MS&E 226: Small Data

UNIT II: RESEARCH METHODS

Chapter 1.1. The Process of Science. Essential Questions

Section 2: Data & Measurement

Economics 2010a. Fall Lecture 11. Edward L. Glaeser

Lecture 2: Basic Principles, Theory, Methods. Part I: Basic Principles Part II: Theories Part III: Methods

[a] relationship between two variables in which a change or variation in one variables produces a change or variation in a second variable.

[POLS 4150] R, Randomization and Sampling

Title: Ch01-02;FI; pg research is research that has a fairly direct, immediate application to a real-world situation. a.

Chapter 02 Developing and Evaluating Theories of Behavior

Lecture (chapter 1): Introduction

Research and science: Qualitative methods

COURSE: NURSING RESEARCH CHAPTER I: INTRODUCTION

6. A theory that has been substantially verified is sometimes called a a. law. b. model.

Chapter Three: Hypothesis

PSYCHOLOGY AND THE SCIENTIFIC METHOD

Process of Designing & Implementing a Research Project

Lecture 5: Scientific Method, Wicked Problems. Joey Huddleston (for Benjamin Graham)

Chapter 1: Explaining Behavior

COMP 516 Research Methods in Computer Science. COMP 516 Research Methods in Computer Science. Research Process Models: Sequential (1)

KOM 5113: Communication Research Methods (First Face-2-Face Meeting)

Technical Specifications

CHAPTER 1 Understanding Social Behavior

Our goal in this section is to explain a few more concepts about experiments. Don t be concerned with the details.

Key Ideas. Explain how science is different from other forms of human endeavor. Identify the steps that make up scientific methods.

Research Prospectus. Your major writing assignment for the quarter is to prepare a twelve-page research prospectus.

1. Fun. 2. Commitment

The Role and Importance of Research

METHODOLOGY FOR DISSERTATION

Diversity of Preferences

The Psychology of Inductive Inference

Psychology Research Process

Philosophy of Physical Activity

5. is the process of moving from the specific to the general. a. Deduction

ch1 1. What is the relationship between theory and each of the following terms: (a) philosophy, (b) speculation, (c) hypothesis, and (d) taxonomy?

Modeling and Environmental Science: In Conclusion

What Constitutes a Good Contribution to the Literature (Body of Knowledge)?

The Regression-Discontinuity Design

Introduction to Behavioral Economics Like the subject matter of behavioral economics, this course is divided into two parts:

Sleeping Beauty is told the following:

Critical Thinking: Science, Models, & Systems

So You Want to do a Survey?

August 29, Introduction and Overview

Transcription:

and and Fall 2015

and The Road to Scientific Knowledge

and Make your Theories Causal Think in terms of causality X causes Y Basis of causality Rules of the Road Time Ordering: The cause precedes the effect Co-Variation: Changes in X are associated with changes in Y Non-Spuriousness: There is not a variable Z that causes both X and Y

and Rules of the Road Don t let data alone drive your theories Correlation does not equal causation is prior to analysis Examples Ice cream sales and crime Fire trucks and fire deaths tylervigen.com

and Rules of the Road Consider only empirical evidence and avoid normative statements Anecdotes are not evidence Formal theories need empirical testing Normative statements are not evidence

and Rules of the Road Pursue both generality and parsimony Generalizable (External Validity) Knowledge can be applied to many cases or events (present and future) not explicitly covered by the study Research applicable to many cases is often considered better than research applicable to one or a few cases

and Rules of the Road Pursue both generality and parsimony Parsimony Parsimony literally means to spare. Generally, the simplest causal statement is considered the best all else equal The key is all else equal. A complex theory that better explains/predicts phenomena than a simple theory is still usually best.

and Theories and Functions When we say X causes Y we mean Y is a function of X Linear function y = f (x) = 5 + x Examples Opinion on climate change = f(ideology) Employment = f(education) Grade = f(studying)

and Good Theories A good theory is one that changes the way that we think about some aspect of the political world No easy or single answer on how to do this, but there are a set of strategies Interesting research questions Identifying interesting variation Learning to use your knowledge Examine previous research Think formally

and Good Theories Interesting research questions Two criteria for identifying a worthy research question It should be relevant for the real world That is, important for social, political and economic life The answer to the question should improve our understanding of the topic Academic knowledge

and Interesting research questions Good Theories Figure: Table 2.1 from Kellstedt and Whitten pg. 26

and Identifying interesting variation Good Theories Because theories are designed to explain variation in the dependent variable, identifying some variation that is of interest to you is a good jumping off point When we think about measuring our dependent variable, the first things that we need to identify are the time and spatial dimensions over which we would like to measure this variable The time dimension identifies the point or points in time at which we would like to measure our variable The spatial dimension identifies the physical units that we want to measure

Figure: Time-Series: Presidential Approval, 1995-2005 and Time-Series

Figure: Cross-Sectional: Military Spending in 2005 and Cross-Sectional

and Good Theories Learning to use your knowledge It is helpful to know some specifics about politics, but it is also important to be able to distance yourself from the specifics of one case and to think more broadly about the underlying causal process. Moving from a specific event to more general theories Know local, think global: can you drop the proper nouns?

and Good Theories Examine Previous Research As you examine previous research, keep the following list of questions in mind: What (if any) other causes of the dependent variable did the previous researchers miss? Can their theory be applied elsewhere? If we believe their findings, are there further implications? How might this theory work at different levels of aggregation (micro vs. macro)?

and Formal theory A deductive approach Good Theories This approach to social science phenomena starts out with a fairly basic set of assumptions about human behavior and then uses game theory and other mathematical tools to build models of phenomena of interest We can summarize these assumptions about human behavior by saying that formal theorists assume that all individuals are rational utility maximizers that they attempt to maximize their self-interest

and Formal Example: Why do people vote? R i = (B i P i ) C i R: is the reward someone receives from voting B: benefit received if preferred candidate wins P: probability that voter will cast deciding vote C: is the sum of the costs incurred from voting

and Formal Example: Why do people vote? R i = (B i P i ) C i + D i R: is the reward someone receives from voting B: benefit received if preferred candidate wins P: probability that voter will cast deciding vote C: is the sum of the costs incurred from voting D: is the satisfaction from participating in the democratic process

and Do I have a good theory? Does your theory offer an answer to an interesting research question? Is your theory causal? Can you test your theory on data that you have not yet observed? How general is your theory? How parsimonious is your theory? How new is your theory? How non-obvious is your theory?

and Causal and : A tentative conjecture about the causes of some phenomenon of interest Theories Generate Testable : A theory-based statement about a relationship that we expect to observe Null hypothesis: No relationship between variables Working hypothesis Many hypotheses (if confirmed) make up a theory

and Formulating Developing good hypotheses is a mix of intuition, imagination, inductive reasoning and careful consideration of existing research Characteristics of a good hypotheses Empirical statement Generality Plausibility Specificity Corresponds to the measurement of variables Testability

and Formulating Empirical statement Educated guesses about relationships that exist in the real world Proposes an explanation for a phenomenon that can be observed empirically

and Formulating Generality Explains a general phenomenon rather than one particular occurrence Joe is a liberal because his mother is one, too vs. People tend to adopt political viewpoints similar to those of their parents

and Formulating Plausibility There should be some logical reason for thinking that it might be confirmed Literature reviews help to formulate plausible hypotheses

and Formulating Specificity Should be specific and state the direction of the relationship between the variables Positive relationship: increase in size together or decrease in size together; move in the same direction Negative relationship: one concept increases (or decreases) in size the other decreases (or increases); move in the opposite direction

and Formulating Corresponds to the measurement of variables Stated in a way that is consistent with the data If you posit a changing relationship over time, you should have time-series data. If you posit a relationship across different units, you should have cross-sectional data

and Formulating Testability It must be possible and feasible to obtain data that will indicate whether the hypothesis can be confirmed Can the concepts be measured? The concepts should be distinct