PA 552: Designing Applied Research. Bruce Perlman Planning and Designing Research

Transcription

1 PA 552: Designing Applied Research Bruce Perlman Planning and Designing Research

2 PA 552 DESIGNING RESEARCH

3 Research Approach Basic Plan Adopted for Conducting the Research Overall Framework of the Project Match Approach to Research Problem Fit Approach to Audience Relate the Approach to Researcher s Experience

4 Basic Research Approaches Choice of Appropriate Approach Depends on: Objectives of the Research How Much is Known about the Problem Three Traditional kinds of Research Design: 1. Exploratory 2. Descriptive 3. Causal/Hypothesis- Testing Includes Associational.

5 Three Types of Research Approaches Research Objective To gain background information, to define terms To clarify problems and hypotheses, to establish Research priorities. To describe and measure phenomena at a point in time To determine causality, to make if-then statements Appropriate Approach EXPLORATORY DESCRIPTIVE CAUSAL

6 Exploratory Research Objective: Emphasis on discovery of ideas & insights Characteristics: Sample Size is Small Data Requirements are Vague General Rather than Specific Objective Non- probability Sampling

7 Descriptive Approach Objective: Describing Characteristics of Individual or Group Characteristics: Data Collected Relates to Units of Analysis Research has Specific Objective Findings are Definite Likely to Use Random Sampling

8 Aims of Descriptive Approach Provides Answers to Questions Who What When Where How

9 Examples of Descriptive Research Study Measuring Various Attributes of Public Servants Study Measuring Various Attributes of Police Training Measuring How Users of Police Services Behave Tracking Changes in Police Call Volume Characteristics of People Calling Police Satisfaction Study with Police Services

10 Causal/Hypothesis Testing Approach Objective: Test Hypotheses of Causal Relationships Between Variables Characteristics: Data Collected Relates to Units of Analysis Research has Specific Objective Findings are Definite Control Influence of one Variable on Other Dependent Variable Likely to Use Random Sampling

11 Research on Relationships Among Variables Often Referred to as Associational Research Examples: Studying Relationship between achievement and attitude Studying Relationship between childhood experiences and adult characteristics Studying Relationship between teacher characteristics and student achievement Studying Relationship between methods of instruction & achievement comparing students who have been taught by each method Studying Relationship between gender and attitude comparing attitudes of males and females

12 Views on Research Design not a highly specific plan to be followed without deviation, but rather a series of guideposts to keep one headed in right direction Suchman the arrangement of conditions for collection & analysis of data in a manner that aims to combine relevance to the research purpose with economy in procedure Cook Specific Master Plan, Model, or Blueprint Collecting and Analyzing Data

13 Research Design Advance Decisions to Develop Master Plan Specifying Methods and Procedures Selecting Participants Preparing for Data Collection Preparing for Data Analysis Basic Research Designs Can be Matched to a Given Research Problem

14 Benefits of Research Design Smooth Sailing of Research Project Advance Planning of Methods Increased Reliability of Results Prevents Blind Searching Anticipates Problems in Collecting Data

15 Five Advanced Design Approaches Focused on Timing of Data Collection Focused on Specifying Units of Analysis Focused on Improving Validity of Results 1. Experimental 2. Cross-sectional 3. Longitudinal 4. Case Study 5. Comparative

16 Touchstone of Research Experiments Confidence in Robustness of Causal Findings Confidence in Trustworthiness of Causal Findings Yardstick Against which to Assess Non-experimental studies Strong Internal Validity Manipulate Independent Variable(s) (IV) Determine whether it Influences Dependent Variable (DV) One or More Experimental Groups Each Represents Different Types or Levels of IV Degree that Group Differences Account for variations in DV Majority of DVs Cannot be Manipulated, e.g., Gender, Social Class Laboratory experiments: Controlled Settings Field Experiments: Real-life, Natural Settings

17 Cross-sectional Designs Collection of Data on more than One Case A lot More than One Single Point in Time In Order to Collect a Body of Quantitative or Quantifiable Data In Connection with Two or more Variables Examined to Detect Patterns of Association Often called Survey Design Research that employs a cross-sectional Research Design Data are Collected by Questionnaire Data are Collected by Structured Interview

18 Longitudinal Designs Extension of Survey Research Usually Use Questionnaire or Structured Interview Sample is Surveyed at Least Two Different Times Allows Insight into Time Order of Variables Increases Ability to Draw Causal Inferences Two Types: Panel Study Cohort Study

19 Case Study Design Detailed and Intensive Analysis of a Single Case Focus on Complexity and Particular Nature of a Case, e.g. a single community a single school a single family a single organization a single event Emphasis on Intensive Examination of Setting. Studies where Case is the Focus of Interest in its Own Right Case (location, organization) is Not just the Backdrop to Findings Case is Unit of Analysis not the Sample Case is Object of Interest in its Own Right Research Aims to Provide an In-depth Elucidation of the Case Unless the Distinction is Drawn: Impossible to Distinguish Case study as Research Design Any Research can be Considered a Case Study Case Types The Critical Case The Extreme or Unique Case The Representative or Typical Case; Exemplifying Case The Revelatory Case The Longitudinal Case

20 Comparative Design Study at Least Two Contrasting Cases Using More or Less Identical Methods Understand Social Phenomenon Better Compare Across Two or More Contrasting Cases

21 PA 552 METHODS AND METHODOLOGY

22 Research Methodology An Account of Various Research Methods How to Use Them When to Use Them Specification of Research Techniques Employed Detailing of Procedures Employed in Research Step by Step Account of Application

23 Research Methods Specific Procedures Involved In: Data Collection Sampling Instruments Devices for Collecting Data Validity Data Analysis Techniques Tools Reporting

24 Approach vs. Method Research Approach Framework: For Collection and Analysis of Data Structure: To Guide Execution of Methods To Guide Analysis of Data Decisions : Priority of Research Process Dimensions Research Method Techniques: For Collection and Analysis of Data Process: Steps in Execution of Research Steps in Preparation of Findings e.g., Participant Observation e.g., Survey Specific Instruments: e.g., Self-completion Questionnaire e.g., Structured Interview Schedule

25 Examples of Research Methods 1. Surveying Describing characteristics of a group By means of such instruments and techniques as interview schedules, questionnaires, expert panels, focus groups 2. Secondary Data Analysis Searching for and interpreting existing data relevant to the research By use of techniques such as univariate, multivariate, content analysis 3. Observation Watching individuals or groups and recording behavior or conduct By means of instruments and techniques such as checklists, indexes, video cameras, participant observation, ethnography, content analysis