TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement,, Questionnaires & Instruments, Sampling Ch. 12 Lecture note based on the text book and supplemental materials: Cooper, D.R., & Schindler, P.S., Business Research Methods (12th edition), McGraw-Hill/Irwin Paul I-Hai Lin, Professor http://www.ipfw.edu/~lin A Core Course for M.S. Technology Graduate Program Purdue University Fort Wayne 1 Measurement Learning Objectives Understand The nature of attitudes and their relationship to behavior. The critical decisions involved in selecting an appropriate measurement scale. The characteristics and use of rating, ranking, sorting, and other preference scales. 2 1
The Scaling Process 3 Nature of Attitudes Cognitive I think oatmeal is healthier than corn flakes for breakfast. Affective I hate corn flakes. Behavioral I intend to eat more oatmeal for breakfast. 4 2
Nature of Attitudes Attitude An attitude is a learned, stable predisposition to respond to oneself, other persons, objects, or issues in a consistently favorable or unfavorable way. 1. She is convinced Cognitive-based attitude: memories, evaluation, and beliefs about properties of the object A Belief - an estimate (probability) about the truth of something 2. She loves working at Affective based attitude: feeling, intuition, value, and emotion towards 3. She expects to stay Behavioral or Conative-based attitudes 5 Improving Predictability Specific Multiple measures Reference groups Factors Strong Direct Basis: Cognitive, Affective 6 3
Selecting a Measurement Scale Research objectives Response types Data properties Balanced or unbalanced Number of scale points Number of dimensions Forced or unforced choices Rater errors 7 Response Types Rating scale: Score, without making a direct comparison Ranking scale: Make comparison and determine order among two or more properties Categorization: Place into groups or categories Sorting: Sort using established criteria 8 4
Number of Dimensions Unidimensional: One attribute Multi-dimensional: Combined multiple attributes into one measure 9 Balanced or Unbalanced Scales Balanced Scale - has an equal number of categories Above and Below the Midpoint Very bad Bad Neither good nor bad Good Very good Unbalanced Scale - has an unequal number of favorable and unfavorable response choices Poor Fair Good Very good Excellent 10 5
Forced or Unforced Choices Unforced provides No Opinion choice Forces requires a choice Very bad Bad Neither good nor bad Good Very good Very bad Bad Neither good nor bad Good Very good No opinion Don t know 11 Number of Scale Points 3-point scale Better than average Average Worse than average 5, 7,11 point scales Very bad Bad Neither good nor bad Good Very good Very bad Somewhat bad A little bad Neither good nor bad A little good Somewhat good Very good 12 6
Rate Errors Adjust strength of descriptive adjectives Error of central tendency Error of leniency Space intermediate descriptive phrases farther apart Provide smaller differences in meaning between terms near the ends of the scale Use more scale points 13 Rate Errors (cont.) Primacy Effect Recency Effect Reverse order of alternatives periodically or randomly 14 7
Rate Errors (cont.) Rate one trait at a time Halo Effects Reveal one trait per page Reverse anchors periodically 15 Simple attitude scale Dichotomous Data: nominal Simple Category Scale I plan to purchase a MindWriter laptop in the 12 months. Yes No 16 8
Multiple-Choice, Single-Response Scale Check list Select one or several Data: nominal What newspaper do you read most often for financial news? East City Gazette West City Tribune Regional newspaper National newspaper Other (specify: ) 17 Multiple-Choice, Multiple-Response Scale Check list Data: nominal What sources did you use when designing your new home? Please check all that apply. Online planning services Magazines Independent contractor/builder Designer Architect Other (specify: ) 18 9
Summated rating scale Data: interval Likert Scale The Internet is superior to traditional libraries for comprehensive searches. Strongly disagree (1) Disagree (2) Neither agree nor disagree (3) Agree (4) Strongly agree (5) 19 Semantic Differential (SD) Scale Measures the psychological meaning of an attitude object using bipolar adjective. For studies of brand and institute image Data: interval 20 10
Adapting SD Scale Convenience of Reaching the Store from Your Location Nearby : : : : : : : Distant Short time required to reach store : : : : : : : Long time required to reach store Difficult drive : : : : : : : Easy Drive Difficult to find parking place : : : : : : : Easy to find parking place Convenient to other stores I shop : : : : : : : Inconvenient to other stores I shop Products offered Wide selection of different kinds of products : : : : : : : Limited selection of different kinds of products Fully stocked : : : : : : : Understocked Undependable products : : : : : : : Dependable products High quality : : : : : : : Low quality Numerous brands : : : : : : : Few brands Unknown brands : : : : : : : Well-known brands 21 SD Scale for Analyzing Industry Association Candidates E Evaluation, P Potency, A Activity scales are mixed 22 11
Graphic (snake diagram) of SD Analysis - Reordered 23 Numerical Scale Examples Have equal intervals that separate their numeric scale points Data: Ordinal or Interval 24 12
Data: interval Multiple Rating List Scales 25 Constant-Sum Scales Data: ratio 26 13
Staple Scales Similar to Semantic Differential scales Three attributes of corporate image, each attribute requires a scale with bipolar label Data: ordinal or Interval 27 Graphic Rating Scales Enable measurement of finer difference Data: ordinal, interval or ratio 28 14
Ranking Scales Paired-comparison scale Allow expressing attitudes unambiguously by choosing between two objects Forced ranking scale Faster than paired comparisons and is usually easier and more motivating to the participant Comparative scale 29 Paired-Comparison Scale (Exhibit 12-10) Data: Ordinal 30 15
Data: Ordinal Forced Ranking Scale 31 Comparative Scale 32 16
Sorting Example of a Q-sort Solve three special problems: Item selection, Structured or unstructured choices in sorting, or Data analysis Involve the selection of a set of verbal statements, phrases, single words, or photos related the concept being studied 33 Exhibit 12-12 Alternative Scales Considered for MindWriter Likert Scale The problem that prompted service/repair was resolved Strongly Disagree Disagree Neither Agree Nor Disagree Agree Strongly Agree 1 2 3 4 5 Numerical Scale (MindWriter s Favorite) To what extent are you satisfied that the problem that prompted service/repair was resolved? Very Dissatisfied Very Satisfied 1 2 3 4 5 Hybrid Expectation Scale Resolution of the problem that prompted service/repair. Met Few Met Some Met Most Met All Exceeded Expectations Expectations Expectations Expectations Expectations 1 2 34 3 4 5 17
Exhibit 12-13 Plot of MindWriter Scale Evaluation 35 Cumulative Scales Total scores on cumulative scales have the same meaning. Given a person s total score, it is possible to estimate which items were answered positively and negatively A pioneering scale: Scalegram Analysis For discovering highly structured attitudes and behaviors Social distance Organizational hierarchies Evolutionary product stages 36 18
Exhibit 12-14 Ideal Sclogram Response Pattern Assume we are surveying opinion regarding a new Laptop computer and have developed a preference scale of four items: 1. mylaptop is good-looking. 2. I will insist on mylaptop next time because it is great-looking. 3. The appearance of mylaptop is acceptable to me. 4. I prefer the mylaptop style to other styles. 37 Exhibit 12-14 Ideal Scalogram Response Pattern Item 2 4 1 3 Participant Score X X X X 4 X X X 3 X X 2 X 1 0 * X = agree; = disagree. 38 19
Key Terms Attitude Balanced rating scale Categorization Comparative scale Constant-sum scale Cumulative scale Error of central tendency Error of leniency Forced-choice rating scale Forced ranking scale Graphic rating scale Halo effect Item analysis Likert scale Multidimensional scale 39 Key Terms Multiple-choice, multiple-response scale Multiple-choice, single-response scale Multiple rating list Numerical scale Paired-comparison scale Q-sort Ranking scale Rating scale Scaling Scalogram analysis Semantic differential Simple category scale 40 20
Key Terms Sorting Stapel scale Summated rating scale Unbalanced rating scale Unforced-choice rating scale Unidimensional scale 41 PicProfile: i.think Online focus groups Candid thoughts Moderator selection is critical 42 21
PicProfile: Online Survey 43 SnapShot: Paired Comparison We now estimate that Americans with disabilities currently spent $13.2 billion in travel expenditures and that amount would at least double [to $27.2 billion] if travel businesses were more attuned to the needs of those with disabilities. 44 22
PicProfile: i.think 45 Summary 46 23
Summary 47 24