MEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS. ROGER TOURANGEAU, KENNETH A. RASINSKI, and NORMAN BRADBURN

Size: px
Start display at page:

Download "MEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS. ROGER TOURANGEAU, KENNETH A. RASINSKI, and NORMAN BRADBURN"

Transcription

1 MEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS ROGER TOURANGEAU, KENNETH A. RASINSKI, and NORMAN BRADBURN Abstract Responses to an item on general happiness can change when that item follows one on marital happiness. Asking about marital happiness first sometimes reduces reported levels of overall happiness. This reduction may result from a change in the interpretation of the general happiness item. According to this hypothesis, when the general item follows the item on marital happiness, respondents take the item to ask about aspects of their lives other than their marriages-in effect, the respondents subtract their (mostly happy) marriages in answering the general item. The study reported here tests this "subtraction" hypothesis by asking versions of the general happiness item that correspond to the different interpretations. A version of the general item that asked about general happiness "aside from your marriage" yielded responses that were quite similar to those given to the standard item when it followed the item on marital happiness. Another version that asked about general happiness "including your marriage" elicited responses quite similar to those elicited by the standard item when it preceded the marital happiness item. However, reanalysis of the studies that originally demonstrated the impact of the order of the two happiness items casts doubt on the subtraction hypothesis and related models as explanations of the earlier findings. The literature on survey context effects suggests that earlier questions can affect answers to later ones through a number of distinct mechanisms (Schuman and Presser 1981; Smith 1982; Strack and Martin ROGER TOURANGEAU is Vice President at CODA, Inc. KENNETH RASINSKI is a Survey Director at the National Opinion Research Center (NORC) and NORMAN BRADBURN is NORC's Director. The authors thank Tom Smith and Howard Schuman, who carried out the reanalyses reported here. Their cooperation-and promptness-are greatly appreciated. The data collection described here was supported by a grant from the NORC Director's Fund. Public Opinion Quarterly ? 1991 by the Amencan Association for Public Opinion Research Published by The University of Chicago Press / X/91/ /$2.50

2 256 Tourangeau, Rasinski, and Bradburn 1987). In their recent review, Tourangeau and Rasinski (1988) argued that earlier questions can change how respondents interpret later items, what information they retrieve in formulating their answers, and how they make the judgments required by later items. One survey context effect is widely believed to reflect processes operating as the item is interpreted. It involves a question asking about general happiness ("Taken altogether, how would you say things are these days? Would you say that you are very happy, pretty happy, or not too happy?"). This item has figured in some landmark studies of happiness and psychological well-being (e.g., Bradburn 1969). However, answers to the item can vary depending on whether it precedes or follows a similar item on marital happiness ("Taking things all together, how would you describe your marriage? Would you say that your marriage is very happy, pretty happy, or not too happy?"). Schuman and Presser (1981) reported a contrast effect in which respondents were significantly less likely to describe themselves as very happy when they had first answered the question on marital happiness. Complicating matters, Smith (1982) found the opposite-respondents were significantly more likely to say they were very happy when they had first answered the marriage question. Of the two findings, Smith's is the less puzzling. Most respondents (typically, almost two out of three) report that they are very happily married. It is easy to see why reminding respondents of their mostly happy marriages just before asking them about their overall happiness will produce higher levels of reported happiness. The item on marital happiness should increase the chance that respondents will recall their marriages and take them into account in evaluating their overall happiness (McClendon and O'Brien 1988; Smith 1985; Strack, Martin, and Schwarz 1988). Such retrieval-based assimilation effects have been commonly observed, both with items on happiness and with other attitude items (e.g., Tourangeau et al. 1989a, 1989b). Though readily explained, the assimilation effect is likely to be weak. Even without the reminder provided by the preceding item, marriage is likely to be a salient consideration for most respondents as they assess their overall happiness; because the prior item on marital happiness will only affect those respondents who would not have taken their marriages into account anyway, the impact is likely to be small. Consistent with this analysis, efforts to replicate Smith's findings, such as the one reported by Turner (1984), have generally found nonsignificant effects in the direction of assimilation. Schuman and Presser's finding demonstrates that, though assimilation may be the rule, there are definite exceptions. Their results raise two questions: Why does the contrast effect occur? What determines which effect occurs? In answer to the first question, several investiga-

3 Measuring Happiness in Surveys 257 tors have suggested that the contrast effect reflects differences in how the general happiness item is interpreted under the two questionorders. Bradburn (1982), for example, argued that when the general item comes first, respondents may see it as referring to all aspects of their lives including their marriages, but that when it comes second, they see it as referring to aspects of their lives other than their marriages. Because they exclude or "subtract" their marriages in evaluating their overall happiness, respondents who answer the general happiness item after the item on marriage may give a different answer than they would have given had the general item come first. Others have proposed similar accounts of this or related context effects (e.g., Kalton, Collins, and Brook 1978; Schuman and Presser 1981). Researchers have sometimes linked the subtraction hypothesis to more fundamental processes. Bradburn argued that respondents may consider it redundant to base their answers to both happiness items on evaluations of their marriages. Tourangeau (1984; sqe also Strack, Martin, and Schwarz 1988; Tourangeau and Rasinski 1988) proposed that this hypothesized tendency to avoid redundancy may reflect an even more basic principle that governs behavior in conversationsnamely, the principle that each contribution should be informative (Grice 1975; Haviland and Clark 1974). If this principle is at work in survey interviews, respondents may interpret the general item to be asking for new information-that is, about areas of their lives not already covered by the preceding item on marital happiness. The subtraction account suggests some variables that may affect whether assimilation or contrast will occur. For example, summaries are not always redundant, particularly when many or diverse specifics have been touched on. As Tourangeau and Rasinski point out, a long list of prior specifics "may encourage respondents to interpret the general item as a summary of the particulars rather than as a residual category" (1988, 303). Thus, when the marriage and general happiness items are part of a longer series of related items, contrast effects may be less likely. The number of prior specific items may provide a clue about why Smith found an assimilation effect but Schuman and Presser found contrast (Schwarz, Strack, and Mai 1991). In the 1980 General Social Survey (GSS) on which Smith's results are based, the two happiness items followed five questions about satisfaction in other life domains; Schuman and Presser's study did not include the satisfaction items. Despite its popularity, the evidence in favor of the subtraction account for the contrast effect has mostly been quite indirect. Smith (1982) noted that the subtraction hypothesis implied that the effect of the preceding marital happiness item should depend on how respondents answered that question-that is, the effect of excluding marriage

4 258 Tourangeau, Rasinski, and Bradburn from the judgment of overall happiness should depend on whether the marriages being left out are, on the average, happy or unhappy ones. Strack, Martin, and Schwarz (1988) went further, arguing that the difference in interpretation should affect the correlation between responses to the two happiness items; the correlation should be reduced when marriage is excluded from the evaluation of general happiness. But the central claim of the subtraction hypothesis-that the difference in question order can produce a difference in the interpretation of the general happiness item-has only recently been tested. The subtraction hypothesis states that, when the general happiness item follows the item on marital happiness, respondents interpret it to mean something like "Aside from your marriage, how happy are you?" but that when it comes first, respondents interpret it to mean something like "Including your marriage and other aspects of your life, how happy are you?" If this is true, then it should be possible to duplicate the results obtained under the two question orders merely by rephrasing the general happiness item to make the intended interpretation clear and explicit. This is what a recent study by Schwarz and his colleages attempted to do (Schwarz, Strack, and Mai 1991). It is possible that this study does not fully capture the essential features of the original studies. First of all, Schwarz and his co-workers made several changes in the wording and format of the happiness items. Their items asked about satisfaction instead of happiness and provided an 11-point response scale instead of the usual 3-point scale. The biggest wording change involved replacing the item on marriage with an item that covered dating relationships as well; this allowed unmarried respondents to take part in the study. However, in a similar study that examined order effects on items asking about satisfaction in several life domains, McClendon and O'Brien (1988) reported differences between married and unmarried respondents-only the married respondents showed assimilation effects. Schwarz and his colleagues do not report the results separately for married and unmarried respondents or say what proportion of their sample was married, so we cannot assess whether including unmarried respondents affected their results. Second, the respondents in the new study were a convenience sample of volunteers who filled out written questionnaires. The change from personal interviews in the earlier studies to self-administered questionnaires in the new one may have altered the results; elsewhere, Schwarz and Strack have argued that self-administered questionnaires reduce or eliminate question order effects (Bishop et al. 1988; Schwarz et al., in press). Third, although the new study shows clear evidence of assimilation effects, the evidence for contrast is much weaker. Re-

5 Measuring Happiness in Surveys 259 spondents who received the version of the general item that explicitly instructed them to leave out their marital or dating relationship did not show a significantly reduced correlation between the two happiness items relative to the control group, although the difference was in that direction. We carried out a study that avoided some of these problems; our study reproduces the main features of the original studies more exactly than the study by Schwarz, Strack, and Mai (1991). It uses telephone interviews carried out by experienced interviewers with a randomly selected sample of married respondents. Our study also includes conditions that retain the exact wordings of the original items. Finally, we carried out a detailed comparison of our results with those of the original studies and a recent replication on the 1987 GSS. This comparison proved to be quite revealing. Method DESIGN The study was a split-ballot experiment with four groups. Respondents in two groups got the standard wording of the general happiness item ("Taken altogether, how would you say things are these days? Would you say that you are very happy, pretty happy, or not too happy?"). In one of these standard wording groups, the general happiness item preceded the item on marital happiness; in the other, it followed the item on marital happiness. The two standard wording groups thus replicate the conditions reported by Schuman and Presser (1981) and Smith (1982). The final two groups received variant wordings for the general happiness item. For one group, the item read: "Taking things all together, including your marriage and other important aspects of your life, how would you say things are these days? Would you say that you are very happy, pretty happy, or not too happy?" For the other group, the general item read: "Aside from your marriage, how would you say things are these days? Would you say that you are very happy, pretty happy, or not too happy?" In both variant wording groups, the general happiness item followed the item on marital happiness. All four groups got the standard wording of the marital happiness item ("Taking things all together, how would you describe your marriage? Would you say that your marriage is very happy, pretty happy, or not too happy?"). In all four, the two happiness items were the last questions in the interview and immediately followed an item that asked about the respondent's marital status; twelve items on welfare and abortion preceded the items on marital status and happiness.

6 260 Tourangeau, Rasinski, and Bradburn SAMPLE The experiment reported here was conducted as part of a larger study in which a sample of households in Chicago was contacted by telephone and individuals were selected for interview; those who completed an initial interview were recontacted and interviewed over the telephone a second time. The happiness items were administered during the second interview. We drew the sample for the initial interview by randomly selecting telephone numbers from the Chicago directory and replacing the final digit of each number with a random digit. Interviewers called this initial pool of telephone numbers and contacted a total of 1,481 households; calls to an additional 570 numbers were never answered. The selection of a respondent within the household was nonrandom, with interviewers asking for any available adult male or, when no male was available, any adult female. The initial interview, which concerned attitudes on abortion and welfare, was completed by 599 respondents. Respondents to the initial interview were recontacted by telephone three weeks later. Four hundred ninety-nine of the original respondents also completed the reinterview; 228 of them were married. Of the 228, 48.7% were men and 51.3% were women; 55.3% said they were white, 27.4% Black, 5.8% Hispanic, and 11.4% classified themselves in other race or ethnic categories. Their ages ranged from 18 to 87 years, with a mean of 47 years. PROCEDURE Ten experienced telephone interviewers carried out both the initial interviews and the reinterviews. Each interviewer received a batch of reinterview questionnaires, with the different versions in a random order. By working their way through the questionnaires, the interviewers randomly assigned reinterview respondents to one of the four experimental groups. Results The hypotheses can be summarized quite simply. The correlation between responses to the two happiness items should be relatively high when the general item preceded the item on marital happiness or when the wording of the general item made it clear that respondents were to take their marriages into consideration. The correlation should be relatively low when the general item followed the item on marital happiness or when the wording of the general item made it clear that respondents were to exclude their marriages from consideration.

7 Measuring Happiness in Surveys 261 Table 1 presents the correlations for the four groups. As is apparent, they conform quite closely to the hypothesized pattern. The two correlations that are supposed to be high are considerably higher than the two that are supposed to be low (.545 and.524 vs..277 and.267). A contrast that compares the first two of these correlations with the last two reveals a significant difference (z = 2.32; p <.05). Table 1 also shows the significance of the differences between pairs of these correlations; both pairwise comparisons are marginally significant. Although the correlations between the items vary across the four groups, the marginals on the general happiness item do not. The proportion of respondents describing themselves as "very happy" was 34.0% among those who got the standard item after the marital happiness item, 40.0% among those who got the standard item before the marital happiness item, 33.3% among those who got the "aside from your marriage" revised wording, and 33.9% among those who got the "including your marriage" revised wording. None of the differences in the marginals for the general happiness item are significant. Discussion In terms of the correlations between the two happiness items, respondents who got the revised item asking them about their lives aside from their marriages show results very similar to those who received the standard general happiness item after the item on marital happiness. Those who got the revised item asking about their lives including their marriages were quite similar to those who got the standard item first. These results are certainly consistent with the view that the revised items reflect the different interpretations that respondents give to the standard item under the different question orders. What is particularly striking about the findings is how closely the correlations for the two revised groups parallel those for the two standard wording groups. Our findings differ somewhat from the results in the comparable conditions of the study by Schwarz, Strack, and Mai (1991). First, in our study, when the standard general item followed the item on marital happiness, there was a low correlation between the two (r =.28); in their study, the corresponding correlation was quite high (r =.67). Schwarz and his colleagues included another condition that yielded results more like ours. In that condition, the general item followed the specific item and the two items were explicitly linked by a joint introduction; within this group, the correlation (r =.18) was comparable to the value of.28 that we found. As it happens, our study included

8 262 Tourangeau, Rasinski, and Bradburn Table 1. Responses to the General Happiness Item and Correlation with Marital Happiness Correlation "Very with Happy" Marital Group N Percentage z p Happiness z p Standard wording Marital happiness first n.s <.10 General happiness first Revised wording "Aside from your marriage" n. s <. 12 "Including your marriage" NOTE: All significance tests are two-tailed. such a lead-in to the happiness items; just before these items, there was a short introduction that read "Now for a couple of items on an unrelated topic." Even such a vague introduction apparently tended to heighten the relationship between the two items, affecting interpretations of the general item. A second difference between the results of the two studies involved the correlation between the two happiness items when the general item came first. In our study, this correlation was relatively high (r =.55) when the standard version of the general happiness item was used; in the study by Schwarz and his colleagues, the corresponding correlation was relatively low (r =.32). This difference may reflect the reduced importance or accessibility of dating relationships as compared to marriages. The specific item in the study by Schwarz and his colleagues covered both marriage and dating; ours asked only about marriages. The difference in the correlations in the two studies may also reflect the fact that our study included an item to determine whether the respondent was married; this question came right before the two happiness items. The question on marital status may have temporarily heightened the accessibility of the respondent's marriage, increasing its impact on answers to the general happiness item. Data from the earlier studies suggest that both explanations have some merit. For the conditions in which the general item came first, Smith and Schuman and Presser report correlations between the two happiness items that are somewhat lower than ours but somewhat higher than the one

9 Measuring Happiness in Surveys 263 reported by Schwarz and his co-workers (r =.39 in Smith 1982, and r =.49 in Schuman and Presser 1981). Despite these superficial differences, the results of our study are basically consistent with those of Schwarz and his colleagues. The key question that remains is whether either study, both of which found differences in correlations, sheds any light on the original studies, both of which found differences in the overall direction of responses to the general item. If the contrast effect reported by Schuman and Presser results from the reinterpretation of the general happiness item when it follows the marital happiness item, there should be a correlational effect as well as a directional one; as in table 1, the correlation between the two happiness items should be reduced when the general item comes second. Similarly, if the assimilation effect reported by Smith results from the increased accessibility of marital happiness when the item about marriage comes first, this should heighten the correlation between the two items. Were there such correlational effects in the earlier studies? Apparently not. Table 2 presents the results of a reanalysis of the data from the earlier studies and from a recent replication conducted as part of the 1987 GSS. None of the studies showed a significant difference between the correlations obtained under the two question orders. The results shown in table 2 do not depend on the measure of association used; the pattern remains the same whether correlation coefficients, simple or multiple regression coefficients, or gammas are used to measure the association between the two happiness items. There is one situation in which both the subtraction and accessibility hypotheses predict directional rather than correlational effects. That situation is when everyone answers the marital happiness item in more or less the same way. The absence of variability in responses to the specific item will guarantee a low correlation with the general item, regardless of question order. Further, because all respondents will be subtracting (or including) material with similar implications for the general happiness question, the specific item should affect answers to the general item in the same way for all respondents, producing a directional effect. The data in table 2, however, are not consistent with this hypothesis either. The correlations there are not particularly low, ranging from the high.30s to the low.50s. These values are closer to the high correlations in table 1 (and in the study by Schwarz and his colleagues) than to the low ones. To put it another way, the correlation between responses to the two happiness items remains relatively high when the respondents are supposed to be discounting their marriages (as in Schuman and Presser 1981) and it gets no higher when the respondents are supposed to have been reminded of their marriages by the preceding item on marital happiness (as in Smith 1982).

10 264 Tourangeau, Rasinski, and Bradburn Table 2. Responses to the General Happiness Item and Correlation with Marital Happiness Correlation "Very with Happy" Marital Study and Group N Percentage z p Happiness z p Schuman and Presser 1981 Marital happiness first < n.s. General happiness first Smith 1982 Marital happiness first < n.s. General happiness first General Social Survey 1987 Marital happiness first (total) a n.s a n.s. Satisfaction items before happiness items b n.s b n. s. Satisfaction items after happiness items General happiness first NOTE: The five satisfaction items preceded the happiness items in both conditions of Smith 1982; they were omitted from Schuman and Presser a Significance tests measure the marital happiness first condition vs. the general happiness first condition. b Significance tests compare the two satisfaction conditions. Thus, our study and the one by Schwarz and his colleagues do not appear to capture whatever processes produced directional effects in the original studies. Like Schwarz and his colleagues, we found correlational, but not directional, effects; the earlier studies found directional, but not correlational, effects. Although the results of the newer studies support the idea that respondents may reinterpret apparently redundant items (though perhaps only when the items are explicitly linked by a joint introduction), such reinterpretation does not seem to have produced the contrast effect observed by Schuman and Presser. Similarly, although there is considerable evidence that earlier items can increase the accessibility of material that is then more likely to be used to answer later questions, this does not appear to explain the assimilation effect found by Smith. Moreover, the results of the 1987 GSS experiment indicate that the placement of the satisfaction items had little impact on responses to the two happiness items. This variable

11 Measuring Happiness in Surveys 265 does not seem to determine whether assimilation or contrast effects are observed (cf. Schwarz, Strack, and Mai 1991; Tourangeau and Rasinski 1988). In short, our conclusions must remain negative. The subtraction hypothesis does not appear to explain the contrast effect involving the happiness items. Similarly, the more complicated model offered by Schwarz and his colleagues, which incorporates the subtraction hypothesis as a special case, also offers no explanation of the original findings; further, that model's explanation of the assimilation effects found in the 1980 GSS appears to be contradicted by the data shown in table 2. Unfortunately, although we may now be clearer about what is not causing the original effects, we are still unsure about what is causing them. References Bishop, G., H. Hippler, N. Schwarz, and F. Strack "A Comparison of Response Effects in Self-Administered and Telephone Surveys." In Telephone Survey Methodology, ed. R. Groves, P. Biemer, L. Lyberg, J. Massey, W. Nicholls, and J. Waksberg, New York: Wiley. Bradburn, N The Structure of Psychological Well-Being. Chicago: Aldine. Bradburn, N "Question-Wording Effects in Surveys." In Question Framing and Response Consistency, ed. R. Hogarth, San Francisco: Jossey-Bass. Grice, H "Logic and Conversation." In Syntax and Semantics, vol. 3: Speech Acts, ed. P. Cole and T. Morgan, New York: Seminar Press. Haviland, S., and H. Clark "What's New? Acquiring New Information as a Process in Comprehension." Journal of Verbal Learning and Verbal Behavior 13: Kalton, G., M. Collins, and L. Brook "Experiments in Wording Opinion Questions." Journal of the Royal Statistical Society, ser. C, 27: Jabine, T., M. Straf, J. Tanur, and R. Tourangeau Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines. Washington, DC: National Academy Press. McClendon, M., and D. O'Brien "Question-Order Effects on Subjective Well-Being." Public Opinion Quarterly 52: Schuman, H., and S. Presser Questions and Answers in Attitude Surveys: Experiments in Question Form, Wording, and Context. New York: Academic Press. Schwarz, N., F. Strack, H. Hippler, and G. Bishop. In press. "The Impact of Administration Mode on Response Effects in Survey Measurement." Applied Cognitive Psychology. Schwarz, N., Strack, F., and H. Mai "Assimilation and Contrast Effects in Part-Whole Question Sequences: A Conversational Logic Analysis." Public Opinion Quarterly 55:3-23. Smith, T "Conditional Order Effects." GSS Technical Report no. 33. Chicago: NORC. Smith, T "Unhappiness on the 1985 GSS: Confounding Change and Context." GSS Technical Report no. 34. Chicago: NORC. Strack, F., and L. Martin "Thinking, Judging, and Communicating: A Process Account of Context Effects in Attitude Surveys." In Social Information Processing and Survey Methodology, ed. H. Hippler, N. Schwarz, and S. Sudman, New York: Springer-Verlag.

12 266 Tourangeau, Rasinski, and Bradburn Strack, F., L. Martin, and N. Schwarz "Priming and Communication: The Social Determinants of Information Use in Judgments of Life Satisfaction." European Journal of Social Psychology 18: Tourangeau, R "Cognitive Science and Survey Methods." In Cognitive Aspects of Survey Methodology: Building a Bridge between Disciplines, ed. T. Jabine, M. Straf, J. Tanur, and R. Tourangeau, Washington, DC: National Academy Press. Tourangeau, R., and K. Rasinski "Cognitive Processes Underlying Context Effects in Attitude Measurement." Psychological Bulletin 103: Tourangeau, R., K. Rasinski, N. Bradburn, and R. D'Andrade. 1989a. "Belief Accessibility and Context Effects in Attitude Measurement." Journal of Experimental Social Psychology 25: Tourangeau, R., K. Rasinski, N. Bradburn, and R. D'Andrade. 1989b. "Carryover Effects in Attitude Surveys." Public Opinion Quarterly 53: Turner, C "Why Do Surveys Disagree? Some Preliminary Hypotheses and Some Disagreeable Examples." In Surveying the Subjective Phenomena, vol. 2, ed. C. Turner and E. Martin, New York: Russell Sage.

Mental Construal Processes and the Emergence of Context Effects in Attitude Measurement

Mental Construal Processes and the Emergence of Context Effects in Attitude Measurement Survey Methodology Program Working Paper Series Mental Construal Processes and the Emergence of Context Effects in Attitude Measurement Norbert Schwarz Herbert Bless N 005 Survey Methodology Program Institute

More information

Does it Matter How You Ask? Question Wording and Males' Reporting of Contraceptive Use at Last Sex

Does it Matter How You Ask? Question Wording and Males' Reporting of Contraceptive Use at Last Sex Does it Matter How You Ask? Question Wording and Males' Reporting of Contraceptive Use at Last Sex Jennifer Yarger University of Michigan Sarah Brauner-Otto Mississippi State University Joyce Abma National

More information

Mode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge Network Surveys

Mode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge Network Surveys Mode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge Network Surveys Tom W. Smith 1, J. Michael Dennis 2 1 National Opinion Research Center/University

More information

Cognitive Processes Underlying Context Effects in Attitude Measurement

Cognitive Processes Underlying Context Effects in Attitude Measurement Psychological Bulletin 1988, Vol. 103, No. 3, 299-314 Copyright 1988 by the American Psychological Association, Inc. 0033-2909/88/S00.75 Cognitive Processes Underlying Context Effects in Attitude Measurement

More information

What Respondents Learn from Questionnaires: The Survey Interview and the Logic of Conversation

What Respondents Learn from Questionnaires: The Survey Interview and the Logic of Conversation Survey Methodology Program Working Paper Series What Respondents Learn from Questionnaires: The Survey Interview and the Logic of Conversation Norbert Schwarz N B 003 Mi Survey Methodology Program Institute

More information

Why are you calling me? How study introductions change response patterns

Why are you calling me? How study introductions change response patterns Quality of Life Research (2006) 15: 621 630 Ó Springer 2006 DOI 10.1007/s11136-005-4529-5 Why are you calling me? How study introductions change response patterns Dylan M. Smith 1,2, Norbert Schwarz 2,

More information

THE EFFECTS OF SELF AND PROXY RESPONSE STATUS ON THE REPORTING OF RACE AND ETHNICITY l

THE EFFECTS OF SELF AND PROXY RESPONSE STATUS ON THE REPORTING OF RACE AND ETHNICITY l THE EFFECTS OF SELF AND PROXY RESPONSE STATUS ON THE REPORTING OF RACE AND ETHNICITY l Brian A. Harris-Kojetin, Arbitron, and Nancy A. Mathiowetz, University of Maryland Brian Harris-Kojetin, The Arbitron

More information

Why do Psychologists Perform Research?

Why do Psychologists Perform Research? PSY 102 1 PSY 102 Understanding and Thinking Critically About Psychological Research Thinking critically about research means knowing the right questions to ask to assess the validity or accuracy of a

More information

RELATIONSHIPS BETWEEN COGNITIVE PSYCHOLOGY AND SURVEY RESEARCH ~

RELATIONSHIPS BETWEEN COGNITIVE PSYCHOLOGY AND SURVEY RESEARCH ~ RELATIONSHIPS BETWEEN COGNITIVE PSYCHOLOGY AND SURVEY RESEARCH ~ Monroe Sirken, National Center for Health Statistics; Douglas Herrmann, Indiana State University Monroe Sirken, NCHS, 6525 Belcrest Road,

More information

What are Indexes and Scales

What are Indexes and Scales ISSUES Exam results are on the web No student handbook, will have discussion questions soon Next exam will be easier but want everyone to study hard Biggest problem was question on Research Design Next

More information

Boston Library Consortium Member Libraries

Boston Library Consortium Member Libraries Digitized by the Internet Archive in 2011 with funding from Boston Library Consortium Member Libraries http://www.archive.org/details/dopeoplemeanwhatoobert B31 1415.Odr DEWEY Massachusetts Institute

More information

CHAPTER 3 METHOD AND PROCEDURE

CHAPTER 3 METHOD AND PROCEDURE CHAPTER 3 METHOD AND PROCEDURE Previous chapter namely Review of the Literature was concerned with the review of the research studies conducted in the field of teacher education, with special reference

More information

SOCIOLOGICAL RESEARCH

SOCIOLOGICAL RESEARCH SOCIOLOGICAL RESEARCH SOCIOLOGY Is a scientific discipline rooted in Positivism As such it makes use of a number of scientific techniques Including: The experimental method, the survey and questionnaire

More information

DAZED AND CONFUSED: THE CHARACTERISTICS AND BEHAVIOROF TITLE CONFUSED READERS

DAZED AND CONFUSED: THE CHARACTERISTICS AND BEHAVIOROF TITLE CONFUSED READERS Worldwide Readership Research Symposium 2005 Session 5.6 DAZED AND CONFUSED: THE CHARACTERISTICS AND BEHAVIOROF TITLE CONFUSED READERS Martin Frankel, Risa Becker, Julian Baim and Michal Galin, Mediamark

More information

International Journal of Public Opinion Research Advance Access published April 1, 2005 RESEARCH NOTE

International Journal of Public Opinion Research Advance Access published April 1, 2005 RESEARCH NOTE International Journal of Public Opinion Research Advance Access published April 1, 2005 International Journal of Public Opinion Research The Author 2005. Published by Oxford University Press on behalf

More information

Cognitive testing. Quality assurance of the survey. Ăirts Briăis Luxembourg, 13 May, 2009

Cognitive testing. Quality assurance of the survey. Ăirts Briăis Luxembourg, 13 May, 2009 RIGA STRADINS UNIVERSITY Department of Public Health and Epidemiology Cognitive testing Quality assurance of the survey Ăirts Briăis Luxembourg, 13 May, 2009 Aim of a survey To obtain information which

More information

Questionnaire Design Clinic

Questionnaire Design Clinic Questionnaire Design Clinic Spring 2008 Seminar Series University of Illinois www.srl.uic.edu 1 Cognitive Steps in Answering Questions 1. Understand question. 2. Search memory for information. 3. Integrate

More information

Implicit Information in Directionality of Verbal Probability Expressions

Implicit Information in Directionality of Verbal Probability Expressions Implicit Information in Directionality of Verbal Probability Expressions Hidehito Honda (hito@ky.hum.titech.ac.jp) Kimihiko Yamagishi (kimihiko@ky.hum.titech.ac.jp) Graduate School of Decision Science

More information

Examining the relationship between the accuracy of self-reported data and the availability of respondent financial records

Examining the relationship between the accuracy of self-reported data and the availability of respondent financial records Examining the relationship between the accuracy of self-reported data and the availability of respondent financial records Emily Geisen, Charles Strohm, M. Christopher Stringer, Brandon Kopp, Ashley Richards

More information

Interviewing, Structured and Unstructured

Interviewing, Structured and Unstructured Interviewing, Structured and Unstructured Department of Government London School of Economics and Political Science 1 Participant Observation 2 Questionnaire Methods Recall-type Questions Evaluative Questions

More information

Measuring and Assessing Study Quality

Measuring and Assessing Study Quality Measuring and Assessing Study Quality Jeff Valentine, PhD Co-Chair, Campbell Collaboration Training Group & Associate Professor, College of Education and Human Development, University of Louisville Why

More information

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research

Chapter 11 Nonexperimental Quantitative Research Steps in Nonexperimental Research Chapter 11 Nonexperimental Quantitative Research (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) Nonexperimental research is needed because

More information

ATTITUDES, BELIEFS, AND TRANSPORTATION BEHAVIOR

ATTITUDES, BELIEFS, AND TRANSPORTATION BEHAVIOR CHAPTER 6 ATTITUDES, BELIEFS, AND TRANSPORTATION BEHAVIOR Several studies were done as part of the UTDFP that were based substantially on subjective data, reflecting travelers beliefs, attitudes, and intentions.

More information

INTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook

INTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook INTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook www.srl.uic.edu General information Please hold questions until the end of the presentation Slides available at www.srl.uic.edu/seminars/fall14seminars.htm

More information

Social Psychology (Soc 220) Data Analysis Exercise Spring 2004

Social Psychology (Soc 220) Data Analysis Exercise Spring 2004 Social Psychology (Soc 220) J. Lashbrook Data Analysis Exercise Spring 2004 INTRODUCTION Social Structure Personality: What is the relationship between social class and child-rearing values? The sociologist,

More information

THE LAST-BIRTHDAY SELECTION METHOD & WITHIN-UNIT COVERAGE PROBLEMS

THE LAST-BIRTHDAY SELECTION METHOD & WITHIN-UNIT COVERAGE PROBLEMS THE LAST-BIRTHDAY SELECTION METHOD & WITHIN-UNIT COVERAGE PROBLEMS Paul J. Lavrakas and Sandra L. Bauman, Northwestern University Survey Laboratory and Daniel M. Merkle, D.S. Howard & Associates Paul J.

More information

Sexism Predicts Appeal of Gender Stereotypes from a Popular Book on Relationships

Sexism Predicts Appeal of Gender Stereotypes from a Popular Book on Relationships Sexism Predicts Appeal of Gender Stereotypes from a Popular Book on Relationships Jeanna E. Cooper and Margaret L. Signorella 1 The Pennsylvania State University College students and older adults had difficulty

More information

Pooling Subjective Confidence Intervals

Pooling Subjective Confidence Intervals Spring, 1999 1 Administrative Things Pooling Subjective Confidence Intervals Assignment 7 due Friday You should consider only two indices, the S&P and the Nikkei. Sorry for causing the confusion. Reading

More information

Chapter 2 Survey Research Design and Quantitative Methods of Analysis for Cross-Sectional Data

Chapter 2 Survey Research Design and Quantitative Methods of Analysis for Cross-Sectional Data SSRIC Teaching Resources Depository Public Opinion on Social Issues -- 1975-2010 Elizabeth N. Nelson and Edward E. Nelson, California State University, Fresno Chapter 2 Survey Research Design and Quantitative

More information

Running Head: TRUST INACCURATE INFORMANTS 1. In the Absence of Conflicting Testimony Young Children Trust Inaccurate Informants

Running Head: TRUST INACCURATE INFORMANTS 1. In the Absence of Conflicting Testimony Young Children Trust Inaccurate Informants Running Head: TRUST INACCURATE INFORMANTS 1 In the Absence of Conflicting Testimony Young Children Trust Inaccurate Informants Kimberly E. Vanderbilt, Gail D. Heyman, and David Liu University of California,

More information

Optimal Flow Experience in Web Navigation

Optimal Flow Experience in Web Navigation Optimal Flow Experience in Web Navigation Hsiang Chen, Rolf T. Wigand and Michael Nilan School of Information Studies, Syracuse University Syracuse, NY 13244 Email: [ hchen04, rwigand, mnilan]@mailbox.syr.edu

More information

Protocol analysis and Verbal Reports on Thinking

Protocol analysis and Verbal Reports on Thinking Protocol analysis and Verbal Reports on Thinking An updated and extracted version from Ericsson (2002) Protocol analysis is a rigorous methodology for eliciting verbal reports of thought sequences as a

More information

Huber, Gregory A. and John S. Lapinski "The "Race Card" Revisited: Assessing Racial Priming in

Huber, Gregory A. and John S. Lapinski The Race Card Revisited: Assessing Racial Priming in Huber, Gregory A. and John S. Lapinski. 2006. "The "Race Card" Revisited: Assessing Racial Priming in Policy Contests." American Journal of Political Science 50 (2 April): 421-440. Appendix, Version 1.0

More information

Item Nonresponse and the 10-Point Response Scale in Telephone Surveys 1

Item Nonresponse and the 10-Point Response Scale in Telephone Surveys 1 Vol. 5, no 4, 2012 www.surveypractice.org The premier e-journal resource for the public opinion and survey research community Item Nonresponse and the 10-Point Response Scale in Telephone Surveys 1 Matthew

More information

Design and Analysis of Surveys

Design and Analysis of Surveys Beth Redbird; redbird@northwestern.edus Soc 476 Office Location: 1810 Chicago Room 120 R 9:30 AM 12:20 PM Office Hours: R 3:30 4:30, Appointment Required Location: Harris Hall L06 Design and Analysis of

More information

Chapter 5: Producing Data

Chapter 5: Producing Data Chapter 5: Producing Data Key Vocabulary: observational study vs. experiment confounded variables population vs. sample sampling vs. census sample design voluntary response sampling convenience sampling

More information

Women s Symptom Memories: More Accessible Than Men s?

Women s Symptom Memories: More Accessible Than Men s? Women s Symptom Memories: More Accessible Than Men s? J.A. Skelton & Elizabeth Corrigan Dickinson College Men are more likely than women to die at virtually every age, but women report greater numbers

More information

The Impact of Item Sequence Order on Local Item Dependence: An Item Response Theory Perspective

The Impact of Item Sequence Order on Local Item Dependence: An Item Response Theory Perspective Vol. 9, Issue 5, 2016 The Impact of Item Sequence Order on Local Item Dependence: An Item Response Theory Perspective Kenneth D. Royal 1 Survey Practice 10.29115/SP-2016-0027 Sep 01, 2016 Tags: bias, item

More information

The Accuracy and Utility of Using Paradata to Detect Interviewer Question-Reading Deviations

The Accuracy and Utility of Using Paradata to Detect Interviewer Question-Reading Deviations University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln 2019 Workshop: Interviewers and Their Effects from a Total Survey Error Perspective Sociology, Department of 2-26-2019 The

More information

Is There any Difference Between the Results of the Survey Marked by the Interviewer and the Respondent?

Is There any Difference Between the Results of the Survey Marked by the Interviewer and the Respondent? Is There any Difference Between the Results of the Survey Marked by the Interviewer and the Respondent? Cetin Kalburan, PhD Cand. Tugce Aksoy, Graduate Student Institute of Social Sciences, Pamukkale University,

More information

CHARACTERISTICS OF RESPONDENTS IN BUSINESS WEB SURVEYS IN CROATIA: CASE OF STATISTICAL METHODS USE SURVEYS

CHARACTERISTICS OF RESPONDENTS IN BUSINESS WEB SURVEYS IN CROATIA: CASE OF STATISTICAL METHODS USE SURVEYS CHARACTERISTICS OF RESPONDENTS IN BUSINESS WEB SURVEYS IN CROATIA: CASE OF STATISTICAL METHODS USE SURVEYS Berislav ŽMUK Faculty of Economics and Business, University of Zagreb, Trg J. F. Kennedyja 6,

More information

ISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology

ISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology ISC- GRADE XI HUMANITIES (2018-19) PSYCHOLOGY Chapter 2- Methods of Psychology OUTLINE OF THE CHAPTER (i) Scientific Methods in Psychology -observation, case study, surveys, psychological tests, experimentation

More information

One-Way ANOVAs t-test two statistically significant Type I error alpha null hypothesis dependant variable Independent variable three levels;

One-Way ANOVAs t-test two statistically significant Type I error alpha null hypothesis dependant variable Independent variable three levels; 1 One-Way ANOVAs We have already discussed the t-test. The t-test is used for comparing the means of two groups to determine if there is a statistically significant difference between them. The t-test

More information

Stat 13, Intro. to Statistical Methods for the Life and Health Sciences.

Stat 13, Intro. to Statistical Methods for the Life and Health Sciences. Stat 13, Intro. to Statistical Methods for the Life and Health Sciences. 0. SEs for percentages when testing and for CIs. 1. More about SEs and confidence intervals. 2. Clinton versus Obama and the Bradley

More information

Nonresponse Bias in a Longitudinal Follow-up to a Random- Digit Dial Survey

Nonresponse Bias in a Longitudinal Follow-up to a Random- Digit Dial Survey Nonresponse Bias in a Longitudinal Follow-up to a Random- Digit Dial Survey Doug Currivan and Lisa Carley-Baxter RTI International This paper was prepared for the Method of Longitudinal Surveys conference,

More information

20. Experiments. November 7,

20. Experiments. November 7, 20. Experiments November 7, 2015 1 Experiments are motivated by our desire to know causation combined with the fact that we typically only have correlations. The cause of a correlation may be the two variables

More information

The U-Shape without Controls. David G. Blanchflower Dartmouth College, USA University of Stirling, UK.

The U-Shape without Controls. David G. Blanchflower Dartmouth College, USA University of Stirling, UK. The U-Shape without Controls David G. Blanchflower Dartmouth College, USA University of Stirling, UK. Email: david.g.blanchflower@dartmouth.edu Andrew J. Oswald University of Warwick, UK. Email: andrew.oswald@warwick.ac.uk

More information

Inferences: What inferences about the hypotheses and questions can be made based on the results?

Inferences: What inferences about the hypotheses and questions can be made based on the results? QALMRI INSTRUCTIONS QALMRI is an acronym that stands for: Question: (a) What was the broad question being asked by this research project? (b) What was the specific question being asked by this research

More information

Chapter 7: Descriptive Statistics

Chapter 7: Descriptive Statistics Chapter Overview Chapter 7 provides an introduction to basic strategies for describing groups statistically. Statistical concepts around normal distributions are discussed. The statistical procedures of

More information

Survey Errors and Survey Costs

Survey Errors and Survey Costs Survey Errors and Survey Costs ROBERT M. GROVES The University of Michigan WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION CONTENTS 1. An Introduction To Survey Errors 1 1.1 Diverse Perspectives

More information

Magnitude and accuracy differences between judgements of remembering and forgetting

Magnitude and accuracy differences between judgements of remembering and forgetting THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY 2012, 65 (11), 2231 2257 Magnitude and accuracy differences between judgements of remembering and forgetting Michael J. Serra and Benjamin D. England Department

More information

2 Critical thinking guidelines

2 Critical thinking guidelines What makes psychological research scientific? Precision How psychologists do research? Skepticism Reliance on empirical evidence Willingness to make risky predictions Openness Precision Begin with a Theory

More information

M2. Positivist Methods

M2. Positivist Methods M2. Positivist Methods While different research methods can t simply be attributed to different research methodologies - the Interpretivists would never touch a questionnaire approach - some methods are

More information

Developing and Testing Survey Items

Developing and Testing Survey Items Developing and Testing Survey Items William Riley, Ph.D. Chief, Science of Research and Technology Branch National Cancer Institute With Thanks to Gordon Willis Contributions to Self-Report Errors Self-report

More information

Vocabulary. Bias. Blinding. Block. Cluster sample

Vocabulary. Bias. Blinding. Block. Cluster sample Bias Blinding Block Census Cluster sample Confounding Control group Convenience sample Designs Experiment Experimental units Factor Level Any systematic failure of a sampling method to represent its population

More information

The degree to which a measure is free from error. (See page 65) Accuracy

The degree to which a measure is free from error. (See page 65) Accuracy Accuracy The degree to which a measure is free from error. (See page 65) Case studies A descriptive research method that involves the intensive examination of unusual people or organizations. (See page

More information

Analyze the Impact of Control Source on Explicit and Implicit Memory

Analyze the Impact of Control Source on Explicit and Implicit Memory 2012, TextRoad Publication ISSN 2090-4304 Journal of Basic and Applied Scientific Research www.textroad.com Analyze the Impact of Control Source on Explicit and Implicit Memory Mitra Attar Hamedi PhD Student

More information

UBC Social Ecological Economic Development Studies (SEEDS) Student Report

UBC Social Ecological Economic Development Studies (SEEDS) Student Report UBC Social Ecological Economic Development Studies (SEEDS) Student Report Encouraging UBC students to participate in the 2015 Transit Referendum Ines Lacarne, Iqmal Ikram, Jackie Huang, Rami Kahlon University

More information

Any Way You Slice It: On Fission, Fusion and the Weighing of Welfare 1. [Please note: Citations have yet to be added.]

Any Way You Slice It: On Fission, Fusion and the Weighing of Welfare 1. [Please note: Citations have yet to be added.] Jacob Ross University of Southern California Any Way You Slice It: On Fission, Fusion and the Weighing of Welfare 1 [Please note: Citations have yet to be added.] It is generally thought that there are

More information

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions Readings: OpenStax Textbook - Chapters 1 5 (online) Appendix D & E (online) Plous - Chapters 1, 5, 6, 13 (online) Introductory comments Describe how familiarity with statistical methods can - be associated

More information

INVESTIGATING FIT WITH THE RASCH MODEL. Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form

INVESTIGATING FIT WITH THE RASCH MODEL. Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form INVESTIGATING FIT WITH THE RASCH MODEL Benjamin Wright and Ronald Mead (1979?) Most disturbances in the measurement process can be considered a form of multidimensionality. The settings in which measurement

More information

Chapter Three Research Methodology

Chapter Three Research Methodology Chapter Three Research Methodology Research Methods is a systematic and principled way of obtaining evidence (data, information) for solving health care problems. 1 Dr. Mohammed ALnaif METHODS AND KNOWLEDGE

More information

IMMEDIATE RELEASE THURSDAY, JUNE 18, 2015

IMMEDIATE RELEASE THURSDAY, JUNE 18, 2015 Eagleton Institute of Politics Rutgers, The State University of New Jersey 191 Ryders Lane New Brunswick, New Jersey 08901-8557 www.eagleton.rutgers.edu eagleton@rci.rutgers.edu 732-932-9384 Fax: 732-932-6778

More information

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions

Statistics is the science of collecting, organizing, presenting, analyzing, and interpreting data to assist in making effective decisions Readings: OpenStax Textbook - Chapters 1 5 (online) Appendix D & E (online) Plous - Chapters 1, 5, 6, 13 (online) Introductory comments Describe how familiarity with statistical methods can - be associated

More information

Unit 1 Exploring and Understanding Data

Unit 1 Exploring and Understanding Data Unit 1 Exploring and Understanding Data Area Principle Bar Chart Boxplot Conditional Distribution Dotplot Empirical Rule Five Number Summary Frequency Distribution Frequency Polygon Histogram Interquartile

More information

Which Comes First: Poor Psychological Well-Being or Decreased Friendship Activity?

Which Comes First: Poor Psychological Well-Being or Decreased Friendship Activity? Which Comes First: Poor Psychological Well-Being or Decreased Friendship Activity? By: Rebecca G. Adams Adams, R.G. 1988 Which Comes First: Poor Psychological Well-Being or Decreased Friendship Activity?

More information

Audio: In this lecture we are going to address psychology as a science. Slide #2

Audio: In this lecture we are going to address psychology as a science. Slide #2 Psychology 312: Lecture 2 Psychology as a Science Slide #1 Psychology As A Science In this lecture we are going to address psychology as a science. Slide #2 Outline Psychology is an empirical science.

More information

Survey Methods in Relationship Research

Survey Methods in Relationship Research Purdue University Purdue e-pubs Department of Psychological Sciences Faculty Publications Department of Psychological Sciences 1-1-2009 Survey Methods in Relationship Research Christopher Agnew Purdue

More information

Sociological Research Methods and Techniques Alan S.Berger 1

Sociological Research Methods and Techniques Alan S.Berger 1 Sociological Research Methods and Techniques 2010 Alan S.Berger 1 Sociological Research Topics Sociologists: Study the influence that society has on people s attitudes and behavior Seek to understand ways

More information

Exploring a Method to Evaluate Survey Response Scales

Exploring a Method to Evaluate Survey Response Scales Exploring a Method to Evaluate Survey Response Scales René Bautista 1, Lisa Lee 1 1 NORC at the University of Chicago, 55 East Monroe, Suite 2000, Chicago, IL 60603 Abstract We present results from a qualitative

More information

Linda R. Murphy and Charles D. Cowan, U.S. Bureau of the Census EFFECTS OF BOUNDING ON TELESCOPING IN THE NATIONAL CRIME SURVEY.

Linda R. Murphy and Charles D. Cowan, U.S. Bureau of the Census EFFECTS OF BOUNDING ON TELESCOPING IN THE NATIONAL CRIME SURVEY. EFFECTS OF BOUNDING ON TELESCOPING IN THE NATIONAL CRIME SURVEY Linda R. Murphy and Charles D. Cowan, U.S. Bureau of the Census Introduction In a general population sample survey calling for respondent

More information

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity

PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with

More information

CONTEXT EFFECTS IN SOCIAL SURVEYS: BETWEEN INSTRUMENT AND RESPONDENT

CONTEXT EFFECTS IN SOCIAL SURVEYS: BETWEEN INSTRUMENT AND RESPONDENT * CONTEXT EFFECTS IN SOCIAL SURVEYS: BETWEEN INSTRUMENT AND RESPONDENT Abstract. The intention of this article is to examine the nature of cognitive representations that respondents create and utilise

More information

The Role of Modeling and Feedback in. Task Performance and the Development of Self-Efficacy. Skidmore College

The Role of Modeling and Feedback in. Task Performance and the Development of Self-Efficacy. Skidmore College Self-Efficacy 1 Running Head: THE DEVELOPMENT OF SELF-EFFICACY The Role of Modeling and Feedback in Task Performance and the Development of Self-Efficacy Skidmore College Self-Efficacy 2 Abstract Participants

More information

Psychology: The Science

Psychology: The Science Psychology: The Science How Psychologists Do Research Ex: While biking, it seems to me that drivers of pick up trucks aren t as nice as car drivers. I make a hypothesis or even develop a theory that p/u

More information

MBA SEMESTER III. MB0050 Research Methodology- 4 Credits. (Book ID: B1206 ) Assignment Set- 1 (60 Marks)

MBA SEMESTER III. MB0050 Research Methodology- 4 Credits. (Book ID: B1206 ) Assignment Set- 1 (60 Marks) MBA SEMESTER III MB0050 Research Methodology- 4 Credits (Book ID: B1206 ) Assignment Set- 1 (60 Marks) Note: Each question carries 10 Marks. Answer all the questions Q1. a. Differentiate between nominal,

More information

A Framework Relating Questionnaire Design and Evaluation Processes to Sources of Measurement Error 1

A Framework Relating Questionnaire Design and Evaluation Processes to Sources of Measurement Error 1 A Framework Relating Questionnaire Design and Evaluation Processes to Sources of Measurement Error 1 James L. Esposito Bureau of Labor Statistics, Postal Square Building, Room 4985 2 Massachusetts Avenue,

More information

It is often implied, and sometimes explicitly asserted, that folk psychology is best

It is often implied, and sometimes explicitly asserted, that folk psychology is best Folk Psychology and Folk Morality: Response to Critics 1 Joshua Knobe Princeton University It is often implied, and sometimes explicitly asserted, that folk psychology is best understood as a kind of predictive

More information

Durkheim. Durkheim s fundamental task in Rules of the Sociological Method is to lay out

Durkheim. Durkheim s fundamental task in Rules of the Sociological Method is to lay out Michelle Lynn Tey Meadow Jane Jones Deirdre O Sullivan Durkheim Durkheim s fundamental task in Rules of the Sociological Method is to lay out the basic disciplinary structure of sociology. He begins by

More information

How consumption influences our self-image Effects of material values and loneliness on self-image stability. Bachelor thesis Stephanie Haen ANR

How consumption influences our self-image Effects of material values and loneliness on self-image stability. Bachelor thesis Stephanie Haen ANR 1 How consumption influences our self-image Effects of material values and loneliness on self-image stability Bachelor thesis Stephanie Haen ANR 553186 Supervisor: Dr. R.M.A. Nelissen Department of Social

More information

Some Implications for Contingent Valuation Surveys

Some Implications for Contingent Valuation Surveys Survey Methodology Program Working Paper Series Cognition, Communication, and Survey Measurement: Some Implications for Contingent Valuation Surveys Norbert Schwarz N tt 007 Survey Methodology Program

More information

Attitude Measurement

Attitude Measurement Business Research Methods 9e Zikmund Babin Carr Griffin Attitude Measurement 14 Chapter 14 Attitude Measurement 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or

More information

Temporalization In Causal Modeling. Jonathan Livengood & Karen Zwier TaCitS 06/07/2017

Temporalization In Causal Modeling. Jonathan Livengood & Karen Zwier TaCitS 06/07/2017 Temporalization In Causal Modeling Jonathan Livengood & Karen Zwier TaCitS 06/07/2017 Temporalization In Causal Modeling Jonathan Livengood & Karen Zwier TaCitS 06/07/2017 Introduction Causal influence,

More information

CHAPTER 2. MEASURING AND DESCRIBING VARIABLES

CHAPTER 2. MEASURING AND DESCRIBING VARIABLES 4 Chapter 2 CHAPTER 2. MEASURING AND DESCRIBING VARIABLES 1. A. Age: name/interval; military dictatorship: value/nominal; strongly oppose: value/ ordinal; election year: name/interval; 62 percent: value/interval;

More information

American Views on Stem Cell Research Summary of Survey Findings. Results for America

American Views on Stem Cell Research Summary of Survey Findings. Results for America March 2000 American Views on Stem Cell Research Summary of Survey Findings Prepared for: Results for America A Project of Civil Society Institute Prepared by OPINION RESEARCH CORPORATION February 15, 2005

More information

PROBABILITY Page 1 of So far we have been concerned about describing characteristics of a distribution.

PROBABILITY Page 1 of So far we have been concerned about describing characteristics of a distribution. PROBABILITY Page 1 of 9 I. Probability 1. So far we have been concerned about describing characteristics of a distribution. That is, frequency distribution, percentile ranking, measures of central tendency,

More information

Item-Nonresponse and the 10-Point Response Scale in Telephone Surveys

Item-Nonresponse and the 10-Point Response Scale in Telephone Surveys Vol. 5, Issue 4, 2012 Item-Nonresponse and the 10-Point Response Scale in Telephone Surveys Matthew Courser 1, Paul J. Lavrakas 2 Survey Practice 10.29115/SP-2012-0021 Dec 01, 2012 Tags: measurement error,

More information

Funnelling Used to describe a process of narrowing down of focus within a literature review. So, the writer begins with a broad discussion providing b

Funnelling Used to describe a process of narrowing down of focus within a literature review. So, the writer begins with a broad discussion providing b Accidental sampling A lesser-used term for convenience sampling. Action research An approach that challenges the traditional conception of the researcher as separate from the real world. It is associated

More information

RESPONSE FORMATS HOUSEKEEPING 4/4/2016

RESPONSE FORMATS HOUSEKEEPING 4/4/2016 RESPONSE FORMATS Allyson L. Holbrook Associate Professor of Public Administration and Psychology & Associate Research Professor at the Survey Research Laboratory of the University of Illinois at Chicago

More information

CONTRADICTIONS ON THE ABORTION SCALE BY TOM W. SMITH CHICAGO, ILLINOIS. NATIONAL OPIONION RESEARCH CENTER September, 1981

CONTRADICTIONS ON THE ABORTION SCALE BY TOM W. SMITH CHICAGO, ILLINOIS. NATIONAL OPIONION RESEARCH CENTER September, 1981 CONTRADICTIONS ON THE ABORTION SCALE BY TOM W. SMITH CHICAGO, ILLINOIS GSS Mc*o~~\~~\clc,\ t2crcct NO. NATIONAL OPIONION RESEARCH CENTER September, 1981 This research was done for the General Social Survey

More information

Developing a Comprehensive and One-Dimensional Subjective Well-Being Measurement: Evidence from a Belgian Pilot Survey

Developing a Comprehensive and One-Dimensional Subjective Well-Being Measurement: Evidence from a Belgian Pilot Survey Developing a Comprehensive and One-Dimensional Subjective Well-Being Measurement: Evidence from a Belgian Pilot Survey Marc Hooghe 1 1 University of Leuven (Belgium), e-mail: Marc.Hooghe@soc.kuleuven.be

More information

Math 140 Introductory Statistics

Math 140 Introductory Statistics Math 140 Introductory Statistics Professor Silvia Fernández Sample surveys and experiments Most of what we ve done so far is data exploration ways to uncover, display, and describe patterns in data. Unfortunately,

More information

so that a respondent may choose one of the categories to express a judgment about some characteristic of an object or of human behavior.

so that a respondent may choose one of the categories to express a judgment about some characteristic of an object or of human behavior. Effects of Verbally Labeled Anchor Points on the Distributional Parameters of Rating Measures Grace French-Lazovik and Curtis L. Gibson University of Pittsburgh The hypothesis was examined that the negative

More information

Creative Commons Attribution-NonCommercial-Share Alike License

Creative Commons Attribution-NonCommercial-Share Alike License Author: Brenda Gunderson, Ph.D., 2015 License: Unless otherwise noted, this material is made available under the terms of the Creative Commons Attribution- NonCommercial-Share Alike 3.0 Unported License:

More information

Checking the counterarguments confirms that publication bias contaminated studies relating social class and unethical behavior

Checking the counterarguments confirms that publication bias contaminated studies relating social class and unethical behavior 1 Checking the counterarguments confirms that publication bias contaminated studies relating social class and unethical behavior Gregory Francis Department of Psychological Sciences Purdue University gfrancis@purdue.edu

More information

Chapter 11. Experimental Design: One-Way Independent Samples Design

Chapter 11. Experimental Design: One-Way Independent Samples Design 11-1 Chapter 11. Experimental Design: One-Way Independent Samples Design Advantages and Limitations Comparing Two Groups Comparing t Test to ANOVA Independent Samples t Test Independent Samples ANOVA Comparing

More information

A Probability Puzzler. Statistics, Data and Statistical Thinking. A Probability Puzzler. A Probability Puzzler. Statistics.

A Probability Puzzler. Statistics, Data and Statistical Thinking. A Probability Puzzler. A Probability Puzzler. Statistics. Statistics, Data and Statistical Thinking FREC 408 Dr. Tom Ilvento 213 Townsend Hall Ilvento@udel.edu A Probability Puzzler Pick a number from 2 to 9. It can be 2 or it can be 9, or any number in between.

More information

Combining Dual Scaling with Semi-Structured Interviews to Interpret Rating Differences

Combining Dual Scaling with Semi-Structured Interviews to Interpret Rating Differences A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

Americans Current Views on Smoking 2013: An AARP Bulletin Survey

Americans Current Views on Smoking 2013: An AARP Bulletin Survey Americans Current Views on Smoking 2013: An AARP Bulletin Survey November 2013 Americans Current Views on Smoking 2013: An AARP Bulletin Survey Report Prepared by Al Hollenbeck, Ph.D. Copyright 2013 AARP

More information

Mindful Beings: Visitors Descriptions of Emotions, Intelligence, Consciousness, Creativity, and Mind. Joyce Ma. January 2002

Mindful Beings: Visitors Descriptions of Emotions, Intelligence, Consciousness, Creativity, and Mind. Joyce Ma. January 2002 Mindful Beings: Visitors Descriptions of Emotions, Intelligence, Consciousness, Creativity, and Mind Joyce Ma January 2002 Keywords: 1 Mind and Learning - Front-End Evaluation

More information