Journal of Experimental Psychology: Learning, Memory, and Cognition
|
|
- Adele McCormick
- 5 years ago
- Views:
Transcription
1 Journal of Experimental Psychology: Learning, Memory, and Cognition Base Rates: Both Neglected and Intuitive Gordon Pennycook, Dries Trippas, Simon J. Handley, and Valerie A. Thompson Online First Publication, November 11, doi: /a CITATION Pennycook, G., Trippas, D., Handley, S. J., & Thompson, V. A. (2013, November 11). Base Rates: Both Neglected and Intuitive. Journal of Experimental Psychology: Learning, Memory, and Cognition. Advance online publication. doi: /a
2 Journal of Experimental Psychology: Learning, Memory, and Cognition 2013, Vol. 40, No. 1, American Psychological Association /13/$12.00 DOI: /a Base Rates: Both Neglected and Intuitive Gordon Pennycook University of Waterloo Dries Trippas and Simon J. Handley Plymouth University Valerie A. Thompson University of Saskatchewan Base-rate neglect refers to the tendency for people to underweight base-rate probabilities in favor of diagnostic information. It is commonly held that base-rate neglect occurs because effortful (Type 2) reasoning is required to process base-rate information, whereas diagnostic information is accessible to fast, intuitive (Type 1) processing (e.g., Kahneman & Frederick, 2002). To test this account, we instructed participants to respond to base-rate problems on the basis of beliefs or statistics, both in free time (Experiments 1 and 3) and under a time limit (Experiment 2). Participants were given problems with salient stereotypes (e.g., Jake lives in a beautiful home in a posh suburb ) that either conflicted or coincided with base-rate probabilities (e.g., Jake was randomly selected from a sample of 5 doctors and 995 nurses for conflict; 995 doctors and 5 nurses for nonconflict ). If utilizing base-rates requires Type 2 processing, they should not interfere with the processing of the presumably faster belief-based judgments, whereas belief-based judgments should always interfere with statistics judgments. However, base-rates interfered with belief judgments to the same extent as the stereotypes interfered with statistical judgments, as indexed by increased response time and decreased confidence for conflict problems relative to nonconflict. These data suggest that baserates, while typically underweighted or neglected, do not require Type 2 processing and may, in fact, be accessible to Type 1 processing. Keywords: dual-process theories, base-rate neglect, conflict detection, intuition Supplemental materials: Much research has demonstrated that preconceived notions about representativeness can influence probability judgments (Barbey & Sloman, 2007; Kahneman & Tversky, 1973; Tversky & Kahneman, 1974). For example, given a description of a randomly sampled male U.S. citizen described as being shy and introverted, one might judge that he is more likely to be a librarian than a farmer, even though there are roughly 20 times more farmers than librarians in the United States (Kahneman, 2011). These types of biased judgments are thought to occur because representativeness cues an intuitive response that is difficult to override (Kahneman & Frederick, 2002; Kahneman & Tversky, 1973; Tversky & Kahneman, 1974). It is also frequently assumed by dual process theorists that some degree of slow and deliberative Type 2 processing is required for prior probabilities to enter into judgment, indicating that a disparity in the ease with which base-rates and stereotypes are processed is the source of base-rate neglect (e.g., Bonner & Newell, 2010; De Neys & Glumicic, 2008; Ferreira, Garcia-Marques, Sherman, & Sherman, 2006; Kahneman & Frederick, 2002). This perspective is theoretically grounded in dual-process theory, which postulates a fundamental cognitive difference between autonomous Type 1 processes and working memory dependent Type 2 processes (Evans, 2008; Evans & Stanovich, 2013; Kahneman, 2003; Sloman, 1996; Stanovich, 2004; Thompson, 2013). In this work we adapt an instruction manipulation from a deductive reasoning paradigm (Handley, Newstead, & Trippas, 2011) to test this analytic base-rate account of base-rate neglect. Gordon Pennycook, Department of Psychology, University of Waterloo, Waterloo, Ontario, Canada; Dries Trippas and Simon J. Handley, Department of Psychology, Plymouth University, Plymouth, England; Valerie A. Thompson, Department of Psychology, University of Saskatchewan, Saskatoon, Saskatchewan, Canada. This research was funded, in part, by a Discovery Grant from the Natural Engineering and Research Council of Canada to Valerie Thompson. Gordon Pennycook and Dries Trippas contributed equally to this work. Correspondence concerning this article should be addressed to Gordon Pennycook, Department of Psychology, University of Waterloo, 200 University Avenue West, Waterloo, ON, Canada, N2L 3G1. gpennyco@uwaterloo.ca 1 Base-Rate Neglect Consider the following example (De Neys & Glumicic, 2008, adapted from Kahneman & Tversky, 1973): In a study 1,000 people were tested. Among the participants there were 995 nurses and five doctors. Jake is a randomly chosen participant of this study. Jake is 34 years old. He lives in a beautiful home in a posh suburb. He is well spoken and very interested in politics. He invests a lot of time in his career.
3 2 PENNYCOOK, TRIPPAS, HANDLEY, AND THOMPSON What is more likely? (a) Jake is a nurse. (b) Jake is a doctor. This very basic type of base-rate problem contains two conflicting pieces of information: (a) a base-rate probability that suggests Jake is likely to be a nurse, and (b) a stereotypical description that suggests Jake is likely to be a doctor. Decades of research has demonstrated that people have a strong tendency to favor the diagnostic information over the base-rates, leading to the term base-rate neglect (Kahneman & Tversky, 1973; Tversky & Kahneman, 1974). Further, participants higher in cognitive abilities (i.e., intelligence, working memory capacity, etc.) and/or more disposed to analytic thought are more likely to use base-rate information during reasoning (Pennycook, Cheyne, Barr, Koehler, & Fugelsang, 2013; Pennycook, Cheyne, Seli, Koehler, & Fugelsang, 2012; but see Stanovich & West, 2008). It is frequently claimed and broadly accepted that diagnostic information, such as stereotypes, are preferred over base-rates because the two types of information are processed very differently (see Barbey & Sloman, 2007, for a review). Proponents of fuzzy-trace theory, for example, contend that base-rate neglect occurs because diagnostic information cues intuitive gist-based associations in memory, whereas base-rates are processed via more analytical verbatim-based reasoning (Reyna, 2004; Reyna & Brainerd, 2008; Reyna & Mills, 2007; Wolfe & Fisher, 2013). Such dual-process theories, including more general versions that nonetheless presume that base-rates, unlike diagnostic information, require analytic reasoning (e.g., Barbey & Sloman, 2007; De Neys & Glumicic, 2008; Ferreira et al., 2006; Kahneman & Frederick, 2002), are supported by the finding that problem structure factors that allow base-rates to be more easily processed make base-rate neglect much less prominent (Barbey & Sloman, 2007; Brainerd, 2007; Reyna & Mills, 2007). For example, Barbey and Sloman (2007) argued that frequency formats make the nested set nature of the problem more evident, which induces people to substitute associative (Type 1) processing with rule-based (Type 2) processing thereby leading to decreased levels of base-rate neglect. More generally, on this view participants tend to neglect or underweight the base-rates because humans tend to forego Type 2 (T2) processing; and those who are more willing and able to think analytically are more likely to override the intuitive stereotypical response and employ the base-rate information. However, as pointed out by De Neys (2007), there is limited evidence that utilizing base-rates actually requires T2 processing. Moreover, recent research by Pennycook and Thompson (2012) has called this account into question, suggesting instead that baserates may be evaluated using Type 1 (T1) processing. Participants evaluated problems similar to the above example; however, the base-rates were excluded for half of the participants. The base-rate problems did not elicit longer response times relative to cases where base-rates were excluded despite evidence that participants incorporated them into their judgments. This finding is inconsistent with the claim that base-rates require slow, T2 processing. Also, contrary to the assumption that stereotypes are always processed in a primarily intuitive manner, participants were just as likely to change their answer in the direction of the stereotype as they were to change it in the direction of the base-rate when given the opportunity to rethink their answer. This evidence suggests T1 processes are used to evaluate both base-rates and stereotypes and, in cases where they conflict, T2 processing is required to resolve the conflict in one direction over the other. Thus, the evidence indicates that both base-rates and stereotypes can be processed quickly and that both are also processed analytically, contrary to the assumption that belief information is only processed quickly via T1 processes and that utilizing base-rates requires slower, T2 processing. Conflict Detection and Base-Rate Neglect Researchers have manipulated base-rate problems so that the base-rates either conflict or coincide with the diagnostic information (see Appendix) to determine whether base-rates are entirely neglected or, rather, if they have subtle effects on behavior when they conflict with diagnostic information. In a series of experiments, it has been shown that conflict problems elicit longer response times (De Neys & Glumicic, 2008; Thompson, Prowse Turner, & Pennycook, 2011) and lower confidence (De Neys, Comheeke, & Osman, 2011; Thompson et al., 2011) relative to nonconflict problems. This interference as a result of conflict even arises when participants give the stereotypical response, which De Neys and colleagues have taken to suggest that humans are able to at least implicitly recognize when they are being biased (see De Neys, 2012, for a review). While the research by De Neys and colleagues did not set out to investigate base-rate neglect per se, their findings were originally interpreted under the analytic base-rate view (De Neys, Comheeke, & Osman, 2011; De Neys & Franssens, 2009; De Neys & Glumicic, 2008; De Neys, Vartanian, & Goel, 2008; Franssens & De Neys, 2009). As discussed recently by De Neys (2012), the issue of whether base-rates are accessible to T1 processing (and therefore do not require T2 processing) has implications for the nature of conflict detection, particularly as it applies specifically to base-rate neglect. If comprehending base-rates requires T2 processing, some level of analytic reasoning is therefore necessary for conflicts between base-rates and stereotypes to be detected. However, participants were able to detect the conflict under a working memory load, suggesting that conflict detection is highly efficient and relatively effortless (Franssens & De Neys, 2009), at least when the base-rates are salient (Pennycook, Fugelsang, & Koehler, 2012). On the basis of this (among other studies), De Neys (2012) has rejected the earlier stance that the detected conflict is between a T1 (stereotype) and a T2 (base-rate) response, and now, consistent with Pennycook and Thompson (2012) and Thompson et al. (2011), claims that the conflict is between the outputs of two sets of T1 processes (see also De Neys & Bonnefon, 2013). Again, given that conflict detection is a general phenomenon that has been established using a number of reasoning tasks (such as syllogisms, De Neys & Franssens, 2009; De Neys, Moyens, & Vansteenwegen, 2010; the conjunction fallacy, De Neys et al., 2011; Villejoubert, 2009; ratio bias, Bonner & Newell, 2010; and the Cognitive Reflection Test; De Neys, Rossi, & Houdé, 2013), De Neys s (2012) T1-T1 conflict stance was not intended as a specific theory of base-rate neglect, though it is consistent with the perspective of Pennycook and Thompson (2012; see also Pennycook, Fugelsang, & Koehler, 2012; Thompson et al., 2011) and inconsistent with the analytic base-rate view that is prominent in the field (e.g.,
4 BASE RATES ARE INTUITIVE 3 Barbey & Sloman, 2007; Ferreira et al., 2006; Kahneman & Frederick, 2002). Research Paradigm As with base-rate problems, participants are able to reliably detect conflict between logical validity and conclusion believability inherent in relatively simple syllogisms (De Neys & Franssens, 2009; De Neys et al., 2010). Perhaps unsurprisingly, then, a parallel debate has arisen in the deductive reasoning literature where some authors have claimed that people have an intuitive sense of logical validity (e.g., Morsanyi & Handley, 2012; but see Klauer & Singmann, 2012). Following those who have used instructional manipulations to investigate the relationship between deductive and inductive reasoning (Heit & Rotello, 2010; Rotello & Heit, 2009), Handley, Newstead, and Trippas (2011) instructed participants to judge both the logical validity and the believability of a series of simple reasoning problems. The instances of interest were problems in which logic and belief conflicted. The common view of belief bias is very similar to that of base-rate neglect, namely, that T1 processes produce belief-based judgments that are difficult to overturn via analytic T2 processing (e.g., Newstead, Pollard, Evans, & Allen, 1992; Sá, West, & Stanovich, 1999). Contrary to this account, participants were quicker and more accurate at making logic judgments than belief judgments. More important, belief-logic conflict actually interfered more with belief judgments during reasoning than with logic judgments. That is, inhibiting logical considerations appears more difficult than inhibiting belief-based considerations for simple propositional reasoning problems. It was concluded that (a) making logically valid judgments does not necessarily require T2 processing, and (b) making belief-based judgments does not exclusively rely on T1 processing. In the current work, we test the hypothesis that utilizing baserates requires T2 processing by adapting this instruction manipulation for base-rate problems. Whereas logic and belief conflict for syllogisms, base-rate probabilities and stereotypes (belief) conflict for base-rate problems. According to the analytic base-rate view, information about beliefs enter into judgment autonomously via T1 processes and should therefore interfere with the slower, more deliberate T2 processing required to evaluate the base-rates. In addition, because the base-rates should be processed more slowly, they should not interfere with judgments based on the stereotype. Thus, if instructed to respond according to belief, participants should be able to make probability estimates that accord strongly with the stereotypes, respond quickly, and be highly confident regardless of whether base-rates and stereotypes conflict. In contrast, when instructed to respond according to statistics, participants should have difficulty inhibiting the intuitive diagnostic information, leading to slower response time, decreased confidence, and less accurate probability estimates for conflict problems. However, if base-rates can be comprehended by T1 processes, responding under statistics instructions should be no more difficult than responding under belief instructions and the conflict between the two pieces of information should make these problems difficult, regardless of instructions. This should lead to longer response times, lower confidence, and less accurate probability estimates for conflict relative to nonconflict problems for both belief and statistics judgments. Experiment 1 By analogy to Handley et al. (2011), we presented people with a series of base-rate neglect problems under either belief or statistics instructions. Belief instructions required participants to respond according to their knowledge of what they think to be true in the world ; these instructions were designed to cue responding on the basis of the stereotypical description while ignoring the base-rate. Conversely, under statistics instructions, participants were told to assume that their prior beliefs about the world are not necessarily relevant and that they should concentrate on the actual probability that something will happen. Participants were therefore led to respond on the basis of the base-rate while ignoring the stereotypical description for the statistics instructions. The goal of the instruction manipulation was to lead participants to focus on one of the two categories of information in the base-rate problems (i.e., base-rates or stereotypes). The analytic base-rate view outlined above predicts that participants should be less inclined to incorporate base-rates into their judgments when given the opportunity to respond according to beliefs because they should already have a representation of the problem derived from a highly accessible representativeness heuristic (Kahneman, 2003). Method Participants. A total of 48 undergraduate students volunteered to participate in exchange for course credit (23 from the University of Saskatchewan, Canada and 25 from Plymouth University, England). Of the participants, 25 were female and 23 were male. The mean age was 21 years (SD 4). Materials and procedure. The participants received a total of 24 base-rate problems similar to those used by De Neys and Glumicic (2008). Twelve of the problems were taken from Thompson et al. (2011; previously adapted from De Neys & Glumicic, 2008) and 12 were novel. The stereotypes for the 12 novel problems were developed from adjective typicality ratings for a series of professions taken using data from an earlier study (Neilens, Handley, & Newstead, 2009). Stereotypical descriptions of comparable length to those used by De Neys and Glumicic were developed by using the adjective that was rated to be the most diagnostic for each profession (see online supplemental materials for full set of problems). A pilot test using nine graduate student volunteers from Plymouth University ensured that all descriptions for both old and new items were stereotypical for the intended group and nondiagnostic for the complementary group (see results below). Participants were presented with two types of problems as defined by the relationship between the stereotypical description and the base-rates (see Appendix): (a) base-rates and stereotype suggested the same response (nonconflict), and (b) base-rates and stereotype suggested different responses (conflict). In addition, we created four neutral items in which the description was not diagnostic of either group. These were used as practice items. Two versions of the stimulus set were created wherein each stereotypical description matched the larger group (nonconflict) or the smaller group (conflict) an equal number of times. Three base-rate probability ratios were presented equally often; 995/5, 996/4, 997/3. Extreme ratios were used to remain consistent with the problem set that was used in earlier base-rate research (e.g., De Neys & Glumicic, 2008; De Neys et al., 2008; Pennycook, Fugel-
5 4 PENNYCOOK, TRIPPAS, HANDLEY, AND THOMPSON sang, & Koehler, 2012, 2013; Pennycook & Thompson, 2012; Thompson et al., 2011). Participants were asked to estimate the probability that the individual belonged to one of the two groups. The groups that were asked about were counterbalanced such that, for each question, the large group was asked about half the time, and the small group was asked about half of the time, allowing us to use the same description in both the nonconflict and conflict conditions (e.g., in the doctor problem presented earlier, changing the base-rate to 995 doctors and 5 nurses turns it into a nonconflict problem). Each participant received half the items in their nonconflict form and half in their conflict form; the items were counterbalanced across participants such that each item appeared equally often in each form. Problem order was randomized for each participant. After each judgment, participants were asked to rate their confidence on a scale from 1 7, ranging from not confident at all to very confident. The instructions were manipulated within participant, such that they responded on the basis of belief half the time and on the basis of statistics half the time: For each problem, you will be cued to answer either according to beliefs or according to statistics. When instructed to answer according to your beliefs, this means you must answer according to your knowledge of what you think to be true in the world. For example, if you met someone on the street who is dressed in very ragged clothing and asking for money, it is a good bet that such a person is homeless. If you were to be asked the probability that such a person is homeless, you would want to give a high probability because, based upon our knowledge of the world, people who dress in ragged clothing and ask for money on the street are usually homeless. In contrast, when instructed to answer according to statistics, this means you must assume that your prior beliefs about the world aren t necessarily relevant. Instead, you should concentrate on the actual probability that something will happen. For example, if you knew that only a small percentage of people in a city were homeless, then you would want to give a low probability because, based on statistics, only a small percentage of people are homeless. The instructions manipulation was counterbalanced across participants, such that the problems presented under belief instructions to half the participants were presented under statistics instructions to the other half, and vice versa. Participants were prompted with BELIEF or STATISTICS at the bottom of the screen for each problem in a randomized order. Results Pilot test. Nine volunteers who did not participate in the actual experiment were presented our 24 descriptions. For each description participants were given a 7-point Likert-type scale and asked to rate whether the information was more stereotypical for the intended target group ( 7) or a group for which the description was not intended ( 1). A score of 4 indicated that the information was not particularly diagnostic for either group. We tested whether the personality descriptions were rated as more diagnostic of the intended group than for the complementary group using a one-sample t test comparing the average rating per participant with the scale midpoint of four. The descriptions were significantly more diagnostic of the target groups than the nontargets (M 5.79, SD 0.50), t(8) 22.2, p.001. The internal consistency of the raters was on the high end of acceptable (Cronbach s.79). Scoring. The data in the conflict condition were recoded so that a high score always indicated a correct response given the instructions. This facilitated easy interpretation of the data. For instance, if there were 3 lawyers and 997 farmers in the sample and the participant was questioned about the probability of being a lawyer while under statistics instructions, a low probability estimate would indicate a response in line with the instructions. On the other hand, if the participant was questioned about the farmers, a high probability estimate would indicate a correct response. Under belief instructions, on the other hand, if the personality description was stereotypical for the lawyers and the participant was asked about the farmers under belief instructions, a low probability judgment would indicate compliance to the instructions. Finally, still under belief instructions, if the participant was questioned about the lawyers, a high probability judgment would be correct. To put all the trials on the same scale for comparison, we recoded the probability estimates for the relevant cases by subtracting them from 100 so that high values always indicated compliance with the instructions (hereafter referred to as correct probability estimates). Examples for each case can be found in the Appendix. Power analysis. We performed power analysis using More- Power 6.0 (Campbell & Thompson, 2012) to ensure power was adequately high to detect the crucial Conflict Instructions interaction. Handley et al. (2011) conducted five experiments with a very similar methodology and reported an average effect size for the interaction of 2 p.23 (range:.14.33). We calculated the power to detect an effect with a conservative assumed effect size of 2 p.15 for an alpha level of.05, given our sample. In the current experiment, power was acceptable (.81) given the sample of 48 participants. Probability estimates. We analyzed the probability estimates as scored to reflect compliance with the instructions (hereafter referred to as accuracy; see above) using a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: belief vs. statistics) repeated-measures analysis of variance (ANOVA). Probability estimates were less accurate for conflict (M 65.8) than nonconflict (M 81.3) trials, F(1, 47) 43.4, p.001, 2 p.48. No other effects approached significance(all Fs 1.5, all ps.22). In other words, conflict problems produced interference, regardless of whether people were instructed to judge on the basis of belief or statistics. Latency. We transformed the response times (RTs) using the natural logarithm RTs in Table 1 are in original units. The resulting values were submitted to a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: belief vs. statistics) repeatedmeasures ANOVA. A main effect of instructions was found, indicating that participants made faster judgments under statistics instructions (M s) than under belief instructions (M s), F(1, 47) 6.24, p.016, 2 p.12. There was no main effect of congruency, F(1, 47) 2.55, p.12, 2 p.05, although the trend is in the expected direction (i.e., longer RTs for conflict relative to nonconflict problems). The interaction did not approach significance (F 1, p.41). Confidence ratings. We performed a 2 (Congruency) 2 (Instructions) repeated-measures ANOVA on the confidence ratings data. There was a main effect of congruency, wherein people were less confident for judgments where stereotype and base-rate
6 BASE RATES ARE INTUITIVE 5 Table 1 Mean Probability Estimates, Response Times, and Confidence Ratings as a Function of Congruency and Instruction for Experiment 1 Variable Nonconflict Conflict Belief Statistics Total Belief Statistics Total M SEM M SEM M SEM M SEM M SEM M SEM Probability estimates Response time (seconds) Confidence (out of 7) information were in conflict (M 5.28) than when both cues suggested the same response (M 5.68), F(1, 47) 19.2, p.001, p A marginally significant interaction between congruency and instructions was also found, F(1, 47) 2.9, p.098, p Follow-up comparisons confirmed that participants were more confident in their judgments for nonconflict than for conflict trials for both belief, t(47) 3.04, p.004, and logic instructions, t(47) 3.71, p.001 (see Table 1). Discussion We found a strong effect of congruency on accuracy, but no main effect of the instruction manipulation. This finding suggests that processing the stereotypes interfered with making judgments on the basis of the base-rates but also that the base-rates interfered with making judgments on the basis of the stereotypes. The results from the confidence ratings converged on the same finding. At a minimum, this suggests that inhibiting the stereotypical information is no more difficult than inhibiting the base-rate probability. Somewhat surprisingly, statistics judgments were performed more quickly than belief judgments without any loss of confidence, or without affecting the ability to comply with the instructions when making probability judgments. These results are clearly inconsistent with the view that analytic processing is required for baserates to affect judgment. Rather, both base-rates and stereotypes appear to be accessible to intuitive processing. Experiment 2 In Experiment 1, the probability and the confidence data supported an account of base-rate neglect that allows for intuitive processing of base-rate probabilities. Although the latency data were less straightforward in terms of the congruency effect, overall, it was clearly not consistent with the view that utilizing base-rates requires analytic processing. In Experiment 2, we used a response deadline paradigm as a means to perform a stronger test of both accounts of base-rate neglect by limiting T2 processing. Limiting the time available to respond has been shown to interfere with analytic processing in deductive reasoning (Evans & Curtis- Holmes, 2005; Schroyens, Schaeken, & Handley, 2003). If both base-rate and stereotypes are accessible to T1 processing, baserates will interfere with stereotypes (and vice versa), as in E1, regardless of whether participants are asked to respond according to belief or statistics and regardless of the time deadline. In contrast, the analytic base-rate view suggests that participants should have difficulty responding according to the more analytic base-rate information, particularly when under time pressure. Method Participants. Eighty undergraduates from the University of Saskatchewan participated in exchange for course credit. There were 33 male and 47 female participants (M 25, SD 8). Materials and procedure. The materials and procedure were identical to those used in Experiment 1, with the exception of the time limit. Participants were instructed to respond within 5 s. After the time limit had passed, the problem text would go bold and red indicating that the participants had to respond immediately. Results Missing data. Participants responded within the time limit for 82% of the trials on average. We removed those participants who did not score within the time limit for at least half the trials (n 10). The remaining 70 participants responded within the imposed time limit for 89% of the trials. We excluded all responses that were not given within the time limit. Missing values were replaced by the cell mean (Handley et al., 2011). Power analysis. We calculated the power to detect a large effect ( 2 p.15) for an alpha level of.05 and given the current sample size (n 80 for the original sample but 70 for the actual analysis). Power was high (.93) for both cases. Probability estimates. The probability estimates were rescored in the manner described for Experiment 1. We submitted the estimates to a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: statistics vs. belief) repeated-measures ANOVA. The analysis resulted in a main effect of congruency with more accurate probability estimates for nonconflict (M 80.2) than conflict (M 60.3) items, F(1, 69) 104.4, p.001, 2 p.60 (see Table 2). No other effects reached significance (all Fs 2, all ps.17). Latency. All RTs were transformed using the natural logarithm RTs in Table 2 are in original units. We submitted the resulting values to a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: statistics vs. belief) repeated-measures ANOVA. The analysis resulted in a main effect of congruency showing that participants responded faster to nonconflict (M 3.69 s) than to conflict (M 3.80 s) trials, F(1, 69) 6.10, p.016, 2 p.08. No other effects approached significance (all Fs 1, all ps.50). Confidence ratings. The confidence ratings were submitted to a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: statistics vs. belief) repeated-measures ANOVA. The analysis resulted in a main effect of congruency, showing that people were more confident responding to nonconflict (M 5.53) than to conflict (M 5.31) trials, F(1, 69) 12.4, p.001, 2 p.15. No
7 6 PENNYCOOK, TRIPPAS, HANDLEY, AND THOMPSON Table 2 Mean Probability Estimates, Response Times, and Confidence Ratings as a Function of Congruency and Instruction for Experiment 2 Variable Nonconflict Conflict Belief Statistics Total Belief Statistics Total M SEM M SEM M SEM M SEM M SEM M SEM Probability estimates Response time (seconds) Confidence (out of 7) other effects approached significance (Fs 1, ps.70). See Table 2 for the means and standard deviations. Discussion As in Experiment 1, we found a strong effect of congruency on accuracy and confidence data regardless of the time deadline, but no main effect of the instruction manipulation. Participants also took longer to respond for conflict relative to no conflict problems, regardless of instruction. As above, base-rates interfered with belief judgments a finding that is not consistent with the claim that comprehending base-rates requires slower, T2 processes, whereas beliefs are processed using faster, T1 processes. Moreover, base-rates had robust effects on behavior even when participants were instructed to respond according to beliefs under a time deadline intended to minimize T2 processing. Experiment 3 In the previous two experiments we manipulated instruction as a within-participant factor. While the constant reminder about which type of information to focus on may have kept participants on task, it is also possible that switching from belief-based responding to statistics-based responding (and vice versa) may have led to increased interference as a function of response conflict. In other words, requiring participants to alternate use of base-rates and stereotypes within the same experiment may have increased the probability of conflict detection regardless of instruction. It is also possible that the act of switching in and of itself could create interference. To rule out these possible confounds we manipulated instruction as a between-participants factor in an online study. Method Participants. We recruited 120 participants online via Amazon Mechanical Turk. There were 67 male and 53 female participants (M age 36, SD 13.8). Materials and procedure. Items from Experiment 1 were presented to participants in a single random order. Participants were presented with either statistics or belief instructions based on whether their birthday falls on the first or second half of the year, counterbalanced across participants. This was done because the online format requires each condition to be run in-turn. Thus, participants filtered into the crucial two between-participants conditions at roughly equivalent times. Congruency was also counterbalanced across participants such that each problem was a conflict problem for half of the participants and a nonconflict problem for the other half. This yielded four between subjects conditions that were cycled through in-turn. Participants entered probability estimates in a text box and gave confidence ratings on a 7-point scale (as above). Items were presented on separate pages, although alongside confidence ratings. Results Missing data. Given that participants were not continually kept on task by a trial-by-trial instruction prompt, as in Experiments 1 and 2, we included a number of measures to ensure that only participants who followed the belief/statistics instructions were included in the analysis. Thus, participants were excluded from analysis for a number of reasons. Specifically, two participants were excluded because they had missing data, three indicated that they had seen similar problems before in previous studies, one person indicated that he or she was not fluent in English, and six people failed a check question included to ensure that participants were paying attention. 1 We also included three additional follow-up questions to ensure that participants followed the belief/ statistics instructions. Of the remaining participants, eight responded yes when asked, Did you forget at any point during the task to respond according to statistics? (or beliefs depending on condition), and six responded no when asked, Did you read all of the information for each problem carefully? Finally, and most important, participants were given an open-ended text box and asked the following question directly after completing the 24 base-rate problems (i.e., prior to the above check questions): At the beginning of this study, you were asked to respond to the problems using probability estimates based on what? In total, 27 of the remaining participants (28.7%) failed to correctly answer this question and were excluded on that basis. 2 Thus, 67 participants (31 statistics condition, 36 beliefs condition) remained in the final sample. None of the remaining participants had identical IP addresses. Power analysis. We calculated the power to detect a large effect ( 2 p.15) for an alpha level of.05 and given the retained sample size of 67 participants. As in the previous two Experiments, power to detect the interaction between congruency and instruction was sufficiently high (.92). 1 Participants were given a list of hobbies following a demographics questionnaire and asked Below is a list of hobbies. If you are reading these instructions please write I read the instructions in the other box. 2 We permitted some minimal leniency here. For example, probability or percentages were common answers in the statistics condition and knowledge of the world and experience came up in the belief condition.
8 BASE RATES ARE INTUITIVE 7 Probability estimates. We submitted the probability ratings recoded to signify correct responding to a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: statistics vs. belief) mixed ANOVA. The analysis resulted in a main effect of congruency with higher probability estimates for nonconflict (M 88.6) than conflict (M 64) items, F(1, 65) 59.47, p.001, 2 p.48 (see Table 3). No other effects reached significance(all Fs 1.5, all ps.23). 3 Confidence ratings. The confidence ratings were submitted to a 2 (Congruency: nonconflict vs. conflict) 2 (Instructions: statistics vs. belief) mixed ANOVA. The analysis resulted in a main effect of congruency, showing that people were more confident responding to nonconflict (M 5.83) than to conflict (M 5.26) trials, F(1, 65) 42.24, p.001, 2 p.39. No other effects approached significance (Fs 1, ps.35). 4 See Table 3 for the means and standard deviations. Discussion The results from Experiment 1 were replicated in a betweenparticipants design despite the fact that we were very conservative in our analysis, including only the participants who passed a number of check questions (representing 55.8% of the sample). These data rule out the possibility that switching from beliefbased to statistics-based judgments (and vice versa) explain the results from Experiments 1 and 2. We also note that the probability estimates and confidence ratings for the betweenparticipants online sample experiment (Table 3) closely parallel the data from the within-participant university sample experiments (Tables 1 and 2). General Discussion The finding that base-rates are underweighted or neglected is commonly explained by noting the compelling intuitive nature of stereotypical or diagnostic information and asserting a failure to adjust the response by integrating the base-rates via analytic reasoning processes (e.g., De Neys & Glumicic, 2008; Ferreira et al., 2006; Kahneman & Frederick, 2002). This assumption is consistent with the finding that reasoners who are more able and/or willing to engage in T2 processing are more likely to utilize base-rate information when making judgments (e.g., Pennycook et al., 2013). However, the data presented here indicate that, at the very least, extreme base-rates are accessible to rapid, T1 processing. Specifically, both belief and statistical judgments were made difficult by conflict, even when the possibility for T2 processing was reduced by imposing a time deadline. Finally, participants were just as fast and confident when responding according to statistics as when making judgments based on belief. These results all converge on the same conclusion: Base-rates probabilities (at least the extreme ones used in our study) are accessible to T1 processing and can influence beliefs just as beliefs can influence statistics judgments. Thus, the conflict observed between baserates and stereotypes may result from a conflict of T1 outputs, rather than a conflict between a T1 and T2 output (De Neys, 2012; Pennycook, Fugelsang, & Koehler, 2012; Pennycook & Thompson, 2012; Thompson et al., 2011). Why Are Base-Rates Neglected? Using a binary choice format, only roughly 18 24% of respondents typically choose the base-rate option over the stereotypical response for problems similar to the ones used here (De Neys & Glumicic, 2008; Pennycook, Fugelsang, & Koehler, 2012). If base-rates are accessible to intuitive processing, why are they routinely underweighted or, in some cases, neglected completely? One view is that base-rates are neglected because they require effortful analytic reasoning and that responses based upon explicit cues of this kind are preempted by intuitive judgments that draw upon readily available stereotypes (e.g., De Neys & Glumicic, 2008; Ferreira et al., 2006; Kahneman & Frederick, 2002). We suggest instead that participants typically respond according to stereotypes rather than base-rates not because the former is primarily intuitive and the latter is primarily analytic, but because the former is simply more salient than the latter in the base-rate problems that are typically constructed. Whereas the base-rates represent a single source of information, the descriptions that we presented contained three to five pieces of detailed information that reinforced the targeted stereotype (see supplemental materials for items). If we assume that the likelihood and strength of a particular intuitive output is affected by contextual factors such as this, it is no surprise that diagnostic information is typically favored over base-rate probabilities. This context-dependent view of base-rate use is consistent with recent research which shows that the percentage of base-rate responses for problems with rich sources of diagnostic information (as used here) tends to be very low (24%; Pennycook, Fugelsang, & Koehler, 2012). However, an alternative set of problems where the descriptions merely consisted of a set of five personality traits (e.g., orderly, organized, precise, practical and realistic) along with extreme base-rates, resulted in a majority (59%) of base-rate responses. How does this relative salience account explain existing data that seems to support the claim that utilizing base-rates requires T2 processing? Specifically, high capacity participants respond more often according to the base-rates than lower capacity individuals (Pennycook et al., 2013; but see Stanovich & West, 2008) and the mere willingness to engage analytic reasoning processes also predicts base-rate responding (Pennycook, Cheyne, et al., 2012). Consistent with the conclusions presented above, we speculate that the observed differences may be attributed to strategy choices. Under this explanation, the overall preference for diagnostic information likely has more to do with cognitive miserliness (i.e., nonanalytic cognitive style) and less to do with competence (i.e., absent or ineffective cognitive abilities) because, as our data indicate, it does not appear to be a processing deficit that leads to base-rate neglect. In other words, we suggest that the base-rates are typically recognized by all but that individuals who are willing to engage T2 processing consider them more explicitly. More miserly participants may focus on the more detailed stereotypical informa- 3 As would be expected, the excluded participants gave probability estimates that were (moderately) less in-line with the instruction relative to the included participants, t(106) 1.72, SE 2.95, p The excluded participants also had lower confidence for conflict (M 5.40) relative to nonconflict (M 5.85) problems, F(1, 40) 20.35, p.001, p Without the instruction manipulation, the task for the excluded participants would be akin to a standard base-rate neglect study.
9 8 PENNYCOOK, TRIPPAS, HANDLEY, AND THOMPSON Table 3 Mean Probability Estimates and Confidence Ratings as a Function of Congruency and Instruction for Experiment 3 Variable Nonconflict Conflict Belief Statistics Total Belief Statistics Total M SEM M SEM M SEM M SEM M SEM M SEM Probability estimates Confidence (out of 7) tion because it leads to a stronger intuitive response that comes to mind more fluently, leading to an increased feeling of rightness (Thompson et al., 2011, 2013). Participants who are more willing to engage analytic reasoning are simply more likely to weigh the base-rates against the stereotypes, given that the more salient diagnostic information remains the default, this leads to decreased levels of stereotypical responding. This process may also be facilitated by the possibility that more analytic individuals are better able to detect conflicts between cognitive outputs, leading to increased deliberative weighing of the conflicting responses against each other (Pennycook et al., 2013). This account is consistent with the finding that analytic cognitive style is more predictive of base-rate responding than cognitive ability (Pennycook, Cheyne, et al., 2012, 2013; Stanovich & West, 2008), though this finding needs to be replicated using full IQ scales. It is also consistent with the finding that neutral base-rate problems (i.e., items that lack stereotypical content) are associated with lower feelings of rightness than problems with stereotypical content, regardless of conflict status (Thompson et al., 2011). We note, in addition, that interpretation of the individual difference data is also complicated by the fact that the normatively correct response to typical base-rate problems according to Bayes theorem is to combine the diagnostic and base-rate probabilities, a strategy that does not appear to arise very often for conflict problems (Pennycook & Thompson, 2012). Another finding that appears to support the claim that utilizing base-rates requires T2 processing is that base-rate neglect has been shown to increase for conflict problems when participants were given a working memory load, suggesting a decrease in base-rate processing concurrent with a disruption of T2 processing (Franssens & De Neys, 2009). However, Franssens and De Neys (2009) also demonstrated that recall of base-rates was not affected by the working memory load, indicating that the base-rates were processed despite the decrease in base-rate responding. Moreover, as previously discussed, giving participants an opportunity to rethink an initial response leads to a roughly equal proportion of answer changes toward the base-rates as away from them (Pennycook & Thompson, 2012). These findings indicate that while T2 processing is not likely required for base-rates to enter into judgment, T2 processing may nonetheless be necessary to decide between the two sources of conflicting information. Dual-Process Theory and Intuitive Base-Rates Given that our data are inconsistent with the standard dualprocess explanation of base-rate neglect, one might wonder why we have nonetheless framed our results in terms of dual-process theory. One could argue, for example, that the claim that base-rates are accessible to T1 processing is a violation of the definition of T1 processing as evolutionarily old, contextualized, and isolated to implicit knowledge (for overviews of dual-process theories, see Evans, 2008, 2009; Evans & Frankish, 2009; Evans & Stanovich, 2013; Sloman, 1999; Stanovich, 2009; Stanovich & West, 2000). However, as recently discussed by Evans and Stanovich (2013), factors such as contextualization are typical correlates of T1 or T2 processes, but not defining features. Evans and Stanovich have isolated the use of working memory and the processes of cognitive decoupling and mental simulation as defining features of T2 processing. In contrast, T1 processes are considered autonomous and operate independently of working memory. Thus, although baserates may not be intuitive in the sense that they cue a cognitive output via gist-based associations in memory (Reyna, 2004, 2012; Reyna & Brainerd, 2008), it is possible that the use of base-rates in judgment has been practiced enough by adulthood that they are part of an encapsulated knowledge base that is accessible to T1 processing (Stanovich, West, & Toplak, 2011). This potentially explains how a simple but nonetheless abstract probabilistic concept can be processed via T1 processes. The finding that base-rates interfered with purportedly beliefbased judgments suggests that they entered into judgment autonomously; i.e., the execution of the T1 process was mandatory once the stimulus was encountered (Evans & Stanovich, 2013; Thompson, 2013). However, it is not necessarily true that the autonomous instantiation of the rule if stimulus then response is qualitatively different from more deliberative T2 processes (Kruglanski, 2013; Kruglanski & Gigerenzer, 2011). This forms part of a larger debate that certainly will not be resolved here (see Evans & Stanovich, 2013; Keren, 2013; Kruglanski, 2013; Osman, 2013; Thompson, 2013). However, our data do speak to this debate. Specifically, the finding that conflict selectively increases response time is parsimoniously explained in a dual-process framework as an increase in T2 processing that is required to resolve the conflict between two cognitive outputs. The difficulty that participants apparently have deciding between the base-rates and stereotypes (Pennycook & Thompson, 2012) is not at all surprising given the claim that cognitive decoupling is a primary function of (typically) more effortful T2 processing (Stanovich, 2009, 2011). Our data indicate that participants must actively inhibit the conflicting source of information to solve the problem, a process that seems to be fundamentally different from the one that engendered the output in the first place. Additional Implications These data have implications for research outside of base-rate neglect. In Experiment 2, participants had lower confidence and
Journal of Experimental Psychology: Learning, Memory, and Cognition
Journal of Experimental Psychology: Learning, Memory, and Cognition Conflict and Bias in Heuristic Judgment Sudeep Bhatia Online First Publication, September 29, 2016. http://dx.doi.org/10.1037/xlm0000307
More informationThe influence of conflict monitoring on meta-reasoning and response times in a base rate task
Page of 0 0 0 0 0 0 The influence of conflict monitoring on meta-reasoning and response times in a base rate task Marin Dujmović*, Pavle Valerjev Department of Psychology, University of Zadar, Zadar, Croatia
More informationConflict detection in dual-process theory: Are we good at detecting when we are biased in decision making? Gordon Pennycook.
Conflict detection in dual-process theory: Are we good at detecting when we are biased in decision making? by Gordon Pennycook A thesis presented to the University of Waterloo in fulfilment of the thesis
More informationThompson, Valerie A, Ackerman, Rakefet, Sidi, Yael, Ball, Linden, Pennycook, Gordon and Prowse Turner, Jamie A
Article The role of answer fluency and perceptual fluency in the monitoring and control of reasoning: Reply to Alter, Oppenheimer, and Epley Thompson, Valerie A, Ackerman, Rakefet, Sidi, Yael, Ball, Linden,
More informationWhat Makes us Think? A Three-Stage Dual-Process Model of Analytic Engagement. Gordon Pennycook. A thesis. presented to the University of Waterloo
What Makes us Think? A Three-Stage Dual-Process Model of Analytic Engagement by Gordon Pennycook A thesis presented to the University of Waterloo in fulfilment of the thesis requirement for the degree
More informationA perspective on the theoretical foundation of dual-process models. Gordon Pennycook Yale University
1 A perspective on the theoretical foundation of dual-process models Gordon Pennycook Yale University To appear in W. De Neys (Ed.), Dual Process Theory 2.0. New York, NY: Psychology Press. Author Note
More informationTasks That Prime Deliberative Processes Boost Base Rate Use
Tasks That Prime Deliberative Processes Boost Base Rate Use Natalie A. Obrecht (obrechtn@wpunj.edu) William Paterson University, Department of Psychology 300 Pompton Road Wayne, NJ 07470 USA Dana L. Chesney
More informationImplicit Conflict Detection During Decision Making
Implicit Conflict Detection During Decision Making Wim De Neys (Wim.Deneys@psy.kuleuven.be) Department of Psychology, K.U.Leuven, Tiensestraat 102 3000 Leuven, Belgium Abstract Popular dual process theories
More informationWhy Does Similarity Correlate With Inductive Strength?
Why Does Similarity Correlate With Inductive Strength? Uri Hasson (uhasson@princeton.edu) Psychology Department, Princeton University Princeton, NJ 08540 USA Geoffrey P. Goodwin (ggoodwin@princeton.edu)
More informationIntuitive Confidence Reflects Speed of Initial Responses in Point Spread Predictions. Alexander C. Walker. A thesis
Intuitive Confidence Reflects Speed of Initial Responses in Point Spread Predictions by Alexander C. Walker A thesis presented to the University of Waterloo in fulfilment of the thesis requirement for
More informationBias and Conflict: A Case for Logical Intuitions
Bias and Conflict: A Case for Logical Intuitions Perspectives on Psychological Science 7(1) 28 38 The Author(s) 2012 Reprints and permission: sagepub.com/journalspermissions.nav DOI: 10.1177/1745691611429354
More informationUsing metacognitive cues to infer others thinking
Judgment and Decision Making, Vol. 9, No. 4, July 2014, pp. 349 359 Using metacognitive cues to infer others thinking André Mata Tiago Almeida Abstract Three studies tested whether people use cues about
More informationDual-Process Theories: Questions and Outstanding Issues. Valerie A. Thompson University of Saskatchewan
Dual-Process Theories: Questions and Outstanding Issues Valerie A. Thompson University of Saskatchewan Outline Why do we need Dual Process Theories? Integrate with each other, cognitive theories Integration
More informationIs It Time for a Tri-Process Theory? Distinguishing the Reflective and the Algorithmic Mind. Keith E. Stanovich University of Toronto
Is It Time for a Tri-Process Theory? Distinguishing the Reflective and the Algorithmic Mind Keith E. Stanovich University of Toronto Missing Components of Current Dual-Process Theories and Their Implications
More informationSeeing the conflict: an attentional account of reasoning errors
Psychon Bull Rev (2017) 24:1980 1986 DOI 10.3758/s13423-017-1234-7 BRIEF REPORT Seeing the conflict: an attentional account of reasoning errors André Mata 1 & Mário B. Ferreira 2,3 & Andreas Voss 3 & Tanja
More informationNegations in syllogistic reasoning: Evidence for a heuristic analytic conflict
Negations in syllogistic reasoning: Evidence for a heuristic analytic conflict Item type Article Authors Stupple, Edward J. N.; Waterhouse, Eleanor F. Citation Stupple, Edward J. N., Waterhouse, Eleanor
More informationThis is an Author's Original Manuscript of an article submitted to Behavior & Brain Science and may differ from the final version which is available here: http://journals.cambridge.org/action/displayabstract?frompage=online&aid=8242505
More informationINDIVIDUAL DIFFERENCES IN CONFLICT DETECTION DURING REASONING
INDIVIDUAL DIFFERENCES IN CONFLICT DETECTION DURING REASONING Darren Frey 1,2, Eric D. Johnson 3, Wim De Neys 1,2,4 1 - Paris Descartes University, Sorbonne Paris Cité, UMR 8240 LaPsyDÉ, France 2 - Caen
More informationSyllogistic reasoning time: Disconfirmation disconfirmed
Psychonomic Bulletin & Review 2003, 10 (1), 184-189 Syllogistic reasoning time: Disconfirmation disconfirmed VALERIE A. THOMPSON, CHRISTOPHER L. STRIEMER, RHETT REIKOFF, RAYMOND W. GUNTER, and JAMIE I.
More informationUC Merced Proceedings of the Annual Meeting of the Cognitive Science Society
UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society Title Processing Time Evidence for a Default-Interventionist Model of Probability Judgments Permalink https://escholarship.org/uc/item/6sc1970f
More informationDoes coffee make you reason smarter? The effect of caffeine on executive functioning and dual-process reasoning.
Does coffee make you reason smarter? The effect of caffeine on executive functioning and dual-process reasoning. Katrijn Pipijn (Katrijn.Pipijn@ppw.kuleuven.be) Leen Janssens (Leen.Janssens@ppw.kuleuven.be)
More informationIs Conflict Detection in Reasoning Domain General?
Is Conflict Detection in Reasoning Domain General? Darren Frey (darren@post.harvard.edu) Paris Descartes University, Sorbonne Paris Cité CNRS UMR 8240, LaPsyDÉ, Paris, France Wim De Neys (wim.de-neys@parisdescartes.fr)
More informationMetacognition and abstract reasoning
Mem Cogn (2015) 43:681 693 DOI 10.3758/s13421-014-0488-9 Metacognition and abstract reasoning Henry Markovits & Valerie A. Thompson & Janie Brisson Published online: 22 November 2014 # Psychonomic Society,
More informationThinking and Intelligence
Thinking and Intelligence Learning objectives.1 The basic elements of thought.2 Whether the language you speak affects the way you think.3 How subconscious thinking, nonconscious thinking, and mindlessness
More informationA POWER STRUGGLE: BETWEEN- VS. WITHIN-SUBJECTS DESIGNS IN DEDUCTIVE REASONING RESEARCH
Psychologia, 2004, 47, 277 296 A POWER STRUGGLE: BETWEEN- VS. WITHIN-SUBJECTS DESIGNS IN DEDUCTIVE REASONING RESEARCH Valerie A. THOMPSON 1) and Jamie I. D. CAMPBELL 1) 1) University of Saskatchewan, Canada
More informationNot All Syllogisms Are Created Equal: Varying Premise Believability Reveals Differences. Between Conditional and Categorical Syllogisms
Not All Syllogisms Are Created Equal: Varying Premise Believability Reveals Differences Between Conditional and Categorical Syllogisms by Stephanie Solcz A thesis presented to the University of Waterloo
More informationABSTRACT. Directed By: Distinguished University Professor, Arie W. Kruglanski, Department of Psychology
ABSTRACT Title of Document: THE IMPACT OF MOTIVATION, PROCESSING DIFFICULTY AND COGNITIVE RESOURCES ON THE USE OF BASE-RATES IN SOCIAL JUDGMENT Shira F. Fishman, M.A. 2005 Directed By: Distinguished University
More informationOn the Link between Cognitive Control and Heuristic Processes
On the Link between Cognitive Control and Heuristic Processes Edward T. Cokely (cokely@mpib-berlin.mpg.de) Paula Parpart (parpart@mpib-berlin.mpg.de) Lael J. Schooler (schooler@mpib-berlin.mpg.de) Max
More informationLogic Brightens My Day: Evidence for Implicit Sensitivity to Logical Validity.
Logic Brightens My Day: Evidence for Implicit Sensitivity to Logical Validity. Trippas, D., Handley, S. J., Verde, M. F., & Morsanyi, K. (2016). Logic Brightens My Day: Evidence for Implicit Sensitivity
More informationInteractions between inferential strategies and belief bias
Mem Cogn (2017) 45:1182 1192 DOI 10.3758/s13421-017-0723-2 Interactions between inferential strategies and belief bias Henry Markovits 1 & Janie Brisson 1 & Pier-Luc de Chantal 1 & Valerie A. Thompson
More informationExamples of Feedback Comments: How to use them to improve your report writing. Example 1: Compare and contrast
Examples of Feedback Comments: How to use them to improve your report writing This document contains 4 examples of writing and feedback comments from Level 2A lab reports, and 4 steps to help you apply
More informationNecessity, possibility and belief: A study of syllogistic reasoning
THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2001, 54A (3), 935 958 Necessity, possibility and belief: A study of syllogistic reasoning Jonathan St. B.T. Evans, Simon J. Handley, and Catherine N.J.
More informationAudio: In this lecture we are going to address psychology as a science. Slide #2
Psychology 312: Lecture 2 Psychology as a Science Slide #1 Psychology As A Science In this lecture we are going to address psychology as a science. Slide #2 Outline Psychology is an empirical science.
More informationRecognizing Ambiguity
Recognizing Ambiguity How Lack of Information Scares Us Mark Clements Columbia University I. Abstract In this paper, I will examine two different approaches to an experimental decision problem posed by
More informationConsider the alternative: The effects of causal knowledge on representing and using. alternative hypotheses in judgments under uncertainty
Consider the alternative: The effects of causal knowledge on representing and using alternative hypotheses in judgments under uncertainty Brett K. Hayes 1 Guy E. Hawkins 1,2 Ben R. Newell 1 1 School of
More informationValerie Thompson a & Jonathan St. B. T. Evans a a Department of Psychology, University of
This article was downloaded by: [University of Saskatchewan Library] On: 24 August 2012, At: 16:08 Publisher: Psychology Press Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered
More informationSemantic Coherence and Fallacies in Estimating Joint Probabilities
Journal of Behavioral Decision Making J. Behav. Dec. Making, 23: 203 223 (2010) Published online 14 April 2009 in Wiley InterScience (www.interscience.wiley.com).650 Semantic Coherence and Fallacies in
More informationChapter 11 Decision Making. Syllogism. The Logic
Chapter 11 Decision Making Syllogism All men are mortal. (major premise) Socrates is a man. (minor premise) (therefore) Socrates is mortal. (conclusion) The Logic Mortal Socrates Men 1 An Abstract Syllogism
More informationBlack 1 White 5 Black
PSYCHOLOGICAL SCIENCE Research Report Black 1 White 5 Black Hypodescent in Reflexive Categorization of Racially Ambiguous Faces Destiny Peery and Galen V. Bodenhausen Northwestern University ABSTRACT Historically,
More informationDual Processes and Training in Statistical Principles
Dual Processes and Training in Statistical Principles Helen L. Neilens (hneilens@plymouth.ac.uk) Department of Psychology, University of Plymouth, Drake Circus Plymouth, PL4 8AA UK Simon J. Handley (shandley@plymouth.ac.uk)
More informationCommunication Research Practice Questions
Communication Research Practice Questions For each of the following questions, select the best answer from the given alternative choices. Additional instructions are given as necessary. Read each question
More informationFraming the frame: How task goals determine the likelihood and direction of framing effects
McElroy, T., Seta, J. J. (2007). Framing the frame: How task goals determine the likelihood and direction of framing effects. Judgment and Decision Making, 2(4): 251-256. (Aug 2007) Published by the Society
More informationDUAL PROCESSES AND CONFLICT DURING MORAL AND LOGICAL REASONING: A CASE FOR UTILITARIAN INTUITIONS?
DUAL PROCESSES AND CONFLICT DURING MORAL AND LOGICAL REASONING: A CASE FOR UTILITARIAN INTUITIONS? Wim De Neys 1, 2, 3 & Michal Bialek 4 1 CNRS, Unité 8240 LaPsyDÉ, France 2 Université Paris Descartes,
More informationCognitive Psychology
Cognitive Psychology 63 (2011) 107 140 Contents lists available at ScienceDirect Cognitive Psychology journal homepage: www.elsevier.com/locate/cogpsych Intuition, reason, and metacognition Valerie A.
More informationInvariant Effects of Working Memory Load in the Face of Competition
Invariant Effects of Working Memory Load in the Face of Competition Ewald Neumann (ewald.neumann@canterbury.ac.nz) Department of Psychology, University of Canterbury Christchurch, New Zealand Stephen J.
More informationThe influence of (in)congruence of communicator expertise and trustworthiness on acceptance of CCS technologies
The influence of (in)congruence of communicator expertise and trustworthiness on acceptance of CCS technologies Emma ter Mors 1,2, Mieneke Weenig 1, Naomi Ellemers 1, Dancker Daamen 1 1 Leiden University,
More informationWhat matters in the cued task-switching paradigm: Tasks or cues?
Journal Psychonomic Bulletin & Review 2006,?? 13 (?), (5),???-??? 794-799 What matters in the cued task-switching paradigm: Tasks or cues? ULRICH MAYR University of Oregon, Eugene, Oregon Schneider and
More informationArtificial Intelligence and Human Thinking. Robert Kowalski Imperial College London
Artificial Intelligence and Human Thinking Robert Kowalski Imperial College London 1 Artificial Intelligence and Human Thinking The Abductive Logic Programming (ALP) agent model as a unifying framework
More informationInterpreting Instructional Cues in Task Switching Procedures: The Role of Mediator Retrieval
Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, Vol. 32, No. 3, 347 363 Copyright 2006 by the American Psychological Association 0278-7393/06/$12.00 DOI: 10.1037/0278-7393.32.3.347
More informationDétection de Conflits Durant le Raisonnement: Résultats Empiriques et Perspective Développementale
Détection de Conflits Durant le Raisonnement: Résultats Empiriques et Perspective Développementale Mémoire de synthèse en vue d une Habilitation à Diriger des Recherches Wim De Neys 2013 Conflict Detection
More informationConflict Sensitivity and the Conjunction Fallacy: Eye-tracking Evidence for Logical Intuitions in Conjunction Probability Judgments
Sensitivity and the Conjunction Fallacy: Eye-tracking Evidence for Logical Intuitions in Conjunction Probability Judgments Jenny Faure-Bloom, Gaëlle Vallée-Tourangeau, and Sabira Mannan Department of Psychology,
More informationHEURISTICS, BIASES, AND THE DEVELOPMENT OF CONFLICT DETECTION DURING REASONING
HEURISTICS, BIASES, AND THE DEVELOPMENT OF CONFLICT DETECTION DURING REASONING 1, 2, 3 Wim De Neys 1 CNRS, Unité 3521 LaPsyDÉ, France 2 Université Paris Descartes, Sorbonne Paris Cité, Unité 3521 LaPsyDÉ,
More information2 Critical thinking guidelines
What makes psychological research scientific? Precision How psychologists do research? Skepticism Reliance on empirical evidence Willingness to make risky predictions Openness Precision Begin with a Theory
More informationThe Effects of Task Difficulty and Reward Opportunity on Motivation
The Huron University College Journal of Learning and Motivation Volume 52 Issue 1 Article 8 2014 The Effects of Task Difficulty and Reward Opportunity on Motivation Benjamin Lipson Huron University College
More informationThis article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and
This article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and education use, including for instruction at the authors institution
More informationThe Empirical Case for Acquiescing to Intuition
723377PSSXXX10.1177/0956797617723377Walco, RisenEmpirical Case for Acquiescence research-article2017 Research Article The Empirical Case for Acquiescing to Intuition Psychological Science 2017, Vol. 28(12)
More informationThe role of sampling assumptions in generalization with multiple categories
The role of sampling assumptions in generalization with multiple categories Wai Keen Vong (waikeen.vong@adelaide.edu.au) Andrew T. Hendrickson (drew.hendrickson@adelaide.edu.au) Amy Perfors (amy.perfors@adelaide.edu.au)
More informationNumeracy, frequency, and Bayesian reasoning
Judgment and Decision Making, Vol. 4, No. 1, February 2009, pp. 34 40 Numeracy, frequency, and Bayesian reasoning Gretchen B. Chapman Department of Psychology Rutgers University Jingjing Liu Department
More informationEffect of Positive and Negative Instances on Rule Discovery: Investigation Using Eye Tracking
Effect of Positive and Negative Instances on Rule Discovery: Investigation Using Eye Tracking Miki Matsumuro (muro@cog.human.nagoya-u.ac.jp) Kazuhisa Miwa (miwa@is.nagoya-u.ac.jp) Graduate School of Information
More informationSeparating Cue Encoding From Target Processing in the Explicit Task- Cuing Procedure: Are There True Task Switch Effects?
Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, Vol. 33, No. 3, 484 502 Copyright 2007 by the American Psychological Association 0278-7393/07/$12.00 DOI: 10.1037/0278-7393.33.3.484
More informationSeparating Habit and Recollection: Memory Slips, Process Dissociations, and Probability Matching
Journal of Experimental Psychology: Learning, Memory, and Cognition 1996, Vol. 22, No. 6,1323-1335 Copyright 19% by the American Psychological Association, Inc. 0278-7393/96/$3.00 Separating Habit and
More informationWhat Matters in the Cued Task-Switching Paradigm: Tasks or Cues? Ulrich Mayr. University of Oregon
What Matters in the Cued Task-Switching Paradigm: Tasks or Cues? Ulrich Mayr University of Oregon Running head: Cue-specific versus task-specific switch costs Ulrich Mayr Department of Psychology University
More informationProbability matching and strategy availability
Memory & Cognition 2010, 38 (6), 667-676 doi:10.3758/mc.38.6.667 Probability matching and strategy availability DEREK J. KOEHLER AND GRETA JAMES University of Waterloo, Waterloo, Ontario, Canada Findings
More informationIndividual Differences and the Belief Bias Effect: Mental Models, Logical Necessity, and Abstract Reasoning
THINKING AND REASONING, 1999, THE 5 (1), BELIEF 1 28 BIAS EFFECT 1 Individual Differences and the Belief Bias Effect: Mental Models, Logical Necessity, and Abstract Reasoning Donna Torrens and Valerie
More informationAMERICAN JOURNAL OF PSYCHOLOGICAL RESEARCH
AMERICAN JOURNAL OF PSYCHOLOGICAL RESEARCH Volume 4, Number 1 Submitted: August 20, 2008 Revisions: October 16, 2008 Accepted: October 17, 2008 Publication Date: October 20, 2008 Start Today or the Very
More informationMagnitude and accuracy differences between judgements of remembering and forgetting
THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY 2012, 65 (11), 2231 2257 Magnitude and accuracy differences between judgements of remembering and forgetting Michael J. Serra and Benjamin D. England Department
More informationReasons and the Motivated Numeracy Effect
Reasons and the Motivated Numeracy Effect Cristina Ballarini (cristina_ballarini@brown.edu) Department of Cognitive, Linguistic, and Psychological Sciences, Brown University 190 Thayer St, Providence,
More informationReasoning with Uncertainty. Reasoning with Uncertainty. Bayes Rule. Often, we want to reason from observable information to unobservable information
Reasoning with Uncertainty Reasoning with Uncertainty Often, we want to reason from observable information to unobservable information We want to calculate how our prior beliefs change given new available
More informationImplicit Information in Directionality of Verbal Probability Expressions
Implicit Information in Directionality of Verbal Probability Expressions Hidehito Honda (hito@ky.hum.titech.ac.jp) Kimihiko Yamagishi (kimihiko@ky.hum.titech.ac.jp) Graduate School of Decision Science
More informationThe interplay of domain-specific and domain general processes, skills and abilities in the development of science knowledge
The interplay of domain-specific and domain general processes, skills and abilities in the development of science knowledge Stella Vosniadou Strategic Professor in Education The Flinders University of
More informationNIH Public Access Author Manuscript Learn Individ Differ. Author manuscript.
NIH Public Access Author Manuscript Individual Differences in Base Rate Neglect: A Fuzzy Processing Preference Index Christopher R. Wolfe and Christopher R. Fisher Miami University Oxford, Ohio, USA Abstract
More informationThe Color of Similarity
The Color of Similarity Brooke O. Breaux (bfo1493@louisiana.edu) Institute of Cognitive Science, University of Louisiana at Lafayette, Lafayette, LA 70504 USA Michele I. Feist (feist@louisiana.edu) Institute
More informationThe Ontogeny and Durability of True and False Memories: A Fuzzy Trace Account
JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY 71, 165 169 (1998) ARTICLE NO. CH982468 The Ontogeny and Durability of True and False Memories: A Fuzzy Trace Account Stephen J. Ceci Cornell University and Maggie
More informationThe Influence of Activation Level on Belief Bias in Relational Reasoning
Cognitive Science (2012) 1 34 Copyright 2012 Cognitive Science Society, Inc. All rights reserved. ISSN: 0364-0213 print / 1551-6709 online DOI: 10.1111/cogs.12017 The Influence of Activation Level on Belief
More informationFULL REPORT OF RESEARCH ACTIVITIES. Background
FULL REPORT OF RESEARCH ACTIVITIES Background There has been a recent upsurge of interest in individual differences in reasoning which has been well summarised by Stanovich & West (2000). The reason for
More informationThe effect of premise order in conditional reasoning: a test of the mental model theory
Cognition 63 (1997) 1 28 The effect of premise order in conditional reasoning: a test of the mental model theory Vittorio Girotto *, Alberto Mazzocco, Alessandra Tasso a, b b a CREPCO CNRS and University
More informationWho Is Rational? Studies of Individual Differences in Reasoning
Book Review/Compte rendu 291 Who Is Rational? Studies of Individual Differences in Reasoning Keith E. Stanovich Mahwah, NJ: Lawrence Erlbaum Associates, 1999. Pp. xvi, 1-296. Hardcover: ISBN 0-8058-2472-3,
More informationAttentional Theory Is a Viable Explanation of the Inverse Base Rate Effect: A Reply to Winman, Wennerholm, and Juslin (2003)
Journal of Experimental Psychology: Learning, Memory, and Cognition 2003, Vol. 29, No. 6, 1396 1400 Copyright 2003 by the American Psychological Association, Inc. 0278-7393/03/$12.00 DOI: 10.1037/0278-7393.29.6.1396
More informationLogic Brightens My Day: Evidence for Implicit Sensitivity to Logical Validity
Journal of Experimental Psychology: Learning, Memory, and Cognition 2016, Vol. 42, No. 9, 1448 1457 2016 American Psychological Association 0278-7393/16/$12.00 http://dx.doi.org/10.1037/xlm0000248 Logic
More informationThe Role of Modeling and Feedback in. Task Performance and the Development of Self-Efficacy. Skidmore College
Self-Efficacy 1 Running Head: THE DEVELOPMENT OF SELF-EFFICACY The Role of Modeling and Feedback in Task Performance and the Development of Self-Efficacy Skidmore College Self-Efficacy 2 Abstract Participants
More informationChapter 11. Experimental Design: One-Way Independent Samples Design
11-1 Chapter 11. Experimental Design: One-Way Independent Samples Design Advantages and Limitations Comparing Two Groups Comparing t Test to ANOVA Independent Samples t Test Independent Samples ANOVA Comparing
More informationUnconscious Bias, Cognitive Errors, and the Compliance Professional
Unconscious Bias, Cognitive Errors, and the Compliance Professional Michael W. Johnson, J.D. Clear Law Institute mjohnson@clearlawinstitute.com (703) 312-9440 www.clearlawinstitute.com About Michael Johnson
More informationIn press, Organizational Behavior and Human Decision Processes. Frequency Illusions and Other Fallacies. Steven A. Sloman.
In press, Organizational Behavior and Human Decision Processes Nested-sets and frequency 1 Frequency Illusions and Other Fallacies Steven A. Sloman Brown University David Over University of Sunderland
More informationLearning Deterministic Causal Networks from Observational Data
Carnegie Mellon University Research Showcase @ CMU Department of Psychology Dietrich College of Humanities and Social Sciences 8-22 Learning Deterministic Causal Networks from Observational Data Ben Deverett
More informationSupplementary experiment: neutral faces. This supplementary experiment had originally served as a pilot test of whether participants
Supplementary experiment: neutral faces This supplementary experiment had originally served as a pilot test of whether participants would automatically shift their attention towards to objects the seen
More informationReadings: Textbook readings: OpenStax - Chapters 1 11 Online readings: Appendix D, E & F Plous Chapters 10, 11, 12 and 14
Readings: Textbook readings: OpenStax - Chapters 1 11 Online readings: Appendix D, E & F Plous Chapters 10, 11, 12 and 14 Still important ideas Contrast the measurement of observable actions (and/or characteristics)
More informationWhat do Americans know about inequality? It depends on how you ask them
Judgment and Decision Making, Vol. 7, No. 6, November 2012, pp. 741 745 What do Americans know about inequality? It depends on how you ask them Kimmo Eriksson Brent Simpson Abstract A recent survey of
More informationT. Kushnir & A. Gopnik (2005 ). Young children infer causal strength from probabilities and interventions. Psychological Science 16 (9):
Probabilities and Interventions 1 Running Head: PROBABILITIES AND INTERVENTIONS T. Kushnir & A. Gopnik (2005 ). Young children infer causal strength from probabilities and interventions. Psychological
More informationHeuristics & Biases:
Heuristics & Biases: The Availability Heuristic and The Representativeness Heuristic Psychology 355: Cognitive Psychology Instructor: John Miyamoto 05/29/2018: Lecture 10-2 Note: This Powerpoint presentation
More informationBroadening the Conditions for Illusory Correlation Formation: Implications for Judging Minority Groups
BASIC AND APPLIED SOCIAL PSYCHOLOGY, 21(4), 263 279 Copyright 1999, Lawrence Erlbaum Associates, Inc. Broadening the Conditions for Illusory Correlation Formation: Implications for Judging Minority Groups
More informationFrequency versus probability formats in statistical word problems
J.St.B.T. Evans et al. / Cognition 77 (2000) 197±213 197 COGNITION Cognition 77 (2000) 197±213 www.elsevier.com/locate/cognit Frequency versus probability formats in statistical word problems Jonathan
More informationRetrieval of Concepts in Script-Based Texts and Narratives: The Influence of General World Knowledge
Journal of Experimental Psychology: Learning, Memory, and Cognition 2002, Vol. 28, No. 4, 780 790 Copyright 2002 by the American Psychological Association, Inc. 0278-7393/02/$5.00 DOI: 10.1037//0278-7393.28.4.780
More informationAutomaticity of Number Perception
Automaticity of Number Perception Jessica M. Choplin (jessica.choplin@vanderbilt.edu) Gordon D. Logan (gordon.logan@vanderbilt.edu) Vanderbilt University Psychology Department 111 21 st Avenue South Nashville,
More informationThe Standard Theory of Conscious Perception
The Standard Theory of Conscious Perception C. D. Jennings Department of Philosophy Boston University Pacific APA 2012 Outline 1 Introduction Motivation Background 2 Setting up the Problem Working Definitions
More informationRetrieval-induced forgetting in implicit memory tests: The role of test awareness
Psychonomic Bulletin & Review 2005, 12 (3), 490-494 Retrieval-induced forgetting in implicit memory tests: The role of test awareness GINO CAMP, DIANE PECHER, and HENK G. SCHMIDT Erasmus University Rotterdam,
More informationPredictions from Uncertain Beliefs
Predictions from Uncertain Beliefs Samuel G. B. Johnson 1, Thomas Merchant 2, & Frank C. Keil 1 (samuel.johnson@yale.edu, thomas_merchant@brown.edu, frank.keil@yale.edu) 1 Dept. of Psychology, Yale University,
More informationReplacing the frontal lobes? Having more time to think improve implicit perceptual categorization. A comment on Filoteo, Lauritzen & Maddox, 2010.
Replacing the frontal lobes? 1 Replacing the frontal lobes? Having more time to think improve implicit perceptual categorization. A comment on Filoteo, Lauritzen & Maddox, 2010. Ben R. Newell 1 Christopher
More informationHow Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis?
How Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis? Richards J. Heuer, Jr. Version 1.2, October 16, 2005 This document is from a collection of works by Richards J. Heuer, Jr.
More informationThe Role of Feedback in Categorisation
The Role of in Categorisation Mark Suret (m.suret@psychol.cam.ac.uk) Department of Experimental Psychology; Downing Street Cambridge, CB2 3EB UK I.P.L. McLaren (iplm2@cus.cam.ac.uk) Department of Experimental
More informationCategorization vs. Inference: Shift in Attention or in Representation?
Categorization vs. Inference: Shift in Attention or in Representation? Håkan Nilsson (hakan.nilsson@psyk.uu.se) Department of Psychology, Uppsala University SE-741 42, Uppsala, Sweden Henrik Olsson (henrik.olsson@psyk.uu.se)
More information