This seminar provides an introduction to different aspects of decision neuroscience by exploring the neural

Size: px

Start display at page:

Download "This seminar provides an introduction to different aspects of decision neuroscience by exploring the neural"

Willa Kelly
5 years ago
Views:

1 ECON FS16 Time / Room: Wed ; BLU-E-003 Instructors: Christian Ruff, Philippe Tobler dec.neurosci@gmail.com Course description This seminar provides an introduction to different aspects of decision neuroscience by exploring the neural processes and computations that underlie decision making in humans, non-human primates and rodents. The seminar builds on the course Neuroscience for economists and behavioral economics for neuroscientists and will begin with a recapitulation of basic neuroscience and economic methods. Topics that will then be covered include neural and economic frameworks of decision making, neural representations of valuation, decision mechanisms, learning, perceptual decision making and social decision making. The seminar will be divided between overview lectures, student presentations of research papers and general discussion of how neural data can inform theories of decision making. Reading list The list below is a preliminary list of papers that will be covered throughout the seminar. Papers in italics can be chosen for student presentations. The letters in brackets before each paper are meant as a guideline to help pick appropriate papers. Review papers - marked by (R) - provide a more general introduction to the topic covered and are recommended reading. Please take a look at the list and let us know which papers you would be interested in presenting. You should indicate at least 4 papers from at least two different categories (e.g., valuation and learning). We will try and match the papers with everyone s interests and background as best as possible. Note: All reading materials are provided on the OLAT course website:

2 Introduction and overview Introduction to decision neuroscience Overview of class structure and topics Basics: Models of decision making and models of the brain Discussion of individual reading on basics of decision-making models and elementary neuroscience Reading materials on basics of decision-making models and neuroscience are Representation (R) Platt ML, Huettel SA (2008) Risky business: the neuroeconomics of decision making under uncertainty. Nature Neuroscience 11(4) pp Huettel et al. (2006) Neural signatures of economic preferences for risk and ambiguity. Neuron 49(5) pp McCoy AN, Platt ML (2005) Risk-sensitive neurons in macaque posterior cingulate cortex. Nature Neuroscience 8(9) pp Maier JX, Wachowiak M, Katz DB (2012) Chemosensory convergence on primary olfactory cortex. J Neurosci. 32(48) pp Grabenhorst F, Rolls ET. (2014) The representation of oral fat texture in the human somatosensory cortex. Hum Brain Mapp. 35(6) pp Representation (R) Rushworth MF, Behrens TE (2008) Choice, uncertainty and value in prefrontal and cingulate cortex. Nat Neurosci 11(4) pp

3 Preuschoff K, Bossaerts P, Quartz SR (2006) Neural differentiation of expected reward and risk in human subcortical structures. Neuron 51(3) pp Croxson PL, Walton ME, O'Reilly JX, Behrens TEJ, Rushworth MFS (2009) Effort-based cost-benefit valuation and the human brain. J. Neurosci. 29(14) pp Gottfried JA, O'Doherty J, Dolan RJ (2003) Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science 301(5636) pp Rolls ET, Murzi E, Yaxley S, Thorpe SJ, Simpson SJ (1986) Sensory-specific satiety: food-specific reduction in responsiveness of ventral forebrain neurons after feeding in the monkey. Brain Res. 368(1) pp Valuation (R) Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience 9(7) pp Padoa-Schioppa C, Assad JA (2006) Neurons in the orbitofrontal cortex encode economic value. Nature 441(7090) pp Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nature Neuroscience 11(1) pp Valuation Plassmann H, O'Doherty J, Rangel A (2007) Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. The Journal of Neuroscience 27(37) pp Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10(12) pp Lebreton M, Jorge S, Michel V, Thirion B, Pessiglione M (2009) An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 64(3) pp Levy I, Snell J, Nelson AJ, Rustichini A, Glimcher PW (2010) Neural representation of subjective value under risk and ambiguity. J Neurophysiol 103(2) pp Winecoff A, Clithero JA, Carter RM, Bergman SR, Wang L, Huettel SA (2013) Ventromedial prefrontal cortex encodes emotional value. J Neurosci. 33(27) pp

4 Zatorre RJ, Salimpoor VN (2013) From perception to pleasure: music and its neural substrates. Proc Natl Acad Sci U S A 110(Suppl 2) pp Action selection (R) Sugrue LP, Corrado GS, Newsome WT (2005) Choosing the greater of two goods: neural currencies for valuation and decision making. Nat Rev Neurosci 6(5) pp Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400(6741) pp Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304(5678) pp So NY, Stuphorn V (2010) Supplementary eye field encodes option and action value for saccades with variable reward. J Neurophysiol. 104(5) pp Chau BK, Kolling N, Hunt LT, Walton ME, Rushworth MF (2014) A neural mechanism underlying failure of optimal choice with multiple alternatives. Nat Neurosci. 17(3) pp doi: /nn Action selection Barraclough DJ, Conroy ML, Lee D (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci 7(4) pp Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62(5) pp Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441(7095) pp Mobbs D, Hassabis D, Yu R, Chu C, Rushworth M, Boorman E, Dalgleish T (2013) Foraging under competition: the neural basis of input-matching in humans. J Neurosci. 33(23) pp doi: /JNEUROSCI

5 Learning (R) Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275(5306) pp (R) Montague PR, Hyman SE, Cohen JD (2004) Computational roles for dopamine in behavioural control. Nature 431(7010) pp Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47(1) pp Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412(6842) pp D'Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319(5867) pp Learning Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS (2007) Learning the value of information in an uncertain world. Nat Neurosci 10(9) pp Hart AS, Rutledge RB, Glimcher PW, Phillips PE (2014) Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci. 34(3) pp Garrison J, Erdeniz B, Done J (2013) Prediction error in reinforcement learning: a meta-analysis of neuroimaging studies. Neurosci Biobehav Rev. 37(7) pp Suzuki S, Harasawa N, Ueno K, Gardner JL, Ichinohe N, Haruno M, Cheng K, Nakahara H (2012) Learning to simulate others' decisions. Neuron. 74(6): Perceptual decision making (R) Gold JI, Shadlen MN (2007) The neural basis of decision making. Annu Rev Neurosci 30 pp

6 (R) Heekeren HR, Marrett S, Ungerleider LG (2008) The neural systems that mediate human perceptual decision making. Nat Rev Neurosci. 9(6) pp Kiani R, Hanks TD, Shadlen MN (2008) Bounded integration in parietal cortex underlies decisions even when viewing duration is dictated by the environment. J Neurosci. 28(12) pp Hanks TD, Ditterich J, Shadlen MN (2006) Microstimulation of macaque area LIP affects decision-making in a motion discrimination task. Nat Neurosci. 9(5) pp Hernández A, Nácher V, Luna R, Zainos A, Lemus L, Alvarez M, Vázquez Y, Camarillo L, Romo R. (2010). Decoding a perceptual decision process across cortex. Neuron 66(2) pp Heekeren HR, Marrett S, Bandettini PA, Ungerleider LG (2004). A general mechanism for perceptual decisionmaking in the human brain. Nature 431(7010) pp O'Connell RG, Dockree PM, Kelly SP (2012) A supramodal accumulation-to-bound signal that determines perceptual decisions in humans. Nat Neurosci 15(12) pp doi: /nn Perceptual decision making Resulaj A, Kiani R, Wolpert DM, Shadlen MN (2009) Changes of mind in decision-making. Nature 461(7261) pp Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870) pp Kiani R, Shadlen MN (2009) Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324(5928) pp de Lafuente V, Romo R (2011) Dopamine neurons code subjective sensory experience and uncertainty of perceptual decisions. Proc Natl Acad Sci U S A 108(49) pp Summerfield C, Behrens TE, Koechlin E (2011) Perceptual classification in a rapidly changing environment. Neuron 71(4) pp doi: /j.neuron

7 Social decision making (R) Rilling JK, Sanfey AG (2011) The neuroscience of social decision-making. Annual Review of Psychology 62 pp doi: /annurev.psych de Quervain DJF, Fischbacher U, Treyer V, Schellhammer M, Schnyder U, Buck A, Fehr E (2004) The neural basis of altruistic punishment. Science 305(5688) pp King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR, Montague PR (2005) Getting to know you: reputation and trust in a two-person economic exchange. Science 308(5718) pp Harbaugh WT, Mayr U, Burghart DR (2007) Neural responses to taxation and voluntary giving reveal motives for charitable donations. Science 316(5831) pp de Waal FBM, Leimgruber K, Greenberg AR (2008) Giving is self-rewarding for monkeys. Proceedings of the National Academy of Sciences of the USA 105(36) pp Hare B, Kwetuenda S (2010) Bonobos voluntarily share their own food with others. Current Biology 20(5) pp. R230-R231. Fliessbach K, Weber B, Trautner P, Dohmen T, Sunde U, Elger CE, Falk A (2007). Social comparison affects rewardrelated brain activity in the human ventral striatum. Science 318(5854) pp Mobbs D, Yu R, Meyer M, Passamonti L, Seymour B, Calder AJ, Schweizer S, Frith CD, Dalgleish T (2009) A key role for similarity in vicarious reward. Science 324(5929) p Nicolle A, Klein-Flügge MC, Hunt LT, Vlaev I, Dolan RJ, Behrens TE (2012) An agent independent axis for executed and modeled choice in medial prefrontal cortex. Neuron 75(6) pp doi: /j.neuron Social decision making Knoch D, Pascual-Leone A, Meyer K, Treyer V, Fehr E (2006) Diminishing reciprocal fairness by disrupting the right prefrontal cortex. Science 314(5800) pp Tricomi E, Rangel A, Camerer CF, O Doherty JP (2010) Neural evidence for inequality-averse social preferences. 7

8 Nature 463(7284) pp Haruno M, Frith, CD (2010) Activity in the amygdala elicited by unfair divisions predicts social value orientation. Nature Neuroscience 13(2) pp Brosnan SF, de Waal FBM (2003) Monkeys reject unequal pay. Nature 425(6955) pp Baumgartner T, Knoch D, Hotz P, Eisenegger C, Fehr E (2011) Dorsolateral and ventromedial prefrontal cortex orchestrate normative choice. Nat Neurosci. 14(11) pp doi: /nn

Decision neuroscience seeks neural models for how we identify, evaluate and choose

VmPFC function: The value proposition Lesley K Fellows and Scott A Huettel Decision neuroscience seeks neural models for how we identify, evaluate and choose options, goals, and actions. These processes