Choosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making
|
|
- George Richard
- 6 years ago
- Views:
Transcription
1 Choosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making Leo P. Surgre, Gres S. Corrado and William T. Newsome Presenter: He Crane Huang 04/20/2010
2 Outline Studies on neural correlates of simple perceptual decisions Interactions between decision making and reward Studies of value-based decisions on free-choice tasks
3 Neural correlates of perceptual decisions Sensory input Motor output Sensation Action LIP FEF SEF V1 V4 Area 46 IT Figure 1 Visual and oculomotor systems of the primate Visual and oculomotor systems of the primate brain
4 Action Conceptual framework for (2AFC) decision making 2-Alternative forced-choice discrimination task a Conceptual framework for simple perceptual decisions Sensory Sensory input b Conceptual framework f simple value-based dec Actor Sensory input + physiological need Sensory representation Common reward currency Decision E Action implementation Probability of choice Choice Decision representation Probability of choice P
5 REVIEWS (Perceptual) Decision-making tasks a Perceptual discrimination task % left choices Left? Motion b Linking behaviour to perception Right? d Linking behaviour to valuation and recordings from monkey caudate neurons during simple associative conditioning tasks show activity that is consistent with the creation of such stimulus response bonds However, the direct yoking of stimuli to actions and outcomes implied by the current generation of these models fails to capture the facility with which higher organisms construct complex representations of value and flexibly link them to action selection (BOX 2). Responding to these limitations, more recent theoretical proposals have expanded the role of the dopamine signal to include the shaping of more abstract models of valuation Consistent with this approach, FIG. 2b portrays the dopamine system as a critic whose influence extends beyond the generation of simple associative predictions to the construction and modification of complex value s. In this scheme, the striatum is considered to have the crucial role of liaison between actor and critic. If correct, this proposal indicates that dopamine neurons have access to the value representation depicted in FIG. 2b. Consistent with this idea, Nakahara and colleagues 50 recently showed that dopamine responses were strongly modulated by contextual information that pertained to the evolution Roitman of and reward Shadlen, probability 2002 across successive trials in a task, even when this information was not accompanied by any explicit sensory LIP activity during the RT-direction discrimination task 9482 J. Neurosci., November 1, 2002, 22(21): Roitman and Shadlen Response Stimulus strength (left) Figure 7. Time course of LIP activity in the RT-direction-discrimination task. A, Average response from 54 LIP neuro Figure (Task 3 difficulty Decision-making decrease/ tasks. Coherence a General Increases) motion strength and choice as indicated by color and line type. The responses are aligned to two events in the trial. On structure to the of a onset perceptual of stimulus discrimination motion. Response task, in averages in this portion of the graph are drawn to the median RT for each m which a monkey reports its judgement of the direction activity of motion within in a random 100 msec dot ofstimulus eye movement with initiation. On the right, responses are aligned to initiation of the eye movemen
6 LIP activity in RT-motion discrimination task Implements the decision. Convert a sensory representation of visual motion into a decision variable Predicts not only the decision, but when the decision has been reached. [box1]: Encode a mixture of sensory, motor and cognitive signals that might guide decisions about upcoming behavioral responses. LIP reflects a general decision variable that is monotonically related to the log likelihood ratio that the animal will select on of the two alternatives. -- Thursday a paper
7 Decision making and reward Adaptive decisions -take reward into account a Conceptual framework for b Conceptual framework for simple perceptual decisions simple value-based decisions a Conceptual framework for b Conceptual Actor framework Sensory forinput simple perceptual decisions simple value-based + physiological decisions needs Sensory input Actor Sensory input + physiological needs Sensory Striatum Common reward currency Striatum Sensory Common reward representation Decision currency Error Outcomes signal Decision Action implementation Probability of choice Action implementation Choice Probability of choice Decision representation Decision Action implementation Probability of choice Error signal representation Probability Predictions of choice Dopamine (VTA) Predictions Critic Outcomes Dopamine (VTA) Critic Action Choice implementation Figure 2 Conceptual frameworks for decision making. A conceptual framework that illustrates proposed processing stages for Choice the formation of simple perceptual and value-based expect Psychol the infl making notably reward most ph ing hol activity transfor tors beg order to adaptive A co value-b clusive n from w internal sentatio hand si propose
8 Decision making and reward A common neural currency for reward Reward: anything that an animal will work to acquire, consists motivational and affective dimensions. Brain stimulation reward (BSR): there Decisionis a dedicated neural network devoted to reward processing. a Conceptual framework for simple perceptual decisions Probability of choice Shizgal and colleagues: BSR contributes Action as a implementation reward signal that is responsible for valuation. b Conceptual framework for simple value-based decisions Actor Sensory input + physiological needs Decision Action implementation Common reward currency representation Probability of choice Choice Striatum Error signal Predictions Outcomes Dopamine (VTA) Critic Figure 2 Conceptual frameworks for decision making. A conceptual framework that illustrates proposed processing stages for the formation of simple perceptual and value-based expectati Psycholog the influe making in notably abs reward is most physi ing hold r activity th transform tors begun order to e adaptive b A conc value-base clusive no from whic internal re sentation hand side proposed this fram comprises
9 Decision making and reward REVIEWS Incentives and errors framework for eptual decisions bility of b Conceptual framework for simple value-based decisions Actor Sensory input + physiological needs Decision Action implementation Common reward currency representation Probability of choice Choice Striatum Error signal Predictions Outcomes Dopamine (VTA) Critic eptual frameworks for decision making. A conceptual framework that sed processing stages for the formation of simple perceptual and value-based expectation of the likely abundance of fish. Psychologists and economists have long appreciated the influence of reward and valuation on decision making in higher mammals 24, but these factors were notably absent from our preceding discussion. Although reward is an implicit variable in every operant task, most physiological studies of perceptual decision mak- Dopamine system: ing hold reward contingencies constant to isolate activity that is specifically related to sensorimotor s (FIG. 2a). Only recently have investigators begun to manipulate reward independently in order to explore the neural basis of valuation and adaptive behaviour. a central role in processing the motivational aspect of reward do not signal the occurrence of rewards, but A conceptual can be framework considered within to which code to consider reward prediction value-based error choice is proposed in FIG. 2b. Neither conclusive nor complete, it is intended as a starting point from which to discuss the basic steps in building an internal representation of value and using that representation to guide behaviour. Focus first on the lefthand side of this diagram (labelled actor ). Like the proposed framework for perceptual decisions (FIG 2a), this framework for value-based decision making comprises three key processing stages. At the first stage, a value takes the input
10 -based decision making The cortex as the stage for valuation Anatomically, several regions within the prefrontal and parietal association cortices are positioned to link reward to behavioral responses (motor planning). V1 V4 LIP IT FEF a Conceptual framework for simple perceptual decisions Decision SEF Action implementation Area 46 Probability of choice Figure 1 Visual and oculomotor systems of the primate b Conceptual framework for simple value-based decisions Actor Sensory input + physiological needs Common reward currency Striatum Error signal Outcomes Critic identified sensory representations as well as decisionrelated signals in areas of the parietal representation Dopamine and frontal (VTA) cortices. At the neural level, differentiating sensory signals from decision-related Decision signals is relatively straightforward. First, sensory signals require the presence of the Predictions sensory stimulus, Probability and of extinguish with stimulus offset. Second, and more choiceimportantly, in discrimination tasks in which behavioural Action decisions and neural activity are implementation measured across a range of stimulus strengths, animals make both correct Choice and incorrect judgements in response to the presentation of identical stimuli. On these trials, sensory neurons encode the visual stimulus itself, Figure 2 Conceptual frameworks for decision making. A conceptual framework that illustrates proposed processing stages for the formation of simple perceptual and value-based expectat Psycholog the influe making in notably ab reward is most phys ing hold activity th transform tors begu order to e adaptive b A conc value-base clusive no from whic internal re sentation hand side proposed this fram comprise stage, a v
11 -based decision making free choice task design c Free-choice task Improve Left? Right? Limitation of the the imperative tasks: -The value is all or none -The decision is simple one-to-one mapping
12 -based decision making Demonstrating behavioral control Two different approaches: Nash equilibrium from the theory of competitive games Provide a means of assessing behavioral control. The matching law from a general principle of animal foraging behavior.
13 -based decision making Understanding local strategy Nash Equations Matching law average behavior at equilibrium Local strategies that produce these average behavioral phenomena? (-based behavior control: behavior is under stimulus control ) Quantitative modeling of local choice strategy: the variables link reward history to behavior Neurophysiological exploration of model variables: how to understand the model at the neural level.
14 -based decision making Three free-choice studies signals in frontal cortex The matching pennies game, Barraclough and colleagues signals in parietal cortex behavioral dynamics behavioral equilibria Matching behavior and value representation, Leo P. Sugre, et al. The inspection game, Dorris and Glimcher
15 -based decision making free-choice study 1: signals in frontal cortex Frequency histograms of P(right) a Matching pennies Computer chooses Left Right 1 0 Monkey chooses Left Right Payoff for monkey Payoff for computer Figure 4 Payoff matrices for competitive g Barraclough and colleagues: matching pennies game Foreperiod delay
16 -based decision making free-choice study 1: signals in frontal cortex Reinforcement learning algorithms provide a general framework for finding optimal strategies in a dynamic environment. Prefrontal cortex might have a key role in optimizing decision-making strategies.
17 -based decision making free-choice study 2: signals in parietal cortex (area LIP)-behavioral dynamics Matching behavior in monkeys Leo P. Sugre, et al * Rewards are assigned to the two colors at rates that are independent and stochastic. * Once assigned, a reward remains available until the associated color is chosen. * This persistence of assigned rewards means that the likelihood of being rewarded increases with the time since a color was last chosen... and ensures that matching approximates the optimal probabilistic strategy in this task.
18 -based decision making free-choice study 2: signals in parietal cortex (area LIP)- behavioral dynamics Dynamic matching behavior a A local model of matching behavior Leaky integrators Local income Local fractional income Probability of choice τ I red FI red PC red Reward histories τ I green b c d Probability of choice (red) Model Monkeys Local fractional income (red) 1 Cumulative red choices Model Monkeys Cumulative green choices Neural response (spikes s 1 ) Into the RF Out of the RF 0 1 Local fractional income (RF target) Figure 6 A local model of matching behaviour. a A linear nonlinear probabilistic model uses leaky integration over recent
19 -based decision making free-choice study 2: signals in parietal cortex (area LIP)-behavioral dynamics Local fractional income is the valuation variable that modulates LIP firing rates. LIP neuron activity predicts the monkey s eye movement responses, contribute to plan shifts in gaze or visual attention.
20 -based decision making free-choice study 3: signals in parietal cortex (area LIP)-behavioral equilibria Human vs. Human in 3 blocks Nash prediction Risky (subject) Inspect (opponent) Dorris and Glimcher, 2004
21 -based decision making free-choice study 3: signals in parietal cortex (area LIP)-behavioral equilibria c Probability of choice (%) Trial number Neural response (spikes s 1 ) A player s overall choice distribution should equalize the average payoff resulting from alternative action.(global Nash equilibrium) LIP encodes each alternative s average payoff (which is a constant), rather then the probability of choosing that alternative (which varies). LIP encodes an abstract representation of the stimuli apart from specific motor plan.
22 Conclusion New efforts to understand value-based decision making might bring together two areas of neuroscience that have traditionally existed in separate spheres the study of perception and cognition, and the study of reward and motivation. The study of value-based choice might be uniquely positioned to lay the foundations for this unified neurobiology of choice behavior.
CHOOSING THE GREATER OF TWO GOODS: NEURAL CURRENCIES FOR VALUATION AND DECISION MAKING
CHOOSING THE GREATER OF TWO GOODS: NEURAL CURRENCIES FOR VALUATION AND DECISION MAKING Leo P. Sugrue, Greg S. Corrado and William T. Newsome Abstract To make adaptive decisions, animals must evaluate the
More informationA neural circuit model of decision making!
A neural circuit model of decision making! Xiao-Jing Wang! Department of Neurobiology & Kavli Institute for Neuroscience! Yale University School of Medicine! Three basic questions on decision computations!!
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis
More informationA Neural Model of Context Dependent Decision Making in the Prefrontal Cortex
A Neural Model of Context Dependent Decision Making in the Prefrontal Cortex Sugandha Sharma (s72sharm@uwaterloo.ca) Brent J. Komer (bjkomer@uwaterloo.ca) Terrence C. Stewart (tcstewar@uwaterloo.ca) Chris
More informationHow rational are your decisions? Neuroeconomics
How rational are your decisions? Neuroeconomics Hecke CNS Seminar WS 2006/07 Motivation Motivation Ferdinand Porsche "Wir wollen Autos bauen, die keiner braucht aber jeder haben will." Outline 1 Introduction
More informationSignal detection theory. Direct comparison of perception and neural activity. ? Choice probability. Visual stimulus. Behavioral judgement
Signal detection theory yes no Visual stimulus Neurometric function Psychometric function Neuronal response? Choice probability Behavioral judgement Direct comparison oerception and neural activity Record
More informationThree methods for measuring perception. Magnitude estimation. Steven s power law. P = k S n
Three methods for measuring perception 1. Magnitude estimation 2. Matching 3. Detection/discrimination Magnitude estimation Have subject rate (e.g., 1-10) some aspect of a stimulus (e.g., how bright it
More informationConsciousness The final frontier!
Consciousness The final frontier! How to Define it??? awareness perception - automatic and controlled memory - implicit and explicit ability to tell us about experiencing it attention. And the bottleneck
More information5th Mini-Symposium on Cognition, Decision-making and Social Function: In Memory of Kang Cheng
5th Mini-Symposium on Cognition, Decision-making and Social Function: In Memory of Kang Cheng 13:30-13:35 Opening 13:30 17:30 13:35-14:00 Metacognition in Value-based Decision-making Dr. Xiaohong Wan (Beijing
More informationNeural response time integration subserves. perceptual decisions - K-F Wong and X-J Wang s. reduced model
Neural response time integration subserves perceptual decisions - K-F Wong and X-J Wang s reduced model Chris Ayers and Narayanan Krishnamurthy December 15, 2008 Abstract A neural network describing the
More informationSpontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Berkes, Orban, Lengyel, Fiser.
Statistically optimal perception and learning: from behavior to neural representations. Fiser, Berkes, Orban & Lengyel Trends in Cognitive Sciences (2010) Spontaneous Cortical Activity Reveals Hallmarks
More informationA Role for Neural Integrators in Perceptual Decision Making
A Role for Neural Integrators in Perceptual Decision Making Mark E. Mazurek, Jamie D. Roitman, Jochen Ditterich and Michael N. Shadlen Howard Hughes Medical Institute, Department of Physiology and Biophysics,
More informationMemory, Attention, and Decision-Making
Memory, Attention, and Decision-Making A Unifying Computational Neuroscience Approach Edmund T. Rolls University of Oxford Department of Experimental Psychology Oxford England OXFORD UNIVERSITY PRESS Contents
More informationLateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game
7278 The Journal of Neuroscience, June 3, 2009 29(22):7278 7289 Behavioral/Systems/Cognitive Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game Hyojung Seo, 1 * Dominic
More informationbrain valuation & behavior
brain valuation & behavior 9 Rangel, A, et al. (2008) Nature Neuroscience Reviews Vol 9 Stages in decision making process Problem is represented in the brain Brain evaluates the options Action is selected
More informationNeural Coding. Computing and the Brain. How Is Information Coded in Networks of Spiking Neurons?
Neural Coding Computing and the Brain How Is Information Coded in Networks of Spiking Neurons? Coding in spike (AP) sequences from individual neurons Coding in activity of a population of neurons Spring
More informationThe Adolescent Developmental Stage
The Adolescent Developmental Stage o Physical maturation o Drive for independence o Increased salience of social and peer interactions o Brain development o Inflection in risky behaviors including experimentation
More informationThe Integration of Features in Visual Awareness : The Binding Problem. By Andrew Laguna, S.J.
The Integration of Features in Visual Awareness : The Binding Problem By Andrew Laguna, S.J. Outline I. Introduction II. The Visual System III. What is the Binding Problem? IV. Possible Theoretical Solutions
More informationRetinotopy & Phase Mapping
Retinotopy & Phase Mapping Fani Deligianni B. A. Wandell, et al. Visual Field Maps in Human Cortex, Neuron, 56(2):366-383, 2007 Retinotopy Visual Cortex organised in visual field maps: Nearby neurons have
More information(Visual) Attention. October 3, PSY Visual Attention 1
(Visual) Attention Perception and awareness of a visual object seems to involve attending to the object. Do we have to attend to an object to perceive it? Some tasks seem to proceed with little or no attention
More informationBayesian integration in sensorimotor learning
Bayesian integration in sensorimotor learning Introduction Learning new motor skills Variability in sensors and task Tennis: Velocity of ball Not all are equally probable over time Increased uncertainty:
More informationTHE BRAIN HABIT BRIDGING THE CONSCIOUS AND UNCONSCIOUS MIND
THE BRAIN HABIT BRIDGING THE CONSCIOUS AND UNCONSCIOUS MIND Mary ET Boyle, Ph. D. Department of Cognitive Science UCSD How did I get here? What did I do? Start driving home after work Aware when you left
More informationPrefrontal cortex. Executive functions. Models of prefrontal cortex function. Overview of Lecture. Executive Functions. Prefrontal cortex (PFC)
Neural Computation Overview of Lecture Models of prefrontal cortex function Dr. Sam Gilbert Institute of Cognitive Neuroscience University College London E-mail: sam.gilbert@ucl.ac.uk Prefrontal cortex
More informationHebbian Plasticity for Improving Perceptual Decisions
Hebbian Plasticity for Improving Perceptual Decisions Tsung-Ren Huang Department of Psychology, National Taiwan University trhuang@ntu.edu.tw Abstract Shibata et al. reported that humans could learn to
More informationNeuronal representations of cognitive state: reward or attention?
Opinion TRENDS in Cognitive Sciences Vol.8 No.6 June 2004 representations of cognitive state: reward or attention? John H.R. Maunsell Howard Hughes Medical Institute & Baylor College of Medicine, Division
More informationSUPPLEMENTARY INFORMATION
doi:10.1038/nature14066 Supplementary discussion Gradual accumulation of evidence for or against different choices has been implicated in many types of decision-making, including value-based decisions
More informationA Drift Diffusion Model of Proactive and Reactive Control in a Context-Dependent Two-Alternative Forced Choice Task
A Drift Diffusion Model of Proactive and Reactive Control in a Context-Dependent Two-Alternative Forced Choice Task Olga Lositsky lositsky@princeton.edu Robert C. Wilson Department of Psychology University
More informationNeuronal Representations of Value
C H A P T E R 29 c00029 Neuronal Representations of Value Michael Platt and Camillo Padoa-Schioppa O U T L I N E s0020 s0030 s0040 s0050 s0060 s0070 s0080 s0090 s0100 s0110 Introduction 440 Value and Decision-making
More informationAttention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load
Attention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load Intro Examine attention response functions Compare an attention-demanding
More informationInformation processing and decision-making: evidence from the brain sciences and implications for Economics
Information processing and decision-making: evidence from the brain sciences and implications for Economics Isabelle Brocas University of Southern California and CEPR March 2012 Abstract This article assesses
More informationEffects of Network Topology on Decision-Making Behavior in A Biological Network Model
Effects of Network Topology on Decision-Making Behavior in A Biological Network Model Suojun Lu*, Jian an Fang, Qingying Miao College of Information Science & Technology, Donghua University, 2999 North
More informationBeyond bumps: Spiking networks that store sets of functions
Neurocomputing 38}40 (2001) 581}586 Beyond bumps: Spiking networks that store sets of functions Chris Eliasmith*, Charles H. Anderson Department of Philosophy, University of Waterloo, Waterloo, Ont, N2L
More informationSupplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more
1 Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more strongly when an image was negative than when the same
More informationEmotion Explained. Edmund T. Rolls
Emotion Explained Edmund T. Rolls Professor of Experimental Psychology, University of Oxford and Fellow and Tutor in Psychology, Corpus Christi College, Oxford OXPORD UNIVERSITY PRESS Contents 1 Introduction:
More informationThe role of amplitude, phase, and rhythmicity of neural oscillations in top-down control of cognition
The role of amplitude, phase, and rhythmicity of neural oscillations in top-down control of cognition Chair: Jason Samaha, University of Wisconsin-Madison Co-Chair: Ali Mazaheri, University of Birmingham
More informationThe Neuroscience of Addiction: A mini-review
The Neuroscience of Addiction: A mini-review Jim Morrill, MD, PhD MGH Charlestown HealthCare Center Massachusetts General Hospital Disclosures Neither I nor my spouse/partner has a relevant financial relationship
More informationModels of Attention. Models of Attention
Models of Models of predictive: can we predict eye movements (bottom up attention)? [L. Itti and coll] pop out and saliency? [Z. Li] Readings: Maunsell & Cook, the role of attention in visual processing,
More informationSelective bias in temporal bisection task by number exposition
Selective bias in temporal bisection task by number exposition Carmelo M. Vicario¹ ¹ Dipartimento di Psicologia, Università Roma la Sapienza, via dei Marsi 78, Roma, Italy Key words: number- time- spatial
More informationLecturer: Rob van der Willigen 11/9/08
Auditory Perception - Detection versus Discrimination - Localization versus Discrimination - - Electrophysiological Measurements Psychophysical Measurements Three Approaches to Researching Audition physiology
More informationEffects of Sequential Context on Judgments and Decisions in the Prisoner s Dilemma Game
Effects of Sequential Context on Judgments and Decisions in the Prisoner s Dilemma Game Ivaylo Vlaev (ivaylo.vlaev@psy.ox.ac.uk) Department of Experimental Psychology, University of Oxford, Oxford, OX1
More informationTHE NEUROBIOLOGY OF VISUAL-SACCADIC DECISION MAKING
Annu. Rev. Neurosci. 2003. 26:133 79 doi: 10.1146/annurev.neuro.26.010302.081134 Copyright c 2003 by Annual Reviews. All rights reserved THE NEUROBIOLOGY OF VISUAL-SACCADIC DECISION MAKING Paul W. Glimcher
More informationThe neural systems that mediate human perceptual decision making
The neural systems that mediate human perceptual decision making Hauke R. Heekeren*, Sean Marrett and Leslie G. Ungerleider Abstract Perceptual decision making is the act of choosing one option or course
More informationLecturer: Rob van der Willigen 11/9/08
Auditory Perception - Detection versus Discrimination - Localization versus Discrimination - Electrophysiological Measurements - Psychophysical Measurements 1 Three Approaches to Researching Audition physiology
More informationREPORT DOCUMENTATION PAGE
REPORT DOCUMENTATION PAGE Form Approved OMB NO. 0704-0188 The public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions,
More informationLecture 1: Neurons. Lecture 2: Coding with spikes. To gain a basic understanding of spike based neural codes
Lecture : Neurons Lecture 2: Coding with spikes Learning objectives: To gain a basic understanding of spike based neural codes McCulloch Pitts Neuron I w in Σ out Θ Examples: I = ; θ =.5; w=. - in = *.
More informationSupplementary materials for: Executive control processes underlying multi- item working memory
Supplementary materials for: Executive control processes underlying multi- item working memory Antonio H. Lara & Jonathan D. Wallis Supplementary Figure 1 Supplementary Figure 1. Behavioral measures of
More informationHierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy
Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy Braden A. Purcell a and Roozbeh Kiani a, PNAS PLUS a Center for Neural Science, New York University,
More informationThe basal ganglia optimize decision making over general perceptual hypotheses
The basal ganglia optimize decision making over general perceptual hypotheses 1 Nathan F. Lepora 1 Kevin N. Gurney 1 1 Department of Psychology, University of Sheffield, Sheffield S10 2TP, U.K. Keywords:
More informationThe storage and recall of memories in the hippocampo-cortical system. Supplementary material. Edmund T Rolls
The storage and recall of memories in the hippocampo-cortical system Supplementary material Edmund T Rolls Oxford Centre for Computational Neuroscience, Oxford, England and University of Warwick, Department
More informationSelective Attention. Modes of Control. Domains of Selection
The New Yorker (2/7/5) Selective Attention Perception and awareness are necessarily selective (cell phone while driving): attention gates access to awareness Selective attention is deployed via two modes
More informationHow Neurons Do Integrals. Mark Goldman
How Neurons Do Integrals Mark Goldman Outline 1. What is the neural basis of short-term memory? 2. A model system: the Oculomotor Neural Integrator 3. Neural mechanisms of integration: Linear network theory
More informationTheoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück
The Binding Problem This lecture is based on following articles: Adina L. Roskies: The Binding Problem; Neuron 1999 24: 7 Charles M. Gray: The Temporal Correlation Hypothesis of Visual Feature Integration:
More informationRepresentational Switching by Dynamical Reorganization of Attractor Structure in a Network Model of the Prefrontal Cortex
Representational Switching by Dynamical Reorganization of Attractor Structure in a Network Model of the Prefrontal Cortex Yuichi Katori 1,2 *, Kazuhiro Sakamoto 3, Naohiro Saito 4, Jun Tanji 4, Hajime
More informationDecision neuroscience seeks neural models for how we identify, evaluate and choose
VmPFC function: The value proposition Lesley K Fellows and Scott A Huettel Decision neuroscience seeks neural models for how we identify, evaluate and choose options, goals, and actions. These processes
More informationNIH Public Access Author Manuscript Nature. Author manuscript; available in PMC 2009 August 17.
NIH Public Access Author Manuscript Published in final edited form as: Nature. 2008 May 15; 453(7193): 406 409. doi:10.1038/nature06849. Free choice activates a decision circuit between frontal and parietal
More informationLEAH KRUBITZER RESEARCH GROUP LAB PUBLICATIONS WHAT WE DO LINKS CONTACTS
LEAH KRUBITZER RESEARCH GROUP LAB PUBLICATIONS WHAT WE DO LINKS CONTACTS WHAT WE DO Present studies and future directions Our laboratory is currently involved in two major areas of research. The first
More informationObservational Learning Based on Models of Overlapping Pathways
Observational Learning Based on Models of Overlapping Pathways Emmanouil Hourdakis and Panos Trahanias Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH) Science and Technology
More informationChoice set options affect the valuation of risky prospects
Choice set options affect the valuation of risky prospects Stian Reimers (stian.reimers@warwick.ac.uk) Neil Stewart (neil.stewart@warwick.ac.uk) Nick Chater (nick.chater@warwick.ac.uk) Department of Psychology,
More informationDecision-making mechanisms in the brain
Decision-making mechanisms in the brain Gustavo Deco* and Edmund T. Rolls^ *Institucio Catalana de Recerca i Estudis Avangats (ICREA) Universitat Pompeu Fabra Passeigde Circumval.lacio, 8 08003 Barcelona,
More informationPrefrontal cortex and decision making in a mixedstrategy
Prefrontal cortex and decision making in a mixedstrategy game Dominic J Barraclough, Michelle L Conroy & Daeyeol Lee In a multi-agent environment, where the outcomes of one s actions change dynamically
More informationCSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems
CSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems Compare Chap 31 of Purves et al., 5e Chap 24 of Bear et al., 3e Larry Wittie Computer Science, StonyBrook University http://www.cs.sunysb.edu/~cse511
More informationMotor Systems I Cortex. Reading: BCP Chapter 14
Motor Systems I Cortex Reading: BCP Chapter 14 Principles of Sensorimotor Function Hierarchical Organization association cortex at the highest level, muscles at the lowest signals flow between levels over
More informationExtrastriate Visual Areas February 27, 2003 A. Roe
Extrastriate Visual Areas February 27, 2003 A. Roe How many extrastriate areas are there? LOTS!!! Macaque monkey flattened cortex Why? How do we know this? Topography Functional properties Connections
More informationGaze Bias Learning II. Linking neuroscience, computational modeling, and cognitive development. Tokyo, Japan March 12, 2012
Gaze Bias Learning II Linking neuroscience, computational modeling, and cognitive development Tokyo, Japan March 12, 2012 Tamagawa University Research & Management Building Meeting room 507 This workshop
More informationFramework for Comparative Research on Relational Information Displays
Framework for Comparative Research on Relational Information Displays Sung Park and Richard Catrambone 2 School of Psychology & Graphics, Visualization, and Usability Center (GVU) Georgia Institute of
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single
More informationInformation Processing During Transient Responses in the Crayfish Visual System
Information Processing During Transient Responses in the Crayfish Visual System Christopher J. Rozell, Don. H. Johnson and Raymon M. Glantz Department of Electrical & Computer Engineering Department of
More informationTaken From The Brain Top to Bottom //
Taken From The Brain Top to Bottom // http://thebrain.mcgill.ca/flash/d/d_03/d_03_cl/d_03_cl_que/d_03_cl_que.html THE EVOLUTIONARY LAYERS OF THE HUMAN BRAIN The first time you observe the anatomy of the
More informationOptimal decision-making theories: linking neurobiology with behaviour
Review TRENDS in Cognitive Sciences Vol.11 No.3 Optimal decision-making theories: linking neurobiology with behaviour Rafal Bogacz Department of Computer Science, University of Bristol, Bristol BS8 1UB,
More informationChapter 5. Summary and Conclusions! 131
! Chapter 5 Summary and Conclusions! 131 Chapter 5!!!! Summary of the main findings The present thesis investigated the sensory representation of natural sounds in the human auditory cortex. Specifically,
More informationAnalysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014
Analysis of in-vivo extracellular recordings Ryan Morrill Bootcamp 9/10/2014 Goals for the lecture Be able to: Conceptually understand some of the analysis and jargon encountered in a typical (sensory)
More informationComputational Explorations in Cognitive Neuroscience Chapter 7: Large-Scale Brain Area Functional Organization
Computational Explorations in Cognitive Neuroscience Chapter 7: Large-Scale Brain Area Functional Organization 1 7.1 Overview This chapter aims to provide a framework for modeling cognitive phenomena based
More informationMicrostimulation of macaque area LIP affects decision-making in a motion discrimination task
Microstimulation of macaque area LIP affects decision-making in a motion discrimination task Timothy D Hanks, Jochen Ditterich,2 & Michael N Shadlen A central goal of cognitive neuroscience is to elucidate
More informationacquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events
acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationComputational Cognitive Neuroscience (CCN)
introduction people!s background? motivation for taking this course? Computational Cognitive Neuroscience (CCN) Peggy Seriès, Institute for Adaptive and Neural Computation, University of Edinburgh, UK
More informationCell Responses in V4 Sparse Distributed Representation
Part 4B: Real Neurons Functions of Layers Input layer 4 from sensation or other areas 3. Neocortical Dynamics Hidden layers 2 & 3 Output layers 5 & 6 to motor systems or other areas 1 2 Hierarchical Categorical
More informationLecture. Experimental Models of Introspection in the Animal
Introspection and metacognition: Mechanisms of self-knowledge Stanislas Dehaene Chair of Experimental Cognitive Psychology Lecture Experimental Models of Introspection in the Animal Course translated from
More informationCognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence
Cognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence To understand the network paradigm also requires examining the history
More informationCh.20 Dynamic Cue Combination in Distributional Population Code Networks. Ka Yeon Kim Biopsychology
Ch.20 Dynamic Cue Combination in Distributional Population Code Networks Ka Yeon Kim Biopsychology Applying the coding scheme to dynamic cue combination (Experiment, Kording&Wolpert,2004) Dynamic sensorymotor
More informationEMOTION-I Model: A Biologically-Based Theoretical Framework for Deriving Emotional Context of Sensation in Autonomous Control Systems
28 The Open Cybernetics and Systemics Journal, 2007, 1, 28-46 EMOTION-I Model: A Biologically-Based Theoretical Framework for Deriving Emotional Context of Sensation in Autonomous Control Systems David
More informationHow Therapy Changes the Human Brain
Selected Neural Plasticity References How Therapy Changes the Human Brain Martha S. Burns, Ph.D.,ccc-slp Joint Appointment Professor Northwestern University Bryck & Fisher (2012) Training the Brain: Practical
More informationDecoding a Perceptual Decision Process across Cortex
Article Decoding a Perceptual Decision Process across Cortex Adrián Hernández, 1 Verónica Nácher, 1 Rogelio Luna, 1 Antonio Zainos, 1 Luis Lemus, 1 Manuel Alvarez, 1 Yuriria Vázquez, 1 Liliana Camarillo,
More informationNeurophysiology and Information: Theory of Brain Function
Neurophysiology and Information: Theory of Brain Function Christopher Fiorillo BiS 527, Spring 2012 042 350 4326, fiorillo@kaist.ac.kr Part 5: The Brain s Perspective: Application of Probability to the
More information1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.
1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified
More informationDifferent inhibitory effects by dopaminergic modulation and global suppression of activity
Different inhibitory effects by dopaminergic modulation and global suppression of activity Takuji Hayashi Department of Applied Physics Tokyo University of Science Osamu Araki Department of Applied Physics
More informationSensory Cue Integration
Sensory Cue Integration Summary by Byoung-Hee Kim Computer Science and Engineering (CSE) http://bi.snu.ac.kr/ Presentation Guideline Quiz on the gist of the chapter (5 min) Presenters: prepare one main
More informationOutlier Blindness : Efficient Coding Generates an Inability to Represent Extreme Values
Motivation Outlier Blindness : Efficient Coding Generates an Inability to Represent Extreme Values Elise Payzan-LeNestour & Michael Woodford AFA January 2019 Outline Motivation Question Conjecture Study
More informationNeurophysiology and Information
Neurophysiology and Information Christopher Fiorillo BiS 527, Spring 2011 042 350 4326, fiorillo@kaist.ac.kr Part 10: Perception Reading: Students should visit some websites where they can experience and
More informationUniversity of California- Los Angeles. Affiliations: University of California- Los Angeles
(1) Overview Title A random dot kinematogram for online visual psychophysics Paper Authors 1. Rajananda, Sivananda; 2. Lau, Hakwan; 3. Odegaard, Brian Paper Author Roles and Affiliations 1. Designed software;
More informationSingle cell tuning curves vs population response. Encoding: Summary. Overview of the visual cortex. Overview of the visual cortex
Encoding: Summary Spikes are the important signals in the brain. What is still debated is the code: number of spikes, exact spike timing, temporal relationship between neurons activities? Single cell tuning
More informationIncorporation of Imaging-Based Functional Assessment Procedures into the DICOM Standard Draft version 0.1 7/27/2011
Incorporation of Imaging-Based Functional Assessment Procedures into the DICOM Standard Draft version 0.1 7/27/2011 I. Purpose Drawing from the profile development of the QIBA-fMRI Technical Committee,
More informationAttention: Neural Mechanisms and Attentional Control Networks Attention 2
Attention: Neural Mechanisms and Attentional Control Networks Attention 2 Hillyard(1973) Dichotic Listening Task N1 component enhanced for attended stimuli Supports early selection Effects of Voluntary
More informationA Model of Dopamine and Uncertainty Using Temporal Difference
A Model of Dopamine and Uncertainty Using Temporal Difference Angela J. Thurnham* (a.j.thurnham@herts.ac.uk), D. John Done** (d.j.done@herts.ac.uk), Neil Davey* (n.davey@herts.ac.uk), ay J. Frank* (r.j.frank@herts.ac.uk)
More informationOscillatory Neural Network for Image Segmentation with Biased Competition for Attention
Oscillatory Neural Network for Image Segmentation with Biased Competition for Attention Tapani Raiko and Harri Valpola School of Science and Technology Aalto University (formerly Helsinki University of
More informationAFRL-OSR-VA-TR
AFRL-OSR-VA-TR-2013-0089 Sequential Analysis of Automatic Target Detection with Classification Algorithms and Optimality of Dynamic Decision Making Under Uncertainty Jun Zhang The Regents of the University
More informationTHE BRAIN HABIT BRIDGING THE CONSCIOUS AND UNCONSCIOUS MIND. Mary ET Boyle, Ph. D. Department of Cognitive Science UCSD
THE BRAIN HABIT BRIDGING THE CONSCIOUS AND UNCONSCIOUS MIND Mary ET Boyle, Ph. D. Department of Cognitive Science UCSD Linking thought and movement simultaneously! Forebrain Basal ganglia Midbrain and
More informationCognition in Parkinson's Disease and the Effect of Dopaminergic Therapy
Cognition in Parkinson's Disease and the Effect of Dopaminergic Therapy Penny A. MacDonald, MD, PhD, FRCP(C) Canada Research Chair Tier 2 in Cognitive Neuroscience and Neuroimaging Assistant Professor
More informationChapter 10 Studying Metacognitive Processes at the Single Neuron Level
Chapter 10 Studying Metacognitive Processes at the Single Neuron Level Paul G. Middlebrooks, Zachary M. Abzug and Marc A. Sommer 10.1 Introduction Over the past few decades, strides have been made toward
More informationReading Neuronal Synchrony with Depressing Synapses
NOTE Communicated by Laurence Abbott Reading Neuronal Synchrony with Depressing Synapses W. Senn Department of Neurobiology, Hebrew University, Jerusalem 4, Israel, Department of Physiology, University
More informationPHGY 210,2,4 - Physiology SENSORY PHYSIOLOGY. Martin Paré
PHGY 210,2,4 - Physiology SENSORY PHYSIOLOGY Martin Paré Associate Professor of Physiology & Psychology pare@biomed.queensu.ca http://brain.phgy.queensu.ca/pare PHGY 210,2,4 - Physiology SENSORY PHYSIOLOGY
More information