brain valuation & behavior

Size: px
Start display at page:

Download "brain valuation & behavior"

Transcription

1 brain valuation & behavior 9

2 Rangel, A, et al. (2008) Nature Neuroscience Reviews Vol 9

3 Stages in decision making process Problem is represented in the brain Brain evaluates the options Action is selected Evaluate the results of our actions

4 Learning updates the representation, the valuation and the actionselection processes. 154

5 Valuation key to the decision making process WATER WATER BOTTLED WATER BOTTLED WATER FLAVORED WATER FLAVORED WATER Motivation is a reason or a set of reasons for engaging in a particular behavior. 155

6 Select between different foods, make a decision, you eat it, and based on your experience, you learn, and then modify your valuation associated with this food 156

7 157

8 158

9 159

10 160

11 161

12 162

13

14

15

16

17

18 Subjective Value Is the average firing rate of a population of neurons coding behavioral preferences. An object has subjective value if it is a reward or a punishment.

19 Reward is something for which an animal will work. Punishment is something an animal will work to escape or avoid. The object (the dog treat) only has value if the dog will work in order to have the treat.

20 Skinner Box: Operant Conditioning 170

21 Frequency and speed of response = subjective value. 171

22 ICSS (intracranial self stimulation) Pleasure Circuit A rat pressing a lever in order to obtain stimulation reward. Olds and Milner (1958) 172

23 Rats were placed in a large levered Skinner box (Operant Conditioning Chamber) on 2 consecutive days and were subjected to both an acquisition period and an extinction period. During the 3 hour acquisition period, whenever the rat pressed a lever it would connect a circuit and activate current flow into an electrode placed at a particular location in the rat s brain. Then, during the 30 minute extinction period, the lever was deprived of its special stimulatory powers; when the rat pressed the lever, no current would flow. During both the acquisition and extinction periods, the percentage of time that rats spent lever pressing was recorded. (This percentage measurement was calculated by determining whether or not a rat had pressed a lever at least once during a given 30 second interval.) Olds and Milner then determined whether rats pressed the lever at different rates during the acquisition phase compared to the extinction phase, and asked whether this was related to the specific brain area being stimulated. They reasoned that if the rats pressed at higher rates during acquisition, then stimulation of this brain area must reflect some type of positive, rewarding sensation for the rat. bin/wordpress/?p=3733 Olds, J. & Milner, P., Journal of Comparative and Physiological Psychology, 47(6), pp

24 Animals would attack the lever with singular focus, pressing repeatedly and forcefully at high rates. Animals would self-stimulate to exhaustion and die because they would not sleep, feed or drink water. Peter Shizgal, Brain Stimulation Reward 174

25 175

26 reward prediction error 10

27 The OFC and NA connection: OFC: Orbital frontal cortex NA: Nucleus Accumbens PUT: Putamen CAU: Caudate 178

28 Salgado and Kaplitt (2015) Stereotact Funct Neurosurg 93:75-93

29 Afferent and efferent connections to NAc. Salgado and Kaplitt (2015) Stereotact Funct Neurosurg 93:75-93

30 181 Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1

31 The food is invisible to the monkey but the monkey can touch the food by placing its hand underneath the protective cover. The peri event time histogram of the neuronal impulses is shown above the raster display, in which each dot denotes the time of a neuronal impulse in reference to movement onset (release of resting key). Each horizontal line represents the activity of the same neuron on successive trials, with the first trials presented at the top and the last trials at the bottom of the raster display. a Touching food reward in the absence of stimuli that predict reward produces a brief increase in firing rate within 0.5 s of movement initiation. Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1 182

32 Touching a piece of apple (top) enhances the firing rate but touching the bare wire or an inedible object that the monkey had previously encountered does not. The traces are aligned to a temporal reference point provided by touching the hidden object (vertical line). Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1 183

33 Dopamine neurons encode an error in the temporal prediction of reward. The firing rate is depressed when the reward is delayed beyond the expected time point (1 s after lever touch). The firing rate is enhanced at the new time of reward delivery whether it is delayed (1.5 s) or precocious (0.5 s). The three arrows indicate, from left to right, the time of precocious, habitual and delayed reward delivery. The original trial sequence is from top to bottom. Data are from a two picture discrimination task. Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1 184

34 Schultz, W. (2006) Annu. Rev. Psychol. 57:87 115

35

36 Basic assumptions of animal learning theory defining the behavioral functions of rewards. Contiguity refers to the temporal proximity of a conditioned stimulus (CS), or action, and the reward. Specifically, a reward needs to follow a CS or response by an optimal interval of a few seconds, whereas rewards occurring before a stimulus or response do not contribute to learning (backward conditioning). Schultz, W. (2006) Annu. Rev. Psychol. 57:87 115

37 Reward and prediction of reward in N. Accumbens Schultz, W. (2006) Annu. Rev. Psychol. 57: Conditioned Stimulus Reward

Learning = an enduring change in behavior, resulting from experience.

Learning = an enduring change in behavior, resulting from experience. Chapter 6: Learning Learning = an enduring change in behavior, resulting from experience. Conditioning = a process in which environmental stimuli and behavioral processes become connected Two types of

More information

NSCI 324 Systems Neuroscience

NSCI 324 Systems Neuroscience NSCI 324 Systems Neuroscience Dopamine and Learning Michael Dorris Associate Professor of Physiology & Neuroscience Studies dorrism@biomed.queensu.ca http://brain.phgy.queensu.ca/dorrislab/ NSCI 324 Systems

More information

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play

More information

Brain Reward Pathway and Addiction

Brain Reward Pathway and Addiction STO-131 Brain Reward Pathway and Addiction Part 1: Is Addictive? Medical Report Ray is feeling horrible. He is very depressed and nervous. He has a headache and nausea, and he is having trouble sleeping.

More information

1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.

1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher. 1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified

More information

Reinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain

Reinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain Reinforcement learning and the brain: the problems we face all day Reinforcement Learning in the brain Reading: Y Niv, Reinforcement learning in the brain, 2009. Decision making at all levels Reinforcement

More information

acquisition associative learning behaviorism B. F. Skinner biofeedback

acquisition associative learning behaviorism B. F. Skinner biofeedback acquisition associative learning in classical conditioning the initial stage when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned

More information

acquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events

acquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned

More information

PSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning

PSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning PSY402 Theories of Learning Chapter 8, Theories of Appetitive and Aversive Conditioning Operant Conditioning The nature of reinforcement: Premack s probability differential theory Response deprivation

More information

Supplementary materials for: Executive control processes underlying multi- item working memory

Supplementary materials for: Executive control processes underlying multi- item working memory Supplementary materials for: Executive control processes underlying multi- item working memory Antonio H. Lara & Jonathan D. Wallis Supplementary Figure 1 Supplementary Figure 1. Behavioral measures of

More information

Psychology, Ch. 6. Learning Part 1

Psychology, Ch. 6. Learning Part 1 Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening

More information

Psychology in Your Life

Psychology in Your Life Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life FIRST EDITION Chapter 6 Learning 2014 W. W. Norton & Company, Inc. Section 6.1 How Do the Parts of Our Brains Function? 6.1 What Are

More information

nucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727

nucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727 Nucleus accumbens From Wikipedia, the free encyclopedia Brain: Nucleus accumbens Nucleus accumbens visible in red. Latin NeuroNames MeSH NeuroLex ID nucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727

More information

Study Plan: Session 1

Study Plan: Session 1 Study Plan: Session 1 6. Practice learning the vocabulary. Use the electronic flashcards from the Classical The Development of Classical : The Basic Principles of Classical Conditioned Emotional Reponses:

More information

Unit 6 Learning.

Unit 6 Learning. Unit 6 Learning https://www.apstudynotes.org/psychology/outlines/chapter-6-learning/ 1. Overview 1. Learning 1. A long lasting change in behavior resulting from experience 2. Classical Conditioning 1.

More information

Food restriction: enhancing effects on drug reward and striatal cell signaling

Food restriction: enhancing effects on drug reward and striatal cell signaling Food restriction: enhancing effects on drug reward and striatal cell signaling K.D. Carr Departments of Psychiatry & Pharmacology NYU School of Medicine Common Neural Substrates for Incentive-Motivating

More information

Psychology in Your Life

Psychology in Your Life Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life SECOND EDITION Chapter 6 Learning 2016 W. W. Norton & Company, Inc. 1 Humans are learning machines! Learning: A change in behavior,

More information

Choosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making

Choosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making Choosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making Leo P. Surgre, Gres S. Corrado and William T. Newsome Presenter: He Crane Huang 04/20/2010 Outline Studies on neural

More information

Council on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain

Council on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain Council on Chemical Abuse Annual Conference November 2, 2017 The Science of Addiction: Rewiring the Brain David Reyher, MSW, CAADC Behavioral Health Program Director Alvernia University Defining Addiction

More information

Learning. 3. Which of the following is an example of a generalized reinforcer? (A) chocolate cake (B) water (C) money (D) applause (E) high grades

Learning. 3. Which of the following is an example of a generalized reinforcer? (A) chocolate cake (B) water (C) money (D) applause (E) high grades Learning Practice Questions Each of the questions or incomplete statements below is followed by five suggested answers or completions. Select the one that is best in each case. 1. Just before something

More information

Unit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.

Unit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation. Unit 06 - Overview How We Learn and Classical Conditioning Operant Conditioning Operant Conditioning s Applications, and Comparison to Classical Conditioning Biology, Cognition, and Learning Learning By

More information

Chapter 5 Study Guide

Chapter 5 Study Guide Chapter 5 Study Guide Practice Exam Questions: Which of the following is not included in the definition of learning? It is demonstrated immediately Assuming you have eaten sour pickles before, imagine

More information

Understanding Addiction

Understanding Addiction Understanding Addiction How Addiction Hijacks the Brain Addiction involves craving for something intensely, loss of control over its use, and continuing involvement with it despite adverse consequences.

More information

Chapter 5: How Do We Learn?

Chapter 5: How Do We Learn? Chapter 5: How Do We Learn? Defining Learning A relatively permanent change in behavior or the potential for behavior that results from experience Results from many life experiences, not just structured

More information

Learning. Learning: Problems. Chapter 6: Learning

Learning. Learning: Problems. Chapter 6: Learning Chapter 6: Learning 1 Learning 1. In perception we studied that we are responsive to stimuli in the external world. Although some of these stimulus-response associations are innate many are learnt. 2.

More information

I. Classical Conditioning

I. Classical Conditioning Learning Chapter 8 Learning A relatively permanent change in an organism that occur because of prior experience Psychologists must study overt behavior or physical changes to study learning Learning I.

More information

Instrumental Conditioning I

Instrumental Conditioning I Instrumental Conditioning I Basic Procedures and Processes Instrumental or Operant Conditioning? These terms both refer to learned changes in behavior that occur as a result of the consequences of the

More information

Learning. Learning is the relatively permanent change in an organism s behavior due to experience.

Learning. Learning is the relatively permanent change in an organism s behavior due to experience. Chapter 7 Learning Learning Learning is the relatively permanent change in an organism s behavior due to experience. Learning The Mexican Gray wolves had problems after being released back into the wild,

More information

The Neurobiology of Drug Addiction

The Neurobiology of Drug Addiction National Institute on Drug Abuse (NIDA) The Neurobiology of Drug Addiction Last Updated January 2007 https://www.drugabuse.gov 1 Table of Contents The Neurobiology of Drug Addiction Section I: Introduction

More information

PSY402 Theories of Learning. Chapter 9 Biological Influences on Learning

PSY402 Theories of Learning. Chapter 9 Biological Influences on Learning PSY402 Theories of Learning Chapter 9 Biological Influences on Learning Limits to Learning How general are the laws of learning? Skinner s rules work in both lab and real-world settings, across species.

More information

Brain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver

Brain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver Brain Imaging studies in substance abuse Jody Tanabe, MD University of Colorado Denver NRSC January 28, 2010 Costs: Health, Crime, Productivity Costs in billions of dollars (2002) $400 $350 $400B legal

More information

Learning. AP PSYCHOLOGY Unit 5

Learning. AP PSYCHOLOGY Unit 5 Learning AP PSYCHOLOGY Unit 5 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction

More information

Associative Learning

Associative Learning Learning Learning Associative Learning Classical Conditioning Operant Conditioning Observational Learning Biological Components of Learning Cognitive Components of Learning Behavioral Therapies Associative

More information

Neocortex. Hemispheres 9/22/2010. Psychology 472 Pharmacology of Psychoactive Drugs. Structures are divided into several section or lobes.

Neocortex. Hemispheres 9/22/2010. Psychology 472 Pharmacology of Psychoactive Drugs. Structures are divided into several section or lobes. Neocortex Psychology 472 Pharmacology of Psychoactive Drugs 1 Is the most developed in Humans Has many folds and fissures The folds of tissue are called gyri or a gyrus (single) The fissures or valleys

More information

Chapter 7. Learning From Experience

Chapter 7. Learning From Experience Learning From Experience Psychology, Fifth Edition, James S. Nairne What s It For? Learning From Experience Noticing and Ignoring Learning What Events Signal Learning About the Consequences of Our Behavior

More information

Basic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia.

Basic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia. Basic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia. Neurobiological basis and pathways involved in anhedonia. Objective characterization and computational

More information

June 16, The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones.

June 16, The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones. K K The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones. rods: 75 to 150 million cells which are very sensitive to all levels of light. cones: 6 to 7 million

More information

3/7/2010. Theoretical Perspectives

3/7/2010. Theoretical Perspectives Theoretical Perspectives REBT (1955) Albert Ellis Action & Result Oriented Teaches how to identify self-defeating thoughts Replaces thoughts w/ life enhancing ones 1 A B C s of personality formation: A

More information

CSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems

CSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems CSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems Compare Chap 31 of Purves et al., 5e Chap 24 of Bear et al., 3e Larry Wittie Computer Science, StonyBrook University http://www.cs.sunysb.edu/~cse511

More information

How rational are your decisions? Neuroeconomics

How rational are your decisions? Neuroeconomics How rational are your decisions? Neuroeconomics Hecke CNS Seminar WS 2006/07 Motivation Motivation Ferdinand Porsche "Wir wollen Autos bauen, die keiner braucht aber jeder haben will." Outline 1 Introduction

More information

Chapter Six. Learning. Classical Conditioning Operant Conditioning Observational Learning

Chapter Six. Learning. Classical Conditioning Operant Conditioning Observational Learning Chapter Six Learning Classical Conditioning Operant Conditioning Observational Learning Part One: Classical Conditioning Classical Conditioning is conditioning by association, such as a pet getting excited

More information

LESSON 3.4 WORKBOOK. Can you become addicted to food?

LESSON 3.4 WORKBOOK. Can you become addicted to food? DEFINITIONS OF TERMS Dopamine A compound that sends signals from one neuron to another, and is made from the amino acid tyrosine. Dopamine reward pathway A circuit in the brain that when activated leads

More information

Phasic Accumbal Firing May Contribute to the Regulation of Drug Taking during Intravenous Cocaine Self-administration Sessions

Phasic Accumbal Firing May Contribute to the Regulation of Drug Taking during Intravenous Cocaine Self-administration Sessions Phasic Accumbal Firing May Contribute to the Regulation of Drug Taking during Intravenous Cocaine Self-administration Sessions LAURA L. PEOPLES, a ANTHONY J. UZWIAK, FRED GEE, ANTHONY T. FABBRICATORE,

More information

BRAIN MECHANISMS OF REWARD AND ADDICTION

BRAIN MECHANISMS OF REWARD AND ADDICTION BRAIN MECHANISMS OF REWARD AND ADDICTION TREVOR.W. ROBBINS Department of Experimental Psychology, University of Cambridge Many drugs of abuse, including stimulants such as amphetamine and cocaine, opiates

More information

Learning & Language Development

Learning & Language Development Learning & Language Development Classical Conditioning An involuntary response when a stimulus that normally causes a particular response is paired with a new, neutral stimulus. After enough pairings,

More information

Learning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction

Learning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction 1 2 3 4 5 Myers Psychology for AP* Unit 6: Learning Unit Overview How Do We Learn? Classical Conditioning Operant Conditioning Learning by Observation How Do We Learn? Introduction Learning Habituation

More information

Emotion Explained. Edmund T. Rolls

Emotion Explained. Edmund T. Rolls Emotion Explained Edmund T. Rolls Professor of Experimental Psychology, University of Oxford and Fellow and Tutor in Psychology, Corpus Christi College, Oxford OXPORD UNIVERSITY PRESS Contents 1 Introduction:

More information

PSY 315 Lecture 13 (3/7/2011) (Learning & Memory Mechanics) Dr. Achtman PSY 215

PSY 315 Lecture 13 (3/7/2011) (Learning & Memory Mechanics) Dr. Achtman PSY 215 PSY 215 Lecture 13 Topic: Learning & Memory- Mechanics Chapter 13.2, pages 393-399 Announcements: Question #37 was removed from Exam 2 and all students will receive an additional point. Average grade on

More information

STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning

STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? 1. learning 2. associate; associations; associative learning; habituates 3. classical 4. operant 5. observing Classical Conditioning 1.

More information

Learning. AP PSYCHOLOGY Unit 4

Learning. AP PSYCHOLOGY Unit 4 Learning AP PSYCHOLOGY Unit 4 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction

More information

Chapter 6/9: Learning

Chapter 6/9: Learning Chapter 6/9: Learning Learning A relatively durable change in behavior or knowledge that is due to experience. The acquisition of knowledge, skills, and behavior through reinforcement, modeling and natural

More information

Substance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress.

Substance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress. Drug Addiction Substance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress. Most recognize it as harmful but continue the addictive

More information

Associative learning

Associative learning Introduction to Learning Associative learning Event-event learning (Pavlovian/classical conditioning) Behavior-event learning (instrumental/ operant conditioning) Both are well-developed experimentally

More information

Chapter 7 - Learning

Chapter 7 - Learning Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.

More information

Reading Neuronal Synchrony with Depressing Synapses

Reading Neuronal Synchrony with Depressing Synapses NOTE Communicated by Laurence Abbott Reading Neuronal Synchrony with Depressing Synapses W. Senn Department of Neurobiology, Hebrew University, Jerusalem 4, Israel, Department of Physiology, University

More information

Overview of Brain Structures

Overview of Brain Structures First Overview of Brain Structures Psychology 470 Introduction to Chemical Additions Steven E. Meier, Ph.D. All parts are interrelated. You need all parts to function normally. Neurons = Nerve cells Listen

More information

If you give any person a prescription of something like Valium and have them take it on

If you give any person a prescription of something like Valium and have them take it on As always I am happy to do this presentation, which is my favorite topic in addiction medicine. I am an internist, and I have done healthcare for the homeless in Springfield as well as been the medical

More information

Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli

Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli in rats RN Cardinal, JA Parkinson, H Djafari Marbini, AJ Toner, TW Robbins, BJ Everitt Departments of

More information

Classical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts

Classical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts Learning Classical Conditioning Pavlov study of digestion dogs salivate before getting food learning as signal detection: emphasis on what happens before a given behavior Classical conditioning terms Stimulus:

More information

Supplementary Material for

Supplementary Material for Supplementary Material for Selective neuronal lapses precede human cognitive lapses following sleep deprivation Supplementary Table 1. Data acquisition details Session Patient Brain regions monitored Time

More information

Taken From The Brain Top to Bottom //

Taken From The Brain Top to Bottom // Taken From The Brain Top to Bottom // http://thebrain.mcgill.ca/flash/d/d_03/d_03_cl/d_03_cl_que/d_03_cl_que.html THE EVOLUTIONARY LAYERS OF THE HUMAN BRAIN The first time you observe the anatomy of the

More information

Microcircuitry coordination of cortical motor information in self-initiation of voluntary movements

Microcircuitry coordination of cortical motor information in self-initiation of voluntary movements Y. Isomura et al. 1 Microcircuitry coordination of cortical motor information in self-initiation of voluntary movements Yoshikazu Isomura, Rie Harukuni, Takashi Takekawa, Hidenori Aizawa & Tomoki Fukai

More information

Clusters, Symbols and Cortical Topography

Clusters, Symbols and Cortical Topography Clusters, Symbols and Cortical Topography Lee Newman Thad Polk Dept. of Psychology Dept. Electrical Engineering & Computer Science University of Michigan 26th Soar Workshop May 26, 2006 Ann Arbor, MI agenda

More information

Theoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück

Theoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück The Binding Problem This lecture is based on following articles: Adina L. Roskies: The Binding Problem; Neuron 1999 24: 7 Charles M. Gray: The Temporal Correlation Hypothesis of Visual Feature Integration:

More information

Representation of negative motivational value in the primate

Representation of negative motivational value in the primate Representation of negative motivational value in the primate lateral habenula Masayuki Matsumoto & Okihide Hikosaka Supplementary Figure 1 Anticipatory licking and blinking. (a, b) The average normalized

More information

Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more

Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more 1 Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more strongly when an image was negative than when the same

More information

Dikran J. Martin. Psychology 110. Name: Date: Principal Features. "First, the term learning does not apply to (168)

Dikran J. Martin. Psychology 110. Name: Date: Principal Features. First, the term learning does not apply to (168) Dikran J. Martin Psychology 110 Name: Date: Lecture Series: Chapter 5 Learning: How We're Changed Pages: 26 by Experience TEXT: Baron, Robert A. (2001). Psychology (Fifth Edition). Boston, MA: Allyn and

More information

Double dissociation of value computations in orbitofrontal and anterior cingulate neurons

Double dissociation of value computations in orbitofrontal and anterior cingulate neurons Supplementary Information for: Double dissociation of value computations in orbitofrontal and anterior cingulate neurons Steven W. Kennerley, Timothy E. J. Behrens & Jonathan D. Wallis Content list: Supplementary

More information

Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007

Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007 Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007 What is involved in learning? Evolution -The changes in behaviour that accumulate across generations are stored in the genes Combined with natural

More information

Emotion I: General concepts, fear and anxiety

Emotion I: General concepts, fear and anxiety C82NAB Neuroscience and Behaviour Emotion I: General concepts, fear and anxiety Tobias Bast, School of Psychology, University of Nottingham 1 Outline Emotion I (first part) Studying brain substrates of

More information

Ch. 18. Brain Mechanisms of Emotion. Bear et al., Neuroscience: Exploring the Brain, 3 rd ed., Lippincott Williams & Wilkins, 2006, pp

Ch. 18. Brain Mechanisms of Emotion. Bear et al., Neuroscience: Exploring the Brain, 3 rd ed., Lippincott Williams & Wilkins, 2006, pp Ch. 18. Brain Mechanisms of Emotion Bear et al., Neuroscience: Exploring the Brain, 3 rd ed., Lippincott Williams & Wilkins, 2006, pp 564-583. WHAT IS EMOTION? Love, hate, disgust, joy, shame, envy, guilt,

More information

Operant Conditioning B.F. SKINNER

Operant Conditioning B.F. SKINNER Operant Conditioning B.F. SKINNER Reinforcement in Operant Conditioning Behavior Consequence Patronize Elmo s Diner It s all a matter of consequences. Rewarding Stimulus Presented Tendency to tell jokes

More information

Modeling Effects of Drugs on Neuron Communication

Modeling Effects of Drugs on Neuron Communication Modeling Effects of Drugs on Neuron Communication How do neurons communicate? Your nervous system is made of nerve cells called neurons. Neurons do not touch each other. They are separated by a small gap

More information

Chapter 6. Learning: The Behavioral Perspective

Chapter 6. Learning: The Behavioral Perspective Chapter 6 Learning: The Behavioral Perspective 1 Can someone have an asthma attack without any particles in the air to trigger it? Can an addict die of a heroin overdose even if they ve taken the same

More information

25 Things To Know. Pre- frontal

25 Things To Know. Pre- frontal 25 Things To Know Pre- frontal Frontal lobes Cognition Touch Sound Phineas Gage First indication can survive major brain trauma Lost 1+ frontal lobe Gage Working on a railroad Gage (then 25) Foreman on

More information

Book 3: Lab Procedures Book 3: Ch. 1: The Hypothesis and Overview

Book 3: Lab Procedures Book 3: Ch. 1: The Hypothesis and Overview Book 3: Lab Procedures Book 3: Ch. 1: The Hypothesis and Overview 13 Introduction This experiment will investigate how cocaine acts on dopamine neurons in the brain. Cocaine is a drug of abuse that increases

More information

Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.

Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. behaviorism - the view that psychology (1) should be an objective science

More information

Behavioral Neuroscience: Fear thou not. Rony Paz

Behavioral Neuroscience: Fear thou not. Rony Paz Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival? Threats are much better reinforcers? Fear is a prime

More information

Name: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning?

Name: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning? Name: Period: Chapter 7: Learning Introduction, How We Learn, & Classical Conditioning (pp. 291-304) 1. Learning: 2. What does it mean that we learn by association? 3. Habituation: 4. Associative Learning:

More information

Orbitofrontal cortical activity during repeated free choice

Orbitofrontal cortical activity during repeated free choice J Neurophysiol 107: 3246 3255, 2012. First published March 14, 2012; doi:10.1152/jn.00690.2010. Orbitofrontal cortical activity during repeated free choice Michael Campos, Kari Koppitch, Richard A. Andersen,

More information

The Neuroscience of Addiction: A mini-review

The Neuroscience of Addiction: A mini-review The Neuroscience of Addiction: A mini-review Jim Morrill, MD, PhD MGH Charlestown HealthCare Center Massachusetts General Hospital Disclosures Neither I nor my spouse/partner has a relevant financial relationship

More information

ISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien.

ISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien. ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr An important (but rarely addressed) question: How can animals and humans adapt (survive)

More information

Experimental Psychology PSY 433. Chapter 9 Conditioning and Learning

Experimental Psychology PSY 433. Chapter 9 Conditioning and Learning Experimental Psychology PSY 433 Chapter 9 Conditioning and Learning Midterm Results Score Grade N 29-34 A 9 26-28 B 4 23-25 C 5 20-22 D 2 0-19 F 4 Top score = 34/34 Top score for curve = 33 What is Plagiarism?

More information

PSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)

PSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) PSY 402 Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) Classical vs. Instrumental The modern view is that these two types of learning involve similar

More information

Prof. Greg Francis 7/31/15

Prof. Greg Francis 7/31/15 s PSY 200 Greg Francis Lecture 06 How do you recognize your grandmother? Action potential With enough excitatory input, a cell produces an action potential that sends a signal down its axon to other cells

More information

Supplementary Information. Gauge size. midline. arcuate 10 < n < 15 5 < n < 10 1 < n < < n < 15 5 < n < 10 1 < n < 5. principal principal

Supplementary Information. Gauge size. midline. arcuate 10 < n < 15 5 < n < 10 1 < n < < n < 15 5 < n < 10 1 < n < 5. principal principal Supplementary Information set set = Reward = Reward Gauge size Gauge size 3 Numer of correct trials 3 Numer of correct trials Supplementary Fig.. Principle of the Gauge increase. The gauge size (y axis)

More information

Lecture overview. What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods )

Lecture overview. What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods ) Lecture overview What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods ) 1 Lecture overview What hypothesis to test in the fly? Quantitative data collection

More information

Parts of the Brain. Hindbrain. Controls autonomic functions Breathing, Heartbeat, Blood pressure, Swallowing, Vomiting, etc. Upper part of hindbrain

Parts of the Brain. Hindbrain. Controls autonomic functions Breathing, Heartbeat, Blood pressure, Swallowing, Vomiting, etc. Upper part of hindbrain Parts of the Brain The human brain is made up of three main parts: 1) Hindbrain (or brainstem) Which is made up of: Myelencephalon Metencephalon 2) Midbrain Which is made up of: Mesencephalon 3) Forebrain

More information

2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable.

2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable. True/False 1. S-R theories of learning in general assume that learning takes place more or less automatically, and do not require and thought by humans or nonhumans. ANS: T REF: P.18 2. Hull s theory of

More information

Outline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture

Outline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture Outline What is learning? Associative Learning Classical Conditioning Operant Conditioning Observational Learning History of Learning Theory Nature or Nurture BEHAVIORISM Tabula Rasa Learning: Systematic,

More information

DOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION

DOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION Chapter 1 : INFORMATION MANAGEMENT & TECHNOLOGY This volume stems from the efforts of scholars who seek to understand the social dynamics of large technical systems. The purpose is to develop concepts

More information

ANNA STATE HOSPITAL. peated measurement of the attack. A mechanical

ANNA STATE HOSPITAL. peated measurement of the attack. A mechanical JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR VOLUME 8, NUMBER 3 MAY, 1965 THE OPPORTUNITY FOR AGGRESSION AS AN OPERANT REINFORCER DURING AVERSIVE STIMULATION' N. H. AZRIN, R. R. HUTCHINSON, AND R.

More information

Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer

Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer RN Cardinal, JA Parkinson *, TW Robbins, A Dickinson, BJ Everitt Departments of Experimental

More information

Classical & Operant Conditioning. Learning: Principles and Applications

Classical & Operant Conditioning. Learning: Principles and Applications Classical & Operant Conditioning Learning: Principles and Applications Which Pen Would You Choose? The researchers placed the participants in the room. In this room the participants first viewed purple

More information

Dopamine neurons report an error in the temporal prediction of reward during learning

Dopamine neurons report an error in the temporal prediction of reward during learning articles Dopamine neurons report an error in the temporal prediction of reward during learning Jeffrey R. Hollerman 1,2 and Wolfram Schultz 1 1 Institute of Physiology, University of Fribourg, CH-1700

More information

Connect with amygdala (emotional center) Compares expected with actual Compare expected reward/punishment with actual reward/punishment Intuitive

Connect with amygdala (emotional center) Compares expected with actual Compare expected reward/punishment with actual reward/punishment Intuitive Orbitofronal Notes Frontal lobe prefrontal cortex 1. Dorsolateral Last to myelinate Sleep deprivation 2. Orbitofrontal Like dorsolateral, involved in: Executive functions Working memory Cognitive flexibility

More information

Introduction to Computational Neuroscience

Introduction to Computational Neuroscience Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis

More information

Chapter 6: Learning The McGraw-Hill Companies, Inc.

Chapter 6: Learning The McGraw-Hill Companies, Inc. Chapter 6: Learning Learning A relatively permanent change in behavior brought about by experience Distinguishes between changes due to maturation and changes brought about by experience Distinguishes

More information

biological psychology, p. 40 The study of the nervous system, especially the brain. neuroscience, p. 40

biological psychology, p. 40 The study of the nervous system, especially the brain. neuroscience, p. 40 biological psychology, p. 40 The specialized branch of psychology that studies the relationship between behavior and bodily processes and system; also called biopsychology or psychobiology. neuroscience,

More information

THE AMYGDALA AND REWARD

THE AMYGDALA AND REWARD THE AMYGDALA AND REWARD Mark G. Baxter* and Elisabeth A. Murray The amygdala an almond-shaped group of nuclei at the heart of the telencephalon has been associated with a range of cognitive functions,

More information