ISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien.

Size: px
Start display at page:

Download "ISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien."

Transcription

1 ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr

2 An important (but rarely addressed) question: How can animals and humans adapt (survive) in a unknown, dynamic, changing world with few help? Fundamental processes: learning, motivations, emotions A systemic approach in computational neuroscience

3 The goal of learning is to: What is Learning? Extract invariants in the multimodal and sensorimotor world Adapt initial or previously acquired knowledge to drifts and changes Reduce the huge quantity of information received: o reduce the number of data (prototypes) o reduce the dimensionality (representation) o enhance specific internal and external signals (pain, pleasure, novelty, errors, motivations, emotions)

4 What are Emotions? Automatic response to appetitive/aversive stimuli" Biologically significant stimuli" Learning predicting stimuli for anticipation" Response = motor, autonomic, hormonal" Evaluation of their value" " For response adjustment and comparison" Pleasure/pain interoception by the body

5 What are Motivations? Extrinsic motivations:" Linked to external reinforcement" Hunger, thirst, mating, integrity of the body" Intrinsic motivations" Linked to internal reinforcement" Novelty, error of prediction, exploration, curiosity" Motivations give drives and define goals

6 Complementary roles for Motivations and Emotions Emotions detect hedonic salience: I like" (or I dislike this stimulus representing or predicting reward or punishment)" Emotional learning = learning stimuli that predict reinforcement, to anticipate and prepare the body: pavlovian or respondent conditioning" Motivations give incentive to act: I want " (to get the reward or to avoid the punishment)" Motivational learning = selection of action to maximize expectancy of reinforcement:" operant or instrumental conditioning"

7 Pavlovian conditioning or classical or respondent conditioning Unconditioned Stimuli (US) : biologically significant stimuli Conditioned Stimuli (CS) : learned (emotional) stimuli (CS and US can be aversive or appetitive)

8 Pavlovian conditioning Acquisition: CS+US Test: CS CR Extinction: CS Test: CS no-cr (But not so simple )

9 Instrumental conditioning or operant conditioning - Principle (Skinner): S-A-O (Outcomes) - Reinforcement Learning: Selection (and reinforcement) of action that maximize rewards and minimize punishment - Linked to motivations

10 The amygdala Association between a stimulus and its emotional consequences AAA ME CE ABN A-H CO BN LN

11 More complex sensory information from multimodal sensory cortex and hippocampus Simple CS US BLA: CS-US Association and representation CeA: pavlovian response Influence from and to operant conditioning Hormonal, autonomic, motor responses

12 Basal Ganglia and decision- making

13 Motivation-Goal-Planning-Execution (Penner and Mizumori 2012)

14 mpfc (motivation: benefit for the body) vs OFC (preference: value of the goal) 14

15

16 Neuromodulation: dopamine (rewards, error of prediction), serotonin (punishment, risk), noradrenaline (known uncertainty), acetylcholine (unknown uncertainty)

17 CSA V A Respondent Conditioning: Learning CS-US associations CSi Predicted US Occuring US (λ=0/1) Just an associative learning? (Not so simple )

18 Some problems in pavlovian conditioning Blocking (principe of parsimony) Phase 1: CS1+US; Phase 2: CS1&CS2+US Test: CS2 no-cr Learning depends on history of association: CS often associated with US learn less quickly Reversal quicker after overtraining Need a long time to learn extinction; context-dependent; renewal immediate (extinction is not forgetting but temporary inhibition)

19 CSA V A Respondent Conditioning: US-processing models CSi Predicted US Occuring US (λ=0/1) Rescorla-Wagner Model: Learning occurs if what happens (US=0/1) does not match expectation: Learning based on error of prediction Expectation = sum of predictive values of all stimuli CS present

20 Some problems in pavlovian conditioning Blocking (principe of parsimony) Phase 1: CS1+US; Phase 2: CS1&CS2+US Test: CS2 no-cr Learning depends on the history of association: CS often associated with US learn less quickly Reversal quicker after overtraining Need a long time to learn extinction; context-dependent; renewal immediate (extinction is not forgetting but temporary inhibition)

21 CSA V A Respondent Conditioning: CS-processing models CSi Predicted US Occuring US (λ=0/1) Pearce-Hall Model: increase associability of less known CS, as a function of surprise (=abs(rpe)): Mackintosh Model: maintain high associability for reliable CS:

22 Reward Prediction Error in VTA and Surprise (associability) in BLA (Roesch et al., 2012)

23 When there is a surprise, choosing between two kinds of uncertainty: noradrenaline (known uncertainty), acetylcholine (unknown uncertainty) (Yu and Dayan, 2005)

24 Some problems in pavlovian conditioning Blocking (principe of parsimony) Phase 1: CS1+US; Phase 2: CS1&CS2+US Test: CS2 no-cr Learning depends on history of association: CS often associated with US learn less quickly Reversal quicker after overtraining Need a long time to learn extinction; context-dependent; renewal immediate (extinction is not forgetting but temporary inhibition)

25 Interactions Respondent-Operant US vs Outcomes; CS vs CRf (conditioned reinforcers); role in addiction Action-Reflexes interactions Goal-Directed vs habitual behavior: role of the Hippocampus Task sets and history in PFC: Motivation in PL can lead to devaluation; Preference in IL can lead to extinction Neuromodulation triggered from CeA and PL/IL

26 The amygdala A more precise view on the inner circuitry

27 RW rule in LA PH rule and Ach/DA Mackintosh rule and NE History in PL/IL Features in Thalamus and Cortex Examples in context in Hippocampus

28 An amygdalar systemic model of Respondent Conditioning Learning CS predicting US : How are CS represented? (cues, contextual, history) Amount of associative change? (hybrid model) Different modes for functioning and learning rules? (neuromodulation) Fully explains pavlovian learning for sets of examples Ongoing work: Implementing online learning with task sets in PFC Extinction is an inhibition and not a forgetting (cues vs context; history)

29 Back at the systemic level Emotions and motivations are fundamental adaptive processes:" Written down on the body" Basis for decision and organization of behavior" Motivation, Goal, Strategy, Execution" Need for a deeper understanding in neuroscience" Implication in most neurological diseases" Acknowledgement to the in Bordeaux

30 ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr

Instrumental Conditioning VI: There is more than one kind of learning

Instrumental Conditioning VI: There is more than one kind of learning Instrumental Conditioning VI: There is more than one kind of learning PSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives outline what goes into instrumental

More information

1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.

1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher. 1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified

More information

Associative learning

Associative learning Introduction to Learning Associative learning Event-event learning (Pavlovian/classical conditioning) Behavior-event learning (instrumental/ operant conditioning) Both are well-developed experimentally

More information

After Rescorla-Wagner

After Rescorla-Wagner After Rescorla-Wagner W. Jeffrey Wilson March 6, 2013 RW Problems STM-LTM & Learning SOP Model Configural vs Elemental Nodes Problems with Rescorla-Wagner Model Extinction: No Spontaneous Recovery or Rapid

More information

Study Plan: Session 1

Study Plan: Session 1 Study Plan: Session 1 6. Practice learning the vocabulary. Use the electronic flashcards from the Classical The Development of Classical : The Basic Principles of Classical Conditioned Emotional Reponses:

More information

acquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events

acquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned

More information

acquisition associative learning behaviorism B. F. Skinner biofeedback

acquisition associative learning behaviorism B. F. Skinner biofeedback acquisition associative learning in classical conditioning the initial stage when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned

More information

Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer

Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer RN Cardinal, JA Parkinson *, TW Robbins, A Dickinson, BJ Everitt Departments of Experimental

More information

Behavioral Neuroscience: Fear thou not. Rony Paz

Behavioral Neuroscience: Fear thou not. Rony Paz Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival Threats are much better reinforcers Fear is a prime

More information

Classical Conditioning

Classical Conditioning What is classical conditioning? Classical Conditioning Learning & Memory Arlo Clark-Foos Learning to associate previously neutral stimuli with the subsequent events. Howard Eichenbaum s Thanksgiving Pavlov

More information

Name: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning?

Name: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning? Name: Period: Chapter 7: Learning Introduction, How We Learn, & Classical Conditioning (pp. 291-304) 1. Learning: 2. What does it mean that we learn by association? 3. Habituation: 4. Associative Learning:

More information

Behavioral Neuroscience: Fear thou not. Rony Paz

Behavioral Neuroscience: Fear thou not. Rony Paz Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival? Threats are much better reinforcers? Fear is a prime

More information

Unit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.

Unit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation. Unit 06 - Overview How We Learn and Classical Conditioning Operant Conditioning Operant Conditioning s Applications, and Comparison to Classical Conditioning Biology, Cognition, and Learning Learning By

More information

The Rescorla Wagner Learning Model (and one of its descendants) Computational Models of Neural Systems Lecture 5.1

The Rescorla Wagner Learning Model (and one of its descendants) Computational Models of Neural Systems Lecture 5.1 The Rescorla Wagner Learning Model (and one of its descendants) Lecture 5.1 David S. Touretzky Based on notes by Lisa M. Saksida November, 2015 Outline Classical and instrumental conditioning The Rescorla

More information

Emotion Explained. Edmund T. Rolls

Emotion Explained. Edmund T. Rolls Emotion Explained Edmund T. Rolls Professor of Experimental Psychology, University of Oxford and Fellow and Tutor in Psychology, Corpus Christi College, Oxford OXPORD UNIVERSITY PRESS Contents 1 Introduction:

More information

ZNZ Advanced Course in Neuroscience Mon Limbic System II. David P. Wolfer MD

ZNZ Advanced Course in Neuroscience Mon Limbic System II. David P. Wolfer MD ZNZ Advanced Course in Neuroscience Mon 05.05.2014 Limbic System II David P. Wolfer MD Institute of Anatomy, University of Zurich Institute for Human Movement Sciences and Sport, ETH Zurich http://www.dpwolfer.ch

More information

Developmental Psychology and Learning SOCIAL EDUCATION COURSE Academic year 2014/2015

Developmental Psychology and Learning SOCIAL EDUCATION COURSE Academic year 2014/2015 Developmental Psychology and Learning SOCIAL EDUCATION COURSE Academic year 2014/2015 EXTENDED SUMMARY Lesson #6 Monday, Oct. 27 th 2014: 19:00/21:00 Friday, Oct. 31 th 2014, 09:00/11:00 LESSON PLAN: HUMAN

More information

PSYC2010: Brain and Behaviour

PSYC2010: Brain and Behaviour PSYC2010: Brain and Behaviour PSYC2010 Notes Textbook used Week 1-3: Bouton, M.E. (2016). Learning and Behavior: A Contemporary Synthesis. 2nd Ed. Sinauer Week 4-6: Rieger, E. (Ed.) (2014) Abnormal Psychology:

More information

Chapter 5: How Do We Learn?

Chapter 5: How Do We Learn? Chapter 5: How Do We Learn? Defining Learning A relatively permanent change in behavior or the potential for behavior that results from experience Results from many life experiences, not just structured

More information

Neuroanatomy of Emotion, Fear, and Anxiety

Neuroanatomy of Emotion, Fear, and Anxiety Neuroanatomy of Emotion, Fear, and Anxiety Outline Neuroanatomy of emotion Critical conceptual, experimental design, and interpretation issues in neuroimaging research Fear and anxiety Neuroimaging research

More information

Learning. Learning is a relatively permanent change in behavior acquired through experience or practice.

Learning. Learning is a relatively permanent change in behavior acquired through experience or practice. Learning Learning is a relatively permanent change in behavior acquired through experience or practice. What is Learning? Learning is the process that allows us to adapt (be flexible) to the changing conditions

More information

Council on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain

Council on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain Council on Chemical Abuse Annual Conference November 2, 2017 The Science of Addiction: Rewiring the Brain David Reyher, MSW, CAADC Behavioral Health Program Director Alvernia University Defining Addiction

More information

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play

More information

ECHO Presentation Addiction & Brain Function

ECHO Presentation Addiction & Brain Function ECHO Presentation Addiction & Brain Function May 23 rd, 2018 Richard L. Bell, Ph.D. Associate Professor of Psychiatry Indiana University School of Medicine ribell@iupui.edu Development of Addiction Addiction

More information

Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.

Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. behaviorism - the view that psychology (1) should be an objective science

More information

LEARNING AND MOTIVATION

LEARNING AND MOTIVATION LEARNING AND MOTIVATION Lecture 1 - Learning: Biological Bases of Behaviour Learning: an enduring change within an organism brought about by experience that makes a change in behaviour possible. Enduring:

More information

Association. Operant Conditioning. Classical or Pavlovian Conditioning. Learning to associate two events. We learn to. associate two stimuli

Association. Operant Conditioning. Classical or Pavlovian Conditioning. Learning to associate two events. We learn to. associate two stimuli Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association

More information

Myers PSYCHOLOGY. (7th Ed) Chapter 8. Learning. James A. McCubbin, PhD Clemson University. Worth Publishers

Myers PSYCHOLOGY. (7th Ed) Chapter 8. Learning. James A. McCubbin, PhD Clemson University. Worth Publishers Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association

More information

PSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning

PSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning PSY402 Theories of Learning Chapter 8, Theories of Appetitive and Aversive Conditioning Operant Conditioning The nature of reinforcement: Premack s probability differential theory Response deprivation

More information

Learning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction

Learning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction 1 2 3 4 5 Myers Psychology for AP* Unit 6: Learning Unit Overview How Do We Learn? Classical Conditioning Operant Conditioning Learning by Observation How Do We Learn? Introduction Learning Habituation

More information

Reinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain

Reinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain Reinforcement learning and the brain: the problems we face all day Reinforcement Learning in the brain Reading: Y Niv, Reinforcement learning in the brain, 2009. Decision making at all levels Reinforcement

More information

2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable.

2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable. True/False 1. S-R theories of learning in general assume that learning takes place more or less automatically, and do not require and thought by humans or nonhumans. ANS: T REF: P.18 2. Hull s theory of

More information

Psychology, Ch. 6. Learning Part 1

Psychology, Ch. 6. Learning Part 1 Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening

More information

BIOMED 509. Executive Control UNM SOM. Primate Research Inst. Kyoto,Japan. Cambridge University. JL Brigman

BIOMED 509. Executive Control UNM SOM. Primate Research Inst. Kyoto,Japan. Cambridge University. JL Brigman BIOMED 509 Executive Control Cambridge University Primate Research Inst. Kyoto,Japan UNM SOM JL Brigman 4-7-17 Symptoms and Assays of Cognitive Disorders Symptoms of Cognitive Disorders Learning & Memory

More information

Effects of limbic corticostriatal lesions on a u t o shaping performance in rats

Effects of limbic corticostriatal lesions on a u t o shaping performance in rats Effects of limbic corticostriatal lesions on a u t o shaping performance in rats BJ Everitt, JA Parkinson, G Lachenal, KM Halkerston, N Rudarakanchana, RN Cardinal, J Hall, CH Morrison, JW Dalley, SR Howes,

More information

Learning = an enduring change in behavior, resulting from experience.

Learning = an enduring change in behavior, resulting from experience. Chapter 6: Learning Learning = an enduring change in behavior, resulting from experience. Conditioning = a process in which environmental stimuli and behavioral processes become connected Two types of

More information

Behavioral and Motivational mechanisms of Brain. Limbic system and the Hypothalamus

Behavioral and Motivational mechanisms of Brain. Limbic system and the Hypothalamus Behavioral and Motivational mechanisms of Brain Limbic system and the Hypothalamus 1 General functions 1. Control of behavior 2. Control level of activities in different parts of brain 3. Motivational

More information

Learning. Learning. Stimulus Learning. Modification of behavior or understanding Is it nature or nurture?

Learning. Learning. Stimulus Learning. Modification of behavior or understanding Is it nature or nurture? Learning Chapter 6 Learning Modification of behavior or understanding Is it nature or nurture? Stimulus Learning Habituation: when you pay less attention to something over time response starts out strong

More information

BRAIN MECHANISMS OF REWARD AND ADDICTION

BRAIN MECHANISMS OF REWARD AND ADDICTION BRAIN MECHANISMS OF REWARD AND ADDICTION TREVOR.W. ROBBINS Department of Experimental Psychology, University of Cambridge Many drugs of abuse, including stimulants such as amphetamine and cocaine, opiates

More information

Dikran J. Martin Introduction to Psychology

Dikran J. Martin Introduction to Psychology Dikran J. Martin Introduction to Psychology Name: Date: Lecture Series: Chapter 7 Learning Pages: 32 TEXT: Lefton, Lester A. and Brannon, Linda (2003). PSYCHOLOGY. (Eighth Edition.) Needham Heights, MA:

More information

Introduction to Systems Neuroscience. Nov. 28, The limbic system. Daniel C. Kiper

Introduction to Systems Neuroscience. Nov. 28, The limbic system. Daniel C. Kiper Introduction to Systems Neuroscience Nov. 28, 2017 The limbic system Daniel C. Kiper kiper@ini.phys.ethz.ch http: www.ini.unizh.ch/~kiper/system_neurosci.html LIMBIC SYSTEM The term limbic system mean

More information

Chapter 7 - Learning

Chapter 7 - Learning Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.

More information

Learning. Association. Association. Unit 6: Learning. Learning. Classical or Pavlovian Conditioning. Different Types of Learning

Learning. Association. Association. Unit 6: Learning. Learning. Classical or Pavlovian Conditioning. Different Types of Learning Unit 6: Learning Learning Learning relatively permanent change in an organism s behavior due to experience experience (nurture) is the key to learning Different Types of Learning Classical -learn by association

More information

STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning

STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? 1. learning 2. associate; associations; associative learning; habituates 3. classical 4. operant 5. observing Classical Conditioning 1.

More information

Neurobiology of Addiction

Neurobiology of Addiction Neurobiology of Addiction Tiffany Love, Ph.D. Department of Psychiatry The University of Utah What is Addiction? Addiction is a chronic, relapsing, and treatable brain disorder. Compulsive drug seeking

More information

Learning. Learning. Habituation. Sensitization. Habituation and Sensitization

Learning. Learning. Habituation. Sensitization. Habituation and Sensitization Learning Learning Adaptive change in behavior that results from past experiences Nonassociative Learning Habituation Sensitization Classical Conditioning Instrumental Learning/Operant Conditioning Ability

More information

Psych3BN3 Topic 4 Emotion. Bilateral amygdala pathology: Case of S.M. (fig 9.1) S.M. s ratings of emotional intensity of faces (fig 9.

Psych3BN3 Topic 4 Emotion. Bilateral amygdala pathology: Case of S.M. (fig 9.1) S.M. s ratings of emotional intensity of faces (fig 9. Psych3BN3 Topic 4 Emotion Readings: Gazzaniga Chapter 9 Bilateral amygdala pathology: Case of S.M. (fig 9.1) SM began experiencing seizures at age 20 CT, MRI revealed amygdala atrophy, result of genetic

More information

Metadata of the chapter that will be visualized online

Metadata of the chapter that will be visualized online Metadata of the chapter that will be visualized online Chapter Title Attention and Pavlovian Conditioning Copyright Year 2011 Copyright Holder Springer Science+Business Media, LLC Corresponding Author

More information

Learning Approaches. Classical Conditioning Conditioned Stimulus (CS)... Conditioned Response (CR)... Acquisition... Extinction...

Learning Approaches. Classical Conditioning Conditioned Stimulus (CS)... Conditioned Response (CR)... Acquisition... Extinction... Reading: H & O Chapters 9, 10, 11 Terms you should know. J. B. Watson Pavlov Classical Conditioning Unconditioned Stimulus (UCS) Unconditioned Response (UCR) Conditioned Stimulus (CS) Conditioned Response

More information

an ability that has been acquired by training (process) acquisition aversive conditioning behavior modification biological preparedness

an ability that has been acquired by training (process) acquisition aversive conditioning behavior modification biological preparedness acquisition an ability that has been acquired by training (process) aversive conditioning A type of counterconditioning that associates an unpleasant state (such as nausea) with an unwanted behavior (such

More information

Effects of rewards and reward-predictive cues on gamma oscillations in the ventral striatum

Effects of rewards and reward-predictive cues on gamma oscillations in the ventral striatum Effects of rewards and reward-predictive cues on gamma oscillations in the ventral striatum by Sushant Malhotra A thesis presented to the University of Waterloo in fulfillment of the thesis requirement

More information

Stress and Emotion. Stressors are things that challenge homeostasis -- these challenges may be real or merely anticipated

Stress and Emotion. Stressors are things that challenge homeostasis -- these challenges may be real or merely anticipated Stress and Emotion 1 Stressors are things that challenge homeostasis -- these challenges may be real or merely anticipated Stress responses are what the body does about it 2 1 Two broad stressor categories

More information

Associative Learning

Associative Learning Learning Learning Associative Learning Classical Conditioning Operant Conditioning Observational Learning Biological Components of Learning Cognitive Components of Learning Behavioral Therapies Associative

More information

Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli

Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli in rats RN Cardinal, JA Parkinson, H Djafari Marbini, AJ Toner, TW Robbins, BJ Everitt Departments of

More information

Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood, June 2004.

Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood, June 2004. Ivan Pavlov http://physiologyonline.physiology.org/ cgi/content/full/19/6/326 Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood,

More information

Category Learning in the Brain

Category Learning in the Brain Aline Richtermeier Category Learning in the Brain The key to human intelligence Based on the article by: Seger, C.A. & Miller, E.K. (2010). Annual Review of Neuroscience, 33, 203-219. Categorization Ability

More information

marijuana and the teen brain MARY ET BOYLE, PH. D. DEPARTMENT OF COGNITIVE SCIENCE UCSD

marijuana and the teen brain MARY ET BOYLE, PH. D. DEPARTMENT OF COGNITIVE SCIENCE UCSD marijuana and the teen brain MARY ET BOYLE, PH. D. DEPARTMENT OF COGNITIVE SCIENCE UCSD in this talk what is marijuana? the brain on marijuana is the teen brain special? current research what is marijuana?

More information

Parallel incentive processing: an integrated view of amygdala function

Parallel incentive processing: an integrated view of amygdala function ARTICLE IN PRESS Parallel incentive processing: an integrated view of amygdala function Bernard W. Balleine 1 and Simon Killcross 2 1 Department of Psychology and the Brain Research Institute, University

More information

DOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION

DOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION Chapter 1 : INFORMATION MANAGEMENT & TECHNOLOGY This volume stems from the efforts of scholars who seek to understand the social dynamics of large technical systems. The purpose is to develop concepts

More information

Toward a Mechanistic Understanding of Human Decision Making Contributions of Functional Neuroimaging

Toward a Mechanistic Understanding of Human Decision Making Contributions of Functional Neuroimaging CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Toward a Mechanistic Understanding of Human Decision Making Contributions of Functional Neuroimaging John P. O Doherty and Peter Bossaerts Computation and Neural

More information

Motivation, Conflict, Emotion. Abdul-Monaf Al-Jadiry, MD; FRCPsych Professor of Psychiatry

Motivation, Conflict, Emotion. Abdul-Monaf Al-Jadiry, MD; FRCPsych Professor of Psychiatry Motivation, Conflict, Emotion Abdul-Monaf Al-Jadiry, MD; FRCPsych Professor of Psychiatry Motivation Motivation is the psychological feature that arouses an organism to action toward a desired goal and

More information

PSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)

PSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) PSY 402 Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) Classical vs. Instrumental The modern view is that these two types of learning involve similar

More information

Provided for non-commercial research and educational use. Not for reproduction, distribution or commercial use.

Provided for non-commercial research and educational use. Not for reproduction, distribution or commercial use. Provided for non-commercial research and educational use. Not for reproduction, distribution or commercial use. This article was originally published in the Learning and Memory: A Comprehensive Reference,

More information

Nervous System. Oct 15 10:00 AM

Nervous System. Oct 15 10:00 AM Nervous System Oct 15 10:00 AM 1 Nerve net = series of interconnected nerve cells Nerve = axons of many nerve cells Oct 15 10:10 AM 2 bilateral organisms exhibit cephalization (evolutionary trend towards

More information

CHAPTER 8 COMPARATIVE ANALYSIS OF ASSOCIATIVE LEARNING

CHAPTER 8 COMPARATIVE ANALYSIS OF ASSOCIATIVE LEARNING CHAPTER 8 COMPARATIVE ANALYSIS OF ASSOCIATIVE LEARNING A tentative classification of learning phenomena Learning Phenomena General Specific Nonassociative Habituation Short term Long term? Sensitization

More information

Emotions: Why do we care? Emotions impact our decision making skills

Emotions: Why do we care? Emotions impact our decision making skills The Emotional Brain Emotions: Why do we care? Emotions impact our decision making skills Emotions: Why do we care? Emotions impact our decision making skills Think about patients with frontal lobe injuries

More information

PHYSIOLOGY of LIMBIC SYSTEM

PHYSIOLOGY of LIMBIC SYSTEM PHYSIOLOGY of LIMBIC SYSTEM By Dr. Mudassar Ali Roomi (MBBS, M.Phil.) Assistant Professor Physiology Limbic system: (shown in dark pink) Limbic = border Definition: limbic system means the entire neuronal

More information

THE FORMATION OF HABITS The implicit supervision of the basal ganglia

THE FORMATION OF HABITS The implicit supervision of the basal ganglia THE FORMATION OF HABITS The implicit supervision of the basal ganglia MEROPI TOPALIDOU 12e Colloque de Société des Neurosciences Montpellier May 1922, 2015 THE FORMATION OF HABITS The implicit supervision

More information

Lecture Series Outline

Lecture Series Outline Impact of vitamins & nutrients on neurological function Lecture Series Outline Week 1: Introduction to the brain Week 2: B-vitamins and development (Guest Lecture: Usha Shan) Week 3: B-vitamins and aging

More information

Chapter 5 Study Guide

Chapter 5 Study Guide Chapter 5 Study Guide Practice Exam Questions: Which of the following is not included in the definition of learning? It is demonstrated immediately Assuming you have eaten sour pickles before, imagine

More information

Memory, Attention, and Decision-Making

Memory, Attention, and Decision-Making Memory, Attention, and Decision-Making A Unifying Computational Neuroscience Approach Edmund T. Rolls University of Oxford Department of Experimental Psychology Oxford England OXFORD UNIVERSITY PRESS Contents

More information

1. Learning theory. Cambridge MRCPsych course Tue 23 Oct 2018

1. Learning theory. Cambridge MRCPsych course Tue 23 Oct 2018 1. Learning theory Rudolf Cardinal rudolf@pobox.com University Lecturer in Clinical Informatics, Department of Psychiatry, University of Cambridge Honorary consultant psychiatrist, Liaison Psychiatry Service,

More information

Dikran J. Martin. Psychology 110. Name: Date: Principal Features. "First, the term learning does not apply to (168)

Dikran J. Martin. Psychology 110. Name: Date: Principal Features. First, the term learning does not apply to (168) Dikran J. Martin Psychology 110 Name: Date: Lecture Series: Chapter 5 Learning: How We're Changed Pages: 26 by Experience TEXT: Baron, Robert A. (2001). Psychology (Fifth Edition). Boston, MA: Allyn and

More information

25 Things To Know. Pre- frontal

25 Things To Know. Pre- frontal 25 Things To Know Pre- frontal Frontal lobes Cognition Touch Sound Phineas Gage First indication can survive major brain trauma Lost 1+ frontal lobe Gage Working on a railroad Gage (then 25) Foreman on

More information

Brain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver

Brain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver Brain Imaging studies in substance abuse Jody Tanabe, MD University of Colorado Denver NRSC January 28, 2010 Costs: Health, Crime, Productivity Costs in billions of dollars (2002) $400 $350 $400B legal

More information

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion NEUROBIOLOGY OF ADDICTION REVIEW Neural systems of reinforcement for drug addiction: from actions to habits to compulsion Barry J Everitt & Trevor W Robbins Drug addiction is increasingly viewed as the

More information

Neuroplasticity:. Happens in at least 3 ways: - - -

Neuroplasticity:. Happens in at least 3 ways: - - - BRAIN PLASTICITY Neuroplasticity:. Happens in at least 3 ways: - - - Recently, it was found that new neurons and glial cells are born in specific brain regions - reorganization. Brain plasticity occurs

More information

CHAPTER 6. Learning. Lecture Overview. Introductory Definitions PSYCHOLOGY PSYCHOLOGY PSYCHOLOGY

CHAPTER 6. Learning. Lecture Overview. Introductory Definitions PSYCHOLOGY PSYCHOLOGY PSYCHOLOGY Learning CHAPTER 6 Write down important terms in this video. Explain Skinner s view on Free Will. Lecture Overview Classical Conditioning Operant Conditioning Cognitive-Social Learning The Biology of Learning

More information

Do Reinforcement Learning Models Explain Neural Learning?

Do Reinforcement Learning Models Explain Neural Learning? Do Reinforcement Learning Models Explain Neural Learning? Svenja Stark Fachbereich 20 - Informatik TU Darmstadt svenja.stark@stud.tu-darmstadt.de Abstract Because the functionality of our brains is still

More information

BRAIN PLASTICITY. Neuroplasticity:. Happens in at least 3 ways: - - -

BRAIN PLASTICITY. Neuroplasticity:. Happens in at least 3 ways: - - - BRAIN PLASTICITY Neuroplasticity:. Happens in at least 3 ways: - - - Recently, it was found that new neurons and glial cells are born in specific brain regions - reorganization. Brain plasticity occurs

More information

Author's personal copy

Author's personal copy Künstl Intell (2011) 25:235 244 DOI 10.1007/s13218-011-0106-y FACHBEITRAG ANeuroscientificViewontheRoleofEmotionsinBehaving Cognitive Agents Julien Vitay Fred H. Hamker Received: 1 February 2011 / Accepted:

More information

THE PREFRONTAL CORTEX. Connections. Dorsolateral FrontalCortex (DFPC) Inputs

THE PREFRONTAL CORTEX. Connections. Dorsolateral FrontalCortex (DFPC) Inputs THE PREFRONTAL CORTEX Connections Dorsolateral FrontalCortex (DFPC) Inputs The DPFC receives inputs predominantly from somatosensory, visual and auditory cortical association areas in the parietal, occipital

More information

Psychological Hodgepodge. Mr. Mattingly Psychology

Psychological Hodgepodge. Mr. Mattingly Psychology Psychological Hodgepodge Mr. Mattingly Psychology The Number: Eight What is conditioning? Conditioning = learned or trained Classical Conditioning = learning procedure where associations are made Usually

More information

IMPACT OF TRAUMA ON CHILDHOOD DEVELOPMENT

IMPACT OF TRAUMA ON CHILDHOOD DEVELOPMENT IMPACT OF TRAUMA ON CHILDHOOD DEVELOPMENT IMPLICATIONS FOR THE EDUCATION AND SOCIAL PROWESS OF REFUGEE CHILDREN C. Richard Clark BA (Hons), PhD, MACS, BCN, FANSA, FASSA Emeritus Professor, Flinders University,

More information

Classical and Instrumental Conditioning. Lecture 8

Classical and Instrumental Conditioning. Lecture 8 Classical and Instrumental Conditioning Lecture 8 1 Basic Procedure for Classical Conditioning CS (Bell) US (Meat Powder) CR (Salivation) UR (Salivation) 2 Acquisition Major Phenomena of Classical Conditioning

More information

Psychology in Your Life

Psychology in Your Life Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life SECOND EDITION Chapter 6 Learning 2016 W. W. Norton & Company, Inc. 1 Humans are learning machines! Learning: A change in behavior,

More information

Basic Nervous System anatomy. Neurobiology of Happiness

Basic Nervous System anatomy. Neurobiology of Happiness Basic Nervous System anatomy Neurobiology of Happiness The components Central Nervous System (CNS) Brain Spinal Cord Peripheral" Nervous System (PNS) Somatic Nervous System Autonomic Nervous System (ANS)

More information

Classical & Operant Conditioning. Learning: Principles and Applications

Classical & Operant Conditioning. Learning: Principles and Applications Classical & Operant Conditioning Learning: Principles and Applications Which Pen Would You Choose? The researchers placed the participants in the room. In this room the participants first viewed purple

More information

Outline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture

Outline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture Outline What is learning? Associative Learning Classical Conditioning Operant Conditioning Observational Learning History of Learning Theory Nature or Nurture BEHAVIORISM Tabula Rasa Learning: Systematic,

More information

Theories of Learning

Theories of Learning Theories of Learning Learning Classical conditioning Classical conditioning in real life Operant conditioning Operant conditioning in real life Learning and the mind Watson s Extreme Environmentalism Give

More information

Learning. Learning is a relatively permanent change in behavior acquired through experience.

Learning. Learning is a relatively permanent change in behavior acquired through experience. Learning Learning is a relatively permanent change in behavior acquired through experience. Classical Conditioning Learning through Association Ivan Pavlov discovered the form of learning called Classical

More information

Exploring the Brain Mechanisms Involved in Reward Prediction Errors Using Conditioned Inhibition

Exploring the Brain Mechanisms Involved in Reward Prediction Errors Using Conditioned Inhibition University of Colorado, Boulder CU Scholar Psychology and Neuroscience Graduate Theses & Dissertations Psychology and Neuroscience Spring 1-1-2013 Exploring the Brain Mechanisms Involved in Reward Prediction

More information

The organism s problem: Avoid predation and injury so you can reproduce

The organism s problem: Avoid predation and injury so you can reproduce Learning Chapter 7 Design a Brain The organism s problem: Avoid predation and injury so you can reproduce What characteristics are needed to behave adaptively and reproduce successfully? Consider: nearly

More information

Reward Systems: Human

Reward Systems: Human Reward Systems: Human 345 Reward Systems: Human M R Delgado, Rutgers University, Newark, NJ, USA ã 2009 Elsevier Ltd. All rights reserved. Introduction Rewards can be broadly defined as stimuli of positive

More information

Class 16 Emotions (10/19/17) Chapter 10

Class 16 Emotions (10/19/17) Chapter 10 Class 16 Emotions (10/19/17) Chapter 10 Notes By: Rashea Psych 302 10/19/17 Emotions The issues o Innate or learned? o Voluntary or involuntary? (conscious/unconscious) o Adaptive behavior or communication?

More information

DEFINITION. Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience

DEFINITION. Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience LEARNING DEFINITION Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience WHAT DO WE LEARN? 1. Object :we learn objects with

More information

Chapter 6. Learning: The Behavioral Perspective

Chapter 6. Learning: The Behavioral Perspective Chapter 6 Learning: The Behavioral Perspective 1 Can someone have an asthma attack without any particles in the air to trigger it? Can an addict die of a heroin overdose even if they ve taken the same

More information

Workshop Optimizing Exposure Therapy for Anxiety

Workshop Optimizing Exposure Therapy for Anxiety Workshop Optimizing Exposure Therapy for Anxiety Michelle G. Craske, Ph.D. November, 2016 Professor of Psychology Professor of Psychiatry and Biobehavioral Sciences Director, UCLA Anxiety and Depression

More information

Learning. How do we learn behaviors from our direct and indirect experiences? What are the implications of learning theories for our everyday lives?

Learning. How do we learn behaviors from our direct and indirect experiences? What are the implications of learning theories for our everyday lives? Learning How do we learn behaviors from our direct and indirect experiences? What are the implications of learning theories for our everyday lives? How do we learn? For the next few minutes brainstorm

More information

Signals of Reward and Non Reward

Signals of Reward and Non Reward Signals of Reward and Non Reward Signals of reward and non reward predict: Pleasure or disappointment Success or failure 1 Reward Training By definition, this means that the animal carries out a response/action

More information