ISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien.
|
|
- Virgil Wright
- 5 years ago
- Views:
Transcription
1 ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr
2 An important (but rarely addressed) question: How can animals and humans adapt (survive) in a unknown, dynamic, changing world with few help? Fundamental processes: learning, motivations, emotions A systemic approach in computational neuroscience
3 The goal of learning is to: What is Learning? Extract invariants in the multimodal and sensorimotor world Adapt initial or previously acquired knowledge to drifts and changes Reduce the huge quantity of information received: o reduce the number of data (prototypes) o reduce the dimensionality (representation) o enhance specific internal and external signals (pain, pleasure, novelty, errors, motivations, emotions)
4 What are Emotions? Automatic response to appetitive/aversive stimuli" Biologically significant stimuli" Learning predicting stimuli for anticipation" Response = motor, autonomic, hormonal" Evaluation of their value" " For response adjustment and comparison" Pleasure/pain interoception by the body
5 What are Motivations? Extrinsic motivations:" Linked to external reinforcement" Hunger, thirst, mating, integrity of the body" Intrinsic motivations" Linked to internal reinforcement" Novelty, error of prediction, exploration, curiosity" Motivations give drives and define goals
6 Complementary roles for Motivations and Emotions Emotions detect hedonic salience: I like" (or I dislike this stimulus representing or predicting reward or punishment)" Emotional learning = learning stimuli that predict reinforcement, to anticipate and prepare the body: pavlovian or respondent conditioning" Motivations give incentive to act: I want " (to get the reward or to avoid the punishment)" Motivational learning = selection of action to maximize expectancy of reinforcement:" operant or instrumental conditioning"
7 Pavlovian conditioning or classical or respondent conditioning Unconditioned Stimuli (US) : biologically significant stimuli Conditioned Stimuli (CS) : learned (emotional) stimuli (CS and US can be aversive or appetitive)
8 Pavlovian conditioning Acquisition: CS+US Test: CS CR Extinction: CS Test: CS no-cr (But not so simple )
9 Instrumental conditioning or operant conditioning - Principle (Skinner): S-A-O (Outcomes) - Reinforcement Learning: Selection (and reinforcement) of action that maximize rewards and minimize punishment - Linked to motivations
10 The amygdala Association between a stimulus and its emotional consequences AAA ME CE ABN A-H CO BN LN
11 More complex sensory information from multimodal sensory cortex and hippocampus Simple CS US BLA: CS-US Association and representation CeA: pavlovian response Influence from and to operant conditioning Hormonal, autonomic, motor responses
12 Basal Ganglia and decision- making
13 Motivation-Goal-Planning-Execution (Penner and Mizumori 2012)
14 mpfc (motivation: benefit for the body) vs OFC (preference: value of the goal) 14
15
16 Neuromodulation: dopamine (rewards, error of prediction), serotonin (punishment, risk), noradrenaline (known uncertainty), acetylcholine (unknown uncertainty)
17 CSA V A Respondent Conditioning: Learning CS-US associations CSi Predicted US Occuring US (λ=0/1) Just an associative learning? (Not so simple )
18 Some problems in pavlovian conditioning Blocking (principe of parsimony) Phase 1: CS1+US; Phase 2: CS1&CS2+US Test: CS2 no-cr Learning depends on history of association: CS often associated with US learn less quickly Reversal quicker after overtraining Need a long time to learn extinction; context-dependent; renewal immediate (extinction is not forgetting but temporary inhibition)
19 CSA V A Respondent Conditioning: US-processing models CSi Predicted US Occuring US (λ=0/1) Rescorla-Wagner Model: Learning occurs if what happens (US=0/1) does not match expectation: Learning based on error of prediction Expectation = sum of predictive values of all stimuli CS present
20 Some problems in pavlovian conditioning Blocking (principe of parsimony) Phase 1: CS1+US; Phase 2: CS1&CS2+US Test: CS2 no-cr Learning depends on the history of association: CS often associated with US learn less quickly Reversal quicker after overtraining Need a long time to learn extinction; context-dependent; renewal immediate (extinction is not forgetting but temporary inhibition)
21 CSA V A Respondent Conditioning: CS-processing models CSi Predicted US Occuring US (λ=0/1) Pearce-Hall Model: increase associability of less known CS, as a function of surprise (=abs(rpe)): Mackintosh Model: maintain high associability for reliable CS:
22 Reward Prediction Error in VTA and Surprise (associability) in BLA (Roesch et al., 2012)
23 When there is a surprise, choosing between two kinds of uncertainty: noradrenaline (known uncertainty), acetylcholine (unknown uncertainty) (Yu and Dayan, 2005)
24 Some problems in pavlovian conditioning Blocking (principe of parsimony) Phase 1: CS1+US; Phase 2: CS1&CS2+US Test: CS2 no-cr Learning depends on history of association: CS often associated with US learn less quickly Reversal quicker after overtraining Need a long time to learn extinction; context-dependent; renewal immediate (extinction is not forgetting but temporary inhibition)
25 Interactions Respondent-Operant US vs Outcomes; CS vs CRf (conditioned reinforcers); role in addiction Action-Reflexes interactions Goal-Directed vs habitual behavior: role of the Hippocampus Task sets and history in PFC: Motivation in PL can lead to devaluation; Preference in IL can lead to extinction Neuromodulation triggered from CeA and PL/IL
26 The amygdala A more precise view on the inner circuitry
27 RW rule in LA PH rule and Ach/DA Mackintosh rule and NE History in PL/IL Features in Thalamus and Cortex Examples in context in Hippocampus
28 An amygdalar systemic model of Respondent Conditioning Learning CS predicting US : How are CS represented? (cues, contextual, history) Amount of associative change? (hybrid model) Different modes for functioning and learning rules? (neuromodulation) Fully explains pavlovian learning for sets of examples Ongoing work: Implementing online learning with task sets in PFC Extinction is an inhibition and not a forgetting (cues vs context; history)
29 Back at the systemic level Emotions and motivations are fundamental adaptive processes:" Written down on the body" Basis for decision and organization of behavior" Motivation, Goal, Strategy, Execution" Need for a deeper understanding in neuroscience" Implication in most neurological diseases" Acknowledgement to the in Bordeaux
30 ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr
Instrumental Conditioning VI: There is more than one kind of learning
Instrumental Conditioning VI: There is more than one kind of learning PSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives outline what goes into instrumental
More information1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.
1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified
More informationAssociative learning
Introduction to Learning Associative learning Event-event learning (Pavlovian/classical conditioning) Behavior-event learning (instrumental/ operant conditioning) Both are well-developed experimentally
More informationAfter Rescorla-Wagner
After Rescorla-Wagner W. Jeffrey Wilson March 6, 2013 RW Problems STM-LTM & Learning SOP Model Configural vs Elemental Nodes Problems with Rescorla-Wagner Model Extinction: No Spontaneous Recovery or Rapid
More informationStudy Plan: Session 1
Study Plan: Session 1 6. Practice learning the vocabulary. Use the electronic flashcards from the Classical The Development of Classical : The Basic Principles of Classical Conditioned Emotional Reponses:
More informationacquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events
acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationacquisition associative learning behaviorism B. F. Skinner biofeedback
acquisition associative learning in classical conditioning the initial stage when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationEffects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer
Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer RN Cardinal, JA Parkinson *, TW Robbins, A Dickinson, BJ Everitt Departments of Experimental
More informationBehavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival Threats are much better reinforcers Fear is a prime
More informationClassical Conditioning
What is classical conditioning? Classical Conditioning Learning & Memory Arlo Clark-Foos Learning to associate previously neutral stimuli with the subsequent events. Howard Eichenbaum s Thanksgiving Pavlov
More informationName: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning?
Name: Period: Chapter 7: Learning Introduction, How We Learn, & Classical Conditioning (pp. 291-304) 1. Learning: 2. What does it mean that we learn by association? 3. Habituation: 4. Associative Learning:
More informationBehavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival? Threats are much better reinforcers? Fear is a prime
More informationUnit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.
Unit 06 - Overview How We Learn and Classical Conditioning Operant Conditioning Operant Conditioning s Applications, and Comparison to Classical Conditioning Biology, Cognition, and Learning Learning By
More informationThe Rescorla Wagner Learning Model (and one of its descendants) Computational Models of Neural Systems Lecture 5.1
The Rescorla Wagner Learning Model (and one of its descendants) Lecture 5.1 David S. Touretzky Based on notes by Lisa M. Saksida November, 2015 Outline Classical and instrumental conditioning The Rescorla
More informationEmotion Explained. Edmund T. Rolls
Emotion Explained Edmund T. Rolls Professor of Experimental Psychology, University of Oxford and Fellow and Tutor in Psychology, Corpus Christi College, Oxford OXPORD UNIVERSITY PRESS Contents 1 Introduction:
More informationZNZ Advanced Course in Neuroscience Mon Limbic System II. David P. Wolfer MD
ZNZ Advanced Course in Neuroscience Mon 05.05.2014 Limbic System II David P. Wolfer MD Institute of Anatomy, University of Zurich Institute for Human Movement Sciences and Sport, ETH Zurich http://www.dpwolfer.ch
More informationDevelopmental Psychology and Learning SOCIAL EDUCATION COURSE Academic year 2014/2015
Developmental Psychology and Learning SOCIAL EDUCATION COURSE Academic year 2014/2015 EXTENDED SUMMARY Lesson #6 Monday, Oct. 27 th 2014: 19:00/21:00 Friday, Oct. 31 th 2014, 09:00/11:00 LESSON PLAN: HUMAN
More informationPSYC2010: Brain and Behaviour
PSYC2010: Brain and Behaviour PSYC2010 Notes Textbook used Week 1-3: Bouton, M.E. (2016). Learning and Behavior: A Contemporary Synthesis. 2nd Ed. Sinauer Week 4-6: Rieger, E. (Ed.) (2014) Abnormal Psychology:
More informationChapter 5: How Do We Learn?
Chapter 5: How Do We Learn? Defining Learning A relatively permanent change in behavior or the potential for behavior that results from experience Results from many life experiences, not just structured
More informationNeuroanatomy of Emotion, Fear, and Anxiety
Neuroanatomy of Emotion, Fear, and Anxiety Outline Neuroanatomy of emotion Critical conceptual, experimental design, and interpretation issues in neuroimaging research Fear and anxiety Neuroimaging research
More informationLearning. Learning is a relatively permanent change in behavior acquired through experience or practice.
Learning Learning is a relatively permanent change in behavior acquired through experience or practice. What is Learning? Learning is the process that allows us to adapt (be flexible) to the changing conditions
More informationCouncil on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain
Council on Chemical Abuse Annual Conference November 2, 2017 The Science of Addiction: Rewiring the Brain David Reyher, MSW, CAADC Behavioral Health Program Director Alvernia University Defining Addiction
More informationChapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted
Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play
More informationECHO Presentation Addiction & Brain Function
ECHO Presentation Addiction & Brain Function May 23 rd, 2018 Richard L. Bell, Ph.D. Associate Professor of Psychiatry Indiana University School of Medicine ribell@iupui.edu Development of Addiction Addiction
More informationClassical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.
Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. behaviorism - the view that psychology (1) should be an objective science
More informationLEARNING AND MOTIVATION
LEARNING AND MOTIVATION Lecture 1 - Learning: Biological Bases of Behaviour Learning: an enduring change within an organism brought about by experience that makes a change in behaviour possible. Enduring:
More informationAssociation. Operant Conditioning. Classical or Pavlovian Conditioning. Learning to associate two events. We learn to. associate two stimuli
Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association
More informationMyers PSYCHOLOGY. (7th Ed) Chapter 8. Learning. James A. McCubbin, PhD Clemson University. Worth Publishers
Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association
More informationPSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning
PSY402 Theories of Learning Chapter 8, Theories of Appetitive and Aversive Conditioning Operant Conditioning The nature of reinforcement: Premack s probability differential theory Response deprivation
More informationLearning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction
1 2 3 4 5 Myers Psychology for AP* Unit 6: Learning Unit Overview How Do We Learn? Classical Conditioning Operant Conditioning Learning by Observation How Do We Learn? Introduction Learning Habituation
More informationReinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain
Reinforcement learning and the brain: the problems we face all day Reinforcement Learning in the brain Reading: Y Niv, Reinforcement learning in the brain, 2009. Decision making at all levels Reinforcement
More information2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable.
True/False 1. S-R theories of learning in general assume that learning takes place more or less automatically, and do not require and thought by humans or nonhumans. ANS: T REF: P.18 2. Hull s theory of
More informationPsychology, Ch. 6. Learning Part 1
Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening
More informationBIOMED 509. Executive Control UNM SOM. Primate Research Inst. Kyoto,Japan. Cambridge University. JL Brigman
BIOMED 509 Executive Control Cambridge University Primate Research Inst. Kyoto,Japan UNM SOM JL Brigman 4-7-17 Symptoms and Assays of Cognitive Disorders Symptoms of Cognitive Disorders Learning & Memory
More informationEffects of limbic corticostriatal lesions on a u t o shaping performance in rats
Effects of limbic corticostriatal lesions on a u t o shaping performance in rats BJ Everitt, JA Parkinson, G Lachenal, KM Halkerston, N Rudarakanchana, RN Cardinal, J Hall, CH Morrison, JW Dalley, SR Howes,
More informationLearning = an enduring change in behavior, resulting from experience.
Chapter 6: Learning Learning = an enduring change in behavior, resulting from experience. Conditioning = a process in which environmental stimuli and behavioral processes become connected Two types of
More informationBehavioral and Motivational mechanisms of Brain. Limbic system and the Hypothalamus
Behavioral and Motivational mechanisms of Brain Limbic system and the Hypothalamus 1 General functions 1. Control of behavior 2. Control level of activities in different parts of brain 3. Motivational
More informationLearning. Learning. Stimulus Learning. Modification of behavior or understanding Is it nature or nurture?
Learning Chapter 6 Learning Modification of behavior or understanding Is it nature or nurture? Stimulus Learning Habituation: when you pay less attention to something over time response starts out strong
More informationBRAIN MECHANISMS OF REWARD AND ADDICTION
BRAIN MECHANISMS OF REWARD AND ADDICTION TREVOR.W. ROBBINS Department of Experimental Psychology, University of Cambridge Many drugs of abuse, including stimulants such as amphetamine and cocaine, opiates
More informationDikran J. Martin Introduction to Psychology
Dikran J. Martin Introduction to Psychology Name: Date: Lecture Series: Chapter 7 Learning Pages: 32 TEXT: Lefton, Lester A. and Brannon, Linda (2003). PSYCHOLOGY. (Eighth Edition.) Needham Heights, MA:
More informationIntroduction to Systems Neuroscience. Nov. 28, The limbic system. Daniel C. Kiper
Introduction to Systems Neuroscience Nov. 28, 2017 The limbic system Daniel C. Kiper kiper@ini.phys.ethz.ch http: www.ini.unizh.ch/~kiper/system_neurosci.html LIMBIC SYSTEM The term limbic system mean
More informationChapter 7 - Learning
Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.
More informationLearning. Association. Association. Unit 6: Learning. Learning. Classical or Pavlovian Conditioning. Different Types of Learning
Unit 6: Learning Learning Learning relatively permanent change in an organism s behavior due to experience experience (nurture) is the key to learning Different Types of Learning Classical -learn by association
More informationSTUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning
STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? 1. learning 2. associate; associations; associative learning; habituates 3. classical 4. operant 5. observing Classical Conditioning 1.
More informationNeurobiology of Addiction
Neurobiology of Addiction Tiffany Love, Ph.D. Department of Psychiatry The University of Utah What is Addiction? Addiction is a chronic, relapsing, and treatable brain disorder. Compulsive drug seeking
More informationLearning. Learning. Habituation. Sensitization. Habituation and Sensitization
Learning Learning Adaptive change in behavior that results from past experiences Nonassociative Learning Habituation Sensitization Classical Conditioning Instrumental Learning/Operant Conditioning Ability
More informationPsych3BN3 Topic 4 Emotion. Bilateral amygdala pathology: Case of S.M. (fig 9.1) S.M. s ratings of emotional intensity of faces (fig 9.
Psych3BN3 Topic 4 Emotion Readings: Gazzaniga Chapter 9 Bilateral amygdala pathology: Case of S.M. (fig 9.1) SM began experiencing seizures at age 20 CT, MRI revealed amygdala atrophy, result of genetic
More informationMetadata of the chapter that will be visualized online
Metadata of the chapter that will be visualized online Chapter Title Attention and Pavlovian Conditioning Copyright Year 2011 Copyright Holder Springer Science+Business Media, LLC Corresponding Author
More informationLearning Approaches. Classical Conditioning Conditioned Stimulus (CS)... Conditioned Response (CR)... Acquisition... Extinction...
Reading: H & O Chapters 9, 10, 11 Terms you should know. J. B. Watson Pavlov Classical Conditioning Unconditioned Stimulus (UCS) Unconditioned Response (UCR) Conditioned Stimulus (CS) Conditioned Response
More informationan ability that has been acquired by training (process) acquisition aversive conditioning behavior modification biological preparedness
acquisition an ability that has been acquired by training (process) aversive conditioning A type of counterconditioning that associates an unpleasant state (such as nausea) with an unwanted behavior (such
More informationEffects of rewards and reward-predictive cues on gamma oscillations in the ventral striatum
Effects of rewards and reward-predictive cues on gamma oscillations in the ventral striatum by Sushant Malhotra A thesis presented to the University of Waterloo in fulfillment of the thesis requirement
More informationStress and Emotion. Stressors are things that challenge homeostasis -- these challenges may be real or merely anticipated
Stress and Emotion 1 Stressors are things that challenge homeostasis -- these challenges may be real or merely anticipated Stress responses are what the body does about it 2 1 Two broad stressor categories
More informationAssociative Learning
Learning Learning Associative Learning Classical Conditioning Operant Conditioning Observational Learning Biological Components of Learning Cognitive Components of Learning Behavioral Therapies Associative
More informationRole of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli
Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli in rats RN Cardinal, JA Parkinson, H Djafari Marbini, AJ Toner, TW Robbins, BJ Everitt Departments of
More informationBronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood, June 2004.
Ivan Pavlov http://physiologyonline.physiology.org/ cgi/content/full/19/6/326 Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood,
More informationCategory Learning in the Brain
Aline Richtermeier Category Learning in the Brain The key to human intelligence Based on the article by: Seger, C.A. & Miller, E.K. (2010). Annual Review of Neuroscience, 33, 203-219. Categorization Ability
More informationmarijuana and the teen brain MARY ET BOYLE, PH. D. DEPARTMENT OF COGNITIVE SCIENCE UCSD
marijuana and the teen brain MARY ET BOYLE, PH. D. DEPARTMENT OF COGNITIVE SCIENCE UCSD in this talk what is marijuana? the brain on marijuana is the teen brain special? current research what is marijuana?
More informationParallel incentive processing: an integrated view of amygdala function
ARTICLE IN PRESS Parallel incentive processing: an integrated view of amygdala function Bernard W. Balleine 1 and Simon Killcross 2 1 Department of Psychology and the Brain Research Institute, University
More informationDOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION
Chapter 1 : INFORMATION MANAGEMENT & TECHNOLOGY This volume stems from the efforts of scholars who seek to understand the social dynamics of large technical systems. The purpose is to develop concepts
More informationToward a Mechanistic Understanding of Human Decision Making Contributions of Functional Neuroimaging
CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE Toward a Mechanistic Understanding of Human Decision Making Contributions of Functional Neuroimaging John P. O Doherty and Peter Bossaerts Computation and Neural
More informationMotivation, Conflict, Emotion. Abdul-Monaf Al-Jadiry, MD; FRCPsych Professor of Psychiatry
Motivation, Conflict, Emotion Abdul-Monaf Al-Jadiry, MD; FRCPsych Professor of Psychiatry Motivation Motivation is the psychological feature that arouses an organism to action toward a desired goal and
More informationPSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)
PSY 402 Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) Classical vs. Instrumental The modern view is that these two types of learning involve similar
More informationProvided for non-commercial research and educational use. Not for reproduction, distribution or commercial use.
Provided for non-commercial research and educational use. Not for reproduction, distribution or commercial use. This article was originally published in the Learning and Memory: A Comprehensive Reference,
More informationNervous System. Oct 15 10:00 AM
Nervous System Oct 15 10:00 AM 1 Nerve net = series of interconnected nerve cells Nerve = axons of many nerve cells Oct 15 10:10 AM 2 bilateral organisms exhibit cephalization (evolutionary trend towards
More informationCHAPTER 8 COMPARATIVE ANALYSIS OF ASSOCIATIVE LEARNING
CHAPTER 8 COMPARATIVE ANALYSIS OF ASSOCIATIVE LEARNING A tentative classification of learning phenomena Learning Phenomena General Specific Nonassociative Habituation Short term Long term? Sensitization
More informationEmotions: Why do we care? Emotions impact our decision making skills
The Emotional Brain Emotions: Why do we care? Emotions impact our decision making skills Emotions: Why do we care? Emotions impact our decision making skills Think about patients with frontal lobe injuries
More informationPHYSIOLOGY of LIMBIC SYSTEM
PHYSIOLOGY of LIMBIC SYSTEM By Dr. Mudassar Ali Roomi (MBBS, M.Phil.) Assistant Professor Physiology Limbic system: (shown in dark pink) Limbic = border Definition: limbic system means the entire neuronal
More informationTHE FORMATION OF HABITS The implicit supervision of the basal ganglia
THE FORMATION OF HABITS The implicit supervision of the basal ganglia MEROPI TOPALIDOU 12e Colloque de Société des Neurosciences Montpellier May 1922, 2015 THE FORMATION OF HABITS The implicit supervision
More informationLecture Series Outline
Impact of vitamins & nutrients on neurological function Lecture Series Outline Week 1: Introduction to the brain Week 2: B-vitamins and development (Guest Lecture: Usha Shan) Week 3: B-vitamins and aging
More informationChapter 5 Study Guide
Chapter 5 Study Guide Practice Exam Questions: Which of the following is not included in the definition of learning? It is demonstrated immediately Assuming you have eaten sour pickles before, imagine
More informationMemory, Attention, and Decision-Making
Memory, Attention, and Decision-Making A Unifying Computational Neuroscience Approach Edmund T. Rolls University of Oxford Department of Experimental Psychology Oxford England OXFORD UNIVERSITY PRESS Contents
More information1. Learning theory. Cambridge MRCPsych course Tue 23 Oct 2018
1. Learning theory Rudolf Cardinal rudolf@pobox.com University Lecturer in Clinical Informatics, Department of Psychiatry, University of Cambridge Honorary consultant psychiatrist, Liaison Psychiatry Service,
More informationDikran J. Martin. Psychology 110. Name: Date: Principal Features. "First, the term learning does not apply to (168)
Dikran J. Martin Psychology 110 Name: Date: Lecture Series: Chapter 5 Learning: How We're Changed Pages: 26 by Experience TEXT: Baron, Robert A. (2001). Psychology (Fifth Edition). Boston, MA: Allyn and
More information25 Things To Know. Pre- frontal
25 Things To Know Pre- frontal Frontal lobes Cognition Touch Sound Phineas Gage First indication can survive major brain trauma Lost 1+ frontal lobe Gage Working on a railroad Gage (then 25) Foreman on
More informationBrain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver
Brain Imaging studies in substance abuse Jody Tanabe, MD University of Colorado Denver NRSC January 28, 2010 Costs: Health, Crime, Productivity Costs in billions of dollars (2002) $400 $350 $400B legal
More informationNeural systems of reinforcement for drug addiction: from actions to habits to compulsion
NEUROBIOLOGY OF ADDICTION REVIEW Neural systems of reinforcement for drug addiction: from actions to habits to compulsion Barry J Everitt & Trevor W Robbins Drug addiction is increasingly viewed as the
More informationNeuroplasticity:. Happens in at least 3 ways: - - -
BRAIN PLASTICITY Neuroplasticity:. Happens in at least 3 ways: - - - Recently, it was found that new neurons and glial cells are born in specific brain regions - reorganization. Brain plasticity occurs
More informationCHAPTER 6. Learning. Lecture Overview. Introductory Definitions PSYCHOLOGY PSYCHOLOGY PSYCHOLOGY
Learning CHAPTER 6 Write down important terms in this video. Explain Skinner s view on Free Will. Lecture Overview Classical Conditioning Operant Conditioning Cognitive-Social Learning The Biology of Learning
More informationDo Reinforcement Learning Models Explain Neural Learning?
Do Reinforcement Learning Models Explain Neural Learning? Svenja Stark Fachbereich 20 - Informatik TU Darmstadt svenja.stark@stud.tu-darmstadt.de Abstract Because the functionality of our brains is still
More informationBRAIN PLASTICITY. Neuroplasticity:. Happens in at least 3 ways: - - -
BRAIN PLASTICITY Neuroplasticity:. Happens in at least 3 ways: - - - Recently, it was found that new neurons and glial cells are born in specific brain regions - reorganization. Brain plasticity occurs
More informationAuthor's personal copy
Künstl Intell (2011) 25:235 244 DOI 10.1007/s13218-011-0106-y FACHBEITRAG ANeuroscientificViewontheRoleofEmotionsinBehaving Cognitive Agents Julien Vitay Fred H. Hamker Received: 1 February 2011 / Accepted:
More informationTHE PREFRONTAL CORTEX. Connections. Dorsolateral FrontalCortex (DFPC) Inputs
THE PREFRONTAL CORTEX Connections Dorsolateral FrontalCortex (DFPC) Inputs The DPFC receives inputs predominantly from somatosensory, visual and auditory cortical association areas in the parietal, occipital
More informationPsychological Hodgepodge. Mr. Mattingly Psychology
Psychological Hodgepodge Mr. Mattingly Psychology The Number: Eight What is conditioning? Conditioning = learned or trained Classical Conditioning = learning procedure where associations are made Usually
More informationIMPACT OF TRAUMA ON CHILDHOOD DEVELOPMENT
IMPACT OF TRAUMA ON CHILDHOOD DEVELOPMENT IMPLICATIONS FOR THE EDUCATION AND SOCIAL PROWESS OF REFUGEE CHILDREN C. Richard Clark BA (Hons), PhD, MACS, BCN, FANSA, FASSA Emeritus Professor, Flinders University,
More informationClassical and Instrumental Conditioning. Lecture 8
Classical and Instrumental Conditioning Lecture 8 1 Basic Procedure for Classical Conditioning CS (Bell) US (Meat Powder) CR (Salivation) UR (Salivation) 2 Acquisition Major Phenomena of Classical Conditioning
More informationPsychology in Your Life
Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life SECOND EDITION Chapter 6 Learning 2016 W. W. Norton & Company, Inc. 1 Humans are learning machines! Learning: A change in behavior,
More informationBasic Nervous System anatomy. Neurobiology of Happiness
Basic Nervous System anatomy Neurobiology of Happiness The components Central Nervous System (CNS) Brain Spinal Cord Peripheral" Nervous System (PNS) Somatic Nervous System Autonomic Nervous System (ANS)
More informationClassical & Operant Conditioning. Learning: Principles and Applications
Classical & Operant Conditioning Learning: Principles and Applications Which Pen Would You Choose? The researchers placed the participants in the room. In this room the participants first viewed purple
More informationOutline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture
Outline What is learning? Associative Learning Classical Conditioning Operant Conditioning Observational Learning History of Learning Theory Nature or Nurture BEHAVIORISM Tabula Rasa Learning: Systematic,
More informationTheories of Learning
Theories of Learning Learning Classical conditioning Classical conditioning in real life Operant conditioning Operant conditioning in real life Learning and the mind Watson s Extreme Environmentalism Give
More informationLearning. Learning is a relatively permanent change in behavior acquired through experience.
Learning Learning is a relatively permanent change in behavior acquired through experience. Classical Conditioning Learning through Association Ivan Pavlov discovered the form of learning called Classical
More informationExploring the Brain Mechanisms Involved in Reward Prediction Errors Using Conditioned Inhibition
University of Colorado, Boulder CU Scholar Psychology and Neuroscience Graduate Theses & Dissertations Psychology and Neuroscience Spring 1-1-2013 Exploring the Brain Mechanisms Involved in Reward Prediction
More informationThe organism s problem: Avoid predation and injury so you can reproduce
Learning Chapter 7 Design a Brain The organism s problem: Avoid predation and injury so you can reproduce What characteristics are needed to behave adaptively and reproduce successfully? Consider: nearly
More informationReward Systems: Human
Reward Systems: Human 345 Reward Systems: Human M R Delgado, Rutgers University, Newark, NJ, USA ã 2009 Elsevier Ltd. All rights reserved. Introduction Rewards can be broadly defined as stimuli of positive
More informationClass 16 Emotions (10/19/17) Chapter 10
Class 16 Emotions (10/19/17) Chapter 10 Notes By: Rashea Psych 302 10/19/17 Emotions The issues o Innate or learned? o Voluntary or involuntary? (conscious/unconscious) o Adaptive behavior or communication?
More informationDEFINITION. Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience
LEARNING DEFINITION Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience WHAT DO WE LEARN? 1. Object :we learn objects with
More informationChapter 6. Learning: The Behavioral Perspective
Chapter 6 Learning: The Behavioral Perspective 1 Can someone have an asthma attack without any particles in the air to trigger it? Can an addict die of a heroin overdose even if they ve taken the same
More informationWorkshop Optimizing Exposure Therapy for Anxiety
Workshop Optimizing Exposure Therapy for Anxiety Michelle G. Craske, Ph.D. November, 2016 Professor of Psychology Professor of Psychiatry and Biobehavioral Sciences Director, UCLA Anxiety and Depression
More informationLearning. How do we learn behaviors from our direct and indirect experiences? What are the implications of learning theories for our everyday lives?
Learning How do we learn behaviors from our direct and indirect experiences? What are the implications of learning theories for our everyday lives? How do we learn? For the next few minutes brainstorm
More informationSignals of Reward and Non Reward
Signals of Reward and Non Reward Signals of reward and non reward predict: Pleasure or disappointment Success or failure 1 Reward Training By definition, this means that the animal carries out a response/action
More information