brain valuation & behavior
|
|
- Damon Mosley
- 5 years ago
- Views:
Transcription
1 brain valuation & behavior 9
2 Rangel, A, et al. (2008) Nature Neuroscience Reviews Vol 9
3 Stages in decision making process Problem is represented in the brain Brain evaluates the options Action is selected Evaluate the results of our actions
4 Learning updates the representation, the valuation and the actionselection processes. 154
5 Valuation key to the decision making process WATER WATER BOTTLED WATER BOTTLED WATER FLAVORED WATER FLAVORED WATER Motivation is a reason or a set of reasons for engaging in a particular behavior. 155
6 Select between different foods, make a decision, you eat it, and based on your experience, you learn, and then modify your valuation associated with this food 156
7 157
8 158
9 159
10 160
11 161
12 162
13
14
15
16
17
18 Subjective Value Is the average firing rate of a population of neurons coding behavioral preferences. An object has subjective value if it is a reward or a punishment.
19 Reward is something for which an animal will work. Punishment is something an animal will work to escape or avoid. The object (the dog treat) only has value if the dog will work in order to have the treat.
20 Skinner Box: Operant Conditioning 170
21 Frequency and speed of response = subjective value. 171
22 ICSS (intracranial self stimulation) Pleasure Circuit A rat pressing a lever in order to obtain stimulation reward. Olds and Milner (1958) 172
23 Rats were placed in a large levered Skinner box (Operant Conditioning Chamber) on 2 consecutive days and were subjected to both an acquisition period and an extinction period. During the 3 hour acquisition period, whenever the rat pressed a lever it would connect a circuit and activate current flow into an electrode placed at a particular location in the rat s brain. Then, during the 30 minute extinction period, the lever was deprived of its special stimulatory powers; when the rat pressed the lever, no current would flow. During both the acquisition and extinction periods, the percentage of time that rats spent lever pressing was recorded. (This percentage measurement was calculated by determining whether or not a rat had pressed a lever at least once during a given 30 second interval.) Olds and Milner then determined whether rats pressed the lever at different rates during the acquisition phase compared to the extinction phase, and asked whether this was related to the specific brain area being stimulated. They reasoned that if the rats pressed at higher rates during acquisition, then stimulation of this brain area must reflect some type of positive, rewarding sensation for the rat. bin/wordpress/?p=3733 Olds, J. & Milner, P., Journal of Comparative and Physiological Psychology, 47(6), pp
24 Animals would attack the lever with singular focus, pressing repeatedly and forcefully at high rates. Animals would self-stimulate to exhaustion and die because they would not sleep, feed or drink water. Peter Shizgal, Brain Stimulation Reward 174
25 175
26 reward prediction error 10
27 The OFC and NA connection: OFC: Orbital frontal cortex NA: Nucleus Accumbens PUT: Putamen CAU: Caudate 178
28 Salgado and Kaplitt (2015) Stereotact Funct Neurosurg 93:75-93
29 Afferent and efferent connections to NAc. Salgado and Kaplitt (2015) Stereotact Funct Neurosurg 93:75-93
30 181 Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1
31 The food is invisible to the monkey but the monkey can touch the food by placing its hand underneath the protective cover. The peri event time histogram of the neuronal impulses is shown above the raster display, in which each dot denotes the time of a neuronal impulse in reference to movement onset (release of resting key). Each horizontal line represents the activity of the same neuron on successive trials, with the first trials presented at the top and the last trials at the bottom of the raster display. a Touching food reward in the absence of stimuli that predict reward produces a brief increase in firing rate within 0.5 s of movement initiation. Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1 182
32 Touching a piece of apple (top) enhances the firing rate but touching the bare wire or an inedible object that the monkey had previously encountered does not. The traces are aligned to a temporal reference point provided by touching the hidden object (vertical line). Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1 183
33 Dopamine neurons encode an error in the temporal prediction of reward. The firing rate is depressed when the reward is delayed beyond the expected time point (1 s after lever touch). The firing rate is enhanced at the new time of reward delivery whether it is delayed (1.5 s) or precocious (0.5 s). The three arrows indicate, from left to right, the time of precocious, habitual and delayed reward delivery. The original trial sequence is from top to bottom. Data are from a two picture discrimination task. Schultz, W. (2000) NATURE REVIEWS NEUROSCIENCE VOLUME 1 184
34 Schultz, W. (2006) Annu. Rev. Psychol. 57:87 115
35
36 Basic assumptions of animal learning theory defining the behavioral functions of rewards. Contiguity refers to the temporal proximity of a conditioned stimulus (CS), or action, and the reward. Specifically, a reward needs to follow a CS or response by an optimal interval of a few seconds, whereas rewards occurring before a stimulus or response do not contribute to learning (backward conditioning). Schultz, W. (2006) Annu. Rev. Psychol. 57:87 115
37 Reward and prediction of reward in N. Accumbens Schultz, W. (2006) Annu. Rev. Psychol. 57: Conditioned Stimulus Reward
Learning = an enduring change in behavior, resulting from experience.
Chapter 6: Learning Learning = an enduring change in behavior, resulting from experience. Conditioning = a process in which environmental stimuli and behavioral processes become connected Two types of
More informationNSCI 324 Systems Neuroscience
NSCI 324 Systems Neuroscience Dopamine and Learning Michael Dorris Associate Professor of Physiology & Neuroscience Studies dorrism@biomed.queensu.ca http://brain.phgy.queensu.ca/dorrislab/ NSCI 324 Systems
More informationChapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted
Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play
More informationBrain Reward Pathway and Addiction
STO-131 Brain Reward Pathway and Addiction Part 1: Is Addictive? Medical Report Ray is feeling horrible. He is very depressed and nervous. He has a headache and nausea, and he is having trouble sleeping.
More information1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.
1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified
More informationReinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain
Reinforcement learning and the brain: the problems we face all day Reinforcement Learning in the brain Reading: Y Niv, Reinforcement learning in the brain, 2009. Decision making at all levels Reinforcement
More informationacquisition associative learning behaviorism B. F. Skinner biofeedback
acquisition associative learning in classical conditioning the initial stage when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationacquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events
acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationPSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning
PSY402 Theories of Learning Chapter 8, Theories of Appetitive and Aversive Conditioning Operant Conditioning The nature of reinforcement: Premack s probability differential theory Response deprivation
More informationSupplementary materials for: Executive control processes underlying multi- item working memory
Supplementary materials for: Executive control processes underlying multi- item working memory Antonio H. Lara & Jonathan D. Wallis Supplementary Figure 1 Supplementary Figure 1. Behavioral measures of
More informationPsychology, Ch. 6. Learning Part 1
Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening
More informationPsychology in Your Life
Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life FIRST EDITION Chapter 6 Learning 2014 W. W. Norton & Company, Inc. Section 6.1 How Do the Parts of Our Brains Function? 6.1 What Are
More informationnucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727
Nucleus accumbens From Wikipedia, the free encyclopedia Brain: Nucleus accumbens Nucleus accumbens visible in red. Latin NeuroNames MeSH NeuroLex ID nucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727
More informationStudy Plan: Session 1
Study Plan: Session 1 6. Practice learning the vocabulary. Use the electronic flashcards from the Classical The Development of Classical : The Basic Principles of Classical Conditioned Emotional Reponses:
More informationUnit 6 Learning.
Unit 6 Learning https://www.apstudynotes.org/psychology/outlines/chapter-6-learning/ 1. Overview 1. Learning 1. A long lasting change in behavior resulting from experience 2. Classical Conditioning 1.
More informationFood restriction: enhancing effects on drug reward and striatal cell signaling
Food restriction: enhancing effects on drug reward and striatal cell signaling K.D. Carr Departments of Psychiatry & Pharmacology NYU School of Medicine Common Neural Substrates for Incentive-Motivating
More informationPsychology in Your Life
Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life SECOND EDITION Chapter 6 Learning 2016 W. W. Norton & Company, Inc. 1 Humans are learning machines! Learning: A change in behavior,
More informationChoosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making
Choosing the Greater of Two Goods: Neural Currencies for Valuation and Decision Making Leo P. Surgre, Gres S. Corrado and William T. Newsome Presenter: He Crane Huang 04/20/2010 Outline Studies on neural
More informationCouncil on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain
Council on Chemical Abuse Annual Conference November 2, 2017 The Science of Addiction: Rewiring the Brain David Reyher, MSW, CAADC Behavioral Health Program Director Alvernia University Defining Addiction
More informationLearning. 3. Which of the following is an example of a generalized reinforcer? (A) chocolate cake (B) water (C) money (D) applause (E) high grades
Learning Practice Questions Each of the questions or incomplete statements below is followed by five suggested answers or completions. Select the one that is best in each case. 1. Just before something
More informationUnit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.
Unit 06 - Overview How We Learn and Classical Conditioning Operant Conditioning Operant Conditioning s Applications, and Comparison to Classical Conditioning Biology, Cognition, and Learning Learning By
More informationChapter 5 Study Guide
Chapter 5 Study Guide Practice Exam Questions: Which of the following is not included in the definition of learning? It is demonstrated immediately Assuming you have eaten sour pickles before, imagine
More informationUnderstanding Addiction
Understanding Addiction How Addiction Hijacks the Brain Addiction involves craving for something intensely, loss of control over its use, and continuing involvement with it despite adverse consequences.
More informationChapter 5: How Do We Learn?
Chapter 5: How Do We Learn? Defining Learning A relatively permanent change in behavior or the potential for behavior that results from experience Results from many life experiences, not just structured
More informationLearning. Learning: Problems. Chapter 6: Learning
Chapter 6: Learning 1 Learning 1. In perception we studied that we are responsive to stimuli in the external world. Although some of these stimulus-response associations are innate many are learnt. 2.
More informationI. Classical Conditioning
Learning Chapter 8 Learning A relatively permanent change in an organism that occur because of prior experience Psychologists must study overt behavior or physical changes to study learning Learning I.
More informationInstrumental Conditioning I
Instrumental Conditioning I Basic Procedures and Processes Instrumental or Operant Conditioning? These terms both refer to learned changes in behavior that occur as a result of the consequences of the
More informationLearning. Learning is the relatively permanent change in an organism s behavior due to experience.
Chapter 7 Learning Learning Learning is the relatively permanent change in an organism s behavior due to experience. Learning The Mexican Gray wolves had problems after being released back into the wild,
More informationThe Neurobiology of Drug Addiction
National Institute on Drug Abuse (NIDA) The Neurobiology of Drug Addiction Last Updated January 2007 https://www.drugabuse.gov 1 Table of Contents The Neurobiology of Drug Addiction Section I: Introduction
More informationPSY402 Theories of Learning. Chapter 9 Biological Influences on Learning
PSY402 Theories of Learning Chapter 9 Biological Influences on Learning Limits to Learning How general are the laws of learning? Skinner s rules work in both lab and real-world settings, across species.
More informationBrain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver
Brain Imaging studies in substance abuse Jody Tanabe, MD University of Colorado Denver NRSC January 28, 2010 Costs: Health, Crime, Productivity Costs in billions of dollars (2002) $400 $350 $400B legal
More informationLearning. AP PSYCHOLOGY Unit 5
Learning AP PSYCHOLOGY Unit 5 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction
More informationAssociative Learning
Learning Learning Associative Learning Classical Conditioning Operant Conditioning Observational Learning Biological Components of Learning Cognitive Components of Learning Behavioral Therapies Associative
More informationNeocortex. Hemispheres 9/22/2010. Psychology 472 Pharmacology of Psychoactive Drugs. Structures are divided into several section or lobes.
Neocortex Psychology 472 Pharmacology of Psychoactive Drugs 1 Is the most developed in Humans Has many folds and fissures The folds of tissue are called gyri or a gyrus (single) The fissures or valleys
More informationChapter 7. Learning From Experience
Learning From Experience Psychology, Fifth Edition, James S. Nairne What s It For? Learning From Experience Noticing and Ignoring Learning What Events Signal Learning About the Consequences of Our Behavior
More informationBasic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia.
Basic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia. Neurobiological basis and pathways involved in anhedonia. Objective characterization and computational
More informationJune 16, The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones.
K K The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones. rods: 75 to 150 million cells which are very sensitive to all levels of light. cones: 6 to 7 million
More information3/7/2010. Theoretical Perspectives
Theoretical Perspectives REBT (1955) Albert Ellis Action & Result Oriented Teaches how to identify self-defeating thoughts Replaces thoughts w/ life enhancing ones 1 A B C s of personality formation: A
More informationCSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems
CSE511 Brain & Memory Modeling Lect 22,24,25: Memory Systems Compare Chap 31 of Purves et al., 5e Chap 24 of Bear et al., 3e Larry Wittie Computer Science, StonyBrook University http://www.cs.sunysb.edu/~cse511
More informationHow rational are your decisions? Neuroeconomics
How rational are your decisions? Neuroeconomics Hecke CNS Seminar WS 2006/07 Motivation Motivation Ferdinand Porsche "Wir wollen Autos bauen, die keiner braucht aber jeder haben will." Outline 1 Introduction
More informationChapter Six. Learning. Classical Conditioning Operant Conditioning Observational Learning
Chapter Six Learning Classical Conditioning Operant Conditioning Observational Learning Part One: Classical Conditioning Classical Conditioning is conditioning by association, such as a pet getting excited
More informationLESSON 3.4 WORKBOOK. Can you become addicted to food?
DEFINITIONS OF TERMS Dopamine A compound that sends signals from one neuron to another, and is made from the amino acid tyrosine. Dopamine reward pathway A circuit in the brain that when activated leads
More informationPhasic Accumbal Firing May Contribute to the Regulation of Drug Taking during Intravenous Cocaine Self-administration Sessions
Phasic Accumbal Firing May Contribute to the Regulation of Drug Taking during Intravenous Cocaine Self-administration Sessions LAURA L. PEOPLES, a ANTHONY J. UZWIAK, FRED GEE, ANTHONY T. FABBRICATORE,
More informationBRAIN MECHANISMS OF REWARD AND ADDICTION
BRAIN MECHANISMS OF REWARD AND ADDICTION TREVOR.W. ROBBINS Department of Experimental Psychology, University of Cambridge Many drugs of abuse, including stimulants such as amphetamine and cocaine, opiates
More informationLearning & Language Development
Learning & Language Development Classical Conditioning An involuntary response when a stimulus that normally causes a particular response is paired with a new, neutral stimulus. After enough pairings,
More informationLearning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction
1 2 3 4 5 Myers Psychology for AP* Unit 6: Learning Unit Overview How Do We Learn? Classical Conditioning Operant Conditioning Learning by Observation How Do We Learn? Introduction Learning Habituation
More informationEmotion Explained. Edmund T. Rolls
Emotion Explained Edmund T. Rolls Professor of Experimental Psychology, University of Oxford and Fellow and Tutor in Psychology, Corpus Christi College, Oxford OXPORD UNIVERSITY PRESS Contents 1 Introduction:
More informationPSY 315 Lecture 13 (3/7/2011) (Learning & Memory Mechanics) Dr. Achtman PSY 215
PSY 215 Lecture 13 Topic: Learning & Memory- Mechanics Chapter 13.2, pages 393-399 Announcements: Question #37 was removed from Exam 2 and all students will receive an additional point. Average grade on
More informationSTUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning
STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? 1. learning 2. associate; associations; associative learning; habituates 3. classical 4. operant 5. observing Classical Conditioning 1.
More informationLearning. AP PSYCHOLOGY Unit 4
Learning AP PSYCHOLOGY Unit 4 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction
More informationChapter 6/9: Learning
Chapter 6/9: Learning Learning A relatively durable change in behavior or knowledge that is due to experience. The acquisition of knowledge, skills, and behavior through reinforcement, modeling and natural
More informationSubstance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress.
Drug Addiction Substance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress. Most recognize it as harmful but continue the addictive
More informationAssociative learning
Introduction to Learning Associative learning Event-event learning (Pavlovian/classical conditioning) Behavior-event learning (instrumental/ operant conditioning) Both are well-developed experimentally
More informationChapter 7 - Learning
Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.
More informationReading Neuronal Synchrony with Depressing Synapses
NOTE Communicated by Laurence Abbott Reading Neuronal Synchrony with Depressing Synapses W. Senn Department of Neurobiology, Hebrew University, Jerusalem 4, Israel, Department of Physiology, University
More informationOverview of Brain Structures
First Overview of Brain Structures Psychology 470 Introduction to Chemical Additions Steven E. Meier, Ph.D. All parts are interrelated. You need all parts to function normally. Neurons = Nerve cells Listen
More informationIf you give any person a prescription of something like Valium and have them take it on
As always I am happy to do this presentation, which is my favorite topic in addiction medicine. I am an internist, and I have done healthcare for the homeless in Springfield as well as been the medical
More informationRole of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli
Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli in rats RN Cardinal, JA Parkinson, H Djafari Marbini, AJ Toner, TW Robbins, BJ Everitt Departments of
More informationClassical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts
Learning Classical Conditioning Pavlov study of digestion dogs salivate before getting food learning as signal detection: emphasis on what happens before a given behavior Classical conditioning terms Stimulus:
More informationSupplementary Material for
Supplementary Material for Selective neuronal lapses precede human cognitive lapses following sleep deprivation Supplementary Table 1. Data acquisition details Session Patient Brain regions monitored Time
More informationTaken From The Brain Top to Bottom //
Taken From The Brain Top to Bottom // http://thebrain.mcgill.ca/flash/d/d_03/d_03_cl/d_03_cl_que/d_03_cl_que.html THE EVOLUTIONARY LAYERS OF THE HUMAN BRAIN The first time you observe the anatomy of the
More informationMicrocircuitry coordination of cortical motor information in self-initiation of voluntary movements
Y. Isomura et al. 1 Microcircuitry coordination of cortical motor information in self-initiation of voluntary movements Yoshikazu Isomura, Rie Harukuni, Takashi Takekawa, Hidenori Aizawa & Tomoki Fukai
More informationClusters, Symbols and Cortical Topography
Clusters, Symbols and Cortical Topography Lee Newman Thad Polk Dept. of Psychology Dept. Electrical Engineering & Computer Science University of Michigan 26th Soar Workshop May 26, 2006 Ann Arbor, MI agenda
More informationTheoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück
The Binding Problem This lecture is based on following articles: Adina L. Roskies: The Binding Problem; Neuron 1999 24: 7 Charles M. Gray: The Temporal Correlation Hypothesis of Visual Feature Integration:
More informationRepresentation of negative motivational value in the primate
Representation of negative motivational value in the primate lateral habenula Masayuki Matsumoto & Okihide Hikosaka Supplementary Figure 1 Anticipatory licking and blinking. (a, b) The average normalized
More informationSupplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more
1 Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more strongly when an image was negative than when the same
More informationDikran J. Martin. Psychology 110. Name: Date: Principal Features. "First, the term learning does not apply to (168)
Dikran J. Martin Psychology 110 Name: Date: Lecture Series: Chapter 5 Learning: How We're Changed Pages: 26 by Experience TEXT: Baron, Robert A. (2001). Psychology (Fifth Edition). Boston, MA: Allyn and
More informationDouble dissociation of value computations in orbitofrontal and anterior cingulate neurons
Supplementary Information for: Double dissociation of value computations in orbitofrontal and anterior cingulate neurons Steven W. Kennerley, Timothy E. J. Behrens & Jonathan D. Wallis Content list: Supplementary
More informationPsychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007
Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007 What is involved in learning? Evolution -The changes in behaviour that accumulate across generations are stored in the genes Combined with natural
More informationEmotion I: General concepts, fear and anxiety
C82NAB Neuroscience and Behaviour Emotion I: General concepts, fear and anxiety Tobias Bast, School of Psychology, University of Nottingham 1 Outline Emotion I (first part) Studying brain substrates of
More informationCh. 18. Brain Mechanisms of Emotion. Bear et al., Neuroscience: Exploring the Brain, 3 rd ed., Lippincott Williams & Wilkins, 2006, pp
Ch. 18. Brain Mechanisms of Emotion Bear et al., Neuroscience: Exploring the Brain, 3 rd ed., Lippincott Williams & Wilkins, 2006, pp 564-583. WHAT IS EMOTION? Love, hate, disgust, joy, shame, envy, guilt,
More informationOperant Conditioning B.F. SKINNER
Operant Conditioning B.F. SKINNER Reinforcement in Operant Conditioning Behavior Consequence Patronize Elmo s Diner It s all a matter of consequences. Rewarding Stimulus Presented Tendency to tell jokes
More informationModeling Effects of Drugs on Neuron Communication
Modeling Effects of Drugs on Neuron Communication How do neurons communicate? Your nervous system is made of nerve cells called neurons. Neurons do not touch each other. They are separated by a small gap
More informationChapter 6. Learning: The Behavioral Perspective
Chapter 6 Learning: The Behavioral Perspective 1 Can someone have an asthma attack without any particles in the air to trigger it? Can an addict die of a heroin overdose even if they ve taken the same
More information25 Things To Know. Pre- frontal
25 Things To Know Pre- frontal Frontal lobes Cognition Touch Sound Phineas Gage First indication can survive major brain trauma Lost 1+ frontal lobe Gage Working on a railroad Gage (then 25) Foreman on
More informationBook 3: Lab Procedures Book 3: Ch. 1: The Hypothesis and Overview
Book 3: Lab Procedures Book 3: Ch. 1: The Hypothesis and Overview 13 Introduction This experiment will investigate how cocaine acts on dopamine neurons in the brain. Cocaine is a drug of abuse that increases
More informationClassical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.
Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. behaviorism - the view that psychology (1) should be an objective science
More informationBehavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival? Threats are much better reinforcers? Fear is a prime
More informationName: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning?
Name: Period: Chapter 7: Learning Introduction, How We Learn, & Classical Conditioning (pp. 291-304) 1. Learning: 2. What does it mean that we learn by association? 3. Habituation: 4. Associative Learning:
More informationOrbitofrontal cortical activity during repeated free choice
J Neurophysiol 107: 3246 3255, 2012. First published March 14, 2012; doi:10.1152/jn.00690.2010. Orbitofrontal cortical activity during repeated free choice Michael Campos, Kari Koppitch, Richard A. Andersen,
More informationThe Neuroscience of Addiction: A mini-review
The Neuroscience of Addiction: A mini-review Jim Morrill, MD, PhD MGH Charlestown HealthCare Center Massachusetts General Hospital Disclosures Neither I nor my spouse/partner has a relevant financial relationship
More informationISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien.
ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr An important (but rarely addressed) question: How can animals and humans adapt (survive)
More informationExperimental Psychology PSY 433. Chapter 9 Conditioning and Learning
Experimental Psychology PSY 433 Chapter 9 Conditioning and Learning Midterm Results Score Grade N 29-34 A 9 26-28 B 4 23-25 C 5 20-22 D 2 0-19 F 4 Top score = 34/34 Top score for curve = 33 What is Plagiarism?
More informationPSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)
PSY 402 Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) Classical vs. Instrumental The modern view is that these two types of learning involve similar
More informationProf. Greg Francis 7/31/15
s PSY 200 Greg Francis Lecture 06 How do you recognize your grandmother? Action potential With enough excitatory input, a cell produces an action potential that sends a signal down its axon to other cells
More informationSupplementary Information. Gauge size. midline. arcuate 10 < n < 15 5 < n < 10 1 < n < < n < 15 5 < n < 10 1 < n < 5. principal principal
Supplementary Information set set = Reward = Reward Gauge size Gauge size 3 Numer of correct trials 3 Numer of correct trials Supplementary Fig.. Principle of the Gauge increase. The gauge size (y axis)
More informationLecture overview. What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods )
Lecture overview What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods ) 1 Lecture overview What hypothesis to test in the fly? Quantitative data collection
More informationParts of the Brain. Hindbrain. Controls autonomic functions Breathing, Heartbeat, Blood pressure, Swallowing, Vomiting, etc. Upper part of hindbrain
Parts of the Brain The human brain is made up of three main parts: 1) Hindbrain (or brainstem) Which is made up of: Myelencephalon Metencephalon 2) Midbrain Which is made up of: Mesencephalon 3) Forebrain
More information2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable.
True/False 1. S-R theories of learning in general assume that learning takes place more or less automatically, and do not require and thought by humans or nonhumans. ANS: T REF: P.18 2. Hull s theory of
More informationOutline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture
Outline What is learning? Associative Learning Classical Conditioning Operant Conditioning Observational Learning History of Learning Theory Nature or Nurture BEHAVIORISM Tabula Rasa Learning: Systematic,
More informationDOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION
Chapter 1 : INFORMATION MANAGEMENT & TECHNOLOGY This volume stems from the efforts of scholars who seek to understand the social dynamics of large technical systems. The purpose is to develop concepts
More informationANNA STATE HOSPITAL. peated measurement of the attack. A mechanical
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR VOLUME 8, NUMBER 3 MAY, 1965 THE OPPORTUNITY FOR AGGRESSION AS AN OPERANT REINFORCER DURING AVERSIVE STIMULATION' N. H. AZRIN, R. R. HUTCHINSON, AND R.
More informationEffects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer
Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer RN Cardinal, JA Parkinson *, TW Robbins, A Dickinson, BJ Everitt Departments of Experimental
More informationClassical & Operant Conditioning. Learning: Principles and Applications
Classical & Operant Conditioning Learning: Principles and Applications Which Pen Would You Choose? The researchers placed the participants in the room. In this room the participants first viewed purple
More informationDopamine neurons report an error in the temporal prediction of reward during learning
articles Dopamine neurons report an error in the temporal prediction of reward during learning Jeffrey R. Hollerman 1,2 and Wolfram Schultz 1 1 Institute of Physiology, University of Fribourg, CH-1700
More informationConnect with amygdala (emotional center) Compares expected with actual Compare expected reward/punishment with actual reward/punishment Intuitive
Orbitofronal Notes Frontal lobe prefrontal cortex 1. Dorsolateral Last to myelinate Sleep deprivation 2. Orbitofrontal Like dorsolateral, involved in: Executive functions Working memory Cognitive flexibility
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis
More informationChapter 6: Learning The McGraw-Hill Companies, Inc.
Chapter 6: Learning Learning A relatively permanent change in behavior brought about by experience Distinguishes between changes due to maturation and changes brought about by experience Distinguishes
More informationbiological psychology, p. 40 The study of the nervous system, especially the brain. neuroscience, p. 40
biological psychology, p. 40 The specialized branch of psychology that studies the relationship between behavior and bodily processes and system; also called biopsychology or psychobiology. neuroscience,
More informationTHE AMYGDALA AND REWARD
THE AMYGDALA AND REWARD Mark G. Baxter* and Elisabeth A. Murray The amygdala an almond-shaped group of nuclei at the heart of the telencephalon has been associated with a range of cognitive functions,
More information