Associative learning
|
|
- Marsha Sherman
- 6 years ago
- Views:
Transcription
1 Introduction to Learning Associative learning Event-event learning (Pavlovian/classical conditioning) Behavior-event learning (instrumental/ operant conditioning) Both are well-developed experimentally and theoretically Note confusion in usages as procedures, outcomes, and processes 1
2 Pavlovian conditioning Bell (CS) orient (OR) Food (US) salivate (UR) CS = conditioned stimulus US = unconditioned stimulus OR = orienting response CR = conditioned response UR = unconditioned response salivate (CR) Note limiting nature of defined properties of these events Important consequences of Pavlovian conditioning Behavioral Reflexes vs behavior systems Regulatory systems; anticipatory homeostasis (allostasis) Affective Motivational states and modulation of other behavior Reinforcement power Cognitive Attention Representation 2
3 Learning theory What are the conditions of learning? What are the contents of learning? What is the relation of learning to behavior? Conditions for learning External (environmental) vs internal (organismic) conditions External Time Reinforcement (do you need it; what is it?) Internal Motivation (drive) 3
4 Conditions for learning External (environmental) vs internal (organismic) conditions External Time, information Reinforcement (do you need it; what is it?) Internal Motivation (drive) Attention other hypothetical variables Function and evolutionary history Time Conditions for learning Inter-stimulus interval (ISI) 4
5 Acquisition of Pavlovian associations: interstimulus interval Interstimulus-interval (ISI) function Percent CRs CS-US interval (m sec) Condition for learning or content of learning? 1 Eyeblink 1 Licking Pecking % CRs % CRs Trials to Criterion Seconds Seconds Seconds 5 Rear. Conditioned Suppression Flavor Aversion 1. % CRs Latency (s) Rejection Ratio Seconds Seconds Hours 5
6 Time Important variables Inter-stimulus interval (ISI) Inter-trial interval (ITI) Ratio of ITI/ISI Condition for learning or content of learning? Important variables Time Inter-stimulus interval (ISI) Inter-trial interval (ITI) ITI/ISI Information Contingency/correlation CS US CS US CS US E R I 6
7 Time Important variables Inter-stimulus interval (ISI) Inter-trial interval (ITI) Information Contingency/correlation Excitation and inhibition Blocking Blocking experiment B: Light food light + tone food tone? C: Light / food light + tone food tone? 7
8 Many theories Most common & successful are contiguity theories: Learning-induced variations in processing of USs and CSs Reinforcement theories: USs change effectiveness; unpredicted USs more effective Attention theories: CSs change effectiveness; good (or poor) predictors processed better Learning-induced variations in processing of USs Rescorla-Wagner model: V A = α A β 1 (λ 1 -V ΣA...X ) Reinforcing event is error signal (discrepancy between expected and actual value of US) If US underexpected (error>) learning is excitatory If US overexpected (error < ) learning is inhibitory Thus, excitation & inhibition tied to change/contrast rather than absolute events Symmetry of conditions for, and content of, excitation and inhibition Error signal is aggregate error (all sources) Rate parameters for CS and US (constants) determine how fast things happen, and sometimes how big the differences are but otherwise not typically critical 8
9 Learning-induced variations in processing of USs Rescorla-Wagner model: V A = α A β 1 (λ 1 -V ΣA...X ) Became a standard in behavioral psychology because it did a great job of modeling a large number of odd (counterintuitive) findings as well as obvious ones, with minimum complexity of representation and computation (will demonstrate) later became a standard in neuroscience because it is easy to implement and because midbrain dopamine neurons seemed to show requisite properties to be R-W teaching signals (aggregate prediction error) delivery of unexpected rewards ( positive prediction error ) produces rate increases omission of expected rewards ( negative prediction error ) produces rate decreases as reward becomes expected on the basis of a cue or response, the increases come under control of that cue/response, and fail to occur to reward delivery itself (will say more on this later, too) Learning-induced variations in processing of USs Rescorla-Wagner model: V A = α A β 1 (λ 1 -V ΣA...X ) Apply to blocking Apply to conditioned inhibition procedure (A+, AX-) Apply to overexpectation (A+, B+ ABX+ X?) Apply to contingency (AC+, C-) (AC+, C+) (AC-, C+) Not the last word; many intolerable flaws and wrong predictions Symmetry of excitation and inhibition elusive (e.g., extinction of inhibition and excitation) Aggregate error may not be the whole story; constrained error terms Retrieval effects Evidence for more detailed representation of world ( model-based learning, e.g., Rescorla, 1973) No role for changes in CS processing (attention) 9
10 Learning-induced variations in processing of CSs Passive (limited resource) models (e.g. Suthreland & Mackintosh, 1971) Active models (must learn to distribute resources) Mackintosh: α increases to better predictors, decreases to worse predictors Pearce-Hall model: V A = α A λ 1, where α A ~ λ 1 -V ΣA...X. (Unsigned) reinforcement error signal determines processing of CS (learning rate parameter). Attends more to bad predictors. Pearce-Hall model Contrast learning and action (controlled and automatic) Apply to blocking Apply to cases in opposition to R-W Unblocking: A++ AX+ X? Hall-Pearce negative transfer & rescue A+ A- A++ A+ A++ A- 1
11 Pearce-Hall model Works in principle, but usually a problem with speed of process in simple acquisition to one cue, would be gradual loss of α (OK) if added another cue, as in blocking experiment, such that λ V agg =, change in α would be instantaneous if changed or removed reinforcer, change in α would be instantaneous Added dampening factor, such that α A = ϒ λ V agg + (1-ϒ) α A When combined with R-W term for variations in reinforcer effectiveness, accounts for nearly everything Any evidence for an unsigned Pearce-Hall-like error signal? establish learning with one reinforcer and then shift to a bigger or smaller one normalized firing rate Central Nucleus of Amygdala Down shift Up shift.6 block switch first ten trial last ten trials normalized firing rate Basolateral Amygdala Down shift Up shift block switch first ten trial last ten trials normalized firing rate Dopamine (VTA) 1 Down shift Up shift.8 block switch first ten trial last ten trials 1.9 normalized signal strength (undamped version) Selective Downshift Signal Down shift Up shift block switch first ten trial last ten trials normalized signal strength 1 Down shift Up shift (damped version) Attention Signal block switch first ten trial last ten trials normalized signal strength (Recorla-Wagner signed error) Error Signal 1 Down shift Up shift block switch first ten trial last ten trials 11
12 More complex theories Contingency theories: Learn individual event relations and compute contingencies Learning based (frequentist & Bayesian) Performance-based (Comparator theory) Learn everything and compute whatever needed Non-arbitrary nature of events Identity of associates matter Engage different neural and behavioral systems for learning Both CS and US individually, and their combination Garcia example 12
13 Acquisition of Pavlovian associations: cue to consequence Garcia Experiment Bright+Noisy+Tasty -- illness -or- Bright+Noisy+Tasty -- pain % CR 3 2 tasty bright+noisy 1 illness pain US Content of learning: Pavlovian conditioning as knowledge acquisition Stimulus-stimulus (S-S) vs stimulus-response (S-R) associations Learning how vs. learning what (procedural vs declarative) Model-free vs model-based learning Light means slobber vs Light means food Devaluation experiment ( behavioral syllogism ): Light food men are mortal Food illness Peter is a man Light? Peter is mortal 13
14 Mediated Performance (devaluation) 4 % time in food cup T1 T Sessions Trials T1 --> flavor1 T2 --> flavor2 flavor2 --> LiCl T1? T2? Holland, 1975;199 Mediated learning Median fluid consumption (ml) Dev Non Pretest Test Light Food1 Food1? Light LiCl (Dev) Food1? Tone Food2 Food2? Tone nothing (Non) Food2? Holland,
15 Sensory processing of absent events Mediated Performance (devaluation) 4 % time in food cup T1 T Sessions Trials T1 --> flavor1 T2 --> flavor2 flavor2 --> LiCl T1? T2? continue testing T1 and T2, with unflavored sucrose in cup Sensory processing of absent events Mediated Performance (devaluation) 4 % time in food cup T1 T Sessions Trials T1 --> flavor1 T2 --> flavor2 flavor2 --> LiCl T1? T2? T1 continue testing T1 and T2, with unflavored sucrose in cup 15
16 Sensory processing of absent events Mediated Performance (devaluation) 4 % time in food cup T1 T Sessions Trials T1 --> flavor1 T2 --> flavor2 flavor2 --> LiCl T1? T2? T2 continue testing T1 and T2, with unflavored sucrose in cup Sensory processing of absent events Mediated Performance (devaluation) % time in food cup T1 T2 Frequency Suc Suc + T1 Suc + T Sessions Trials Injestive Aversive Evaluative Response T1 --> flavor1 T2 --> flavor2 flavor2 --> LiCl T1? T2? 16
17 Group Maintain Tone sucrose sucrose//licl tone? Group Devalue Tone sucrose sucrose LiCl tone? Group CTL Tone//sucrose sucrose LiCl, or tone? sucrose//licl Group Maintain Tone sucrose sucrose//licl tone? Group Devalue Tone sucrose sucrose LiCl tone? Group CTL Tone//sucrose sucrose LiCl, or tone? sucrose//licl Response to tone+water Frequency/1s Maintain Devalue CTL Appetitive Aversive Response Kerfoot, Agarwal, Lee, & Holland, 24 17
18 FOS expression in nucleus accumbens Accumbens Shell Maintain Devalue CTL Counts Anterior Posterior Kerfoot, Agarwal, Lee, & Holland, 25 FOS expression in gustatory cortex GC Counts Maintain Devalue CTL Group Maintain Devalue CTL Kerfoot, Agarwal, Lee, & Holland, 25 18
The Rescorla Wagner Learning Model (and one of its descendants) Computational Models of Neural Systems Lecture 5.1
The Rescorla Wagner Learning Model (and one of its descendants) Lecture 5.1 David S. Touretzky Based on notes by Lisa M. Saksida November, 2015 Outline Classical and instrumental conditioning The Rescorla
More informationClassical Conditioning V:
Classical Conditioning V: Opposites and Opponents PSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives where were we? Classical conditioning = prediction
More informationISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien.
ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr An important (but rarely addressed) question: How can animals and humans adapt (survive)
More informationWhat is Learned? Lecture 9
What is Learned? Lecture 9 1 Classical and Instrumental Conditioning Compared Classical Reinforcement Not Contingent on Behavior Behavior Elicited by US Involuntary Response (Reflex) Few Conditionable
More informationAmount of training effects in representationmediated food aversion learning: No evidence of a role for associability changes
Journal Learning & Behavior 2005,?? 33 (?), (4),???-??? 464-478 Amount of training effects in representationmediated food aversion learning: No evidence of a role for associability changes PETER C. HOLLAND
More informationAfter Rescorla-Wagner
After Rescorla-Wagner W. Jeffrey Wilson March 6, 2013 RW Problems STM-LTM & Learning SOP Model Configural vs Elemental Nodes Problems with Rescorla-Wagner Model Extinction: No Spontaneous Recovery or Rapid
More informationEffects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer
Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer RN Cardinal, JA Parkinson *, TW Robbins, A Dickinson, BJ Everitt Departments of Experimental
More informationNSCI 324 Systems Neuroscience
NSCI 324 Systems Neuroscience Dopamine and Learning Michael Dorris Associate Professor of Physiology & Neuroscience Studies dorrism@biomed.queensu.ca http://brain.phgy.queensu.ca/dorrislab/ NSCI 324 Systems
More informationMetadata of the chapter that will be visualized online
Metadata of the chapter that will be visualized online Chapter Title Attention and Pavlovian Conditioning Copyright Year 2011 Copyright Holder Springer Science+Business Media, LLC Corresponding Author
More informationContext and Pavlovian conditioning
Context Brazilian conditioning Journal of Medical and Biological Research (1996) 29: 149-173 ISSN 0100-879X 149 Context and Pavlovian conditioning Departamento de Psicologia, Pontifícia Universidade Católica
More informationClassical Conditioning
What is classical conditioning? Classical Conditioning Learning & Memory Arlo Clark-Foos Learning to associate previously neutral stimuli with the subsequent events. Howard Eichenbaum s Thanksgiving Pavlov
More informationThe Contribution of the Amygdala to Reward-Related Learning and Extinction
Chapter 14 The Contribution of the Amygdala to Reward-Related Learning and Extinction Rose Chesworth and Laura Corbit Additional information is available at the end of the chapter Abstract There has been
More informationRescorla-Wagner (1972) Theory of Classical Conditioning
Rescorla-Wagner (1972) Theory of Classical Conditioning HISTORY Ever since Pavlov, it was assumed that any CS followed contiguously by any US would result in conditioning. Not true: Contingency Not true:
More information1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.
1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified
More informationBehavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival Threats are much better reinforcers Fear is a prime
More informationLearning. Learning. Habituation. Sensitization. Habituation and Sensitization
Learning Learning Adaptive change in behavior that results from past experiences Nonassociative Learning Habituation Sensitization Classical Conditioning Instrumental Learning/Operant Conditioning Ability
More informationChapter 5: How Do We Learn?
Chapter 5: How Do We Learn? Defining Learning A relatively permanent change in behavior or the potential for behavior that results from experience Results from many life experiences, not just structured
More informationChapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted
Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play
More informationacquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events
acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationBehavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival? Threats are much better reinforcers? Fear is a prime
More informationExcitation and Inhibition in Unblocking
Journal of Experimental Psychology: Animal Behavior Processes 1988, Vol. 14, No. 3, 261-279 Copyright 1988 by the American Psychological Association, Inc. 0097-7403/88/S00.75 Excitation and Inhibition
More informationPSY 402. Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)
PSY 402 Theories of Learning Chapter 4 Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning) Classical vs. Instrumental The modern view is that these two types of learning involve similar
More informationStudy Plan: Session 1
Study Plan: Session 1 6. Practice learning the vocabulary. Use the electronic flashcards from the Classical The Development of Classical : The Basic Principles of Classical Conditioned Emotional Reponses:
More informationPredicting danger: The nature, consequences, and neural mechanisms of predictive fear learning
Review Predicting danger: The nature, consequences, and neural mechanisms of predictive fear learning Gavan P. McNally 1 and R. Frederick Westbrook School of Psychology, The University of New South Wales,
More informationExploring the Brain Mechanisms Involved in Reward Prediction Errors Using Conditioned Inhibition
University of Colorado, Boulder CU Scholar Psychology and Neuroscience Graduate Theses & Dissertations Psychology and Neuroscience Spring 1-1-2013 Exploring the Brain Mechanisms Involved in Reward Prediction
More informationProvided for non-commercial research and educational use. Not for reproduction, distribution or commercial use.
Provided for non-commercial research and educational use. Not for reproduction, distribution or commercial use. This article was originally published in the Learning and Memory: A Comprehensive Reference,
More informationCOMPUTATIONAL MODELS OF CLASSICAL CONDITIONING: A COMPARATIVE STUDY
COMPUTATIONAL MODELS OF CLASSICAL CONDITIONING: A COMPARATIVE STUDY Christian Balkenius Jan Morén christian.balkenius@fil.lu.se jan.moren@fil.lu.se Lund University Cognitive Science Kungshuset, Lundagård
More informationA response rule for positive and negative stimulus interaction in associative learning and performance
Psychonomic Bulletin & Review 2007, 14 (6, 1115-1124 A response rule for positive and negative stimulus interaction in associative learning and performance Oskar Pineño Hofstra University, Hempstead, New
More informationacquisition associative learning behaviorism B. F. Skinner biofeedback
acquisition associative learning in classical conditioning the initial stage when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
More informationIvan Petrovich Pavlov ( )
Ivan Petrovich Pavlov (1849-1936) Chapter 7 1 Ivan Petrovich Pavlov 1. Born in Ryazan, Russia on Sep 14, 1849. 2. Studied the digestive system and won the Nobel Prize in 1904 for physiology and medicine.
More informationLearned changes in the sensitivity of stimulus representations: Associative and nonassociative mechanisms
Q0667 QJEP(B) si-b03/read as keyed THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2003, 56B (1), 43 55 Learned changes in the sensitivity of stimulus representations: Associative and nonassociative
More informationUnit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.
Unit 06 - Overview How We Learn and Classical Conditioning Operant Conditioning Operant Conditioning s Applications, and Comparison to Classical Conditioning Biology, Cognition, and Learning Learning By
More informationPSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives
Too much dopamine can be bad for you: 1I. Latent inhibition and schizophrenia PSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives thanks to Ina Weiner
More informationLearning = an enduring change in behavior, resulting from experience.
Chapter 6: Learning Learning = an enduring change in behavior, resulting from experience. Conditioning = a process in which environmental stimuli and behavioral processes become connected Two types of
More informationRole of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli
Role of the anterior cingulate cortex in the control over behaviour by Pavlovian conditioned stimuli in rats RN Cardinal, JA Parkinson, H Djafari Marbini, AJ Toner, TW Robbins, BJ Everitt Departments of
More informationChapter 6. Learning: The Behavioral Perspective
Chapter 6 Learning: The Behavioral Perspective 1 Can someone have an asthma attack without any particles in the air to trigger it? Can an addict die of a heroin overdose even if they ve taken the same
More informationOccasion Setters: Specificity to the US and the CS US Association
Learning and Motivation 32, 349 366 (2001) doi:10.1006/lmot.2001.1089, available online at http://www.idealibrary.com on Occasion Setters: Specificity to the US and the CS US Association Charlotte Bonardi
More informationPROBABILITY OF SHOCK IN THE PRESENCE AND ABSENCE OF CS IN FEAR CONDITIONING 1
Journal of Comparative and Physiological Psychology 1968, Vol. 66, No. I, 1-5 PROBABILITY OF SHOCK IN THE PRESENCE AND ABSENCE OF CS IN FEAR CONDITIONING 1 ROBERT A. RESCORLA Yale University 2 experiments
More informationPSYC2010: Brain and Behaviour
PSYC2010: Brain and Behaviour PSYC2010 Notes Textbook used Week 1-3: Bouton, M.E. (2016). Learning and Behavior: A Contemporary Synthesis. 2nd Ed. Sinauer Week 4-6: Rieger, E. (Ed.) (2014) Abnormal Psychology:
More informationRelations Between Pavlovian-Instrumental Transfer and Reinforcer Devaluation
Journal of Experimental Psychology: Animal Behavior Processes 2004, Vol. 30, No. 2, 104 117 Copyright 2004 by the American Psychological Association 0097-7403/04/$12.00 DOI: 10.1037/0097-7403.30.2.104
More informationInstrumental Conditioning VI: There is more than one kind of learning
Instrumental Conditioning VI: There is more than one kind of learning PSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives outline what goes into instrumental
More informationEffects of limbic corticostriatal lesions on a u t o shaping performance in rats
Effects of limbic corticostriatal lesions on a u t o shaping performance in rats BJ Everitt, JA Parkinson, G Lachenal, KM Halkerston, N Rudarakanchana, RN Cardinal, J Hall, CH Morrison, JW Dalley, SR Howes,
More informationFunctional Relationships Between Arbitrary Stimuli and Fixed Responses: Reflex Conditioning
Chapter 9 1 CHAPTER 9 Functional Relationships Between Arbitrary Stimuli and Fied Responses: Refle Conditioning I. Introduction II. Prototypical Procedure Resulting in a Functional Relationship Between
More informationValue Transfer in a Simultaneous Discrimination Appears to Result From Within-Event Pavlovian Conditioning
Journal of Experimental Psychology: Animal Behavior Processes 1996, Vol. 22. No. 1, 68-75 Copyright 1996 by the American Psychological Association. Inc. 0097-7403/96/53.00 Value Transfer in a Simultaneous
More informationALG Christmas Workshop 2012
ALG Christmas Workshop 2012 http://www.psych.usyd.edu.au/alg/xmas_workshop_2012.html When: Friday 7th December 2012. Where: New Law Seminar 100, Eastern Avenue,. (To get to Seminar Room 100, enter the
More informationClassical & Operant Conditioning. Learning: Principles and Applications
Classical & Operant Conditioning Learning: Principles and Applications Which Pen Would You Choose? The researchers placed the participants in the room. In this room the participants first viewed purple
More informationChapter 1: Behaviorism and the beginning of cognitive science
Chapter 1: Behaviorism and the beginning of cognitive science Steps towards cognitive science The cognitive turn in psychology (away from behaviorism) Developments in the theory of computation and theory
More informationLearning. Learning: Problems. Chapter 6: Learning
Chapter 6: Learning 1 Learning 1. In perception we studied that we are responsive to stimuli in the external world. Although some of these stimulus-response associations are innate many are learnt. 2.
More informationThe effects of Pavlovian CSs on two food-reinforced baselineswith and without noncontingent shock
Animal Learning & Behavior 1976, Vol. 4 (3), 293-298 The effects of Pavlovian CSs on two food-reinforced baselineswith and without noncontingent shock THOMAS s. HYDE Case Western Reserve University, Cleveland,
More informationChapter 5 Study Guide
Chapter 5 Study Guide Practice Exam Questions: Which of the following is not included in the definition of learning? It is demonstrated immediately Assuming you have eaten sour pickles before, imagine
More informationUnit 6 Learning.
Unit 6 Learning https://www.apstudynotes.org/psychology/outlines/chapter-6-learning/ 1. Overview 1. Learning 1. A long lasting change in behavior resulting from experience 2. Classical Conditioning 1.
More informationContemporary associative learning theory predicts failures to obtain blocking. Comment on Maes et al. (2016)
Contemporary associative learning theory predicts failures to obtain blocking. Comment on Maes et al. (2016) Fabian A. Soto Department of Psychology, Florida International University In a recent article,
More informationTHEORIES OF ASSOCIATIVE LEARNING
Annu. Rev. Psychol. 2001. 52:111 39 Copyright c 2001 by Annual Reviews. All rights reserved THEORIES OF ASSOCIATIVE LEARNING IN ANIMALS John M. Pearce School of Psychology, Cardiff University, Cardiff
More informationCue competition as a retrieval deficit
Denniston, J. C., Savastano, H. I., Blaisdell, A. P., & Miller, R. R. (2003). Cue competition as a retrieval deficit. Learning and Motivation, 34(1): 1-31. (Feb 2003) Published by Elsevier (ISSN: 1095-9122).
More informationbrain valuation & behavior
brain valuation & behavior 9 Rangel, A, et al. (2008) Nature Neuroscience Reviews Vol 9 Stages in decision making process Problem is represented in the brain Brain evaluates the options Action is selected
More informationContext specificity of sensory preconditioning: Implications for processes of within-event learning
Animal Learning & Behavior 1998, 26 (2), 225-232 Context specificity of sensory preconditioning: Implications for processes of within-event learning JASPER WARD-ROBINSON, MICHELLE SYMONDS, and GEOFFREY
More information2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable.
True/False 1. S-R theories of learning in general assume that learning takes place more or less automatically, and do not require and thought by humans or nonhumans. ANS: T REF: P.18 2. Hull s theory of
More informationEffect of extended training on generalization of latent inhibition: An instance of perceptual learning
Learn Behav (2011) 39:79 86 DOI 10.3758/s13420-011-0022-x Effect of extended training on generalization of latent inhibition: An instance of perceptual learning Gabriel Rodríguez & Gumersinda Alonso Published
More informationThe Mechanics of Associative Change
The Mechanics of Associative Change M.E. Le Pelley (mel22@hermes.cam.ac.uk) I.P.L. McLaren (iplm2@cus.cam.ac.uk) Department of Experimental Psychology; Downing Site Cambridge CB2 3EB, England Abstract
More informationSupplementary Figure 1. Recording sites.
Supplementary Figure 1 Recording sites. (a, b) Schematic of recording locations for mice used in the variable-reward task (a, n = 5) and the variable-expectation task (b, n = 5). RN, red nucleus. SNc,
More informationComputational Versus Associative Models of Simple Conditioning i
Gallistel & Gibbon Page 1 In press Current Directions in Psychological Science Computational Versus Associative Models of Simple Conditioning i C. R. Gallistel University of California, Los Angeles John
More informationChapter 7 - Learning
Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.
More informationRodent Behavioral Learning and Memory Models. From Mechanisms of Memory, 2 nd Edition by J. David Sweatt, Ph.D.
Rodent Behavioral Learning and Memory Models From Mechanisms of Memory, 2 nd Edition by J. David Sweatt, Ph.D. Hippocampal Pyramidal Neuron of Mice and Rats Figure 1 Open Field Apparatus Open Field Behavior
More informationAssociative Learning
Learning Learning Associative Learning Classical Conditioning Operant Conditioning Observational Learning Biological Components of Learning Cognitive Components of Learning Behavioral Therapies Associative
More informationUsing Taste Aversion as a Tool to Explore Context Conditioning and Perceptual Learning. Geoffrey Hall Department of Psychology University of York
Hall 1 Using Taste Aversion as a Tool to Explore Context Conditioning and Perceptual Learning Geoffrey Hall Department of Psychology University of York I want to write about two things here, and neither,
More informationLearning. Learning. Stimulus Learning. Modification of behavior or understanding Is it nature or nurture?
Learning Chapter 6 Learning Modification of behavior or understanding Is it nature or nurture? Stimulus Learning Habituation: when you pay less attention to something over time response starts out strong
More informationOvershadowing by fixed and variable duration stimuli. Centre for Computational and Animal Learning Research
Overshadowing by fixed and variable duration stimuli Charlotte Bonardi 1, Esther Mondragón 2, Ben Brilot 3 & Dómhnall J. Jennings 3 1 School of Psychology, University of Nottingham 2 Centre for Computational
More informationUncertainty and the Bayesian Brain
Uncertainty and the Bayesian Brain sources: sensory/processing noise ignorance change consequences: inference learning coding: distributional/probabilistic population codes neuromodulators Multisensory
More information3/7/2010. Theoretical Perspectives
Theoretical Perspectives REBT (1955) Albert Ellis Action & Result Oriented Teaches how to identify self-defeating thoughts Replaces thoughts w/ life enhancing ones 1 A B C s of personality formation: A
More informationLearning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction
1 2 3 4 5 Myers Psychology for AP* Unit 6: Learning Unit Overview How Do We Learn? Classical Conditioning Operant Conditioning Learning by Observation How Do We Learn? Introduction Learning Habituation
More informationNeurobiological Foundations of Reward and Risk
Neurobiological Foundations of Reward and Risk... and corresponding risk prediction errors Peter Bossaerts 1 Contents 1. Reward Encoding And The Dopaminergic System 2. Reward Prediction Errors And TD (Temporal
More informationClassical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.
Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. behaviorism - the view that psychology (1) should be an objective science
More informationPsychology, Ch. 6. Learning Part 1
Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening
More informationLesions of the Basolateral Amygdala Disrupt Selective Aspects of Reinforcer Representation in Rats
The Journal of Neuroscience, November 15, 2001, 21(22):9018 9026 Lesions of the Basolateral Amygdala Disrupt Selective Aspects of Reinforcer Representation in Rats Pam Blundell, 1 Geoffrey Hall, 1 and
More informationPsychological Hodgepodge. Mr. Mattingly Psychology
Psychological Hodgepodge Mr. Mattingly Psychology The Number: Eight What is conditioning? Conditioning = learned or trained Classical Conditioning = learning procedure where associations are made Usually
More informationOvershadowing by fixed- and variable-duration stimuli
THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2015 Vol. 68, No. 3, 523 542, http://dx.doi.org/10.1080/17470218.2014.960875 Overshadowing by fixed- and variable-duration stimuli Charlotte Bonardi 1,
More informationPredictive Accuracy and the Effects of Partial Reinforcement on Serial Autoshaping
Journal of Experimental Psychology: Copyright 1985 by the American Psychological Association, Inc. Animal Behavior Processes 0097-7403/85/$00.75 1985, VOl. 11, No. 4, 548-564 Predictive Accuracy and the
More informationOccasion Setting without Feature-Positive Discrimination Training
LEARNING AND MOTIVATION 23, 343-367 (1992) Occasion Setting without Feature-Positive Discrimination Training CHARLOTTE BONARDI University of York, York, United Kingdom In four experiments rats received
More informationOutline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture
Outline What is learning? Associative Learning Classical Conditioning Operant Conditioning Observational Learning History of Learning Theory Nature or Nurture BEHAVIORISM Tabula Rasa Learning: Systematic,
More informationSTUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning
STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? 1. learning 2. associate; associations; associative learning; habituates 3. classical 4. operant 5. observing Classical Conditioning 1.
More informationI. Classical Conditioning
Learning Chapter 8 Learning A relatively permanent change in an organism that occur because of prior experience Psychologists must study overt behavior or physical changes to study learning Learning I.
More informationStill at the Choice-Point
Still at the Choice-Point Action Selection and Initiation in Instrumental Conditioning BERNARD W. BALLEINE AND SEAN B. OSTLUND Department of Psychology and the Brain Research Institute, University of California,
More informationLearning. AP PSYCHOLOGY Unit 4
Learning AP PSYCHOLOGY Unit 4 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction
More informationReinforcement Learning. With help from
Reinforcement Learning With help from A Taxonomoy of Learning L. of representations, models, behaviors, facts, Unsupervised L. Self-supervised L. Reinforcement L. Imitation L. Instruction-based L. Supervised
More informationContemporary Study of Pavlovian Conditioning
The Spanish Journal of Psychology Copyright 2003 by The Spanish Journal of Psychology 2003, Vol. 6, No. 2, 185-195 1138-7416 Contemporary Study of Pavlovian Conditioning Robert A. Rescorla University of
More informationSupplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more
1 Supplementary Figure 1. Example of an amygdala neuron whose activity reflects value during the visual stimulus interval. This cell responded more strongly when an image was negative than when the same
More informationParallel incentive processing: an integrated view of amygdala function
ARTICLE IN PRESS Parallel incentive processing: an integrated view of amygdala function Bernard W. Balleine 1 and Simon Killcross 2 1 Department of Psychology and the Brain Research Institute, University
More informationPsychology in Your Life
Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life SECOND EDITION Chapter 6 Learning 2016 W. W. Norton & Company, Inc. 1 Humans are learning machines! Learning: A change in behavior,
More informationLearning. Learning is a relatively permanent change in behavior acquired through experience or practice.
Learning Learning is a relatively permanent change in behavior acquired through experience or practice. What is Learning? Learning is the process that allows us to adapt (be flexible) to the changing conditions
More informationAP PSYCH Unit 6.1 Learning & Classical Conditioning. Before ever opening this book, what did you think learning meant?
AP PSYCH Unit 6.1 Learning & Classical Conditioning Before ever opening this book, what did you think learning meant? Learning We are not born with a genetic plan that gets us through our entire life Much
More informationRepresentations of single and compound stimuli in negative and positive patterning
Learning & Behavior 2009, 37 (3), 230-245 doi:10.3758/lb.37.3.230 Representations of single and compound stimuli in negative and positive patterning JUSTIN A. HARRIS, SABA A GHARA EI, AND CLINTON A. MOORE
More informationBlocking by fixed and variable stimuli: Effects of stimulus distribution on blocking.
Stimulus distribution effects on blocking 1 Blocking by fixed and variable stimuli: Effects of stimulus distribution on blocking. Dómhnall J. Jennings 1 & Charlotte Bonardi 2 1 Institute of Neuroscience,
More informationan ability that has been acquired by training (process) acquisition aversive conditioning behavior modification biological preparedness
acquisition an ability that has been acquired by training (process) aversive conditioning A type of counterconditioning that associates an unpleasant state (such as nausea) with an unwanted behavior (such
More informationReinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain
Reinforcement learning and the brain: the problems we face all day Reinforcement Learning in the brain Reading: Y Niv, Reinforcement learning in the brain, 2009. Decision making at all levels Reinforcement
More informationSystems Neuroscience November 29, Memory
Systems Neuroscience November 29, 2016 Memory Gabriela Michel http: www.ini.unizh.ch/~kiper/system_neurosci.html Forms of memory Different types of learning & memory rely on different brain structures
More informationMyers PSYCHOLOGY. (7th Ed) Chapter 8. Learning. James A. McCubbin, PhD Clemson University. Worth Publishers
Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association
More informationStimulus competition in the absence of compound conditioning
Animal Learning & Behavior 1998, 26 (1), 3-14 Stimulus competition in the absence of compound conditioning HELENA MATUTE and OSKAR PINEÑO Universidad de Deusto, Bilbao, Spain Most associative theories
More informationOvershadowing not potentiation of illness-based contextual conditioning by a novel taste
Animal Learning & Behavior 1999, 27 (4), 379-390 Overshadowing not potentiation of illness-based contextual conditioning by a novel taste MICHELLE SYMONDS and GEOFFREY HALL University of York, York, England
More informationSecond-order conditioning during a compound extinction treatment
Learning and Motivation 38 (2007) 172 192 www.elsevier.com/locate/l&m Second-order conditioning during a compound extinction treatment Oskar Pineño a, *, Jessica M. Zilski a, Todd R. Schachtman b a Dpto.
More informationCue competition as a retrieval deficit q
Learning and Motivation 34 (2003) 1 31 www.elsevier.com/locate/l&m Cue competition as a retrieval deficit q James C. Denniston, a, * Hernan I. Savastano, b Aaron P. Blaisdell, c and Ralph R. Miller d a
More information