Instrumental or Operant. Operant Conditioning. History of Instrumental Cond. Classical vs. Instrumental 10/10/2017. Law of Effect
|
|
|
- Lynette Eaton
- 6 years ago
- Views:
Transcription
1 Instrumental or Operant Law of Effect Operant Conditioning Learning & Memory Arlo Clark-Foos operates on environment to cause an outcome behavior is instrumental in causing outcome Priscilla the Fastidious Pig Thorndike & Skinner Classical vs. Instrumental History of Instrumental Cond. Differences Classical Reflexive, automatic behavior Reinforcement follows CS, regardless of response Instrumental Voluntary behavior Reinforcement only follows the response Similarities Negative acceleration, blocking, conditioned inhibition, spontaneous recovery, generalization and discrimination Edward Thorndike s (1898) puzzle boxes Initially random acts Decrease in time to escape Law of Effect (S-R Association) Annoying vs. Satisfying events Believed reinforcer is not part of association! S D R 1
2 Superstitious Behavior Belongingness Breland & Breland (1961) What makes Sammy dance? B.F. Skinner (1938) showed that nearly any behavior a pigeon performs during reinforcement will increase in frequency. Shettleworth (1975) Reinforcing with food only reinforces feeding Behaviors Learned Helplessness Losing Streaks Seligman & Maier (1967) Rats and yoked shocks Detroit Lions, 2008 Detroit Lions, 2015? Later extended to college students and anagrams Also extended to depression 2
3 Willard Small 1901: Introduced mazes to animal research Studying/Observing Instrumental Learning METHODOLOGY Hampton Court, London Mazes in Research Mazes in Research T-Maze Alternation learning Better at win-shift than win-stay Radial Arm Maze Random without repetition Memory Load: 16+ 3
4 Mazes in Research Morris Water Maze Cued (Response) Learning Rats can see the platform: S-R Association Place Learning Platform is below surface: Explicit, cognitive memory Conditioning Takes Time Skinner s Free Operant Protocol (vs. Discrete Trials) Skinner box (automatizing data collection) Cumulative recorder (akin to Odometer) Secondary Reinforcer What is Learned? Discriminative Stimuli (S D ) S D (light on) R (press lever) O (get food) S D (light off) R (press lever) O (no food) Habit Slips (Slips of Action; Reason, 1975) Responses (R) Lashley s rats swimming mazes (different motor responses) Outcomes (O) Reinforcers and Punishments Shaping Behavior Shaping Requires skilled trainer Physical rehabilitation and language in autism Bomb/drug detecting dogs Chaining Backward chaining Twiggy m/watch?v=dvfxf8o-lhw 4
5 Human Skills and Habits Walking feedback from vision/muscles? 1. Lashley (1951): RTs > 100ms Pianists: 16+ movements per second 2. Damage to sensory feedback 3. Sequencing errors 4. Time to initiate depends on length Human Skills and Habits Motor Programs Initiated complete General outline, malleable (Schmidt, 1988) Skill Acquisition (Anderson, 1982) 1. Cognitive Stage 2. Associative Stage 3. Autonomous Stage Reinforcers Primary Food, water, sleep, sex, shelter (temp control) Secondary Predict arrival of primary Token Economies (Conestogas) Drive Reduction Theory (Hull, 1943) Primary not always reinforcing Negative contrast Nipple sucking for sugar water Lame treats on Halloween Punishers Determinants of effectiveness 1. Punishment variable behavior Hot stove 2. SD can encourage cheating Speeding or my dog and Krispy Kreme 3. Concurrent reinforcement Class clowns 4. Intensity matters Child rearing or criminal justice 5
6 Differential Reinforcement of Alternative Behaviors (DRA) Cinemark (2011) Building S D R O Timing Immediate is best Criminal Justice, Punishment Self Control Immediate vs. Delayed Reward Diets, Studying, etc. Precommitment (SI) Positive vs Negative Reinforcement Positive vs Negative Punishment 6
7 Continuous vs. Partial Reinforcement Schedules Fixed-ratio (FR) Postreinforcement pause Variable-ratio (VR) Slot machine (keep playing) Fixed-interval (FI) TBPM Variable-interval (VI) Waiting is the hardest part Choosing Between Behaviors Concurrent reinforcement schedules Football on Saturdays Matching Law Behavioral Economics (Thaler wins Nobel Prize, 2017) Bliss point and Sunfish (observation of behavior) Why do I watch football? Behaviors with no primary reinforcers Premack Principle (1959) Rats with water/wheel, Children with candy/pinball For me: Grading/Cleaning Response Deprivation Hypothesis Illegal Drugs? BRAIN SUBSTRATES 7
8 Basal ganglia S D R Prefrontal Cortex R O Dorsal Striatum (caudate nucleus, putamen) Receives highly processed sensory info Projects to M1 Lesioned rats fail to learn behaviors in response to stimuli SD (light) R (lever press) O (food) Orbitofrontal cortex (OPFC) Receives sensory input (senses and visceral) Projects to dorsal striatum Grape juice neurons (Tremblay & Schultz, 1999) Habitual and Automatic Behaviors Bike riding, playing instruments, running past food in a maze I want you to want me by Cheap Trick James Olds (1954) Electrical current in lateral hypothalamus 700 times an hour, physical exhaustion, starvation Ventral Tegmental Area (VMA) Pleasure center? Excitement/anticipation? Wanting in the VTA/SNc VTA SNc Dopaminergic System Incentive Salience Hypothesis Working for pleasure (want/drive) What if there is no drive (no dopamine)? Addiction, cues, and precommitment Motivational value Projects to SNc 8
9 Endogenous Opioids Exogenous Opiates: Opium, Morphine, Heroin May mediate Hedonic value Increases liking of other stimuli Decreases perception of pain Endogenous released in response to primary reinforcers Which and how many activated may determine preference Nipple Suckers Play Halo or Watch Cartoons Punishment Signaling Somatosensory Cortex (S1) Nociceptors Social Rejection Insular Cortex (Insula) Dorsal posterior insula Degree of activation correlates with magnitude of punisher Dorsal Anterior Cingulate Cortex Motivational value of punishment Drug Addiction Pathological Known harmful consequences Concurrent reinforcement Yay drugs & Boo withdrawals Dopaminergic System Stroke damage to insula can wipe out addiction Might as well face it, you re addicted to love Behavioral Addiction Gambling, VR Schedules (Skinner), and Gambler s Fallacy Parkinson s patients and dopamine agonists Cognitive and Behavioral Therapies based on Conditioning 9
10 Not All Conditioning is Equal Partial Reinforcement Effect Partial Reinforcement Extinction Effect (PREE) Frustration (Amsel) vs. Sequential (Capaldi) Theories Fixed vs. Variable & Ratio vs. Interval Child rearing, pet training, gambling, supersition What explains the PREE? Frustration Theory (Amsel) CRF R+ Extinction R- Frustration Punishes Response CRF: R+ R+ R+ R+ R+ R+ Develop (R-O) expectancy PRF: R+ R+ R- R+ R- R- Develop (R-O) and (R-no O) expectancy Evidence for Frustration: Behavior of pigeons Children tantrums S (frustration) R O What explains the PREE? Sequential Theory (Capaldi) Outcome of previous trial serves as a cue for subsequent behavior PRF: R+ R+ R- R+ R- R- Fm Fm NFm Fm NFm NFm Response Chaining Backward Chaining Breaks in the chain Animal intelligence Complex Behavior NFm R (S-R) strengthened by next R+ What happens with long ITI?...Decay Frustration? Memory? Stronger PREE with long ITI 10
11 Striatum and Skill/Habit Broca vs. Wernicke Double Dissociation Caudate, putamen, nucleus accumbens Organizes somatosensory representations and motor responses for planning and executing goal-oriented behavior. Packard et al. (1989) Radial Arm Maze (8 arms) Win-Stay vs. Win-Shift Response vs. Place Learning 11
12 Habit Learning in Humans Parkinson s Disease Impaired dopaminergic system in striatum Huntington s Disease Loss of some striatal function Weather Prediction Game Knowlton et al. (1996) (Gabrieli, 1995) Weather Prediction Game Knowlton et al. (1996) Weather Prediction Game Poldrack et al. (1999) 12
13 Neurophysiological Data Mink (1996) Neurons in striatum fire in anticipation of movement Schultz (2006) DA Neurons from brain stem into striatum Fire with expectation and reception of rewards Blocking and expectation Addiction and Drug Use Dopamine and Reward Loose Ends Stress and Memory Anxiogenics Response Strategy (Packard & Wingard, 2004) Peripheral or Intra-Basolateral Amygdala (Hippocampus) Yohimibine, RS , Vehicle (Placebo) Autopilot 13
Associative Learning
Learning Learning Associative Learning Classical Conditioning Operant Conditioning Observational Learning Biological Components of Learning Cognitive Components of Learning Behavioral Therapies Associative
Behavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival Threats are much better reinforcers Fear is a prime
Psychology in Your Life
Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life FIRST EDITION Chapter 6 Learning 2014 W. W. Norton & Company, Inc. Section 6.1 How Do the Parts of Our Brains Function? 6.1 What Are
Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted
Chapter 5: Learning and Behavior A. Learning-long lasting changes in the environmental guidance of behavior as a result of experience B. Learning emphasizes the fact that individual environments also play
Unit 6 Learning.
Unit 6 Learning https://www.apstudynotes.org/psychology/outlines/chapter-6-learning/ 1. Overview 1. Learning 1. A long lasting change in behavior resulting from experience 2. Classical Conditioning 1.
Psychology, Ch. 6. Learning Part 1
Psychology, Ch. 6 Learning Part 1 Two Main Types of Learning Associative learning- learning that certain events occur together Cognitive learning- acquisition of mental information, by observing or listening
Schedules of Reinforcement 11/11/11
Schedules of Reinforcement 11/11/11 Reinforcement Schedules Intermittent Reinforcement: A type of reinforcement schedule by which some, but not all, correct responses are reinforced. Intermittent reinforcement
Behavioral Neuroscience: Fear thou not. Rony Paz
Behavioral Neuroscience: Fear thou not Rony Paz Rony.paz@weizmann.ac.il Thoughts What is a reward? Learning is best motivated by threats to survival? Threats are much better reinforcers? Fear is a prime
nucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727
Nucleus accumbens From Wikipedia, the free encyclopedia Brain: Nucleus accumbens Nucleus accumbens visible in red. Latin NeuroNames MeSH NeuroLex ID nucleus accumbens septi hier-259 Nucleus+Accumbens birnlex_727
Learning. Learning: Problems. Chapter 6: Learning
Chapter 6: Learning 1 Learning 1. In perception we studied that we are responsive to stimuli in the external world. Although some of these stimulus-response associations are innate many are learnt. 2.
Classical and Instrumental Conditioning. Lecture 8
Classical and Instrumental Conditioning Lecture 8 1 Basic Procedure for Classical Conditioning CS (Bell) US (Meat Powder) CR (Salivation) UR (Salivation) 2 Acquisition Major Phenomena of Classical Conditioning
The Frontal Lobes. Anatomy of the Frontal Lobes. Anatomy of the Frontal Lobes 3/2/2011. Portrait: Losing Frontal-Lobe Functions. Readings: KW Ch.
The Frontal Lobes Readings: KW Ch. 16 Portrait: Losing Frontal-Lobe Functions E.L. Highly organized college professor Became disorganized, showed little emotion, and began to miss deadlines Scores on intelligence
Learning. Association. Association. Unit 6: Learning. Learning. Classical or Pavlovian Conditioning. Different Types of Learning
Unit 6: Learning Learning Learning relatively permanent change in an organism s behavior due to experience experience (nurture) is the key to learning Different Types of Learning Classical -learn by association
SKILL MEMORY PSYC LEARNING & MEMORY ARLO CLARK-FOOS, PH.D.
SKILL MEMORY PSYC 461 - LEARNING & MEMORY ARLO CLARK-FOOS, PH.D. I GOT SKILLZ Skill Ability that can improve over time through practice Perceptual-Motor Nunchuck skills, bow hunting skills, athletes, musicians,
Overview. Non-associative learning. Associative Learning Classical conditioning Instrumental/operant conditioning. Observational learning
Learning Part II Non-associative learning Overview Associative Learning Classical conditioning Instrumental/operant conditioning Observational learning Thorndike and Law of Effect Classical Conditioning
Association. Operant Conditioning. Classical or Pavlovian Conditioning. Learning to associate two events. We learn to. associate two stimuli
Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association
Myers PSYCHOLOGY. (7th Ed) Chapter 8. Learning. James A. McCubbin, PhD Clemson University. Worth Publishers
Myers PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers Learning Learning relatively permanent change in an organism s behavior due to experience Association
Study Plan: Session 1
Study Plan: Session 1 6. Practice learning the vocabulary. Use the electronic flashcards from the Classical The Development of Classical : The Basic Principles of Classical Conditioned Emotional Reponses:
acquisition associative learning behaviorism B. F. Skinner biofeedback
acquisition associative learning in classical conditioning the initial stage when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
Unit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.
Unit 06 - Overview How We Learn and Classical Conditioning Operant Conditioning Operant Conditioning s Applications, and Comparison to Classical Conditioning Biology, Cognition, and Learning Learning By
Psychology in Your Life
Sarah Grison Todd Heatherton Michael Gazzaniga Psychology in Your Life SECOND EDITION Chapter 6 Learning 2016 W. W. Norton & Company, Inc. 1 Humans are learning machines! Learning: A change in behavior,
Emotion Explained. Edmund T. Rolls
Emotion Explained Edmund T. Rolls Professor of Experimental Psychology, University of Oxford and Fellow and Tutor in Psychology, Corpus Christi College, Oxford OXPORD UNIVERSITY PRESS Contents 1 Introduction:
590,000 deaths can be attributed to an addictive substance in some way
Mortality and morbidity attributable to use of addictive substances in the United States. The Association of American Physicians from 1999 60 million tobacco smokers in the U.S. 14 million dependent on
Learning = an enduring change in behavior, resulting from experience.
Chapter 6: Learning Learning = an enduring change in behavior, resulting from experience. Conditioning = a process in which environmental stimuli and behavioral processes become connected Two types of
SKILL MEMORY PSYC LEARNING & MEMORY ARLO CLARK-FOOS, PH.D.
SKILL MEMORY PSYC 461 - LEARNING & MEMORY ARLO CLARK-FOOS, PH.D. I GOT SKILLZ Skill Ability that can improve over time through practice Perceptual-Motor Nunchuck skills, bow hunting skills, athletes, musicians,
BRAIN MECHANISMS OF REWARD AND ADDICTION
BRAIN MECHANISMS OF REWARD AND ADDICTION TREVOR.W. ROBBINS Department of Experimental Psychology, University of Cambridge Many drugs of abuse, including stimulants such as amphetamine and cocaine, opiates
brain valuation & behavior
brain valuation & behavior 9 Rangel, A, et al. (2008) Nature Neuroscience Reviews Vol 9 Stages in decision making process Problem is represented in the brain Brain evaluates the options Action is selected
1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.
1. A stimulus change that increases the future frequency of behavior that immediately precedes it. 2. In operant conditioning, a reinforcement schedule that reinforces a response only after a specified
Learning. AP PSYCHOLOGY Unit 4
Learning AP PSYCHOLOGY Unit 4 Learning Learning is a lasting change in behavior or mental process as the result of an experience. There are two important parts: a lasting change a simple reflexive reaction
Neurobiology of Addiction
Neurobiology of Addiction Tiffany Love, Ph.D. Department of Psychiatry The University of Utah What is Addiction? Addiction is a chronic, relapsing, and treatable brain disorder. Compulsive drug seeking
ISIS NeuroSTIC. Un modèle computationnel de l amygdale pour l apprentissage pavlovien.
ISIS NeuroSTIC Un modèle computationnel de l amygdale pour l apprentissage pavlovien Frederic.Alexandre@inria.fr An important (but rarely addressed) question: How can animals and humans adapt (survive)
Operant Conditioning
Operant Conditioning Classical vs. Operant Conditioning With classical conditioning you can teach a dog to salivate, but you cannot teach it to sit up or roll over. Why? Salivation is an involuntary reflex,
Chapter 6/9: Learning
Chapter 6/9: Learning Learning A relatively durable change in behavior or knowledge that is due to experience. The acquisition of knowledge, skills, and behavior through reinforcement, modeling and natural
Cognitive Functions of the Mind
Chapter 6 Learning Cognitive Functions of the Mind Mediate adaptive behaviours Interactions between person and world Form internal representations of the world Perception, memory Reflect on this knowledge
Chapter 5 Study Guide
Chapter 5 Study Guide Practice Exam Questions: Which of the following is not included in the definition of learning? It is demonstrated immediately Assuming you have eaten sour pickles before, imagine
Neocortex. Hemispheres 9/22/2010. Psychology 472 Pharmacology of Psychoactive Drugs. Structures are divided into several section or lobes.
Neocortex Psychology 472 Pharmacology of Psychoactive Drugs 1 Is the most developed in Humans Has many folds and fissures The folds of tissue are called gyri or a gyrus (single) The fissures or valleys
THE BRAIN HABIT BRIDGING THE CONSCIOUS AND UNCONSCIOUS MIND. Mary ET Boyle, Ph. D. Department of Cognitive Science UCSD
THE BRAIN HABIT BRIDGING THE CONSCIOUS AND UNCONSCIOUS MIND Mary ET Boyle, Ph. D. Department of Cognitive Science UCSD Linking thought and movement simultaneously! Forebrain Basal ganglia Midbrain and
Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer
Effects of lesions of the nucleus accumbens core and shell on response-specific Pavlovian i n s t ru mental transfer RN Cardinal, JA Parkinson *, TW Robbins, A Dickinson, BJ Everitt Departments of Experimental
PSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning
PSY402 Theories of Learning Chapter 8, Theories of Appetitive and Aversive Conditioning Operant Conditioning The nature of reinforcement: Premack s probability differential theory Response deprivation
CHAPTER 6. Learning. Lecture Overview. Introductory Definitions PSYCHOLOGY PSYCHOLOGY PSYCHOLOGY
Learning CHAPTER 6 Write down important terms in this video. Explain Skinner s view on Free Will. Lecture Overview Classical Conditioning Operant Conditioning Cognitive-Social Learning The Biology of Learning
Basal Ganglia General Info
Basal Ganglia General Info Neural clusters in peripheral nervous system are ganglia. In the central nervous system, they are called nuclei. Should be called Basal Nuclei but usually called Basal Ganglia.
DOWNLOAD PDF SOCIAL RESPONSES TO LARGE TECHNICAL SYSTEMS: CONTROL OR ANTICIPATION
Chapter 1 : INFORMATION MANAGEMENT & TECHNOLOGY This volume stems from the efforts of scholars who seek to understand the social dynamics of large technical systems. The purpose is to develop concepts
Outline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture
Outline What is learning? Associative Learning Classical Conditioning Operant Conditioning Observational Learning History of Learning Theory Nature or Nurture BEHAVIORISM Tabula Rasa Learning: Systematic,
Gamification: What can pigeons teach us about highway safety?
Gamification: What can pigeons teach us about highway safety? Michael Lee Psychology Graduate Student Center for Visualization and Virtual Environments User Experience Lab Overview Gamification Using game
acquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events
acquisition associative learning In classical conditioning, the initial stage, when one links a neutral stimulus and an unconditioned stimulus so that the neutral stimulus begins triggering the conditioned
PSY402 Theories of Learning. Chapter 6 Appetitive Conditioning
PSY402 Theories of Learning Chapter 6 Appetitive Conditioning Midterm Results Animals Search and rescue dogs -- http://www.sardogsus.org/ Dog Tricks Appetitive Conditioning Appetitive something desirable
Brain Mechanisms of Emotion 1 of 6
Brain Mechanisms of Emotion 1 of 6 I. WHAT IS AN EMOTION? A. Three components (Oately & Jenkins, 1996) 1. caused by conscious or unconscious evaluation of an event as relevant to a goal that is important
THE PREFRONTAL CORTEX. Connections. Dorsolateral FrontalCortex (DFPC) Inputs
THE PREFRONTAL CORTEX Connections Dorsolateral FrontalCortex (DFPC) Inputs The DPFC receives inputs predominantly from somatosensory, visual and auditory cortical association areas in the parietal, occipital
BIOMED 509. Executive Control UNM SOM. Primate Research Inst. Kyoto,Japan. Cambridge University. JL Brigman
BIOMED 509 Executive Control Cambridge University Primate Research Inst. Kyoto,Japan UNM SOM JL Brigman 4-7-17 Symptoms and Assays of Cognitive Disorders Symptoms of Cognitive Disorders Learning & Memory
Learning. Learning. Stimulus Learning. Modification of behavior or understanding Is it nature or nurture?
Learning Chapter 6 Learning Modification of behavior or understanding Is it nature or nurture? Stimulus Learning Habituation: when you pay less attention to something over time response starts out strong
Instrumental Conditioning VI: There is more than one kind of learning
Instrumental Conditioning VI: There is more than one kind of learning PSY/NEU338: Animal learning and decision making: Psychological, computational and neural perspectives outline what goes into instrumental
Basic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia.
Basic definition and Classification of Anhedonia. Preclinical and Clinical assessment of anhedonia. Neurobiological basis and pathways involved in anhedonia. Objective characterization and computational
Reinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain
Reinforcement learning and the brain: the problems we face all day Reinforcement Learning in the brain Reading: Y Niv, Reinforcement learning in the brain, 2009. Decision making at all levels Reinforcement
an ability that has been acquired by training (process) acquisition aversive conditioning behavior modification biological preparedness
acquisition an ability that has been acquired by training (process) aversive conditioning A type of counterconditioning that associates an unpleasant state (such as nausea) with an unwanted behavior (such
25 Things To Know. Pre- frontal
25 Things To Know Pre- frontal Frontal lobes Cognition Touch Sound Phineas Gage First indication can survive major brain trauma Lost 1+ frontal lobe Gage Working on a railroad Gage (then 25) Foreman on
Chapter 6: Learning The McGraw-Hill Companies, Inc.
Chapter 6: Learning Learning A relatively permanent change in behavior brought about by experience Distinguishes between changes due to maturation and changes brought about by experience Distinguishes
Strengthening Operant Behavior: Schedules of Reinforcement. reinforcement occurs after every desired behavior is exhibited
OPERANT CONDITIONING Strengthening Operant Behavior: Schedules of Reinforcement CONTINUOUS REINFORCEMENT SCHEDULE reinforcement occurs after every desired behavior is exhibited pro: necessary for initial
Brain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver
Brain Imaging studies in substance abuse Jody Tanabe, MD University of Colorado Denver NRSC January 28, 2010 Costs: Health, Crime, Productivity Costs in billions of dollars (2002) $400 $350 $400B legal
Behavioral Pharmacology
Psych 181: Dr. Anagnostaras Lecture 4 Behavioral Pharmacology Behavioral Pharmacology Behavioral Pharmacology The study of the relationship between the physiological actions of drugs and their effects
Dikran J. Martin. Psychology 110. Name: Date: Principal Features. "First, the term learning does not apply to (168)
Dikran J. Martin Psychology 110 Name: Date: Lecture Series: Chapter 5 Learning: How We're Changed Pages: 26 by Experience TEXT: Baron, Robert A. (2001). Psychology (Fifth Edition). Boston, MA: Allyn and
Operant Conditioning B.F. SKINNER
Operant Conditioning B.F. SKINNER Reinforcement in Operant Conditioning Behavior Consequence Patronize Elmo s Diner It s all a matter of consequences. Rewarding Stimulus Presented Tendency to tell jokes
Review Sheet Learning (7-9%)
Name Ms. Gabriel/Mr. McManus Date Period AP Psychology Review Sheet Learning (7-9%) 1) learning 2) associative learning Classical Conditioning 3) Ivan Pavlov 4) classical conditioning 5) John Watson 6)
Unit 5: Learning. Topic: Operant Conditioning
Unit 5: Learning Topic: Operant Conditioning 1874-1949 key name Edward THORNDIKE Proposed the Law of Effect behaviors followed by favorable outcomes are more likely conducted puzzle box experiments on
Learning. Learning. relatively permanent change in an organism s behavior due to experience
Cat Video Cat Roundup Learning Learning relatively permanent change in an organism s behavior due to experience Association We learn by association Our minds naturally connect events that occur in sequence
PSYC 221 Introduction to General Psychology
PSYC 221 Introduction to General Psychology Session 5 Learning Lecturer: Dr. Joana Salifu Yendork, Psychology Department Contact Information: jyendork@ug.edu.gh College of Education School of Continuing
What is Learning? Learning: any relatively permanent change in behavior brought about by experience or practice
CHAPTER 5 learning What is Learning? Learning: any relatively permanent change in behavior brought about by experience or practice When people learn anything, some part of their brain is physically changed
Council on Chemical Abuse Annual Conference November 2, The Science of Addiction: Rewiring the Brain
Council on Chemical Abuse Annual Conference November 2, 2017 The Science of Addiction: Rewiring the Brain David Reyher, MSW, CAADC Behavioral Health Program Director Alvernia University Defining Addiction
Learning Theories - Behaviourism -
Learning Theories - Behaviourism - Kimberley A. Clow kclow2@uwo.ca http://instruct.uwo.ca/psychology/257e-570 Office Hour: Thursdays 2-3pm Office: S302 Outline What is Learning? Classical Conditioning
Learning. Learning. Learning via Association 1/8/2012. Chapter Eight. Change in an organism s behavior or thought as a result of experience
Chapter Eight Learning Learning Change in an organism s behavior or thought as a result of experience Many different kinds, most basic are habituation and sensitization Responding to stimuli less or moreover
PSY402 Theories of Learning. Chapter 9 Biological Influences on Learning
PSY402 Theories of Learning Chapter 9 Biological Influences on Learning Limits to Learning How general are the laws of learning? Skinner s rules work in both lab and real-world settings, across species.
Learning: a relatively permanent change in an organism s behavior due to experience.
Learning: a relatively permanent change in an organism s behavior due to experience. Instinct: unlearned behaviors due to evolution. Ex. bears hibernating. Habituation: an organism s decreasing response
Classical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts
Learning Classical Conditioning Pavlov study of digestion dogs salivate before getting food learning as signal detection: emphasis on what happens before a given behavior Classical conditioning terms Stimulus:
I. Classical Conditioning
Learning Chapter 8 Learning A relatively permanent change in an organism that occur because of prior experience Psychologists must study overt behavior or physical changes to study learning Learning I.
Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood, June 2004.
Ivan Pavlov http://physiologyonline.physiology.org/ cgi/content/full/19/6/326 Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood,
The Neuroscience of Addiction: A mini-review
The Neuroscience of Addiction: A mini-review Jim Morrill, MD, PhD MGH Charlestown HealthCare Center Massachusetts General Hospital Disclosures Neither I nor my spouse/partner has a relevant financial relationship
Cognition in Parkinson's Disease and the Effect of Dopaminergic Therapy
Cognition in Parkinson's Disease and the Effect of Dopaminergic Therapy Penny A. MacDonald, MD, PhD, FRCP(C) Canada Research Chair Tier 2 in Cognitive Neuroscience and Neuroimaging Assistant Professor
... CR Response ... UR NR
Learning is the (1) brain-based phenomenon that is a (2) relatively permanent change (3) in behavior that results from (4) experience, (5) reinforcement, or (6) observation. (1) brain-based (2) relatively
PSYC2010: Brain and Behaviour
PSYC2010: Brain and Behaviour PSYC2010 Notes Textbook used Week 1-3: Bouton, M.E. (2016). Learning and Behavior: A Contemporary Synthesis. 2nd Ed. Sinauer Week 4-6: Rieger, E. (Ed.) (2014) Abnormal Psychology:
Prefrontal dysfunction in drug addiction: Cause or consequence? Christa Nijnens
Prefrontal dysfunction in drug addiction: Cause or consequence? Master Thesis Christa Nijnens September 16, 2009 University of Utrecht Rudolf Magnus Institute of Neuroscience Department of Neuroscience
Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.
Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events. behaviorism - the view that psychology (1) should be an objective science
Substance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress.
Drug Addiction Substance Abuse and Addictions Substance abuse: a pattern of substance use that produces clinically significant impairment or distress. Most recognize it as harmful but continue the addictive
DEFINITION. Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience
LEARNING DEFINITION Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience WHAT DO WE LEARN? 1. Object :we learn objects with
Exam #3 Study Guide. Chapter 5 The Feeling Mind: Motivation and Emotion
Exam #3 Study Guide Chapter 5 The Feeling Mind: Motivation and Emotion I. Pain i. Damage to tissue causes a) release of special chemicals b) stimulates pain receptors ii. Pain receptors iii. Pain Pathway
STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning
STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? 1. learning 2. associate; associations; associative learning; habituates 3. classical 4. operant 5. observing Classical Conditioning 1.
Chapter 5: How Do We Learn?
Chapter 5: How Do We Learn? Defining Learning A relatively permanent change in behavior or the potential for behavior that results from experience Results from many life experiences, not just structured
Anatomy of the basal ganglia. Dana Cohen Gonda Brain Research Center, room 410
Anatomy of the basal ganglia Dana Cohen Gonda Brain Research Center, room 410 danacoh@gmail.com The basal ganglia The nuclei form a small minority of the brain s neuronal population. Little is known about
Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007
Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007 What is involved in learning? Evolution -The changes in behaviour that accumulate across generations are stored in the genes Combined with natural
PSYCHOLOGY. Chapter 6 LEARNING PowerPoint Image Slideshow
PSYCHOLOGY Chapter 6 LEARNING PowerPoint Image Slideshow Learning? What s that? A relatively permanent change in behavior brought about by experience or practice. Note that learning is NOT the same as
June 16, The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones.
K K The retina has two types of light-sensitive receptor cells (or photoreceptors) called rods and cones. rods: 75 to 150 million cells which are very sensitive to all levels of light. cones: 6 to 7 million
Learning. 3. Which of the following is an example of a generalized reinforcer? (A) chocolate cake (B) water (C) money (D) applause (E) high grades
Learning Practice Questions Each of the questions or incomplete statements below is followed by five suggested answers or completions. Select the one that is best in each case. 1. Just before something
Learning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction
1 2 3 4 5 Myers Psychology for AP* Unit 6: Learning Unit Overview How Do We Learn? Classical Conditioning Operant Conditioning Learning by Observation How Do We Learn? Introduction Learning Habituation
Chapter 7 - Learning
Chapter 7 - Learning How Do We Learn Classical Conditioning Operant Conditioning Observational Learning Defining Learning Learning a relatively permanent change in an organism s behavior due to experience.
Neuroplasticity:. Happens in at least 3 ways: - - -
BRAIN PLASTICITY Neuroplasticity:. Happens in at least 3 ways: - - - Recently, it was found that new neurons and glial cells are born in specific brain regions - reorganization. Brain plasticity occurs
Lecture 5: Learning II. Major Phenomenon of Classical Conditioning. Contents
Lecture 5: Learning II Contents Major Phenomenon of Classical Conditioning Applied Examples of Classical Conditioning Other Types of Learning Thorndike and the Law of Effect Skinner and Operant Learning
BRAIN PLASTICITY. Neuroplasticity:. Happens in at least 3 ways: - - -
BRAIN PLASTICITY Neuroplasticity:. Happens in at least 3 ways: - - - Recently, it was found that new neurons and glial cells are born in specific brain regions - reorganization. Brain plasticity occurs
Learning: Chapter 7: Instrumental Conditioning
Learning: Chapter 7: Instrumental Conditioning W. J. Wilson, Psychology November 8, 2010 1. Reinforcement vs. Contiguity Thorndike (a reinforcement theorist): Law of effect: positive consequences strengthen
2. Hull s theory of learning is represented in a mathematical equation and includes expectancy as an important variable.
True/False 1. S-R theories of learning in general assume that learning takes place more or less automatically, and do not require and thought by humans or nonhumans. ANS: T REF: P.18 2. Hull s theory of
TO BE MOTIVATED IS TO HAVE AN INCREASE IN DOPAMINE. The statement to be motivated is to have an increase in dopamine implies that an increase in
1 NAME COURSE TITLE 2 TO BE MOTIVATED IS TO HAVE AN INCREASE IN DOPAMINE The statement to be motivated is to have an increase in dopamine implies that an increase in dopamine neurotransmitter, up-regulation
Connect with amygdala (emotional center) Compares expected with actual Compare expected reward/punishment with actual reward/punishment Intuitive
Orbitofronal Notes Frontal lobe prefrontal cortex 1. Dorsolateral Last to myelinate Sleep deprivation 2. Orbitofrontal Like dorsolateral, involved in: Executive functions Working memory Cognitive flexibility
Instrumental Conditioning I
Instrumental Conditioning I Basic Procedures and Processes Instrumental or Operant Conditioning? These terms both refer to learned changes in behavior that occur as a result of the consequences of the