Operant Conditioning B.F. SKINNER

Similar documents
Chapter 6/9: Learning

PSYC2010: Brain and Behaviour

Schedules of Reinforcement 11/11/11

Operant Conditioning

Classical Conditioning Classical Conditioning - a type of learning in which one learns to link two stimuli and anticipate events.

Chapter 5: How Do We Learn?

Unit 6 Learning.

Learning. AP PSYCHOLOGY Unit 4

Psychological Hodgepodge. Mr. Mattingly Psychology

I. Classical Conditioning

Learning. Learning is a relatively permanent change in behavior acquired through experience.

Learning. Learning. Learning

Chapter 6: Learning The McGraw-Hill Companies, Inc.

Classical Conditioning. Learning. Classical conditioning terms. Classical Conditioning Procedure. Procedure, cont. Important concepts

Myers PSYCHOLOGY. (7th Ed) Chapter 8. Learning. James A. McCubbin, PhD Clemson University. Worth Publishers

Associative Learning

CHAPTER 6. Learning. Lecture Overview. Introductory Definitions PSYCHOLOGY PSYCHOLOGY PSYCHOLOGY

Spontaneous recovery. Module 18. Processes of Conditioning. Classical Conditioning (cont d)

Unit 06 - Overview. Click on the any of the above hyperlinks to go to that section in the presentation.

Association. Operant Conditioning. Classical or Pavlovian Conditioning. Learning to associate two events. We learn to. associate two stimuli

Outline. History of Learning Theory. Pavlov s Experiment: Step 1. Associative learning 9/26/2012. Nature or Nurture

Module 27: Operant Conditioning

Psychology in Your Life

... CR Response ... UR NR

Chapter 7. Learning From Experience

Chapter 5: Learning and Behavior Learning How Learning is Studied Ivan Pavlov Edward Thorndike eliciting stimulus emitted

Learning Habituation Associative learning Classical conditioning Operant conditioning Observational learning. Classical Conditioning Introduction

PSY402 Theories of Learning. Chapter 8, Theories of Appetitive and Aversive Conditioning

Learning. Association. Association. Unit 6: Learning. Learning. Classical or Pavlovian Conditioning. Different Types of Learning

Theories of Learning

PSYC 337 LEARNING. Session 6 Instrumental and Operant Conditioning Part Two

Cognitive Functions of the Mind

acquisition associative learning behaviorism B. F. Skinner biofeedback

Chapter 5 Study Guide

Classical and Instrumental Conditioning. Lecture 8

Learning. Learning is a relatively permanent change in behavior acquired through experience or practice.

Psychology in Your Life

PSY402 Theories of Learning. Chapter 6 Appetitive Conditioning

Learning. Learning. relatively permanent change in an organism s behavior due to experience

Chapter 7 - Learning

3/7/2010. Theoretical Perspectives

an ability that has been acquired by training (process) acquisition aversive conditioning behavior modification biological preparedness

Learning: Some Key Terms

Gamification: What can pigeons teach us about highway safety?

Psychology 020 Chapter 7: Learning Tues. Nov. 6th, 2007

STUDY GUIDE ANSWERS 6: Learning Introduction and How Do We Learn? Operant Conditioning Classical Conditioning

Learning and conditioning

Chapter 6. Learning: The Behavioral Perspective

acquisition associative learning behaviorism A type of learning in which one learns to link two or more stimuli and anticipate events

The Behaviourist Perspective

Vidya Prasarak Mandal s K. G. Joshi College of Arts and N. G. Bedekar College of Commerce, Thane.

Learning. Learning is the relatively permanent change in an organism s behavior due to experience.

Classical Conditioning & Operant Conditioning

What is Learning? Learning: any relatively permanent change in behavior brought about by experience or practice

Initial Tests of the Learned Helplessness Explanation Innoculation against helplessness If dogs are given escapable pre-preshock, then subsequent expo

Learning Theories. Dr. Howie Fine INTRODUCTION. Learning is one of the most researched and discussed area in Psychology.

Name. True or False: 1. Learning is a relatively permanent change in behavior brought about by experience. True False

Unit 6 REVIEW Page 1. Name: Date:

Learning. Learning. Learning via Association 1/8/2012. Chapter Eight. Change in an organism s behavior or thought as a result of experience

Review Sheet Learning (7-9%)

Objectives. 1. Operationally define terms relevant to theories of learning. 2. Examine learning theories that are currently important.

PSYC 221 Introduction to General Psychology

Learning & Conditioning

Module One: Booklet #7

Learning = an enduring change in behavior, resulting from experience.

PSYCHOLOGY. Chapter 6 LEARNING PowerPoint Image Slideshow

Modules. PART I Module 26: How We Learn and Classical Conditioning

Learning. Classical Conditioning. Classical Conditioning

Association. Defining Learning. A relatively in knowledge or behavior that results from.

1. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.

Psychology Study Guide Chapter 7

Learning. How do we learn behaviors from our direct and indirect experiences? What are the implications of learning theories for our everyday lives?

Operant conditioning: a learning theory of attachments

Learning. Learning: Problems. Chapter 6: Learning

Learning. 3. Which of the following is an example of a generalized reinforcer? (A) chocolate cake (B) water (C) money (D) applause (E) high grades

CHAPTER 6. Test Yourself, p. 228

Learning Chapter 6 1

Strengthening Operant Behavior: Schedules of Reinforcement. reinforcement occurs after every desired behavior is exhibited

Which of the following is not an example of a reinforced behavior?

Chapter Six. Learning. Classical Conditioning Operant Conditioning Observational Learning

Name: Period: Chapter 7: Learning. 5. What is the difference between classical and operant conditioning?

What is Learned? Lecture 9

Learning Theories - Behaviourism -

AZA/AAZK Animal Training Terms & Definitions

Psychology, Ch. 6. Learning Part 1

Lecture 5: Learning II. Major Phenomenon of Classical Conditioning. Contents

Behaviorism & Education

GCSE PSYCHOLOGY UNIT 2 LEARNING REVISION

Bronze statue of Pavlov and one of his dogs located on the grounds of his laboratory at Koltushi Photo taken by Jackie D. Wood, June 2004.

Operant Conditioning

Learning Chapter 6. Please visit the Study Site at psychology.com. Developed by Stephen Tracy Community College of Southern Nevada

Classical Conditioning. Operant Conditioning. Operant Conditioning. Observational Learning. Classical versus operant conditioning

Learning Activity 1 Review questions

Learning: a relatively permanent change in an organism s behavior due to experience.

DEFINITION. Learning is the process of acquiring knowledge (INFORMATIN ) and new responses. It is a change in behavior as a result of experience

Basic characteristics

Behaviorism. B. F. Skinner

Dikran J. Martin. Psychology 110. Name: Date: Principal Features. "First, the term learning does not apply to (168)

John Broadus Watson, 1930

Transcription:

Operant Conditioning B.F. SKINNER

Reinforcement in Operant Conditioning Behavior Consequence Patronize Elmo s Diner It s all a matter of consequences. Rewarding Stimulus Presented Tendency to tell jokes increases

Operant conditioning A form of learning in which responses come to be controlled by their consequences. Stimulus After the fact. Operant responses are said to be emitted rather than elicited.

Primary reinforcers Events that are inherently reinforcing because they satisfy biological needs. Examples include food, water, warmth, sex Secondary (conditioned) reinforcers Events that acquire reinforcing qualities by being associated with primary reinforcers. Examples include paycheck, attention, praise, grades

Skinner Box Speaker Signal lights Lever To food dispenser Food pellet Electric grid To shock generator A small enclosure in which an animal can make a specific response that is recorded while the consequences of the response are systematically controlled.

Cumulative Recorder Drum One response Series of rapid responses Pen Not responding Reinforcement slash Creates a graphic record of responding and reinforcement in a Skinner box as a function of time.

Acquisition and Shaping Acquisition The initial stages of learning a new response. Shaping Process of repeatedly reinforcing closer and closer approximations to desired response.

Extinction Cumulative s Rate decreasing High rate extinguished Resistance to Extinction When an organism continues to make a response after delivery of the reinforce has been terminated. Rate increasing Time

Schedules of Reinforcement Continuous Reinforcement Intermittent Reinforcement Reinforcer Reinforcer Reinforcer Reinforcer Reinforcer Reinforcer Reinforcer Reinforcer Reinforcer Reinforcer All of the time Some of the time

Pattern of Reinforcement Cumulative s Fixed-ratio (FR) Lower resistance to extinction Rapid responding Short pause after reinforcement Note: Higher ratios generate higher response rates Why would this reinforcement pattern result in a lower resistance to extinction? Time

Pattern of Reinforcement Cumulative s Variable-ratio (VR) Higher resistance to extinction High, steady rate without pauses Note: Higher ratios generate higher response rates Why would this reinforcement pattern result in a higher resistance to extinction? Time

Pattern of Reinforcement Cumulative s Fixed-interval (FI) Lower resistance to extinction Long pause after reinforcement yields scalloping effect Note: Short intervals generate higher rates overall Time

Pattern of Reinforcement Cumulative s Variable-interval (VI) Higher resistance to extinction Low, steady rate without pauses Note: Short intervals generate higher rates overall Time

Positive Reinforcement When a response is strengthened because it is followed by the presentation of a rewarding stimulus. Behavior Consequence Tendency to press lever increases Press lever Rewarding Stimulus Presented Food delivered

Negative Reinforcement When a response is strengthened because it is followed by the removal of an aversive (unpleasant) stimulus. Behavior Consequence Tendency to press lever increases Press lever Aversive Stimulus Removed Shock turned off

Positive or Negative Reinforcement? A toddler begins to cry in a toy store. The toddler s mother gives her a toy to quiet her down. Next time they go to the store, the child starts crying again. Positive Reinforcement

Positive or Negative Reinforcement? A teacher has a policy that requires all late students to attended detention. The class watches as a student is assigned detention. The next day, the student is early to class. Negative Reinforcement

Aversive Conditioning Escape & Avoidance Avoidance learning an organism acquires a response that prevents some aversive stimulation from occurring. Escape (CS) Light (US) Shock (CR) (UR) Fear

Conditioned Taste Aversion Unconditioned Stimulus (Illness) (CR) (UR) Nausea Conditioned Stimulus (Taste of Berries)

Punishment An event following a response weakens the tendency to make that response. Consequence If the mouse gets shocked when it presses the lever, the punishment will reduce the likeliness that the mouse will press the lever again. Press lever