Operant ConditioningOperant Conditioning

Unit 7Unit 7Lesson 2Lesson 2

ObjectivesObjectives Describe and apply components of Describe and apply components of

operant conditioning.operant conditioning. Identify B.F. Skinner.Identify B.F. Skinner. Analyze uses and effectiveness of Analyze uses and effectiveness of

reinforcement and punishment.reinforcement and punishment. Describe reinforcement schedules.Describe reinforcement schedules.

Warm UpWarm Up

What is learning?What is learning?

Relatively Relatively permanent change permanent change in behavior that in behavior that results from results from experience.experience.

Review of Prior LearningReview of Prior Learning You always talk to your (boy/girl) friend while You always talk to your (boy/girl) friend while

sitting in your beanbag chair. After an ugly sitting in your beanbag chair. After an ugly breakup, you find that even looking at the chair breakup, you find that even looking at the chair upsets you, so you give it to Goodwill.upsets you, so you give it to Goodwill.

Identify the NS-UCS-UCR-CS-CRIdentify the NS-UCS-UCR-CS-CR What would be occurring if you couldn’t sit in any What would be occurring if you couldn’t sit in any

chair while talking on the phone?chair while talking on the phone? What if you only refused to sit in beanbag chairs?What if you only refused to sit in beanbag chairs? What if you go away to college and your What if you go away to college and your

roommate has a chair that makes you chuckle as roommate has a chair that makes you chuckle as you sit in it and think about the story?you sit in it and think about the story?

And this can only occur after it’s gone away And this can only occur after it’s gone away which is called?which is called?

Classical vs. Operant Classical vs. Operant ConditioningConditioning

ClassicalClassical

Environment Environment provides the provides the stimulus and the stimulus and the subject responds.subject responds.

OperantOperant

Environment Environment responds to the responds to the subject’s behavior subject’s behavior (stimulus).(stimulus).

Edward ThorndikeEdward Thorndike

Thorndike’s Law of Thorndike’s Law of EffectEffect Rewarded behavior Rewarded behavior

likely to recurlikely to recur

B.F. SkinnerB.F. Skinner

Behavior Behavior influenced by influenced by history of its history of its consequencesconsequences

Skinner BoxSkinner Box

ShapingShaping Reward behaviors close to the Reward behaviors close to the

behavior he was looking for until behavior he was looking for until animal performed desired behavior.animal performed desired behavior.

Operant ConditioningOperant Conditioning RewardReward A.k.a. Positive A.k.a. Positive

ReinforcementReinforcement

Actions taken that Actions taken that result in result in consequencesconsequences

Behavior Behavior moremore likely to occur againlikely to occur again

PunishmentPunishment

Actions taken that Actions taken that result in result in consequencesconsequences

Behavior Behavior lessless likely likely to occur againto occur again

Operant ConditioningOperant Conditioning Negative Negative

ReinforcementReinforcement

Actions taken to Actions taken to avoid punishmentsavoid punishments

Behavior Behavior moremore likely to occur likely to occur againagain

Omission TrainingOmission Training

Actions taken which Actions taken which result in something result in something being taken away being taken away

Behavior Behavior lessless likely likely to occur againto occur again

Operant Conditioning ChartOperant Conditioning Chart

PositivePositiveReinforcementReinforcement

PunishmentPunishment

OmissionOmissionTrainingTraining

NegativeNegativeReinforcementReinforcement

Pleasant Aversive

+

_

ActivityActivity Introduction to Operant Conditioning Introduction to Operant Conditioning

“problems”“problems”

When you’ve worked your way through When you’ve worked your way through the problem, identify which principle of the problem, identify which principle of

operant conditioning is at work.operant conditioning is at work.( +R, -R, OT, P)( +R, -R, OT, P)

Closure Day 1Closure Day 1 Use all 4 principles of operant Use all 4 principles of operant

conditioning to describe how you’d get conditioning to describe how you’d get a child to eat spinach without a child to eat spinach without

complaining.complaining.

Premack Principle- Use more preferred Premack Principle- Use more preferred activity to motivate you to do less activity to motivate you to do less

preferred activitypreferred activity

Day 2 Warm UpDay 2 Warm Up What’s the difference What’s the difference

between classical and between classical and operant conditioning?operant conditioning?

Classical-subject Classical-subject responds to responds to environmentenvironment

Operant – environment Operant – environment responds to subject’s responds to subject’s behavior.behavior.

ReviewReview Which principle of operant Which principle of operant

conditioning…conditioning…

Presents something unpleasant?Presents something unpleasant? Takes something pleasant away?Takes something pleasant away? Takes something unpleasant away?Takes something unpleasant away? Presents something pleasant?Presents something pleasant?

Types of ReinforcersTypes of Reinforcers

Primary ReinforcerPrimary Reinforcer Value doesn’t need Value doesn’t need

to be learned.to be learned. Satisfies basic Satisfies basic

human need.human need. Ex: Food, sleepEx: Food, sleep

Secondary Secondary ReinforcerReinforcer Value has to be Value has to be

learnedlearned Without conditioning, Without conditioning,

it would have no +/- it would have no +/- valuevalue

Ex: $, Praise, Hug, Ex: $, Praise, Hug, GradesGrades

Providing ReinforcementProviding Reinforcement

Continuous Continuous ReinforcementReinforcement Reinforcement Reinforcement

given every time given every time desired behavior desired behavior occursoccurs

Partial Partial ReinforcementReinforcement Reinforcement only Reinforcement only

given sometimes given sometimes after desired after desired behavior occurs.behavior occurs.

Online ActivityOnline Activity PsychSim 5.0 “Operant Conditioning”PsychSim 5.0 “Operant Conditioning” http://www.worthpublishers.com/expl

oring5e/content/psychsim5/Operant%20Conditioning/PsychSim_Shell.html

This activity will review classical and This activity will review classical and operant conditioning and introduce operant conditioning and introduce you to schedules of reinforcement.you to schedules of reinforcement.

4 Schedules of Partial 4 Schedules of Partial ReinforcementReinforcement

Ratio ScheduleRatio Schedule # of correct # of correct

responses subject responses subject makes between makes between reinforcementreinforcement

Interval ScheduleInterval Schedule Amt of time that Amt of time that

passes before passes before reinforcement givenreinforcement given

Rate of Rate of Reinforcement:Reinforcement:

FixedFixed If time or # of If time or # of

responses is responses is constantconstant

VariableVariable If time or # of If time or # of

responses is randomresponses is random

4 Schedules of Partial 4 Schedules of Partial ReinforcementReinforcement

Fixed-RatioFixed-Ratio Reinforcement Reinforcement

occurs after specific, occurs after specific, unchanging # of unchanging # of responses.responses.

Variable-RatioVariable-Ratio Reinforcement Reinforcement

occurs after occurs after unpredictable # of unpredictable # of responses.responses.

Fixed-IntervalFixed-Interval Reinforcement Reinforcement

occurs after set amt occurs after set amt of timeof time

Variable-IntervalVariable-Interval Reinforcement Reinforcement

occurs at occurs at unpredictable time unpredictable time intervalinterval

ActivityActivity Schedules of ReinforcementSchedules of Reinforcement

ActivityActivity Operant PracticeOperant Practice

(Principles and Reinforcement (Principles and Reinforcement Schedules)Schedules)

ClosureClosure What is the difference between What is the difference between

operant and classical conditioning?operant and classical conditioning?