Operant ConditioningOperant Conditioning
Unit 7Unit 7Lesson 2Lesson 2
ObjectivesObjectives Describe and apply components of Describe and apply components of
operant conditioning.operant conditioning. Identify B.F. Skinner.Identify B.F. Skinner. Analyze uses and effectiveness of Analyze uses and effectiveness of
reinforcement and punishment.reinforcement and punishment. Describe reinforcement schedules.Describe reinforcement schedules.
Warm UpWarm Up
What is learning?What is learning?
Relatively Relatively permanent change permanent change in behavior that in behavior that results from results from experience.experience.
Review of Prior LearningReview of Prior Learning You always talk to your (boy/girl) friend while You always talk to your (boy/girl) friend while
sitting in your beanbag chair. After an ugly sitting in your beanbag chair. After an ugly breakup, you find that even looking at the chair breakup, you find that even looking at the chair upsets you, so you give it to Goodwill.upsets you, so you give it to Goodwill.
Identify the NS-UCS-UCR-CS-CRIdentify the NS-UCS-UCR-CS-CR What would be occurring if you couldn’t sit in any What would be occurring if you couldn’t sit in any
chair while talking on the phone?chair while talking on the phone? What if you only refused to sit in beanbag chairs?What if you only refused to sit in beanbag chairs? What if you go away to college and your What if you go away to college and your
roommate has a chair that makes you chuckle as roommate has a chair that makes you chuckle as you sit in it and think about the story?you sit in it and think about the story?
And this can only occur after it’s gone away And this can only occur after it’s gone away which is called?which is called?
Classical vs. Operant Classical vs. Operant ConditioningConditioning
ClassicalClassical
Environment Environment provides the provides the stimulus and the stimulus and the subject responds.subject responds.
OperantOperant
Environment Environment responds to the responds to the subject’s behavior subject’s behavior (stimulus).(stimulus).
Edward ThorndikeEdward Thorndike
Thorndike’s Law of Thorndike’s Law of EffectEffect Rewarded behavior Rewarded behavior
likely to recurlikely to recur
B.F. SkinnerB.F. Skinner
Behavior Behavior influenced by influenced by history of its history of its consequencesconsequences
Skinner BoxSkinner Box
ShapingShaping Reward behaviors close to the Reward behaviors close to the
behavior he was looking for until behavior he was looking for until animal performed desired behavior.animal performed desired behavior.
Operant ConditioningOperant Conditioning RewardReward A.k.a. Positive A.k.a. Positive
ReinforcementReinforcement
Actions taken that Actions taken that result in result in consequencesconsequences
Behavior Behavior moremore likely to occur againlikely to occur again
PunishmentPunishment
Actions taken that Actions taken that result in result in consequencesconsequences
Behavior Behavior lessless likely likely to occur againto occur again
Operant ConditioningOperant Conditioning Negative Negative
ReinforcementReinforcement
Actions taken to Actions taken to avoid punishmentsavoid punishments
Behavior Behavior moremore likely to occur likely to occur againagain
Omission TrainingOmission Training
Actions taken which Actions taken which result in something result in something being taken away being taken away
Behavior Behavior lessless likely likely to occur againto occur again
Operant Conditioning ChartOperant Conditioning Chart
PositivePositiveReinforcementReinforcement
PunishmentPunishment
OmissionOmissionTrainingTraining
NegativeNegativeReinforcementReinforcement
Pleasant Aversive
+
_
ActivityActivity Introduction to Operant Conditioning Introduction to Operant Conditioning
“problems”“problems”
When you’ve worked your way through When you’ve worked your way through the problem, identify which principle of the problem, identify which principle of
operant conditioning is at work.operant conditioning is at work.( +R, -R, OT, P)( +R, -R, OT, P)
Closure Day 1Closure Day 1 Use all 4 principles of operant Use all 4 principles of operant
conditioning to describe how you’d get conditioning to describe how you’d get a child to eat spinach without a child to eat spinach without
complaining.complaining.
Premack Principle- Use more preferred Premack Principle- Use more preferred activity to motivate you to do less activity to motivate you to do less
preferred activitypreferred activity
Day 2 Warm UpDay 2 Warm Up What’s the difference What’s the difference
between classical and between classical and operant conditioning?operant conditioning?
Classical-subject Classical-subject responds to responds to environmentenvironment
Operant – environment Operant – environment responds to subject’s responds to subject’s behavior.behavior.
ReviewReview Which principle of operant Which principle of operant
conditioning…conditioning…
Presents something unpleasant?Presents something unpleasant? Takes something pleasant away?Takes something pleasant away? Takes something unpleasant away?Takes something unpleasant away? Presents something pleasant?Presents something pleasant?
Types of ReinforcersTypes of Reinforcers
Primary ReinforcerPrimary Reinforcer Value doesn’t need Value doesn’t need
to be learned.to be learned. Satisfies basic Satisfies basic
human need.human need. Ex: Food, sleepEx: Food, sleep
Secondary Secondary ReinforcerReinforcer Value has to be Value has to be
learnedlearned Without conditioning, Without conditioning,
it would have no +/- it would have no +/- valuevalue
Ex: $, Praise, Hug, Ex: $, Praise, Hug, GradesGrades
Providing ReinforcementProviding Reinforcement
Continuous Continuous ReinforcementReinforcement Reinforcement Reinforcement
given every time given every time desired behavior desired behavior occursoccurs
Partial Partial ReinforcementReinforcement Reinforcement only Reinforcement only
given sometimes given sometimes after desired after desired behavior occurs.behavior occurs.
Online ActivityOnline Activity PsychSim 5.0 “Operant Conditioning”PsychSim 5.0 “Operant Conditioning” http://www.worthpublishers.com/expl
oring5e/content/psychsim5/Operant%20Conditioning/PsychSim_Shell.html
This activity will review classical and This activity will review classical and operant conditioning and introduce operant conditioning and introduce you to schedules of reinforcement.you to schedules of reinforcement.
4 Schedules of Partial 4 Schedules of Partial ReinforcementReinforcement
Ratio ScheduleRatio Schedule # of correct # of correct
responses subject responses subject makes between makes between reinforcementreinforcement
Interval ScheduleInterval Schedule Amt of time that Amt of time that
passes before passes before reinforcement givenreinforcement given
Rate of Rate of Reinforcement:Reinforcement:
FixedFixed If time or # of If time or # of
responses is responses is constantconstant
VariableVariable If time or # of If time or # of
responses is randomresponses is random
4 Schedules of Partial 4 Schedules of Partial ReinforcementReinforcement
Fixed-RatioFixed-Ratio Reinforcement Reinforcement
occurs after specific, occurs after specific, unchanging # of unchanging # of responses.responses.
Variable-RatioVariable-Ratio Reinforcement Reinforcement
occurs after occurs after unpredictable # of unpredictable # of responses.responses.
Fixed-IntervalFixed-Interval Reinforcement Reinforcement
occurs after set amt occurs after set amt of timeof time
Variable-IntervalVariable-Interval Reinforcement Reinforcement
occurs at occurs at unpredictable time unpredictable time intervalinterval
ActivityActivity Schedules of ReinforcementSchedules of Reinforcement
ActivityActivity Operant PracticeOperant Practice
(Principles and Reinforcement (Principles and Reinforcement Schedules)Schedules)
ClosureClosure What is the difference between What is the difference between
operant and classical conditioning?operant and classical conditioning?