Operant conditioningOperant conditioning

More on reinforcement and More on reinforcement and beyondbeyond

Certain materials in this presentation are included under The Fair Certain materials in this presentation are included under The Fair Use exemption of the U.S. copyright Law and should not be Use exemption of the U.S. copyright Law and should not be reproduced without the permission of the copyright holder.reproduced without the permission of the copyright holder.

Operant ConditioningOperant Conditioning

The kind of learning that The kind of learning that applies to voluntary behavior applies to voluntary behavior in animals and peoplein animals and people

Skinner and the Skinner Skinner and the Skinner BoxBox Skinner is a behavioristSkinner is a behaviorist He followed ThorndikeHe followed Thorndike

– Law of EffectLaw of Effect If an action is followed by a pleasurable If an action is followed by a pleasurable

consequence, it will tend to be repeatedconsequence, it will tend to be repeated

– We learn how to function in lifeWe learn how to function in life

ReinforcementReinforcement

““What is in it for me”What is in it for me” To strengthenTo strengthen Contributes to behaviorContributes to behavior Follows a behavior, the Follows a behavior, the

behavior will more likely behavior will more likely happen againhappen again

The BoxThe Box

Primary ReinforcerPrimary Reinforcer

Fulfills a basic needFulfills a basic need– WaterWater– Food- a candy bar Food- a candy bar – Comfort – praiseComfort – praise

Can easily be used with toddlers, young Can easily be used with toddlers, young children and animalschildren and animals

Removing pain can be a primary Removing pain can be a primary reinforcementreinforcement

Secondary reinforcerSecondary reinforcer

These must first beThese must first be paired with primarypaired with primary reinforcers to promptreinforcers to prompt increases in behaviorsincreases in behaviors

– money money

Positive ReinforcementPositive Reinforcement

Response followed by a pleasurable Response followed by a pleasurable consequence will increase the consequence will increase the response happening againresponse happening again

Negative Negative ReinforcementReinforcement Removal of something unpleasantRemoval of something unpleasant

Getting Pain to stopGetting Pain to stop

Reinforcement Reinforcement schedulesschedules Two different types of basic Two different types of basic

reinforcement schedules:reinforcement schedules:

Continuous-RContinuous-Reinforcementeinforcement

follows every correct follows every correct

responseresponse

Reinforcement Reinforcement schedulesschedules Partial schedules Partial schedules – – only only

occasional correct responses are occasional correct responses are reinforcedreinforced

Partial ReinforcementPartial Reinforcement

Reinforcement after some of the Reinforcement after some of the behaviorbehavior

Very resistant to extinctionVery resistant to extinction More true to real lifeMore true to real life Completed in different patternsCompleted in different patterns

The allure of intermittent The allure of intermittent reinforcementreinforcement

Continuous Reinforcement Continuous Reinforcement quickly succumb to extinctionquickly succumb to extinction

Intermittent Reinforcment Intermittent Reinforcment are are quite resistant to extinctionquite resistant to extinction

LottoLotto That unpredictable That unpredictable

boyfriend/girlfriend boyfriend/girlfriend

Interval ScheduleInterval Schedule

Timing of the response is more Timing of the response is more importantimportant– An event happening once in a An event happening once in a

certain amount of timecertain amount of time

Ratio ScheduleRatio Schedule

Certain amount of responses is Certain amount of responses is required for each reinforcerrequired for each reinforcer

Fixed Interval Fixed Interval ScheduleSchedule Reinforcement delivered after a Reinforcement delivered after a

fixed amount of timefixed amount of time Slow responseSlow response Quicker responsesQuicker responses

right beforeright before

reinforcement reinforcement

Variable intervalVariable interval

Reinforcement delivered after a Reinforcement delivered after a varying amount of timevarying amount of time

UnpredictableUnpredictable Responses are made at Responses are made at

a slow and steady ratea slow and steady rate An astronomer looking for An astronomer looking for

cometscomets

Fixed ratioFixed ratio

Provide reinforcement after only Provide reinforcement after only a fixed number of correct a fixed number of correct responsesresponses

Marked by a steady response rateMarked by a steady response rate If many responses are needed to If many responses are needed to

secure reinforcement, a pause secure reinforcement, a pause follows reinforcementfollows reinforcement

Variable ratioVariable ratio

Reinforcement provided after Reinforcement provided after a variable amount of a variable amount of responsesresponses

Marked by steadyMarked by steady response ratesresponse rates Playing slot machines, lotto, Playing slot machines, lotto,

other types of gamblingother types of gambling

Stimulus generalizationStimulus generalization

Somewhat similar to classical Somewhat similar to classical conditioningconditioning

If a certain response/behavior If a certain response/behavior received reinforcement in a received reinforcement in a certain situation, you are certain situation, you are likely to make the same likely to make the same response in a similar situationresponse in a similar situation

discriminationdiscrimination

Some responses gain reinforcement, Some responses gain reinforcement, others don’tothers don’t

As you would expect, those that gain As you would expect, those that gain reinforcement will be much more likely reinforcement will be much more likely to be repeatedto be repeated

We learn to chose or We learn to chose or discriminate discriminate between the twobetween the two

Discriminative stimuliDiscriminative stimuli

Any stimulus that provides an Any stimulus that provides an organism with a organism with a cue cue for for making a certain response in making a certain response in orderorder

to obtain reinforcementto obtain reinforcement Stop signsStop signs Warm smiles/ eye contactWarm smiles/ eye contact Or a frownOr a frown

PunishmentPunishment

Different than reinforcementDifferent than reinforcement– Positive reinforcementPositive reinforcement

Adds something pleasurableAdds something pleasurable– Candy, money, privilegesCandy, money, privileges

– Negative ReinforcementNegative Reinforcement Removes something painfulRemoves something painful

– Clean room so mom stops naggingClean room so mom stops nagging– Give baby bottle to stop cryingGive baby bottle to stop crying

PunishmentPunishment

Opposite of reinforcementOpposite of reinforcement– Weakens the responseWeakens the response– Takes awayTakes away

Two formsTwo forms– ApplicationApplication

Spanking, yelling, anything unpleasantSpanking, yelling, anything unpleasant

– RemovalRemoval Something pleasant is taken awaySomething pleasant is taken away

Problems with Problems with PunishmentPunishment Punishment gets forgottenPunishment gets forgotten Might avoid punisherMight avoid punisher May encourage lyingMay encourage lying Creates fearCreates fear May provide a role model of May provide a role model of

aggressive behavioraggressive behavior

ShapingShaping

•Small steps to ultimate goalSmall steps to ultimate goal•Reinforce the most simple of Reinforce the most simple of stepssteps

Latent LearningLatent Learning

Learning that occurs but is not Learning that occurs but is not immediately reflected in a immediately reflected in a behavior changebehavior change

Observational learningObservational learning

Learning new behavior through Learning new behavior through watching the actions of a modelwatching the actions of a model– We might like what we seeWe might like what we see– Or not Or not

Bandura’s contributionBandura’s contribution

Albert Bandura realized that Skinner’s Albert Bandura realized that Skinner’s framework was incompleteframework was incomplete

We learn from watchingWe learn from watching

the behavior of othersthe behavior of others

not just enduring thenot just enduring the

consequencesconsequences

of our ownof our own

imitationimitation

Poor Bobo, the adult cursed and Poor Bobo, the adult cursed and beat on himbeat on him– The children that watchedThe children that watched

Repeated those actionsRepeated those actions

Happy Bobo, the adult did not Happy Bobo, the adult did not interact with Bobointeract with Bobo– The Children that watchedThe Children that watched

The kids did not interact with BoboThe kids did not interact with Bobo

Vicarious Vicarious consequencesconsequences

If the children watched the adult If the children watched the adult being disciplined for pounding being disciplined for pounding BoboBobo– they didn’t rough him upthey didn’t rough him up

They had somehow vicariously They had somehow vicariously experienced the adult’s experienced the adult’s punishment and the behavior punishment and the behavior never emergednever emerged

Vicarious Vicarious reinforcementreinforcement

Powerball winnersPowerball winners Are they hidden?Are they hidden? No, they are celebrated No, they are celebrated We share in their triumph We share in their triumph We can’t wait for our chanceWe can’t wait for our chance How about all those who lost big?How about all those who lost big?

Self efficacySelf efficacy

““self esteem”self esteem”– We have to believe that we also can We have to believe that we also can

perform the behaviorperform the behavior

Self efficacy iiSelf efficacy ii

The belief that you yourself could The belief that you yourself could perform the task successfullyperform the task successfully– A key factor in maximizing potentialA key factor in maximizing potential– If we believe, we will:If we believe, we will:

1) start the process,1) start the process,

2) persist despite obstacles, 2) persist despite obstacles, andand

3) finish successfully3) finish successfully

Encouraging moral Encouraging moral behaviorbehavior

““Catch them when Catch them when they are being they are being good”?good”?

Moral behavior rarely occurs Moral behavior rarely occurs spontaneouslyspontaneously

So, we teach it through …..So, we teach it through …..

modelingmodeling

We imitate those we view We imitate those we view as:as:

1) Powerful,1) Powerful,

2) Successful,2) Successful,

3) Similar to us, and3) Similar to us, and

4) Warm/Kind.4) Warm/Kind.

Modeling iiModeling ii

We find an individual or character We find an individual or character who fits these criteria and then who fits these criteria and then we show them displaying the we show them displaying the desired qualitydesired quality

It It might might make an impression make an impression