50
How Dogs Learn HSHV Volunteer Continuing Education Jan. 28, 2018 Angela Schmorrow, CPDT-KA

How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

How Dogs Learn HSHV Volunteer Continuing EducationJan. 28, 2018

Angela Schmorrow, CPDT-KA

Page 2: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Agenda

How animals learn: science of learning theory

Making training decisions

Using positive reinforcement effectively

Empowerment-based training

Case study

Page 3: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

The Science:How Animals Learn

Page 4: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

What is Behavior “For”?

Changing one’s environment

Getting needs met

Communication

Not inherently “good” or “bad”

Page 5: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Unlabel Me

Think beyond “reactive,” “aggressive,” “fearful,” “hyperactive,” “stubborn,” etc.

What is the animal actually doing?

Behavior is modifiable using scientifically-established principles

Page 6: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

How do dogs learn?

By association (Classical Conditioning) What is safe? What is scary?

By consequences (Operant Conditioning) What happens when I do this?

Page 7: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Classical Conditioning

Creating an association between two stimuli Primary/unconditioned – animal doesn’t need to learn to like or

dislike it (food, pain)

Secondary/conditioned – animal learns to react to it based on its association with the primary stimulus

This is occurring ALL the time.

Page 8: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Pavlov’s dogs:

Food triggers salivation

Bell began predicting food

Soon, bell alone could trigger salivary response normally only caused by food.

Food Salivation

Bell Food Salivation

Bell Salivation

Page 9: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Operant Conditioning

Forming an association between a behavior and a consequence.

Triggered by an antecedent in the environment.

Behavior is changed by changing the antecedent or consequence.

Antecedent Behavior Consequence

Page 10: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Four Possible Consequences

Reinforcement(behavior increases)

Punishment(behaviordecreases)

Positive(something is added)

Positive Reinforcement:Something added increases behavior

PositivePunishment:Something added decreases behavior

Negative (something is taken away)

NegativeReinforcement: Something removed increases behavior

Negative Punishment:Something removed decreases behavior

Page 11: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

You don’t need to remember all the technical terms . . .

Just ask: Do I want to stop this behavior, or make it continue?

Am I going to give the dog something he likes, or do something to him he doesn’t like?

Page 12: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Dog training examples

Reinforcement(behavior increases)

Punishment(behaviordecreases)

Positive(something is added)

Dog sits and is given a treat (+R)

Dog jumps on guest and is kneedin the chest (+P)

Negative (something is taken away)

Handler shoves dog’s rear down until dog sits on ground(-R)

Dog receives no attention and is ignored when jumps on guests (-P)

Page 13: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

How Do We Choose?

All four quadrants work – all can change behavior.

But there are important issues to consider when choosing which method to use . . .

Page 14: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Reinforcement vs. Punishment

Reinforcement BUILDS behavior. Behaviors that are reinforced become inherently rewarding on

their own.

Example: Dog that is reinforced enough for going to a mat will begin to seek out that mat to relax on, even on his own.

Punishment TEMPORARILY stops behavior. Behavior may even stop for a long time, but in the absence of

punishment, it will reappear, and require additional punishment.

Page 15: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

The Problems With Punishment

Requires impeccable observation skills and timing that most of us don’t have. (Too easy to correct your dog for the wrong thing)

Desensitization: learners become used to a level of punishment, so require harsher punishments over time to be effective. How many of us really want to do this?

Using punishment is like dropping a bomb: imprecise and unpredictable

Remember the lessons of classical conditioning – a punished dog may associate anything in its environment at the time with the punishment, including you. Common fallout from punishment: increased fear, aggression, and

anxiety

Something doesn’t have to be painful to be aversive.

Avoidance: dogs try to prevent punishment from happening by stopping all behaviors, which ultimately slows learning.

We’re not solving the underlying problem. It’s like pushing down a beach ball in the water. Sooner or later, it’s going to pop up somewhere!

Page 16: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Advantages of Positive Reinforcement

Creates eager learners who enjoy the behaviors being taught (classical conditioning at work again)

Builds a relationship between teacher and learner

Mistakes do no harm (just a couple extra calories for the “oops” cookies!)

Creates strong behaviors

Easier to focus on what we DO want than all the things we DON’T. Rather than punishing a behavior, we can replace it with

something better (sitting instead of jumping)!

Creates positive associations

Page 17: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

“Pavlov is always sitting on your shoulder.”

Page 18: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes
Page 19: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Shelter Example: Dog Jumping on Walker in Kennel

Basic Needs: Has dog been able to eliminate recently?

Is kennel dry and clean?

Does dog feel safe in kennel?

Antecedent Arrangements: change the environment to promote a different behavior Toss treats on ground before entering, cheese whiz on floor or wall

Page 20: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Shelter Example: Dog Jumping on Walker in Kennel

Positive reinforcement: reinforce dog when feet remain on ground

Reinforcement of alternate behavior: teach dog to sit when walker touches kennel door and enters

Negative Punishment: Ignoring dog, leaving kennel when jumps (NOTE: This can still be very frustrating for the dog, and therefore aversive!)

Page 21: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

What DON’T we want to do?

Negative Reinforcement: Shout at dog continuously until stops jumping

Positive Punishment: Shoving dog down, spray bottle, shaker can, kneeing in chest, etc.

What could happen if we did these things? How does dog feel about walks? About people?

Page 22: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Do “difficult dogs” really need a heavier hand?

Not if our goal is to solve underlying problems or to prevent problems from getting worse

Let’s go back to learning theory Reinforcement builds behavior

Punishment temporarily suppresses behavior and can have fallout that will make things worse/more dangerous

Animals are constantly making associations. Not enough to stop a behavior – need to also change the emotional response.

Same for all animals, and all behaviors regardless of severity

Page 23: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

"From both a practical and a personal point of view, perhaps the most significant thing to remember about the first side effect of coercion is that people who use punishment become conditioned punishers themselves . . . All the side effects that shocks generate, we, too, will generate. Anyone who uses shock becomes a shock." - Murray Sidman, "Coercion and Its Fallout"

Page 24: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

The Art:Teaching Behaviors

Page 25: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Get the Behavior!

Capturing: Catch the animal naturally doing the behavior Advantages: Useful for behaviors that are offered frequently (sit), or that are

natural behaviors that may be hard to elicit otherwise (stretching).

Considerations: Need to be prepared and observant. May capture unintended behaviors.

Luring: Using food to lead animal into desired position. Advantages: Fast way to get certain behaviors.

Considerations: Animal may be following food, not as aware of behavior. Need to get food out of hand quickly or food may become the cue for the behavior.

Shaping: Rewarding successive approximations (baby steps) on the path to the desired behavior. Advantages: Builds strong behaviors. Empowering. Can get complicated

behaviors that you couldn’t elicit otherwise.

Considerations: Requires higher level of trainer skill (observation skills and mechanics)

Page 26: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

How does dog know what behavior earned the reward?

Reward Markers Communication tool that has already been associated with a

primary reward (food, toys)

Examples: clickers, saying “yes”, thumbs up signal for deaf dogs, touch on specific part of body for deaf/blind dogs.

Reward marker indicates the behavior that we are looking for –reward still will always follow.

Used for teaching a new behavior. Not necessary once dog understands.

Page 27: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Get it on Cue!

Cue: Signal to the dog to perform the new behavior.

Five Dollar Rule: When you will bet $5 that the dog will perform the behavior, then add a cue.

Physical Cues Often first learned

May come naturally from what we were doing to elicit behavior (ex. Hand lure towards the ground for down, body position).

Verbal Cues Must be given right before you would expect dog to perform the

behavior.

Page 28: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Generalization and Proofing

Can animal perform behavior in different contexts, settings, etc.?

When one element gets harder, may need to back up and reduce criteria (reward more frequently, less duration, etc.)

Page 29: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

“It is effortful to train for situations you don’t normally have to cope with.” – Susan Friedman

Page 30: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Dealing with Incorrect Responses

Plan A: Be proactive and set dog up for success! Manage environment, split behaviors, reinforce

Calmly interrupt if necessary (the behavior is dangerous, destructive, self-rewarding, etc.) Removing reinforcement is enough – no need for “NO!” or other

corrections

Change the environment Lower criteria after more than 2 incorrect responses Behavioral momentum: Ask for a highly likely behavior (a

favorite trick, etc.) before continuing Increase rate of reinforcement and/or value of reward

Page 31: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

What if it isn’t working?

Basic physiological needs must be met Health Food

SAFETY! If these needs aren’t met, most of dog’s behavior will be about trying

to get them met. They aren’t in a place to learn new things – they are trying to survive.

The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes.

Need to identify ways that dogs still get reinforcement for undesired behaviors. Example: petting the dog that is jumping up on you.

Dog unable to determine what is relevant in environment.

Page 32: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Empowerment-Based Training:

The Power of Choice in Training

Page 33: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Importance of Choice

“Being able to choose what to do, freely and without compulsion, is an incredibly important aspect of life.” - Irith Bloom

“The power to control one’s own outcomes is essential to behavioral health, and the degree to which a behavior reduction procedure preserves learner control is essential to developing a standard of humane, effective practice.” - Susan Friedman

Animals need to have opportunities to make choices, and see that their behaviors can control the outcomes.

If you remove choice and predictability, effects can include anxiety, stress, depression, and decreased immune function as well as other problems.

What choices are already taken away from dogs?

Page 34: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Choice-Based Training

Create situations where dog can make a decision

Make it easy/desirable to perform the decision you like

Control access to the rewards so that undesired behaviors won’t get rewarded

Reward the decisions you like

Wait! As long as something isn’t destructive, dangerous, or rewarding to the dog, have patience to let them figure out what will work instead.

Page 35: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Shelter Case Study:Fish

Page 36: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Why Would We Train Dogs in the Shelter?

Teach desired behaviors

Modify behaviors that may be undesirable

Build confidence

Create predictability

Form relationships

Mental enrichment

Page 37: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

“Animals deserve the best care we can possibly provide. Training should not be considered a luxury that is only provided if there is time; it is an essential part of good animal care. Just as one would never consider developing an animal care program without a veterinary component, a nutritional component, a social component, and an environmental component, nobody should consider caring for an animal without a behavioral management component integrated into the program” -Ken Ramirez

Page 38: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Fish

Adult male lab mix

Transferred to Michigan shelter from high-kill animal control in southern state

No history

Heartworm positive and intact at time of intake

Scarring on ears from excessive fly bites, thick scarring around neck (history of embedded collar?)

Fearful and avoidant of staff, growling at some male staff

Page 39: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Notes from first attempt to assess:

“Unable to test today - too fearful. Ran from me in exterior kennel, tail tucked, body low, wide eyed. M. leashed up and brought into real life room. Paced and stood at door - very stressed. Would take treats I dropped but not from hand. Would avoid if I tried to touch.”

Page 40: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

First two weeks:

Worked on pure desensitization/counter conditioning – tossing treats from outside kennel.

Eventually would approach and allow me to leash and take out.

Other than leashing, would avoid any contact. Startled, cowered and fled with any slight movement.

Page 41: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Started Clicker Training

Worked on shaping two foundation behaviors: settle on mat and hand target

Goal was to build relationship with him where he was empowered to make decisions and earn reinforcement.

His behaviors mattered and he could control the interaction.

Predictable ways of engaging with a person.

Page 42: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Go to Mat, First Session:

Clicking for any movement toward or on to the mat, then remaining there.

Treat delivered on mat.

Re-set cookies after several seconds.

Page 43: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Go to Mat: Second Session

Waiting for body fully standing on mat.

Page 44: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Go to Mat: Third Session

Shaping a default sit, building to a down.

Page 45: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Go to Mat: Fourth Session

Settling in down position on mat.

Now use this as his “consent” behavior to work on DS/CC to my movement. Begin standing up and moving gradually.

If he stands up, I will sit back down.

Empowers him to communicate if he is ready.

Page 46: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Hand Target

Goal: shape Fish to touch nose to my hand as a way to voluntarily approach, take in information, and interact with me.

The problem: Any movement of my hand would cause a fear/avoidance response.

Fish began HW treatment and subsequently came down with kennel cough. Could not go to play yards due to treatment, or to real life room due to his infection. Worked with kennel door between us, which made my hand less intimidating to him.

Page 47: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Fish Now

Was able to be assessed, did well, and is up for adoption.

Approaches all staff and others eagerly for attention.

Continuing to work on settling on mat during movement and environmental change.

Working on chin rest behavior as consent for touching for husbandry.

Shaping games.

Page 48: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

What Did Fish Learn?

A couple basic skills

That people equal good things

That his behaviors and choices matter

That he can control his environment

Page 49: How Dogs Learn - HSHV...The dog decides whether something is reinforcing or not. If a behavior is not increasing, the reward is not really a reward. Need to know what the dog likes

Recommended Reading

Karen Pryor, “Reaching the Animal Mind.”

Karen Pryor, “Don’t Shoot the Dog.”

Patricia McConnell, “The Other End of the Leash”

Grisha Stewart, “The Ahimsa Dog Training Manual” and “Behavior Adjustment Training 2.0”

Pamela Reid, “Excel-erated Learning: Explaining How Dogs Learn and How Best to Teach Them.”