Sandra Poppema from HippoLogic
12mo ago
This happens when you expect positive reinforcement (R+) to be similar to or the same as negative reinforcement training (R-).
If you just came across this post, please read part 1, part 2 and part 3 first. Only then does this article make sense.
2 Phases of Negative Reinforcement (R-) Horse Training
Click here to access my previous post, in which I explain this in detail.
5 Phases of Positive Reinforcement (R+) Horse Training
Learn more about phase 4 here.
Phase 5: Stimulus Control (SC) and Other Criteria
SC is fancy jargon to indicate that the horse reliably performs a specific behaviour in response to a distinct cue and does not perform it in the absence of the cue, or in response to other cues.
In this phase, we're crossing the t's in our training.
We train for stimulus control.
3 D's of Advanced Training
We train the 3 D's. This is advanced training.
The first D stands for Duration. We ask our horse to hold up his leg longer.
If we're training walk, trot or canter, we train more than a few steps. We want the horse to keep going until he receives a different cue.
The second D stands for Distractions. This means sprinkling in distractions without losing our horse's attention.
If the behaviour calls for it, we'll practise cueing our horse from a Distance.
We ask our horse to 'stand' while we're walking away to get something. the distance between horse and trainer increases. Often horses want to follow us, so this can be a challenging criterion.
Context Shifts
We train for context shifts, so that the behaviour is strong no matter the environment, or what happens around him.
Trailer loading goes just as well at home, as after a 3-day intentive clinic or after a scary trail ride enountering fireworks and plastic bags.
This phase requires a lot of skill from the trainer!
Novice or sloppy trainers will not reach this level of training, but I believe that anyone can accomplish this phase.
I love teaching this phase to horse owners, because this is the super fancy, very advanced training!
Stimulus Control explained
The horse performs the behavior every time the cue is given: A horse will touch a target every time he hears the word "Target" and not just sometimes.
The horse does not perform the behavior if the cue is not given: A horse will not touch his target, when the target is lying on the ground or when you walk by the pylon. Unless you gave the "Target"-cue.
The horse does not perform the behavior in response to other cues: The horse will not (try to) touch the target when you ask to "Walk on" or cue another behaviour.
The horse does not perform any other behavior when the cue is given: When you say "Target," the horse touches the target gently with his nose, and won't offer a head lowering or tries to kick it with his foot instead.
I think it's very hard to get 100% stimulus control in horses, for all behaviours.
Other species, like dogs are easier to get to this level.
Maybe because we spent more time with our dogs (8-16 hours a day) than our horses (1-2 hours a day, including doing chores, like mucking).
Context Shifts: The Final Phase in Clicker Training
In order to get a reliable horse, we need to train the behaviour in different environments. It's related to the 3rd bullet point under stimulus control.
Horses are really good 'context learners'.
They come and greet you in the pasture, but not when you're holding a halter. They like you, but the halter represents something different...
Your horse is forward under saddle, but without a whip not so much...
The horse loads perfectly every time at home. But after a lesson, when you want to go home it takes an hour to get him in.
You don't understand why your horse doesn't listen! "He knows what to do!" Right?
Wrong!
You haven't trained the behaviour in a different envionment. Horses take the environmental cues seriously. It makes them such good guessers.
We have to practise the behaviour in as much different circumstances and environments as possible.
Until the horse learns to generalize the behaviour.
Generalisation as part of the R+ Training Process
Generalisation is achieved through a gradual process of proofing, where the trainer introduces new variables one at a time. it's important to lower some other criteria when asking the behaviour in a new environment.
For example, start clicking for putting one foot on the loading ramp of the trailer when your loading your horse away from home. This will give him confidence about what to do.
Once a horse has generalized one behaviour, the process will go much faster with other behaviours as well.
Getting Stuck in Phase 5
Usually the expectations of the trainer are way too high. We get disapponted. Frustrated! We think the horse 'knows to get into the trailer' because he does so well at home. We forget to see it from our horse's perspective.
Now the trailer is in a different environment, and the circumstances are different, it is different.
We often forget how much unnatural things we ask from our horse. Self preservation is a highly developed survival behaviour in horses.
When we load our horse during the day, the trailer looks different at night. It's bright inside! At mnight you want to see your surroundings. That's when the predators hunt! No one wants to go into a trap, where escape is not possible.
Similar thing happens on a bright, sunny day.
Inside the trailer it's dark. Horse's eyes (pupils) don't adjust as fasts as human eyes do. So as soon as the horse has his head in the trailer, he experiences it as a dark hole! Scary!
He flies out!
You ask yourself "Why?" It's my own trailer. He's used to it.
Know your Learner! His behaviour, his physiological traits, his learning processes.
Train the behaviour in as much different environments and in as much differents scenario's possible. That's how you get a well-behaviour horse that you can count on.
In every situation.
Even the most unexpected ones. That's the partnership you want to accomplish so you can be safe at all times!
Sandra Poppema from HippoLogic
12mo ago
Traditional training is based on negative reinforcement (R-). Taking away an aversive to strengthen a behaviour.
R- has only 2 phases in the training process, while R+ has 5 (!) phases before a behaviour is trained solidly.
You expect to reach your goal after two steps in the process. Yet, the process has five steps. This causes frustration and disappointment.
2 Phases of Negative Reinforcement (R-) Horse Training
Click here to access my previous post, in which I explain this in detail.
5 Phases of Positive Reinforcement (R+) Horse Training
Now that you're fully caught up, let's talk about phase 4.
This part of training is also often ignored.
Probably because most people don't know about it. Here's what you need to know about the second to last step in successful clicker training.
Phase 4: Fading Out Training Tools
This phase is often skipped by novice clicker trainers. Here's what you need to know about how horses learn.
Horses are really good context learners.
A target means: touch. The target becomes the trigger, the (environmental) cue for the horse. It usually means the same thing: touch lead to treat.
Halters means: clicker training (Yeey!).
Pylons mean 'touch with the nose'.
You get the drift.
Natural horsemanship trainers mean aversives.
Vets mean injections.
Farriers mean being restricted and being hold down.
Horses learn to pay attention to the environment and context. These become part of the expectation.
Training tools become part of your cue
This can be beneficial if used deliberately. If it happens unconciously, our training tool becomes a crutch.
You test your verbal cue and point, but your horse only pays attention to your feet: if they move, he must do the same.
We can't get our horse out of the pasture without a treat pouch.
Your horse won't trot if we're not holding a moving target in front of him.
The horse won't stand without his feet touching a mat.
Your horse is missing the context. His guesses go flat. He's in trouble. He needs more information! The trainer gets confused about why the horse 'isn't listening'...
Getting Stuck in Phase 4
When we skip phase 3: only reinforcing the behaviour after we cued it, we create Good Guessers. The horse will keep touching the target, because the trainer is inconsistent.
Intermittent reinforcement schedule
Some days the horse will get reinforced for touching the target with out a cue. "Oh, so cute..." Or, we laugh (positive attention!!) and we don't realize that we are reinforcing spontaneously offered behaviour!
Other days it's irritating that our horse tries to toucht the target! We didn't ask for it! We ignore the behaviour...
We don't see that we just used an intermittent reinforcement schedule and... thus strengthened the "touch target' behaviour without a cue.
Tools become crutches instead of 'information'
The other common pitfall is that our training tools become crutches. the horse doesn't pay attention to the trainer's cue. The horse is either guessing what to do, or only pays attention to the training tool (clicks, treat pouch, target stick etc).
Without the training tool, the horse is lost. He gets frustrated or opts out. That's when we get frustrated. We see the problem, but can't find a solution because we're missing an important piece.
How horses learn. The Principles of Learning & MOtivation. With that piece in hand, we can solve all struggles in training.
Phase 5: the final phase in clicker training behaviours
Stay tuned for tomorrow's post. I will give you the final phase of training with positive reinforcement. If you enjoyed this, you'll love tomorrows solution!
Sandra Poppema from HippoLogic
12mo ago
Traditional training is based on negative reinforcement (R-). Taking away an aversive to strengthen a behaviour.
R- has only 2 phases in the training process, while R+ has 5 (!) phases before a behaviour is trained solidly.
You expect to reach your goal after two steps in the process. Yet, the process has five steps. This causes frustration and disappointment.
2 Phases of Negative Reinforcement (R-) Horse Training
Click here to access my previous post, in which I explain this in detail.
5 Phases of Positive Reinforcement (R+) Horse Training
Some people claim that positive reinforcement (R+) training doesn't work for their horse.
Or, they don't want to 'keep giving treats'. Or are afraid their horse turns into a pushy, mugging, 'cookie monster'.
Here's what they don't know...
When Clicker Training Doesn't Work
People often get stuck in training. Heck, I get stuck from time to time. That's normal, for anyone, in any learning process.
Some animals are so traumatized that they are not ready yet for clicker training. They need to trust you first.
Do not Clicker Train Fearful or Agressive Horses
I didn't know that there was a protocol I could use for fearful or aggressive horses. I only learned that 5 years ago. I have been clicker training for 20!
There is always more to learn. That's my motto.
When "clicker training" doesn't work, it means that the trainer needs to adjust!
You're unknowingly skipping a step, or lack knowledge. Outside eyes, that are more experienced will help you see this.
The horse can be too traumatized to learn. Trust needs to be established first, before (positive reinforcement) training starts. A horse in fight- or flight mode is not in learning mode!
He's in survival!
Positive Reinforcement ALWAYS works
All living beings move away from aversives (R-) and want to go towards (R+) appetitives. it's how we survive!
Even plants move towards the sun, or away from the sun. Depending if they are shadowloving or sunloving plants.
When training doesn't work, the principle of R+ still works!
There are 5 phases in clicker training that every horse goes through, before the goal behaviour is on a solid, reliable cue.
5 Phases of Positive Reinforcement Training
The R+ training process is very different from R-.
R+ thas five phases, while R- only has two.
Most people stop in phase 2 of clicker training. No wonder they think 'it doesn't work'.
They are skipping 3 steps in a 5-step process!
Phase 1: The horse knows nothing!
He has no clue what the trainer wants.
The trainer guides the horse with clicks (the marker signal to mark the desired behaviour) and appetitives. An appetitive is something the horse wants, values and is willing to work for! Usually food.
I call it a treat, but it's just normal horse feed.
The goal behaviour is split into small steps. Small enough for the horse to understand that step. This process is called a Shaping Plan.
Every small step that leads towards the goal behaviour is marked with a click and reinforced with an appetitive.
Every click means "Yes!". Do more of that!
The horse learns quickly that offering behaviour leads to rewards he values! The Rate of Reinforcement (RoR) is high: lots of clicks and treats in this phase.
Sessions are short.
The goal of the session is to teach the horse one step. We're not aiming for the end goal, as we do in R-.
Phase 2: The horse understands how to get reinforced
The goal behaviour is now offered consistently.
The horse knows what to do, in order to get a treat. So far, this is exactly like in negative reinforcement training, where the horse starts to understand how to avoid an aversive stimulus.
This is also the pitfall that leads to frustration and dissappointment. This happens when clicker trainers expect to reach the goal behaviour in this phase. Just like in traditional training.
In phase 2 we pair the goal behaviour to a cue.
Most people stop advancing at this point. They keep clicking and giving food rewards (treats) for the goal behaviour. They start training a new, more exciting behaviour! They think they have accomplished their goal.
In phase 2 we must also slowly change the reinforcement schedule.
We need to change from a 100% reinforcement reinforcement schedule (click and treat for the slightest try) to an intermittant reinforcement schedule.
Not all attemtpts of the horse lead to clicks and treats anymore. Only some. Only the best preformances!
Intermittant reinforcement schedules prevent predictability and strengthen behaviours.
High predicatibily of the clicks and treats in this phase, weakens performance.
Getting Stuck in Phase 2
When you become very predicatble in training with your clicks and treats, the horse starts to make deliberate decisions.
'Do I want to do all this for that?" And, sometimes the answer is "No".
Performance goes down, instead of up. The trainer doesn't understand the Principles of Learning & Motivation.
Clicker training didn't work... People conclude -incorrectly- that they need to keep feeding treats to get the behaviour.
Postive reinforcement then morpfs into bribary. Bribary never leads to longlasting results!
Phase 3: Strengthening the Cue
The horse understands the cue and performs the goal behaviour well.
In phase 3 it's time to strenghten the cue. From now on, the horse only gets reinforced for performing the behaviour after your cue!
In this phase, spontaneously offered behaviour is not reinforced anymore!
And the horse will still try!
Getting Stuck in Phase 3
First pitfall is that we -trainers- have just trained ourselves to be generous with clicks. We learned to click for 'the slightest tries' and get a cooperative horse.
We trained ourselves not to be stingy with clicks.
Now, we have to become selective with our clicks and treats. It's time to withhold the click for sponaneously offered behaviours. 'Click and Treat' has become muscle memory and we need to undo that.
Become very conscoius and deliberate about what we click and reinforce. That takes skill!
Another reason to get stuck in this phase is the following. After we end our session, our horse suddenly offers a much higher quality of behaviour! Without a cue!
The witholding of the click (no more clicks without cues) triggered a slight extinction burst in the horse.
Now the trainer is in dillemma: should I click or not? I didn't cue the behaviour.
When the trainer clicks, the higher quality behaviour gets trained.
The fear is that the horse never will offer this again. This fear is ungrounded. We are still at in the learning phase of training a behaviour.
Because of this fear, the trainer clicks. The horse learns that sponaneously offered behaviour leads to what he wants: food.
The cue is weakened... 'The horse doesn't listen [to the cue].'
Conclusion of the inexperienced trainer: "Clicker training is hard, it takes so much longer. It doesn't work..."
Testing Your Cues
Is your horse a good Guesser or is he well-trained?
Here is a simple way to test if your voice cues are as solid as you think they are.
Phase 4
Tomorrow I will shed some light on the next crucial steps in clicker training your horse!
The advanced steps.
For now, test how many of the behaviours you've trained are on solid cues?
Sandra Poppema from HippoLogic
1y ago
Keep it simple! You don’t need to give away all of your control when interacting with your horse.
Here’s how you can give your horse agency, offering choices. While staying safe, and… building a friendship with your horse in the process.
Pour yourself a hot cup of tea to enjoy while you read.
I promise, it’s worth your time.
What is ‘Agency’?
To give horses agency means to empower them to make their own choices, decisions, and take independent action.
It involves respecting their ability to act on their own behalf. They should take control of their life. This way, they feel a sense of self-determination.
Start Offering Small Choices First
Offering small choices can already give the other a sense of agency.
For example, loosen the reins during the warm-up or cool-down of your horse. Give your horse a choice over speed, direction and duration of his gait.
Maybe your horse wants to stand still. Explore the mirror on the wall of the indoor arena. Maybe he wants to walk around. Explore. Sniff that interesting pile of manure another horse left there.
Let him do what he wants.
Building Trust
Once you experience that your horse won’t run off with you on his back, or do crazy, dangerous things, you can start to relax.
Your horse won’t act dangerously or ‘out of control’. He won’t buck you off. Or get rid of you, by running closely past those jump stands where your knee will get stuck.
This fear is based on the experience of traditional horse trainers who rely on coercion and punishment. Their training techniques can become really abusive. Their horses are in survival! They would choose safety, if they were given the freedom of choice. Those horses would be caring for themselves in that moment.
Horses in Survival Mode can act Dangerously!
Fearful horses in flight- or fight mode are dangerous! Not because they want to hurt you. It’s because they are big, strong and fast! They want to be safe! Those horses are in Survival Mode!
Your horse isn’t like that. He won’t respond with fight or flight if he gets agency. He’s not abused by you. Otherwise, you would not still be reading!
Your horse hasn’t suffered from severe aversives in your training and riding. He’s not afraid of you.
Horses are Social and Peaceful
Horses are peaceful, sentient beings who are hardwired to socialize. Their lives depend on it. Peace keeps them from getting injured. Fighting is dangerous. Predators will seek out injured horses in the hope they will be easy prey.
That’s why horses have developed reliable conflict avoidant communication among themselves. Learn their language and you’ll recognize their signals.
Learn to trust their decisions.
Your horse in return, will love you for his newly gained freedom and agency. He will use it to make choices. You can learn a lot. It can be the start of a beautiful two-way communication and a bond based on mutual trust!
Get to Know Your Horse Better
You get to know your horse, based on the decisions he makes.
Does he love to move? Does he want to explore? Read his emails (manure) first? Does he want to check the environment for danger, or is he comfortable right away in the arena?
All feedback is just ‘information’. He doesn’t want to disobey you. His concerns are his own safety, health and enjoying social interactions.
Example
I have many stories about how allowing your horse agency keeps people safe! The one I’m sharing here is not an exception.
Think back and remember when you gave your horse choices. What did he choose? What did you learn from it?
How Allowing My Horse Agency, Took Away My All Stress, My Frustration and My Feeling of Being Failure!
Sholto
It was back in the day, when horses where often stabled up in Winter.
Sholto was my small Hackney pony. In order to give him exercise after being stabled for 24 hours, I lunged him.
Every time, he started trotting and cantering right away. He even bucked in the air. That wasn’t how lunging is suppose to go…
‘Proper warm-up on the lunge line’
My pony needed to listen! A proper 10-minute warm up in walk, was ‘how it’s done’. It’s common sense for athletes.
I wanted my horse to be an athlete!
Horse Owner’s Responsibilities
A ‘real‘ horse person knows that you can’t let a horse trot and canter after 24 hours in a stable. Trotting cold muscles could lead to serious injuries! All horse people know that!
I wanted to be a ‘real horse person’! Someone who understands horses. In my eyes, it was the highest status a horse owner can accomplish.
Horse Knowledge
A ‘real horse person’ takes good care of her horse. Keeps him sound and prevent injuries! A ‘real horse person’ trains her horse and has a well-behaved horse that listens. ‘Real horse people’ have safe horses, not dangerous ones!
Lunging became a frustrating endeavour. I wasn’t looking forward to it.
I knew Sholto wouldn’t listen for the first 10 minutes. He would canter and buck and do funny moves in the air. He offered Caprioles and Levades.
Just not in a Classical Dressage kind of way.
Stress, Frustration and Feeling like a Failure
It stressed me out that I wasn’t ‘in control’ during lunging. I wasn’t in control of my own pony! Stupid!
He did whatever he wanted on the lunge line. He wouldn’t walk, he would fly! I was not in control. I didn’t realize this on a conscious level, though.
Fear of Injuries
I was afraid for tendon injuries. They take a long time to heal. It would involve a lot of daily care.
An injuries would also cause a lot of guilt.
I was fully aware of the risks of skipping a proper warm-up. An injury is a very costly event. Vets are expensive! I was just a student with a small budget.
Most stabled horses love to run and go crazy for a couple of minutes
What’s wrong with me? Why Wouldn’t my Pony Listen?
It frustrated me that Sholto wouldn’t listen! I had his best interest, his safety in mind!
I knew it looked bad in the eyes of everyone around. It felt bad. Even when there was no one around to judge me. I judged myself!
I had studied horses and training for my whole life (a whooping 20 years)!
Why was he ignoring me on the lunge line? It drove me crazy! Hindsight is 20-20.
The Pivoting Moment that Made me a ‘Real’ Horse Person
One day I was so $%^&$ frustrated, that I yelled to my Sholto: “OK, fly around, buck, canter! See what happens!” I let go of trying to give him a proper, 10-minute warm-up in walk…
Agency for the Horse
Sholto ran, he bucked, he jumped with great athleticism.
He enjoyed being ‘free’, not oppressed. He clearly enjoyed making his own decisions. Finally, he got agency. On the lunge line!
He really enjoyed himself!
It scared me. At first!
Surprise!!!
Sholto didn’t injure himself. Ever! He knew his own body! He loved his new agency.
I started to let him go ‘wild’ every time! Without a lunge line. I felt that was safer: less restriction.
I figured that the lunge line and keeping him restricted was maybe even increasing risks!
I started to let him do ‘whatever he wanted’ for 10 minutes in the arena. Without a lunge line. This became his ‘mental’ warm-up.
After that, we would do something I wanted, for instance lunging.
After his ‘crazy 10 minutes’ he was willing to listen to me! Now he was the well-behaved pony I wanted to have!
Win-Win for Both of Us
Lesson learned. Here’s what happened:
He never injured himself ‘going crazy’.
He never caught a cold, even though he sweated heavily.
He was ready to listen to me after his crazy 10 minutes. He became wonderful to work with, after his own chosen warm-up.
Although he scared me, he took full responsibility for his own body. I learned to trust him and his instincts. I knew those were well-developed in his upbringing.
I learned a lot about his needs!
I learned to listen more to him!
How I Became a ‘Real’ Horse Person
I believe that this made me a better horse person. I feel like a real horse person now! Even when I’m breaking so many rules from the traditional horse world.
I am not traditional.
I want to listen to my horse! I want to make this a two-way partnership built on mutual trust and mutual understanding!
I think that’s what being a real horse person is all about: Understanding Horses and Horses Understanding You.
Willingly!
Hindsight
In hindsight it all makes sense. Sholto had these urges to move. I was fighting him. He was fighting himself.
I’m sure he wanted to listen.
It was not disobedience. It was cropped up energy that he needed to release! He struggled with cropped up energy because of being not able to release that during the day!
What about you?
How can you give your horse (a bit more) agency? In what areas can you give him more choice(s)?
Do you need to go against traditional rules? Are you scared?
Trust your gut. trust your horse. Start small!
Start!
Happy Horse Training!
Sandra Poppema
PS Do you want to allow your horse more agency and choices? Would you like to build a friendship based on mutual trust and understanding, while staying safe? Not sure where to start? Connect and I’ll give you some ideas!
Related
What does ‘HippoLogic’ offer Equestrians and Equine Businesses? Why does it matter so much?
Does Positive Reinforcement (R+) Training Really Lead to Safer, More Trustworthy Horses?
Sandra Poppema from HippoLogic
1y ago
When you work with your horse, voice cues can be a real game-changer.
When you start your horse from the ground, you can take those voice cues in the saddle. It will make the transition from groundwork to riding easier.
What is a 'cue'?
Once a behaviour is trained and predictable, we pair it with a cue. A cue is a signal that becomes a predictor of a potential appetitive (something the horse wants to receive). If the horse is trained well, he'll be focused on your cues: they are important to him.
How to Test the Strength of Your Voice Cue
Most horse owners think that their voice cues work, but they are mistaken. They think "Walk On", "Whoa", "Trot", and "Canter" are solid.
In reality, the horse pays attention to a combination of cues: your body language (arms, legs, where you're looking, tension in your body) and maybe even the tools you hold in your hand (target stick).
Isolate the Vocal Cue
If you're convinced your horse will start to walk on your voice cue "Walk On", test it by isolating the verbal cue from your body language.
When the horse starts to walk, your voice cue is solid. Congrats! You've done a really good job training your horse.
When Your Voice Cue is NOT Solid
When your horse is not responding to your voice cue, you want to give more information. You can use a target in front of him or use mats, to entice forward movement. Repeat until the behaviour walk is strong.
Don't Fall Into This Common Pitfall
Here's what most people often forget when training their horse. They forget that their training tools, like the target, must be faded out. Only then can you train your horse purely on a voice cue.
Fade out your mats, target and body language. you walking first, can become the actual cue for your horse to start walking. This will become a bottleneck in At Liberty because your horse will only walk as long and as fast as you are walking. When you put the "walk" on a voice cue, your horse will walk without you.
PS Interested in At Liberty with positive reinforcement to build a better connection with your horse? Check out my program here
