45
Klinik für Neurologie Models of Smooth Pursuit Eye Movements Models of Smooth Pursuit Eye Movements Peter Trillenberg & Rebekkan Lencer Dept. of Neurology, University Hospital of Schleswig-Holstein, Campus Lübeck & University of Lübeck

Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Embed Size (px)

Citation preview

Page 1: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Models of Smooth Pursuit Eye Movements

Peter Trillenberg & Rebekkan Lencer

Dept. of Neurology, University Hospital of Schleswig-Holstein, Campus Lübeck & University of Lübeck

Page 2: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Robinson‘s pursuit model(Biol Cybern 55: 43)

Knapps Ophthalmotrop (nach 1861)Berliner Medizinhistorisches Museum der Charité

What is a model?

Page 3: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsWhat is a Workshop?

ignorance

At least we knowwho theothers

are

blaQuestions

that aresupposed

to leadsomething

Answersthat lead to

newquestions

bla

Answersthat lead to

newquestions

bla

Answerwith nextnot slideprepared

Answerwith next

slideprepared

bla

shit

partial absence

ofignorance

Who cares …

Page 4: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assignment #1:

Design a system that drives the eye to follow an object. Chose a simple plausible algorithm that does not necessarily employ mechanismsidentical to physiology!

time

posi

tion

Page 5: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assignment #1:

Design a system that drives the eye to follow an object. Chose a simple plausible algorithm that does not necessarily employ mechanismsidentical to physiology!

time

posi

tion

∆ ∙ ∆

Page 6: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assignment #1:

Design a system that drives the eye to follow an object. Chose a simple plausible algorithm that does not necessarily employ mechanismsidentical to physiology!

Show EXCEL #1

A B C D1 lambda …23 time Stim eye4 … …5 …. … =abxjsjhjh6 … … =abxjsjhjh

Page 7: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assignment #1:

Design a system that drives the eye to follow an object. Chose a simple plausible algorithm that does not necessarily employ mechanismsidentical to physiology!

Show EXCEL #1

A B C D1 lambda …23 time Stim eye4 … …5 …. … =-C$1*(C5-B5)6 … … =C5+D5

Page 8: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Questions for assignment #1

1. Does the model hit a resting target?

2. Does the model follow a moving target?

3. What is the frequency characteristic of the model?

4. What is the fundamental difference between this model and eyemovements?

Page 9: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Questions for assignment #1

1. Does the model hit a resting target?Yes (asymptotically)

2. Does the model follow a moving target?Yes (but with a constant position error)

3. What is the frequency characteristic of the model?Low-Pass (G ->1 for low f, ->0 for high f)

4. What is the fundamental difference between this model and eyemovements?

Dichotomy between saccadic and pursuit system ignored

Page 10: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

. . .

r.h.s.

11

Page 11: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Low pass element

pass

block

The Robinson pursuit model

„corner frequency“ 1/T

Page 12: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsGoals of eye movements

Correction of errors in eye position:saccades

Correction of errors in eye velocity:

OKNSmooth pursuit eye movementsVOR

medial: 45°

lateral: 90°

foveal*: 2°

*thumbnail at an armlength‘s distance

Page 13: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

11

Naive for physiology With knowledge ofeye movementsystems

Page 14: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

But:

How can the brain know the target velocity?

Page 15: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Naive for physiology With knowledge ofeye movementsystems

-+

How could this system be realized?(3 eyes, Antishake, vestibular organ)

„feedback loop“

Page 16: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

-+

„gain element“

Assignment #2:

Explore the effects of a feedbackloop on a gain element!

More specifically: what is theoverall gain of the system as a function of g (ramp stimulus)?

Page 17: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assignment #2:

Explore the effects of a feedback loop on a gain element! More specifically: what is the overall gain of the system as a function of g (ramp stimulus)?

Show EXCEL #2

A B C D1 gain g …23 time target vel Eye vel4 … …5 …. …6 … … =xfasgwjgjwhg

Page 18: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Show EXCEL #2

A B C D1 gain g …23 time target vel Eye vel4 … …5 …. …6 … … =C$1*(B5-C5)

Assignment #2:

Explore the effects of a feedback loop on a gain element! More specifically: what is the overall gain of the system as a function of g (ramp stimulus)?

Page 19: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

-+

∙ ⟹ 1 ∙

1

Page 20: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Situation so far:

There is a negative feedback loop in the system.

This forces the system to work with high gains that render the systemunstable.

We have to get rid of this loop! Suggest something that makes targetvelocity enter the brain!

-+

Page 21: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsThe Robinson pursuit model

Assignment # 3

Make two suggestions for „Brain“!

Physicallydefined

neuronallydefined„efferencecopy“

++

-+

Page 22: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsThe Robinson pursuit model

++

-+

11

Page 23: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsThe Robinson pursuit model

++

-+

11

11

Assignment # 4

What does imply in reality?

Page 24: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

++

-+

The Robinson pursuit model

11

11

Page 25: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

delay element:

. . .

r.h.s.

Page 26: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Robinson, Gordon & Gordon: Biol Cybern 55: 43 (1986)

Desired eyeacceleration

integration

The Robinson pursuit model

Page 27: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Krauzlis & Lisberger, Neural Comput 1: 116

The Lisberger pursuit model

Page 28: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsThe Robinson pursuit model

Assignment # 5

Explore the effect of a fixed delay of 100 ms on sine pursuit!

++

-+

11

11

Page 29: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsThe Robinson pursuit model

Stimulus frequency

Stimulusperiod

Phase

0,3 Hz1 Hz5 Hz10 Hz

Page 30: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsThe Robinson pursuit model

Stimulus frequency

Stimulusperiod

Phase

0,3 Hz 121 Hz 1000 ms 365 Hz 200 ms 180 Delay by a half wave10 Hz 100 ms 360 Delay by a full period

Speculate why these large phase shifts do not occur in reality?

Page 31: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsBeyond the Robinson pursuit model

Assigment # 6

Imagine ways to represent (horizontal) target motion forprediction!

Page 32: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsBeyond the Robinson pursuit model

If you know the stimulus is a sine: amplitude and frequency

The stimulus is a physical object => borrow ideas from physics

Page 33: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsProblems with control systems models

What is the problemassociated with thisapproach?

K1=3∙0.87∙fK2=tan(/8+2∙∙0.87·f∙( delays))-1

Van den Berg, Exp Brain Res (1988) 72: 95

Page 34: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye MovementsBeyond control systems models

Assigment # 5

If you know the stimulus is a sine: amplitude and frequency

The stimulus is a physical object => borrow ideas from physics

, /0 1… …

Assignment #7

Imagine examples (physically defined situations) for this approach to bepossible!

Always true

Never really true, alwaysapproximately true

Page 35: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Positionvelocity

Real stateof the target

Assumed stateof the target

Command tothe eye

Retinal errorand retinal slipvelocity

How do we learn the target dynamics?

⋯ ⋯

Shibata et al, Neural Networks 18 (2005) 213–224

Page 36: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assumption on targetdynamics: general form

Shibata et al, Neural Networks 18 (2005) 213–224

⋯ ⋯

How do we learn the target dynamics?

Assignment #8: Apply this equation to a ramp target (constant velocity, linear change in position)

Page 37: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assumption on targetdynamics: general form

Shibata et al, Neural Networks 18 (2005) 213–224

⋯ ⋯

How do we learn the target dynamics?

Assignment #8: Apply this equation to a ramp target

10 1

works

Does it work here?

Page 38: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assumption on targetdynamics: general form

Shibata et al, Neural Networks 18 (2005) 213–224

⋯ ⋯

How do we learn the target dynamics?

Assignment #9: Apply this equation to a ramp target

10 1

works

doesn‘t work

Page 39: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Assumption on targetdynamics: general form

Special case ramp: position increasing, velocityconstant

Special case sinussoidalstimulus with frequency/2

Shibata et al, Neural Networks 18 (2005) 213–224

⋯ ⋯

10 1

cos sinsin cos

How do we learn the target dynamics?

Page 40: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Shibata et al, Neural Networks 18 (2005) 213–224

How do we learn the target dynamics?

We have a representation for parameters that can facilitate prediction for a small number of stimuli

Suggest something to adjust these parameters to a given stimulus!

Positionvelocity

Real stateof the target

Assumed stateof the target

Command tothe eye

Retinal errorand retinal slipvelocity

Page 41: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Shibata et al, Neural Networks 18 (2005) 213–224

How do we learn the target dynamics?

⋯ ⋯

Page 42: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Shibata et al, Neural Networks 18 (2005) 213–224

How do we learn the target dynamics?

Page 43: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Shibata et al, Neural Networks 18 (2005) 213–224

cos sinsin cos

How do we learn the target dynamics?

Page 44: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Shibata et al, Neural Networks 18 (2005) 213–224

How do we learn the target dynamics?

What happens during target blanking?

Page 45: Models of Smooth Pursuit Eye Movements Freiburg 2014 · PDF fileKlinik für Neurologie Models of Smooth Pursuit Eye Movements Robinson‘s pursuit model (Biol Cybern 55: 43) Knapps

Klinik für Neurologie

Models of Smooth Pursuit Eye Movements

Shibata et al, Neural Networks 18 (2005) 213–224

How do we learn the target dynamics?