19
Event-Based Haptics Günter Niemeyer Stanford Telerobotics Lab http://telerobotics.stanford.edu Adding High-Frequency Playback to make virtual feel real

Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

Event-Based Haptics

Günter Niemeyer

Stanford Telerobotics Labhttp://telerobotics.stanford.edu

Adding High-Frequency Playbackto make virtual feel real

Page 2: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

2Telerobotics Lab

Exploration: Static or Dynamic?

(LaMotte, 2000; Kontarinis and Howe, 1998; Lawrence et al., 2000)

Press?

Stiffness

or Tap!!

x

F&

&

x

F

∆Rate-hardness

Page 3: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

3Telerobotics Lab

Very Dynamic!

Tapping

Firm Grip

Soft Grip

up to

~ 1000 Hz

Page 4: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

4Telerobotics Lab

Today’s Haptics = NERF World

Need HF!

Page 5: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

5Telerobotics Lab

Classic Haptics: Control like Robot

Compute forces every servo cycle (closed-loop feedback)

MotionForce

Ke

F = - Ke xm

Page 6: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

6Telerobotics Lab

Why not realistic?

Kcontrol

Fuser

mdevice

o Frequency content from CL poles:mass ↔ stiffness

ω = √ K/m

o Typical K = 1000 N/mm = 100 g = 0.1 kg

ω = √ 10,000 = 100 rad/sec= 16 Hz

Page 7: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

7Telerobotics Lab

• High gain K = 4,000,000 N/m• Amplifiers ~ 10,000 Hz• Servo rate ~ 10,000 Hz• Encoders ~ 4,000,000 lines/rev

To make it “real”… YIKES!

o Generate frequency content1000 Hz >60x improvement

Fcol∆encK =

Robot with µm and sub-ms resolution…

Page 8: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

8Telerobotics Lab

o We

• Position >1 mm

• Move <10 Hz

• React >100 ms

o But

• Sense force up to 1000 Hz!

o Asymmetric!

Detect Event Signatures

Would we want to?

Page 9: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

9Telerobotics Lab

Event-Based Haptics

Event = Impact, Transition

Open-loop playback ofcharacteristic force profile

POW!M

F = - Ke xm + Fevent(t,vin)

= +

Page 10: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

10Telerobotics Lab

o Superimpose HFover PD (LF)

o Uncontrolled< 50 … 100 ms

o Library of transientsfor velocity andmaterial

o Momentum cancellation

Event-Based Haptics (cont’d)

Page 11: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

11Telerobotics Lab

User Testing

o 12 objects (3 real, 9 virtual)

o 16 subjects

Page 12: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

12Telerobotics Lab

Acceleration Matching

=Fwood

Fmotorastylus astylus

Fwood ≠ Fmotor

astylus = astylus

Page 13: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

13Telerobotics Lab

Acceleration Matching

o Invert model to match stylus accelerations

Page 14: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

14Telerobotics Lab

vin

o Library by velocity vin

Event-Based “Signature” Libraries

Can approximate as:

Decaying Sinusoids(Okamura et al.)

Pulses(Salcudean et al.)

Page 15: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

15Telerobotics Lab

o Classic PD = Foam, Event-Based = Real

Event-Based Haptics “feels real”

Page 16: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

16Telerobotics Lab

Surface Feature = Micro-Tap

vinFdown

o Flight phase (no contact force)o Fdown vin Fpeak

Fsurface

t

Page 17: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

17Telerobotics Lab

Micro Steps...Classic: Event-Based: POW! Real:

Page 18: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

18Telerobotics Lab

o Open-loop HF playback →More real, more information

o Surface features ≈ micro-taps

o Parameterized libraries

o Easier computation(lower servo rates)

Event-Based is GOOD ☺

Fdown

Page 19: Event-Based Hapticspeople.rennes.inria.fr/Anatole.Lecuyer/tutorials... · Event-Based Haptics (cont’d) Telerobotics Lab 11 User Testing o 12 objects (3 real, 9 virtual) o 16 subjects

19Telerobotics Lab

o Students:Jesse HwangMichael WilliamsKatherine KuchenbeckerJonathan Fiene

Acknowledgements / Questions?

o Funding:NSF Career IIS-0547672Stanford OTL Award