43
ME 327: Design and Control of Haptic Systems Winter 2018 Lecture 1: Introduction to haptics and Kinesthetic haptic devices Allison M. Okamura Stanford University

Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

  • Upload
    haque

  • View
    267

  • Download
    8

Embed Size (px)

Citation preview

Page 1: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

ME 327: Design and Control of Haptic Systems Winter 2018

Lecture 1:Introduction to haptics

andKinesthetic haptic devices

Allison M. OkamuraStanford University

Page 2: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

today’s objectives

introduce you to the field of haptics (definition, why it is important, and

why haptic technology is challenging)

give an overview of course content and policies

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 3: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

what is haptics?

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 4: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

haptic box

Pass it around. Feel inside.Try to identify three objects.

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 5: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

hearing

sight

smell

taste

touch

which sense is most valuable

to you?

which would you relinquish

last?Katherine Kuchenbecker

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 6: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

hap·tic ('hap-tik)adj. Of or relating to the sense of touch.

[Greek haptikos, from haptesthai, to grasp, touch. (1890)]

TemperatureTexture

SlipVibration

Force

Location/configurationMotionForce

ComplianceCutaneous

Kinesthesia

The haptic senses work together with the motor control system to:- Coordinate movement- Enable perception

Johansson and Westling

J. Edward ColgateStanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 7: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

what would life be like without touch?

Kinesthesiahttp://www.youtube.com/watch?v=FKxyJfE831Q

Cutaneoushttps://www.youtube.com/watch?v=0LfJ3M3Kn80

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 8: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

why do we have brains?

Daniel Wolpert

seasquirt

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 9: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

how does your computer/smartphone/iPad see you?

illustration by Tom Igoe

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 10: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

what if...

you could make any surfacefeel fuzzy, sticky, soft...?

you could touchpriceless works of art?

there was a haptic holodeck?

haptics could teach you?

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 11: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Learning Method RetentionWhat one reads 10%What one hears 26%What one sees 30%What one sees and hears 50%What one speaks 70%

J.E. Stice, Engineering Education, pp. 291-296, 1987

what about what one feels?

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 12: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

haptic box

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

what was in there?how did you know?

Page 13: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

tactual stereognosis• Tactual = tactile = via the sense of touch

• Stereognosis = the mental perception of three-dimensionality by the senses, usually in reference to perceiving the form of solid objects by touch

• One study (Klatzky et al., 1985) showed that subjects could identify 100 common objects almost perfectly, taking about 2 seconds per object.

• People are very good at tactual stereognosis.

Katherine Kuchenbecker

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 14: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

K. KuchenbeckerStanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 15: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

existing applications of hapticsentertainment

Nintendo Stanford/JHU Immersion

education

human-computer interfaces

BMWSamsung Boeing

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 16: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

course overview

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 17: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

course objectivesby the end of this course, you should:

• understand selected topics in haptics for virtual environments and teleoperation (see specific objectives on syllabus)

• improve your paper reading and presentation skills

• experience defining a design/research problem and investigating it

• be creative and have fun!

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 18: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

structure

Lectures by Allison and the CAs give way to lectures by you as the quarter progresses

grading10% class participation

30% assignments10% paper presentation

50% project

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 19: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

course contentPart 1 Design and control of kinesthetic interfaces

Part 2 Tactile devices

Part 3 Teleoperation

Part 4 Human haptics

Part 5 Haptic interface evaluation

Part 6 Student presentations

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 20: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

by the end of this course, you should be able to:• Identify the primary mechanisms of human haptic sensing• Understand a number of methods for sensing the position of and actuating

haptic interfaces• Describe the differences between grounded and ungrounded force

feedback• Identify salient features of a haptic device design• List a variety of different types of haptic interfaces• Implement controllers to render various dynamics (stiffness, damping,

inertia)• Describe and implement basic telemanipulation controllers• Understand the causes of instability in virtual reality and teleoperation

systems• Design psychophysical and perceptual tests• Describe applications of haptic devices• Develop a new haptic device or application of a haptic device• Read, evaluate, and critique research papers• Design and deliver a research presentation

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 21: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

don’t be shy

Learning Method RetentionWhat one reads 10%What one hears 26%What one sees 30%What one sees and hears 50%What one speaks 70%

J.E. Stice, Engineering Education, pp. 291-296, 1987

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 22: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

fill out the survey http://www.stanford.edu/class/me327/assignments/survey.pdf

(return to my office or in class by Thursday class time)

fill out when2meet poll https://www.when2meet.com/?6566122-ccxKO (by Wednesday)

pay lab materials fee ($50 check made out to Stanford University)

get access to PRL if desired (if necessary, sign up for training at http://productrealization.stanford.edu)

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

register on piazza https://piazza.com/stanford/winter2018/me327/home

Page 23: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

kinesthetic (force-feedback)

device basics

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 24: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

kinesthetic vs. tactile haptic devices

Kinesthetic haptic devices display forces or motions

through a tool

Tactile haptic devices stimulate

the skin

single,resolved

forcedistributed forces/

displacements

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 25: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

kinesthetic vs. tactile haptic devices

Tactile haptic devices can more

easily be wearable

vibration feedback elementencased in glove

Kinesthetic haptic devices are usually grounded

force is transmittedfrom ground

to hand

motor

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 26: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

typical kinesthetic device configurations

manipulandum

drawing by Jorge Cham

grasp

drawing by Tricia Gibo

exoskeleton

drawing byDavid Grow

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 27: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

manipulandums (expensive)

Omegafrom Force Dimension

delta configuration3 degrees of freedom

Phantom Premium 1.5from SensAble/Geomagic

5-bar + rotation3 degrees of freedom

Virtuosefrom Haption

additional “wrist”6 degrees of freedom

all images from Wikimedia Commons

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 28: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

manipulandums (cheaper)

Falcon from Novint

delta configuration3 degrees of freedom

Phantom Omni/Touchfrom SensAble/Geomagic

5-bar + rotation3 degrees of freedom

Sidewinderfrom Microsoft

spherical mechanism2 degrees of freedom

image from Wikimedia Commons photographed by Akiko Nabeshima image from Wikimedia Commons

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 29: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Grip/grasp

© 2007 IEEE. Reprinted, with permission, from L. N. Verner and A. M. Okamura..

Effects of Translational and Gripping Force Feedback are Decoupled in a 4-Degree-

of-Freedom Telemanipulator, World Haptics Conference,, pp. 286-291, 2007

Single-finger Cybergraspfrom Cyberglove Systems

photographed by Akiko Nabeshima

da Vinci Surgical Systemfrom Intuitive Surgical, Inc.(no programmable force

feedback on gripper)photograph courtesyStanford Center for Design Research

Custom haptic gripper forPhantom Premium

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 30: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Exoskeletons

DARPAHarvardimages from Wikimedia Commons

KINARM Exoskeletonfrom BKIN Technologies

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 31: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Hapkit

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 32: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Hapkit

userforce user

force

userforce

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 33: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Hapkit

deviceforce device

force

deviceforce

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 34: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

impedance-type kinesthetic devices

position sensors on kinesthetic

haptic device

force is computed as a

function of position

haptic device outputs force

usermotion

userfeels force

most force feedback devices are of the “impedance” type

impedance

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 35: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

admittance-type kinesthetic devices

force sensors on kinesthetichaptic device

desired position is computed as a function of

force

haptic device outputs position

userforce

userfeels

motion

“admittance”-type devices are not as common

admittance

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 36: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

K. KuchenbeckerStanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 37: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

mechatronics basics

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 38: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

a kinesthetic haptic system

ComputerHaptic Device

Mechatronics Interface

Motion Digital position

Force Digital force

Hum

an

Tele

oper

ated

Rob

ot?

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 39: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

a kinesthetic haptic system

ComputerHaptic Device

Mechatronics Interface

Motion Digital position

Force Digital force

Hum

an

system dynamics

rendering

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 40: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

motion signals

illustration by K. Kuchenbecker

handle(m)

drum or motor (rad)

positionsensor

computeror board

virtual handle

(m)fwd kin.

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 41: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

force generation signals

illustration by K. Kuchenbecker

virtual world (N)

D/A orPWM amplifier motor handle

(N)counts volts currentor voltage

torque

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 42: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

Hapkit

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

Page 43: Lecture 1: Introduction to haptics and Kinesthetic haptic ... · Introduction to haptics and Kinesthetic haptic devices ... why haptic technology is challenging)

fill out the survey http://www.stanford.edu/class/me327/assignments/survey.pdf

(return to my office or in class by Thursday class time)

fill out when2meet poll https://www.when2meet.com/?6566122-ccxKO (by Wednesday)

pay lab materials fee ($50 check made out to Stanford University)

get access to PRL if desired (if necessary, sign up for training at http://productrealization.stanford.edu)

Stanford University ME 327: Design and Control of Haptic Systems © Allison M. Okamura, 2018

register on piazza https://piazza.com/stanford/winter2018/me327/home