PowerPoint Presentation
Hand interaction in virtual environments
Jakob Johansson
1
Surgeon Simulator by Bossa Studios
3
Toybox Demo by Oculus
Spaceship repair
Spaceship Repair
Giant Cop by Other Ocean
6
ADR1FT by Three One Zero
7
Job Simulator by Owlchemy Labs
The cortical homunculusPrimary motor cortex
9
25Mixamo
10
Performance
speed, strength, repeatability, accuracy, etc.)Flexibility
(quantity of tasks)
What Hand do you need for your Application?
11
Performance
simple, user-friendly, dev-friendly, responsive, etc.
What Input do you need for your Application?Flexibility
(quantity of tasks)
12
Some things we learned
Choose controller based on the use case
13
Daydream
HTC VivePerception Neuron
Manus Machina
Oculus Touch
GloveOne
Dexmo Glove
Kinect One
Sony PS4 Camera
Nimble VR
Intel Realsense
LeapMotion
Sony Move
STEM
T-Glove
Motion ControllersGloves3D sensors
14
Feedback
Finger Tracking
Motion ControllersGloves3D sensorsConvenient
15
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valley
16
R2-D2
C-3PO
17
R2-D2
C-3PO
19
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)
20
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)Be consistent
22
Representation
Gloves / human handsRobot handsTransparent handsCartoon
handsTools & controllers
Interaction
Highly naturalSomewhat naturalObject
penetrationInvisibleStaticComplex
Abstract
23
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)Be consistentSkip the
arms for now
24
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)Be consistentSkip the
arms for nowThink long and hard about every object in the scene
25
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)Be consistentSkip the
arms for nowThink long and hard about every object in the sceneMake
it obvious how to interact with the object
27
The Gallery by Cloudhead Games
28
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)Be consistentSkip the
arms for nowThink long and hard about every object in the sceneMake
it obvious how to interact with the objectPick the most natural
grasps
29
M. R. Cutkosky (1989). On grasp choice, grasp models, and the
design of hands for manufacturing tasks
Grasp Taxonomies
Some things we learned
Choose controller based on the use caseAvoid the uncanny
valleyAvoid hand personalities (use gloves)Be consistentSkip the
arms for nowThink long and hard about every object in the sceneMake
it obvious how to interact with the objectPick the most natural
graspsUse feedback
31
VirtualGrasp
32
Thank [email protected]: @Jakob_Gleechi
