1

NIW Meeting, Udine, 23-24 February 2011 1

INRIA advancement report

A. Lécuyer, G. Cirio, L. Terziman, M. Marchal (INRIA)

NIW Project, Udine, 23-24 February 2011

2

NIW Meeting, Udine, 23-24 February 2011 2

OutlineWalking device (M. Marchal)

• JoyMan : a human-scale joystick for NIW

Ground rendering (G. Cirio)• Haptic liquids (liquid grounds)

• Multi-state haptics (multi-state grounds = deformable, solid, fluid)

• Vibratory rendering of liquid grounds

Pseudo-haptic feedback (A. Lécuyer)• New effect for material properties

• « King-Kong » effect

Interactive techniques (L. Terziman)• Shake-your-head : comparison with joystick

• Multi-sensory shake-your-head : visual (king-kong effect), tactile, audio

3

NIW Meeting, Udine, 23-24 February 2011 3

« JoyMan » : a Human-Scale Joystick

« Human joystick » : navigation based on body orientation

(Marchal et al., IEEE 3DUI 2011)

(Patent, 2011)

M. Marchal, J. Pettre, A. Lécuyer, “Joyman: a Human-Scale Joystick for Navigating in Virtual Worlds”, IEEE International Symposium on 3D User Interfaces (IEEE 3DUI), Singapore, 2011

4

NIW Meeting, Udine, 23-24 February 2011 4

A novel approach for haptic rendering of fluids

6 DOF physically-based solid-fluid haptic interaction

A generic system: variable viscosity, arbitrary-shaped objects, multiple haptic coupling

6DoF Haptic Interaction with Fluids

G. Cirio, M. Marchal, S. Hillaire, A. Lécuyer, “Six Degrees-of-Freedom Haptic Interaction with Fluids”, IEEE Transactions on Visualization and Computer Graphics, In Press.

Presentation at IEEE Virtual Reality, Singapore, March 2011

5

NIW Meeting, Udine, 23-24 February 2011 5

6DoF Haptic Interaction with Multiple States of Matter

A single model allowing to interact with: Fluids (Navier-Stokes)

Deformable bodies (continuum mechanics)

Rigid bodies (rigid body dynamics)

A single haptic rendering technique The first multistate haptic rendering technique

G. Cirio, M. Marchal, A. Le Gentil, A. Lécuyer, “Tap, Squeeze and Stir the Virtual World: Touching the Different States of Matter Through 6DoF Haptic Interaction”, IEEE Virtual Reality 2011

G. Cirio, M. Marchal, A. Lécuyer, “Assessing the 6DoF Haptic Rendering of Multi-State Simulations with Fluid, Deformable and Rigid Media”, Submitted to World Haptics 2011

6

NIW Meeting, Udine, 23-24 February 2011 6

Vibrotactile Rendering of Fluids

Vibrotactile rendering of foot-fluid interaction

Model based on 3 components Harmonic Bubbles

Main Cavity Oscillation

Initial Impact

Future work :

• Paper for IEEE ToH

• Further evaluations? >> McGill tiles, UPMC shoes

• Acoustic rendering with Verona?

7

NIW Meeting, Udine, 23-24 February 2011 7

Pseudo-haptic feedback

Simulation of material property: wood, metal, foam, etc

Novel effect based on visual vibration

Inspired by Force transients and event-based haptics

Seems very efficient !

T. Hachisu, G. Cirio, M. Marchal, A. Lécuyer, H. Kajimoto, « Pseudo-Haptic Feedback Augmented with Visual and Tactile Vibrations » , International Symposium on VR Innovation (ISVRI), 2011

8

NIW Meeting, Udine, 23-24 February 2011 8

Simulation of feet-ground contacts with visual oscillations

Inspired by movie effect

>> Oscillating motion of the virtual camera

Simulation of ground properties?

To be tested with Shake-Your-Head..

« King-Kong » effect?

9

NIW Meeting, Udine, 23-24 February 2011 9

Walking-in-Place

Novel technique based on head movements

Sitting or Standing

Walk+Turn+Jump+Crawl

Evaluation : fast learning, high appreciation

Walking-in-Place and« Shake-Your-Head »

10

NIW Meeting, Udine, 23-24 February 2011 10

Implementation

L. Terziman, M. Marchal, M. Emily, F. Multon, B. Arnaldi, A. Lécuyer, “Shake-Your-Head: Revisiting Walking-In-Place for Desktop Virtual Reality”, ACM Symposium on Virtual Reality Software and Technology, Hong-Kong, China, 2010

11

NIW Meeting, Udine, 23-24 February 2011 11

Shake-your-head : comparison with joystick

•Joystick trajectories:

•« Shake-Your-Head » (SYH) trajectories:

12

NIW Meeting, Udine, 23-24 February 2011 12

Shake-your-head : comparison with joystick

•Spatial analysis

–Macroscopic:

–Shape of the trajectories

–Distance to the shortest path

–Mean trajectories

–Microscopic:

–Curvature

•Temporal analysis

–Speed

–Smoothness

13

NIW Meeting, Udine, 23-24 February 2011 13

Multi-sensory shake-your-head

AudioVisual

Vibration

14

NIW Meeting, Udine, 23-24 February 2011 14

Publications (reporting period)

Cirio, M. Marchal, S. Hillaire, A. Lécuyer, “Six Degrees-of-Freedom Haptic Interaction with Fluids”, IEEE Transactions on Visualization and Computer Graphics, in press

G. Cirio, M. Marchal, A. Le Gentil, A. Lécuyer, “‘Tap, Squeeze and Stir’ the Virtual World: Touching the Different States of Matter Through 6DoF Haptic Interaction”, IEEE International Conference on Virtual Reality (IEEE VR), Singapore, 2011

M. Marchal, J. Pettre, A. Lécuyer, “Joyman: a Human-Scale Joystick for Navigating in Virtual Worlds”, IEEE International Symposium on 3D User Interfaces (IEEE 3DUI), Singapore, 2011

T. Hachisu, G. Cirio, M. Marchal, A. Lécuyer, H. Kajimoto, « Pseudo-Haptic Feedback Augmented with Visual and Tactile Vibrations » , International Symposium on VR Innovation (ISVRI), 2011

+2 submissions at WHC