Moritz von Grotthuss (gestigon) Natural User Interfaces at AR and VR

A NATURAL USER INTERFACEIN EVERY CAR, HOME, EVERY PERSONAL DEVICE

Virtual-/Augemented- and Mixed Realityrequire hand based natural interaction.

… everyone knows!

In Augmented Reality you need your hands even more.

You can use controllers.

And they are not bad.

But are controllers

NATURAL? ALWAYS ON?

EVERYWHERE AVAILABLE?

gestigon puts your hands into AR, VR and MR.5 years of relevant experience. 28 software engineers.

Key learnings.

3D depth sensors provide the data.

Avatar

How do you visualize the hand?vs RGB-cut-out vs true hand & skin customization

Latency. Matters. Most.

How did we solve it?

HAND DETECTION AND SKELETON TRACKING IS GREAT.

FINGER TIP DETECTION IS FASTER AND SUFFICIENT

> 35 DIFFERENT DEPTH SENSORS INTEGRATEDany technology, any chipset, any supplier

CAMBOARD PICO FLEXX (TOF Sensor)• Direct measurement of depth in every pixel for

highest accuracy• Monocular system architecture with no requirement

for mechanicalbaseline

• Easy once-in-a-lifetime calibration and no need for recalibration

• Ready for AR, VR and 3D scanning - only depth sensing technology whichis integrated into mobile devices (Lenovo Phab2 Pro)

INUITIVE VERONICA REFERENCE DESIGN Veronica is the Inuitive‘ reference design

for AR/VR Enhanced IR stereo depth sensor NU3000 Multicore processors Additional vision processors by CEVA

gestigon and Inuitive cooperate to provide gesture control and hand visualisation solutions for AR/VR

FOCU S ON EM BEDDED SYSTE MS

Example - A R M Cortex M4• ARM Cortex M4 based processor

(STM32F429NIH6 microcontroller)• 180MHz• 2 GB Micro5Dcard• 8MB RAM

-+ Fingertip tracking runs at 1oof ps

MOVIDIUS VISION PROCESSING PLATFORM ‚MYRIAD 2‘

Movidius is the leader in platforms for embedded visual intelligence Ultra low power, high

performance Programmable achitecture Small size / footprint

gestigon integrated it‘s gesture tracking solutions on the Myriad 2 platform with a focus on AR/VR use cases

DIN ISO 9001 (certified 06/16)

2016: A-SPICE Level 22017: A-SPICE Level 3

It simply works.

You don‘t need more than this..

Components you need.

gestigon. CARNIVAL AR/VR Interaction Suite.

POKEMON GO on a Cardboard in Mixed Reality

PRODUCTION PROCESS PLANNINGUsing gestigon‘ VR tools for digital planning of production lines

VR IS ARRIVING IN THE MARKETObama and Merkel at HannoverMesse 2016using gestigon‘ SDK & cardboard design

www.gestigon.com

Moritz von Grotthuss, CEO moritz@gestigon.com Tel. +49-176-10216788