19
EYE-INTERACTION: THE NEXT FRONTIER OF AR/VR/MR AND UNLOCKING HUMAN POTENTIAL Jim Marggraff, Founder & CEO @Eyefluence #AWE2016

Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Embed Size (px)

Citation preview

Page 1: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

EYE-INTERACTION: THE NEXT FRONTIER OF AR/VR/MR AND UNLOCKING HUMAN POTENTIAL

Jim Marggraff, Founder & CEO @Eyefluence#AWE2016

Page 2: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Eyefluence Confidential

Jim Marggraff founds Eyefluence, in 2013 (StrataCom $4.5B, LeapFrog $2.5B, Livescribe) acquiring all assets (IP, technology & team) from Eye-Com.

1998 - 2012 20142013 2015

Series A Financing Led by Intel Capital, Dec 2013

Eyefluence advances core eye-tracking & eye-interaction technology with Fortune 50 partners

Dr. William Torch, neurologist, founds Eye-Com in 1998 raising $15M in NIH, DOT, DOD funding for research, technology, & prototype development.

Series B Financing Led by Motorola Solutions, July 2015

R&D GrantsNIH, DOT, DOD ‘98-’12

BACKGROUND

2016

Page 3: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

OUR MISSION

Eyefluence transforms intent into action through your eyes

Page 4: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Human-Computer Interaction

Wearable Computing

Augmented & Virtual Reality

RealSense Perceptual Comp.Emotiv EEG headsetLeapMotion Hand controllerMyo Gesture controller...

HTC/Valve ViveMicrosoft HololensOculus RiftSamsung Gear VRSony MorpheusGoogle Glass VxSony GlassesEpson MoverioVuzix M100Magic LeapAvegantMeta

Interaction ModesEyesHeadHandsVoiceFaceMind

THE CENTER OF 3 HIGH GROWTH MARKETS

Page 5: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

HMDS ARE INCOMPLETE...

Page 6: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

...WITHOUT THE EYES

Eye-Tracking & Eye-Interaction in HMDs

NavigationActivationReadingPaging

SearchingZoomingPanning

Text Input ControlGame Interaction

Multimodal ControlMeasurementAR InteractionVR InteractionMR Interaction

Page 7: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

IT’S ALL ABOUT THE UX

Transforming Intent Into Action...

...For Real Or Virtual Interaction

...On Any Device...

Page 8: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

HMDs VariabilityUse Cases & Technical Requirements

Page 9: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

RobustnessEnvironmental

User

Power

Low MIPS & mWs

Size & Placement

UI/UX

TECHNICAL CHALLENGES

Biology & Technology

Page 10: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

SMALL, LOW POWER, LOW MIPS, ROBUSTEYE-TRACKING AND EYE-INTERACTION

Page 11: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

THE EYE-BRAIN CONNECTION

Page 12: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Eyefluence Confidential

EnigmaLiteratures Warns of Visual/Cognitive

Collision: Controlling vs. Consuming

Conventional Eye Tracking “Control”

Dwell - Slow, fatiguing, frustrating, impeding thought

Winking and Blinking - Reflex, Difficult, Unnatural, Stigma

Eye-Interaction Challenge

Page 13: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

TRANSFORMING INTENT INTO ACTIONTHE EYE-BRAIN CONNECTION

Primary visual cortex

Optic radiations

Lateral geniculate body

Optic tract

Page 14: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

7. Gaze Anxiety

8. Movers

9. Tracking Feedback

10. Latency Fatigue

11. Multimodality

12. Improved Working Memory & Intelligence

EYEFLUENCE 12 LAWS FOR UX“LET YOUR EYES DO WHAT YOUR EYES DO”

1.Purposeful & Non-Purposeful Activation

2.Activation Context3.Gap Effect, Speed, &

Focus4.Non-Foveal

Distraction5.Transitions6.Foveal Indiscretion

Page 15: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Eyefluence Confidential

A NEW INTERACTION MODEL

The world’s firstuser interface for the eyes

Page 16: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Eyefluence Confidential

Look here

Page 17: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

Eyefluence Confidential

Page 18: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

VR COMMAND & CONTROL CENTER

Drones Body Cams Smart glasses

● Speed communication ● Reduce costs ● Increase response time● Improve mobile intelligence

Rapidly monitor multiple user views with bidirectional gaze overlay

Page 19: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential

AI AGENT IN AN EYE-INTERACTIVE DIALOGUE