Virtual Reality: Learn to Maximize Present and Future Creative Possibilities!

Stephan TanguayTechnical Lead / User Experience Designer / Game Designer

info@call2action.ca

Virtual RealityLearn to Maximize Present and Future

Creative Possibilities!

What's Changed since the 90’s?

Fast ,Wide & 3D

● Immersive stereoscopic 3D● Near instant response ● Ultra wide field of view

Tools

● Unity3D & UDK

Consumer Sweet Spot

● Cutting Edge, lightweight and affordable

Did I mention Skyrim

Current Gen VR Hardware● Oculus Rift DK1 / DK2● Samsung Gear VR● Google Cardboard● Sony Project Morpheus

Oculus Rift Developer Kit 2● 75 frames per second● 2ms persistence● Response time down to 30ms● 100° FOV ( DK1 was 110° )● Motion tracking via camera● Built in latency tester

Samsung Gear VR● Android Based ( $200 HMD + Note 4 )● 96 degree field of view● 20ms response time● 60 frames per second● has integrated touch pad● includes wireless game pad

Project Morpheus

● FOV is smaller ( 90 vs 100 / 110 )● screen blurs a lot when moving● move controllers are fantastic for vr● controllers have minor line of sight issues

Google Card Board

● It’s about the SDK!● Potential for mobile hardware to adapt to VR requirements

Consumer Grade VR is Almost Here!

Current Generation of Consumer VRStrengths

● Incredible sense of presence● The ability to visually explore the virtual world● A sense of scale and distance that would normally be

impossible● Natural feeling experience

Current Generation of Consumer VRKnow the limitations

● Position tracking is great but not 100%● Resolution is still low ( takes about 4x resolution )● Controls must feel natural● Can be disorientating

Current Generation of Consumer VRDesign for the limitations

● Great standing / sitting simulator… but locomotion is tricky● User natural metaphor / anchor in the real world like being in a

vehicle that provides orientation ● Traditional 2D user interfaces can be awkward● Design interfaces into the virtual space as much as possible● Hands off the keyboard if possible, this stops the sense of

immersion

Current Generation of Consumer VRMotions to Avoid

● Avoid vertical acceleration● Avoid tilting or flipping the horizon ● Avoid high speed impacts● Avoid dramatic changes in velocity● Be aware of the inner ear ^_^

Experiences & Approaches● On Rails Narratives● 360 Video● Exploration● Horror● Driving / Cockpit Based Experiences

360 VideoWhat about video?

● Several systems allow 360 3D video ( JauntVR / Samsung )● Realtime 360 cameras ( Bubble )● Allows you to transport people and share experiences● Massive narrative potential

Sense of PresenceWhy horror is so powerful in the rift

● Sense of presence is so powerful it feels like you can reach out and touch things in the world

● Immersion means you can’t look away

Physical Controls & Cockpits● Intuitive if it matches something known in the real world● User can has expectations that match the strengths and

weakness of the experience

Exploration & On Rails Narratives● Exploit the ability to take the user literally anywhere● Visually exploring the environment has never been so intuitive

How hard it to get started?Walk through in Unity3D

● Download the Oculus SDK - Unity 4 Pro Integration from oculusvr.com

● OVR Camera Controller● OVR Player Controller

Working with the Oculus RiftMy Experiences So Far

● Very easy to retrofit games● Quick to add to new projects● Takes time to build experiences that feel natural● Maintain as high a frame rate as possible 60-80/fps

3D User Interfaces● Anchored in the virtual world not the players eyes● Rethinking interface design - move from 2D to 3D● Utilize depth, size and position in new ways● You can tell where the player is looking● Interface should give feedback ( virtual roll over )

Virtual Sight● Raycasting lets you know what the user is looking at● Power full tool to determine user intentions

Moving From 2D to 3D● Start with what you know… traditional design tools● Prototype to a better place

Interactive Virtual Spaces● you can tell where the player is looking● environment should be able to provide feedback● use this to create surprises as well

Virtual Touch● With position tracking you need to respond to proximity of the

hands● Incredibly natural and precise experience

Consumer VR Industry Impacts● Games● Realestate● Educational● Institutional ( Museums / Galleries )● Marketing● Retail

Future Potential● Consumer Version of the Oculus Rift● Leap Motion VR / Nimble VR● SixSense Position Tracking ( 5 position sensors )● Fully body tracking● VR / AR

Consumer Version!● 2k or more resolution ● Possibly 90-120 Frames Per Second● Probably next summer or later● Position tracking camera included with 360 tracking

Leap Motion?VR Related Features / Products

● VR Mount for the Oculus Rift● V2 Tracking Beta

Leap Motion VR !!!LEAP MOTION VR MOUNT

Leap Motion VR !!!V2 Tracking Beta

● Enables image pass through!

Leap Motion VR !!!V2 Tracking Beta

● Put it together

Leap Motion VR !!!Getting Started

● Leap Developer Portal https://developer.leapmotion.com/● Install runtime / V2 Tracking Beta● Unity3D Leap Integration● Leap Motion VR Pass Through Assets For Unity3D● Documentation https://developer.leapmotion.com/documentation/skeletal/csharp/index.html

● Have Fun

Leap Motion VR !!!Where to mount the leap motions

● Really depends on the height and placement of the camera

Leap Motion VR !!!Amazing Input Opportunity

● Simple intuitive user interactions● Little to no instructions required for the user● Leap Motion is releasing Leap VR user interface widgets!

Nimble VR!● Leap Motion competitor offering better tracking!

Using the Razer Hydra 360 Position tracking available today

● Enables position tracking with two hand sensors● Use to give the users a avatar and way to interact with the

world● An extreme sense of immersion since you can move 360

degrees● Use one of the sensors to track the head or body● If you do body tracking it really adds to the experience● SixSense SDK for Unity3D works on Mac / PC● Sensitive to the environment ( don’t use next to a electric motor

of any kind )

The Stem360 Position tracking available really soon…

● Up to five wireless sensors● No Line of sight requirement● 8 foot radius / range from sensor● 2 hand controllers● Very effective inverse kinematics mecanim integration

PrioVR Position tracking available soon

● Pro system tracks 17 points on the body● No line if site required● Wireless and completely untethered● Can move over 20 feet in the real world

Prio VR

● Awesome experience● Its a bit like putting on a wet suit, takes along time to get it on the first

time… but over time you could get a down to a few minutes● Hopefully coming out this fall● Can be used for cheap mo-cap

Thanks For Coming Out!

Questions?