Mixing Realities

Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354

Unprecedented access to perception

Geographical & Professional Record of Paul Reynolds • 1975 - Present

Over 16 years of interactive 3D software and experience development.

Blast Off Inc

Jellyvision

Electronic ArtsSolWorks

Atari

Magic Leap

F**K YEAH PORTLAND!

All kinds of other stuff too.

Magic Leap Headquarters • 2014 • Stirling Road, Fort Lauderdale, Florida, USA, Earth

In 2014, I saw the future…in Florida?

Optical Engineer Eric Browy • Image: http://www.wired.com/2016/04/magic-leap-vr/

It was kind of like this. (But not this.)

“It’s cool... but your demos kinda’ suck.”

Honesty • Transparency • Integrity

Reynolds Residence • 2014 • Alexandria Ave, Myrtle Beach, South Carolina, USA, Earth

This company needs my help.

We are moving to Florida.

Dragons in the room.(Sorry, no photos. Imagination required for this slide.)

Photos Not Allowed • Imagination Required

“What did I just feel?”Powerful New Experiences • Image: https://www.flickr.com/photos/-akayphotography/12657383523

My theory on reality.

Pioneer Square • Image: https://www.flickr.com/photos/adavey/8699673325

Sensory Overload • Image: https://www.flickr.com/photos/weeklydig/6146537969

Presence(Highly Simplified)

ProprioceptionSense of one’s own body

ExteroceptionSense of external stimuli

Forces • Touch • Sound • Light

Digital Brain Rendering • Image: https://www.flickr.com/photos/healthblog/8384110298

Incoming signals are processed and our reality is modeled in our mind.

True mixed reality happens when the digital signals are sufficient enough to pass the checks and balances of the perception system.

Image: https://www.flickr.com/photos/dianasch/15505299296

Vision is one of the most powerful input signals into our perception of reality.

A Focus on Vision • Image: https://www.flickr.com/photos/23560963@N03/4509631223/

Step 1: Wire a powerful computer directly into the visual cortex.

Brain Jacks • Image: https://www.flickr.com/photos/minnemom/12708596515

Just kidding.

Gotcha!

Organic Visual Cortex Interface • Image: https://www.flickr.com/photos/civilon/5425730840

These are wired in pretty well already.

Photons Are Cool

In the analog world, we are bombarded by photons.

These light signals come from physical objects containing color, brightness, and distance cues.

“We do not scan the world like a photocopier scans a document. Rather, we sporadically sample what is in front of our eyes.”Arne Dietrich • “Introduction to Consciousness”

Image: https://www.flickr.com/photos/emzee/167706499

Image: http://jov.arvojournals.org/article.aspx?articleid=2122611

Image: http://jov.arvojournals.org/article.aspx?articleid=2122611

The problem with traditional 3D display techniques has been this mismatch between the focal and vergence distance.

This incorrect signal puts our mind in “high alert” and, in the worst cases, causes discomfort.

Organic Visual Cortex Interface • Image: https://www.flickr.com/photos/civilon/5425730840

With optical view-through displays, the user is processing the analog world in a relaxed state.

If the digital content is a sufficiently similar signal, we receive the benefit of the full perception system.

At times, even creating non-visual sensations.

Mixed Reality display technology is amplified with environmental awareness.

“Aligning 3D Models to RGB-D Images of Cluttered Scenes” • Image: https://people.eecs.berkeley.edu/~sgupta/

Input is becoming more natural too.

“Aligning 3D Models to RGB-D Images of Cluttered Scenes” • Image: https://people.eecs.berkeley.edu/~sgupta/

Mixed Reality is going to give us unprecedented ability to create dynamic interactive digital content that people will have difficulty discerning from the analog world.

Image: https://www.flickr.com/photos/99574551@N04/14723454269

Image: https://www.flickr.com/photos/accidentdesigns/6137308437/

“Sounds great, but how do I create with it?”

Good News • Bad News

BAD NEWSEverything is rendered in realtime 3D. Current tools and workflows come from video game technology. If you want to start making things now, the learning curve may be steep.

GOOD NEWSTools will evolve to be more intuitive and accessible. And, most of you have lived your entire life in a 3D world!

Image: https://www.flickr.com/photos/accidentdesigns/6137308437/

It’s early days. Get in the headspace first.

Image: https://www.flickr.com/photos/accidentdesigns/6137308437/

Unlike traditional media, you no longer control the context.

Think sparse: First generation AR/MR tech will be best utilized for “magical moments” and VR is best suited for “magical worlds”

Native experiences that take advantage of the unique capabilities will always win.

Kiki the Elephant • Magic Leap, Inc.

(Quick aside.)

Reddit • https://www.reddit.com/r/oculus/comments/2m0owl/i_got_into_the_magic_leap_beta/

“I got into the Magic Leap Beta!”

Mixed Reality Grocery Game • Source: http://hyper-reality.co

Source: Artefact Group • https://www.artefactgroup.com/articles/mixed-reality-without-rose-colored-glasses

Laws of Mixed Reality proposed by @John_Rousseau

Law 1: The IndividualMixed reality must enhance our capacity for mindful attention.

Law 2: SocietyMixed reality must embody a shared human experience.

Law 3: EconomicsMixed reality must respect boundaries between commerce and data.

“The Laws provide a foundation for identifying preferable outcomes that should be considered in the creation of new products, services and business models.”

Mixed Reality Grocery Game • Source: http://hyper-reality.co

Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354

Thoughtful design always wins over novelty.

“Is this better?”

“Is this building the world I want to live in?”

Let’s help each other make cool stuff!

@MugOfPaul • paul@vertexlabs.co

Fourth Edition

Applied Mixed Reality

Mount Jefferson • Image: https://www.flickr.com/photos/nagarajan-kanna/15337821354

Paul Reynolds