Patrick Spear - Cloud City

8/14/2019 Patrick Spear - Cloud City

1/26

CLOUd Cit


2/26

Cloud City in v est iages t he impl icat ion s of t echn ol ogies

t hat w il l al l ow f or t he ar bit r ar y con n ect ion of spacest hr ough portals


3/26

Por tal s v s Scr een s

A screen is something like a moni-tor or TV.

A screen is something you look at.

A screen is a 2D object

A screen belongs to the realm ofcomputing

A portals is something like a door or awindow.

A portals is something you seethrough.

A portal gives way to a 3D space.

A portal belongs to the realm of archi-tecture

To t ur n a sc r een in to a por tal , you simply hav e tochan ge w hat 's on t he scr een

acc or din g to w her e it is bein g v iew ed f r om.

This in v olv es Head t r ackin g.


4/26

Begin n in gs

Project based on the desire to pinpoint a 3D position wihtout using disruptive devices.

Bl uetoot h First experiments using other APIs to access remote hardware through Python

bindings

Wasnt feasable- strength was not precise enough, greatly affected by obstacles.

Superb support under Linux. Easy to interfaces with- Python bindings.

Built in camera with automatic globbing.

First system: simply tracked a point in 3D space using data from two Wiimotes.

Wiimot es


5/26

Headt r ackin g


6/26


7/26

IR Data: 2D coordinates globbed from the IR cam.Each Wiimote can track four automatically.

Traces: 3D scene-space vectors

Objects: Intersections of traces that infer the exsitence of an object

Concepts: The identity of objects is assigned based on object behavior

From IR Camera

To Display Server


8/26

This demo

In f r ar ed poin ts

Av atar s

Man ual COn st r uct ion

Pr oj ect ion

Headtracking

Person display

Room display

Actuation


9/26

Wit h a bit mor e t ime/ $

Fac ial Recogn it ion

cutouts

sIMPLE 3d Recon st r uct ion

l cd wal l scr een s

Headtracking

Person display

Room display

Actuation


10/26

Just ar oun d t he cor n er ...

Body an aly sis

3D model s

Compl ex 3d Recon st r uct ion

OLED Wal l scr een s

Headtracking

Person display

Room display

Actuation

Wall Wal l

Ceil ing

Tabl e

Lamp


11/26

St r uct ur e

f r om Mot ion

Subf r ame

sampl in g

Biomechan ics

Project NatalMicrosoft

Commercial Product2D3

Computer Vision ResearchUniversity of Washington


12/26

Thr ough t he por tal

When it 's poss ibl e to ar bit r ar ily choose t he adj acen ciesof your por tal s , space becomes location in depen den t .


13/26


14/26


15/26

Because t he sy st em can on ly be used by on e per sonat a t ime, por tal s ar e best pl aced in spaces w her e

peopl e of t en f in d t hemselv es alon e.


16/26

Per son al Spaces


17/26

Per son al Spaces


18/26

In c iden tal Spaces


19/26

In c iden tal Spaces


20/26

Space stor age

Local Cl oud


21/26

Space access

pr iv at e shar ed publ ic


22/26

1010001010110101010

01011010101001010110101110101010101101101010010101011011010110111010100010101110101011101010010

01001111 1

11010101

1

Space r el at ion - Basic

Vir t ual al gor it hmic r eal , han dmodel ed


23/26

S.pace r el at ion - Aw esome

Real Augemen t ed Hy Br id


24/26

Space r el at ion - cr azy aw esome

n ON- PHYSICAL bROADCAST OFFSCALE


25/26

Mult ipl e user s


26/26

Documents

Patrick Spear - Cloud City