Embed Size (px)
Citation preview
IMPROVING PRESENCE WITH DEPTH SENSOR TECHNOLOGY
Dennis LinNuvixa, Inc.“Vision Guy”
3 | Presence with Depth Sensor | June 14, 2011
IMPROVING PRESENCE WITH DEPTH SENSOR TECHNOLOGY
4 | Presence with Depth Sensor | June 14, 2011
SUMMARYWhat we do–Remote presence
How we do it–Depth sensors and (accelerated) computer vision
Why it’s cool–Practical augmented reality
5 | Presence with Depth Sensor | June 14, 2011
A REMOTE PRESENCE REVOLUTION
Nuvixa’s focus is on delivering a radically improved virtual-presence experience, accessible to everyone…
…more immersive, compelling, and intuitive than any existing video technology
6 | Presence with Depth Sensor | June 14, 2011
CURRENT GENERATION
7 | Presence with Depth Sensor | June 14, 2011
REVOLUTION
8 | Presence with Depth Sensor | June 14, 2011
THE SPEAKER IS A ROCKSTARFree to walk aboutIn command of the content
9 | Presence with Depth Sensor | June 14, 2011
MAINSTREAM VIRTUAL PRESENCEWe take the new types of affordable 3D sensors…
…add our own state-of-the-art computer vision algorithms & know-how…
…to deliver a new video experience
10 | Presence with Depth Sensor | June 14, 2011
DEPTH SENSOR
11 | Presence with Depth Sensor | June 14, 2011
TECHNOLOGIESStructured Light–PrimeSense–Kind of like stereo–Good for long range–Higher resolution (for now)
Time of Flight–SoftKinetic, PMDTechnologies–Good at short range–Less sensor shadow–Less calibration
12 | Presence with Depth Sensor | June 14, 2011
THE MAIN ADVANTAGE
13 | Presence with Depth Sensor | June 14, 2011
SOFTWARE
14 | Presence with Depth Sensor | June 14, 2011
NAÏVE SEGMENTATION
15 | Presence with Depth Sensor | June 14, 2011
ADVANCED PROCESSING
16 | Presence with Depth Sensor | June 14, 2011
RESULT
17 | Presence with Depth Sensor | June 14, 2011
OPENCLReal-time problem–Jitter > latency > throughput–Avoid pipelining to prevent latency
Vision is parallelParallel is hard–But it keeps you honest
Memory is key–Use appropriate memory transfer–Avoid blocking calls (use the queueing API)
18 | Presence with Depth Sensor | June 14, 2011
HINTS FROM OUT OPENCL GURUVector is one of the advantages–Easy to use, especially for
matrices
Want 128 workitems in work groups–That’s the minimum
recommended
Use AMD profiling tools–GPU events
Memory alignment isn’t as much an issue–Cache
Avoid branches–This includes short-circuit and/or–Use select()
Write test cases
19 | Presence with Depth Sensor | June 14, 2011
AUGMENTED REALITYTo improve remote presence, we need solutions that
…are natural – avoid having to learn complex gestures
…are robust – so that you know the systemfights for you, not against you
…are compelling – to deliver an interacitveexperiences never before possible
20 | Presence with Depth Sensor | June 14, 2011
COMPARE
21 | Presence with Depth Sensor | June 14, 2011
CHANGE BULLETS
22 | Presence with Depth Sensor | June 14, 2011
FOCUS
23 | Presence with Depth Sensor | June 14, 2011
FUTURE
24 | Presence with Depth Sensor | June 14, 2011
http://nuvixa.com/stagepresence
25 | Presence with Depth Sensor | June 14, 2011
Disclaimer & AttributionThe information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors.
The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and roadmap changes, component and motherboard version changes, new model and/or product releases, product differences between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. There is no obligation to update or otherwise correct or revise this information. However, we reserve the right to revise this information and to make changes from time to time to the content hereof without obligation to notify any person of such revisions or changes.
NO REPRESENTATIONS OR WARRANTIES ARE MADE WITH RESPECT TO THE CONTENTS HEREOF AND NO RESPONSIBILITY IS ASSUMED FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION.
ALL IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE ARE EXPRESSLY DISCLAIMED. IN NO EVENT WILL ANY LIABILITY TO ANY PERSON BE INCURRED FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
AMD, the AMD arrow logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. All other names used in this presentation are for informational purposes only and may be trademarks of their respective owners.
The contents of this presentation were provided by individual(s) and/or company listed on the title page. The information and opinions presented in this presentation may not represent AMD’s positions, strategies or opinions. Unless explicitly stated, AMD is not responsible for the content herein and no endorsements are implied.
