Upload
qualcomm-developer-network
View
922
Download
2
Tags:
Embed Size (px)
DESCRIPTION
Learn how to build breakthrough gaming and shopping experiences that take advantage of what the Smart Terrain™ feature of the Qualcomm® Vuforia™ mobile vision platform, a product of Qualcomm Connected Experiences, Inc. can offer. Intended for developers who have built at least one Vuforia app or who are proficient with Unity, this session provides a workflow overview and insights on how best to optimize for depth-sensing cameras. Watch this presentation on YouTube: https://www.youtube.com/watch?v=1RmyHZ2_vg0
Citation preview
1
Smart Terrain™ feature for Depth Sensing Cameras
David Beard Developer Evangelist, Qualcomm Connected Experiences, Inc.
Smart Terrain is a feature of the Qualcomm Vuforia SDK. Qualcomm Vuforia is a product of Qualcomm Connected Experiences, Inc.
3 3
Smart Terrain
Reconstructs the environment
Awareness of your environment
Intelligence to interact with objects and surfaces
4
Overview
Smart Terrain for standard device cameras
Advantages of Depth Sensing
How it works
Developing with Smart Terrain
5
Smart Terrain for Standard Device Cameras
6
Supported Environments
Simulated images
7
Initializing Smart Terrain
Simulated images
8
Builds Primary Surface
Simulated images
9
Detects Props
Simulated images
10
Approximates Objects & Surfaces
Simulated images
11
Smart Terrain for Depth Sensing Cameras
12
Advantages of Depth Sensing Devices
Standard Device Cameras Uses an initialization target Requires user motion Approximates objects
Infrared Depth Sensors Automatic initialization No motion required Faster and richer results
13
Depth Sensing Cameras
Standard Device Cameras Uses visible light Senses contrast
Infrared Depth Sensors Projects Infrared light Fuses RGB image & depth map
14
Automatic initialization
Simulated images
15
Faster and richer results
Simulated images
16
Surface reconstruction
Simulated images
17
Object reconstruction
Simulated images
18
Automatic scale estimation
Simulated images
19
20
Developing with Smart Terrain
21
Best Practices Recommendations for the best user experiences
Supported Environments
User Experience
Designing content
Managing meshes
22
Near range experiences Stages with visually distince borders Opaque non-reflective surfaces Stable room lighting
Supported Environments
23
Designing Content
Simulated images
24
Managing Meshes
Simulated images
25
Abstracts the features of the hardware
Consistent life cycle management
Consistent event handling
Easy portability
Smart Terrain API A universal API for depth aware devices
26
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)
27
Initialize Smart Terrain
Simulated images
28
Initialize Smart Terrain
StartMeshUpdates()
29
Build Mesh
Simulated images
30
Build Mesh
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
31
Detect Props
Simulated images
32
OnPropUpdated(Prop prop)
Detect Props
33
StopMeshUpdates(Prop prop)
Stop Reconstruction
34
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)
35
Creating a Smart Terrain App in Unity
36
For more information on Qualcomm, visit us at: www.qualcomm.com & www.qualcomm.com/blog
©2013-2014 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries,. Uplinq and Smart Terrain are trademarks of Qualcomm Incorporated. Alll Qualcomm Incorporated trademarks are used with permission.Other products and brand names may be trademarks or registered trademarks of their respective owners.of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.
Thank you FOLLOW US ON: