HololensMixed Reality vs. VR & ARCapabilitiesUse CasesAR/MR MarketKabel OfferingEngagement Model
Dic. 2016
KABEL
Kabel is a catalyst for Human and Organizational transformation. Kabel designs, develops and constructs Digital transformation projects based on our 4P Framework: People, Processes, Platforms and Places. Our People are what makes us different. We are all proud and passionate Digital Technology Artisans. Our guiding principles are continuous learning and sharing knowledge as broadly as possible. We eat our own dogfood and use all new technology in house first. In our Kabel Lab we innovate using the latest technologies and methodologies inspired by our presence in Silicon Valley. Through our Cloud Managed Services we provide niche added value managing cloud platforms.
+21 years
105Geeks
1stMicrosoft Spanish
partner in # competencies
(19th WW)
Contents
1. Mixed Reality vs. VR & AR2. Capabilities3. Use Cases4. AR/MR Market5. Kabel Offering6. Engagement Model
Annex 1. ComponentsAnnex 2. Additional Capabilities
1. Mixed Reality vs. AR/VR
“Augmented reality overlays digital information on top of your real world. By understanding your environment, mixed reality enables holograms to look and sound like they’re part of your world.”
Source: www.microsoft.com
2. Capabilities
3D Holograms Display System Spatial Understanding Human Interaction APIs (Gaze, Gesture, Voice &
Sound) Physical Holograms Mapping System 3D Sound & 4 Microphones Recording Capabilities. MRC (Mixed Reality Capture). Sharing Capabilities. Wifi, Streaming, Hololens Sharing
(xef file)… Integration APIs. To be used with IoT, BIM, Cognitive
Services…
2. Capabilities
General Description & Features Hololens official web site. Microsoft’s HoloLens Demo at Microsoft Build 2015. It includes a
few demos about construction, healthcare, Education, + IoT-Virtual Robot (on top of a Physical Robot).
Introducing the Microsoft Hololens - what it is & what it can do. Microsoft HoloLens: what it’s really like?. Device Characteristics. Microsoft’s HoloLens at Microsoft Build 2
016.
Microsoft HoloLens Review, mind blowing Augmented Reality!. Hololens spatial sound.
2 Capabilities
HL + 3D Depth Cameras (Kinect or MSR) = Holoportation
3. Use Cases
Education. All Interactive and 3D. Healthcare. Training, explanations for patients, assisted surgery… Insurance. Cars & houses inspection reports,… Construction. Design, Customer Experience, BIM, Guidance… Tourism. f.i. Mixed Reality on top of a 360º Video. Holotour, Interactive
visits to places. Engineering. Design, Training, Maintenance… Other Sectors. Sports, Utilities, Automotive, Manufacturing,
SmartCities, etc…)
Also we can: Build our own holograms by using tools like Holostudio, beta
Actiongram or even Paint 3D Preview … Use Cognitive services and IoT to get more from people and the
environment… Or even use HLs as Multi Screen 3D Business Desktop
Use Cases. Some interesting Links grouped by sector (cont.) HealthCare
App for Training (Healthcare) Holographic Assisted Spine Surgery with Hololens MediSIM demo (HoloLens with world's first abdominal simulator) Braim Dissection VR for Babies Osiris Viewer
Education Partner Spotlight with Case Western Reserve University Galaxy Explorer: GitHub (Microsoft Open Source development
environment) Project Business-Office tools (Business Desktop)
Skype HoloStudio ActionGram Powerpoint, Outlook, Excel
Tourism Holotour
3. Use Cases
Use Cases. Some interesting Links grouped by sector Engineering
Aircraft tracker Japan Airlines at Worldwide Partner Conference 2016
Maintenance Thyssenkrupp –
bringing new vision to elevator maintenance with Microsoft HoloLens Construction
The world is 3D so build that way Three Construction Cases. (CDM Smith, Ship Building & ThyssenKrupp
elevators maintenance) Mounting Guidance. Building a 3D Model of your Room (adjusting resolution). BUILD15 Trimble HoloLens 1080p2398 ProResHQ SPLI
Smart cities gets 3D maps through Taqtile’s new ‘HoloMaps’ technology
Safety Boeing Is Fighting Wildfires with the Microsoft HoloLens & Large Drones
3. Use Cases
Use Cases. Some interesting Links grouped by sector (cont) Gaming
Old Games running in Hololens. Pokemon go on Hololens. Roboraid Fragments Young Conker Xbox controller for Hololens. Project Xray. Holy Crap, This New Hololens Demo Is Freaking Crazy.
Wearable Hologram. 3. Use Cases
4. AR/MR Market
Market Analysis and competitors Available in USA, CAN, FR, UK, IR, GE, AUS, NZ, JP How
to buy them in Spain? AR/VR Market. Predictions & Analysis. Top 5 AR developments for 2016 Some Competitors.
3 Alternatives to Hololens AiR Glasses (Atheer Labs) META Shima (Laforge)
11 AR Headsets Magic Leaps (in development Phase)
Magic Leap Concept Explored Part 1 Magic Leap is actually way behind
5. Kabel Offering
Offering1. Mixed/Augmented reality education/training - Hololens as
demo/transformational device2. Mixed Reality ideation consultancy 3. Creation of POC´s4. Creation of Minimal Viable Products5. Full product development
1. 3D Customer Experience services. (Holographic) 3D experience for Marketing Areas. Holographic App development. Involving modern services for IoT, Cognitive services, BIM….
2. Holoportation6. HoloLens Devices Deployment & Management Services.
Customization, User management, security. (HDM)7. End to end Project Management.
6. Engagement Model
Engagement Phases (HoloLens + IoT + Cognitive Services)1. Introduction & Demo. Executive Level (1h-free)2. Describe use cases by sector and functional áreas.
(Content)3. Requirements capture including demo to LOB áreas
Meeting (1,5h free)4. Design Thinking.(2-5 days).
1. Identify Pains2. Find use cases that fix them (VP)3. Build Experiment. Define working hypothesys
5. Development. Build an MVP (instrumented to meassure hypothesys-KPIs)
6. Measure. Validate with users. 7. Bussines Model Generation Support & Training.8. Redefine or abort.
Thanks!José Tomás González MartínezMarketing, Partnership & Strategic Business Development Director@J_T_GM
https://es.linkedin.com/in/jtomasgonzalez
Annex 1 Components
Hololens Device Processor: 32 Bits intel CPU/GPU & Custom HPU
(Holographic process unit) 64Gb flash, 2GB RAM CPU and 1GB HPU Battery Life 2-3 hours of active use. (we have seen up to 5
hours) Weight. 579g. Integrated Speakers Bluetooth 4.1 LE, micro USB 2.0, Wifi 802.11ac.
Hololens Device Portal app (Streaming, Video/Photo, Virtual Keyboard, App Manager, Device Info/restart…)
Hololens Development Environment. windows 10 (UWP) C# or C++. SharpDX open source software library only for C# Unity Hololens technical preview (based on unity 5.4
builds) or DirectX 11 (12 not supported). Others like Vuforia, WebGRV, KRPANO, html-5.
Visual Studio 2015 update 3 Main APIs available: Gaze Tracking (cursor-ray cast), Gesture
Input, Voice support & spatial Sound support Device Portal for Developers (mem Dumps, files,
processes…) Hololens Emulator (requires Hyper-v compatible PC)
Annex 2 Additional Capabilities
3D Holograms display system See-through holographic lenses (waveguides) that use
advanced optical projection system to generate multi-dimensional full-color holograms with very low latency
2 HD 16:9 light engines Automatic pupillary distance calibration Holographic Resolution: 2.3M total light points Holographic Density: >2.5k radiants (light points
per radian)
Annex 2 Additional Capabilities
Spatial Understanding It Includes several sensors for:
1 IMU* (Inertial Measurement Unit) 4 environment understanding cameras RGBD (depth cameras) 2MPixels photo & HD video camera Mixed reality capture (MRC) 1 ambient light sensor
Spatial understanding max. distance ≈ up to 5 Meters ≈ 38Mbytes storage needed to scan a house (70m2) using 1200
triangles resolution. Space understanding resolution can be adjusted. (Settings->systems->spaces).
* Inertial Measurement Units (IMUs) is a self-contained system that measures linear and angular motion usually with a triad of gyroscopes and triad of accelerometers. An IMU can either be gimballed or strapdown, outputting the integrating quantities of angular velocity and acceleration in the sensor/body frame. They are commonly referred to in literature as the rate-integrating gyroscopes and accelerometers.
Annex 2 Additional Capabilities
Holoportation, 3D Scanning & Advanced capabilities Holoportation Part 1 & Part 2 Holoportation. A futuristic vision of the age of holograms Affordable Holoportation based on Kinect or Gopro Cameras Scanning with Kinect V2 3D body reconstruction & recognition Creating Kinect Apps. Converting a VR app into a AR app for Hololens. Spatial Understanding. IoT integration. Hololens with Raspberry Pi
Annex 2 Additional Capabilities
Development Tools & Frameworks Basic Toolkit Installation HoloLens emulator HoloStudio. Tool to manage 3D designs. It is useful to generate Holograms
based on some predefinitions already done: Hololens PC App Installation. (needed for video streaming) Development Frameworks:
Unity Unity development overview Develop Mixed Reality Applications with Unity for Microsoft HoloLens Unity 5.5 Out of preview Unite Europe 2016 - Real World HoloLens Mixed Reality Development with
Unity Be Part of the Future Vuforia How to develop augmented reality apps with Vuforia
for Windows 10 Vuforia SDK
Others… OpenCV (Open Computer Vision), Wave, WebGRV, krpano, html-5. Tutorials for developers Personal site of Jared Bienz and Paul De Carlo (Hololens Team)
Annex 2 Additional Capabilities
Commercial edition of Hololens Includes these additional features: Kiosk Mode Windows Store for Bussiness Azure Active Directory support for Identity Management. Bitlocker Device Data Encryption HDM (Holographic Device Management) …