Download pptx - insideAR Tokyo 2014 - AR Maintenance - How to create guided-through maintenance applications - Workshop

AR Maintenance How to create guided-through

maintenance applications

Thomas Berton - Metaio

Table of contents1. Introduction2. The scenario3. Tracking configuration preparation4. Content preparation5. AREL Package creation6. Tests and deployment7. Conclusion8. Q&A

InsideAR Tokyo 2014 – How to create guided-through maintenance applications

Introduction – The Metaio SDK: Rough overview


Camera image capturing

Rendering

Tracking

AR experience

Application(choices: online/offline, native/AREL programming language, platform, ...)

Introduction – Tracking technologies• Image/pattern recognition

– 2D marker• ID markers• Picture markers

– 2D markerless– LLA marker– Extensible tracking

• Object and environment recognition and exploration– 3D tracking– Edge-based initialization + 3D tracking

• Instant tracking• Sensors

– GPS position / orientation• Barcodes, QR codesInsideAR Tokyo 2014 – How to create guided-through maintenance applications

Introduction – Rendering features• SDK provides own rendering

– Loading MD2, OBJ, MFBX* models– Adjustment of translation, rotation, scale based on tracked coordinate system or

other coordinate system (e.g. in camera space; relative to screen corners e.g. for GUI purposes)

– Built-in effects: environment mapping (reflections), fade in when pattern tracked– Dynamic lighting– Custom shading

• Custom rendering– Use any 3D/game engine or renderer– Only use Metaio SDK for capturing/tracking of camera images and calculating

the pose• Unity pluginInsideAR Tokyo 2014 – How to create guided-through maintenance applications

Introduction – Different platforms and application types


Native application(Java / C++ / Objective-C)

AREL-based application

(JavaScript, cross-platform)

AREL Player(JavaScript, standalone for

Windows/Mac)

Unity(choice between

C#/JavaScript/Boo)

Junaio channel(JavaScript, cross-platform)

Cloud Plugin(JavaScript, cross-platform)

The scenario• On the air conditioner, we will guide the maintenance worker through

different procedure to remove the fan and the fan motor of the unit

• We will use AREL and the Metaio SDK with edge based initialization


Tracking configuration preparation• 2 tracking configurations

– 1 for application development – On an image– 1 for the final application – On the real object

• Application development– Image provided in the Metaio SDK (AR Marker)

• Final application tracking (Edge based initialization)– From the CAD data of the object– Creator and Edge based initialization configurator


Content preparation• In the Metaio Creator

– Check that the models are properly displayed– Align the elements properly– Find out the names of the animations– Test with the live preview

• Convert FBX to MFBX


AREL Package creation• XML containing

– AREL configuration• Tracking configuration• Objects

– Scenario configuration• User workflow• Parameters for the different steps

• HTML files for the GUI• Assets• Tracking configuration files• JavaScript logic / AREL filesInsideAR Tokyo 2014 – How to create guided-through maintenance applications

Test and deployment• Change the tracking configuration file to the real object tracking

• Test on the real object

• Make fine tuning adjustment


Conclusion• Simple maintenance workflow

• AREL based – Platform independent

• Can be extended easily with XMLs

• Track any type of object (simple or complex)

• Works with wearable


Q&A


MetaioPhone (EMEA): +49-89-5480-198-0Phone (US): [email protected]

http://www.facebook.com/metaio

@twitt_ARhttp://twitter.com/#!/twitt_AR

http://augmentedblog.wordpress.com/

http://www.youtube.com/user/metaioAR