More Efficient and Intuitive PLM by Integrated AR/VR€¦ · 15 Training for Assembly & Service...

Round Table Session – Georg Fiechtner

More Efficient and Intuitive PLM by

Integrated AR/VR

Service Portfolio

2

PLM Consulting

PLM Software

Development

Human-System

InteractionAMS

• Processes• Systems• Technologies

• Design• Customization• Implementation• Rollout

• Clients:Rich/Web/Mobile

• VR/AR/MR/VUI• AI

• Global Support Models

• Levels 2-4

3

4

Which Industries are here today?What is your expectation on xR from a today‘s perspective?

Source: https://www.gartner.com/smarterwithgartner/top-trends-in-the-gartner-hype-cycle-for-emerging-technologies-2017/

5

With Expectations Set Straight...

6

VR/AR is gaining momentum

In the Consumer Market

With Expectations Set Straight...

7

Shorter innovation cycle of consumer electronics (< 2 years)

especially due to strong competition

VR/AR is gaining momentum

8

With Expectations Set Straight...

9

Most user friendly/intuitive systems win – Standards emerge

VR/AR is gaining momentum

So

urc

e:

htt

ps:/

/re

ad

wri

te.c

om

/2

01

7/0

7/1

0/vr-

ar-

he

ad

se

t-sa

les-2

02

1-d

l4/

10

What do you expect from the Consumer Market?In your opinion, how does it influence the industry?

11

How can this be applied to PLM?Examples? Why?

VR Product Configurator

12

Mercedes Me Store in Hamburg

Product-

planning

Design &

Engineering

Production-

planningProduction Sales Service Recycling

► „85 percent of new car buyers still make use of the classic dealership

touchpoints, three-quarters of these customers are dissatisfied with the

quality of their experience there“

► real-time gaming technology to create a photorealistic interactive scenario

► real-time rendering on the basis of CAD data and information from PDM

► time required for project: „a few weeks“

Source: http://www.mackevision.com/references/mercedes-benz-w213-real-time-application/

Product Design & Engineering

13

Collaboration in VR

Product-

planning

Design &

Engineering

Production-

planningProduction Sales Service Recycling

So

urc

e: h

ttp

://w

ww

.ma

cke

vis

ion.c

om

/port

folio

/sh

are

d-s

tudio

-vr/

► Rapid presentation and testing of models in different (prepared) scenarios

► Photo-realistic presentation

► A collaborative VR space with multiple users (multi-user approach)

► Worldwide interaction with users in different locations

► Interaction with the VR model such as adding comments or voice notes

Product Design & Engineering

14

BMW Mixed Reality Lab

Product-

planning

Design &

Engineering

Production-

planningProduction Sales Service Recycling

Sources:

(*) https://pro.merckgroup.com/archive/en/welcome-to-the-holodeck/

https://uploadvr.com/bmw-is-using-vr-mixed-reality-build-your-next-car/

https://www.unrealengine.com/en-US/blog/bmw-opts-to-incorporate-htc-vive-vr-headsets-and-mixed-reality-into-the-development-of-new-vehicle-models

► Room-scale VR with an area of 5 x 5 metres

► Based on HTC Vive

► Merge between physical model and photorealistic virtual world

► More than 20 developer stations of this type(*)

► Can cheaply and quickly be updated with better and

additional hardware, e.g.

o New version of base stations (10 x 10 metres VR area)

o Wireless HMD-Kit (TPCast, ...)

o Finger/Hand-capturing (Leap Motion, ...)

► Based on Unreal(R) Game Development Platform / Engine

15

Training for Assembly & Service

Product-

planning

Design &

Engineering

Production-

planningProduction Sales Service Recycling

VR Repair Training

VR Assembly Training ► Room-scale VR with an area of 5 x 5 metres

► Based on HTC Vive

► Based on Unity Game Development Platform / Engine

► For Mobile and VR devices

► Training context and content defined in dynamically loaded PLMXML

► Supports parts, tools, operational information,

assembly/disassembly animations (from NX)

► Uses pre-defined scenes

► Semi-automatic CAD-data preparation (tesselation / cleanup)

PITERION Customer Studies

How is it Done?

16

Semi-automatic step from PLM to VR / Rise of content creation plattforms

Product-

planning

Design &

Engineering

Production-

planningProduction Sales Service Recycling

Source: http://www.mackevision.com/portfolio/visualization-data-management/

Authoring Plattform/Pipeline

17

Design Validation

19

Dealing with large and multi-format CAD-data sets

PDM

CA

D

Pro

cess

Dat

a

Insp

ecti

on

Sce

ne

Automated CAD Conversion+ Reference Mapping

UpdateChanges

UpdateChanges

Reference Mapping+ Transfer Changes

Minutes Seconds

VR

Insp

ecti

on

VR

Sce

ne

& M

od

el

Process Simulate to VR

20

Manufacturing – Programming Robots in VR

21

(*) exluding application of materials

Usability Improvements

22

► Mitigate Motion Sickness

► Dynamic calibration of HMDs

► Natural User Interfaces (Gesture, Voice, Gaze)

► Adapt to User (experience, needs, limitations)

► Use of Cognitive Capabilities...

(Machine Learning)

VR/AR must be as immersive and intuitive as the real world

Cognitive AR

23

Machine Learning Methods + Augmented Reality Techniques

Sourc

e: http://w

ww

.ioxp.d

e/e

n/ioxpcognitiv

e-a

r/

Step 1: Record actions of expert

Cognitive AR

24

Machine Learning Methods + Augmented Reality Techniques

Step 2: Understand workflow &

automatically create service manual

Sourc

e: http://w

ww

.ioxp.d

e/e

n/ioxpcognitiv

e-a

r/

Cognitive AR

25

Machine Learning Methods + Augmented Reality Techniques

Step 3: Guide user from any step &

understand progress

Sourc

e: http://w

ww

.ioxp.d

e/e

n/ioxpcognitiv

e-a

r/

Cognitive AR

26

Machine Learning Methods + Augmented Reality Techniques

Step 3: Guide user from any step &

understand progress

Sourc

e: http://w

ww

.ioxp.d

e/e

n/ioxpcognitiv

e-a

r/

Cognitive VR

27

Machine Learning Methods + Virtual Reality Techniques

Sourc

e: https://c

ognitiv

e3d.c

om

/► Measure action and engagement in immersive vehicle experiences

► Develop insights around showroom configurations

► Identify issues or compliance with training scenarios

► Test manufacturing and assembly line configurations

► Determine health and safety issues in manufacturing process

A Quick Glance into the Future

The Future of Industrial xR

29

► xR will be the medium to reduce complexity, transport information, create content

(in combination with other technologies, like Machine Learning)

► xR Authoring Plattforms and Pipelines will emerge

► That either interface or merge with current PLM systems (only way to scale)

► xR is all about software – it will become device agnostic

► People will become more and more xR savy (like with smartphones today)

► There will be standards and best practices on how to interact with xR

(heavily influenced by the consumer market)

~ 5+ years

PLM

Co

gn

itiv

e

Me

tho

ds

30

Plattform for PLM-VR/AR/MR Applications

Device Abstraction

xR-Plattform

Process

Data

xR-Authoring

xR-PLM Plattform

ScenesCAx

FunctionsMaterials

xR-BOM/BOP

Autom. CAD Import/Preparation Virtual Collaboration

31

Start now and make xR a vital part of your Digitalization Strategy!

32

Where is your standing with xR?In Consideration/PoC/Large Scale Use?

Thank You for Your Attention!

Tel.:

Fax:

Mob:

Email:

Web: www.piterion.com

Georg FiechtnerInnovation Management

+49 89-2000 395-62

georg.fiechtner@piterion.com

+49 89-2000 395-80

+49 173 6041751

PITERION GmbH

Reichenbachstraße 2

85737 Ismaning

3424.10.2017

„... A membership funded alliance, helping to accelerate the

adotion of Enterprise Augmented Reality by creating a

comprehensive ecosystem.“

http://thearea.org/

The cross-platform VR standard

eliminates industry fragmentation

by enabling applications to be

written once to run on any VR

system, and to access VR devices

integrated into those VR systems to

be used by applications.

https://www.khronos.org/openxr

37

Source: https://uploadvr.com/oculus-nate-mitchell-oc4/

More than a Hype?