1

CEEA Collaborative Engineering Environment for

Visualizing Engineering Simulations

Ismael H. F. dos Santos 1

Prof Dr Marcelo Gattass 2

Dr Alberto Raposo2

1-CENPES/Petrobras 2-Tecgraf/PUC-Rio

PhD Thesis – April 10

2

Large-scale Engineering Projects CPSE - Collaborative Problem Solving Environment

CEE - Collaborative Engineering Environment, as a CPSE for Engineering

Related works CEE Conceptual Model Application Scenarios Conclusion

Main Contributions Future Work

Publications

Outline

3

CEE Large-scale Engineering Projects

4

Large-scale Engineering Projects

Highly data intensive and computational demanding

Highly multidisciplinary, requiring the cooperation of different specialists

Involve large distributed teamsof researchers working together on a single complex problem

Each team of specialists has its own model of the engineering artifacts to be designed

Specialists have limited ability to understand each other's model

They proceed by successive refinement of the models.

5

LSEP example – Aircraft Projects

6

LSEP example – Offshore Engineering

Design of oil production units, mooring systems, production rises, anchor system

Integrated Visualization of production systems Sea Floor arrangement. Mooring and riser systems

Simulation of Structural Behaviors

7

LSEP Requirements

LSEP Requirements: Remote Collaboration Virtual Reality Visualization High Performance Computing (HPC)

LSEP main characteristics: Multidisciplinary, requiring cooperation of different specialists

organized in large distributed teams using distributed and heterogeneous resources;

Private partial models, with limited ability to understand each other’s model. Due to their huge complexity, LSEP are divided into smaller interrelated subprojects where each one have an equivalent representation of the others.

Data intensive & computational demanding;

8

LSEP Requirements

Virtual Reality Visualization and Remote Collaboration Understanding the output of large-scale computational science

runs is typically a group task, often with experts geographically distributed;

Analysis takes place over several days to weeks; Complex multi person problem solving strategies often are

required to understand and validate the simulation output. Data exploration through visualization provides new insights to

the users by comparing results from multiple simulations with distinct points of view in a 3D world.

HPC Large-scale computing work naturally fits into campaigns of

multiple weeks per problem with breathers in between

9

CPSE - Collaborative Problem Solving Environment

Problem Solving Environment (PSE) is a specialized software system that provides all the computational facilities needed to solve a target class of problems

Collaborative Problem Solving Environments (CPSE) focus on the development of a PSE coupled with collaborative environments to support the modeling and simulation of complex scientific and engineering problems

LSEP Requirements Remote Collaboration Massive Visualization High Performance Computing (HPC)

10

CEE CPSE - Collaborative Problem Solving Environment

CEE - Collaborative Problem Solving Environment for Offshore Engineering

11

PSE: a typical scenario in scientific andengineering research

Activities are: Iterative, dynamic and human centered Requires different levels of resources

Define problems Simulations /Experiments

Data analysis Discovery

• Analysis

• Hypothesis

• Related work

• Propose experiments

• Define steps

• Prototype computing systems

• Perform experiments

• Data collection

• Visualization

• Validation

• Adjust experiment

• Refine hypothesis

• Presentation

• Present results

12

PSE: a typical scenario in scientific andengineering research

Define problems Simulations /Experiments

Data analysis Discovery

Traditional PSE: organize and execute resources locally!

Scientific workflow management systems:A new guise of PSE!

13

CEE - Collaborative Problem Solving Environment for Offshore Engineering

Main Components: Collaborative Visualization Environment

Virtual Reality Visualization (VRV) tool Videoconference System (VCS)

Scientific Workflow Environment Scientific Workflow Management System (ScWfMS) Grid Computing Infrastructure (GCI) Data Access Service

Project Management Environment Workflow Management System (WfMS) Document Management System (DMS)

14

CEE - Collaborative Problem Solving Environment for Offshore Engineering

22

15

CEE Related Works

16

Related Works

Klie et ali [KBG+06]. DDMSF (Data Driven Multiphysics Simulation Framework), a PSE for multiphysics simulation

Paventhan et al. [PTC+06] proposed the creation of a Scientific Workflow for wind tunnel applications

17

Related Works

Vistrails, C. Silva et ali [CFS+06] is a visualization management system for data exploration

IAM provides a modeling environment for specifying and executing a workflows from reservoir simulations to economic evaluation [SBO+06]

18

Related Works - Comparison

19

CEE CEE Conceptual Model

20

CEE Main ComponentsScientific Workflow Environment:

Scientific Workflow Service Grid Computing Infrastructure Engineering Simulation Service Data Access Service

21

CEE Main ComponentsCollaborative Visualization Environment:

Videoconference Service VR Visualization Service Collaboration Manager Service

22

CEE Main ComponentsProject Management Environment:

Project Workflow Service Project Repository

23

SOA Architecture

Business Process Engineering for CEE

24

CEE SOA Architecture

3311

25

CEE Detailed SOA Architecture

22

26

CEE Usage Scenario Overview

Project Workflow1. Project Workflow

• Engineering Simulation

2. Abstract Workflow3. Concrete Workflow

1. Collaborative Modeling

2. Distributed Execution

3. Collaborative Visualization

27

User interaction with CEE1. User A accesses the CEE

Portal through a web browser

2. Services are requested from the CEE Server

3. User A models collaboratively with User B a Concrete Scientific Workflow

4. User A submits the workflow as a simulation on a Grid integrated into the CEE infrastructure

5. Results are visualized in a Collaborative Visualization Session with User B

28

CEE Scientific Workflow

Scientific Workflow: Modeling and Executing a

Scientific Workflow Constructing the Riser Analysis

workflow on BPEL Designer

29

CEE Portal

30

CEE Collaborative Visualization

31

CEE Application Scenarios

32

Collaborative Risers Analysis

Videoconference (Environ + CSV Tool)

33

Collaborative Risers Analysis

3D Annotations: Two users making comments

and creating 3D annotations in a CEE collaborative visualization session

34

Collaborative Riser Analysis3D Measurements: Users monitoring the behavior of

marine buoyant

35

Design Review

Measurements in a CAD

Engineering information

36

Virtual Guided Tour

1. Two users in a CEE collaborative visualization session

2. Users following a 3D path passing through important points

3. An annotation is created to mark some important event on the platform, maintenance or commission of new equipment

1

32

37

CEE Conclusion

38

From the offshore engineering viewpoint, the proposal of using a Scientific Workflow in their project life cycle

allows them to have a more structured way to solve their problems the idea of a CPSE conduces to the creation of engineering tools that

can be used by a wider group of users;

From the visualization viewpoint, the integration of a VRV and Remote Collaboration in the PSE

facilitates the information exchange and common understanding of complex problems. Users are compelled to think the overall solution of an engineering problem, using the visualization as a first class tool;

Contributions

39

From the CPSE viewpoint (cont.) Using an SOA architecture with an ESB and a MOM for dealing with

distributed applications and allowing then to cooperate using different technologies and with an asynchronous paradigm is also a valuable contribution for constructing a CEE;

Contributions

40

Project Workflow Environment: Introduction of Project Management System with an Integrated Data

Management System tor control all documents and artifacts generated during the project lifecycle;

Close and functional integration with ERP systems, like SAP;

Scientific Workflow Environment: Implementation of the Open Provenance Model for BPEL workflows Use of an Ontology inference engine for better creating new scientific

workflows and carefully choosing its parameters; Support for data replication and data distribution management

providing a real transparency of localizations to CEE

Future Work

41

Project Workflow Environment: Introduction of Project Management System with an Integrated Data

Management System tor control all documents and artifacts generated during the project lifecycle;

Close and functional integration with ERP systems, like SAP;

Scientific Workflow Environment: Implementation of the Open Provenance Model for BPEL workflows Use of an Ontology inference engine for better creating new scientific

workflows and carefully choosing its parameters; Support for data replication and data distribution management

providing a real transparency of localizations to CEE

Collaborative Visualization Environment: Multimedia Communication System with a more powerful tools, such

as instant messages, better audio / video tools, etc Agent Based system for improving collaboration among users during a

collaborative visualization session

Future Work

42

Future Work Computational Steering towards a Colaborative Tele-immersive PSE

43

CEE Publications

44

Detailed publications list http://www.tecgraf.puc-rio.br/~ismael/imk/publications/publications.html

Publications from last 5 yearsPeriodicals Environ: Integrating VR and CAD in Engineering Projects. IEEE Computer

Graphics & Applications, v.29, n.6, p.91-95, 2009. (ISSN 0272-1716). DOI: 10.1109/MCG.2009.118. Raposo, A., Santos, I. H. F., Soares, L., Wagner, G., Corseuil, E., Gattass, M.

Book Chapters Collaborative Environment for Engineering Simulations with Integrated

VR Visualization. In: Lecture Notes in Computer Science, On the Move to Meaningful Internet Systems: OTM 2008 Workshops - Vol. 5333/2008, Springer Verlag, Berlin/Heidelberg, 2008, p. 12-13. (ISBN-978-3-540-88874-1). Santos, I. H. F, Raposo, A. B., Gattass, M.

Publications

45

Publications from last 5 years(cont.)Book Chapters A Service-Oriented Architecture for a Collaborative Engineering

Environment in Petroleum Engineering. Virtual Concept International Conference. CanCun, Mexico, 2006. Research in Interactive Design Proceedings of Virtual Concept 2006, Springer Verlag (ISBN-10: 2-287-48363-2, ISBN-13: 978-2-287-48363-9). Santos, I. H. F, Raposo, A. B., Gattass, M.

Papers in Conferences2009 Integrating The Galileo Applications For Simulation of Offshore Systems

Via The GXML Unified Format. XXX CILAMCE - Iberian Latin American Congress on Computational Methods in Engineering - 2009 (CD-ROM), p 1-15. Buzios, RJ, Brasil.Santos, I. H. F, Braganholo, V., Mattoso M., Jacob, B. P., Albrecht, C.

Publications

46

Publications from last 5 years(cont.)Papers in Conferences (cont.)2009 Integrating VR in an Engineering Collaborative Problem Solving Environment.

ICEIS 2009 – 11th International Conference on Enterprise Information Systems, Vol HCI, p. 124-129. Milan, Italy, 2009. Santos, I. H. F, Raposo, A. B., Gattass, M.

Managing Information of CAD Projects in Virtual Environments.. XI Simposium on Virtual and Augmented Reality – SVR 2009, p. 168-174. Porto Alegre, Brasil, 2009. Soares, L. P., Carvalho, F. G., Raposo, A. B., Santos, I. H. F.

2008 A Software Architecture for an Engineering Collaborative Problem Solving

Environment. 32nd Annual IEEE Software Engineering Workshop – SEW 2008, p. 43-51. Kassandra, Greece, 2008. Santos, I. H. F, Raposo, A. B., Gattass, M.

Collaborative Environment for Engineering Simulations with Integrated VR Visualization. 16th International Conference on Cooperative Information Systems –COOPIS 2008. Lecture Notes in Computer Science, Vol. 5333, p. 12-13. Monterrey, Mexico. Springer-Verlag, 2008. Santos, I. H. F, Raposo, A. B., Gattass, M.

Publications

47

Publications from last 5 years(cont.)Papers in Conferences (cont.)2008 EnViron: An Integrated VR Tool for Engineering Projects. 12th International

Conference on CSCW in Design – CSCWD 2008. Xi’an, China, RJ, Abril 2008. Santos, I. H. F, Raposo, A. B., Soares, L. P., Corseuil, e. T. L., Wagner, G. N., Santos, P. I. N., Toledo, R, Gattass, M.

Environ: Uma Ferramenta de Realidade Virtual para Projetos de Engenharia. XXIX CILAMCE - Iberian Latin American Congress on Computational Methods in Engineering - 2008 (CD-ROM), 17p. Maceió, AL, Brasil, 2008. Soares, L. P., Corseuil, E. T. L., Raposo, Gattass, M., Santos, I. H. F.

2007 Uma Ferramenta de Videoconferência para apoiar Múltiplas Sessões de

Trabalho Colaborativo. XIII Brazilian Symposium on Multimedia and Web, WebMidia 2007, Oct 2007, Gramado, RS, Brazil. Lima, L. S., Karlsson, B., Raposo, A. B., Santos, I. H. F.

Publications

48

Publications from last 5 years(cont.)Papers in Conferences (cont.)2006 Towards the Use of CAD Models in VR Applications - ACM SIGGRAPH

International Conference on Virtual-Reality Continuum and its Applications in Industry, VRCIA 2006, pp 67-74, June, Hong Kong, China, (ISBN 1-59593-324-7). Raposo, A. B., Corseuil, e. T. L., Wagner, G. N., Santos, I. H. F, Gattass, M.

2004 A Multimedia Workflow-Based Collaborative Engineering Environment for Oil

& Gas Industry. ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, VRCAI 2004, pp 112-119, June 2004, Singapore, SI, (ISBN 1-58113-884-9). Santos, I. H. F, Göbel, M., Raposo, A. B., Gattass, M.

A Multimedia Collaborative Engineering Environment.- 6th International Conf. on Enterprise Information Systems, ICEIS 2004, pp 259-262, April 2004, Porto, PT, (ISBN 972-8865-00-7). Santos, I. H. F, Valle, C., Raposo, A. B., Gattass, M.

Publications

49

CEE

Questions ?

50

CEEA Collaborative Engineering Environment for

Visualizing Engineering Simulations

Ismael H. F. dos Santos 1

Prof Dr Marcelo Gattass 2

Dr Alberto Raposo2

1-CENPES/Petrobras 2-Tecgraf/PUC-Rio

PhD Thesis – April 10

51

Principais serviços Service Coordinator: responsável por criar e controlar a execução de uma

Collaborative Visualization Session Service Registry: contém o registro dos serviços disponíveis na máquina do

cliente

Collaboration Manager Service: armazena a informação a respeito dos usuários logados que fazem parte da sessão colaborativa

Visualization Service: responsável por dar o suporte para a execução de uma Visualization Session e, em conjunto com o Colaboration Manager Service, suportar a criação de uma sessão de visualização colaborativa

Videoconference Service: responsável por controlar a evolução de uma sessão de videoconferência que ocorre simultaneamente com uma sessão de visualização

Project Workflow Service: controle do ambiente de projeto\

Data Sources Service: responsável pela conexão com as bases de dados do Simulador Galileu

52

Registro de Serviços Primeira etapa a ser

executada no Simulador Galileu

Componentes responsáveis: Service Registry Collaboration Manager

Service

Registro dos serviços: Environ Service VC Service User Service

53

Ambiente de Projeto O Simulador Galileu é um

Ambiente Colaborativo de Resolução de Problemas (CPSE - Collaborative Problem Solving Environments)

Criação de workflowscientíficos a partir de uma base de workflows previamente definidos

54

Videoconferência Análise colaborativa

dos resultados de uma simulação

Cada conferência criada é registrada no CSV Multiserver

Principais Componentes: Service Coordinator Session Manager VC Service VC Proxy CSV Client

55

Visualização EnViron (ENvironment for

VIRtual Objects Navigation) -visualização de modelos massivos CAD e simulações de engenharia em ambientes imersivos

Principais componentes da Sesão de Visualização Colaborativa:

Service Coordinator Session Manager Environ Service Environ Proxy Environ

56

Sending Commands

57