SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481

Workflow-Oriented Science Gateway for Astrophysical

VisualizationEva Sciacca

M. Bandieramonte, U. Becciani , A. Costa , M. Krokos, P. Massimino ,

C. Petta, C. Pistagna , S. Riggi and F. Vitelloeva.sciacca@oact.inaf.it

MotivationsSeveral TBs are often generated by modern cosmological simulations and

large-scale astrophysical observations are stored in archives. Such large data volumes pose significant challenges in terms of data analysis, storage and access; a critical step forward in understanding, interpreting and verifying their intrinsic characteristics can be achieved trough visualization.DCIs access

Multiple users need to share visualization experiences, by interacting simultaneously with astrophysical datasets giving feedback on what other participants are doing/seeing. Collaborative environment

The reproduction of specific visualization results is a challenging task as selecting suitable visualization parameters may not be a straightforward process.Workflow-driven application

SCI-BUS ProjectSCI-BUS aims to create a generic-purpose gateway technology as a toolset to provide seamless access to major computing, data and networking infrastructures and services in Europe.

www.sci-bus.eu

Outline Background

• Science Gateway• Workflow System• WSPGrade/gUse

VisIVO Science Gateway• Visualization and Analysis Tools• Portlets and workflows

VisIVO Mobile Case Study Results

Science GatewayIt is a community-developed set of tools,

applications, and data collections that are integrated via a portal or a suite of applications.

Gateways provide access to a variety of capabilities including workflows, visualization, resource discovery and job execution services.

What is a Workflow?A workflow consists of a sequence of connected stepsScientific workflows allows scientists to model, design,

execute, debug, re-configure and re-run their analysis and visualization pipelines.

Part of the established scientific method is to create a record of the origins of a result: how it was obtained, datasets and experimental methods used, machine calibrations and parameters, etc.

Such information is useful for a scientist to interpret their workflow results and for other scientists to establish trust in the experimental result and re-use all the computational pipeline.

WorkflowsThe skeleton of a workflow is represented by a Graph.

Jobs denote the activities, which envelop insulated computations Channels are directed edges of a graph, directed from the output ports towards the input ports.

WSPgrade/gUse (grid and cloud User Support Environment) is a

DCI virtualization environment providing a scalable set of high-level services by which interoperation between DCIs and user communities can be achieved.

The WS-PGRADE Portal is a web portal of the gUSE. It supports development and submission of distributed applications executed on the computational resources of various distributed computing infrastructures including clusters, grids and clouds.

A web application framework constructed of functional units called portlets.

http://www.guse.huhttp://www.sourceforge.net/projects/guse

VisIVO Science GatewayThe VisIVO Science Gateway is designed as a

workflow enabled grid portal that is wrapped around WS-PGRADE providing visualization and data management services to the scientific community.

The gateway offers role-based authorization modules and supports login with user name and password.

Advanced User, can develop and configure workflow. All gUse functionalities are available.

Standard User uses Workflow developed by a “workflow developer” through an ASM.

Architecture

Visualization and Analysis Tools

11

Local or Remote (URL) User Data

VBT: VisIVO Binary Table

VisIVO Importer

VisIVO Filters

VisIVO Viewer

New VBT

https://sourceforge.net/projects/visivoserver

Navigation -- Zoom -- Palette -- Algorithms --

Data selection -- Picker op.

Visualization

Portlets…

… and workflows

VisIVO Mobile

A short demohttp://visivoportal.oact.inaf.it:8080

View the demo HERE

A case study: Muon Portal

17

The Project: Exploring the container content searching for nuclear material (uranium, plutonium)

Prototype muon track deviation

Compute: coordinates and deviation angle that the muon track has when high-Z material element is in the path.

Results

Workflow

Filtered Dataset(Threshold filtering)

Un-Filtered Dataset

Input Datas

et

POCA

Dataset Processing

Isosurface Images

Filtered Dataset

Un-Filtered Dataset

Panoramic Movies

Filtered Dataset

Un-Filtered Dataset

Filtered Dataset

Tomographic Images

Un-Filtered Dataset

ConclusionsA workflow-oriented gateway allows scientists to

share their analysis workflows and identify best practices for investigating their datasets. More importantly, they can automate workflows for repeated analysis with changed parameters. This way scientists can focus on their core scientific discoveries as opposed to spending time in data analysis on inadequate resources.

Through the shareable workflows and reusable portlets of the gateway, not just astrophysicists but also other scientific fields scientists can exploit the developed technologies.

Thank you for your attention!

Development Tools

A free, open-source Integrated Development Environment for software developers.

A web application framework for Rich Internet Applications. It features a robust server-side architecture. It offers a large collection of UI components such as Buttons, Tables, Trees and Layouts. The components use events, listeners and data binding to communicate with each other and with the business logic.

VisIVO DCI Infrastructure- Trigrid Cluster - AMD Dual Opteron 280 2.4

GHz, 14 Blades with 4 cores with 8 GB RAM / Blade (52 CPU core) - Total storage: 3.7 TB (lsf)

- 2 X Server Intel Xeon 3060 2.4 GHz, Dual-Core, 2 GB RAM - Total storage: 23 TB

- Server Intel Xeon 3050 2.13 GHz, Dual-Core, 2 GB RAM - Total storage: 8 TB

- Hybrid system  cpu-GPU, N 2:  Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz, 24 GB RAM DDR3-1333 NVIDIA TESLA C2070, 448 cuda core + 6 GBRam

- COMETA grid – gLite nodes ~1500 CPU/core (250 hosted at INAF-OACT) AMD Dual Opteron 280 2.4 GHz (jdl)

VisIVO Gateway:Infrastructures