SCI-BUS is supported by the FP7 Capacities Programme under contract RI-283481ER-FLOW is supported by the FP7 Infrastructures under contract RI-312579

Workflows for HELIOPhysics

Dr. Gabriele PierantoniDr. David Perez Suarez

Workflows for Heliophysics

• What advantages ? – Formal representation of a process– Allows to handle very complex

programs– Allows sharing of knowledge through

repositories.

Workflows for Heliophysics

• What are they for ? – Propagation Models– Search metadata– Extract metadata

Workflows for Heliophysics

• Where do they come from ? – Propagation Models

• WS-PGRADE (TCD-SCSS & Others)– Search metadata

• TAVERNA (HELIO)– Extract metadata

• WS-PGRADE (TCD-PHY & TCD-SCSS)

Propagation Models

• A propagation model is used to help determine which observations, where and when may be of interest in order to satisfy the user's search criteria.

Advanced Propagation Model

Origin

t

Target

t

Perio

d of

inte

rest E

E

ETA Range

P = Pmin

P = Pmax

EP = POK

Propagation Models

Download Event List from catalogues

Step Workflow MeaningSourceEventFinder Given a list of catalogues an extraction

criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Extract Parameters

Step Workflow MeaningSourceEventFinder Given a list of catalogues an extraction

criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Extract Time Ranges

Step Workflow MeaningSourceEventFinder Given a list of catalogues an extraction

criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Execute the model

Step Workflow MeaningSourceEventFinder Given a list of catalogues an extraction

criteria returns a VOtable with the list of all relevant events

ParameterExtractor Givent a list of events, it extracts the parameter values or ranges that are relevant for the execution of the propagation model.

TimeExtractor Given a list of events, it extracts the time values or ranges that are relevant for the execution of the propagation model.

Propagator It invokes the SHEBA propagation model with the parameters and times produced by ParameterExtractor and TimeExtractor

Ranker It ranks the results of the propagation model.

Rank the results

LO-FAR

• LOFAR is a real-time multiple sensor array.

• Very different sensors can be placed along a common infrastructure and make use of it the same time.

• Analysis of raw frequency data requires significant storage and computation resources.

• We are developing a standardizes processing and storage workflow to the community to be easily configured

Processing Nodes

• Data Staging• PreProcessing• Processing• PostProcessing• DataPublications

Java Standard Node

PORTLET / PORTAL

WORFLOWS

NODES

PROGRAMS

Java Standard Node

Standard Java Node

Input Data

Input Status

Input Parameter

Output Data

Output Status

Java Standard Node

Input Data

Load FilesInput Status

Input Parameter

Check Status

Failed

Processing

Completed

Output Data

Output Status

Java Standard Node

AbstractGenericNode

AbstractStringNode

ConcreteStringNode

Defines the sequence of actions

Defines how to read and write files

Defines the processing

Metadata Extraction(LO-FAR)

Metadata Extraction(LO-FAR)

ER-FLOW

WS-Pgrade WorkflowsDevelopment of HELIO portal

Access to DCIs

Web ServicesTAVERNA workflows

Events Count

Events Count

Counts the number of events for a period.

Fastest CMEs Propagation

This workflow is used to investigate one of the most relevant events in HELIOphysics; Coronal Mass Ejections. The propagation of these events is studied throughout the Solar System by the means of the execution of the SHEBA propagation model on the HELIO Processing Service.

Fastest CMEs Propagation

Find parameters for model

Execute the model

Validate the results

High Energy Flares

Given a time range, this workflow looks for flares within the specified energy range and provides the observations for such time range for the list of instruments asked. It also provides the table of flares with its properties.

High Energy Flares