IGI – the Italian Grid initiative and its impact for the Astrophysics community

Fabio PasianINAF – Information Systems Unit

INAF – Osservatorio Astronomico Trieste

F.Pasian - Italian Grid Infrastructure 2

Outline IGI – definition and scope Previous initiatives Activities Impact on astrophysics

10 April 2008

F.Pasian - Italian Grid Infrastructure 3

IGI IGI = association for the Italian Grid Infrastructure Has been established as a consortium of 10

different national institutions and 4 consortia to provide long term sustainability for the Italian Grid.

Partners: INFN, CNR, ELETTRA, ENEA, INAF, INGV, UNICAL, UNINA, UNIPG, UNIPNM; COMETA, COSMOLAB, GARR, SPACI

10 April 2008

F.Pasian - Italian Grid Infrastructure 4

IGI – scope IGI focuses on setting up and operating a common e-

Infrastructure for the Italian Sciences, and includes the main public Resource Providers and Computing Centers, in addition to various Regional Initiatives and other related projects. IGI will provide a consistent and coordinated Italian strategy as a step towards the European Grid Initiative (EGI) and as an interface to the EU Grid infrastructure projects e-IRG (e-Infrastructure Reflection Group) and ESFRI (European Strategy Forum on Research Infrastructures), and to other international activities as the need arises.

10 April 2008

F.Pasian - Italian Grid Infrastructure 5

INFNGrid The INFN Grid project, approved in late 1999, has

developed and deployed the first Italian Grid Infrastructure, based on GARR, the Italian research network.

More than 30 sites, both INFN and some among the most important Italian universities.

Although primarily focused on physics, it has been, since the beginning, open to other fields of research (bio-medicine, earth observation, etc.) and to industry.

Training/support activities

10 April 2008

F.Pasian - Italian Grid Infrastructure 6

Grid.it

With a grant received from the MIUR-FIRB funds (governmental funds for investment in fundamental research) for the Grid.it project, a number of National Research Institutions paved the way in 2002-06 for the development of a common production grid infrastructure supporting the Italian Research Area. Developments Production Grid

10 April 2008

F.Pasian - Italian Grid Infrastructure 7

Transition

Grid.it : 50 sites ("resource centers"), 4500 CPUs (4.5 MSPECINT), 1 PByte storage, 2.5 Gbps bandwidth

Grid.it has come to a close in 2006 as a development project; to extend its benefits, IGI has taken over and acts as the national coordinator for the different pieces of the Italian e-Infrastructure present in EGEE.

10 April 2008

F.Pasian - Italian Grid Infrastructure 8

Grid.it

SPACI

GRISÙ(Cometa, Cresco, Cosmolab, Scope)

Grid@Trieste

10 April 2008

F.Pasian - Italian Grid Infrastructure 9

PON consortia National funding to enhance computational

infrastructures in southern Italy Four regional projects created:

COMETA consortium (TriGrid and PI2S2 projects) → U.Becciani’s talk Cosmolab (CyberSar project) SCOPE (University of Naples) CRESCO (ENEA)

Share middleware (INFNGrid distribution) → interoperability

MiUR resources to expand PON experience to rest of Italy

10 April 2008

F.Pasian - Italian Grid Infrastructure 10

IGI – build upon previous work Leverage upon the large integration and

standardization effort of international and national research projects such as EDG, LCG, Grid.it and EGEE, in order to establish a coherent platform of interoperable Grid Services customized for Italian user applications, and make it available in support of the Italian scientific end user communities and, possibly, early commercial adopters

10 April 2008

F.Pasian - Italian Grid Infrastructure 11

IGI middleware distribution (I) The idea is to expand the EGEE gLite distribution

to tackle needs of Italian Grid community Taking from INFNGrid experience: with respect to

the CERN gLite distribution, totally compatible; has additional components and specific configurations. Among the specificities: Support for 20 VOrg’s StoRM (access to storage) P’n’P User Interface, Configured MPI support GridICE monitoring on Worker Nodes …

10 April 2008

F.Pasian - Italian Grid Infrastructure 12

IGI middleware distribution (II) Which components can go in the release? A Board (the Executive Board of IGI) recieves the requests

and evaluates Functionality and added value of component Reference User/VOrg community Usage experience and tests performed Evolution/development/sustainability of component

and decides which are the additional components which can be inserted in the release, defining priorities

A Release Team perfoms a technical evaluation and defines the activity plan and schedule

Tight collaboration with developers is mandatory

10 April 2008

F.Pasian - Italian Grid Infrastructure 13

IGI middleware distribution (III)

10 April 2008

F.Pasian - Italian Grid Infrastructure 14

National framework IGI has submitted a proposal to be included

within the roadmap for Italian research infrastructures

Appropriate funding to be provided by MiUR Complementary to HPC proposal Coordinated with (part of) ESFRI roadmap

for e-infrastructures

10 April 2008

F.Pasian - Italian Grid Infrastructure 15

Communities IGI plans to support activities in a vast range

of scientific disciplines — e.g. Physics, Astrophysics, Biology, Health, Chemistry, Geophysics, Economy, Finance — and any possible extensions to other sectors such as Civil Protection, e-Learning, dissemination in Universities and secondary schools.

10 April 2008

F.Pasian - Italian Grid Infrastructure 16

Astrophysics as an IGI community

Among these, the Astrophysics community is active as a user, by porting applications of various kinds, but also as a resource provider in terms of computing power and storage, and as middleware developer.

10 April 2008

17

Grid(s) for astrophysics

A step backwards … Dedicated WP in Grid.it DRACO: data grid for astrophysics and

coordination with the VObs (2003-05) Separate projects afterwards: VObs.it and

DRACO2 (relying on the Italian grid infrastructure) funded by INAF

10 April 2008 F.Pasian - Italian Grid Infrastructure

F.Pasian - Italian Grid Infrastructure 18

Porting of applications within the Grid.it and DRACO projects:

Montecarlo Hi-res N-body simulations Data processing (OmegaCam)

within the EGEE/EGAAP framework: simulations of the Planck mission

on COMETA: among others, HPC applications (e.g. FLY)

on IGI (and EGEE): population of the BaSTI archive (see poster)

Leadership of A&A EGEE cluster.

10 April 2008

F.Pasian - Italian Grid Infrastructure 19

Development of middleware definition of requirements development of gridftp+EGEE drivers for CFITSIO development of G-DSE → C.Vuerli’s talk

originally in collaboration with INFN “native” Grid access to relational databases applied (and optimised) for astrophysics

benchmarking and comparison among systems managing DBs on the Grid

Leadership of EGEE Database Group.

10 April 2008

F.Pasian - Italian Grid Infrastructure 20

Database access benchmarks

10 April 2008

F.Pasian - Italian Grid Infrastructure 2110 April 2008

F.Pasian - (Super)computing and e-Infrastructures 2212 March 2008

from K.Baxevani

dis

F.Pasian - (Super)computing and e-Infrastructures 2312 March 2008

e-Infrastructure: components

Computing Infrastructure

Network Infrastructure

Data Infrastructure

...Appl Appl Appl Appl

When defining the roadmap for the

development of an e-Infrastructure for Astronomy, these

components need to be thought as

integrated, or at least fully

interoperablegeneric

domain-specific

F.Pasian - Italian Grid Infrastructure 2410 April 2008

The path forward for e-infrastructure All facilities should be integrated in

an interoperable e-infrastructure Goals for the next years:

Consolidating a Data Infrastructure on top of Network and Computing

Domain-specific applications on top of the Data Infrastructure

Inter-operation of applications (data processing, analysis, mining, bibliography, semantic web) to build a Knowledge Infrastructure

Computing Infr.

Network Infr.

Data Infr.

...appl appl appl appl

Knowledge Infrastructure

VObs

This is the area where the VObs expects to bring in its own

standards, tools and facilities