GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner

www.gisela-grid.eu

Grid Initiatives for e-Science virtual communities in Europe and Latin America

GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner- An opportunity for VRCs Bernard Marechal (Project Coordinator)

5th Iberian Grid Infrastructure Conference, 8th-10th June 2011Santander (Spain)

www.gisela-grid.eu IBERGRID 2011 - 8/10 June - Santander (Spain) 22

Outline

• GISELA as Resource Infrastructure Provider:– General

is much experienced in Grid computing has a powerful Infrastructure complies with EGI policies & recommendations

– Specificities Both Service (gLite) and Opportunistic Computing (OurGrid) supported

• GISELA: an option for VRCs– Platform for all kinds of Applications– Offers a series of new, well-supported Services (e.g. DIRAC)– VRC Training & Support– Collaborates with EGI and Regional Initiatives

• GISELA interests in the IBERGRID context– Welcomes international VRCs– Creates emulation process in LA– Interest in Iberian VRCs collaborating with Latin America

www.gisela-grid.eu

6 Iberian Institutions in EELA– Portugal:

Laboratório de Instrumentação e Física Experimental de Partículas (LIP)

– Spain: CIEMAT Consejo Superior de Investigaciones Científicas (CSIC) Universidad Politecnica de Valencia (UPV) Universidad de Cantabria (UC) Red Académica y de Investigación Española (REDIRIS)

IBERGRID 2011 - 8/10 June - Santander (Spain)

Remembering the past

3

10 Iberian Institutions in EELA-2– Portugal:

Universidade do Porto (UPORTO) Universidade de Aveiro (UAV) Universidade do Minho (UMINHO)

– Spain: CETA-CIEMAT Centro de Supercomputación de Galicia (CESGA) MAAT GKnowledge (MAAT) Universidad de Cantabria (UC) Universidad Complutense de Madrid (UCM) Universidad de Extremadura (UEX) Grupo de Reds y Computación de Altas Prestaciones (GRyCAP - UPV)

www.gisela-grid.eu 4

GISELA Countries & Partners

15 Countries (11 in Latin America)

19 Partners (14 in Latin America)

12 Third Parties (11 in Latin America)

IBERGRID 2011 - 8/10 June - Santander (Spain) 4

UNAM Third Parties• CICESE• ITV• ITESM• IPN-CIC• UAEM• UNISON

The GISELA spirit is not anymore to consider Institutions, but rather representatives of JRU / NGI, with the advantage to “accept” de facto all JRU / NGI members.

The GISELA spirit is not anymore to consider Institutions, but rather representatives of JRU / NGI, with the advantage to “accept” de facto all JRU / NGI members.

UPORTO Third Party

• Uminho

REUNA Third Parties• UFRO• UTFSM

UNIANDES Third Parties• UIS• PUJ

UFRJ Third Party• CEFET-RJ


GISELA as Resource Infrastructure Provider

www.gisela-grid.eu 6

Long record in e-Science support


• Fruit of 5-6 year experience of successful e-Science EU-LA Collaboration, through EU funded projects (EELA, EELA-2, GISELA)

• Has long outstanding collaboration with Spain (CIEMAT- Coordinating Institution) and Portugal

• Present in almost all LA countries

• Most encompassing e-Infrastructure for scientific collaborations between Latin America and Europe

• Sound long-term sustainability approach rooted on CLARA, NRENs, LA NGIs

www.gisela-grid.eu IBERGRID 2011 - 8/10 June - Santander (Spain)

GISELA e-Infrastructure (1)

7

Committed CPU & Storage resources (from the GISELA DoW)

Country CPUs TBs RCs Country CPUs TBs RCs

Argentina 130 0 5 Mexico 198 2 8

Brazil 1212 25 9 Peru 110 8 7

Colombia 200 2 6 Panama 100 1 2

Cuba 50 0 1 Portugal 100 0 3

Ecuador 100 1 5 Spain 100 20 2

France 40 0 1 Uruguay 100 10 1

Italy 100 30 1 Venezuela 120 6 3

CPUs TBs RCs

Total 2660 105 56

www.gisela-grid.eu

• GISELA gLite sites integrated in the infrastructure

– CEFET-RJ, CIEMAT-TIC, EELA-UNLP, ICN-UNAM, INFN-CATANIA, UFRJ-IF, ULA-MERIDA, UMinho-CP, Uniandes and UPorto

– About 1000 cores (VO “prod.vo.eu-eela.eu”)

• Non-GISELA sites contributing to the VO “prod.vo.eu-eela.eu”

– CERN-PROD, csTCDie, EELA-UTFSM, IEETA and UNICAN

• OurGrid sites - about 400 cores (all in Brazil):

– LCC2, GMF,DCA, AESA, LCC1, LSD

IBERGRID 2011 - 8/10 June - Santander (Spain)


8



9

• UFRJ is the most active site (gLite only)

– specInt2000



10

• Accumulated load per VO (gLite only)


EGI compliant Infrastructure

• EGI - GISELA Resource Infrastructure Provider MoU signed

• EGI compliance is based on the adoption of common services and practices

– The Operational Level Agreement (OLA)

(http://documents.gisela-grid.eu/record/87?ln=en)

– Monitoring System (Nagios)

– Ticket System (GGUS)

– Accounting System (APEL)

– Middleware (gLite)

– Resource database (GOCDB)

– Operations Dashboard


Platform for any Application / VRC

• VRC initial situation: – EELA-2 ended up supporting 70 Applications from 78 Institutions

• Emerging VRCs– Legacy: EELA-2 User Communities, typically 1-2 Institution group(s), largely located in Latin America,

alone or collaborating with a few Institutions.

– A few large VRCs from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments at CERN)

– More than 200 scientific contacts in LA, e.g. CLARA surveyed communities


Comprehensive framework for VRC support


Rich portfolio of new, well supported Services

• Broad range of services, covering both Application and Infrastructure support

• Examples of services for which support is available:– Application-related Services

Job, Catalogue, File and Data Management• Digital archives, Secure storage, WatchDog, lcg-rec toolkit

– Infrastructure-related Services Support for opportunistic resources (OurGrid middleware) Support for infrastructure bridging (OurGrid and gLite) Support for Storage Accounting (SAGE)

– Data processing and distributed user analysis services DIRAC: workload and data management system (cf DIRAC meeting in Barcelona)


Comprehensive VRC Training & Support (1)

Tailorable to VRCs needs


Adaptable to VRCs

Comprehensive VRC Training & Support (2)


Collaboration with EGI & Regional projects

• EGEE, EGI

– EGEE: Long, outstanding interaction (MoU) in collaboration with other related projects (EUMedGrid, EU-IndiaGrid, EUAsiaGrid, SEE-Grid-2, BalticGrid, BELIEF,..)

– EGI: Natural follow up of the EGEE cooperation Infrastructure Providers MoU, signed with EGI.eu Project MoU (Dissemination, Training, Support tools & Services), signed with EGI-InSPIRE

• EGI-related projects / Regional Initiatives

– DEGISCO: Volunteer computing support (gLite <-> OurGrid bridge) EU: UNIZAR-IBERCIVIS, ATOS ORIGIN, CNRS,… LA: UFCG-Brazil

– CHAIN: Focus on VRC support (MoU under preparation) EU: INFN, CIEMAT LA: CLARA

– EPIKH Joint sponsoring /organisation of Tutorials & Workshops (MoU signed) EU: INFN, CIEMAT, CNRS,.. LA: Brazil: CEFET/RJ, UFRJ, Chile: UTFSM, Mexico: UNAM)


GISELA specific interests

in the IBERGRID context


GISELA interests

• Welcome international VRCs– A few large VRCs already on board such as from Life Sciences (e.g.

WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC experiments)

• Create emulation process in Latin America– Not enough intensive productions from LA VRCs– Wish to stimulate LA Institutions to move on from small tests to evaluate

the Grid technology to mass production as exemplified by the large VRCs.

– Hope to stimulate new collaborations

• Interest in “Iberian” VRCs collaborating with Latin America– GISELA is (was) naturally looking for existing or foreseen collaborations

between SPAIN & Portugal and Latin America


CAM (Community Atmospheric Model)

• Domain: Earth Sciences / Climate forecast

• Collaboration: UNICAN (Spain), UCH+CMM (Chile), SENAHMI (Peru)

• From EELA: “…Therefore, there is a real need for a seamless global+regional climate application in grid environment allowing users to access and submit runs or experiments using a friendly tool (e.g. a portal).”

• Current status, perspectives?


WRF4G (Weather Research and Forecasting for Grid)

• Domain: Earth Sciences / Climate simulation• Collaboration: UNICAN (Spain)• From EELA-2: “One of the advantages of having ported the WRF to the Grid is

the large community of end users around this model world wide. Especially the Latin America has a well established community around the WRF model. If we combine this community with the benefits of the Grid, the WRF4G will allow to create a new virtual community around this application supported by the Grid technology provided by the EELA-2 project.”



BLAST (Basic Local Alignment Search Tool)

• Domain: Life Science / Bio-informatics• Collaboration: UPV (Spain)• From EELA-2: “…processing these databases with BLAST demands

computational resources that exceed the capabilities of most research groups. Nevertheless, these massive experiments can be performed by means of e Science infrastructures (such as EGEE, EELA and some NGIs) following ‘High-Throughput’ approaches”



GAMOS (Geant-based Architecture for Medicine-Oriented Simulations)

GAMOS: Framework for the simulation of medical applications, in (PET/SPECT) and radiotherapy

• Domain: Life Sciences / Medical Physics• Collaboration: CIEMAT (Spain), UTFSM (Chile), UNIANDES (Colombia)• From EELA-2: “the gridified version GAMOS has been successfully deployed

and tested on a first group of selected EELA-2 resources. The suitability of this application for Grid environments has been demonstrated performing a real simulation based in calibrating a commercial accelerator, which is in use in multiple hospitals for radiotherapy.”



CROSS FIRE

• Domain: Civil Protection• Collaboration: UMINHO (Portugal)• From EGRIS1: “Collaborative Resources Online to Support Simulations on

Forest Fires: a Grid Platform to Integrate Geo-referenced Web Services for Real-Time Management”


CROSS FIRE: An integrated system aimed at the simulation of fire growth over complex topology

www.gisela-grid.eu

• GISELA still young (9 months old) but …

• Some concerns (from a managerial point of view):– Slow implementation of the CLARA business plan for long-term

sustainability

– Handover to CLARA and NRENS of the GISELA activities

– (Not enough) use of the GISELA e-Infrastructure

– Third parties not yet fully on board

– Slow and painful NGIs implementation in LA: Different levels of development in LA countries' grid infrastructures/services

Local political issues

Non-uniform enthusiasm (but appreciable efforts in Colombia and Mexico)


Conclusions (1)

www.gisela-grid.eu

• However…– 6 important MoUs already signed and 2 in progress (WP1)

– Excellent dissemination and Outreach activities (WP2)

– VRCs supported and training available (WP3)

– Infrastructure operating satisfactorily (WP4)

– Late, but currently satisfactory, ramping up of the Network Resource Provision (WP5)

– Infrastructure and Applications-oriented Services for User Communities (WP6) rather productive (DIRAC)

• Finally …How could we strengthen the Portugal / Spain – LA collaborations?


Conclusions (2)

Documents

GISELA in the IBERGRID context: - A Resource Infrastructure Provider Partner