Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA and CLARA contribution to e-Science in Latin America

www.gisela-grid.eu

Grid Initiatives for e-Science virtual communities in Europe and Latin America

GISELA and CLARA contribution to e-Science in Latin America

Jesús Cruz Guzman (UNAM)on behalf of B. Marechal (CETA-CIEMAT)

ISUM’ 2012, 14th -16th March 2012 - Guanajuato (Mexico)

www.gisela-grid.eu

Outline

• EELA & EELA-2

• GISELA

• CLARA & NRENs

2ISUM’ 2012, 14th -16th March 2012 - Guanajuato (Mexico)

www.gisela-grid.eu 3

EELA & EELA-2 objectives

ISUM’ 2012, 14th -16th March 2012 - Guanajuato (Mexico) 3

EELA (01/2006 – 12/2007)

• Build a bridge between consolidated e-Infrastructure initiatives in Europe and emerging ones in Latin American

• Create a collaboration network to deploy a large portfolio of scientific applications on a well supported Pilot Test-bed

• Care in parallel of the training in grid technologies and of the knowledge dissemination and outreach

EELA-2 (04/2008 – 03/2010)

• Provide an empowered Grid Facility with versatile services fulfilling application requirements

• Ensure production quality services

• Ensure the long term sustainability of the e-Infrastructure beyond the term of the project

• Expand the current EELA e-Infrastructure

• Look for new communities outside academia (Industry and Business)

www.gisela-grid.eu ISUM’ 2012, 14th -16th March 2012 - Guanajuato (Mexico) 44

Platform for all kinds of Applications / VRCs

• EELA-2 ended up supporting 61 Applications from 78 Institutions

• VRCs– LA User Communities, typically 1-2 Institution group(s), alone or collaborating with a few

Institutions.

– A few large VRCs from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G, Seismic simulations) and HEP (Auger, LHC expts)

– More than 200 scientific contacts in LA e.g. CLARA surveyed communities

www.gisela-grid.eu

GISELA: 34 production applications inherited from EELA / EELA-2 represent potential communities

• 18 Resources Centres provide skilful personnel to support and develop services in the region

• 435 trained users / 73 inst.

• 1794 cores platform

• Operation 24/7

EELA

--01/01/2006

--31/12/2007

GISELA

--31/08/2012

--01/09/2010

EELA-2

--01/04/2008

--31/03/2010

GISELA e-Infrastructure inherited from EELA and EELA-2


The evolution …


15 Countries (11 in Latin America)19 Partners (14 in Latin America)12 Third Parties (9 in Latin America)

UNAM Third Parties• CICESE• ITESM• IPN-CIC• UNISON

UPORTO Third Party• Uminho

REUNA Third Parties• UFRO• UTFSM

UNIANDES Third Parties• UIS• PUJ

UFRJ Third Party• CEFET-RJ

CNRS Third Parties• CPPM• IPGP

6

The GISELA Consortium


GISELA Objectives and Work plan

Objective1: Ensure the long- term sustainability of the e-Infrastructure in the Latin American continent

Objective1: Ensure the long- term sustainability of the e-Infrastructure in the Latin American continent

Objective 2: Provide full support to the Virtual Research Communities spanning Latin America and Europe, using the e-Infrastructure.

Objective 2: Provide full support to the Virtual Research Communities spanning Latin America and Europe, using the e-Infrastructure.

Work plan:• Implement a sustainability model rooted on National Grid Initiatives (NGI), in association with CLARA, Latin American NRENs and collaborating with EGI.

• Provide the communities with the suited e-Infrastructure and Application-related Services required to improve the effectiveness of their research. This will address both:

The current EELA-2 User Communities whose research investigations are carried out at the Institution level or in small collaborations.

The larger Virtual Research Communities as Life & Earth Sciences, HEP

Work plan:• Implement a sustainability model rooted on National Grid Initiatives (NGI), in association with CLARA, Latin American NRENs and collaborating with EGI.

• Provide the communities with the suited e-Infrastructure and Application-related Services required to improve the effectiveness of their research. This will address both:

The current EELA-2 User Communities whose research investigations are carried out at the Institution level or in small collaborations.

The larger Virtual Research Communities as Life & Earth Sciences, HEP

ISUM’ 2012, 14th -16th March 2012 - Guanajuato (Mexico) 7


Powerful e-Infrastructure in Latin America

Year 1 Year 2Pledge

“Extra” resources for the prod.vo.eu-eela.eu VO

8


Grid Services Replicating Networking Services

• In CLARA’s network activities a Regional Network Operation Centre (RNOC) catches the functions of the countries that have no domestic NOC

• When domestic network infrastructures grow, the NRENs are going to be able to install their own NOC

• Once this happens, the RNOC will transfer the domestic networking functions to the NOC that has been installed

• CLARA auctions, among its members NRENs the operation of the regional NOC every four years

• The Grid pioneer Infrastructure could follow the same model

• Those countries that can support the creation of a GOC (Grid Operation Centre) will have one, and those who cannot afford it or are not mature enough to create one, can use the Regional Grid Operation Centre (GSC)

• Domestic GOCs are responsible for their domestic services and interact with the ROC when services have a regional scope

• Those countries without a GOC, will use the ROC for domestic functions in their country.



CLARA Advanced Computing Services

• Adv. Comp. (AC) Expertise Transfer. Technical Consulting to assist in house applications– Customising an existing application to profit the existing Adv. Comp. e-Infrastructure

– Developing in house new applications required by the customer organisation (Research, Industry or NREN)

• SDK/SourceFourge Training To increase the awareness on the AC environments

• Wizard for basic applications. Allows the less expert users and/or NREN to install their applications

• Federated Authentication Resources. Grant authorized access to use the federated resources at a continental scale

• Application Shelf Service: Application Shelf Allows users, industrial partner and/or NREN to contract computing resources

• Virtual Resources Grid Allocation. Virtual services e-Infrastructure, such as:– Allocation of AC resources allowing the member institutions to configure AC environments

(cores/storage/network provisioning) and elements needed to execute their applications

– Running Services records, tracking the processes submitted to the e-infrastructure

• Data Preservation Services. Offer the possibility to store their data for a period of time

• Training and Capacity Building Service. To increases the usage and the culture of Advanced Computing Services by providing people the information and the skills needed to access the AC Services


www.gisela-grid.eu

CLARA Grid VRC Organisational Model

NOC

Regional NOC+NOC

NOC

NETWORK MANAGER (NSC)

CLARA

Country LA–1

REUNA

Country LA–2

Country LA–N

GOC

GOC

Regional GOC+GOC

NGI or EDGS

NGI or EDGS

NGI or EDGS

APPLICATIONS MANAGER

Grid Community Coordinator

Complex Model

Cooperative Broker Model



A Regional Cooperative Solution Offers

User

Grid

ScienceGateway

Authentication

Cloud

Virtual Instruments

Virtual Servers

Commercial

Providers

• On demand resources (Hardware, Software & Manware) from the research groups to the research groups

• High bandwidth and low latency from the Experimental academic advanced Networks

• Replicating other services in the RedCLARA Operational Structure

• Added value to the existent infrastructure

• Better use of the existent computational infrastructure and expertise from different countries

• Promoting local middleware solutions better suited for the region


www.gisela-grid.eu

Science Gateway Service Centric Model


www.gisela-grid.eu

Regional Competitive Solution

14

Business Model Parameters RC Profit Margin % 300%RedCLARA Profit Margin 60%% RedCLARA Capacity 30%Max-Cores- GISELA Capacity 1794MAX-Cores-RedCLARA Capacity 538Max Num days/year (80% UpTime) 292Hours per day 24

RedCLARA Price € 0.17


www.gisela-grid.eu

SERVUCTION & Operational Profit

• First and Second year of operation after GISELA end (31/08/2012

→)

• ½ FTE for administrative purposes as contracts, bills and expenditures

• ½ FTE for technical support

• 1 FTE fore marketing and sales

• Third year (1 FTE - Administrative, 1 FTE - Technical, and 1 FTE – sales)

Fixed Costs


www.gisela-grid.eu

Action Plan (1/3)

Raise awareness, sensitize and inform on the different opportunities of the Advanced Services•Sensitizing and informing research communities of the opportunities that Advanced Services could bring to their environment

– Organize Virtual Days on Technology and the Community– Organize courses and competencies for students who have applications

of general use– Document the existing applications of the GISElA Science Gateway, by

creating tutorials to ease the use and appropriation.•Raise awareness, sensitize and inform the decision makers of S & T and the Directors of the National Research and Education Networks (NRENs) on the opportunities that Advanced Computing Services could bring to Science and Technology

– Interviews with Latin American high authorities of decision makers in Science and Technology. CLARA’s Academic Manager is coordinating interviews with decision makers (Ministers, Directors and General Secretaries) of S&T in the LA region


www.gisela-grid.eu

Action Plan(2/3)

Identify the real needs of Advanced Computing Services by research communities. It is necessary to understand real needs of advanced computing services in the LA region. The communities need to produce a positive social impact in their research results in order to attract the S&T decision makers’ and NRENs Directors’ attention•Identify communities that produce research results with high positive social impact as potential users of advanced computing services•Identify “ambassadors” of each community to conduct a series of actions to first understand the communities’ needs and then to induce the communities into advanced computing services

Increase technical potentialities and capacities of the GISELA Science Gateway to provide an easy and friendly interface that can be used to access different web services through different platforms


www.gisela-grid.eu

Action Plan (3/3)

Train research communities so they adopt the GISELA Science Gateway into their daily research. Communities need to be able to build and maintain their own portals and include all the applications they need to develop research projects•Creation of a Task Force (in collaboration with EPIKH) to implement and give technical support to applications running in the GISELA Science Gateway environment.

– Deploy applications of communities with social impact: seismology and climate– Install Identity Federation Systems in at least two countries of the Latin American region– Document extensively the processes of adaptation and configuration of the GISELA

Science Gateway– Redefine the web interface and usability of the portal

•Create on line and detailed technical documentation to have a permanent reference for the Task Force professionals and local technical representatives of the different institutions involved in the e-infrastructure and resource centers.

•Create a AuthN &AuthZ Infrastructure (AAI) in Latin America based on federated indentity services, "cloning & adapting" the existing "catch all" services developed at INFN Catania

•Update of the CP/CPS documents of the Certification Authorities established in Latin America to allow them issue "robot certificates" that are necessary for the GISELA Science Gateway

•Organise a cycle of technical seminars to follow up of the installation of applications 18ISUM’ 2012, 14th -16th March 2012 - Guanajuato (Mexico)

www.gisela-grid.eu

Conclusions (1/2)

• The service architecture based on GISELA SG centric model includes all possible services to be offered by RedCLARA

• The cooperative shared cost broker model is economically viable and competitive with the present commercial offer

• It has been validated with the

– Directors on NRENs at the RedCLARA Assembly (Oct 27th, 2011) Need to be explained to the S&T Agencies Need to be aligned with National Initiatives Good idea: 30% National capacity to be share regional + Funds for RC Need to be related with other EU projects (RISC, CHAIN, ProIdeal)

– Application Committee (Nov 18th, 2011) Need to allow the possibility to “credit cores” for research projects Need to allow possibility to offer 5% financed resources for good

proposals with no funding opportunities


www.gisela-grid.eu

Conclusions (2/2)

• RedCLARA Assembly (Nov 10th, 2011) and RedCLARA Board Meeting (Dec 2nd , 2011) recommended to:

– Evaluate the cost/performance of the GISELA e-Infrastructure– Convince two or three candidates to start/test the model– Look for funding for the test period (~2 years)

• Develop a LA Call for a Science Gateway Task Force

– Training at LA and EU technical people from VE, CO, PE, MX, EC– F2F meeting and workshop at the Joint GISELA-CHAIN Conference

• Aggressive plan to interact with LA Science & Technology Agencies (AR, CL, MX, PE, EC, CO, VE)

• Marketing strategy aiming to VRC and ComCLARA Communities

• CLARA Market Study for Cloud Services for standard computing services


Documents

Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA and CLARA contribution to e-Science in Latin America