44
www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future) Roberto Barbera (Univ. of Catania and INFN- Italy) Final Project Review Brussels, 11.10.2012

Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

Embed Size (px)

Citation preview

Page 1: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Grid Initiatives for e-Science virtual communities in Europe and Latin America

GISELA Achievements & Legacy (A vision into the future)

Roberto Barbera(Univ. of Catania and INFN- Italy)

Final Project Review

Brussels, 11.10.2012

Page 2: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 2

Outline

• Looking back to the past

• The Latin America AAI: state of the art and future activities

• Adaptability of the GISELA Science Gateway to present and future challenges

• Once more about sustainability: the Science Gateway market place

• Summary and conclusions

GISELA - Final Project Review - Brussels - 11/10/2012

Page 3: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Looking back to the past 7 years…

3

EELA(A test-

bed)

EELA-2(A production

Infrastruc-ture)

GISELA(A sustaina-ble service)

4/2008-3/2010

1/2006-12/2007

9/2010 – 8/2012

GISELA - Final Project Review - Brussels - 11/10/2012

Page 4: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Size of the consortia

4

EELA 10 countries21 partners

EELA-216 countries 18 partners

60 third parties

GISELA15 countries19 partners

12 third parties

4/2008-3/2010

1/2006-12/2007

9/2010 – 8/2012

GISELA - Final Project Review - Brussels - 11/10/2012

Page 5: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu GISELA - Second Project Review - Brussels - 08/12/2011 5

GISELA Partners

Page 6: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Page 7: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Page 8: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu Brussels, Second EELA Annual Review, 25.02.2008

– At least 8 applications in year 2 (4 in year 1)• In 2006, 13 were identified, but not ported…

• 6 Biomedical, 3 HEP, 5 e-Learning, 4 Climate applications 18 applications in total!

– At least 2 new applications considered (1 in 2006)• 9 in 2006

• Out of the 18 applications, 13 are new!

8

Dec 2007

QUALITY METRICS - APPLICATIONS

Page 9: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 9Brussels, Final Project Review, 18.05.2010

As presented atthe First Review

After 2ndGrid School

Today

Fully deployed on theproduction infrastructure

Gridified but running onanother gLite-based Grid

 Ready for standalone use,running locally

Deployed on the prod. infrastructure, but in testing phase

Mar 2010

Supported Applications’ status

Page 10: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

WP3 Applications Portfolio – End of 1st year

GISELA - First year Project Review - Brussels - 15/09/2011 10

• 70 legacy grid applications inherited from EELA & EELA-2

• 34 of them are in a production stage– Not all of them running on regular basis, but…– Can be provided at anytime upon users request in LA

• MoU signed with EGI-InSPIRE (M08) enables…

– VRC members in Europe exploit GISELA resources– VRC members in LA exploit EGI resources (most usual)– EGI/GISELA to coordinate VRC support in every EGI forum– Publishing GISELA applications in http://appdb.egi.eu/

Page 11: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Dec 2007

Page 12: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 12

Mar 2010

Page 13: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

WP4 Numbers – End of 1st year

• Cumulative GISELA contribution per site (normalised CPU hours)

GISELA – First year Project Review – Brussels – 15/09/2011 13

Page 14: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu Brussels, Second EELA Annual Review, 25.02.2008

– At least 100 researchers after 2007 (50 after 2006) that have tested an enhanced application

• 61 EELA VO members at the end of 2006

• 114 EELA VO members at the end of 2007 (not counting ALICE VO and tutorials’ generic users)

14

QUALITY METRICS - USERS

Dec 2007

Page 15: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

saturation

decrease

15

Mar 2010

Page 16: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 16

GISELA - End of 1st year issue

Quality Metric Current status Y2

Q1

Expected outcome Y2

Number of Active Users in the catch-all VO (prod.vo.eu-eela.eu)

36 100

Number of Active Users in the VRC-driven Science Gateway

26 100

Number of Applications in production status on the e-Infrastructure 42 40

Number of Applications integrated in VRC-driven Science Gateways 4 15

Number of specialized Science Gateway for VRC 2 2

GISELA - Second Project Review - Brussels - 08/12/2011

Almost as many users in the Science Gateway in 2 months as in the production VO in 15 months

Page 17: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 17

Path to technology uptake

The Rogers “bell-shape” curve - Rogers, E. M. (1962), “Diffusion of Innovations”, Glencoe: Free Press.

Development of the GISELA SG

GISELA - Final Project Review - Brussels - 11/10/2012

Page 18: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 18

– the GISELA Grid

Davis, F. D. (1989), "Perceived usefulness, perceived ease of use, and user acceptance of information technology", MIS Quarterly 13(3): 319–340

Development of the GISELA

Science Gateway

Requirement for sustainability

Achieved!

GISELA - Final Project Review - Brussels - 11/10/2012

IT acceptance model

Page 19: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

The «Catania» Science Gateway model

19

....... Science

Gatew

ay

App. 1

App. 2

App. N

Embedded Applications AdministratorPower UserBasic User

Users from different

organisations having different

roles and privileges

Standard-based (SAGA) middleware-independent

Grid Engine

Middleware currently available in LatAm

GISELA - Final Project Review - Brussels - 11/10/2012

Page 20: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

AuthN & AuthZ Schema

AuthorisationGISELA Science Gateway

GrIDP

(“catch-all”)

IDPCT(“catch-all”)

IDP_y

LDA

P

....

.....

1. Register to a Service

2. Sign in

Authentication

Social Networks’ Bridge IdP

20

Page 21: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Official Identity Federations supported by GISELA Science Gateway

21

To be created on 26-30 November 2012

GISELA - Final Project Review - Brussels - 11/10/2012

Page 22: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Training Material to create Federated Identity Services

VirtualAppliancesincluded

22

Especially developed in the context of GISELA

GISELA - Final Project Review - Brussels - 11/10/2012

Page 23: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 23

Creation of Federated Identity Services in LA

• IdF Mexico (managed by UNAM)– Done in cooperation between GISELA and EPIKH– 2 persons came to Catania in July 2012 to learn and install the

services– By end of November 2012, the Mexican federation will comprise:

UNAM Universidad de Colima (UCOL) Dirección General de Institutos Tecnológicos (DGIT) CUDI ... for a total of about 500,000 students and researchers !

• Colombia, Costa Rica, Ecuador, Panama– A training event to create federated identity services will take place in

Bucaramanga on 26-30 November (fully paid by RENATA a nice example of sustainability and commitment)

• Future:– INFN will continue to assist and support LA countries to create

federated identity services until the ELCIRA project will take over (ELCIRA started on the 1st of June 2012)

GISELA - Final Project Review - Brussels - 11/10/2012

Page 24: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

eduGAIN(www.edugain.org)

24

GISELA Science Gateway is also

registered as Service Provider of eduGAIN

GISELA - Final Project Review - Brussels - 11/10/2012

Page 25: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

The Grid IDentity Pool (GrIDP)(http://gridp.ct.infn.it)

This is an “open” Identity Federation

25GISELA - Final Project Review - Brussels - 11/10/2012

Page 26: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu GISELA - Final Project Review - Brussels - 11/10/2012

The Grid IDentity Pool (GrIDP)(http://gridp.ct.infn.it)

26

While Identity Federation are being established in LA, single users

as well as Identity Providers are welcome to join GrIDP to access

and use the GISELA Science Gateway

Page 27: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

First set of considerations – Interoperability

• Interoperability is a property referring to the ability of diverse systems and organizations to work together (inter-operate). The term is often used in a technical systems engineering sense, or alternatively in a broad sense, taking into account social, political, and organizational factors that impact system to system performance;

• According to ISO/IEC 2382-01 (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units".

27GISELA - Final Project Review - Brussels - 11/10/2012

Page 28: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

The «Catania» Grid Engine

Grid Engine

UsersTracking

DB

Science GW Interface

SAGA/JSAGA API

Job EngineData Engine UsersTrack &Monit.

GISELA SG

ScienceGW 2

ScienceGW 3

Grid MWs

Liferay Portlets

eTokenServer

Newby WP6

Modified New Modified

Mid

dle

ware

cu

rren

tly a

vailab

le in

LatA

m

28GISELA - Final Project Review - Brussels - 11/10/2012

Page 29: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

The CHAIN Worldwide Interoperability Demo

29

GISELA contributions(WP3, 4 & 6)

GISELA - Final Project Review - Brussels - 11/10/2012

Page 30: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 30

1. e-Infrastructures can be made interoperable at user/application level using standards

2. Both general purpose and VRC-specific applications can be submitted from anywhere and run everywhere

The demo “in action”

GISELA - Final Project Review - Brussels - 11/10/2012

Page 31: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu 31

The demo “in action”

1. The GISELA Science Gateway is completely «agnostic» w.r.t. the middleware deployed in LA

2. No more technical (and political) barriers for a much wider adoption of the e-Infrastructure paradigm

GISELA - Final Project Review - Brussels - 11/10/2012

Page 32: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Second set of considerations – Social Networks

• About 1 billion people have accounts on the existing Social Networks (many of the researchers we are targeting with e-Infrastructures are among them)

• Web-based social networking accounts for more than 10-15% of the total time spent online in the whole world

• Social Networks’ are by far the most used (liked) virtual environments in the world

32GISELA - Final Project Review - Brussels - 11/10/2012

Page 33: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

“Social” Science Gateways(www.facebook.com/pages/Catania-Science-Gateways/220075701389624)

33GISELA - Final Project Review - Brussels - 11/10/2012

Page 34: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

GISELA “social” Science Gateway(The Science Gateway as a Facebook app)

34

SSO possible through the Social Networks’ Bridge IdP

GISELA - Final Project Review - Brussels - 11/10/2012

Page 35: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Third set of considerations – Mobile Access

35

• More than 25% of mobile phones in the world are smartphones and the number of people connected through mobile appliances increases every year

• Social networking amounts to 91% of mobile internet access, compared to 79% on desktops, and it is expected that by 2014 mobile internet should take over desktop internet usage(*)

• So, mobile access to “everything” is not any more an option; it is a must and e-Infrastructures shouldn’t/won’t be an exception

(*) http://www.biztechday.com/mobile-stats-2011-91-use-mobile-phones-to-socialize

GISELA - Final Project Review - Brussels - 11/10/2012

Page 36: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

The “mobile” Authentication Procedure(REST API access to the GISELA Science Gateway)

36GISELA - Final Project Review - Brussels - 11/10/2012

Page 37: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Big challenges are in front of us…

• Now that many users can potentially access and use the GISELA Science Gateway, a new training and communication strategy is needed as well as a portfolio of appealing applications to attract them

• How all this is feasible and sustainable in the future the least possible cost ?

37GISELA - Final Project Review - Brussels - 11/10/2012

Page 38: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

The Science Gateway market place

38

1. 2.

3.

4.

5.

Users/VRCs SG Dev.

GISELA Science GatewayGISELA - Final Project Review - Brussels - 11/10/2012

Page 39: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Survey to propose new applications(http://gisela-gw.ct.infn.it/integre-una-nueva-aplicacion-al-sg)

39GISELA - Final Project Review - Brussels - 11/10/2012The survey is also available in english

Page 40: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Training for GISELA Science Gateway developers

• New training material

• New training tools:

• New training events:– http://agenda.ct.infn.it/conferenceDisplay.py?confId=783 – http://agenda.ct.infn.it/conferenceDisplay.py?confId=784

40GISELA - Final Project Review - Brussels - 11/10/2012

Page 41: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

GISELA Science Gateway developers task force

• Composition:– Argentina: 1– Brazil: 1– Colombia: 9– Ecuador: 2– Italy: ~10– Mexico: 6– Spain: 2– Uruguay: 1– Venezuela: 7

• A tutorial for developers will take place in Bucaramanga (Colombia) on 26-30 November (fully paid by RENATA a nice example of sustainability and commitment)

41GISELA - Final Project Review - Brussels - 11/10/2012

Page 42: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Uptake of «Catania» Science Gateways

184 Organisations from 43 Countries

GISELA Science Gateway figures:• 174 users (~700% increase since Dec 2011; about twice the current number of members of the VO and steadily increasing)• 75 Organisations• 18 countries

42GISELA - Final Project Review - Brussels - 11/10/2012

Page 43: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Summary and conclusions (1/2)

• GISELA legacy builds on four pillars: standard adoption, simplicity, easiness of use and re-usability

• e-Infrastructures can be very useful platforms for many VRCs, provided that they are really easy to use and GISELA has demonstrated that this is not only feasible but also sustainable

• The federated identity based AAI services promoted/fostered/ established by GISELA will bring Latin American countries to the state of the art and will help CLARA and the NRENs in creating new services across the whole continent , shared with Europe and other regions of the world

• The GISELA Science Gateway, with its support for Identity Federations, Social Networks, and mobile access is changing the way the LA Grid infrastructure is used, hugely widening its potential user base, especially non-IT experts and the “citizen scientist”, yet keeping the required level of security

• The adoption of standards (JSR 286, SAGA, SAML, etc.) was a concrete investment towards sustainability and allowed worldwide interoperability at user application level and re-usability of applications at the Science Gateway level

43GISELA - Final Project Review - Brussels - 11/10/2012

Page 44: Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA Achievements & Legacy (A vision into the future)

www.gisela-grid.eu

Summary and conclusions (2/2)

• “We now have clear ideas and goals, the (standard-based) tools and a roadmap to achieve them, and the strength of choices largely shared and supported by other projects” (from GISELA 2nd review, 8/12/2011)

• In the last 10 months ideas were turned into reality and all goals have been achieved but…

• …we have done much more than this: we now have a vision for the future of e-Infrastructure in Latin America which is shared and financially sustained by the most important stakeholders in the region (i.e., CLARA and the NRENs)

44GISELA - Final Project Review - Brussels - 11/10/2012