www.epikh.eu

The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How)

Introduction to the EPIKH/CHAIN

projects

Riccardo Rotondo (riccardo.rotondo@garr.it) Consortium GARR Joint CHAIN/EPIKH School for Application Porting to Science Gateways Beijing, 11.04.2012

Beijing, Asia 4, 11-04-2012 2

Outline

•  Grids and Infrastructures •  The EPIKH project •  The CHAIN project

Computationally Intensive research

Beijing, Asia 4, 11-04-2012 3

Today’ research

Beijing, Asia 4, 11-04-2012

The Grid

•  A  GRID  is  a  distributed  compu4ng  and  storage  infrastructure  –  spanning  several  administra4ve  domains  -­‐  allowing  sharing  of  resources  in  a  coordinated  manner  by  a  set  of  homogeneous  users  organized  within  Virtual  Organiza4ons  

•  A  GRID  provides  single  sign  on  to  access  a  large  variety  of  resources  and  an  added  value  with  respect  to  the  bare  sum  of  its  components  

•  GRIDS  are  the  key  enabler  of  e-­‐Science  Beijing, Asia 4, 11-04-2012 5

e-Science

–  e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it

e-Infrastructure = Networks + Grids .. + Operations, Support, Training… + Data centres, archives, instruments…

•  Networks interconnect resources •  Grids enable flexible usage of interconnected resources:

•  Distributed computing across different administrative domains

Beijing, Asia 4, 11-04-2012 6

Overview

Beijing, Asia 4, 11-04-2012 7

" Virtual  organisa-ons  

e-­‐Science  

7

" Applications " Data " Instruments

" e-Infrastructure " Network

" Computational and Storage resources

e-Infrastructure

Beijing, Asia 4, 11-04-2012 8

National Research and Education Networks

National Grid Initiatives

International Grid Initiatives

World’ Grids

Beijing, Asia 4, 11-04-2012 9

The  Global  Grid  

EELA

OSG

XSEDE

NAREGI EUMedGrid

BalticGrid SEE-Grid

EUIndiaGrid

EUAsiaGrid

EUChinaGrid

DEISA

EGI

EU fundend

Non EU

Beijing, Asia 4, 11-04-2012 10

Beijing, Asia 4, 11-04-2012 11

The Triangle of Knowledge

Research & Development

Innovation Education & Training

Building e-Infrastructures is a waste if we don’t “build”, at the same time, their users.

Along with e-Infrastructures, t-Infrastructures and training programmes are also needed.

t-Infrastructure

Beijing, Asia 4, 11-04-2012 12

The EPIKH Project (www.epikh.eu)

•  “Exchange Programme to advance e-Infrastructure Know-How” (EPIKH) –  EU FP7- Marie Curie Actions – People - International Research

Staff Exchange Scheme (IRSES) •  Consortium “numbers”:

–  23 partners; –  18 countries; –  4 continents (Africa,

Latin America, Asia, Europe); –  115 persons involved; –  >650 researcher-months; –  >500 secondments;

•  Duration: March, 1, 2009 – February, 28, 2013 (48 months)

•  EC contribution: 1,188,000 €

Beijing, Asia 4, 11-04-2012 13

The EPIKH Partners

Chinese Partner

Beijing, Asia 4, 11-04-2012 14

The EPIKH goals •  Strategic aims:

–  Reinforce the impact of e-Infrastructures in scientific research defining and delivering stimulating programme of educational events, including Grid Schools and High Performance Computing courses;

–  Broaden the engagement in e-Science activities and collaborations both geographically and across disciplines.

•  Specific actions: –  Spreading the knowledge about the “Grid Paradigm” to all

potential users: both system administrators and application developers through an extensive training programme;

–  Easing the access of the trained people to the e-Infrastructures existing in the areas of action of the project;

–  Fostering the establishment of scientific collaborations among the countries/continents involved in the project.

Beijing, Asia 4, 11-04-2012 15

EPIKH secondments’ programme 1st Phase:

Non-EU → EU (selected)

Res. Programs

2nd Phase: EU → Non-EU Grid Schools

(with 1st phase tutors) Workshops

Beijing, Asia 4, 11-04-2012 16

EPIKH Quality & Certification Programme •  All seconded people must be

officially selected against their CVs;

•  All Non-EU→EU secondments must have a Research Program agreed between “sending” and “accepting” organisations;

•  All secondments must have final reports both from the seconded person and the “accepting” organisation –  If both reports will be successfull

the seconded person will be provided with an official certificate

Beijing, Asia 4, 11-04-2012 17

EPIKH on the web www.epikh.eu

wiki.epikh.eu

documents.epikh.eu

agenda.epikh.eu

Beijing, Asia 4, 11-04-2012 18

Grants and applications (wiki.epikh.eu)

The call for applications is still open !

GEOMAP Views - Partners

Beijing, Asia 4, 11-04-2012 19

GEOMAP Views – Events

Beijing, Asia 4, 11-04-2012 20

GEOMAP Views – Events

Beijing, Asia 4, 11-04-2012 21

EPIKH Applications

Beijing, Asia 4, 11-04-2012 22

Beijing, Asia 4, 11-04-2012 23

GILDA: the “de facto” standard EPIKH t-Infrastructure

" GILDA: Grid INFN Laboratory for Dissemination Activities " https://gilda.ct.infn.it

" GILDA is a complete Grid production quality infrastructure fully devoted to demonstrate/disseminate Grid computing

" GILDA is an international effort funded by multiple sources " GILDA is adopted by several Grid projects worldwide " It runs the latest Grid middleware version supporting many

middleware such as Condor, Globus, OurGrid, UNICORE, etc.

" Using GILDA is free of charge

Beijing, Asia 4, 11-04-2012 24

The GILDA formats and services (https://gilda.ct.infn.it)

•  Training on Grid –  Tutorial for Users –  Tutorial for Site Admin –  Grid Schools –  Tutorial for Trainers –  Customized events –  University courses (Degree, Ms.C, Ph.D, etc.) –  Training materials: Wiki pages, Printable Documentation, Demos, Videos, etc.

•  Grid Application development –  Support to Grid application development –  Deployment of the applications into the GENIUS and P-GRADE grid portals –  GILDA Ticketing support system

•  Infrastructure –  GILDA CA –  GILDA VOMS –  Creation of pilot test-beds: EELA, EUMED, EUCHINA, EUINDIA, SAGRID, etc. –  Testing and development on new available gLite services –  Dedicated Software repository/Virtual services (INFN Grid) –  Monitoring (GStat, SAM, GridMap, etc. )

Science Gateways Grid School

Beijing, Asia 4, 11-04-2012 25

Conclusions •  Research communities can greatly benefit from EPIKH

and use GILDA to “gridify” and run applications of local interest;

•  EPIKH can represents for young brilliant scientists and technologists a unique occasion to learn and adopt the Grid paradigm through stimulating research programmes;

•  Thanks to EPIKH activities, EUMED Organisations can setup “clones” of GILDA locally to implement campus grids or even nation-wide e-infrastructures (good examples are already existing both in South Africa and Cuba);

•  EPIKH/GILDA can offer free technical support for anyone willing to organize local training events on Grid computing: –  It can be undergraduate courses, M.Sc. courses, Ph.D. curricula,

tutorials, Grid Schools, etc.

Beijing, Asia 4, 11-04-2012 26

Outline

}  General information and CHAIN vision }  Workplan }  State of the art analysis }  Data analysis and recommendations }  Virtual Research Communities }  Interoperation & Interoperability }  Conclusions

27 Beijing, Asia 4, 11-04-2012

Regional Grid infrastructures

CNGrid

NKN & Garuda

EUAsiaGrid

SAGrid & SANREN

GISELA

28 Beijing, Asia 4, 11-04-2012

CHAIN: global coverage

29 Beijing, Asia 4, 11-04-2012

Project objectives

•  Define a strategy and a model for external collaboration, in close collaboration with EGI.eu which will enable operational and organisation interfacing of EGI and external eInfrastructures

•  Validate this model, as a proof-of-principle, by supporting the extension and consolidation of worldwide Virtual Research Communities

•  Explore and propose concrete steps forward towards the coordination with other projects and initiatives (e.g. EGI.eu, EUMEDGRID-Support, EUIndiaGrid2, LinkSCEEM2, NKN & Garuda, etc.)

30 Beijing, Asia 4, 11-04-2012

Project information

•  Grant Agreement for a total EC contribution of 1.1 M€ •  Total cost: about 1.9 M€ •  Start Date: 1st December 2010 - Duration 24 Months •  Partners:

1)  INFN (Italy - Coordinator) 2)  CESNET (Czech Rep.) 3)  CIEMAT (Spain) 4)  GRNET (Greece) 5)  IHEP (China) 6)  UBUNTUNET (Africa) 7)  CLARA (Latin America) 8)  PSA (India) 9)  ASREN (Med./Middle East/Gulf) Since 1 August 2011

31 Beijing, Asia 4, 11-04-2012

Project strategic vision

}  A world-wide Distributed Computing Infrastructure can address big scientific challenges that are not manageable with departmental computing systems

}  Virtual Research Communities can transparently access different kind of resources: scientific applications and tools, Data Repositories, down to CPUs and Disks. The vision is that of VRCs sharing resources ubiquitously across different administrative domains

}  Regional e-Infrastructures should be made interoperable among each other. CHAIN is committed to promote and validate a proof-of-concept that addresses this

32 Beijing, Asia 4, 11-04-2012

Disseminate (WP5)

Project workplan

State of the Art Assessment

(WP2)

Analyse the different Regional

Approaches (WP2, WP4)

Make Recommendatio

ns (WP2, WP3,

WP4)

Involve the VRCs (WP3)

Propose a Road-Map and

Intermediate solutions

(WP4, WP3)

Demonstrate the usefulness of interoperation (WP3, WP4)

33 Beijing, Asia 4, 11-04-2012

State of the art analysis (WP2)

}  Analysis of existing NGI literature and related questionnaires

}  Creation of the regional and NGI questionnaires

}  Questionnaires being implemented and published online  

}  Collection of contact points from all continents

}  Questionnaire is kept open and collection of contact points from all

continents is continued

}  Questionnaire data provided through the CHAIN Knowledge

Base

34 Beijing, Asia 4, 11-04-2012

Knowledge base (WP2, WP5)

35 Beijing, Asia 4, 11-04-2012

www.chain-project/knowledge-base

Country view

36 Beijing, Asia 4, 11-04-2012

Data analysis (WP4, WP2)

Nuber of sites and number of CPU - Mediterranean

012345678

Algeria

EgyptTunisia

Morocco

IranUnited Arab Emirates

Jordan

Site

s

0

100

200

300

400

500

600

700

CPU

cor

es

Number of Grid sites / clusters: Number of CPU cores:

Number of sites and number of CPUs

37 Beijing, Asia 4, 11-04-2012

Nuber of sites and number of CPU - Latin America

0

10

20

30

40

50

60

BrazilEcuador

Colombia

Argentina

Panamá

Paraguay

Mexico

CubaVenezuela

Costa Rica

Guatemala

Peru

Site

s

0

1000

2000

3000

4000

5000

6000

CPU

cor

es

Number of Grid sites / clusters: Number of CPU cores:

Nuber of sites and number of CPU - Asia Pacific

012345678

Indonesia

Singapore

Vietnam

New Zealand

Taiwan

Site

s

0

1000

2000

3000

4000

5000

6000

7000

CPU

cor

es

Number of Grid sites / clusters: Number of CPU cores:

WP2 Recommendations

•  74 Detailed recommendations classified by: –  Short (1 year), Medium (3 years) and Long term (5 years) –  High, Medium, Low priority –  National Grid Initiatives (9):

§  General (5); Regional (4) –  Interoperations (14):

§  General (1), ROC (3), User Support (1), Monitoring (3), Security (2), Core Services (2); Middleware (2)

–  Interoperability (2): General (1), Input/Output (1) –  Virtual Research Communities’ perspective: General (2) –  Regional planning (47):

§  Africa (9), Asia Pacific (6), Central Asia (5), China (7), India (4), Latin America (5), Mediterranean & Arab Countries (11)

38 Beijing, Asia 4, 11-04-2012

Identified VRC (1) }  Coordinator: Dr. Alexandre M.J.J. Bonvin – Universiteit Utrecht }  Structural biology, making use of NMR (Nuclear Magnetic Resonance),

SAXS (Small Angle X-ray Scattering), computational modelling or other related techniques to study biomolecules

}  We-NMR partners in red, collaborations in orange }  MoU signed on 21/09/2011 }  New contacts (WP2 survey)

}  Burundi }  Costa Rica

http://www.wenmr.eu

Beijing, Asia 4, 11-04-2012 39

Identified VRC (2) }  Coordinator: Dr. Antonio Cofiño – Universidad de Cantabria }  Meteorology and other Earth Science related areas willing to enhance

their forecasting techniques on Idealized Simulations, Regional and Global Applications, Parameterization and Data Assimilation or Forecast and Hurricane Research

}  Dissemination within CORDEX project }  WRF4G partners in red, collaborations in orange }  MoU signed on 19/09/2011 }  New contacts (WP2 survey)

}  Burundi }  China }  Costa Rica }  Cuba

http://www.meteo.unican.es/es/software/wrf4g

Beijing, Asia 4, 11-04-2012 40

Identified VRC (3)

}  Coordinator: Dr. David Posada – Universidad de Vigo }  Evolutionary biology for the statistical selection of best-fit models of

nucleotide substitution and amino acid replacement for a given set of aligned sequences (molecular systematics, phylogenetics, phylogenomics, molecular evolution and/or bioinformatics)

}  jModelTest & ProtTest registered users }  Modeltest ~ 30.000 }  jModelTest ~ 11.000 }  Prottest ~ 5.000

}  MoU signed on 21/02/2012 }  New sequential and distributed computing versions available on SG

and being tested }  New contacts (WP2 survey): Burundi, Costa Rica, Democratic Republic

of Congo, Ethiopia, Nigeria, Panama, Sudan, Taiwan

http://darwin.uvigo.es/

Beijing, Asia 4, 11-04-2012 41

Identified VRC (4)

}  LSGC

}  MoU signed during EGI CF 2012

}  One of the biggest Grid users, HEP excluded. According to EGI accounting portal, during last year, there were jobs running in these Regions: }  Asia Pacific

}  Europe }  Canada }  Latin America (IGALC & ROC_LA) }  Russia

Beijing, Asia 4, 11-04-2012 42

Identified VRC (5) }  Coordinator: Dr. Rossella Caffo – ICCU/Ministero per i Beni e le Attività

Culturali }  These initiatives are working on coordination of policy and best practice

regarding the use of e-Infrastructures for digital cultural heritage }  INDICATE / DC-NET partners in red,collaborations in orange }  MoU signed during EGI CF 2012

}  This VRC offers much different requirements than those from traditional R&D communities

}  New contacts to integrate a digital repository in Panama by means of the INDICATE e-Culture Science Gateway

}  http://www.indicate-project.org/ -

http://www.dc-net.org/

Beijing, Asia 4, 11-04-2012 43

Identified VRC (6)

}  Coordinator: Dr. Fulvio Galeazzi - GARR }  Design, implement, and validate a GRID-based e-Infrastructure

building upon neuGRID and relying on the Pan-European backbone GEANT and the NRENs. Over this e-Infrastructure, a service will be provided for the computer-aided extraction of diagnostic markers for Alzheimer's disease and schizophrenia from medical images

}  DECIDE partners in red

}  (http://www.eu-decide.eu) Beijing, Asia 4, 11-04-2012 44

Identified VRC (7)

}  Climate Change

}  Conf. Role of e-Infrastructures in Climate Change

}  List of interested people and projects }  4 projects identified }  20 contacts }  WRF4G is being promoted inside the VRC

}  New development: CAM4G à Strategy to be also used in other models

}  Adaptation of GridWay to SAGA (near future) }  Seismology groups identified in LA, India and Italy

Beijing, Asia 4, 11-04-2012 45

Identified VRC (8)

}  SuperB

}  SuperB will be a heavy flavour accelerator that will provide complementary information to LHC, looking at rare decays with a very high luminosity electron-positron asymmetric collider

}  Potential contacts world-wide by means of LHC collaborations }  Continuous contacts with them

Beijing, Asia 4, 11-04-2012 46

....... Science

Gatew

ay

App. 1 App. 2 App. N

Embedded  Applica-ons   Administrator  Power  User  Basic  User  

Users from different

organisations having different

roles and privileges

Access: the Science Gateway model (WP3, WP4)

Standard-based middleware-independent

Grid Engine

47 Beijing, Asia 4, 11-04-2012

Conclusions

}  CHAIN project has successfully agreed with other regional projects on the SG approach

}  The first test using SG to access different infrastructures has been very encouraging

}  A final test/demo is foreseen at the EGI TF 2012 in Prague in September with possibly other middlewares.

48 Beijing, Asia 4, 11-04-2012

Beijing, Asia 4, 11-04-2012 49

Thank you for your kind attention !

Any questions ?