18
INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC, 8 th December 2004

INFSO-RI-508833 Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

Embed Size (px)

Citation preview

Page 1: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

GILDA and GENIUS Guy WarnerNeSC Training Team

An induction to EGEE for GOSC and the NGSNeSC, 8th December 2004

Page 2: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 2

Overview

• GILDA• The GILDA Testbed

– What is a Grid Testbed?– What is the GILDA Testbed?– Where is the GILDA Testbed?

• The GENIUS Portal– What is a Portal?– What is the GENIUS Portal?– How it works.– Advanced Functionalities

• The Practical

Page 3: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 3

GILDAGrid INFN Laboratory for Dissemination Activities

A virtual laboratory to demonstrate/disseminate the strong capabilities of grid computing.

Run by the EGEE team at INFN Catania (Sicily) under Roberto Barbera

GILDA incorporates: • The Gilda Testbed• GENIUS• A monitoring system using GridICE (not covered here)• Its own Virtual Organization and Certificate Authority

(not covered here)

Page 4: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 4

The GILDA home page(https://gilda.ct.infn.it)

Page 5: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 5

What is a Testbed Grid?

• A testbed (according to Google):– A platform on which an assortment of experimental tools and products may

be deployed and allowed to interact in real-time. Successful tools and products may be identified and developed in an interactive, evolutionary, interdependent process.

– Experimental proof of concept, technology demonstration, pre-prototype.

• The GILDA “Testbed Grid”:

– Provides a safe environment for new users and communities to gain early experience and training in grids.

– New applications can be developed in an environment isolated from already running stable grid applications.

Page 6: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 6

The GILDA Testbed

• An EGEE testbed.

• Running the latest stable EGEE middleware

• Used for initial porting of new applications into EGEE.

• Supports existing and potential new EGEE user communities.

• Supports the EGEE training activities.

Page 7: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 7

GILDA Sites

• 12 Sites• 5 Countries

Page 8: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 8

Using the Grid without a Portal

ReplicaReplicaCatalogueCatalogue

Logging &Logging &Book-keepingBook-keeping

ResourceResourceBrokerBroker

StorageStorageElementElement

ComputingComputingElementElement

Information Information ServiceService

Job Status

DataSets info

Author.&Authen.

Job S

ub

mit

Even

t

Job

Qu

ery

Job

Stat

us

Input “sandbox”

Input “sandbox” + Broker Info

Output “sandbox”

Output “sandbox”

Pu

blis

h

SE & CE info

““User User interface”interface”

edg-job-list-match HelloWorld.jdl

edg-job-submit -o job.id HelloWorld.jdl

edg-job-status -v 1 -i job.id

edg-job-get-output -i job.id --dir .

???

Page 9: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 9

Using the Grid with a Portal

ReplicaReplicaCatalogueCatalogue

Logging &Logging &Book-keepingBook-keeping

ResourceResourceBrokerBroker

StorageStorageElementElement

ComputingComputingElementElement

Information Information ServiceService

Job Status

DataSets info

Author.&Authen.

Job S

ub

mit

Even

t

Job

Qu

ery

Job

Stat

us

Input “sandbox”

Input “sandbox” + Broker Info

Output “sandbox”

Output “sandbox”

Pu

blis

h

SE & CE info

““User User interface”interface”

Page 10: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 10

Introducing GENIUS

• GENIUS – the full version: https://genius.ct.infn.it

• Grid Demonstrator – an ‘open to all’ 24/7 available version:https://grid-demo.ct.infn.it

• Grid Tutor – a version designed for training purposes:https://grid-tutor.ct.infn.it

Several versions of the portal exist:

Page 11: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 11

GENIUS: A grid portal

• A Portal provides a gateway via a web site to grid/internet functionalities.

• GENIUS is a Portal that:– Provides access to the functionality and resources of the grid.– Hides the use of the command line.– Avoids users needing a deep understanding of grid middleware– Accessible from anywhere by desktop, laptop, PDA or mobile

phone.– Protects the user from changes to the grid middleware.– Provides the user with a secure environment at all levels– Is simple to use.

Grid Enabled web eNvironment for site Independent User job Submission

Page 12: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 12

The GENIUS hourglass model

OS & Net services

Basic Services

High level GRID middleware

Applications

INFN/NICEsrl collaboration

(EGEE Services)

(VDT)

Page 13: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 13

3-tier model

GENIUS: how it works

Grid Services

Browser

Portal Development Kit

Web Server

Portal

User interface

Page 14: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 14

• Problem: A web server and hence the portal must run with the lowest possible privileges. How then can it run jobs for the user?

• The best answer is to extend the GSI delegation system so that the user can delegate the rights to run the job to the portal.

• The MyProxy service provides this extension by:– temporarily storing the users credentials.– starting a proxy service on behalf of the user.– providing a separate passphrase for the portal.

Portal Security

Page 15: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 15

Advanced Functionalities

Interactive Services Application Specific Interfaces

Graphic Workflow Editor Peer to Peer Services

Page 16: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 16

Summary

• GILDA is a testbed with a complete suite of grid elements and applications.

• GILDA runs and will run the last production (stable) version of the grid middleware (currently Grid.it 2.2.0 based on LCG 2.2.0).

• GILDA is the dissemination tool which will be used during induction courses and tutorials

• GENIUS is a well established portal which is fundamental in the process of interfacing new applications with the EGEE middleware

• GENIUS hides the complex internals of the EGEE middleware from new and non-experts users.

Page 17: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 17

The Practical 1

• Running Jobs on GILDA by the use of the GENIUS (grid-tutor) portal.– Submission – Monitoring– Retrieving output

• Editing the job description file.– Job inputs and outputs– Job Requirements

• Basic Data Management– Retrieving data from the grid.

Page 18: INFSO-RI-508833 Enabling Grids for E-sciencE  GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

GENIUS and GILDA, NeSC, 8th December 04

Enabling Grids for E-sciencE

INFSO-RI-508833 18

The Practical 2

• Log in to your workstation– UserName: student– Password: G05Cu53r (that’s a zero)

• Open a web browser and go tohttp://homepages.nesc.ac.uk/~gcw/GENIUS/

• Your GENIUS identification is:– UserName: edinburghXX where XX is the number of the lab PC

you are sat in front of (e.g. edinburgh05)– Password: GridEDIXX where XX is as above– MyProxy passphrase: EDINBURGH

• Follow the instructions from there on in.