Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)

Middleware forCampus Grids

Steven Newhouse, ETF Chair

(& Deputy Director, OMII)

©

Which Grid Middleware? gLite (EGEE) OMII GT4 UnitedDevices GridSystems CROWN ….

©

What are your requirements? Research vs. supporting research Bleeding edge vs. production Your potential user community:

‘Intelligence’ Pain threshold

Upfront cost vs. medium/long term costs

©

ETF: Historical Role Started September 2001 Technical forum to build the UK Grid:

GSC DTI/EPSRC Regional Centres Working Groups in 10+ areas

Achievements: Established UK expertise Level 1 Grid: Basic compute/file grid Level 2 Grid: L1 + Application users

©

ETF: Current Activities Integrated with GOSC

0.5 FTE from each regional centre Total 4 FTEs over ~12 people

Leverage wider expertise within the community Evaluating software for production deployment

Continue plenary meetings Focussed short–term ‘action lines’ Evaluation Criteria

©

‘Standard’ Evaluation Criteria Collect the same information Try and answer the same questions Focus on:

General Background Information Systems Management User’s Experience Developer’s Experience Technical

Relate to NGS environment

©

ETF: In context

OMIIETF NGS

Distribution

Other Software Services

Prototypes &

Specifications

Software with proven

capability & realistic

deployment experience

Feedback &

future requirements

EGEE Services

©

ETF: Broader context

UKCampus

andother Grids

NGS

Operations

Providerrequirements

GOSC Board

Userrequirements

ETFSoftwareproviders

Softwareproviders

Softwareproviders

©

Secured Condor Pool Authorised Condor Flocking Use GSI to control access to daemons Flocking through firewalls

©

UDDI Explore use of UDDI v2 Replication of registry

No support at UDDI level Very hard to do at the database level

Poor support for provenance & meta-data Grimoires from OMII to address some issues

©

GridSystems Commercial product InnerGrid: Within the firewall OuterGrid: Between systems (not evaluated) Use of Tomcat/Axis as server

Agents represent resources Modules represent applications Tasks represent modules running on agents

©

GT4 Major new release of the Globus Toolkit

Implementation of WSRF Improved GridFTP Improved WS-GRAM w.r.t. GT3.x

Straightforward portable source & binary installers High quality structured documentation for installation

& development Pure Java code OK on both Linux and Windows

©

GT4 Components

©

GT4 Migration From GT3:

A few straight forward changes to service interfaces.

Improved service performance & reliability From GT2.4:

Pre WS components interoperate

©

GT4 Issues No migration guide for GT2 developers

BUT compatibility library for API Developing Grid systems

As opposed to just GridServices Integration of new DRM into system

Sun Grid Engine

©

OMII 1:Basic Services Services to meet the needs of stakeholders

Service Provider: I have something to share Users: I want to use these shared resources

Functional: Data & Application execution Running jobs using pre-installed applications Movement of input and output data files

Management: Account and Resources Must have an account with a service provider Or delegated access to someone else’s account

©

OMII 1: Architecture

databaseof

accountsresources

applications

resources

computationdata storageapplications

Web Services

Accounting

Resource Mgmt

Data Staging

Job Submission

Client Application

Admin Application

Application

Application

Management(Browser)

Application

WS Security

Tomcat & Axis

©

OMII 1: Stack

WS-Security

AXIS

HappyAxis

TOMCAT

Static Webpage

AcctMgmt

Servlet

ResourceMgmt

Servlet

Account

Allocation

Data

Job

TestS

ervice

Exam

pleService

Application

USER

PBAC

©

OMII 1: Summary Robust and straightforward deployment on

supported platforms Applications need to be installed on the

machine Does what it says on the tin What it does it does well

©

gLite Early releases have been deployed OK Suggested deployment requires ~6 machines Package install OK (but gHeavy!) Configuration complex Evaluation on hold

©

Summary Complete

UDDI Registry Condor

Finishing GridSystems GT4 OMII 1

Underway GridMP Distributed visualisation (RAVE) gLite (hibernating) CROWN

Reports will go on the ETF websitewhen complete.Feed into NGS deployment decisions