Grid ASP Portals and the Grid PSE Builder

Satoshi ItohGTRC, AIST

3rd Oct. 2003

UK & Japan N+N Meeting

Takeshi NishikawaNaotaka YamamotoHiroshi TakemiyaMotonori HiranoYoshio TanakaSatoshi Sekiguchi

2

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Overview of Grid ASP

Grid ASP provides users PSE( Grid services )Portal system hides Grid environment from users

UserGridASP(Grid Service Provider)

PSE components(Grid Services)•Application service•Storage service•Computing service•DB service :

Portal

Main service is a batch job

3

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Activities @ GTRC, AIST

Software toolkit for constructing portalGrid PSE Builder (GridLib)

Grid application portalsISV software( Gaussian, Phoenics, ... )user programming application

Experiment of Grid ASP (planning)Feasibility study with real business players

4

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Overview of the Grid PSE Builder

Framework for building an application portal on a grid environment

Globus Toolkit 2.x (MDS, GRAM, GSI)

5

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Single-sign-on/session manager

SSL client server mutual authentication Session management at SSL/TSL layerX.509 certificate based client authentication

Proxy certificate based on GSI using portal ID( Single user account on grid environment )

6

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

PSE Component information

Interface of applicationXML-based Web page description language

Application name, location ...ContentsArguments (input parameters, ..)Options

<application xmlns="http://www.aist.go.jp/vcc" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.aist.go.jp/vcc application_schema.xml"> <appname>cat</appname> <appid>1</appid> <appcomment>Concatenate file(s).</appcomment> <argspec>/bin/cat %option% %files%</argspec> <arglist>

<args use="option" separate="true"> <title>Operation Option</title> <checkbox name="option"> <box value="-b">number nonblank output lines</box> <box value="-E">display $ at end of each line</box> <box value="-n">number all output lines</box> 　 <box value="-s">never more than one single blank line</box> <box value="-T">display TAB characters as ^I</box> <box value="-v">use ^ and M- notation, except for LFD and TAB</box> </checkbox> </args>

<args use="required"> <title>files</title> <file name="files" max="unbounded" /> </args>

</arglist></application>

7

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

8

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Batch job / Data staging manager

In/Out file management for jobsUpload and download input parameters and files between client and PortalTransfer files from portal server to specified resources using GridFTP

Job execution managementSubmit/ cancel jobs using globus GRMMonitor status of jobs

9

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Future work for Grid PSE Builder

Individual accounting modelProxy certificate for individual userUsers don’t need globus on their clients

Workflow controlUser : describe workflow of their jobsProvider : combine several applications as a single service

10

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Grid Application portals

Phoenics PortalComputational Fluid Dynamics

Weather forecast PortalMeteorology

QC Grid/ Gaussian PortalQuantum Chemistry

http://www.phoenics.co.jp/

11

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Phoenics PortalPHOENICS is a commercial code for CFD.Easy access to CFD application on parallel supercomputer(SR8000)through TSUKUBA-WAN.

user

10km

TSUKUBA-WAN

SR8000Phoenics Portal

AISTNTT-AS lab.

12

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

KU

KISTI

AIST

Weather forecast Grid portalUser programming application

A numerical weather prediction program 3 Grid middlewares

Globus toolkit, Ninf-G, Grid PSE Builder

Globus Toolkit 2.xGlobus Toolkit 2.x

Ninf-GNinf-G

Weather forecast programWeather forecast program

Grid PSE Builder(GridLib)

Grid PSE Builder(GridLib)

http/ https

RPC

Web browser

PC Cluster

disturbanceSimulation

...

tens-hundreds

Simulation

Different random sequences

Statisticsdisturbance

disturbance

Prof. Tanaka (Univ. of Tsukuba).

13

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

QC Grid/ Gaussian Portal

Purpose : Virtual laboratory for Quantum ChemistryTarget users : scientists and engineers in bio-chem, bio-phys, material design, drug design, etc.

Special featurePrediction of required resourcesAvoidance of the same calculation

14

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Components of Gaussian Portal

I/O archives

Meta-schedulerInput AnalyzerEstimatorComparatorRetriever

Web-baseduser interface

Results DB

High-throughput nodes

Large Memorynodes

KnowledgeDBInput flow

output flow

Meta-scheduler is a core component of the Gaussian Portal

15

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Meta-schedulerInput Analyzer

Evaluating the method for calculation, the number of atoms, kind and number of basis set functions.

EstimatorEstimating the amount of computing resources (CPU time, memory, disk space).

Comparatorcomparing the computing time and the retrieval time, and judging whether to retrieve or to compute.

RetrieverRetrieving previous results.

16

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

Grid ASP Experiment

Feasibility study on business modelsReal business players contribute the experiment by their own ways. Period : Oct. 2003 – March 2006

Network : Carrier, ...

Computer, Storage : H/W vender, ...

Middleware : SIer

Man

agem

ent

Applications : ISV vender, ...

Portal: Portal company

Users: companies, laboratories, consumers

17

UK & Japan N+N Meeting @ The Montague Hotel, London 3rd Oct. 2003

ASP リソースプロバイダ

Players in Grid ASP business

Some of functions may be acted by one player.

User company ASP Resource provider

Designdata

Resultdata

User

Portal

Licensemanagement

Usermanagement

Providermanagement.

Computerresources

Applications

Server

StorageData

management

GaussianPhoenics

....