CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A

CHEP 2000, 10.02.2000 Giuseppe Andronico

Giuseppe Andronico

Grid portal based data management for Lattice QCD

data

ACAT03, Tsukuba, 02.12.2003

work in collaboration with A. Falzone and R. Barbera

Università di Catania and INFN Catania - Italy

ILDG and DataGrid Project

Roberto BarberaGiuseppe Andronico

Outline

Introduction

Grid and GENIUS

ILDG Metadata Workgroup

GENIUS implementation

Future developments




GRID

MIDDLEWARE

Visualising

Workstation

Mobile Access

Supercomputer, PC-Cluster

Data-storage, Sensors, Experiments

Internet, networks

Giuseppe Andronico

The Grid metaphor




DataGrid job work-flowReplicaReplicaCatalogueCatalogue

UIJDL

Logging &Logging &Book-keepingBook-keeping

ResourceResourceBrokerBroker

Job SubmissionJob SubmissionServiceService

StorageStorageElementElement

ComputeComputeElementElement

Information Information ServiceService

Job Status

DataSets info

Author.&Authen.

Job S

ub

mit

Even

t

Job

Qu

ery

Job

Stat

us

Input “sandbox”

Input “sandbox” + Broker InfoGlobus RSL

Output “sandbox”

Output “sandbox”

Job Status

Pu

blis

h

grid

-pro

xy-in

it

Exp

and

ed J

DL

SE & CE info

Giuseppe Andronico



Roberto Barbera

A web portal: why and how ?

It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone).It can keep the same user interface to several back-ends (grid “dialects” command-line UI’s).It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level.All available grid services must be incorporated in a logic way, just “one mouse click away”.Its layout must be easily understandable and user friendly.



ACAT03, Tsukuba, 02.12.2003 Giuseppe Andronico

GENIUS®

(Grid Enabled web eNvironment for

site Independent User job Submission)

[https://genius.ct.infn.it]

INFN/NICE collaboration

OS & Net services

Basic Services

High level GRID middleware

ALICE ATLAS CMS LHCbApplications’specific layer

Other apps

GLOBUS

toolkit

DataGRID architectur

e

GENIUS web portal

ACAT03, Tsukuba, 02.12.2003 Giuseppe Andronico



https://genius.ct.infn.it/

https://genius.ct.infn.it/

Roberto Barbera

GENIUS: how it works

Apache

EnginFrame

GENIUShttps+java/xml+rfb

WEB Browser

EDGUI

Local

WS

the GridEDG+GSI

Giuseppe Andronico



3-tier model

Grid authentication with MyProxy

Giuseppe Andronico

EDGUI

MyProxy

Server

grid-proxy-initmyproxy-init

myproxy-get-delegatio

n

Local

WS

GENIUS

Server(EDG

UI)

any grid service

output

WEB Browser

the Grid

execution





Giuseppe AndronicoACAT03, Tsukuba, 02.12.2003

Upon initiative of Prof. Richard Kenway

ILDG peopleTomoteru Yoshie (Japan) Convener

Chris Maynard (UK)

Paul Coddington (Australia)

Jim Simone (USA - SciDAC)

Robert Edwards (USA - SciDAC)

Giuseppe Andronico (Italy)

Dirk Pleiter (Germany)

Balint Joo (UK)

http://www.lqcd.org/ildg/tiki-index.php

ILDGInternational Lattice Data Group




ILDG

Configurations as LQCD resources

Different algorithms and implementations

Different data file format

Standardize metadata to describe configurations:

Management

Implementation

Configuration




ILDG

XML for metadata

Last draft at Lattice 2003, Tsukuba (hep-lat/0309029)

Evolving with LQCD people contribution




XML to SQL




Software

PERL scripts

DOM parser

Storing procedure

Several DB querying procedures

All this is handles from GENIUS




GENIUS




Selecting VO




The VO page




Storing a configuration




Storing a configuration




A trial search




The result




Show metadata info

Roberto BarberaGiuseppe Andronico

Summary and conclusions (1/2)

ILDG is defining a metadata XML structure to help LQCD people to share their workThe Grid offers a proper tool to physically sharing the files world wide in a secure wayWe implemented a trial service to: Store configurations Search between configuration by querying XML informations Show the search result and, potentially, download the data

GENIUS offers a quick and simple way to build a WEB interface to these services to simplify their use GENIUS is the targeted Grid-portal for Generic Applications in EGEE-NA4 (kick-off meeting in Paris on Dec 18)






Future developments

XML to SQL mapping

XML database test

Advanced search engine

Summary and conclusions (2/2)

Documents

CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A