Embed Size (px)
Citation preview
FP7-INFRA-222667
Enabling Grids for E-sciencE
www.eu-egee.org
EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
Acad
em
ic a
nd E
ducat ional Gr id Init iat ive o
f Serbia
A E G I SSep. 19, 2008
Grid services
Dusan Vudragovic
Scientific Computing Laboratory
Institute of Physics Belgrade, Serbia
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
Set of basic Grid services
• Job submission/management• File transfer (individual, queued)• Database access• Data management (replication, metadata)• Monitoring/Indexing system information
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
VOMS (1/4)
• Virtual Organization Membership Service– Problem description
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
VOMS (2/4)
– Grid Security Infrastructure (GSI) enables secure authentication and communication over an open network Public key encryption Digital X.509 certificate Secure Sockets Layer (SSL) communication protocol
– Certification Authority (CA)– grid-mapfile mechanism– LCAS/LCMAPS mechanism allow for a more detailed
definition of user privilege– VOMS server examplehttps://voms.phy.bg.ac.yu:8443/voms/aegis
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
VOMS (3/4)
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
VOMS (4/4)
– Use delegation to establish dynamic distributed system
ComputingCenter
VO
Rights
ComputingCenter
Service
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
BDII (1/2)
• Berkely Database Information Index– Information Service (IS)
Globus Monitoring and Discovery Service (MDS)• GLUE Schema
• Lightweight Directory Access Protocol (LDAP)
• Distinguished Name (DN)
• Directory Information Tree (DIT)
• Grid Resource Information Server (GRIS) Relational Grid Monitoring Architecture
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
BDII (2/2)
• GStathttp://goc.grid.sinica.edu.tw/gstat/
• GOC DBhttps://goc.gridops.org/
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
RGMA
• Relational Grid Monitoring Architecture– Global distributed relational database– Model is more powerful than the LDAP-based one– Advance query operations– Architecture consists of three major components
Producers - provide the information Consumers - request the information Registry - mediates the communication between the Producers and
the Consumers
• EGEE Accounting Portalhttp://www3.egee.cesga.es/gridsite/accounting/CESGA/egee_view.php
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
WMS(1/2)
• Run the Workload Management System– To accept job submissions– Dispatch jobs to appropriate Compute Element (CE) – Allow users
To get information about their status To retrieve their output
• A configuration file on each UI node determines which WMS node(s) will be used
• When a user submits a job, JDL options are to: – Specify CE– Allow WMS to choose CE (using optional tags to define
requirements)– Specify SE (then WMS finds “nearest” appropriate CE,
after interrogating File catalogue service)
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
WMS (2/2)
• Workload Management System
• WMS monitoring tool
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
LB
• Logging and Bookkeeping service– Who did what and when?– What’s happening to my job?– Usually runs on WMS node
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
CE
Homogeneous set of worker nodes
Grid gate node
Local resource management system:Condor / PBS / LSF master
Gatekeeper
Job request
Loc. Info system
Logging
A&A
Information system
L&B
A CE is a grid batch queuewith a “grid gate” front-end:
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
SE
• Storage elements hold files: write once, read many
• Replica files can be held on different SE:– “close” to CE; share load on SE
• File Catalogue - what replicas exist for a file and where are they?
Loc. InfoSystem
EventLogging
A&A
GridFTP
Disk arrays or tapesDisk arrays or tapes
Info system
L&B
Gatekeeper
File transfer Requests
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
Other Grid services
• PX (MyProxy)• FTS (File Transfer Service)• LFC (Logical File Catalog)• AMGA (ARDA Metadata Grid Application)
Enabling Grids for E-sciencE
FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia
What really happens
FileFilecataloguecatalogue
Logging &Logging &Book-keepingBook-keeping
WMSWMS
StorageStorageElementElement
ComputingComputingElementElement
Information Information ServiceService
Job Status
DataSets info
Auth.&Auth.
Jo
b S
ub
mit E
ve
nt
Jo
b
Qu
ery
Job
Stat
us
Input“sandbox”
Input “sandbox” +
Broker Info
Output “sandbox”
Output“sandbox”
Pu
blis
h
SE & CE info
User User interfaceinterface
