Embed Size (px)
DESCRIPTION
gLite Information System. E2GRIS1 Rafael Silva Universidade Federal de Campina Grande (Brazil) Itacuruça (Brazil), 2-15 November 2008. Overview. Information System Adopted Information System BDII Querying a BDII Useful Commands GLUE Schema References Some Exercises. - PowerPoint PPT Presentation
Citation preview
www.eu-eela.eu
E-science grid facility for Europe and Latin America
gLite Information System
E2GRIS1
Rafael Silva
Universidade Federal de Campina Grande (Brazil)
Itacuruça (Brazil), 2-15 November 2008
www.eu-eela.eu
Overview
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 2
• Information System• Adopted Information System
– BDII– Querying a BDII– Useful Commands
• GLUE Schema• References• Some Exercises
www.eu-eela.eu
Information System
• What is?– System to collect information on the state of resources
• Used for?– To discover resources of the grid and their nature– Workload management– Monitoring (health status of resources)
• How?– Monitoring state of the resources locally and publishing fresh
data on the information system– Adopting a data model that must be well known to all
components that want to access monitored information– More than one implementation:
BDII (Berkeley DB Information System) R-GMA (Relational Grid Monitoring Architecture)
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 3
www.eu-eela.eu
Information System (2)
• Hierarchical System– Information is collected on the leaves of a hierarchical tree and
travels towards the root– Clients can query the hierarchical tree at every level– The higher the level against which queries are made, the older is
the obtained information
• Collecting info– Pull model (higher level severs periodically query lower level
severs)– LDAP query model
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 4
www.eu-eela.eu
Adopted Information System
• BDII (Berkeley DB Information System)
– Based on LDAP (Light Direct Access Protocol) servers
– Evolution of the Globus Meta Directory System (MDS)
– Several layers: Lower Level: GRIS (Grid Resource Information Server) Medium Level: GIIS (Grid Index Information Server) Higher Level: Top BDII (BDII Server)
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 5
www.eu-eela.eu
BDII• Stays on top of GIIS sites
• One for each VO
• Centralized system
• Three level of hierarchy
• Every two minutes a cron-job runs a script and collects info from a list of GIIS sites
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 6
www.eu-eela.eu
Querying a BDII
• Query a BDII server
– where the –x option indicates that simple authentication should be used; the –h and –p option precede the hostname and port respectively; and the –b option is used to specify the initial entry for the search in the LDAP tree
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 7
# ldapsearch -x -h <your_BDII_FQDN> -p 2170 -b mds-vo-name=local,o=grid
www.eu-eela.eu
Useful Commands
• lcg-infosites– Obtain VO-specific information on existing Grid resources
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 8
$LCG_GFAL_INFOSYS=<your_BDII_FQDN>:2170
$lcg-infosites –-vo edteam ce
$lcg-infosites –-vo edteam se
$lcg-infosites –-vo edteam rb
#CPU Free Total Jobs Running Waiting ComputingElement
----------------------------------------------------------
106 106 0 0 0 ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam
36 34 0 0 0 ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam
7 7 0 0 0 eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam
22 22 0 0 0 tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam
22 22 0 0 0 ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam
12 0 0 0 0 ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid
88 48 0 0 0 ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam
24 24 0 0 0 ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam
#CPU Free Total Jobs Running Waiting ComputingElement
----------------------------------------------------------
106 106 0 0 0 ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam
36 34 0 0 0 ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam
7 7 0 0 0 eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam
22 22 0 0 0 tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam
22 22 0 0 0 ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam
12 0 0 0 0 ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid
88 48 0 0 0 ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam
24 24 0 0 0 ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam
www.eu-eela.eu
Useful Commands (2)
• lcg-info– List either CEs or SEs satisfying a given set of conditions on
their attributes, and to print, for each of them, the values of a given set of attributes
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 9
$ lcg-info --vo edteam --list-ce
- CE: ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam
- CE: ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam
- CE: ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam
- CE: ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam
- CE: ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid
- CE: eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam
- CE: ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam
- CE: tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam
- CE: ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam
- CE: ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam
- CE: ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam
- CE: ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam
- CE: ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid
- CE: eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam
- CE: ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam
- CE: tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam
www.eu-eela.eu
Useful Commands (3)
• lcg-info
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 10
$ lcg-info --list-se –vo edteam --attrs CloseCE
- SE: eelaSE1.lsd.ufcg.edu.br
- CloseCE eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-eela
eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-lhcb
eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam
eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-ops
- SE: eelaSE1.lsd.ufcg.edu.br
- CloseCE eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-eela
eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-lhcb
eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam
eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-ops
www.eu-eela.eu
Useful Commands
• lcg-info
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 11
$ lcg-info --vo edteam --list-ce --query 'TotalCPUs = 10' --attrs 'RunningJobs,FreeCPUs‘
$ lcg-info --vo gilda --list-se -attrs 'AvailableSpace,CloseCE‘
Querying the BDII of another VO:
$ lcg-info --vo eumed --bdii bdii.isabella.grnet.gr:2170 --list-se --attrs 'AvailableSpace,CloseCE'
www.eu-eela.eu
GLUE Schema
• Grid Laboratory Uniform Environment (GLUE) Schema– Provides a standardized description of a Grid computing
system, to enable resources and services to be presented to users and external services in a uniform way
– Collaboration effort between EU-DataTAG and US-iVDGL projects
• XML Schema– GLUE Schema is being mapped to an XML representation– http://glueschema.forge.cnaf.infn.it
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 12
www.eu-eela.eu
References
• BDII Documentation– https://twiki.cern.ch/twiki/bin/view/EGEE/BDII– https://twiki.cern.ch/twiki/bin/view/LCG/BdiiNotes
• LCG-2 User Guide– https://edms.cern.ch/file/454439//LCG-2-UserGuide.html
• GLUE Schema– http://infnforge.cnaf.infn.it/glueinfomodel
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 13
www.eu-eela.eu
Some Exercises
• Topic related Wiki pages:– https://grid.ct.infn.it/twiki/bin/view/GILDA/InformationSystems
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 14
www.eu-eela.eu
Questions…
Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 15
