20
INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN (Italy) [email protected] ISGC 2007, Taipei (Taiwan) 2007-03-29

INFSO-RI-508833 Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

Embed Size (px)

Citation preview

Page 1: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

GridICE: Grid and Fabric Monitoring Integrated

for gLite-based SitesSergio FantinelINFN (Italy)[email protected]

ISGC 2007, Taipei (Taiwan)2007-03-29

Page 2: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 2

Enabling Grids for E-sciencE

INFSO-RI-508833

OUTLINE

• Brief Architecture Overview

• Stakeholders

• Sample Usage Views

Page 3: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 3

Enabling Grids for E-sciencE

INFSO-RI-508833

Deployment Layout and info Sources

GOC DB• standard info providers

• extended info providers

• GOCDB collected information

Page 4: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 4

Enabling Grids for E-sciencE

INFSO-RI-508833

Infrastructure Layout

DB

GRIS (GLUE+ schema)

LEMON Server

cluster head node

information providers farm

monitoringarchive

runldif output

write

read

information index

BDII/GIIS (GLUE schema)

monitoring server

First discovery phase

Cont. discovery & collection

ldap query

ldap query

web interface

clusterworker node

/procfilesystem

sensors

run

readmetric output

metric output

LEMON monitoring agent

LEMON monitoring agent

clusterworker node

/procfilesystem

sensors

run

readmetric output

metric output

GridICESchema

SITE Level

Page 5: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 5

Enabling Grids for E-sciencE

INFSO-RI-508833

Stakeholders

• High level Managers– Interested in bird-eyes view of resources status and

usage (aggregations, reports, graphs)

• Grid Operators (CIC, ROC,…)– Detail views for day by day shifts help

• Site Administrators– Site level grid and fabric detail views

• Grid Users– Interested in job submission ad tracking

Page 6: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 6

Enabling Grids for E-sciencE

INFSO-RI-508833

GridICE sensors at fabric level

• Standard per host metric collection– CPU, MEM, VMEM, FileSystem, Net Interfaces, …

• GridICE specific probes for advanced measurement– In Production:

Job monitoring LRMSInfo Generic/per role Daemons status with simple config

– Ready but not in release: WMSLB

– In developing (almost ready) storage (CASTOR, DPM, dCache) internal status (almost

done, integration needed) FTS

Page 7: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 7

Enabling Grids for E-sciencE

INFSO-RI-508833

Summary High Level Overview

Page 8: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 8

Enabling Grids for E-sciencE

INFSO-RI-508833

VOs Summary View

Page 9: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 9

Enabling Grids for E-sciencE

INFSO-RI-508833

VO Computational Resources

Page 10: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 10

Enabling Grids for E-sciencE

INFSO-RI-508833

Available Brokers Status

Page 11: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 11

Enabling Grids for E-sciencE

INFSO-RI-508833

Site Comp. Resources Status

Page 12: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 12

Enabling Grids for E-sciencE

INFSO-RI-508833

Site Details

Page 13: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 13

Enabling Grids for E-sciencE

INFSO-RI-508833

Daemons Grid Service Status

Site can be notified by the GridICE server on daemons status change

Page 14: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 14

Enabling Grids for E-sciencE

INFSO-RI-508833

Site Grid Jobs

Page 15: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 15

Enabling Grids for E-sciencE

INFSO-RI-508833

Site detailed graphs

Page 16: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 16

Enabling Grids for E-sciencE

INFSO-RI-508833

SNAP

Page 17: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 17

Enabling Grids for E-sciencE

INFSO-RI-508833

SNAP

Page 18: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 18

Enabling Grids for E-sciencE

INFSO-RI-508833

SNAP

Page 19: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 19

Enabling Grids for E-sciencE

INFSO-RI-508833

SNAP

Page 20: INFSO-RI-508833 Enabling Grids for E-sciencE  GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN

ISGC2007, Taipei (Taiwan), 2007-03-29 20

Enabling Grids for E-sciencE

INFSO-RI-508833

SNAP