Upload
kayla-blair
View
223
Download
0
Tags:
Embed Size (px)
Citation preview
TeraGrid Deployment Testof Grid Software
JP NavarroTeraGrid Software Integration
University of Chicago
OGF 21October 19, 2007
October 2007 OGF21 2
Software BuildFinal step of middleware build
DeploymentAdministrator performs at least 1 manual functional
tests
Pre-Production and ProductionRoutine (where extensive TeraGrid testing happens)Regression (opportunity)
Testing Stages/Types
October 2007 OGF21 3
Inca - User-level Grid monitoring
• Testing and performance measurement from a generic, impartial user’s perspective in order to detect and fix Grid infrastructure problems before the user’s notice them.
• User-level Grid monitoring system:– Runs from a standard user account– Executes using a standard GSI credential– Uses tests that are developed and configured based on user documentation
– Verifies user-accessible Grid access points
October 2007 OGF21 4
Inca Architecture
October 2007 OGF21 5
Collecting Monitoring Data
• Reporters – Executable program that measures some aspect of the system or installed software
– Requirements:•Supports specific command-line options•Writes XML (Inca Reporter schema) to stdout
– Supports multiple types of data– Extensive library support for perl scripts
– Most reporters < 30 lines of code– Independent of other Inca components
October 2007 OGF21 6
Sharing Reporters
•Repositories: collection of reporters available via a URL– Supports package dependencies (Perl modules, Makefile, autoconf)
Packages versioned to allow for automatic updatesInca repository contains 157 reporters
Version, unit test, performance benchmark reportersGrid middleware and tools, compilers, math libraries, data tools, and viz tool
Screenshot of a repository using Inca GUI tool
October 2007 OGF21 7
Centralized configuration and deployment
•Incat–GUI interface to enable a large number of monitoring results to be collected with a minimum of effort
–Configure the reporters to execute on a set of resources
–Configuration stored in a XML file and sent to Agent
•Agent–Implements the configuration specified by Inca administrator
–Stages and launches a reporter manager on each resource
–Sends package and configuration updates
October 2007 OGF21 8
Storing data
•Depot–Stores configuration information and monitoring results
–Uses relational database backend via Hibernate
–Provides full archiving of reporter output–Supports SQL queries and provides predefined queries for latest monitoring results, report instance, and report history
–Supports notifications
October 2007 OGF21 9
Displaying and publishing data
•Data Consumer–Web application that queries and displays monitoring data
–Packaged with Jetty –JSP tags to query data and format using XSL
•Web services–Query data from depot and return as XML
October 2007 OGF21 10
Inca in Use: TeraGrid
• Currently monitoring all 18 allocated TeraGrid resources – Monitoring of
CTSSv4 (in progress)
– Grid jobs (Globus gatekeeper logs)
– CA certificate and CRL checking (notify if 2 weeks from expiration)
– Resource registration in MDS
October 2007 OGF21 11
Summary status status view
October 2007 OGF21 12
Historical data
October 2007 OGF21 13
Inca in use: Grid Assessment Probes
•Set of probes designed to emulate Grid applications
•Deployed using Inca to GEON and TeraGrid
October 2007 OGF21 14
Clients
Clients
Clients
Information Services
CacheCache
WS/RESTHTTP GET
WS/SOAP
WS MDS4
TomcatWebMDS
Apache 2.0
TeraGrid Wide Services
TeraGrid Repositories
WS/SOAPWS MDS4
Resource Provider Services
Resources and Available Kits
October 2007 OGF21 16
Information Services and Inca
REST
SOAP
TeraGrid Capability Kit transitionfrom Development --> Testing, Production
Triggers Inca Testing
October 2007 OGF21 17
Extended regression testingComprehensive functionality suiteScalability/load testingMulti-service grid interaction testing (TeraGrid does some
already)(Reliability and failure testing)
ToolingInca, orMetronome, orMetronome mediated Inca?
SharingMulti-institution testing repositoriesContributions from software providers, integrators, and
users
Testing Opportunities
October 2007 OGF21 18
Website: http://inca.sdsc.edu
Announcements:[email protected]
Email: [email protected]
Supported by:
More Inca Information