Kurt MuellerSan Diego Supercomputer Center

kurt@sdsc.edu

NPACI HotPage Updates

•US National Science Foundation funded collaboration between research institutions:

•San Diego Supercomputer Center (SDSC) - University of California, San Diego

•Texas Advanced Computing Center (TACC) - University of Texas, Austin

•Center for Advanced Computing (CAC) - University of Michigan

•46 other institutions...

NPACINational Partnership for Advanced

Computational Infrastructure

•compute

•SDSC Blue Horizon - 1152 CPU IBM SP

•TACC Longhorn - 224 CPU IBM Power4

•TACC Aurora - 16 CPU Cray SV1

•CAC Morpheus, Hypnos - 256, 134 CPU AMD clusters

•CAC 64 and 24 CPU IBM SP systems

NPACI resources

•storage

•SDSC HPSS - 6 petabytes

•TACC DMF - 1.4 petabytes

•CAC ADSM - 41 terabytes

•Caltech HPSS - 323 terabytes

NPACI resources

•463 nodes

•1854 CPUs

•4345 peak GFlops

•1714 GB RAM

•7.7 petabytes tape storage

aggregate resources

status bar

individual resource info

login for more tools

architecture

•moved to Apache on linux

•underlying GridPort updated to 2.3

•object-oriented perl

•module packaging

•simplified installation

•new features: NWS, etc.

HotPage updates

•old methods of data collection:

•cron jobs on webserver, triggering ssh commands to execute remote scripts on resources and store data on webserver

•Globus job run to execute remote scripts

•GIS queries for status data

data collection

•problems with old methods:

•some scripts generated LDIF, some HTML

•no separation of content and presentation

•GIS support inconsistent across partner sites

•no persistent storage of data - historical record

data collection

•GridPort Information Repository

•developed at TACC, with help from SDSC

•XML-centric database to store performance and other data

•web services data ingester and query interface

GP-IR data repository

•<?xml version="1.0" encoding="UTF-8" ?>

<loadInfo xmlns="http://grids.tacc.utexas.edu/schemas/infoservices/load" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://grids.tacc.utexas.edu/schemas/infoservices/load/load.xsd" timestamp="2001-12-17T09:30:47-05:00" hostname="horizon.sdsc.edu">

• <load>

• <type>queue</type> <Percent>87</Percent>

• </load>

•</loadInfo>

GP-IR data example

•cron jobs run on HotPage server to query GP-IR every five minutes and write out xml to cache directories

•HotPage page requests generate live queries to GP-IR

•if live queries fail, HotPage scripts load cached XML

GP-IR data caching

resource view sorting

•summary table

•grid monitor

•NWS

grid view

•historical performance queries

•portlets - presentation this week

•customization, portability

•GridPort 3.0 - ditto

•OGSA

•HotPage source code distribution - this week?

•rollout technologies to PACI HotPage

•NPACI, NCSA and PSC resources

to do

•https://hotpage.npaci.edu/

•http://www.npaci.edu

•http://www.sdsc.edu

•http://www.tacc.utexas.edu

•GridPort http://gridport.npaci.edu

•GP-IR http://www.tacc.utexas.edu/grid/gpir/

links