18
Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree Phatanapherom ThaiGrid, Thailand Cindy Zheng, SDSC

Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree Phatanapherom ThaiGrid, Thailand Cindy Zheng, SDSC

Embed Size (px)

Citation preview

Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree PhatanapheromThaiGrid, ThailandCindy Zheng, SDSC

Motivation for software catalogingChallenges

Which machines install software you want to use?

Which software has been installed on one machine

Software CatalogingRequirement

Single point of access to software cataloging information

Automatic update for a known software with minimal administrative effort

Presentation of software availability status that is easy to access

Website http://goc.pragma-grid.net/scmsweb/Section Monitoring > SWCatalog

Local Software

Information

Local Software

Information

GridSoftwar

eCatalog

Globus job submission Probe

Software Cataloging processMaster software cataloging service on GOC.Globus is used as a software information

collection mechanismUse globus-job-run to invoke the client probe. Probe investigate the setup on each system

dynamicallyReturn information using name:version:path

format .Storing software information in GOC Provide service to access all the collected data

In CSV and XML format

Information providedList of machine

that install one software

List of software on one system

Available software probesAmberAutodockIntel C/C++/Fortran

compilerNAMDNinf

Alert ServiceAlert checks probe information everyday to

find failure on grid service.Send message to cluster admin when grid service

is not available.send message to admin for 3 days then stop to

prevent the spam.

Bandwidth MonitoringMeasuring bandwidth among sites in

PRAGMAUse Iperf to measure current bandwidthIperf probe provided by SCMSWebProbe information in XML format will

distributed to every node

<probe bandwidth_mbps="0.009091796875" bandwidth="9.31" bandwidth_unit="Kbits/sec" bandwidth_kbps="9.31" bandwidth_bps="9533.44" return_code="0" last_timed_out="1204546516.4" last_fail="0.0" num_fail="0" last_pass="1205140448.58" num_pass="216" num_timed_out="7" return_string="PASS" src_name="ABAC" src_org="AU_TH" dest_name="SutGrid" dest_org="" name="sutgrid.sut.ac.th" target="sutgrid.sut.ac.th" objectclass="SceObject,SceProbe,Iperf" subobjtype="Iperf" command="iperf -c sutgrid.sut.ac.th -p 15001" >

Bandwidth Measurement OutputBandwidth Matrix URL

http://goc.pragma-grid.net/scmsweb/Section Monitoring > Bandwidth

Bandwidth GraphShow current bandwidth and historyDisplay graph, chart and radar chartNot install on PRAGMA yet

Software Probe ExampleNinf-g probe

NAMD_PATH=`which namd2 2> /dev/null`if [ "$?" = 0 ]; then

NAMD_VERSION=`namd2 2> /dev/null | egrep "^Info: NAMD" | sed \ "s/Info: NAMD \([0-9.]*\) for.*/\1/g"`

echo "namd:$NAMD_VERSION:$NAMD_PATH"fi

ICC_PATH=`which icc 2> /dev/null`if [ "$?" = 0 ]; then

ICC_VERSION=`icc -V 2>&1| egrep "Version" | sed \ "s/.*Version[[:space:]]*\([0-9.]*\)[[:space:]]*Build.*/\1/g"`

echo "intel_c_compiler:$ICC_VERSION:$ICC_PATH"fi

Intel C Compiler probe

Formats for SW catalog dataCSVHost\

Softwares,amber,namd,autodock4,intel_c_compiler,intel_fortran_compiler,ninf-g

ASGC,X,X,X,8.1;/prj/intel/00/bin/icc,8.1;/prj/intel/00/bin/ifort,2.4.0;/prj/ng-2.4.0/bin

Syntagma,X,X,X,9.0;/opt/intel/cc/9.0/bin/icc,9.0;/opt/intel/fc/9.0/bin/ifort,2.4.0;/opt/ng/bin

...

XML<SoftwareCatalog>

<Host name="ASGC">

<Software name="intel_c_compiler">

<Path version="8.1">/prj/intel/00/bin/icc</Path>

</Software>

<Software name="intel_fortran_compiler">

<Path version="8.1">/prj/intel/00/bin/ifort</Path>

</Software>

<Software name="ninf-g">

<Path version="2.4.0">/prj/ng-2.4.0/bin</Path>

</Software>

</Host>

</SoftwareCatalog>