Upload
cecil-maxwell
View
216
Download
0
Embed Size (px)
Citation preview
Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree PhatanapheromThaiGrid, ThailandCindy Zheng, SDSC
Motivation for software catalogingChallenges
Which machines install software you want to use?
Which software has been installed on one machine
Software CatalogingRequirement
Single point of access to software cataloging information
Automatic update for a known software with minimal administrative effort
Presentation of software availability status that is easy to access
Website http://goc.pragma-grid.net/scmsweb/Section Monitoring > SWCatalog
Software Cataloging processMaster software cataloging service on GOC.Globus is used as a software information
collection mechanismUse globus-job-run to invoke the client probe. Probe investigate the setup on each system
dynamicallyReturn information using name:version:path
format .Storing software information in GOC Provide service to access all the collected data
In CSV and XML format
Alert ServiceAlert checks probe information everyday to
find failure on grid service.Send message to cluster admin when grid service
is not available.send message to admin for 3 days then stop to
prevent the spam.
Bandwidth MonitoringMeasuring bandwidth among sites in
PRAGMAUse Iperf to measure current bandwidthIperf probe provided by SCMSWebProbe information in XML format will
distributed to every node
<probe bandwidth_mbps="0.009091796875" bandwidth="9.31" bandwidth_unit="Kbits/sec" bandwidth_kbps="9.31" bandwidth_bps="9533.44" return_code="0" last_timed_out="1204546516.4" last_fail="0.0" num_fail="0" last_pass="1205140448.58" num_pass="216" num_timed_out="7" return_string="PASS" src_name="ABAC" src_org="AU_TH" dest_name="SutGrid" dest_org="" name="sutgrid.sut.ac.th" target="sutgrid.sut.ac.th" objectclass="SceObject,SceProbe,Iperf" subobjtype="Iperf" command="iperf -c sutgrid.sut.ac.th -p 15001" >
Bandwidth Measurement OutputBandwidth Matrix URL
http://goc.pragma-grid.net/scmsweb/Section Monitoring > Bandwidth
Bandwidth GraphShow current bandwidth and historyDisplay graph, chart and radar chartNot install on PRAGMA yet
Software Probe ExampleNinf-g probe
NAMD_PATH=`which namd2 2> /dev/null`if [ "$?" = 0 ]; then
NAMD_VERSION=`namd2 2> /dev/null | egrep "^Info: NAMD" | sed \ "s/Info: NAMD \([0-9.]*\) for.*/\1/g"`
echo "namd:$NAMD_VERSION:$NAMD_PATH"fi
ICC_PATH=`which icc 2> /dev/null`if [ "$?" = 0 ]; then
ICC_VERSION=`icc -V 2>&1| egrep "Version" | sed \ "s/.*Version[[:space:]]*\([0-9.]*\)[[:space:]]*Build.*/\1/g"`
echo "intel_c_compiler:$ICC_VERSION:$ICC_PATH"fi
Intel C Compiler probe
Formats for SW catalog dataCSVHost\
Softwares,amber,namd,autodock4,intel_c_compiler,intel_fortran_compiler,ninf-g
ASGC,X,X,X,8.1;/prj/intel/00/bin/icc,8.1;/prj/intel/00/bin/ifort,2.4.0;/prj/ng-2.4.0/bin
Syntagma,X,X,X,9.0;/opt/intel/cc/9.0/bin/icc,9.0;/opt/intel/fc/9.0/bin/ifort,2.4.0;/opt/ng/bin
...
XML<SoftwareCatalog>
<Host name="ASGC">
<Software name="intel_c_compiler">
<Path version="8.1">/prj/intel/00/bin/icc</Path>
</Software>
<Software name="intel_fortran_compiler">
<Path version="8.1">/prj/intel/00/bin/ifort</Path>
</Software>
<Software name="ninf-g">
<Path version="2.4.0">/prj/ng-2.4.0/bin</Path>
</Software>
</Host>
</SoftwareCatalog>