10
LHCb planning for DataGRID LHCb planning for DataGRID testbed0 testbed0 Eric van Herwijnen Eric van Herwijnen Thursday, 10 may 2001 Thursday, 10 may 2001

LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Embed Size (px)

Citation preview

Page 1: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

LHCb planning for DataGRID LHCb planning for DataGRID testbed0testbed0

Eric van HerwijnenEric van Herwijnen

Thursday, 10 may 2001 Thursday, 10 may 2001

Page 2: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

OverviewOverview

Information & organization Information & organization Testbed0 Testbed0 Procedure for participating institutes:Procedure for participating institutes:

Planning of tests: admin Planning of tests: what to test Planning of tests: how to do it

Status so farStatus so far TimescaleTimescale

Page 3: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Information and Information and organizationorganization

Mailing list:Mailing list: [email protected] [email protected]

CVS repository:CVS repository: to get Java production tools:to get Java production tools:

cvs -d $NEWCVSROOT co GRID/productiontools

to get the DataGRID LHCb installation kits:to get the DataGRID LHCb installation kits: cvs -d $NEWCVSROOT co GRID/installationkits

to get sample script and .dat files:to get sample script and .dat files: cvs -d $NEWCVSROOT co GRID/scripts

Page 4: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Testbed0Testbed0

Objective: deploy basic Globus services and test themObjective: deploy basic Globus services and test them

Site OS/machines Batch system Operational LHCb contactCERN 5 PIII's, Linux LSF yes Eric van HerwijnenIN2P3 Lyon ? ? ? ?IN2P3 Marseille 2 PIII's, Linux Condor ? Andrei TsaregorodtsevIN2P3 Clermont-Ferrand

10 PIII's,Linux

? ? Vincent Breton

INFN-CNAF Bologna 5 PII/PIII,Linux

PBS yes Domenico Galli/Umberto Marconi

RAL 10 PIII's,Linux

PBS yes Glenn Patrick

Liverpool ? ? yes Girish Patel/Martin McCubbinEdinburgh/Glasgow ? ? ? Akram KahnImperial College ? Condor yes David CollingBristol ? ? ? Nick BrookNIKHEF ? PBS ? Sander Klous

Page 5: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Procedure for participating Procedure for participating institutesinstitutes

CERN, Lyon, Marseille, RAL, INFN Bologna, CERN, Lyon, Marseille, RAL, INFN Bologna, Liverpool, Edinburgh, Imperial, NikhefLiverpool, Edinburgh, Imperial, Nikhef

others interested please contact meothers interested please contact me

Page 6: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Planning of tests: adminPlanning of tests: admin

Complete your entry in previous table and Complete your entry in previous table and contact me (find out exactly what your local contact me (find out exactly what your local testbed0 is from local WP6 contact)testbed0 is from local WP6 contact)

Decide which tests you want to do (e.g. Submit Decide which tests you want to do (e.g. Submit jobs from Bologna to Liverpool)jobs from Bologna to Liverpool)

Get a national Grid certificate following the Get a national Grid certificate following the procedure on http://marianne.in2p3.frprocedure on http://marianne.in2p3.fr

Get local accounts on the testbeds that you Get local accounts on the testbeds that you want to testwant to test

WP6 will add people to Grid map filesWP6 will add people to Grid map files

Page 7: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Planning of tests: what to testPlanning of tests: what to test

Objective: Objective: run bb-bar inclusive generation and reconstruction job via

Globus if possible send data to CERN update the bookkeeping database

For sites wishing to become part of LHCb For sites wishing to become part of LHCb production:production:

installation of java production tools automate file transfer to CERN

Page 8: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Planning of tests: how to do itPlanning of tests: how to do it

Check out GRID files from cvs repositoryCheck out GRID files from cvs repository uncompress (gunzip *.tar.z) and untar (tar -xvf *.tar) uncompress (gunzip *.tar.z) and untar (tar -xvf *.tar)

the installation kitsthe installation kits run the bbincl.job script, modify it until it works run the bbincl.job script, modify it until it works

(don’t worry about java to start with)(don’t worry about java to start with) when it works, do e.g.:when it works, do e.g.:

globus-job-submit csflnx01.rl.ac.uk/jobmanager-pbs bbincl.job

try to recover output with other globus commands try to recover output with other globus commands or ftp by handor ftp by hand

to install production tools (requires servlet runner) to install production tools (requires servlet runner) contact mecontact me

Page 9: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

Status so farStatus so far

RAL CSF and CERN testbed0 integrated with RAL CSF and CERN testbed0 integrated with LHCb production toolsLHCb production tools

Jobs with 5 events run fineJobs with 5 events run fine Larger jobs can be run one at a time, problems Larger jobs can be run one at a time, problems

with gass_cache under investigationwith gass_cache under investigation Problems interfacing to pbs (jobs always end Problems interfacing to pbs (jobs always end

up in M queue)up in M queue) Problems with using sh or cshProblems with using sh or csh

Page 10: LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001

TimescaleTimescale

Tests of testbed0 should be done before Tests of testbed0 should be done before september 2001 (testbed1 release)september 2001 (testbed1 release)

LHCb Grid meeting Bologna 13-15 june 2001LHCb Grid meeting Bologna 13-15 june 2001 progress on testbed0 tests security issues for testbed1 LHCb analysis model