8
LHCb and DataGRID - the LHCb and DataGRID - the workplan for 2001 workplan for 2001 Eric van Herwijnen Eric van Herwijnen Wednesday, 28 march 2001 Wednesday, 28 march 2001

LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

Embed Size (px)

Citation preview

Page 1: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

LHCb and DataGRID - the LHCb and DataGRID - the workplan for 2001workplan for 2001

Eric van HerwijnenEric van Herwijnen

Wednesday, 28 march 2001 Wednesday, 28 march 2001

Page 2: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

OverviewOverview

WP 8 deliverables WP 8 deliverables Testing of TestbedsTesting of Testbeds Hooking up to the “LHCb GRID”Hooking up to the “LHCb GRID” Grid-ifying the LHCb production toolsGrid-ifying the LHCb production tools Planning next GRID brainstorming meetingPlanning next GRID brainstorming meeting

Page 3: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

WP8 deliverablesWP8 deliverables

Month 6: planning document with specifications Month 6: planning document with specifications of the GRID services required from the other of the GRID services required from the other working groups for the different phases of the working groups for the different phases of the WPWP

Month 12: Use case programs. Report on the Month 12: Use case programs. Report on the interfacing activity of use case software to interfacing activity of use case software to minimal grid services minimal grid services (first delivery of (first delivery of Middleware functions end Sep (M9) ..Testbed1)Middleware functions end Sep (M9) ..Testbed1)

Page 4: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

Testing of testbedsTesting of testbeds

Testbed0 available at CERNTestbed0 available at CERN 5 machines, “LXPLUS”-like environment5 machines, “LXPLUS”-like environment no AFS, could be mounted r/o via NFSno AFS, could be mounted r/o via NFS local certificate authoritylocal certificate authority for accounts, see P. Martucci/S. Jarpfor accounts, see P. Martucci/S. Jarp Not clear yet who will be part of Testbed 1 in Not clear yet who will be part of Testbed 1 in

SeptemberSeptember

Page 5: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

Hooking up to the “LHCb Hooking up to the “LHCb GRID”GRID”

Have started a CVS repository “GRID”Have started a CVS repository “GRID” First package: java job submission toolsFirst package: java job submission tools Interested institutes can download, modify and Interested institutes can download, modify and

install these toolsinstall these tools Keep a central common repository Keep a central common repository Objective: outside institutes to supervise their Objective: outside institutes to supervise their

local productionslocal productions

Page 6: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

1.Production started by filling out a Web form:Version of softwareAcceptance cutsDatabaseChannelNumber of events to generateNumber of jobs to runCentre where the jobs should run

2.Web form calls a java servlet that:Creates a job script (one per job)Creates a cards file (one-three per job) with random number seeds and job options(The cards files need to be accessible by the running job)Issues a job submit command to run script in batch-> WP1

3.Script does the following:Copies executable, detector database and cards filesExecutes executableExecutable creates output datasetOutput copied to local mass store -> WP5Log file copied to web browsable areaScript calls java program (see 4)

4.Java program calls servlet at CERN to:Transfer data back to CERN -> WP2Update meta-database at CERN -> WP2

LHCb Use Case for Datagrid LHCb Use Case for Datagrid (MC production)(MC production)

Page 7: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

Gridi-fying the LHCb Gridi-fying the LHCb production toolsproduction tools

First test (this week): submitting bb-bar First test (this week): submitting bb-bar inclusive jobs at RAL CSF (pbs) using the inclusive jobs at RAL CSF (pbs) using the globus-run commandglobus-run command

Second test (NIKHEF):Second test (NIKHEF): modify production tools to allow submission of general

jobs to pbs gradually replace datamove commands in the scripts by

grid-ftp commands

Third test (september): try the modified tools on Third test (september): try the modified tools on testbed1testbed1

Expect other institutes to participateExpect other institutes to participate

Page 8: LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001

Next LHCb-Grid Next LHCb-Grid ‘brainstorming’ meeting‘brainstorming’ meeting

Hoping to have 2 day meeting in Bologna late Hoping to have 2 day meeting in Bologna late May/early June (venue and dates to be May/early June (venue and dates to be confirmed)confirmed)

Hear about LHCb/Italy computing planning Review our general Computer Facility/GRID

activities Review development of Data Analysis Model

and mapping to GRID