22
May 9 2006 Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Embed Size (px)

Citation preview

Page 1: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

May 9 2006 Donatella Lucchesi 1

CDF Status of Computing

Donatella LucchesiINFN and University of Padova

Page 2: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 2May 9 2006

Introduction

CDF has to reconstruct and to analyze the largest data samples !

How does CDF cope with the increasing data and dedicated resource and manpower reduction?

Page 3: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 3May 9 2006

CDF Code and Data Production Status Reconstruction code: stable and well performing.Plan for final production release in 2006

6 weeks!want to reach 4

Production farm is just an other CAF, it can be usedfor production ntuples for the whole collaboration

Page 4: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 4May 9 2006

CDF User Resources not enough

There is always something in some queue

more resources needed!

Page 5: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 5May 9 2006

How the CDF Resources are used

Fermilab mostlyanalysis orientedbut also some Monte Carlo

Offsite usedfor Monte Carlo

Page 6: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 6May 9 2006

CNAF is special case Some data are there and…

…gives ~50% of offsite resource

Page 7: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 7May 9 2006

CDF usage of CNAF Resources

Some data analysis has been done but largely used forMonte Carlo

Reminder:CNAF is a GlideCAF, opportunistic use of all resources(Other GlideCAF: Lyon, San Diego, MIT and FermiGrid)

S. Sarkar & I. Sfiligoi developed

Page 8: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 8May 9 2006

CDF resources usage respect to CNAF

Total cpu time since April 2005

Total cpu time April 2006

Page 9: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 9May 9 2006

CDF Resources Needs Proportional Model: scale FY2005 resourcesFY200x demand = (FY2005 resources)x(FY200x/FY2005)data vol.

Input parameters:

Results:

Page 10: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 10May 9 2006

CDF Resources Requests Hypothesis

Page 11: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 11May 9 2006

CDF Resources Requests (IFC)

12

Lowerbound

4.3

6.0

Page 12: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 12May 9 2006

Where CDF can find new ResourcesWorking on strategies to improve resources utilization:

One-pass production Centralized ntuple production Run dependent Monte Carlo production

Access GRID Resources Merge several GlideCAF into one:

• Transversal firewall, scalability issues under study• Fermilab - San Diego CMS group project

lcgcaf:• use gLite resource broker • same cdf user interface but code re-written• MC produced by power users up to now• CDF-Italy and INFNGrid project

Page 13: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 13May 9 2006

Lcgcaf designDevelopers: F. Delli Paoli, D. Jeans, S. Sarkar and I. Sfiligoi advices

Page 14: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 14May 9 2006

Lcgcaf status

Resources available in Italy anything but T1: 617KSI2K Compare to T1: 1800 KSI2K

Usage up to now: Monte Carlo production for the B group started Sites used: Tier1 and Padova Stored for the moment at CNAF on Storage Element (SE) Plan for an automatic storage at FNAL

GRID Efficiency: 97%

Monte Carlo data can be produced outside CNAF

Page 15: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 15May 9 2006

Need for Physics Center

Year lumi (fb-1) Peak L3 rate N events BCHARM Skimmed total B(MB/s) x1e9 (TB) (TB) (TB)

2005 1.40 35 2.0 23 12 352006 2.20 60 3.4 54 13 672007 3.80 60 5.7 77 19 962008 6.10 60 9.2 107 27 134

Disk space: - BCHARM dataset and skimmed data are on disk - size of these datasets is scaled using luminosity, logging rate and event size

What we need for B Data

Page 16: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 16May 9 2006

Need for Physics Center

Use year Assigned B needs Asked tot CDF total T1 New CDFIntegrated (TB) (TB) (TB) Integrated (TB) (TB) %

2005 32 35 19 51 507 10%

2006 90 67 22 112 1056 11%

2007 130 96 31 161 1540 10%

2008 170 134 49 219 3960 6%

CDF has some disk space assigned at CNAF.Half of the already assigned resources are devoted to B data we ask for what is missing.

Currently: 65 TB

Page 17: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 17May 9 2006

Need for Physics Center

Use year CDF Total T1 CDF %GR1 maggio 05 KSI2K

2005 494 1818 27%2006 903 3420 26%2007 1032 5040 20%2008 1161 10800 11%

CPUs

Total Tier1 from Mirco talk at CN1 6/7 Feb. 2006

CDF is not asking more than what already discussedand approved one year ago

Page 18: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 18May 9 2006

Manpower

Fermilab: I. Sfiligoi, CDF-GRID and dCAF coordinator need a replacement San Diego group (CAF maintenance) need to be replacedR. Borgatti (SAM support at fnal) Contract at fnal?

Italy: D. Lucchesi (coordination, SAM in Italy, data import)S. Sarkar (CNAF management, GlideCAF, disks, Tier1 Interaction) ends in July 06 , new AR requested.F. Delli Paoli (lcgcaf management, CDF code maintenance) ends in September 06D. Jeans (GlideCaf-disk-user interface) ends in March 07L. Brigliadori (support CNAF management) end January 07

Page 19: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 19May 9 2006

BACKUP

Page 20: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 20May 9 2006

CDF Data recording

Integrated LuminosityPer detector by Oct 09

Peak inst. lum record 1.8 1032 cm-2 s-1

total delivered: 1.6 fb-1/expt total recorded: 1.3 fb-1/expt

Page 21: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 21May 9 2006

Lower bound Resources requests

Page 22: May 9 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi 22May 9 2006

Lower bound Resources requests