GridPP2 Status

Tony Doyle

OC Actions

1. GridPP TO PROVIDE DATA ON WHAT FRACTION OF THE REGISTERED USERS WERE MAKING THE GREATEST USAGE OF THE RESOURCES. SEE TALK

2. GridPP TO PROVIDE PPARC WITH A TIER 1 PURCHASE PLAN FOR FY06. DONE3. GridPP to provide data on experiments’ increased usage of Tier 2

resources. DONE4. GridPP to provide an update of the performance metrics. DONE5. GridPP to present a draft GridPP3 proposal to the next meeting. DONE

(version 0.6)6. GridPP to circulate procedures adopted by Grid Security Vulnerability

Group to Committee members. DONE7. GridPP to provide a paper to the next meeting justifying the proposed

Tier 1 hardware spend in FY07 against other spending options. ONGOING

8. GridPP to describe its relationship with the e-Science Core Programme more fully. ONGOING

9. GridPP to provide PPARC, on a post-by-post basis, details of the cost of extending posts finishing before new funding is expected to be in place (end of March 2008). DONE (on March 15th and included as part of GridPP3 proposal)

gLite 3.0

• What is gLite-3.0?• LCG-2.7 and updates • gLite WMS/LB • gLite CE • gLite/LCG WN • gLite/LCG UI • FTS (Service) • FTA (Agents)

WLCG MoU• 17 March 2006• PPARC signed the

Memorandum of Understanding with CERN

• Commitment to UK Tier-1 at RAL and the four UK Tier-2s to provide services and resources.

• Will need to propagate through LFRC..

UK pledges & medium-term planning

RAL, UKPledged Planned to be pledged

2006 2007 2008 2009 2010

CPU (kSI2K) 98014921234

27123943

4206 6321

585710734

Disk (Tbytes) 450841630

14842232

20873300

30205475

Tape (Tbytes) 6641080555

20742115

39344007

57106402

• As defined in summer 2005..

1. Tier-1 (v26b) plan 2007 or Tier-2 GridPP MoU, followed by pessimistic guess

2. August 2005 “minimal Grid”

3.3. GridPP3 proposalGridPP3 proposal (see Dave’s talk)

• Need to update 2007 pledges by Sept. 06

UK, Sum of all Federations

Pledged Planned to be pledged

2006 2007 2008 2009 2010

CPU (kSI2K) 380038401592

48304251

54106127

60109272

Disk (Tbytes) 530540258

6001174

6602150

7203406

Dissemination highlights

• the Grid by numbers (For MPs)

• the BBC..

Tier-0 to Tier-1

• worldwide data transfers > 950MB/s for 1 week• peak transfer rate from CERN of >1.6GB/s• Need high data rate transfers to/from CERN as

a routine activity

Tier-1 to Tier-2

• UK data transfers >1000Mb/s for 3 days• peak transfer rate from RAL of >1.5Gb/s• Need high data rate transfers to/from RAL as a

routine activity

gLite 3.0 deployment• Upgrades are supported from LCG-2.7.0• Appears to work well • Sites need to keep on the upgrade path• A reasonably well-defined deployment release cycle• Release cycle is getting (somewhat) shorter

0

5

10

15

20

25

30

35

40

09/0

4/2

005

23/0

4/2

005

07/0

5/2

005

21/0

5/2

005

04/0

6/2

005

18/0

6/2

005

02/0

7/2

005

16/0

7/2

005

30/0

7/2

005

13/0

8/2

005

27/0

8/2

005

10/0

9/2

005

24/0

9/2

005

08/1

0/2

005

22/1

0/2

005

05/1

1/2

005

19/1

1/2

005

03/1

2/2

005

17/1

2/2

005

31/1

2/2

005

14/0

1/2

006

28/0

1/2

006

11/0

2/2

006

25/0

2/2

006

11/0

3/2

006

25/0

3/2

006

08/0

4/2

006

22/0

4/2

006

06/0

5/2

006

20/0

5/2

006

03/0

6/2

006

17/0

6/2

006

# s

ites a

t rele

ase

LCG-2_6_0 LCG-2_7_0 GLITE-3_0_0 LCG-2_4_0

Project Status

• Good progress, according to plan

• Glass half full....and half empty

• 5000 ex 10000 CPUs

MetricOK

Metric not OK

Tasks Complete

Tasks Overdue

Tasks due in next 60 days

Items Inactive

Tasks not Due

Change Forms

88(91%)

9 127 (49%)

7 19 20 105 3

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 0.10 0.11 0.12 0.13 0.14 0.15 0.16 0.17 0.100 0.101 0.102 0.103 0.104 0.105 0.106 0.107 0.108 0.109 0.110 0.111 0.112 0.113 0.114 0.115 0.116

0.18 0.19 0.20 0.21 0.22 0.23 0.24 0.25 0.26 0.27 0.28 0.29 0.30 0.31 0.32 0.33 0.34 0.117 0.118 0.119 0.120 0.121 0.122 0.123 0.124 0.125 0.126 0.127 0.128 0.129 0.130 0.131 0.132 0.133

0.35 0.36 0.37 0.38 0.39 0.40 0.41 0.42 0.43 0.44 0.45 0.46 0.47 0.48 0.49 0.50 0.51 0.134 0.135 0.136 0.137 0.138 0.139 0.140 0.141 0.142 0.143 0.144 0.145 0.146 0.1470.52 0.53 0.54 0.55 0.56 0.57 0.58 0.59 0.60 0.61 0.62

2.1 3.1 4.1 5.1 6.11.1.1 1.1.2 1.1.3 1.1.4 2.1.1 2.1.2 2.1.3 2.1.4 2.1.5 3.1.1 3.1.2 3.1.3 3.1.4 3.1.5 4.1.1 4.1.2 4.1.3 4.1.4 4.1.5 5.1.1 5.1.2 5.1.3 5.1.4 5.1.5 6.1.1 6.1.2 6.1.3 6.1.4 6.1.5

1.1.5 2.1.6 2.1.7 2.1.8 2.1.9 2.1.10 3.1.6 3.1.7 3.1.8 3.1.9 3.1.10 4.1.6 4.1.7 4.1.8 4.1.9 4.1.10 5.1.6 5.1.7 5.1.8 5.1.9 5.1.10 6.1.6 6.1.7 6.1.8 6.1.9

2.1.11 2.1.12 3.1.11 3.1.12 3.1.13 4.1.11 4.1.12 5.1.11 5.1.12

2.2 3.2 4.2 5.2 6.21.2.1 1.2.2 1.2.3 1.2.4 2.2.1 2.2.2 2.2.3 2.2.4 2.2.5 3.2.1 3.2.2 3.2.3 3.2.4 3.2.5 4.2.1 4.2.2 4.2.3 4.2.4 4.2.5 5.2.1 5.2.2 5.2.3 5.2.4 5.2.5 6.2.1 6.2.2 6.2.3 6.2.4 6.2.5

1.2.5 2.2.6 2.2.7 2.2.8 2.2.9 2.2.10 3.2.6 3.2.7 4.2.6 4.2.7 4.2.8 4.2.9 4.2.10 5.2.6 5.2.7 5.2.8 5.2.9 5.2.10 6.2.6 6.2.7 6.2.8 6.2.9 6.2.10

2.2.11 2.2.12 2.2.13 2.2.14 2.2.15 4.2.11 4.2.12 4.2.13 4.2.14 4.2.15 5.2.11 5.2.12 5.2.13 5.2.14 5.2.15 6.2.11 6.2.12 6.2.13 6.2.14

2.3 3.3 4.3 6.31.3.1 1.3.2 1.3.3 2.3.1 2.3.2 2.3.3 2.3.4 2.3.5 3.3.1 3.3.2 3.3.3 3.3.4 3.3.5 4.3.1 4.3.2 4.3.3 4.3.4 4.3.5 6.3.1 6.3.2 6.3.3 6.3.4 6.3.5

2.3.6 2.3.7 2.3.8 2.3.9 2.3.10 3.3.6 3.3.7 3.3.8 3.3.9 3.3.10 4.3.6 4.3.7 4.3.8 4.3.9 4.3.10

2.3.11 3.3.11 3.3.12 3.3.13 4.3.11 4.3.12 4.3.13

2.4 3.4 4.4 6.42.4.1 2.4.2 2.4.3 2.4.4 2.4.5 3.4.1 3.4.2 3.4.3 3.4.4 3.4.5 4.4.1 4.4.2 4.4.3 4.4.4 4.4.5 6.4.1 6.4.2 6.4.3 6.4.4

2.4.6 2.4.7 2.4.8 2.4.9 2.4.10 3.4.6 3.4.7 3.4.8 3.4.9 3.4.10 4.4.6 4.4.7 4.4.8 4.4.9

2.4.11 2.4.12 2.4.13 2.4.14 2.4.15 3.4.11 3.4.12 3.4.13 3.4.14 3.4.15

2.5 3.5 60 Days2.5.1 2.5.2 2.5.3 2.5.4 2.5.5 3.5.1 3.5.2 3.5.3 3.5.4 3.5.5

2.5.6 2.5.7 2.5.8 2.5.9 2.5.10 3.5.6 3.5.7 3.5.8 3.5.9 Monitor OK 1.1.1

2.5.11 Monitor not OK 1.1.1

Milestone complete 1.1.1

2.6 3.6 Milestone overdue 1.1.1

2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 3.6.1 3.6.2 3.6.3 3.6.4 3.6.5 Milestone due soon 1.1.1

2.6.6 2.6.7 2.6.8 2.6.9 2.6.10 3.6.6 3.6.7 3.6.8 3.6.9 3.6.10 Milestone not due soon 1.1.1

2.6.11 2.6.12 2.6.13 Item not Active 1.1.1

Workload

6

1.2

Development

Dissemination

Project Execution

BaBarMetadata

Storage

GridPP2 Goal: To develop and deploy a large scale production quality grid in the UK for the use of the Particle Physics community

2 3

Knowledge Transfer

LHCb

GANGA

ATLAS

InteroperabilitySamGrid

Engagement

Production Grid Milestones Production Grid Metrics

1LCG External

4M/S/N

5Non-LHC Apps Management

Navigate downExternal link

PhenoGrid

LHC Apps

1.1

1.3

Security

InfoMon

Design

Service Challenges

Other Link Network LHC Deployment

Project Planning

CMS

Portal

Status Date - 31/Dec/05 + next

UKQCD

Update

Clear

Know your users..

1. GridPP TO PROVIDE DATA ON WHAT FRACTION OF THE REGISTERED USERS WERE MAKING THE GREATEST USAGE OF THE RESOURCES.

Active Users (All VOs)

Job success? Overview

Job Success by LHC experiment

ALICE

CMS

ATLAS

LHCb

Active Users by LHC experiment

ALICE (8)

CMS (150)

ATLAS (70)

LHCb (40)

Fine-grained: active users at RAL

Number of registered users (exc. DTEAM)

Quarter: 05Q4 06Q2 Value: 1342 1831Number of active users (> 10 jobs)Quarter: 05Q4 06Q1 06Q2Value: 83 166 201Fraction [%]: 6.2 11.0Number of active UK users at RALQuarter: 05Q1 05Q2 05Q3 05Q4 06Q1 06Q2Value: 10 19 29 37 44 55

Number of jobs/UK Grid user on RAL resources (06Q2)

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

1 6 11 16 21 26 31 36 41 46 51

Worldwide “Data Protection Act”: non-UK sites requested APEL NOT to include this data by default (hence not switched

on at most UK sites).

Complied in order to ensure APEL is widely deployed.

Where are we now?• Since the last oversight committee meeting a lot has happened.. 1. Progress has been made in the release of gLite-3.0

(first middleware fully integrating all EGEE and LCG components) 2. gLite-3.0 efficiently deployed at 11 UK sites3. Tier-2 resources on the Production Grid beginning to be fully utilised 4. Many measured performance improvements (see Jeremy’s talk) 5. The GridPP2 Project is halfway through:

49% of its targets met, 91% of the metrics within specification5000 ex ~10000 computers on the Grid

6. EGEE phase I reviewed – commended by the EU 7. Dissemination: lead news on BBC technology web site, GridPP

overview for MPs circulated. 8. In March 2006 PPARC signed the worldwide LCG MoU 9. Significant planning performed for GridPP3 (see Dave’s talk)10.Work starting on large-scale experiment-specific file transfers and

improving site performance..