EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE EGEE JRA1 All Hands Meeting July 10-12, 2006 Pilsen, CZ

EGEE-II INFSO-RI-031688

Enabling Grids for E-sciencE

www.eu-egee.orgwww.glite.org

EGEE JRA1 All Hands Meeting

July 10-12, 2006Pilsen, CZ

http://www.eu-egee.org/

http://www.glite.org/

Claudio Grandi - Condor Week - Milano, 28 June 2006 2



AgendaMonday July 10th 13:30 – 18:00Opening

Development clusters summariesDiscussion on Programme of

Work

Tuesday July 11th 9:00 – 12:00Tech. Session I

AccountingL&B scalabilityCEJSDL

Tuesday July 11th 13:30 – 18:00Tech. Session II

Security

Wednesday July 12th 9:00 – 11:30Tech. Session III

ETICSSoftware processImproving error reporting

11:30-12:00Closing




JRA1 Manpower situationPartner From TA Actual CommentsCERN 3 3 CERN DM group spread over many activities.

CESNET 5 4.3

CCLRC 7 7... – 4! 3 people just resigned and another one will resign shortly. Hiring in progress

DATAMAT 5 4

INFN 23 20.5 Proposed reduction of 2.5 due to higher manpower costs. 10 days ‘glitch’ in June

SWITCH 3 3

UH.HIP 2 2

FOM 2 2

UvA 2 2 Answered to PoW only recently

UiB 1 0.5 Answered to PoW only recently

KTH 1 1 Long term sick leave




Reorganization• Coordination of work comes form different sources

– Was only EMT– Now are: new EMT, JRA1 steering, TCG, LCG-MB?, GDB?, ...

• New collocation of EMT:– Now in SA3, responsible for the release– Joint coordination by SA3, SA1 and JRA1– Wider membership– Meets twice a week (Mondays and Wednesdays)– JRA1 needs to participate more (self-criticism!). – Needs tuning... New software process!!!– John is the EMT “bug manager”

• JRA1 steering group created:– For internal JRA1 coordination– All cluster leaders and deputies– Meets once a week (Wednesday after EMT... do we need to change?)




JRA1 Milestones - done

• MJRA1.1.1: Support plan, definition of common components and tools, strategy for multiple platform support– Due PM1 (end April)– Delivered and approved by PEB but: Need to better plan for the multiple platform support since our

planning was considered inadequate!!!• MJRA1.2: Functional Description of Grid

Components– due PM3 (end June)– Delivered, pending internal review

• Quarterly Report– Due PM3 (end June)– Delivered to the Project Office




JRA1 Milestones - coming• MJRA1.3: Grid Components Reengineering Workplan

– Work plan for reengineered Grid Foundation and Grid Services– Due PM 4 (end July)– Will use the PoW agreed with TCG. Will re-discuss details at the end of

this session!!!• MJRA1.4: Shibboleth interoperability through dedicated SICS

– This includes development and operation of a testbed operated by the SWITCH partner.

– Due PM 6 (end September)– By SWITCH!

• MJRA1.5: Shibboleth interoperability with attribute retrieval through VOMS– This includes development and operation of a testbed operated by the

SWITCH partner.– Due PM 9 (end December)– By SWITCH!




Program of Work• Programme of Work decided together with the TCG... ... but the main activity we have now was never

discussed there: Migration to VDT 1.3.10 as a first step for support to

SL(C)4 and 64-bits architectures• We are now in the “continuous release” process... ... but the code we prepared for the gLite 3.1 release is

still unreleased (had to be on the PPS now according to original planning!)Painful process to back-port to gLite 3.0 the chosen

components• The switch to the new VDT (and GT) version will be a

cornerstone We need to define clearly what may enter into the release

before and what enters only after (including Java 1.5!)




Open issues in gLite 3.0• Improve the performances of WMS / LB system

in particular with the bulk submission Migration to Condor 6.7.19 may help• Support for all LRMSs present on PS in BLAH/gLiteCE • Accounting: DGAS deployment and relations to APEL• Issue with the secure data management

Interface to GFAL and LFC and still support gLiteI/O and Fireman• Migration to SRMv2 still underway• Activities on Job Priorities still confused:

Test WMS components with GLUE 1.2. Other work still to be doneGPBOX still out but we need it in the long term.

Critical: interaction with LCAS/LCMAPS needs more understanding!!!• Support for job pilots (AKA glexec on WNs)• Bug fixing in VOMS / VOMSAdmin – VOMRS interaction

More in John’s talk and in the next days!




Open issues since ever

• Stability and robustness• Need to pay attention to what is in production

– E.g. we have been criticized because the gLite CE was released without an interface to the accounting system

• Service logging – hooks for monitoring• Error reporting• Support for other platforms

– And now also for IPv6!!!

Need a formalization of site’s requirement similar to what has been done in the TCG for the user requirements!!!




Preview testbed• The SA3 integration and certification teams are

focused on providing code for the production infrastructure– Strong control over what is accepted, but slow process for the

certification of the new components and of the improvements• JRA1 requested a testbed where to expose to the users

components that are not yet considered for certification– To get feedback from users and site managers– TCG and PEB acknowledged that this is needed, but no

resources were foreseen for this activity in the EGEE II proposalThe JRA1 partners which have also strong commitments

in SA1 have been requested to provide resources (machines and manpower) for this activity without

compromising their commitment in SA1




Hot topics for the preview t.b.• DGAS in certification soon

Should not need the preview • There is now big interest for

the CREAM CE: Test CREAM alone and

together with the gLiteCE:Unique CE with two interfaces!

• Job Provenance is ready since a long time Apart from the new functionalities can unload the L&B!• Need to test glexec running on the WNs Verify how clients deal with sites with and without it!• Last but not least: G-PBOX! Intense activity in the Job Priorities working group

Hope to test some functionalities already on the PPS but interfacing with LCAS/LCMAPS needs the preview!!!

BLAHCE

ICE

SubmitterJob Status

Handler

CREAMCEMon Condor-C




EGEE’06 conference

Mon 14.00-17.30 Healthgrid 2 DM people requestedEGEE OSG Security Some security peopleNA4/SA1/JRA1 all the others

Tue 11.00-12.30 ETICS early adopters14.00-17.30 GSVG Some security people14.00-15.30 EUChinaGrid: IPv6 At least one per cluster16.00-17.30 EUChinaGrid

interoperationAt least DM, VOMS, CE

EGEE, ETICS, EU-OMIIWed 14.00-17.30 MWSGThu 11.00-18.30 Mini user forumFri 9:00-10.30 JRA1/SA3/SA1

http://egee-technical.web.cern.ch/egee-technical/conferences/EGEE06/index.html

Still draft!A few sessions we need to attend (non exhaustive):

http://egee-technical.web.cern.ch/egee-technical/conferences/EGEE06/index.html




Thanks to the organizers!

• I’d really like to thank the organizers for their effort!– We decided late– We didn’t know if we were coming until one month ago!– We registered even later

• ... and the people who decided to come– With short notice– With a lot of work to be done– Special thanks to the ETICS and SA3 people who joined us!!!

• In future we will try to organize the All Hands meetings well in advance!




Next JRA1 All Hands Meeting

8-10 November 2006Cosener's House (Oxford, UK)

Thanks to the CCLRC group!

Documents

EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE EGEE JRA1 All Hands Meeting July 10-12, 2006 Pilsen, CZ