Production GridsProduction Grids

Fabrizio Gagliardi Fabrizio Gagliardi Director, Technical Computing, Microsoft EMEADirector, Technical Computing, Microsoft EMEA

Computer andComputer andInformation Information SciencesSciences

Life SciencesLife Sciences

MultidisciplinaryMultidisciplinaryResearchResearch

Math andMath andPhysical SciencePhysical Science

Earth Earth SciencesSciences

General OverviewGeneral Overview

Social SciencesSocial Sciences

New Materials,New Materials,TechnologiesTechnologies

and Processesand Processes

Talk OutlineTalk Outline

A few personal remarksA few personal remarks Need for e-Infrastructures and GridsNeed for e-Infrastructures and Grids Background historyBackground history Outlook to the futureOutlook to the future MS contributionMS contribution

A few personal remarksA few personal remarks

GGF1 and EDGGGF1 and EDG EGEE and GGF experienceEGEE and GGF experience Acknowledgements Acknowledgements Move to MSMove to MS

Need for e-InfrastructuresNeed for e-Infrastructures

Science, industry and commerce are more Science, industry and commerce are more and more digital, process vast amounts of and more digital, process vast amounts of data and need massive computing powerdata and need massive computing power

We live in a “flat” world:We live in a “flat” world: Science is more and more an international Science is more and more an international

collaboration and often requires a collaboration and often requires a multidisciplinary approachmultidisciplinary approach

Need to use technology for the good causeNeed to use technology for the good cause Fight Digital/DivideFight Digital/Divide

Industrial uptake has become essentialIndustrial uptake has become essential

Some examples (from EU-EGEE): Earth Some examples (from EU-EGEE): Earth sciences applicationssciences applications

Satellite Observations:Satellite Observations: ozone profilesozone profiles

Solid Earth Physics Solid Earth Physics Fast Determination of mechanisms Fast Determination of mechanisms

of important earthquakesof important earthquakes

Hydrology Hydrology Management of water resources Management of water resources

in Mediterranean area (SWIMED)in Mediterranean area (SWIMED)

GeologyGeology Geocluster: R&D initiative of the Geocluster: R&D initiative of the

Compagnie Générale de GéophysiqueCompagnie Générale de Géophysique

GGF16, Athens, 13 February 2006 6

SEEREN

SEEREN

> http://www.see-grid.org

The SEE-GRID initiative

GGF16, Athens, 13 February 2006 7

SEE-GRID e-Infrastructure

Infrastructure use for regional applications

Visualization of Medical diagnostic images, Earth sciences, Thermodynamics, Fluid dynamics, etc. Already deployed and used in University Children’s Hospital in Belgrade.Search Engine for South-East Europe (SE4SEE)Grid-based Web-crawling and domain-specific Web page filtering service

From the original 21 organizations in from 11 countries to 40 organizations in two years

Drug Discovery: a new hope for Drug Discovery: a new hope for developing countriesdeveloping countries

Grid-enabled drug discovery processGrid-enabled drug discovery process Reduce time required to develop drugsReduce time required to develop drugs Develop the next steps of the process Develop the next steps of the process

(molecular dynamics)(molecular dynamics)

Data challenge proposal for docking Data challenge proposal for docking on malariaon malaria Never done on a large scale Never done on a large scale

production infrastructureproduction infrastructure Never done for a neglected diseaseNever done for a neglected disease

Data challenge during the summerData challenge during the summer 5 different structures of the most 5 different structures of the most

promising targetpromising target Output Data: 16,5 million results, ~10 TBOutput Data: 16,5 million results, ~10 TB

Added valueAdded value Facilitates inclusion of developing countries Facilitates inclusion of developing countries Tool to enhance collaboration buildingTool to enhance collaboration building Facilitate distributed software development Facilitate distributed software development

for complex integrated workflowsfor complex integrated workflows

The underlining infrastructureThe underlining infrastructure

HP HPC Forum Divonne

Enabling Grids for E-sciencE

BioMed Grid

• Infrastructure– ~2.000 CPUs– ~21 TB disks– in 12 countries

• >50 users in 7 countries working with 12 applications• 18 research labs

• ~80.000 jobs launched since 04/2004

• ~10 CPU years

Month

Num

ber

of jo

bs

The EGEE GridThe EGEE Grid

www.eu-egee.orgwww.eu-egee.org

The EU research networkThe EU research network

9/2/2006 HP HPC Forum Divonne

• Backbone Network and Athens Metropolitan Area Network (MAN) : 2,5 Gbps lambda (Packet over SDH-PoS)

• Crete Regional Network and Major Institute Access: Gigabit Ethernet

• Dark fibre acquired for 2 network spans

• Major dark fibre tender for the whole backbone underway

• HellasGrid Grid infrastructure hosted by major Research & Academic Institutes in Athens (Demokritos, IASA, NDC), Crete (ICS-FORTH), Patra (CTI-CEID), Thessaloniki (AUTH-UoM):

• ~800 CPUs (x86_64, 2 GB RAM, 80GB HDD, 2x Gbit)

• ~30 TB total raw SAN storage capacity in all other HG nodes

• ~60 TB Tape Library• 4 Access Grid nodes

Leased lambda 2,5 Gbps PoS

Athens MAN (2,5 Gbps PoS)

Dark Fibre (not yet lit)

Patra

Larissa

Heraclion

Syros

Athens

Chania

Rethymnon

Xanthi

Thessaloniki

Ioannina

Leased lambda 1,25 Gbps Gigabit Ethernet

HG-06-AUTH

HG-04-IASA

HG-05-NDC

HG-03-CTI-CEID

HG-01-GRNETIsabella @Demokritos

HG-02-ICS-FORTH

GRNET- Hellasgride-Infrastructure

Hellasgrid Grid Node

GRNET e-Infrastructure

9/2/2006 HP HPC Forum Divonne

• Infrastructure and targeted projects funded by HellasGrid 2M Euro project

• Operations, training, policies supported mainly by EC co-funded FP6 project EGEE

• EGEE major catalyst to secure HellasGrid funding

• Major institutes involved as Third Parties in the EGEE project

• EuGridPMA accredited Certification Authority

• Applications areas supported by local Ministry: Physics, Biomedical, Chemistry, other

• Major call for applications integration under way ~ 0,5M Euro (might be upgraded to > 1M because of great interest shown)

HellasGrid Production Infrastructure

Current situation: Current situation: accomplishments and challengesaccomplishments and challenges

Many Grids around the world, very few Many Grids around the world, very few maintained as a persistent infrastructuremaintained as a persistent infrastructure

Need for public and open Grids (OSG, EGEE Need for public and open Grids (OSG, EGEE and related projects, NAREGI, and and related projects, NAREGI, and TERAGRID, DEISA good prototypes)TERAGRID, DEISA good prototypes)

Persistence, support, sustainability, long Persistence, support, sustainability, long term funding, easy access are the major term funding, easy access are the major challengeschallenges

Key ChallengesKey Challenges

Security (see Blair Dillaway’s talk)Security (see Blair Dillaway’s talk)

Stable accepted industrial standards (GGF and Stable accepted industrial standards (GGF and EGA converging)EGA converging)

Learning curve for applicationsLearning curve for applications

Complexity of running a Grid infrastructure across Complexity of running a Grid infrastructure across different administrative domainsdifferent administrative domains

How did we get here?How did we get here? Meta-computing and distributed computing Meta-computing and distributed computing

early examples in the 80’ and 90’ (CASA, I-early examples in the 80’ and 90’ (CASA, I-Way, Unicore, Condor etc.)Way, Unicore, Condor etc.)

EU FP5 and US Trillium and national GridsEU FP5 and US Trillium and national Grids

EU FP6, US OSG, NAREGI/Japan…EU FP6, US OSG, NAREGI/Japan…

UK e-Science programme and similar other UK e-Science programme and similar other national programmesnational programmes

EU Information Day 25 03 2003 EDG status 18

An ecosystem of prototype Grid projects in US, EU and A/P in 2003

Related Grid Projects

Where are we going?Where are we going?

Top 500 Supercomputer TrendsTop 500 Supercomputer Trends

Industry usage rising

Clusters over 50%

IA is winning

GigE is gaining

Supercomputing Goes PersonalSupercomputing Goes Personal

1991 1998 2005System Cray Y-MP C916 Sun HPC10000 Shuttle @ NewEgg.com

Architecture 16 x Vector4GB, Bus

24 x 333MHz Ultra-SPARCII, 24GB, SBus

4 x 2.2GHz x644GB, GigE

OS UNICOS Solaris 2.5.1 Windows Server 2003 SP1

GFlops ~10 ~10 ~10

Top500 # 1 500 N/A

Price $40,000,000 $1,000,000 (40x drop) < $4,000 (250x drop)

Customers Government Labs Large Enterprises Every Engineer & Scientist

Applications Classified, Climate, Physics Research

Manufacturing, Energy, Finance, Telecom

Bioinformatics, Materials Sciences, Digital Media

The Future: Supercomputing on a ChipThe Future: Supercomputing on a Chip

IBM Cell processor256 Gflops today4 node personal cluster => 1 Tflops32 node personal cluster => Top100

MS Xbox3 custom PowerPCs + ATI graphics processor1 Tflops today$3008 node personal cluster => “Top100” for $2500 (ignoring all that you don’t get for $300)

Intel many-core chips“100’s of cores on a chip in 2015” (Justin Rattner, Intel)“4 cores”/Tflop => 25 Tflops/chip

The Continuing Trend Towards Decentralized, Networked ResourcesThe Continuing Trend Towards Decentralized, Networked Resources

Grids of personal &

departmental clusters

Personal workstations &

departmental servers

Minicomputers

Mainframes

MS HPC road mapMS HPC road map

Computer Cluster Solution (CCS) V1:Beowulf-style compute cluster seamlessly integrated into a Windows-based infrastructure, including security infrastructure (Kerberos and Active Directory); user jobs run under the Windows user credentialsISVs support for most common software applicationsJob scheduler accessible via command-line, COM and via a published Web services protocol.  Can be customized via sys admin-defined admission and release filters that run in the scheduler when a job is submitted and when it becomes scheduled as ready-to-run.  In V2 the scheduler will be made even more extensible.Performance will be comparable to LinuxMPICH (incl. MPICH-2) supported  (open-source version from ANL) 

MS HPC road mapMS HPC road map

CCS areas of focus for V2:Extend to forests of clusters and meta-schedulersStorage and parallel I/O issues, as well as possibly simple workflow supportDevelopment of new the tools

ConclusionsConclusions

Production Grids are a reality and here to stayHPC is becoming commodity seamlessly stretching from desktop to back-end resourcesMS HPC products are coming soonMicrosoft is participating in major standardisation bodiesMS is present at this meeting and prime sponsor

Wish everybody a fruitful and positive week in Athens

you can contact me at: fabrig@microsoft.com

Wish everybody a fruitful and positive week in Athens

you can contact me at: fabrig@microsoft.com