38
© 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12 th , 2004

Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

  • Upload
    others

  • View
    11

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

© 2004 IBM Corporation

IBM Linux Technology Center

Linux HPC Roadmap

Ken RozendalAugust 12th, 2004

Page 2: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Special NoticesThis presentation was produced in the United States. IBM may not offer the products, programs, services or features discussed herein in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the products, programs, services, and features available in your area. Any reference to an IBM product, program, service or feature is not intended to state or imply that only IBM's product, program, service or feature may be used. Any functionally equivalent product, program, service or feature that does not infringe on any of IBM's intellectual property rights may be used instead of the IBM product, program, service or feature.Information in this presentation concerning non-IBM products was obtained from the suppliers of these products, published announcement material or other publicly available sources. Sources for non-IBM list prices and performance numbers are taken from publicly available information including D.H. Brown, vendor announcements, vendor www Home Pages, SPEC Home Page, GPC (Graphics Processing Council) Home Page and TPC (Transaction Processing Performance Council) Home Page. IBM has not tested these products and cannotconfirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.BM may have patents or pending patent applications covering subject matter in this presentation. The furnishing of this presentation does not give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY 10504-1785 USA. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Contact your local IBM office or IBM authorized reseller for the full text of a specific Statement of General Direction.The information contained in this presentation has not been submitted to any formal IBM test and is distributed "AS IS". While each item may have been reviewed by IBM for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. The use of this information or the implementation of any techniques described herein is a customer responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. Customers attempting to adapt these techniques to their own environments do so at their own risk.IBM is not responsible for printing errors in this presentation that result in pricing or information inaccuracies.The information contained in this presentation represents the current views of IBM on the issues discussed as of the date of publication. IBM cannot guarantee the accuracy of any information presented after the date of publication.All prices shown are IBM's suggested list prices; dealer prices may vary.IBM products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.Information about non-IBM products was obtained from suppliers of those products. IBM makes no representations or warranties regarding these products. Non-IBM products are offered and warranted by third-parties, not IBM.

Page 3: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Special NoticesInformation provided in this presentation and information contained on IBM's past and present Year 2000 Internet Web site pages regarding products and services offered by IBM and its subsidiaries are "Year 2000 Readiness Disclosures" under the Year 2000 Information and Readiness Disclosure Act of 1998, a U.S. statute enacted on October 19, 1998. ternet Web site pages have been and will continue to be our primary mechanism for communicating year 2000 information. Please see the "legal" icon on IBM's Year 2000 Web site (www.ibm.com/year2000) for further information regarding this statute and its applicability to IBM.Any performance data contained in this presentation was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements quoted in this presentation may have been made on development-level systems. There is no guarantee these measurements will be the same on generally-available systems. Some measurements quoted in this presentation may have been estimated through extrapolation. Actual results may vary. Users of this presentation should verify the applicable data for their specific environment.The following terms are registered trademarks of International Business Machines Corporation in the United States and/or other countries: AIX, AIXwindows, AS/400, C Set++, CICS, CICS/6000, DataHub, DataJoiner, DB2, DEEP BLUE, DYNIX, DYNIX/ptx, e(logo), ESCON, IBM, IBM(logo), Information Warehouse, Intellistation, IQ-Link, LANStreamer, LoadLeveler, Magstar, MediaStreamer, Micro Channel, MQSeries, Net.Data, Netfinity, NUMA-Q, OS/2, OS/390, OS/400, Parallel Sysplex, PartnerLink, PartnerWorld, POWERparallel, PowerPC, PowerPC(logo), ptx/ADMIN, RISC System/6000, RS/6000, S/390, Scalable POWERparallel Systems, SecureWay, Sequent, SP2, System/390, The Engines of e-business, ThinkPad, Tivoli(logo), TURBOWAYS, VisualAge, WebSphere. The following terms are trademarks of International Business Machines Corporation in the United States and/or other countries: AIX/L, AIX/L(logo), AIX PVMe, Application Region Manager, AS/400e, Blue Gene, Chipkill, ClusterProven, DB2 OLAP Server, DB2 Universal Database, e-business (logo), ^, GigaProcessor, HACMP/6000, Intelligent Miner, iSeries, Network Station, NUMACenter, PowerPC Architecture, PowerPC 604, POWER2 Architecture, pSeries, Sequent (logo), SequentLINK, Service Director, Shark, SmoothStart, SP, Tivoli Enterprise, TME 10, Videocharger, Visualization Data Explorer, xSeries, zSeries. A full list of U.S. trademarks owned by IBM may be found at http://iplswww.nas.ibm.com/wpts/trademarks/trademar.htm. Lotus and Lotus Notes are registered trademarks and Domino and Notes are trademarks of Lotus Development Corporation in the United States and/or other countries. NetView, Tivoli and TME are registered trademarks and TME Enterprise is a trademark of Tivoli Systems, Inc. in the United States and/or other countries.Microsoft, Windows, Windows NT and the Windows logo are registered trademarks of Microsoft Corporation in the United States and/or other countries. UNIX is a registered trademark in the United States and other countries licensed exclusively through The Open Group. LINUX is a registered trademark of Linus Torvalds.Intel and Pentium are registered trademarks and MMX, Itanium, Pentium II Xeon and Pentium III Xeon are trademarks of Intel Corporation in the United States and/or other countries. Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States and/or other countries. Other company, product and service names may be trademarks or service marks of others.

Page 4: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

AgendaHPC Cluster RoadmapIBM Linux StrategyLTC Focus AreasLinux on POWER

Motivation

High Level Objectives

Detailed PlanLTC Detailed Focus Areas

Page 5: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

© 2004 IBM Corporation

IBM Linux Technology Center

HPC Cluster Roadmap

Page 6: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

High Performance ComputingA very important segment for IBM

Goal: • Continue to develop complete, balanced, well integrated solutions• Continue to deliver highest uptime in industry, supporting on-demand• Continue to develop a comprehensive software environment to enable programmers to get maximum

delivered TF on actual user problems

Continue to invest in leading edge HPC technologiesHardware

• Processors (Power4+, Power 5, Power 5+, …)– Also support IA-32 and Opteron based clusters

• CECs (Regatta, Squadrons, …)• Interconnects (eg. Infiniband)

Software• Linux operating System• Cluster File Systems & Parallel File System (GPFS)• Programming Models (MPI, LAPI) & Runtime environments (POE)• Resource Management & Scheduling (LL)• Application development tools (PE, ESSL, PESSL)• Systems Management (CSM)

Page 7: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

updates to most componentssupport for RHEL AS 4

updates to most componentssupport for RHEL AS 4

updates to most componentssupport for RHEL AS 4

updates to most componentssupport for RHEL AS 4

2Q05

updates to most componentssupport for SLES 9

SQ ML8, ML12, ML16 (9/04)CSM 1.4RHEL AS 3

p650CSM 1.3.3SLES 8, RHEL AS 3LoadLeveler 3.2 (SLES only) ESSL 4.1.1/PESSL 3.1.1 MyrinetGPFS 2.2 GigE (SLES only)

Midrange(Myrinet,Ind. Std.)

updates to most componentssupport for SLES 9

Squadrons L4, SF2, SF4 (9/04)CSM 1.4RHEL AS 3

p615, p630CSM 1.3.3SLES 8, RHEL AS 3LoadLeveler 3.2 (SLES only) ESSL 4.1.1/PESSL 3.1.1 MyrinetGPFS 2.2 GigE (SLES only)

Entry(Myrinet, Ind. Std.)

updates to most componentssupport for SLES 9

p655++CSM 1.4SLES 8, RHEL AS 3LoadLeveler 3.2 (SLES only)ESSL 4.1.1/ PESSL 3.1.1

MyrinetGPFS 2.2 GigE (SLES only)

p655++SLES 8, RHEL AS 3CSM 1.3.3LoadLeveler 3.2 (SLES only)ESSL 4.1.1/PESSL 3.1.1 MyrinetGPFS 2.2 GigE (SLES only)

High End(Myrinet,Ind. Std.)

JS20 Blade, JS20+ Blade (11/04)SLES 8CSM 1.4 (+RHEL AS 3 9/04)ESSL 4.1.1/PESSL 3.1.1 MyrinetLoadLeveler 3.2 GPFS 2.2 GigE

8/04

updates to most componentssupport for SLES 9

JS20 Blade (7/04)SLES 8CSM 1.3.3LoadLeveler 3.2ESSL 4.1.1/PESSL 3.1.1 MyrinetGPFS 2.2 GigE

High Volume(Myrinet, Ind. Std.)

YE20045/04pSeries Linux Cluster Software Roadmap

Page 8: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

updates to most componentssupport for RHEL AS 4

updates to most componentssupport for RHEL AS 4

2Q05

updates to most componentssupport for SLES 9

HS40 SLES 8, RHEL 3CSM 1.4LoadLeveler 3.2 (RHEL only)GPFS 2.2

SLES 8, RHEL 3CSM 1.3.3LoadLeveler 3.2 (RHEL

only)GPFS 2.2

IA32 xSeries(including

BladeCenter)(Myrinet/Ind. Std.)

SLES 8, RHEL 3CSM 1.4GPFS 2.2 – SLES only

8/04

updates to most componentssupport for SLES 9

SLES 8, RHEL 3CSM 1.3.3

OpteronxSeries

(Myrinet/Ind. Std.)

YE20045/04

xSeries Linux Cluster Software Roadmap

Page 9: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

© 2004 IBM Corporation

IBM Linux Technology Center

IBM’s Linux Strategy

Page 10: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

IBM’s Linux Strategy• Enabling Linux hardware, software and services

• Partnering with established Linux Vendors

• Participating in the Linux open source development community

• Promoting adoption of open standards

Serv

ices

/Sup

port

Ope

n So

urce

&O

pen

Stan

dard

s

Software

Linux Distribution Partners

Hardware

Serv

ices

/Sup

port

Ope

n So

urce

&O

pen

Stan

dard

s

Software

Linux Distribution Partners

Hardware

Page 11: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Software GroupJavaDevelopment Kit

VisualAgefor Java

WebSphereHost On- Demand

WebSphereHomepage Builder

WebSphereSite Analyzer

Performance PackCache Manager forMultiplatform

WebSphereMQ

LotusDomino

WebSphereApplication Server

WebSphereCommerce Suite

DB2 UniversalDataBase (UDB)

TivoliManagement Software

SecureWayWireless Software

NetworkDispatcher

Eclipse

software

Page 12: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

IBM Global Services

MiddlewareEnablement

DB2WASMQSeriesISV'sQuickStarts

Technical SupportSupport Line - 24/7Account advocateAdvanced SupportAll ^ including clustersSupport for major Linux distributionsPresales technical support teams

ConsultingOpen Source SW ConsultingApplication MigrationConsult Line service optionse-business Enablement

Workload ConsolidationFile/Print, WebservingBynari, SendmailLinux Solution for e-BusinessApplication PortingSolaris to Linux Migration

ClustersSupport Linex1300 InstallationsOEM ProcurementHardware SetupSoftware Installation

Web HostingxSerieszSeries Linuxe-Sourcing

Training / Learning Services5 languages; 20 countriesall ^Web-based and classroomCluster workshops - New!RedbooksLPI Certification

Page 13: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

© 2004 IBM Corporation

IBM Linux Technology Center

Linux Technology CenterFocus Areas

Page 14: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

^xSeries pSeriesiSeries zSeries

BladeCenter Clusters

Customers

Note: Red denotes scope ofLTC mission

Storage Software

Services PCDRSS

Linux OSS Community- Core Components- Key Features

Requirement,Defects,

Features

Development of xLinux, PowerLinux,eServer SW Features

Linux Technology Center• Mission

“Make Linux Better” + “Advantage IBM Products” +“Extend Linux Reach”- Accelerate the growth of Linux as an enterpriseoperating system

- Work as a trusted, valued member or the LinuxCommunity

- Drive development efficiencies and time tomarket for IBM

• www.ibm.com/linux/ltc & ltc.linux.ibm.com

Linux Technology Center• Mission

“Make Linux Better” + “Advantage IBM Products” +“Extend Linux Reach”- Accelerate the growth of Linux as an enterpriseoperating system

- Work as a trusted, valued member or the LinuxCommunity

- Drive development efficiencies and time tomarket for IBM

• www.ibm.com/linux/ltc & ltc.linux.ibm.com

Linu

x D

istr

ibut

ion

Part

ners

Linu

xSo

lutio

ns

ALRT

Page 15: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC Community Participation600+ engineers directly contributing to open source components/projectsThe LTC is a key participant in community organizations:

Open Source Development Lab (OSDL) corporate sponsor.– OSDL provides hardware access and expertise to community open source projects.

Free Standards Group (FSG) driving Linux standardsLTC provides support to other community groups / conferences:

OSDN (Open Source Developer Network) Linux Kernel SummitLinux World ExpoO'Reilly open source conferenceUSENIXGNOMEKDEFree Software FoundationLinux International

Page 16: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC Focus Areas

ScalabilityNetworkingSecurityStorage I/ONetworking I/OVolume ManagementJFSServiceabilityFile/PrintGlobalizationNUMA

DirectoryHPC Clusters & HASystems ManagementStandardsTestPerformanceLevel 3 SupportAccessibilityDocumentationCompilersLibrariesVirtualization

Page 17: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Key Enhancements in 2.6 Kernel

Scalability8 to 32-way SMP per-CPU schedulerper-CPU timers, counters, statistics Improved resource locking

VMM EnhancementsSupport for 32 GB of memory on IA-32Large page supportRMAP - reverse physical to virtual address mappingLarge page in-memory filesystem support

Efficient support for large number of processes/threads (POSIX compatible)NUMA performance

NUMA-aware memory placementNUMA-aware schedulerNUMA API

I/O EnhancementsLarge Block Raw I/OAsynchronous I/OVectored block/raw I/O

Hot Plug CPU, I/ORead-Copy-Update locking technology

IP route cache + RCUIPC locking using RCUdcache locking using RCU

FutexesLogical Volume Management:

Device Mapper and EVMSNetworking Protocols: IPv6, IPSec, SCTP

Page 18: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Kernel Work – 2004/2005Dynamic memory add/removeSCSI Multi-Path I/OEnhanced event loggingOnline diagnosticsHardening device driversResource Scalability (# tasks, IPC, I/O Capacity, etc.)Support for > 32,000 I/O spindlesLinux Kernel Locking and Cache AwarenessKernel Exported User Level APIsNUMA Multipath I/OIPv6 and NFSv4 hardening

Page 19: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

© 2004 IBM Corporation

IBM Linux Technology Center

Power Linux Strategyand

Technical Roadmap

Page 20: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

POWER Linux Motivation – Why POWER?Efficient virtual environment:

Dynamic LPAR

Sub-processor partitioning

Virtual I/OExtremely scalable architecture

Very good SMP hardware scalability

Very good I/O bandwidthEffective RAS capabilities

CPU and memory predictive failure

Capacity Upgrade on Demand

Effective platform and I/O error discovery, handling, and reporting

Page 21: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

POWER Linux Motivation – Why Linux?Non-proprietary operating system

No “lock-in” to single OS vendor

Service and support available from multiple sourcesRuns on variety of hardware

Can choose hardware independently of OS

Porting applications is trivial (just recompile)– Just deal with 32-bit/64-bit and endian-ness

Common programming environmentAll tools freely available

Programming interfaces are well established

Page 22: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

High Level ObjectivesSupport all hardware systems

HV, blades, SquadronsSupport broad set of I/O adapters

Initially, fully support a limited set of each type

Later, support a larger set of each typeFully support POWER virtualization capabilitiesProvide best possible price/performance at low endProvide best possible performance at high endFully support POWER RAS capabilitiesProvide full hardware and software serviceability

Page 23: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

System Models SupportedSquadrons SF2 (F81)Squadrons L4 (DUT)Squadrons L4 Multiples (DV1)Squadrons SF4 (F4P)JS20+ GA2

I/O SupportedMantis-XG (FBH)Sundance MM Drawer (F7D) model D11PCI-X U320 RAID w/ Read Cache 7/04 (Zenith)PCI-X Low Cost 2Gb FC Tape Ctlr 8/04 (Flipper-CR)2-Port USB 2.0 Adapter 8/04 (Rose)USB Diskette 9/04 (Jasper)IDE DVD RAM Slimline (Starr)

Firmware/HMC ContenteFW 2.2

KernelLarge Page SupportNUMA VMNUMA schedulerpersistent device naming

Performance benchmarksJS20 GA2 - HPCSF2 - web, SFS, HPCL4 - FS, HPC

LoP Roadmap v0.1 - SUSESLS 9 (8/15/04)

in plan : sized and committed by dev elopment plan candidate : sizing requested, not committed by development concept/ABO : technical concept available, high level sizing, architecture/design

on-going Cornerstones of Roadmap - Book these first, then the restPlatform Convergence Enabler

Legend

8/12/2004

SLES 8 SP3(a) (3/05/04)

System Models Supportedp655++, p690++JS20 GA1

I/O SupportedQlogic Fibre ChannelFibre Channel Boot (Qlogic & Emulex)Broadcom 10/100 Ethernet (bcm)Myrinet on JS20

KernelGR processor enablement

ServiceabilityQlogic Microcode Update & Diag CLIBroadcom Microcode Update & Diag CLIJS20 Firmware Update

SecurityEAL3 Certification

Page 24: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

ServiceabilityCPU GuardPredictive CalloutService AgentI/O ELAEnhanced FlashupdateV6 RPA Event LogsPlatform dumpEEH tolerance and manual recoveryBoot policy

DocumentationSquadrons installation docsHV installation docs

VirtualizationSPLPARDLPAR (CPU & I/O)Dynamic CUoD ProcessorsCPU HotplugI/O HotplugVirtual SCSI ClientVirtual EthernetVirtual Console ClientVirtual SCSI ServerVirtual Console Server

LoP Roadmap v0.1 - SUSE continuedSLS 9 (8/15/04)

SLES 8 SP3(a) (3/05/04)

8/12/2004

Page 25: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Toolchain32-bit/64-bit application VMX enablement (gcc/glibc)GCC optimizations

BCTLoop unrollingPower4 instruction scheduler

GCC bi-arch supportLarge Appl. optimization (binutils)

Symbol table sizeMultiple TOCPosition independent code (PIE)

GLIBC library optimizationsNPTL thread supportThread local storageReduced sync overheadstrings library optimization

FDPR-Pro (binary, POWER 4 only)xlC/xlF VMX auto-vectorization 7/04

LoP Roadmap v0.1 - SUSE continuedSLS 9 (8/15/04)

SLES 8 SP3(a) (3/05/04)

8/12/2004

Page 26: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LoP Roadmap v0.1 - Red HatRHEL 3 QU3 (8/18/04)

in plan : sized and committed by dev elopment plan candidate : sizing requested, not committed by development concept/ABO : technical concept available, high level sizing, architecture/design

on-going Cornerstones of Roadmap - Book these first, then the restPlatform Convergence Enabler

Legend

System Models SupportedSquadrons SF2 (F81)Squadrons L4 (DUT)Squadrons L4 Multiples (DV1)Squadrons SF4 (F4P)JS20+ GA2

I/O SupportedMantis-XG (FBH)Sundance MM Drawer (F7D) model D11PCI-X U320 RAID w/ Read Cache 7/04 (Zenith)Myrinet on JS202-Port USB 2.0 Adapter 8/04 (Rose)USB Diskette 9/04 (Jasper)IDE DVD RAM Slimline (Starr)

Firmware/HMC ContenteFW 2.2

KernelGR processor enablement

ServiceabilityV6 RPA Event LogsPlatform dumpService Agent

VirtualizationSPLPARVirtual SCSI ClientVirtual EthernetVirtual Console Client

DocumentationSquadrons installation docsHV installation docs

RHEL 3 QU2 (5/10/04)

System Models SupportedJS20 GA1

I/O SupportedQlogic Fibre ChannelFibre Channel Boot (Qlogic)Broadcom 10/100 Ethernet (tg3)

ServiceabilityQlogic Microcode Update & Diag CLIBroadcom Microcode Update & Diag CLIJS20 Firmware UpdatePlatform ELAlsvpd/lscfgInventory ScoutService RMEPOW WarningsScan DumpRemote SupportSUE Recovery

8/12/2004

Page 27: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Linux on POWER Proposed Distributor Roadmap

1Q04 2Q04 3Q04 4Q04

Red Hat

SuSE

RHEL 3Update 38/04

RHEL 3Update 38/04

Power 5systems

JS20 GA2Power 5 systems

RHEL 3Update 25/04

JS20 GA1

Bug fixes

SLES 98/04

Power 5systems &JS20 GA2(2.6 kernel)

Note: 2004 GAdates are onlytargets as they have not yet been interlocked with the Linux Distributers. these GAs also may not exactly line up with the actual HW GA dates.

HW GADates

JS20 GA16/04

JS20 GA2 7/04Sq SF, L4, MLx

SLES 8 SP 3a3/04

JS20 GA1

Page 28: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

POWER Strategic Tooling Scope

Migration Tools,LCPC,LSB,

Arch Specs, Documentation

gcc(LTC)

FDPR(Research –

Haifa)

Integrated Performance

Center

(Performance Tuning/Analysis

Tools)

Pre-compile Build Time Post-compile Deployment

xlc(Toronto)

Toolkit for Linux on POWEREnterprise quality, supported toolset spanning all areas

gdbtbd

gdb

2004 work

2004 work covered outside LTC

Integration into eclipse.org

Com

pat

ibili

ty

Page 29: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

2004 Toolchain work items

Bring FDPR to POWER linux based environment, enhance global code reordering, aggressive function in lining followed by appropriate register allocation for eliminating spills and redundant code and by code reordering, static data reordering, other optimizationsFDPR-Pro

Tool similar to Intel’s VTune and Apple’s CHUD.. Based on eclipse tool environment. Provide perf analysis and tuning perspective to Eclipse, HW analysis, SW app analysis, integrate other existing auxilliary toolsIntegrated Performance Center

The Altivec/VMX ABI for POWER is somewhat baroque and the current GCC functionality fails on some corner cases due to limitations in GCC's infrastructure for passing arguments to functions

Gcc - Address corner case failures for Altivec/VMS

Optimize loops to pipeline through floating point unit with register alloc constraints.Gcc - Software pipelining

Utilize Altivec/VMX and advantage over MMX/SSE (requires early loop opt pass in Tree-SSA)Gcc - Autovectorization

Ensure heuristics thresholds optimal for POWER (most developers have x86 or work performed under contract for various chip manufacturers). Gcc - Compiler optimization heuristics

Stepanov benchmark shows perfect scaling for x86 but penalty for POWER. Gcc - C++ abstraction penalty

SuSE rewrote GCC loop optimization with x86 requirements (for AMD) causing POWER branch on count reg optimization regression.

Gcc - Loop optimization use of PPC CTR branch on count reg

Improve register allocator use of large PowerPC register set relative to few IA-32 registers. Gcc - Register alloc

Current scheduler designed for in-order execution, not GP-type cores Gcc - Scheduler mods

DescriptionLine Item

Page 30: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

2004 Toolchain work items (cont’d)Analyze existing math, memset, dyn mem alloc functions and replace them where needed with code tuned to platformLibm and compiler builtins optimization

License C++ ABI test suite.C++ ABI test suite

Tech writer to provide doc support to improve gcc internals manual , doc on building cross compilers, docs/spec on ppc arch, etcDocumentation

Regression testing, compatibility testing between gcc / xlc

New test case development

Inclusion of some xlc test cases into gcc source base to detect regressionsTest

Setting baseline between x86 and ppc64, setting performance target using internal and gcc community benchmarks to measure progress towards goal

Performance Baselining and Measurement

Definition of vendor-specific Fortran ABIGNU Fortran compiler

DescriptionLine Item

Page 31: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

© 2004 IBM Corporation

IBM Linux Technology Center

Linux Technology CenterDetailed Focus Areas

Page 32: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC's Overall Enterprise Focus AreasPOSIX Threading I/O & Storage improvementsSCSI, RAID, Fibre Channel driver hardeningmulti-path I/Opersistent device naminglarge number of devices

PCI Hot PlugCPU Hot Plugphysical memory add/remove

Kernel ScalabilityPOSIX asynchronous I/ONetwork asynchronous I/OLarge block I/O supportdirect I/O, raw I/Olocking granularity improvementsmulti-queue schedulerNUMA API and process bindingcache line, counter, stat optimizationsread/copy update lock primitive

Page 33: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC's Overall Enterprise Focus Areas (cont’d)

Enterprise Volume Mgmt Systeminteroperability w/ other volume formatsdrive linking, bad block relocation, snapshot (writeable), boot time volume discovery, 64-bit

Journalled File Systemin 2.4 and 2.6 kernels

NetworkingIPv4IPv6MobileIPSCTPTCP/IP Performance

Networking (cont’d)IPSecEtherchannelChannel bondingGB, 10/100 Ethernet driver hardening

Page 34: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC Overall Enterprise Focus Areas (cont.)Serviceability

dynamic probes

POSIX event logging

crash dump facility

kernel debugger

online/concurrent diagnostics

File/Print enhancementsSamba (Kerberos ticket enablement, AD printer publishing)

native CIFS client

Domain Controller (new)

OMNI Printer driver

NFS over TCP

DirectoryOpenLDAP evolution

Internationalization

Performance

Additional protocol support

Page 35: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC Overall Enterprise Focus Areas (cont.)Security

KerberosPKIOpenSSLLoadable Security ModulesXCrypto device supportPKCS-11 API

HPC ClustersOSCARSystem Installation Suite

Systems ManagementCIM infrastructure (WBEM)Pegasus (C++) and SNIA (Java) CIMOMsLinux schema implementation (SBLIM)

High AvailabilityLinux-HAHeartbeat

Page 36: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC Overall Enterprise Focus Areas (cont.)

StandardsLinux Standard BaseLinux Internationalization (Li18nux)IETF

– Networking, IO, Directory, etc.The Open Group

Linux Test Projecttesting each kernel release candidate for maintainertest suite and test harness

Performance Benchmarking/AnalysisTPC-H

TPC-W

VolanoMark

SpecWeb99

Netperf

dbench

lmbench

SPEC SDET

Page 37: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

LTC Enterprise Focus Areas (cont.)

Performance Instrumentation/Toolslockmeter

kernprof

sstat

SGI co-pilot analysis tool

Level 3 Support teamLinux Documentation ProjectAccessibility

InternationalizationUnicodeenablement of xterm, awk, grep, sed, regexp, iconv converters, bash and text utilsLi18nux Specification and Certification Test suite

Graphics Workstation supportDRI, XFree86, Mesa (OpenGL)3D Graphics Adapter enablement

Page 38: Linux HPC Roadmap - ScicomP · 2009-05-22 · © 2004 IBM Corporation IBM Linux Technology Center Linux HPC Roadmap Ken Rozendal August 12th, 2004

IBM Linux Technology Center

© 2004 IBM Corporation

Key Maintainers/Core Members

Free Standards Group (LSB, Li18nux)SambaOpenLDAPIPv6SCTPVarious device driversEVMSJFSSBLIM, Pegasus

LSM, Bastille, xCryptoPCI hot plugUSBAPMOMNI Print PPC32, PPC64Linux-HA, HeartbeatLinux Test Project.....and growing