February 2006 Page 1 of (#)

2006 Sonoma Workshop

General Windows General Windows UpdateUpdate

Gilad Shainer

Mellanox Technologies Inc.

shainer@mellanox.com

February 2006 2006 Sonoma Workshop – MemFree Technology Page 2 of (#)

Goals

• Industry standard IB SW stack– Increases adoption rate– Decreases development costs

• Broad range of upper level protocols• Tight integration into the Windows OS

– Windows Server 2003• x86, x64, and Itanium

– Windows CCS• x64

– Windows XP• x86, x64

– Longhorn

February 2006 2006 Sonoma Workshop – MemFree Technology Page 3 of (#)

Components

• HCA driver• Bus Drivers/Access Layer• IPoIB• SRP Initiator*• Winsock Direct Provider**• SDP• uDAPL• OpenSM• MPI (via Argonne)*Not Available on Windows XP 32 bits** Not availble on Windows XP

February 2006 2006 Sonoma Workshop – MemFree Technology Page 4 of (#)

Windows Stack Overview

February 2006 2006 Sonoma Workshop – MemFree Technology Page 5 of (#)

MPI

• From Argonne National Lab• MPI over native InfiniBand (IBAL)• Pallas benchmark

February 2006 2006 Sonoma Workshop – MemFree Technology Page 6 of (#)

Latest Build

• Beta, 1.0.0.213– Built from SVN revision 213

• Includes:– HCA driver (VAPI-based)– IBAL– IPoIB– WSD– SRP– OpenSM– uDAPL

February 2006 2006 Sonoma Workshop – MemFree Technology Page 7 of (#)

Enhancements in 1.0.0.213

• Main activity– Stabilization and bug fixes of the entire stack

• Low level driver: – Tavor mode only. Based on TVPD (VAPI)– MTHCA-based driver in progress

• Installer – Based on InstallShield

• OpenSM– Latest Linux fixes were ported

• IPoIB– Added Re-registration– ARP

February 2006 2006 Sonoma Workshop – MemFree Technology Page 8 of (#)

Enhancements in 1.0.0.213 – Cont.

• SDP– New ULP– Synchronous operations only.

• WSD– Uncovered Windows WSD provider bugs

• Ported Perf_Main

February 2006 2006 Sonoma Workshop – MemFree Technology Page 9 of (#)

Release 1.0

• Target end of 1Q06

• QA’d components (conservative):– HCA driver (TVPD-based)– IBAL– IPoIB– WSD– OpenSM

February 2006 2006 Sonoma Workshop – MemFree Technology Page 10 of (#)

Enhancements for Release 1.0

• Stabilization and bug fixes of the entire stack• General - Better debug abilities

– Add event log support– Add trace support– Added WSD performance counters

• OSM: – Synch with latest Linux version

• Performance tests– Port the latest from Linux

February 2006 2006 Sonoma Workshop – MemFree Technology Page 11 of (#)

Release 1.1

• Target 2Q06• QA’d components:

– HCA driver (MTHCA-based)– IBAL– IPoIB– SDP (w/ asynchronoush support)– SRP– WSD– OpenSM

February 2006 2006 Sonoma Workshop – MemFree Technology Page 12 of (#)

Enhancements For Release 1.1

• Stabilization and bug fixes of the entire stack• Low level driver:

– Port MTHCA from Linux to Windows and IBAL– Add MemFree– Add FMR

• OSM: – OSM as a service

• SDP– Enhanced API to include Asynchronous operations

February 2006 2006 Sonoma Workshop – MemFree Technology Page 13 of (#)

Microsoft Certification

• Microsoft provide digital signature (Microsoft certification) for – Windows Server 2003– Windows CCS– Longhorn

• IPoIB and WSD• WHQL test suite will be ready in 9 months

– Current WHQL does not fit InfiniBand requirements

• Code coverage test will be used meanwhile

February 2006 2006 Sonoma Workshop – MemFree Technology Page 14 of (#)

How To Achieve Microsoft Certification

• Pass Microsoft WHQL testing 9 month from now• For getting 9 month temporary Microsoft

certification– Send drivers to Microsoft– Receive drivers with monitors– Run your local test suite and achieve more then 70%

code coverage– Send the drivers and the log files to Microsoft– Receive sealed certified drivers from Microsoft

• Any code change will need to pass the process again

February 2006 2006 Sonoma Workshop – MemFree Technology Page 15 of (#)

Version 2.0 Tasks

• Kernel-mode async verbs– Allow all operations to be initiated from DISPATCH_LEVEL

• User-mode single threaded app support– Allow application to select completion notification mechanisms

• Overlapped• APC• Synchronous

• Match native API style• Hibernation Support• Boot support

February 2006 2006 Sonoma Workshop – MemFree Technology Page 16 of (#)

Call For Action

• Send your patches and fixes

• Add driver capabilities

• Add new upper layer protocols

February 2006 2006 Sonoma Workshop – MemFree Technology Page 17 of (#)

Resources

• OpenIB WiKi– https://openib.org/tiki/tiki-index.php?page=OpenIB+Windows

• Openib-windows mailing list– http://openib.org/mailman/listinfo/openib-windows

• Sign up to contribute– http://windows.openib.org/openib/contribute.aspx

February 2006 2006 Sonoma Workshop – MemFree Technology Page 18 of (#)

Q & A