InfiniBand and Next Generation Enterprise Networks · InfiniBand and Next Generation Enterprise Networks ... ADVA’s FSP systems provide the best network consolidation ... FSP 3000

InfiniBand and Next Generation Enterprise Networks

Paul Morkel and Brian Savory

ADVA Optical Networking

© 2009 ADVA Optical Networking. All rights reserved. ADVA confidential. 2

Automobile

The pace of technical innovation is accelerating

0 25 50 100 125 150 75 Years

0

50

100 Telephone Electricity

Radio

Television

VCR PC

Cellular

% P

enet

ratio

n

© 2008 IBM Corporation

Adoption of new technologies are taking hold at double or triple previous rates


Financial services Medical imaging Mobile phones

Sources: IBM Global Technology Outlook, 2005; TABB Group, Trading at Light Speed: Analyzing Low Latency Market Data Infrastructure, March 2007; Aite Group, Algorithmic Trading 2006: More Bells and Whistles, November 2006; Infonetics Research, Radio Access Network Equipment and Subscribers report, October 2007; Pyramid Research, October 2007

1MB/2D image

1TB/4D image

5B market messages

~130B market messages

1B mobile subscribers

~4B mobile subscribers

2004 2007 2006 2010 2002 2010 By 2010 . . .

. . . medical images will take up 30% of the world’s

storage

By 2010 . . .

. . . over half of U.S. equities

trading will be algorithmic

By 2010 . . .

. . . 74% of the world’s mobile

subscribers will live in emerging economies


Business innovation is accelerating with advancements in technology



“More than 70% of the world’s Global 1000 organizations will have to modify their data center facilities significantly during the next five years.”

Gartner Group, September 2007



Problem: connectivity performance

Ref.: Ishida, O., NTT, “Toward Terabit LAN/WAN” Panel, iGRID2005

Moore’s Law Doubles every 18m

WDM

TDM

FC Ethernet

InfiniBand

4x 12x 4xDDR

12xQDR

Fiber

lin

k ca

pac

ity

[b/s

]

100M

1G

10G

100G

1T

10T

1980 1985 1990 1995 2000 2005 2010


CPU connectivity – market

0%

10%

20%

30%

40%

50% 2006 2007

 Market penetration of different CPU interconnect technologies


System z10 an IB based system


Coupling Facility

Coupling Facility

Switch/ Director

Switch/ Director ESS DASD

ESS DASD

Mainframe

*Geographically Dispersed Parallel Sysplex™ (IBM qualified)

CF CF

  Highest protection through redundant Mainframe and Storage (ESS)   Server coupling and timers via Coupling Links (ISC-2, ISC-3)   Disk mirroring via METRO (ESCON and FC) or GLOBAL XRC (FICON)

Fiber

Fiber

A

B

GDPS STP up to 100km and more (with RPQ)

175km

PPRC 4 &10 G ISLs to 175km WITH NO MID SPAN HUT!

Mainframe

IBM GDPS® – FC Server Time Protocol (STP)


Coupling Facility

Coupling Facility

Switch/ Director

Switch/ Director ESS DASD

ESS DASD

Mainframe

*Geographically Dispersed Parallel Sysplex™

CF CF

  Highest protection through redundant Mainframe and Storage (ESS)   Server coupling 2.5 or 5G INFINIBAND (IB)   Disk mirroring via METRO (ESCON and FC) or GLOBAL XRC (FICON)

Fiber

Fiber

A

B

0-200 km

PPRC 4 &10 G ISLs to 200km WITH NO MID SPAN HUT! Mainframe

Extended Distance GDPS STP with 2.5 or 5G Infinband

IBM GDPS® – Server Time Protocol (STP) over IB ADVA is the only qualified vender!!!


 Why is it relevant?   Data centers disperse geographically

(GRID computing, visualization, disaster recovery, …)

  Native, low-latency IB-over-Distance transport was still the missing part

 Cluster connectivity via IB-over-WDM   WAN protocol is IB, no conversion needed   No additional latency   Fully transparent transport

IB Switch Fabric

Dark Fiber

IB Server Cluster A

IB-over-DWDM IB Switch Fabric

IB Server Cluster B

~50km

What about Open Systems?


InfiniBand throughput over distance

  What is the solution?   IB range extender – Credit Buffering, low latency, and conversion to 10G optical   WDM – lowest latency, transparency, capacity, reach, fiber relief

  What are the commercial requirements?   Solution must be based on commercial products   Interworking capabilities must be demonstrated

 Throughput drops significantly after several meters

 Only buffer credits (B2B credits) ensure maximum InfiniBand performance over distance

 Buffer credit size directly related to distance

Thro

ughput

Distance

w/o B2B credits

with B2B credits


Demonstrator setup at HLRS

Cell Cluster

DW

DM

0.4...100.4 km G.652 SSMF

IBM Cluster

Site: HLRS Nobelstrasse Site: HLRS Allmandring

DW

DM

Voltaire ISR2012 Grid Director   288 x DDR IBx4 Ports   11.5 Tb/s Backplane   <450 ns latency

ADVA FSP 2000 DWDM   4 x 10Gb/s transponders   <100 ns link latency

Obsidian Longbow Campus   4 x SDR copper to 10G optical   2-port switch architecture   840 ns port-to-port latency   10/40 km reach (Buffer Credits)


DCB LAN DCB SAN

Eth Eth

Server cluster

1

DCB LAN DCB SAN

FSP WDM

Inputs: 10Gb FCoE

IB IB

Eth Eth

IB IB

Server cluster

2

FSP WDM

Inputs: 1 x 2.5 or 5G or 10G IB per card

Inputs (not shown): Legacy ESCON, FICON, FC

The perfect convergence platform – FSP DWDM high performance computing and mainframe coupling


Take away

  ADVA’s FSP systems provide the best network consolidation tool because they are transparent to protocol, provide unlimited bandwidth, and offer investment protection for legacy protocols!


ADVA Optical Networking

 Founded 1994

 > EUR 250 million revenue1)

 Public company (FSE: ADV)

 > 1,000 employees1)

 Diverse global customer base   > 200 carriers   > 10,000 enterprises

 Market leader   #1 Ethernet Access Devices2)   #2 Metro WDM, Europe3)   #4 Metro WDM, global3)

 Stable company, built for long run

Your Optical+Ethernet solutions partner to advance next-generation network convergence

1) 2007 2) Infonetics Research, 2008

3) Dell'Oro Group, Infonetics Research, Ovum RHK and ADVA Optical Networking internal estimates, 2007

“Our mission is to be the global leader of Optical+Ethernet transport solutions that ADVANCE next-generation networks for data, storage, voice and video services.”


ResNet / Campus Apps / K-12

The FSP product family C

ore

M

etr

o

HPC Data Center Ext / DR-BC Wireless

Un

ifie

d n

etw

ork

an

d s

erv

ice m

an

ag

em

en

t

Regional Optical Network (RON) backbone

Campus

Network

Ubiquitous Ethernet

Acc

ess

Wireless Copper Fiber

Cu

sto

mer

Pre

mis

e

Metro transport

Any media

Data center

Storage

FSP 150

Base station

FSP 3000

FSP 3000

(FTTX/DSL/Cable/HFC/WiMAX)

FSP 3000

FSP 3000

FSP 3000

FSP 150

FSP 3000

FSP 3000

FSP management software suite

FSP 3000

Questions?

Paul Morkel - [email protected]

Brian Savory - [email protected]

IMPORTANT NOTICE

The content of this presentation is strictly confidential. ADVA Optical Networking is the exclusive owner or licensee of the content, material, and information in this presentation. Any reproduction, publication or reprint, in whole or in part, is strictly prohibited.

The information in this presentation may not be accurate, complete or up to date, and is provided without warranties or representations of any kind, either express or implied. ADVA Optical Networking shall not be responsible for and disclaims any liability for any loss or damages, including without limitation, direct, indirect, incidental, consequential and special damages, alleged to have been caused by or in connection with using and/or relying on the information contained in this presentation.

Copyright © for the entire content of this presentation: ADVA Optical Networking.

Documents

InfiniBand and Next Generation Enterprise Networks · InfiniBand and Next Generation Enterprise Networks ... ADVA’s FSP systems provide the best network consolidation ... FSP 3000