Embed Size (px)
Citation preview
www.ethernetalliance.org
HOWTODELPOY25/50/100GETHERNETOPTICSTODAY:2016ETHERNETROADMAPPANEL
BradSmith,DirectorofMarketing,LinkXInterconnects,MellanoxApril13,2016OpenServerSummit
AllInternetTrafficFlowThroughOpticalTransceiversDataCenter
ServerRack
100G32-portSwitch
FromSmartphone/Tablet/Notebook<–>to<–>Server
OpticalTransceiver
OpticalTransceiver
www.ethernetalliance.org
1GBASE-TCAT5isREALLYbiginAsia
IT’SYUGE!
3
www.ethernetalliance.org
NewIndustryMantra
“25Gisthenew10G”
“100Gisthenew40G”
4
WHY?
Themoneytodaymaybein10G/40Goptics…but
5
“25GistheNew10G!”Why?Analystspredict,“25GbEsaleswillrampfasterthananypreviousEthernetspeed”speed
DrivingFactors
• ServerI/O:dataratesareincreasing–new22-24core,PCIeGen3/4CPUscaneasilydrive80Gb/s.
• FLASHstorage:3NVMeSSDscandrive95Gb/sI/O.
• 4Kvideo:uncompressedrequires26Gb/sI/O.
• East-WestTraffic:ModerndatacentertransitionedtoEast-Westarchitecturesrequiringveryhighbandwidths.
6
“25GistheNew10G!”Why?Analystspredict,“25GbEsaleswillrampfasterthananypreviousEthernetspeed”speed
KeyBenefits:2.5xperformanceat:• Smallpricepremiumabove10G
• Nearlysamepowerconsumptionas10G
• KeepingsameSFP&QSFPinfrastructureforSwitches,Adapters,Cables,TransceiversandConnectors• Minimizingimpactsonsystemupgrades,inventorySku’s,maintenance,training,etc.
• 25GLineratesupportfutureproducts(nx25G,PAM4)
www.ethernetalliance.org
BOMCostsareAlmosttheSame;
7
40G(4x10G)SR4,AOC,CWDM4,LR4
100G(4x25G)SR4,AOC,CWDM4,LR4
4-lasersLaserDriver
4DetectorsDetectorAmplifier
PCBPowercontrollerMicrocontrollerQFPshell
MPOopticalconnector8-Multi-modefibers
www.ethernetalliance.org
Switches&NetworkCards–AlmostthesameBOMcosts
8
8xPCIe 16xPCIe
40GbEQSFP28Adapter 100GbEQSFP28Adapter
32-port40GSwitch 32-port100GSwitch
www.ethernetalliance.org
2.5XSpeed/BandwidthwithMinimalInfrastructureImpact&Cost
9
10G/40G 25G/50G/100G
OpticalFibers
DAC&AOCsCablesOpticalTransceivers
Switches&NICs
OpticalFibers
DAC&AOCsCablesOpticalTransceivers
Switches&NICs
www.ethernetalliance.org
MostCommonInterconnectsSchemesInModernDataCentersToday
10
www.ethernetalliance.org
DataCenters=SFP/QSFPFormFactors(andsomeCXP)
11
www.ethernetalliance.org
CommonDatacenterInterconnects101:“ThePlugs””
12
QSFP284-Channels8FibersorwiresQuadSmallFormFactorPluggable3.5W(5Wfuture)MPO8-fiberparallelOpticalconnector
SFP281-Channel2FibersorwiresSmallFormFactorPluggable1-1.5WDuplexLCopticalConnector
8-fiberParallel2-fiberSerial
2-fiberSerial
“Transceiver”4-channelsTransmit4-channelsReceiver
OpticalTransceiver
Convertselectricalsignalstooptical.Transmitsblinkinglaserlightoveropticalfiber.
Keyfeature=longreach-upto10Km.
CAT5e,6,6A,7
UnshieldedTwistedPairCopper
www.ethernetalliance.org
DatacenterInterconnects101:
13
CablesDAC AOC
Multi-modeVCSELLaserGaAs
Single-modeFP,DFBorExtModulatedLaserInP,PLCs,SiliconPhotonics
Transceivers
3m <30m <100m 2Km,10Km
CopperCables OpticalCables
OpticalLinkLength(m)10 100 500150 300 1000 2000
10
25
50
3 51
20
DataRatepe
rLane(Gb\s)
10000500020 30 50 752
SinglemodefiberUseBetweenSwitches
>100m-2KmOM4OM3
CopperDACUseInsideRacks
1-5m
Multi-modefiberUseBetweenSwitches
5m-100m
InP,SiliconPhotonics
DirectAttachCopper• Zeropower• Bestfit3m
VCSELsDACs
ActiveOpticalCables• VCSEL100m• Bestfitfor3-20m
SR4VCSELTransceivers• Reachesto100m(300m)• BestfitforMMF• Structuredcabling
InP&SiliconPhotonicsTransceivers• Reachesto2km/10Km• BestfitforSMF• ParallelPSM4orserialCDM4/
LR4
25GZONE
5M 100M
MMF=MULTI-MODEFIBERSMF=SINGLE-MODEFIBER
DifferentTechnologiesforDifferentReaches/CostPoints
300M
www.ethernetalliance.org
How25G/50G/100GInterconnectsareDeployedin
DataCenters
15
DifferentSizedDataCenters
Multi-mode&DACTerritoryReachesTypically<100m
Single-Mode&DACTerritoryReachesFrom1-10Km
HyperscaleDataCentersTypicalDataCenters
17
▪ DirectAttachCopper(DACs)(aka:PassiveCopperCablesorTwinax)▪ ConnectivityfromTop-Of-Rack(TOR)switchesto
Servers,Disk/FLASHstorage,&NetworkAppliances
DACValueProposition▪ LowestPricedInterconnectSolution▪ Zeropowerconsumption
▪ Lowestlatency
▪ Extensive10/40G&25/50/100Gproductsavailable:
• 0.5mto3m(Ethernet),5m(InfiniBand)
• 100GQSFP28-to-Dual50GQSFP28• 100GQSFP28-to-Quad25GSFP28• 25GSFP28-to-25GSFP28
QUAD25GSFP28
100GQSFP28
100GQSFP28
100GQSFP28
100GQSFP28
25GQSFP28
Dual50G
QSFP28
25GQSFP28
TypicalServer/StorageApplications
Top-Of-RackSwitch
ServerAdapters
TypicalServerRack
40-54+servers
18
TypicalAOCApplications-LinkingRackstoSwitches
32-Port100GTop-Of-Rack
Switch
ServerwithAdaptercard
LEAFMiddleorEnd-of-RowAggregationSwitch
HDDArrays
SSDArrays
NVMeFLASHArrays
ServerAdapter
Upto100m/200m
Multi-modeAOC
Single-modeAOC
SFP28QSFP28
SFP28
Dual100G
Dual25G
Single100G
www.ethernetalliance.org
HowInterconnectsareBeingUsedinDataCenters
19
Multi-ModeOptics3m-100m
DACServer/ToR-to-ToR
SR4Forstructuredcabling
ShortReaches
DAC
CDM4/LR4
8-FiberMPO500m-2Km
AOC:3-50m
“DACIntheRack”3m
Quad25GSFPbreakout
Dual50GBreakout
25GSFP
ForStructuredCablingLongReaches
2-FiberLC2-10Km
OpticalPatchPanel
Quad25GSFPbreakout
Dual50GBreakout
Quad25GSFPbreakout
Dual50GBreakout
25GSFP
Single-ModeOpticsUpto10Km
PSM4ForSingle-ModeMediumReaches
TypicalCloud-Enterprise-HPC-TelcoDataCanters
BigDatacentersaretheseunitsreplicated
WhereAreDACLinksUsed?
DACUp&downthe
Rack.LinkingServers&
storagetoSwitches.
Hybridbreakoutcables
HPCsmayuseAOCseverywhereincludingup&downtherack
Up&DowntherackServers&Storagelinkedto
ToRSwitches
FLASHStorage
WhereAOCsAreUsed?
AOCBetweenSwitchesovershortreaches<20mwhereaccessis
easy(cabletrays)
HPCsmayuseAOCseverywhereincludingup&
downtherack
Whereopenaccessisavailable
WhereSR4/MPOLinksUsed?InOverheadCableTrays
SR4/PSM4TransceiverstoopticalpatchpanelsandinStructuredCablingPipes&
underraisedfloorswhereconnectorsareneeded.
<100m
UndertheFloorsRequiresopticalconnectors&
SR4s
Whereconnectorizedlinksareneeded
4-chanelmulti-modetransceiver
WherePSM4,CWDM4&LR4LinksUsed?
InOverheadCableTrays
PSM4/CWDM4/LR4
Single-modeTransceiverlinkingtootherbuildings/floorsupto2Km/10Km.
Alltogether25G/50G/100GLinks
InOverheadCableTrays
AOCBetweenSwitchesovershortreaches<20mwhereaccessis
easy(cabletrays)
DACUp&downthe
Rack.LinkingServers&
storagetoSwitches.
Hybridbreakoutcables
HPCsmayuseAOCseverywhereincludingup&
downtherack
SR4/PSM4TransceiverstoopticalpatchpanelsandinStructuredCablingPipes&
underraisedfloorswhereconnectorsareneeded.
<100m
PSM4/CWDM4/LR4
Single-modeTransceiverlinkingtootherbuildings/floorsupto2Km/10Km.
UndertheFloorsRequiresopticalconnectors&
SR4s
FLASHStorage
HyperScaleDatacenters–Single-modeTerritory
!!
PSM4/CWDM4/LR4
QTSAtlanta
WhatitlookslikeINTHEOTHERDIRECTION!Thisis~750,000sq.feet.
LargestDatacenterbeingbuiltbyChinaPetroleum6.3Msq.feet!
QTSAtlanta
If you have any questions or comments, please email [email protected]
Visit the Ethernet Alliance
on Facebook
Ethernet Alliance: visit www.ethernetalliance.org
Join the Ethernet Alliance LinkedIn group
Follow @EthernetAllianc on Twitter
www.ethernetalliance.org 28
