New and Emerging Standards for Short Reach Enterprise LAN and Data Center Optical Links

John KaminoOFS

jkamino@ofsoptics.com

Agenda

• Market Drivers• Fiber Types• Applications Roadmap• Application Standards• Conclusions

IP Traffic Growth

• Trends driving growth in the future1. Growth in mobile-to-mobile devices (smart meters,

video surveillance, healthcare monitoring, transportation, and package or asset tracking)

2. Smartphone growth 3. increased video usage, coupled with higher

definition video4. IoT connectivity, including mobile-to-mobile

applications• 25% CAGR between 2017-2022

Cisco Visual Networking Index:Forecast and Methodology, 2017-2022November 26, 2018

Year Global Internet Traffic

1992 100 GB per day

1997 100 GB per hour

2002 100 GB per second

2007 2,000 GB per second

2017 46,600 GB per second

2022 150,700 GB per second

Data Center Traffic

• Global data center traffic will reach 20.6 Zettabytes in 2021, from 6.8 Zettabytes in 2016

• Total East-West traffic will be 85%

• Traffic is growing at a 25% CAGR

Source: Cisco Global Cloud Index: Forecast and Methodology, 2016-2021January 2018

Your Optical Fiber Solutions Partner® at www.ofsoptics.com

Edge Data CentersPotential growth area with VSCEL-MMF links

Hyperscale cloud computing drives a centralized computing model, edge computing swings pendulum back to distributed computing

Edge computing and edge data centers are growing rapidly

• Latency requirements • Localized computing needs

Edge data centers will be smaller, with reaches that make MMF/VCSELs an effective option

Source: Intel

Source: Technavio

Your Optical Fiber Solutions Partner® at www.ofsoptics.com

Co-Location Data CentersPotential growth area with VSCEL-MMF links

Co-location data centers are a growing segment of the off-premises enterprise DC, hybrid cloud solution mix

Industry leaders use a wide variety of network connectivity in their co-location DCs including MMF

Co-location data centers offer different levels of service depending on their business model and customer requirements

Source: Equinix

Your Optical Fiber Solutions Partner® at www.ofsoptics.com

Evolution of network speeds to keep up with growing demandCourtesy LightCounting

• Networks are continually migrating to higher speeds

• 1G, 10G and 40G shipments are declining as higher speed modules take their place in networks around the world

• 100G shipments are ramping quickly• 400G will begin to ship in larger volumes in

the 2020-2021 timeframe• There will be a pause in 2019

Transceiver Module Shipment ForecastCourtesy of LightCounting

MMF vs SMF – 25G to 400G speed modules only

Agenda

• Market Drivers• Fiber Types• Applications Roadmap• Application Standards• Conclusions

Multimode Fiber Types

Multimode(described in the industry using primarily the ISO/IEC 11801 designations)

ISO/IEC 11801-1Nov. 2017

IEC 60793-2-10Aug. 2017

TIA-568.3-DOct. 2016

TIA/EIA 492AAAxvarious

ITU-TDec. 2008 850nm 1300nm 850nm 1300nm 850nm 953nm

62.5/125 OM1 A1b TIA 492AAAA (OM1) 492AAAA --- 3.5 1.5 200 500 --- ---50/125 OM2 A1a.1b(1) TIA 492AAAB (OM2) 492AAAB G.651.1 3.5 1.5 500 500 --- ---50/125 OM3 A1a.2b(1) TIA 492AAAC (OM3) 492AAAC --- 3.0(2) 1.5 1500 500 2000 ---50/125 OM4 A1a.3b(1) TIA 492AAAD (OM4) 492AAAD --- 3.0(2) 1.5 3500 500 4700 ---50/125 OM5 A1a.4b(1) TIA 492AAAE (OM5) 492AAAE --- 3.0 1.5 3500 500 4700 2470

(1) "b" designates Bend-Insensitive

ISO/IEC 11801-1IEC 60793-2-10TIA-568.3-D "Optical Fiber Cabling and Components Standard"TIA/EIA-492AAAxITU-T G.651.1 "Characteristics of a 50/125 um Multimode Graded Index Optical Fibre Cable for the Optical Access Network"

(2) ISO/IEC 11801 has a max. cabled attenuation of 3.5dB/km

"Generic Cabling for Customer Premises"

"Detail Specification for… Class 1a Graded-Index Multimode Optical Fibers"

Effective Modal Bandwidth (EMB)(also know n as Laser

BW)

Industry Standards

Bandwidth (MHz-km)

Fiber Type

"Product Specifications - Sectional Specification for Category A1 Multimode Fibres"

Attenuation -Typical Cabled Max.

(dB/km)Overfilled Launch

(OMBc)

Multimode Bandwidth Comparison

• IEC 86A– IEC 60793-2-10 revisions

• Add guidance for OM3 and OM4 bandwidth from 840nm to 953nm

• TR-42.12– TIA 492AAAx revisions

• Proposal to replace current TIA-492-AAAA, AAAB, AAAC, AAAD, and AAAE with a single document, adapting IEC 60793-2-10 to become TIA-492-AAAF.

Application Space

Enterprise Local Area Network (LAN)

– Riser Backbone –Primarily 10 Gb/s, migration to 40/100 Gb/s speeds

– New construction and office retrofit

– OM3, OM4, and OM5 fibers are standards based solutions for LAN networks

Data Center

Migration to 100/400 Gb/s SpeedsOM3, OM4, OM5 multimode fiber

Migration to 10/25/40/50 Gb/s SpeedsOM3, OM4, OM5 multimode fiber

Why Multimode Fiber instead of Copper?VCSEL-MMF links have greater bandwidth and reach

• 40Gb/s reach– Twinax – 7 meters (m)– Twisted Pair – 30 m– OM4 Multimode Fiber – 100 m

• Can be extended to 400/550m using engineered solutions

• Capacity limited– ≥ 10Gb/s speeds very challenging for

twisted pair– Twinax solutions become unwieldy as

speeds go beyond 10G. • Not suited for structured cabling

• EMI immunity

40Gb/s cable solutions – twinax (8 pair) vs. duplex fiber

Why Multimode Fiber instead of Singlemode?VCSEL-MMF links enjoy cost & power advantages

• Relaxed alignment tolerances (~10x) for laser, mux/demux, and connectors

• MMF connectors more resilient to dirt• Lower drive currents (5-10mA vs. 50-60mA)and on-wafer testing• Benefits will persist when comparing 400G technologies

for short reach• Gearbox function is needed to convert native 50G

PAM-4 to 100G PAM-4 with DR4 & FR4• Laser RIN reduction for PAM-4 is as, or more,

difficult for DFBs as VCSELs• Packaging for 1310nm sources at 100 Gb/s per lane

PAM4 has required significant development

– All these combine to give multimode links a continued cost advantage over singlemode links

Agenda

• Market Drivers• Fiber Types• Applications Roadmap• Application Standards• Conclusions

Multimode Ethernet

200/400 Gb/s Ethernet (IEEE802.3bs)

PMD Link Distance Fiber Count and Media Type Technology

400GBASE-SR16 100 m OM4/OM5(32-f MPO)

32-f MMF 16x25G parallel NRZ 850nm

400GBASE-DR4 500 m 8-f SMF 4x100G parallel PAM41300nm

400GBASE-FR8 2 km 2-f SMF 8x50G CWDM PAM48 wavelengths around 1300nm

400GBASE-LR8 10 km 2-f SMF 8x50G CWDM PAM48 wavelengths around 1300nm

200GBASE-DR4 500 m 8-f SMF 4x50G Parallel PAM41300nm

200GBASE-FR4 2 km 2-f SMF 4x50G CWDM PAM44 wavelengths around 1300nm

200GBASE-LR4 10 km 2-f SMF 4x50G CWDM PAM44 wavelengths around 1300nm

PublishedDec. 2017

50/100/200 Gb/s Ethernet (IEEE 802.3cd)

PMD Link Distance

Fiber Count and Media Type Technology

50GBASE-SR 100 m OM4/OM5 2-f MMF 1x50G PAM-4

850nm

50GBASE-FR 2 km 2-f SMF 1x50G PAM-41300nm

50GBASE-LR 10 km 2-f SMF 1x50G PAM-41300nm

100GBASE-SR2 100 m 4-f MMF 2x50G PAM-4850nm

100GBASE-DR 500 m 2-f SMF 1x100G PAM41300nm

200GBASE-SR4 100 m 8-f MMF 4x50G parallel PAM-4850nm

PublishedDec. 2018

400 Gb/s Ethernet (IEEE 802.3cm)

• Submitted to RevCom• Approval Voting - January 2020

PMD Link DistanceFiber Count and Media

Type λ Connector

Interface

Optical Modulatio

n

400GBASE-SR8 100 m OM4/OM5 16-f MMF 1850nm

16-f MPO (1 row)24-f MPO (2 row) 50G PAM-4

400GBASE-SR4.2 100 m OM4150 m OM5 8-f MMF

2850/910nm

Bi-Directional12-f MPO (1 row) 50G PAM-4

400GBASE-SRx.y# wavelengths per fiber# fiber pairs

400GBASE-SR4.2

• First standards-based application using wavelength division multiplexing (WDM) – Takes advantage of Wideband OM5 fiber

• Baseline adopted with reach objectives– 70m OM3– 100m OM4– 150m OM5

• Two wavelength solution• New nomenclature

– SRx.y• X – number of fibers• Y – number of wavelengths

• Standard 12-fiber MPO connector interface, using 8 active fibers

– Proprietary/MSA solutions currently available for 40/100G WDM duplex links

400GBASE –SR4.2

400Gb/s Bi-Directional Transmission

• Uses same 4-pair infrastructure implemented for 40GBASE-SR4 and 100GBASE-SR4

• 12-fiber MPO interface

• Operates at two different wavelengths • 850nm • 910nm

850 nm

910 nm

850 nm

910 nm

850 nm

910 nm

850 nm

910 nm

910 nm

850 nm

910 nm

850 nm

910 nm

850 nm

910 nm

850 nm

400GBASE-SR4.2

[Left] 4 x 4 fiber shuffle allows a 32-port 400G switch to be used as a 128-port 100G switch

[Left] SR4.2 Low Cost Point-to-Point Link

[Right] SR4.2 4 x 100G breakout SR4.2

SR1.2

SR1.2

SR1.2

SR1.2

SR4.2

SR4.2

SR4.2

SR4.2

SR4.2

SR4.2

SR4.2

SR4.2

SR4.2 SR4.2

Shuffle Application

Data Center Switch Matrix

• 4x400Gb/s Modules• 4x switch faceplate density

• Replaces four 100Gb/s modules with one 400Gb/s module

• Replace 16 separate cable assemblies with a single shuffle matrix

Fanout Application

Switch – Server Links

• 400Gb/s module - breakout to 4 x 100Gb/s modules• 4x switch faceplate density

• Replace 4 100Gb/s modules on switch with 1 400Gb/s module• Replace 4 separate cable assemblies with a single shuffle matrix• Applications are not limited to the speeds above

SR4.2

SR1.2

SR1.2

SR1.2

SR1.2

400GBASE-SR8

• Two connector choices (Media Dependent Interfaces [MDIs]):

• Used in breakout, shuffle, and point-to-point applications– Breakout – 50 or 100Gb/s links to server– Shuffle – switch to switch links to decrease switch port counts– Point to Point – switch to switch links

400GBASE-SR8SR8 SR8

[Left] 4 x 4 fiber shuffle allows a 32-port 400G switch to be used as 128 port 100G switch

[Left] SR8 point-to-point link

[Right] 2 x 2 fiber shuffle allows a 32-port 400G switch to be used as 64 port 200G switch

SR8

SR8

SR8

SR8SR8

SR8

SR8

SR8

SR8

SR8

SR8

SR8

400GBASE-SR8 breakout

• [Right] SR8 module shown in 8 x 50G breakout mode to connect a 400G port on a TOR switch to 8 x 50G server ports

• Application currently used by Google and other hyperscale customers

SR8

SR

SR

SR

SR

SR

SR

SR

SR

IEEE 802.3 Study GroupLower cost, short reach optical PHYs using 100Gb/s wavelengths

• Call For Interest (CFI) passed November 2019

• Study group formed

• To measure the interest in addressing:– lower cost, short reach, optical PHYs using 100 Gb/s wavelengths

ToR switches will give way to MoR/EoR switches

Cost-effective VCSEL optics over 20-30m MMF will replace copper DAC cables or AOCs

Server Count/Rack

Power Dissipation/Server

QSF

P-DD

QSF

P-DD

QSF

P-DD

QSF

P-DD

QSF

P-DD

QSF

P-DD

QSF

P-DD

QSF

P-DD

Applications

• Originally, the effort was targeted at switch-server links, similar to 400G-SR8 is used today by Google and other hyperscale customers

• However, there is interest in switch to switch connections in specific markets, primarily in Asia.

Your Optical Fiber Solutions Partner® at www.ofsoptics.com

100 Gb/s per wavelength VCSELsODCC Next Generation DCs in China

Open Data Center Committee (ODCC) recently completed study of “Next generation Data Center Connections in China,” which states: “MMF might still have a cost advantage and is

expected to evolve to 100G per wavelength” “30m is a reasonable first goal for MMF links for

AOC or transceivers in server interconnects” “Longer distance MMF transceivers are needed

for switch interconnects with transceivers” 50 m reach for switch to switch connections may

be required

Source: http://www.ieee802.org/3/ad_hoc/ngrates/public/19_09/lingle_nea_01a_0919.pdf

Potential Next-Generation MMF Links based on 100 Gb/s PAM4 VCSELs

The potential PMDs for 100 Gb/s PAM4 VCSELs are: 100G-SR (SFP112) 400G-SR4 in quad module (400G QSFP56-DD ports) with breakout to

4×100GBASE-SR When 800G MAC rate is standardized in the future, 800G-SR8

Also possible in the future, when combined with two-wavelength BiDi transmission: 200G-SR1.2, 400G-SR2.2, 800G-SR4.2, and 1.6T-SR8.2 become feasible While four-wavelength SWDM4 technology combined with the same VCSELs could

support 400G-SR1.4, 800G-SR2.4, 1.6T-SR4.4. While only some of the above PMDs will have adequate support/need to become

either an IEEE 802.3 standard or MSA , 100 Gb/s PAM4 VCSELs lay the foundation for VCSEL-MMF links supporting 800G and 1.6T MAC rates as those rates become standardized in the future.

Your Optical Fiber Solutions Partner® at www.ofsoptics.com

Ethernet Modules – Speed ≥ 100Gb/s

• 100 Gb/s VCSELs expected in 2021 – will initially support short-reach server interconnects ≤ 30-50m breakout to server will be first use of 100G/lane VCSELs

OM3 OM4 OM5

100 100GBASE-SR4 Standard 4 1 25G NRZ 70 100 Same as OM4

100 100G – SWDM4 MSA 1 4 25G NRZ 75 100 150

100 100G – BiDi Proprietary 1 2 50G PAM4 70 100 150

400 400GBASE-SR16 16 1 25G NRZ 70 100

50 50GBASE-SR 1 1 50G PAM4 70 100

100 100GBASE-SR2 2 1 50G PAM4 70 100

200 200GBASE-SR4 4 1 50G PAM4 70 100

400 400GBASE-SR8 8 1 50G PAM4 70 100 Same as OM4

400 400GBASE-SR4.2 4 2 50G PAM4 70 100 150

100 100GBASE-SR IEEE Stds. Study Group 1 1 100G PAM4 30/50?

800 800GBASE-SR8 8 1 100G PAM4 30/50?

4/800 4/800GBASE-SRm.n 2/4/8 TBD 100G PAM4Future Technology

100m over MMF

Data RateGb/s

Submitted to RevCom Standards Board Ballot

January 2020

Ethernet Standard Proprietary/MSA Module

IEEE Standard/MSA/Proprietary

# fiber pairs # λ’s Reach (m)

Standard

Optical Modulation

Same as OM4

Multimode Fibre Channel

64GFC – FC-PI-7

– 100 m reach for OM4/OM5 and 70m reach for OM3

– All technical work and reviews completed (errata needed)

– Standard will be published early 2020

Variant Link Distance

Fiber Count and Media Type Technology

64GFC 100 m OM4/OM5 2-f MMF PAM-4

64GFC 10 km 2-f SMF PAM-4

Your Optical Fiber Solutions Partner® at www.ofsoptics.com

Recent Fibre Channel and FCIA for MMF

FC-PI-8/128GFC (serial)• Project approved in April, 2018• Technical work started February 2019• FCIA FC-PI-8 Marketing Requirements Document (MRD):

o backward compatible with 32GFC/64GFC. o 100 m reach for OM5/OM4, 30 m OM3, 2 km & 10 km SMFo Same external connectors as present connector: LC and SFP+ for 128GFCo Target technical stability date of 2021 and product availability of 2022

Finisar Contribution to Fibre Channel FC-PI-8100 Gb/s PAM4 VCSEL link

First 100 Gb/s VCSEL contribution in any applications standards group (T11/Fibre Channel, IEEE 802.3 Ethernet, OIF, ITU, etc.)

Proposing a 940 nm VCSEL (a 930 nm to 950 nm center wavelength range) Issues:

• Only 50 m OM5 reach (vs. MRD 100 m)• Not backward compatible to 32 GFC• Not backward compatible to 850 nm

38

Source: incits.org T11-2019-00161-v000

Conclusions

• Bandwidth demands continue to grow, and application speeds are increasing to support those needs.

• 100 Gb/s PAM-4 VCSELs are the next target for MMF-VCSEL based links• 100/400Gb/s VCSEL-MMF based solutions being deployed widely today

• Singlemode fiber solutions provide significant link length advantages• Bend optimized singlemode fiber offer advantages over standard G652.D fiber