O p e n N e t w o r k i n g D e p l o y m e n t i n P r o d u c t i o n

Attilla de Groot | Sr. Systems Engineer | Cumulus Networks

Networking Track

3

Network Disaggregation

Cisco

Arista

Juniper

App App App

Network OS

Open Hardware

Cumulus NetQ

Network Operating SystemCumulus Linux

4

>4M28% 1100+Ports Powered by

Cumulus Technologyof Fortune

50 CompaniesCustomers Across

Many Industry Verticals

25%of Mega-ScalePublic Clouds

Cumulus OCP customers

5

Open hardware & disaggregation

QFX 3500

N exus 3100

N exus 9000

7500E

7250X

X770

HCL:Edge-Core , Facebook, Penguin, HPE,

Agem a/D N I

powered by

Juniper Cisco Arista Extreme OCP open switchgear

6

Simple Architecture – Spine and Leaf

7

3-Tier Spine and Leafeth1

eth2

eth2eth1 eth1

eth2

eth2eth1

swp1 swp2 sw

p1

swp2

swp1 swp2 sw

p1

swp2

swp21swp21

swp20 swp20

swp21swp21

swp20 swp20leaf01 leaf02 leaf03 leaf04

server01 server02 server03 server04

spine01 spine02

Pod1

eth1 eth

2eth2eth1

swp1 swp2 sw

p1

swp2

server05 server06

exit01 exit02swp4

9swp50 swp

49swp5

0

swp4

9

swp50 swp49

swp50 swp49swp50 swp49

swp50

swp1

swp2

swp3

swp4swp5

swp6 swp1

swp2 swp3

swp4

swp5swp6

swp21swp21

swp20 swp20

eth1

eth2

eth2eth1 eth1

eth2

eth2eth1

swp1 swp2 sw

p1

swp2

swp1 swp2 sw

p1

swp2

swp21swp21

swp20 swp20

swp21swp21

swp20 swp20exit03 exit04 leaf05 leaf06

server07 server08 server09 server10

spine03 spine04

Pod2

eth1 eth

2

eth2eth1

swp1 swp2 sw

p1

swp2

server11 server12

leaf07 leaf08swp4

9swp50 sw

p49swp

50

swp4

9

swp50 swp49

swp50 swp49swp50 swp49

swp50

swp1

swp2

swp3

swp4swp5

swp6 swp1

swp2 swp3

swp4

swp5swp6

swp21swp21

swp20 swp20

super01 super02

3tier

swp5

1swp52

swp5

1

swp5

2 swp51 swp5

2

swp1

swp2

swp3

swp4 swp1

swp2

swp3

swp4

swp51swp52

8

OCP Chassis

Edge-Core OMP800 Facebook Backpack

https://www.opencompute.org/products

9

Open hardware and disaggregationFacebook Backpack

10

Edge-Core OMP800 Fabric Connectivity

11

3-Tier Spine and Leaf

32 port line cards

32 port fabric cards

12

ONIEFrom loading dock to production

ONIE – “PXE on steroids”§ Born from decades of PXE baggage, talented

embedded engineers, and disaggregation goal across the industry

§ No need for consoleSimply scp the operating system directly to ONIE!

§ Backwards-compatible w/PXE setup(DHCPv4 and TFTP)

§ https://github.com/opencomputeproject/onie

13

ONIEFrom loading dock to production

Boot into ONIE§ Management interface network discovery

§ OS image source discovery§ File name search (onie-installer)

§ Install Cumulus Linux

Reboot into Cumulus Linux§ Zero touch provisioning

Optional step to invoke provisioning script

if DHCP option 239, run script

Subsequent boot ups§ Normal Cumulus Linux restart

OS image

Provisioning script

14OCP hardware

Switch Silicon

Front Panel Ports

Use

r Sp

ace

Linu

x K

erne

l

ASICDriverRouting

TablesARP

TableBridgeTable

Ethernet Interfaces

Automation Monitoring

Third Party/Customer Applications

Network OrchestrationRouting

SuiteBridging VXLAN

VxLAN

switchd

Switch HAL

Cumulus Linux architecture on OCP hardwareUniform operating model – write any tools, use any apps

15

Customer use-caseCampus Deployment

Naturalis Biodiversity Center§ Campus deployment

§ Greenfield building

§ Automated with ONIE and Ansible

16

Automated provisioning demo