Engineering

Patrick Crowley, John DeHart, Mart Haitjema, Fred Kuhns, Jyoti Parwatikar, Ritun Patney, Jon Turner, Charlie Wiseman, Mike Wilson, Ken Wong, Dave ZarApplied Research Lab, Washington University

www.arl.wustl.edu/~jst

Internet-Scale Overlay Hosting DEPLOYED Demonstration

2

Engineering

WASH Node

3

Engineering

SPP Components

Chassis Switch

10x1 GbE

CP

ExternalSwitch

netFPGA

GPE GPE NPE

Line Card

4

Engineering

SPP Deployment

22

2

5

Engineering

Hosting Platform Details

Chassis Switch

10x1 GbE

CP

ExternalSwitch

netFPGA

GPE GPE NPE

Line Card

PLOS

VM VM . . .

General PurposeProcessing Engine

filter

. . .

. . .

filter

Line Cardlookupparse header

format

... ...

queues

...

Network Processing Engine

6

Engineering

GEC-6 Demonstrations GPE:

» Forest prototype implemented in GPE» Use as many PlanetLab nodes as needed as data srcs» Data pkts contain PlanetLab hosts performance stats» Laptop at conference site also receives data pkts

• Dumps stats into a set of files that can be monitored at demo site. NPE:

» IP demonstration showing off performance aspects of SPP» Use as many PlanetLab nodes as possible/needed as data srcs» Use multiple slices?» Use sp++/serv to generate data packets in tunnels» Monitor NPE stats via SPPMon (modified ONL RLI GUI)

Run both demos Simultaneously!!! Use Gush (extends Plush) for pushing out code to end

nodes.

15

Engineering

Demo Configuration

R1 R2

R3

Logical ViewCP GPE GPE

LC

NPESystem View

CP GPE GPE

LC

NPE

C1 C3

R2C2

R1R3

PLC

150M 150M300M

10.1.x.21

2

3

10.1.x.24

5

6

16

Engineering

Defining a Slice

R1 R2

R3

CP GPE GPE

LC

NPE

CP GPE GPE

LC

NPE

PLC

C1150M 150M

300M

10.1.x.21

2

3

10.1.x.24

5

6

17

Engineering

Logging into Slice

R1 R2

R3

CP GPE GPE

LC

NPE

CP GPE GPE

LC

NPE

PLC

C1150M 150M

300M

10.1.x.21

2

3

10.1.x.24

5

6

18

Engineering

Downloading Files to Slice

R1 R2

R3

CP GPE GPE

LC

NPE

CP GPE GPE

LC

NPE

PLC

C1

NAT

150M 150M300M

10.1.x.21

2

3

10.1.x.24

5

6

19

Engineering

Configuring Fastpath and Interfaces

R1 R2

R3

CP GPE GPE

LC

NPE

CP GPE GPE

LC

NPE

PLC

C1 D1150M 150M

300M

10.1.x.21

2

3

10.1.x.24

5

6

20

Engineering

CP GPE GPE

LC

NPE

CP GPE GPE

LC

NPE

PLC

C1 D1

Configuring Router Filters, Queues

R1 R2

R3150M 150M

300M

10.1.x.21

2

3

10.1.x.24

5

6

21

Engineering

Sending Traffic Through NetworkLogical View

CP GPE GPE

LC

NPE

System View

CP GPE GPE

LC

NPE

C1 C3

D2C2

D1D3

PLC

R1 R2

R3150M 150M

300M

10.1.x.21

2

3

10.1.x.24

5

6

22

Engineering

NP Blade

SPI Switch

xScaleinput

. . .ME Mem

Int

SRAM SDRAM

ME

ME

output

Exte

rnal

Inte

rfac

es

RTM

FIC

Switc

hIn

terf

ace

TCAM

TCAMInt

NP A

NP B

Loc. Mem.

TC . . .TC

ALU

thre

adco

ntex

ts

23

Engineering

Line Card Datapath

Lookup(2 ME)

RxIn(2 ME)

TxIn(2 ME)

QueueManager

(4 ME)

KeyExtract(2 ME)

HdrFormat(1 ME)

TCAM

DRAMSRAMSRAM

exte

rnal

inte

rface

s

switc

h in

terfa

ce

ingress side

Lookup(2 ME)

KeyExtract(1 ME)

RxEg(2 ME)

TxEg(2 ME)

QueueManager

(4 ME)

HdrFormat(1 ME)

DRAMSRAM SRAM

egress side

FlowStats(2 ME)

SRAM

Filter/route and rate-control traffic Network Address Translation for outgoing flows Record traffic statistics for all outgoing flows

24

Engineering

NPE Datapath (version 1)

Parse and Header Format include slice-specific code » parse extracts header fields to form lookup key» Hdr Format does any required post-lookup processing

Lookup uses opaque key for TCAM lookup Multiple static code options can be supported

» multiple slices per code option» each has own interfaces, filters, queues and private memory

SRAM

Lookup(1 ME)

Rx(2 ME)

Tx(2 ME)

QueueManager

(4 ME)Parse(1 ME)

HdrFormat(1 ME)

TCAM

DRAMSRAMSRAM

Substr.Decap(1 ME)

SRAM

25

Engineering

NPE Datapath (Version 2)

Use both NPs, enabling 10 Gb/s throughput Integrated Decap,Parse,Lookup uses MEs more efficiently Multicast supported by substrate

SRAM

Tx(2 ME)

TCAM

Decap, Parse, Lookup, AddShim(8 MEs)

SRAM

from

switc

h

Rx(2 ME)

SRAM

to sw

itch

SRAM

QueueManager(4 MEs)

Rx(2 ME)

Tx(2 ME)

Lookup& Copy(2 ME)

HdrFmt(4 MEs)

SPI Switch

SRAM