18
BelWü Updates SIG-NOC #1 SIC-NOC #1 08.04.2015 Stuttgart Tim Kleefass [email protected] 1

BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

BelWü Updates

SIG-NOC #1

SIC-NOC #108.04.2015Stuttgart

Tim [email protected]

Page 2: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Baden-Württemberg Extended LAN

Academic Network of the Federal State of Baden-Württemberg, Germany

We are connecting:

9 Universities

47 Universities for applied sciences, etc.

Numerous schools, libraries, student dormitories and other institutes

And offering services (mostly for Schools):

Webhosting (e.g. Moodle e-learning) and youth protection HTTP proxy

E-Mail, SPAM detection

Network services (DNS, NTP, ...)

2

Page 3: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

BelWü (Fiber) Footprint

3

Backbone through Baden-Württemberg

> 3.000 km fiber & 10GigE bandwidth

50 POPs, 50 optical amplifiers

p2p lambdas: >80 * 10G, 10 * 100G(lambdas hop-to-hop only)

70 / 170 * 10GE 320 / 650 * GE 210 * FE

2 * 100GE

~200 backbone router

40 * ASR 9000 (9006, 9010)

23 * ASR 1000

Cat 6509, Cisco 2821, 2921, 3925

~2.500 others like Cisco 8xx DSL/Cable CPE

(C) BelWü-Koordination (Universität Stuttgart), www.belwue.de

(Dieses Bild basiert auf dem Bild "Baden-Wuerttemberg location map.svg" aus http://commons.wikimedia.org

und steht unter der GNU-Lizenz für freie Dokumentation. Die Urheber sind Ssch, kjunix.)

Leitungen

10GE Bandbreite optisches Fenster existierende DF Bandbreite

BelWü-KoordinationUniversität Stuttgart

http://www.belwue.deTue Apr 15 2014

Stand 12/2012

Standorte mit Universität Hochschule Anderer

25

96

42

26

58

5134

40

70

94

51

33

112

25

5015

45

3565

49

68

50

60

2040

23

76

(~250?)

30

42 Leitungslänge in km (ca.)

(~280?) 60

100

33

90

10028

60

50

110?

Böblingen

Freudenstadt

Rastatt

Baden-Baden

Rotten-burg

Biberach

Weingarten

Ravensburg

Friedrichshafen

Sigmaringen

Albstadt

Reutlingen

Nürtingen

Esslingen

GöppingenGeislingen

Heidenheim

AalenSchw. Gmünd

Künzelsau

Schw. HallHeilbronn

Mosbach

Ludwigsburg

Pforzheim

Kehl

Lörrach

Tuttlingen

Trossingen

V-SFurtwangen

HorbOffenburg

Gengenbach

PH FA

Frankfurt

Tübingen

Ulm

Konstanz

Freiburg

Karlsruhe

HohenheimStuttgart

Heidelberg

Mannheim

Page 4: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Ausblick 2014-2016+BelWü 2016+

4

Page 5: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Updates for BelWü 2016+

Long-run contract (3*5 y) with bandwidth and fibre provider ends in 2016

BelWü 2016+

No more rented bandwidths => continuos & redundant fibre-only network

(New) Optical network

For transport between cities (amp, comp, mux, route, …)

For by-passing IP routers and backhauling (less IP router)

For bandwidths between participants

100G IP access to participants

Outsourcing of (some) remote hands and field services

Start of roll-out: 1st of March, 2016

5

Page 6: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

6

(C) BelWü-Koordination (Universität Stuttgart), www.belwue.de

(Dieses Bild basiert auf dem Bild "Baden-Wuerttemberg location map.svg" aus http://commons.wikimedia.org

und steht unter der GNU-Lizenz für freie Dokumentation. Die Urheber sind Ssch, kjunix.)

Possible fiber routes for BelWü 2016+

New fiber

Existing fiber

BelWü-KoordinationUniversität Stuttgart

http://www.belwue.deMon Apr 06 2015

2

7

6

5

4

3

89

10

11

1213

14

15

16

17

18

19

20

21

22

23

24 Bad Mergentheim

Marbach

Standorte mit

Universität (zwei Standorte) Hochschule Anderer Standort

Böblingen

Freudenstadt

Rastatt

Baden-Baden

Rotten-burg

Biberach

Weingarten

Ravensburg

Friedrichshafen

Sigmaringen

Albstadt

Reutlingen

Nürtingen

Esslingen Göppingen

Geislingen

Heidenheim

AalenSchw. Gmünd

Künzelsau

Schw. HallHeilbronn

Mosbach

Ludwigsburg

Pforzheim

Kehl

Lörrach

Tuttlingen

Trossingen

V-SFurtwangen

HorbOffenburg

Gengenbach

PH FA

Frankfurt

Tübingen

Ulm

Konstanz

Freiburg

Karlsruhe

HohenheimStuttgart

Heidelberg

Mannheim

Will tender for fibres (~2.000km)

Now: Defining criteria for tender for fibre (starting next month)

Legal things are getting more complicated :/

Page 7: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Campus Optical - today

Nicht eingezeichnet:Dispersionskompensation

Page 8: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

ROADM directed/colored

Page 9: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

ROADM direction-less/color-less

Page 10: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Optical Network

Prices for 100G (optical and IP) should drop later this year

Lots of vendors will release second generation of line-cards/interface

Smaller chips, more 100G port per line-card

ROADM prices are quite payable

Big vendors are not creative or do not understand us

Hardware often quite the same

Some differences, e.g., if vendor offers Layer 2 cards (MPLS or Ethernet aggregations)

Big differences in software for Planing and NMS tools

10

Page 11: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Optical Network

If 10G waves

Then Compensation necessary

If FlexGrid

Then Compensation must not be channelized

If Compensation fiber

Then +25% latency

Else

Use non-channelized FBG from Proximion

Feedback, anybody: FlexGrid + FBG from Proximion ?

11

Page 12: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Project Content description Comments concerning actual version

Contact & Copyright Author (creator) Date

BelWü WAN 2016+ ??? LWL Plan 2016+ ???filename: 2016-BelWue.graffle

BelWü LandeshochschulnetzIndustriestr. 28D-70565 [email protected]

20.04.2011 14:25 Tim Kleefass

Version 3

Author (last modification) Date

19.03.2015 23:08 Tim Kleefass

Karlsruhe

DE-CIX Telia

Level3

DFN

SWITCH

MANDA??

DFN

Ess-HS

80?

Goe-HS

Sgd-PH

90?

30

40

40?

Alb-HS

60?

DRAFT DRAFT DRAFTAt this time it is unknown if we can or will realize the fiber network as shown in this map.

Fuw-HS

Vis-HS

Tro-MH

Sig-HS

Nue-HS

Reu-HS

Boe-BH

Fds-Zoll

Keh-HS

Hor-DHBW

Gei-HS

Sgd-PH

Fdh-DHBW

Wei-HS

Rav-DHBW

Bib-HS

Lbg-PH

Mar-DLA

10?

55?

50?

51

50

25

80?

C-ba

nd a

s pa

ss

thro

ugh

Frb-KG

-- Only Ch. 52-59 --

Only ITU Ch. 23

Hdl-RZ

Mos-DHBW

Hlb-HS

Kue-HS

Shl-HS

Many pairs of fibers (own, on the Campus, 1-10 km)

One pair of fibersred: fiber with 100G applications/waveblack: static DWDM 10G (old/unchanged)

Ofg-HS

Tut-HS

Man-RZ

Man-Schloß

Stu-NWZ

Kar-RZ

Ras-ALM

Bad-KUHA

Ulm-N26

Hdl-City

Pfo-HS

Frb-RZ

Fra-DECIX

Loe-DHBW

Ulm-N25

Stu-AL30

Tue-Wae

Kon-Bib

Kar-Bib

Kar-Nord

Hoh-Ost

Kon-RZ

Tue-Mor

Aal-HS

Hdh-DHBW

Only L-band in local-loop

C-ba

nd a

s pa

ss th

roug

h

Mannheim

Stuttgart

Hohenheim

Heidelberg

Ulm

Tübingen

Konstanz

Freiburg

Hoh-West

Small Pop, only L-Band(e.g., non-University)

Mid-range PoP (e.g., small University)

Big PoP (e.g. University)w/ 100G connection

Stu-MWK

Stu-Zet

-- Only Ch. 52-59 --

23 km 80?

76

25

96

94

70210

60?

60

50

49 68

37

130110

60? 80? 32

80?

100?

Fra-TC 10

90 5070

Potential optical Amplification Locations

16

9 16

10?

10?

15

101

1

1

1

25?

35?

100GRouter

100GRouter

100GRouter

KIT

Uni UniUni

Uni

Uni

Uni

Uni

Uni

2 * 100G IP Router and backhauls

12

Page 13: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

2 IP routers and fibre cuts…

2.#Spalte:#Unterbruch#Stuttgart#3#TübingenEntfernungen#auf#der#Glasfaser bis$200 ab$200 ab$500 Router$in:$ Stuttgart,#Karlsruhe

RZ RZ West RZ RZ RZ NWZ Wae N26km Freiburg Heidelberg Hohenheim Karlsruhe Konstanz Mannheim Stuttgart Tübingen UlmFreiburg Hop7by7Hop 77 338 338 333 333 191 191 290 290 315 315 308 308 367 471 578 578

Doppelstern 77 338 338 335 335 191 191 550 672 315 315 308 308 369 853 578 578Heidelberg Hop7by7Hop 77 291 291 147 147 506 628 23 23 265 265 325 809 479 479

Doppelstern 77 291 291 147 147 506 628 271 271 265 265 325 809 602 602Hohenheim Hop7by7Hop 77 144 144 267 623 268 268 27 27 86 804 364 364

Doppelstern 77 144 144 269 625 268 268 27 27 88 806 364 364Karlsruhe Hop7by7Hop 77 359 481 124 124 119 119 178 662 456 456

Doppelstern 77 359 481 124 124 119 119 178 662 456 456Konstanz Hop7by7Hop 77 483 605 242 598 181 181 288 288

Doppelstern 77 483 605 242 598 303 1143 579 935Mannheim Hop7by7Hop 77 243 243 302 786 502 502

Doppelstern 77 243 243 302 786 580 580Stuttgart Hop7by7Hop 77 61 779 337 337

Doppelstern 77 61 779 337 337Tübingen Hop7by7Hop 77 398 467

Doppelstern 77 398 1116Ulm Hop7by7Hop 77

Doppelstern 77

13

With less IP routers, round-trip time between two participants can jump from 3ms to 11ms in case of fibre cuts; should we worry ?

Page 14: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Some open questions

How many bandwidths will the participants need (between them) ?

Do we (still) need 10G waves, or do we go with coherent only ?

Mux all 10G applications into 100G/coherent ?

Should we build an bandwidth transportation network, e.g. with OTN or MPLS boxes, maybe directly in the optical network chassis ? (We overcame ATM/SDH and other circuit switching…)

Are 2 * 100G IP routers fine for us, or will the latency increase kill user applications ? => Feedback anybody ?

Do we need optical protection or will our participants have two (redundant) bandwidths anyway ?

Direction-less everywhere ? Or upgrade later ?

14

Page 15: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Some open questions (cont.)

Distribute ROADMs on two Locations on Campus ?

Spectrum sharing w/ participants (“customer”) ?

We have that on some links today w/ static filters …

Page 16: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

It seams that

10G as wavelength is the cost-optimum

Even if it brings +25% latency for compensation

FlexGrid seams to necessary for 400G+, so we plan it today

80-88-96 Ch. in 50 GHz grid

Directed, colored — for IP network

Direction-less — for bigger PoPs (as switchable bandwidths, for participants and additional backbone capacity)

Color-less — if we need to save wavelengths (?)

Contention-less — probably not necessary

Less IP router and more latency between participants is fine

16

Page 17: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

BelWü bought sponsored some RIPE Atlas Probes

Idea: One Probe at each University

Probes are managed by BelWü

(Public or open) Measurement to targets in- and outside of BelWü

Network performance like a users sees it

RIPE Atlas Probes @BelWü

17

Page 18: BelWü Updates SIG-NOC #1 · For transport between cities (amp, comp, mux, route, …) For by-passing IP routers and backhauling (less IP router) For bandwidths between participants

Questions ?

18