Day0 01 Building Converged IP

March 2015

Building Converged IP and Optical Transport Networks

Building Converged IP and Optical Transport Networks – Contributors Dean Cheng – Huawei Networks Rao Cherukuri – Juniper Networks Gabriele Galimberti – Cisco Systems Gert Grammel – Juniper Networks Diane Patton – Cisco Systems Manuel Paul – Deutsche Telekom

2

Agenda

3

Introduction to the Broadband Forum IP and DWDM Integration Market and Business drivers Integration in the Metro Technology Overview

– Coherent DWDM – Data Plane and Interfaces

IP and DWDM Integration Architecture Physically and Logically Integrated Model

– Control Plane and SDN Integration – Management Plane

Fully Separated Model – Management Plane

IP and DWDM Integration Standards IP and DWDM Integration Use Cases Summary

3

Who we Are…

4

The Broadband Forum is the central organization driving global broadband wireline solutions and empowering converged packet networks worldwide

Focused on engineering smooth evolution of broadband networks and mitigating new technology risks

Our work- – defines best practices for global networks – enables service and content delivery – engineers critical device & service management tools, and is key to redefining broadband

https://www.broadband-forum.org



IP and DWDM Integration Market and Business drivers

5

Motivation for Packet & DWDM Integration

A wealth of bandwidth-hungry multimedia applications and services is driving demand for high-capacity packet (IP) transport networks

– Dynamic services, applications are delivered from the cloud

– Content-delivery traffic patterns are leading to an increasing demand between edge and consumer

All-IP Networking and Infrastructure Cloud models continue to change the world (more or less radically)

– Need for scalable and cost efficient network solutions to handle substantial IP traffic growth

– Providers looking for improving efficiency and reducing network complexity

– Here, the basic motivation is similar as for Office consolidation 6

Layer 1 – 3 Convergence

7

TDM Evolution

– Changed from transport mapping scheme to a service – Being phased out – High speed Ethernet service dominant

Packet Transport

– Pure Packet implementation – IP/MPLS becomes the vehicle for Packet Transport – Packet Optical Multilayer Convergence is evolving

Catalyst: 100G Coherent

– Pluggable 100G coherent is emerging – Coherent 100G transponder onto router available today – Metro 100G is ramping

Advantages for Integrated Transport

8

Lower power usage

Operational synergies spanning metro, regional, and Core applications

End-to-end management, PM and OAM

Less components and saving in CAPEX

OPEX savings through simplified operations

– Capacity Planning – Traffic Engineering – Performance, root cause analysis and restoration – Automation and re-configurability

BBF is driving DWDM integration, interoperability and manageability. Packet and DWDM integration is a key enabler on the road towards next stages

of “Broadband”.

The biggest growth of WDM applications is now in the Metro/Regional, Core, as well as Cloud / DC connectivity

– High port density, high interface volumes – Simple topology, medium reach – 100G is clearly moving into the metro/regio, 10G into the access

Network Operators are looking for high-speed integrated IP/optical solutions

enabled by standardized WDM interface solutions. Interoperability and Manageability are key for DWDM integration

=> These are the key objectives BBF is addressing. 9

High-Speed WDM Solutions

… are needed in all areas of backhaul / network transport… – Aggregation, Metro/Edge and Core Networks

– Cloud / Data Center Interconnect

…but also as a key enabler for Mobile Broadband – (p)WDM for Mobile Backhaul in case of fiber constraints

– WDM / optical links as enabler for Mobile Fronthaul

…allowing for – High speed at reasonable cost-per-bit

– Efficiently utilize the resources / optical spectrum

– Low-latency and transparency for a large variety of services

– Carrier-grade Operation & Maintenance (with OTN / G.709 framing) 10

Transition from Optical Rings to Partial Mesh

11

Source: Infonetics Research, now part of IHS Inc: “OTN, MPLS, and Control Plane Strategies: Global Service Provider Survey”, May 2013.

DWDM Integration in the Metro

12

Metro

13

Metro WDM segment surpassed the long haul DWDM segment on a revenue basis (Q3 2013 ACG Research Blog). More traffic is staying within a Metro

Service providers plan to migrate their transport topology either partial or full mesh approaches

Full duplex point to point or mesh. With or without ROADM.

Same platform for metro and core for operational synergies for planning and sparing

Key findings from Heavy Reading Survey analysis (March 2013):

– Price is paramount in metro packet-optical transport – Integration with Layer 2/3 packet networks and superior OAM/management – Converged service transport – IP/MPLS is a serious contender for the metro network architectures of the future

14

Differentiating Features in Metro Optical Transport

* Source: “Heavy Reading Survey: Metro Packet-Optical Transport 2.0”, March 2013 Figure 2-11

0 20 40 60 80

Highest TDM interface density

Best-in-class TDM service features

Integration with Sonet/SDH networks

Highest packet interface density

ASON/GMPLS control plane

Best-in-class packet service features

Superior OAM/management

Integration with Layer 2/3 packet networks

Overall system pricing/cost

Number of Votes

15

Preferred Means of Metro Packet Transport in 3 to 5 years

* Source: “Heavy Reading Survey Analysis: Metro Packet-Optical Transport 2.0”, March 2013 Figure 2-13

0 20 40 60 80 100

Other

PBB-TE

Native MPLS

Ethernet over Sonet/SDH

MPLS-TP

Connectionless carrier Ethernet

IP/MPLS

Number of Votes

16

Metro Elements Targeted for Automated/Dynamic Control Plane

* Source: “Heavy Reading Survey Analysis: Metro Packet-Optical Transport 2.0”, March 2013 Figure 2-19

0% 10% 20% 30% 40% 50% 60%

Other

None

Legacy Sonet/SDH MSPP

Stand-alone WDM equipment

Metro P-OTS (WDM/packet/TDM)

Layer 2/3 switch

IP/MPLS router

DWDM Integration technology Overview

17

10G has become the dominant interface over the past decade

Transport evolving from SONET/SDH to IP/Ethernet over DWDM

40/80 Wavelength DWDM systems are reaching capacity

10G prices have declined continually accompanied by only modest technological improvements

100G Inflection Point

18

100G will quickly dominate transport.

Coherent Detection vs. Direct Detection

19

Direct Detection • Must correct for impairments in the physical domain (insert Dispersion

Compensating Units) • Forced to live with non-correctable impairments via network design (limit

distance, regenerate, adjust channel spacing) • Dumb detection (On/Off Keying), no Digital Signal Processing, only FEC

Coherent Detection • Moves impairment correction from the optical domain into the digital domain • Allows for digital correction of impairments (powerful DSP) vs. physical

correction of impairments (DCU’s). Adds advanced FEC. • Massive performance improvements over Direct Detection.

DD DD DCU DCU DCU

Regen

CD

20

Coherent 100G in DWDM transport is a major leap – Higher Chromatic Dispersion (CD) tolerance – no Dispersion Compensation Unit

needed for most conceivable networks – Higher Polarization Mode Dispersion (PMD) tolerance – tolerant of old / bad fiber – Manageable Optical Signal to Noise Ratio (OSNR) requirement – similar distance

without regeneration – Comparable with existing 10G – maximize wavelength fill

Advanced Modulation – Dual Polarization-Quadrature Phase Shift Keying (DP-QPSK) can use same DWDM

grid spacing as legacy 10G

Intelligent Digital Signal Processing – Compensate for transmission impairments with DSP, enabled by Coherent Detection

Dramatic improvement over 10G

Why is Coherent 100G Significant?

Coherent Technology Evolution Paradigm Shifts

100G

10G

1G

2015 2000 2005 2010 1995

Bit

Rat

e pe

r λ (b

it/s)

Year

> 100Gb/s MQAM 8b/s/Hz 40km ~ 4,000km

100Gb/s PM-QPSK

2b/s/Hz 2,000km

40Gb/s ODB DPSK

1b/s/Hz 1,200km

10Gb/s OOK

0.2b/s/Hz 400km

2.5Gb/s OOK

400km Modern

Coherent Detection

1T

WDM Hard FEC External

modulation

Advanced modulation

formats

Coherent Rx w/ DSP

Soft FEC

Rate adaptive M-QAM, OFDM

Raman

21

22

Major breakthrough and paradigm shift in the transport world: what previously was extremely complex engineering has now been radically simplified.

Use of coherent technology may allow more paths through an optical network. The high tolerance of optical impairments allow a more agile flexible optical network along with dynamic control plane

Tunable coherent receivers are available

Enables use of splitters/couplers as a alternative to ROADMs where applicable

Coherent Detection

DWDM Integration data plane and interface

23

IP Packets into OTN Frames

24

OPU4

ODU4

OTU4 Payload

OPU4 Payload

100G Ethernet Payload

OH

OTU4 FEC

IP packet

ODU4 Payload

OTU4

OH

OH

Enet OH Ethernet LAN PHY

OTN Framing for Packets over Optical Transport network

ITU-T G.709 OTU4 Framing – Standard overhead and payload with extended FEC – Actual rate “FEC” +112Gbps for std OTU4 (103 Gbps for

100GE)

Standard 100GBASE-R Mapping – Bit for bit Ethernet PCS transparency – Timing transparent, Support SyncE

High-order (HO) termination only – Entire OPU4 payload filled with 100GE frames

25

IP and DWDM Integration and Architecture

26

IP and DWDM Integration Architecture

27

Transponder

Packet Node DWDM

Network Element DWDM

Interface Tx

Colored

Interface

End-to-end Connection

End to end Connection Set-up Physical connection between packet node and DWDM Network

Element is optical or Ethernet/OTN. The Connection can be established through:

– GMPLS control plane protocols – SDN controller and related protocols. – Cross-connection node-by-node from management plane.

28

End-to-end Connection

Management Driven Connection Setup

EMS EMS

NMS

• Characterized by a hierarchical relationship

• Management systems are

in full control of the devices

29

GMPLS RSVP Path Message

GMPLS RSVP Path Message

GMPLS RSVP Resv Message

GMPLS RSVP Resv Message

End-to-end GMPLS LSP

GMPLS as the Control Plane IP network and Optical network integrated as an overlay model in

the perspective of GMPLS control plane. GMPLS-UNI (RFC4208) is deployed between packet node and

DWDM Network Element for LSP signaling.

GMPLS-UNI GMPLS-UNI

30

Packet nodes and DWDM Network Element have northbound interface to their respective SDN controllers.

A standards based protocol is used between SDN controllers

Connection is negotiated by SDN controllers.

Use of SDN for Connection Setup

31 End-to-end Connection

SDN Controller

Packet Node Packet Node

Optical Network

DWDM Integration – Physically and Logically Integrated Model

32

Physically Integrated Model DWDM Interface in Packet Node

DWDM Optical Network

Packet Node

Colored

Interface

Colored

Interface

DWDM Network Element

Packet Node DWDM Network Element

33

Physically Integrating DWDM Interfaces

34

DW

DM

N

etwork

Element

Packet node

TXP shelf

TXP

TXP

Savings & Improvements: • 2 Gray optical module + fiber • Board controller • Ethernet framer • TXP Chassis and Shelf Controller • Less packet latency • Integrated management

DWDM Interface Integration

35

Pa Transponder

TX

RX

TX

RX

RX TX

G.709 Grey Interface

OEO

TX RX

G.709 Integrated DWDM Interface

Existing Transport

Packet Node Client

Line

Optical PMs Exist in Packet Node G.709 PMs Exist in Packet Node - Packet Node capable of having - Visibility into optical network

Optical PMs Exist in Transponder G.709 PMs Exist in Transponder

Packet Node

TX RX

Can run alongside existing transport

Physically Integrated Model ITU-T Reference Points

Packet Node DWDM

Network Element

G.698.2 G.709 encapsulation

one G.694.1 λ

Tx

Rx

Ss

Rs

ITU-T G.698.2 Reference points

Colored

Interface

36

Physically Integrated DWDM Interfaces Summary

Integrating DWDM Interfaces into packet nodes: Can reduce equipment, power, space, cabling Can provide ease of visibility between the layers Used alongside existing transport

DWDM Line System

Integrating DWDM Interfaces in packet nodes optimizes the network while providing CAPEX and OPEX reductions and simplifications

Colored

Interface

Packet Node

Colored

Interface

Packet Node

37

DWDM Interface Unit Logically Integrated with Packet Node – Functionally the same as before...

DWDM Interface

Unit

Packet Node

DWDM Interface

Unit

DWDM Optical Network



Logically Integrated Logically Integrated

Grey

Interface

Grey

Interface

Packet Node

* May be implemented as a proprietary interface

* *

38

Logically Integrated DWDM Interface Unit ITU-T Reference Points

Transponder

Packet Node DWDM

Network Element

G.709 encapsulation

Management Channel*

G.698.2

one G.694.1 λ ITU-T G.698.2 Reference points

Ss

Rs

Colored

Interface

DWDM Interface Unit

Tx

Rx

Colored

Interface

SR

Grey Interface

SR

* May be implemented as a proprietary interface 39

Logically Integrated DWDM Interfaces Summary

Logically Integrating DWDM Interfaces into packet nodes: Allows for added scale of packet platform Allows for different lifecycles – packet vs optical equipment Packet node controls and manages DWDM Interface Unit Still provides visibility between the layers Used alongside existing transport

DWDM Line System

Logically Integrating DWDM Interfaces in packet nodes provides visibility while maintaining physical separation


Colored

Interface

Colored

Interface

DWDM Interface Unit

DWDM Interface Unit

40

* *

* May be implemented as a proprietary interface

DWDM Integration – Control Plane and SDN Integration

41

Clients of Transport Networks… The Challenges

42

Clients of a Transport Network

… No visibility into the network’s actual topology No resource availability information For good reason:

Security Considerations

Technology Considerations

Scalability Considerations

However, Clients need to influence …

The way the services provided to them are routed across the transport network Some services need to be

disjoint Some services need to be

co-routed Some services need to be

optimized based on lowest cost criteria, while

Some services need to have the best delay characteristics

Control Plane and SDN Benefits Allows for:

Multi-Layer Provisioning

Automated Wavelength Setup

Automated Provisioning

Automated Request

Circuit Up

IP Team Find a Path

Verify Feasibility

(offline) Provision Manual

Request Circuit

Up Co-ordinate

Transport Team

OPEX

CAPEX

Reduced provisioning times Eliminate human error

Higher interface utilization Fewer packet interfaces

required

With dynamic Control Plane or SDN

Resulting in:

43

44

Compute ‘optimal’ path for packet (client-layer) LSPs Computation/population of client-layer Shared Risk Link Groups Optical protection in-use Coordinated maintenance

Multi-layer Provisioning Association of access-links to abstract-links

coordinated restoration

Multi-layer Optimization

45

Minimize overall transmission costs, while satisfying traffic, resiliency, and performance requirements for multi-layer networks

Create the optimal Packet (client-layer) design

Ability to provision, reroute and de-provision transport links

Create Transport ‘routes’ to satisfy client layer design

Run the networks ‘hotter’ while ensuring predictability, resiliency, and service-level guarantees.

Multi-layer Planning

46

Provides coordinated, multilayer management and control for a globally optimized network

SDN controller will program the path and its associated features onto target network.

Packet network controller - supports standard protocols (e.g. PCEP, BGP-LS, Netconf/YANG, etc.)

Transport network controller – supports standard protocols (e.g, OpenFlow, Netconf/YANG, etc.)

Supports an open, standardized controller to controller interface to provide ‘Abstract’ Topology Exchange.

SDN Controller



47

The physically integrated DWDM interface architecture consists of having the DWDM colored interface directly within the packet node.

A lambda Label Switched Path (LSP) is established as tunnel between the packet nodes. The tunnel provides connectivity between packet nodes. The packet nodes can run IGP adjacencies over the tunnels and treating the tunnels as links in the packet network.

Control Plane Integration

Label Switched Path on L0


48

RFC 4208 discusses how GMPLS signaling based on RFC 3473 can be applied in an overlay model.

In traffic engineered (TE) systems, it is desirable to establish an end-to-end TE path with a set of constraints (such as bandwidth, delay, shared risk) from source to destination.

A lambda LSP is established by sending a PATH/Label Request message from packet node to the destination. The DWDM network element (downstream node) will send back a Resv/Label Mapping message.

Lambda LSP Request: LSP Encoding Type: Lambda Switching Type: Lambda-Switch Capable Generalized Label Format: Section 3.2/RFC 6205 (G.694.1 frequency grid) Bandwidth: 100G

GMPLS Protocol

o

GMPLS RSVP PATH GMPLS RSVP PATH

Head initiates tunnel

signalling

Packet Node (Head)

Packet Node (Tail)

Tunnel established

GMPLS RSVP RESV (Label = lambda)

GMPLS RSVP RESV (Label = lambda)

Tunnel established Dynamic Optical

GMPLS Control Plane

UNI UNI

GMPLS Lambda LSP Setup

49

DWDM Integration – Management Plane

50

Manually via Command Line Interface

Provisioning

51


Netconf/YANG based solution may be utilized

Provisioning

52



If a control plane solution is used, GMPLS via RSVP

Provisioning

53



If a control plane solution is used, GMPLS via RSVP

If SDN is used, the orchestrator can communicate with the individual SDN controllers of the optical and packet domain

Provisioning

54

SDN Controller(s) Orchestrator

Reduced Cost and

Complexity

NETCONF Manager

OSS NMS EMS

• Transactions • Standard models

• Standardized Protocol

Network Management Goals

55

SNMP NETCONF Standard IETF IETF Resources OIDs Paths

Data models Standard MIBs Standard YANG Modules

Data Modeling Language SMI YANG

Management Operations SNMP NETCONF

Wire Encoding BER XML

Transport Stack UDP SSH TLS TCP

SNMP vs NETCONF

56

57

NETCONF (RFC 6241) provides remote procedure calls and notifications.

YANG is a data modeling language used to model configuration and state data manipulated by NETCONF

Generates XML-based configurations, informational data, network operations, alarms and error state notifications.

Hierarchical & Modular.

NETCONF and YANG modeling

NETCONF Manager

NETCONF

Yang Models

YANG Modules YANG

Modules

YANG Modules

YANG Modules

Management Applications

DWDM Integration fully separated model

58

Optical Network



Physically Separated Model Reference Model

Colored Interface

Colored Interface


59

Interface between Packet Node and DWDM Network Element

60

Packet Node

Tx

Rx Tx

Rx

IEEE 802.3 Ethernet

OR

ITU-T G.959.1 White/Gray OTN

Colored Interface


Ethernet Connection between Packet Node and DWDM Network Element

61

Ethernet Frame Packet Node

Tx

Rx Tx

Rx

Colored Interface


Defined by IEEE 802.3 for 10G, 40G, 100G rates

OTN Connection between Packet Node and DWDM Network Element

62

OTN Frame Packet Node

Tx

Rx Tx

Rx

Colored Interface


Defined by G.959.1 OTU2, OTU3, OTU4

Management Plane and OAM The packet network and DWDM network often have separate:

– Management, Operational Procedures, OAM handling

Requires coordination between the two management systems. – SDN technology can be deployed for the integrated management

plane.

OAM handling

– One example for integrated OAM scheme: Ingress/egress DWDM network element to map between 10/40/100G

Ethernet link fault signals and stream of 66 blocks per G.709/Y.1331

63

DWDM Integration - Standards

64

Broadband Forum drives the Industry Adoption by Interoperable Solutions

65

Working in partnership with SDOs Active liaisonship with ITU-T and IETF

IETF - Common Control and Measurement Plane (CCAMP): Control Plane, Management Information Bases (MIB)

ITU-T SG15 Optical transport standards

BBF: defines how to apply technologies in broadband networks to allow interoperability & multi-services support

http://www.itu.int/

Standards Adaption

66

Transport Networks Layer 1/0 interoperability

Client Interfaces Layer 2/1 interoperability

Control Plane, MIB, Netconf, YANG

Client Interfaces Layer 2/1 interoperability

ITU-T SG 15 Q6 – Revision of G.698.2 “black link” to support multi-vendor interoperability for

40G and 100G – Develop enhanced Forward Error Correction (FEC) for 100G – Develop new Recommendation G.metro for multi-vendor interoperability for

low-cost metro application

IETF – CCAMP Working Group – An SNMP MIB extension to RFC3591 to manage optical interface parameters

of DWDM applications (draft-galikunze-ccamp-g-698-2-snmp-mib-08) – Extension to the Link Management Protocol (LMP/DWDM -rfc4209) for

DWDM Optical Line Systems to manage application code of optical interface parameters in DWDM application (draft-dharinigert-ccamp-g-698-2-lmp-07)

– GMPLS extensions to support TE reachability (draft-farrel-interconnected-te-info-exchange-06.txt)

Standards Adaption

67

IP AND OPTICAL INTEGRATION USE CASES

68

Use cases

69

Metro (A.4 Edge and Agg router connect) Cloud Centric Access and Aggregation IP Core Data Center Interconnect

Metro and Aggregation

70

DWDM between Aggregation and Edge Routers

Increase resiliency with optical dynamic control plane

Can also be used for mobile backhaul

Cloud Centric Access and Aggregation

71

Connect to data center in cloud centric network Coherent detection can enable only use of

couplers/splitters in some scenarios

OA

DataCenter(s)

Coupler/Splitter

OD/OMOA

OA

Coupler/Splitter

OD/OMOA

Coupler/Splitter

OD/OMOA

Coupler/Splitter

OD/OMOA

AccessNetwork

DWDMAggregation Network

IP Core

72

Connect Core P/PE Routers together over transport DWDM network

Simple High Speed connectivity and eliminate unnecessary layers and conversions in network

Data Center Interconnect

73

High Speed connectivity

Reduce layers and OEO conversions

Used for mirroring, backup, load balancing, mobility, or data center access

SUMMARY

74

Key Takeaways… IP Traffic Increasing

– Even more-so in the Metro

Coherent 100G will dominate transport

Using DWDM Interfaces can decrease expenses while streamlining services and provide OAM

Multilayer control planes add network automation that can result in lower TCO

Models: – Physically or logically integrated – Separated

Many use cases

For more information, visit us at http://www.broadband-forum.org

Thank you for attending the Building Converged IP and Optical

Transport Networks Tutorial The Broadband Forum is a non-profit corporation organized to create guidelines for broadband network system development and deployment. This Broadband Forum educational presentation has been approved by members of the Forum. This Broadband Forum educational presentation is not binding on the Broadband Forum, any of its members, or any developer or service provider. This Broadband Forum educational presentation is subject to change, but only with approval of members of the Forum. This educational presentation is copyrighted by the Broadband Forum, and all rights are reserved. Portions of this educational presentation may be copyrighted by Broadband Forum members or external sources.

http://www.broadband-forum.org/


Heavy Reading - Metro Packet Optical Transport 2.0: A Heavy Reading Survey Analysis

Infonetics Research, now part of IHS Inc: “OTN, MPLS, and Control Plane Strategies:

Global Service Provider Survey”, May 2013.

References

77

http://www.heavyreading.com/details.asp?sku_id=2988&skuitem_itemid=1477&promo_code=&aff_code=&next_url=/search.asp?

http://www.heavyreading.com/details.asp?sku_id=2988&skuitem_itemid=1477&promo_code=&aff_code=&next_url=/search.asp?

78

Related Standards Organizations and Consortiums

Broadband Forum: http://www.broadband-forum.org

IETF: http://www.ietf.org

ITU-T: http://www.itu.int/itu-t


http://www.ietf.org/

http://www.itu.int/itu-t

Abbreviations

79

BGP-LS Border Gateway Protocol Link State

CAPEX Capital Expenditures

DCU Dispersion Compensating Unit

DP-QPSK Dual Polarization – Quadrature Phase Shift Keying

DSP Digital Signal Processor

DWDM Dense Wavelength Division Multiplexing

EMS Element Management System

FEC Forward Error Correction

GMPLS Generalized Multiprotocol Label Switching

LMP Link Management Protocol

LSP Link State Protocol

MIB Management Information Base

NMS Network Management System

DCU Dispersion Compensating Unit

ODU Optical Data Unit

OFDM Orthogonal Frequency Division Multiplexing

OPEX Operating Expenses

OPU Optical Payload Unit

OSNR Optical Signal to Noise Ratio

OSS Operations Support System

OTN Optical Transport Network

OTU Optical Transport Unit

PCEP Path Computation Element Communication Protocol

PMD Polarization Mode Dispersion

QAM Quadrature Amplitude Modulation

Abbreviations

80

ROADM Reconfigurable Optical Add Drop Multiplexer

RSVP Resource Reservation Protocol

SDN Software Defined Networks

SNMP Simple Network Management Protocol

SRLG Shared Risk Link Group

TXP Transponder

UNI User-Network Interface

81

The Broadband Forum

Thank You

Documents

Day0 01 Building Converged IP