34
Architecting the Network Part 3 Geoff Huston Chief Scientist, Internet Telstra ISOC Workshop ISOC Workshop

Architecting the Network

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Architecting the Network

Architecting the Network

Part 3

Geoff HustonChief Scientist, Internet

Telstra

ISOC WorkshopISOC Workshop

Page 2: Architecting the Network

Network Peer Interface

Page 3: Architecting the Network

Network Peer Interface

Who is my peer?Differentiating between:

client network (they pay me!)service provider network (I pay them!)peer network (we pay each other!)

There are no Internet mechanisms to objectively determine who is a peer network!

Page 4: Architecting the Network

Network Peer Interface

Where do I peer?Onshore 1:1Onshore at a layer 2 exchangeOffshore via Service ProviderOffshore at a layer 2 exchange

Page 5: Architecting the Network

Network Peer Interface

Routing ConsiderationsExport routes via BGP4 using CIDRImport routes using whatever works easily!

Operational ConsiderationsMinimise bandwidth used by routingmaximise operational stability

Page 6: Architecting the Network

Network Route Management

Obtain registered Autonomous System number (AS)

from your Regional Registry

Generate aggregate mask which covers all announced networksAnnounce CIDR aggregate to peer via BGP4 session

Page 7: Architecting the Network

Single Exterior Peer

Announce local nets via CIDR aggregate using BGP4Synthesise static default route directed to exterior peer gateway

default routeCIDR Aggregate

statically configured in exterior gateway

Page 8: Architecting the Network

Multiple Exterior Peers

Externally Imposed Policy differentiationFor example:

Academic & Research peer external networkCommercial peer external network

Routing is Destination address-based - not source addressDefault route based on best policy matchExplicit routes are imported from other network peersTraffic path based on destination net - not local source policy

Page 9: Architecting the Network

Multiple Exterior Peers

multi-defaultroutes

Explicitroutesimportedvia BGP4

Policy Matched CIDRAggregate announcementstatically configured inexterior gateways

Page 10: Architecting the Network

Multiple Exterior Peers

Transit ArrangementImportation of transiting AS network numbersAnnouncement of transiting networks via AS path mechanism

Page 11: Architecting the Network

Exterior Peering

Importing a default route is cost effective and highly efficient as long as there is a suitable policy and capability match with the peerDefault-less routing is expensive, time-consuming, and can be unstableDefault-less routing allows greater levels of self-determination of policy - with an operational cost

Page 12: Architecting the Network

Exterior Peering

Use a simple model initially:Single exterior peerDerived default routeAnnounce CIDR aggregate to peer

Page 13: Architecting the Network

Network Infrastructure

Page 14: Architecting the Network

Network Infrastructure

Bandwidth is a coarse control tool

0

10

20

30

40

50

60

70

80

Effective Data Throughput under TCP Load

RTT failure

RetransmissionPeak Efficiencylink load

Page 15: Architecting the Network

Network Infrastructure

Engineer capacity for peak demand periodsUnderstand end-to-end flow patternsAttempt to avoid sustained (> 15 minutes) acute congestion on any linkConstantly monitor bandwidth utilisation and flow patternsGenerate trend patterns and plan accordingly

Page 16: Architecting the Network

Network Infrastructure

Page 17: Architecting the Network

Network Infrastructure

Communications technology choices:Dedicated Facilities

point to point leased circuitpoint to point radio

Common Switched FacilitiesX.25Frame RelaySMDS access ATM

Page 18: Architecting the Network

Network Infrastructure

Leased circuit designPerformanceReliability(In)FlexibilityCost

Page 19: Architecting the Network

Network Design

Page 20: Architecting the Network

Network Infrastructure

Hierarchy (Star) Topology+ Minimal Cost+ Simple Topology+ Maximal efficiency- Critical points of failure

Page 21: Architecting the Network

Star Topology

Perth

Hobart

Brisbane

SydneyCanberra

Melbourne

AdelaideUS

Darwin

Page 22: Architecting the Network

Network Design

Darwin

Brisbane

Sydney

Canbe rra

Hobart

Ade laide

Perth

Melbourne

128K ISDN

2Mbps Megalink

2Mbps Megalink

256K ISDN

2M2M

2M1.5M Cable

US Internet

Within each State a hub configuration provides a connection point for all local sites.

The Australian Academic and Research Network Trunk Configuration - September 1993

Page 23: Architecting the Network

Network Infrastructure

Mesh Topology+ Resiliency against link or site failure- Higher communications lease cost

Page 24: Architecting the Network

Mesh Topology

Perth

Hobart

Brisbane

SydneyCanberra

Melbourne

Adelaide

US

Darwin

Page 25: Architecting the Network

Network Design

Page 26: Architecting the Network

Network Design34Mb

45Mb

155Mb

155Mb

250Mb

155Mb

Telstra InternetJun 2000

300Mb

300Mb

45Mb

400Mb

Telstra Internet Point of Presence

to USA

Hobart

Canberra

Sydney

Brisbane

Adelaide

Darwin

Perth

to NZ

to USA20Mb

to AsianLoc’ns

to USA

155 Mb

Melbourne

600Mb

45Mb

Auckland

34Mb

Page 27: Architecting the Network

Network Infrastructure

Hybrid - Resiliency via Dial-on-DemandEstablish backup circuits using ISDN, X.25 or modemsIssue of matching backup capacity against primary capacity

Page 28: Architecting the Network

Network Infrastructure

Access to common switched servicesX.25Frame RelaySMDSATM

Page 29: Architecting the Network

Network Infrastructure

Frame and ATM issuesDelivered Service contract (and enforceability)Tariff issuesDynamic vs static virtual channelsEfficiencyCongestion behaviour

Page 30: Architecting the Network

Network Infrastructure Design

Core routers driving major internal trunk linesEdge Routers providing client connection pointAccess Routers used on client site

Page 31: Architecting the Network

Routing within the Network

Choosing an Interior Routing ProtocolRIP (V2)OSPF(E)IGRPIS-IS

Classless routing protocols are now essential for this domain

Page 32: Architecting the Network

Routing within the Network

Integrity and stability of the routing domain is essentialThe routing protocol is not used to learn new routes

authenticity of the routesecurity and integrity of the routing domain

The routing protocol is only used to promulgate the route within the network

Page 33: Architecting the Network

Routing within the Network

Use of static routes to dampen down route flapsA transition of a route (up / down) causes all routers to undertake a cache dump and rebuild the route table from received routing informationRoute Flapping can destroy network performance

Page 34: Architecting the Network

Routing within the Network

One approach – used for scaleabilityUse OSPF as a link state maintenance protocol for the internal network infrastructureUse static routes at the edge for retail customer accessUse eBGP for wholesale, peer and upstream accesssUse BGP route attributes to associate policy with the routeUse I-BGP + default to carry customer routes in the Access netUse I-BGP to carry full routes in the Core net