6500 part 2

PowerPoint Presentation

Catalyst 6500 Supervisors Supervisor 32

The Supervisor 32 is designed for deployment in the Access Layer - there are two Supervisor 32 options, one with 8 GE SFP ports and the other with 2 10GE ports on the front panel

Sup32-8GE

Sup32-10GE

Catalyst 6500 Supervisors Supervisor 32 - Some facts

Supervisor 32 Quick Facts

NO Switch Fabric

Integrated Policy Feature Card 3 (PFC3B) supporting hardware acceleration for select features

Integrated Multilayer Switch Feature Card 2a (MSFC2a) supporting two CPUs for Layer 2 and Layer 3 functionality

IPv6 unicast and multicast forwarding support in hardware

All uplinks can be active in systems with redundant Supervisors

(more information in the notes)

You can add more memory

to the Sup 2a

Catalyst 6500 Supervisors Supervisor 32 - Some facts


NO Switch Fabric

Integrated Policy Feature Card 3 (PFC3B) supporting hardware acceleration for select features

Integrated Multilayer Switch Feature Card 2a (MSFC2a) supporting two CPUs for Layer 2 and Layer 3 functionality




Catalyst 6500 Supervisors Supervisor 32 - The Elements

Both Supervisor 32 models incorporates a Multilayer Switch Feature Card 2a (MSFC2a) and the Policy Feature Card 3 (PFC3) - each of which is highlighted below

PFC3

MSFC2a

Catalyst 6500 SupervisorsSupervisor 720

The Supervisor 720 is designed for deployment in the Core and Distribution Layers of the Network There are two main options available : Sup720 with 10G uplinks and Sup720 with 1G uplinks

VS-S720-10G-3C is shown

Catalyst 6500 Supervisors

Supervisor 720 - Some Facts


Integrated 720Gbps Switch Fabric

Integrated Policy Feature Card 3 (PFC3) supporting hardware acceleration for select features

Integrated Multilayer Switch Feature Card 3 (MSFC3) supporting two CPUs for Layer 2 and Layer 3 functionality


Virtual Switching System (VSS) support with Sup720-10G models



Catalyst 6500 SupervisorsSupervisor 720 - The Elements

All Supervisor 720 models incorporates three main elements - the Multilayer Switch Feature Card 3 (MSFC3), the Policy Feature Card 3 (PFC3) and the Switch Fabric - each of which is highlighted below

Switch Fabric

PFC3

MSFC3

Catalyst 6500 SupervisorsSupervisor 2T

The Supervisor 2T is designed for deployment in the Core and Distribution Layers of the Network - it is the highest performing Supervisor option available for the Catalyst 6500 platform

VS-SUP2T-PFC4 is shown

We have 2 uplinks

3 gig ports

And USB ports

It has CMP as well

Catalyst 6500 SupervisorsSupervisor 2T - Some Facts


Integrated 2-Tbps Switch Fabric

Integrated Policy Feature Card 4 (PFC4) supporting hardware acceleration for select features

Integrated Multilayer Switch Feature Card 5 (MSFC5) supporting a single CPU for L2 and L3 functionality

Connectivity Management Processor (CMP) for improved management capability

One external compact flash slot (power controlled by IOS)



Catalyst 6500 SupervisorsSupervisor 2T - The Elements

All Supervisor 2T models incorporate three main elements - the Multilayer Switch Feature Card 5 (MSFC5), the Policy Feature Card 4 (PFC4) and the Switch Fabric - each of which is highlighted below

Switch Fabric

MSFC5

PFC4

Catalyst 6500 Supervisors MSFC and PFC in more detail

Lets look at the MSFC and PFC in more detail - what they are and what they do

Multilayer Switch Feature Card (MSFC)

Policy Feature Feature Card (PFC)

Provides Control Plane Functionality

Provides Data Plane Functionality

So what is the Control Plane and the Data Plane???

MSFC OVERVIEW

There are two parts to the processing functionality of the Switch - the Control Plane and the Data Plane

SWITCH CONTROL PLANE

SWITCH DATA PLANE

Switch Features that are processed in SOFTWARE by a CPU

There are two control planes

the Switch Processor Control Plane (SP) which processes software based Layer 2 features

the Route Processor Control Plane (RP) which processes software based Layer 3 features

Switch Features that are processed in HARDWARE by Application Specific Integrated Circuits (ASICs)

MSFC

OVERVIEW

Agenda Topics

Catalyst 6500 Supervisors MSFC3 Introduction

MSFC3

Catalyst 6500 Supervisors MSFC3 Components

Route Processor

Bootflash 64MB

Switch Processor

Bootflash 64MB

Switch Processor

Route Processor

Switch Processor DRAM

512MB

Route Processor DRAM

512MB

Catalyst 6500 Supervisors MSFC3 - Switch Processor

MSFC3

Route

Processor

(RP)

Switch

Processor

(SP)

Both the RP and SP perform distinct functions during both the booting of the operating system and the ongoing operation of the switch

- The SP owns the switch at initial boot up before handing over to the RP

The SP runs all layer 2 operations like VTP, Spanning Tree, Chassis and Power Management, etc

Supports other Layer 2 features like CDP, SPAN, Broadcast Suppression, Etherchannel, etc

The Switch Processor is physically located on the MSFC3

Logically considered as the Network Management Processor (NMP)

Dedicated CPU, DRAM and Flash

Catalyst 6500 Supervisors MSFC3 - Route Processor

MSFC3

Both the RP and SP perform distinct functions during both the booting of the operating system and the ongoing operation of the switch

The Route Processor is physically located on the MSFC

Logically considered as the MSFC

Dedicated CPU, DRAM and Flash

The RP runs the Layer 3 routing protocols like OSPF, EIGRP, BGP, etc

Other layer 3 features like IPX and Appletalk

Manages the user interface (CLI)

All show and configuration commands are processed on the RP then sent to the SP for execution

Route

Processor

(RP)

Switch

Processor

(SP)

Catalyst 6500 Supervisors MSFC3 - Bootflash

RP

SP

RP BOOTFLASH

SP BOOTFLASH

The RP and the SP both have their own set of Bootflash

SP Bootflash is used to store the boot image and is referred to as SUP-BOOTFLASH during normal operation

RP Bootflash is referred to as BOOTFLASH during normal operation

6500# dir sup-bootflash:

Directory of sup-bootflash:/

1 -rwx 78958736 May 4 2006 20:07:18 +00:00 s72033-advipservicesk9_wan-vz.122-18.SXF4.bin

512040960 bytes total(433082224 bytes free)

MSFC3

Catalyst 6500 Supervisors MSFC3 - RP and SP DRAM

MSFC3

RP

SP

RP DRAM

SP DRAM

The RP and the SP both have their own set of DRAM

RP/SP DRAM (each is 512MB) is used to store the running configuration, the running IOS image, the routing table, etc the amount of SP and RP DRAM available can be seen using the following commands

6500# show version

cisco Catalyst 6000 (R7000) processor with 458752K/65536K bytes of memory.

6500# remote command switch show version

cisco Catalyst 6000 (R7000) processor with 458752K/65536K bytes of memory.

Remot login switch :: will change to sp prompt

Catalyst 6500 Supervisor 2T MSFC5 Introduction

MSFC5

Catalyst 6500 Supervisor 2T MSFC5 Components

Catalyst 6500 Supervisor 2T MSFC5 Dual Core Processor

MSFC5

Dual Core

Processor

Handle the boot process

Run all layer 2 operations like VTP, Spanning Tree, Chassis and Power Management, etc

Support other Layer 2 features like CDP, SPAN, Broadcast Suppression, EtherChannel, etc

Run the Layer 3 routing protocols like OSPF, EIGRP, BGP, etc

Manage the user interface (CLI)

The MSFC5s Dual Core Processor combines the functionalities that used to be provided by the Switch Processor (SP) and Route Processor (RP) on previous generation Supervisors.

Catalyst 6500 Supervisor 2T MSFC5 CPU Bootflash

The presence of a single Dual Core Processor means that there is just

a single CPU bootflash on the MSFC5.

The MSFC5 Bootdisk is a 1GB Internal Compact Flash by default.

6509E-2T#dir bootdisk:

Directory of bootdisk:/

1022590976 bytes total (1022590976 bytes free)

6509E-2T#

Catalyst 6500 Supervisor 2TMSFC5 - DRAM

The Dual Core Processor of the MSFC5 has two memory sockets that are currently each loaded with a 1GB DIMM. Each DIMM serves one core in the CPU complex and is ECC protected.

6509E-2T#show version

cisco WS-C6509-E (M8572) processor with 2031616K/65536K bytes of memory.

Catalyst 6500 Supervisor 2TMSFC5 Connectivity Management Processor (CMP)

The Connectivity Management Processor (CMP) supports new capabilities that will aid Network Administrators in managing the system:

RP Image Recovery

- TFTP boot of the system

RP File Transfer

- Image on USB device or TFTP

Remote RP Reset

- Hard or Soft reset

RP Console Logging

- Record RP console log for troubleshooting

USB Support

- Booting via Cisco Approved USB flash

- USB serial console access

Catalyst 6500 Supervisors MSFC3 vs MSFC5
FeatureMSFC3 (Supervisor 720-10G)MSFC5 (Supervisor 2T)CPU SpeedSP CPU 600MhzRP CPU 600MhzDual core with each core @ 1.5GhzNumber of CPU cores12DRAMSP CPU Up to 1GBRP CPU Up to 1GB2 x 1GB (1GB for each core)Connectivity Management Processor (CMP) CPUNoSingle core @ 266Mhz32MB Boot Flash256MB System MemoryNVRAM2MB4MBOBFL FlashNo4MBBootflash / BootdiskSP CPU 1GB (CF)RP CPU 64MB (flash)1GB (CF)External CF slot11
OBFL : onboard forwarding logging

PFC OVERVIEW



SWITCH DATA PLANE






PFC

OVERVIEW

Agenda Topics

Catalyst 6500 Supervisors PFC3 Introduction

PFC3x Hardware Features Summary

IPV4 and IPV6 CEF Switching

From 256K-1M IPV4 Routes

IPV4 NAT/PAT in Hardware

GRE and IP in IP Tunnels (HW)

Ingress/Egress Policing

From 128K-500K IPV6 Routes

Port Access Control Lists

User Based Rate Limiting

Hardware based Classification

Bi-Directional PIM

Multi-path URPF

4K ACL Labels (3B/3BXL only)

ACL Counters (3B/3BXL only)

VSS (3C/3CXL only)

96K MAC Table (3C/3CXL only)

PFC3

PFC3A - Base PFC

PFC3B - Adds MPLS, 4K ACL Labels, ACL Counters, improved hash algorithm for Netflow entries

PFC3BXL - Upgrades FIB to 1M entries and Netflow table to 256K Entries

PFC3C - Adds support for VSS, 96K MAC addresses, improved hash algorithm or MAC entries, EtherChannel Enhancements

PFC3CXL - Upgrades FIB to 1M entries and Netflow table to 256K entries

Catalyst 6500 Supervisors PFC3 Components

FIB

TCAM

Adjacency

Table

QoS

ACL

Security

ACL

Netflow

TCAM

Netflow

Table

Netflow

Statistics

Counters

3B/3BXL

Layer 3/4

Forwarding

Engine

Layer 2

Forwarding

Engine

MAC

Table

Contains IPV4, IPV6 prefixes and MPLS entries

Contains Layer 2 rewrite information

Contains QoS ACL entries (up to 32K)

Contains Security ACL entries (up to 32K)

Contains location of flow in Netflow Table

Contains key packet fields for flow

Collection of statistics for each active flow

Security ACL Counters

64K CAM containing MAC addresses

To DBUS

To RBUS

To EOBC

Picture shown is for PFC3A, 3B and 3BXL. PFC3C and 3CXL have a single ASIC for L2, L3 and L4 forwarding operations.

Catalyst 6500 Supervisor 2T PFC4 Introduction

Catalyst 6500 Supervisor 2T PFC4 Introduction

PFC4 Hardware Features Summary

Increased MAC Table (128K)

Improved EtherChannel Hash

L2 Bridge Domain Support

Per-Port - Per-VLAN QoS

Increase Logical Interfaces

Increased Forwarding (60Mpps)

Improved IPv6 Tunneling

uRPF for IPv6

VPLS without a WAN card

MPLSoGRE

16K MPLS Aggregate Labels

L2oGRE

Multi-point EoMPLS

512K Multicast Routes

IGMPv3 / MLDv2 Snooping

1M Netflow Entries (PFC4XL)

Egress Netflow

Flexible Netflow (FnF)

TCP Flags

Cisco TrustSec

Roles-Based ACLs

Increased ACL TCAM (256K)

Increased ACL Labels (16K)

And more ..

PFC4 - Base PFC

PFC4XL - Upgrades FIB to 1M entries and Netflow table to 256K Entries

Catalyst 6500 Supervisors PFC4 Components

Netflow Hash Table

Layer 3

Forwarding

Engine

Adjacency Table

Layer 2 Forwarding Engine

128K MAC

Table

FIB TCAM

Adjacency Statistics

ACE Counters

Netflow Data Table

LIF Map Table

Netflow Statistics

RPF Map Table

Classification ACL

Table #2

LIF Table

LIF Statistics

Exception Table

Classification ACL

Table #1

Bus Backplane

Fabric Replication ASIC

Catalyst 6500 Supervisor 2T PFC4 Components Explained
FIB TCAMIPv4 (u/m), IPv6 (u/m) and MPLS entriesAdjacency TableEgress LIF and Rewrite Table informationAdjacency StatsStatistics for adjacency table usageException TableException Cases and Actions to take Netflow Hash TableNetflow Hash Key and Data Tabel informationNetflow Data TableDate for individual flowsNetflow StatsStatistics for individual flowsLIF Map TableIngress and Egress Logical Interface (LIF) FeaturesRPF Map TableInformation for uRPF checkClassification ACL Table 1Information for Classification Table 2Classification ACL Table 2ACL, QoS, Accounting and CPS resultsACE CountersHardware counters for ACLsLIF TableData records containing LIF informationLIF StatsPer-frame statistics for Ingress, Egress or both

Catalyst 6500 Supervisors PFC3 / PFC4 Comparison
FeaturePFC3B/BXLPFC3C/CXLPFC4/XLIPv4 ForwardingUp to 30MppsUp to 48MppsUp to 60MppsIPv6 ForwardingUp to 20MppsUp to 32MppsUp to 40MppsFIB TCAM IPv4256K / 1M256K / 1M256K / 1MFIB TCAM IPv6128K / 500K128K / 500K128K / 500KAdjacency Table1M1M1MNetflow TableUp to 256K (XL)Up to 256K (XL)Up to 1M (XL)(Ingress 512K : Egress 512K)MAC Table64K (32K)96K (80K)128KEgress NetflowNoNoYesFlexible NetflowNoNoYesMPLSoGRENoNoYesIPv6 uRPFNoNoYes

Catalyst 6500 Supervisors PFC3 / PFC4 Comparison
FeaturePFC3B/BXLPFC3C/CXLPFC4/XLACL Labels4K4K16KSecurity ACEsUp to 32KUp to 32KUp to 192K (XL Default)QoS ACEsUp to 32K Up to 32KUp to 64K (XL Default)Port ACLs2K2K8KAggregate Policers102310236KShared Microflow Policers6363512Egress Microflow PolicingNoNoYesDistributed PolicersNoNoYesPacket or Byte Based PolicingNoNoYesRPF Interfaces2216Native VPLSNoNoYesVSSNoYesYes

Catalyst 6500 Supervisors PFC3 Performance Summary

L2/L3/L4 Switching

30Mpps

ACLs

30Mpps

Netflow

30Mpps

Policing

30Mpps

Marking

30Mpps

GRE

10Mpps

NAT

20Mpps

PAT

12Mpps

IPv4 Centralized Forwarding

v6 to v6

20Mpps

v4 to v6 Tunneling

10Mpps

v6 to v4 Tunneling

10Mpps


v6 to v6

25Mpps

v6 to v4 Tunneling

16Mpps

IPv6 dCEF Forwarding

MPLS

20-30Mpps


48Mpps

25Mpps

25Mpps

dCEF (Up to)

48Mpps

48Mpps

48Mpps

48Mpps

48Mpps

Performance numbers relate to ALL the Supervisor 720 options for IPv4 and IPv6 where displayed

Catalyst 6500 Supervisors PFC4 Performance Summary

L2/L3/L4 Switching

60Mpps

ACLs

60Mpps

Netflow

60Mpps

Policing

60Mpps

Marking

60Mpps

MPLS

60Mpps

EoMPLS Imposition

60Mpps

EoMPLS Disposition

12Mpps


v6 to v6

30Mpps

v4 to v6 Tunneling

20Mpps

v6 to v4 Tunneling

20Mpps


v6 to v6

30Mpps

v6 to v4 Tunneling

20Mpps

IPv6 dCEF Forwarding

60Mpps

60Mpps

25Mpps

dCEF (Up to)

60Mpps

60Mpps

60Mpps

60Mpps

60Mpps

MPLS

30Mpps

MPLS

30Mpps

Catalyst 6500 Supervisors Marketing Performance

The Sup2T is marketed as a 2Tbps Supervisor (hence the 2T in the name) but just how is the 2Tbps number derived?

The Switch Fabric consists of 26 40Gbps fabric channels

26 x 40Gb = 1.04Tbps is the switch fabric capacity

Each Switch Fabric Channel is Full Duplex

This equates to 40G in and 40G out at the same time

Therefore we double 1.04Tbps or full duplex the number to get the marketing number of 2Tbps (we round down from 2.08Tbps)

Catalyst 6500 Supervisors Distributed Forwarding Performance

Another often quoted number is the 720Mpps forwarding number again this is a number derived from utilizing distributed forwarding cards (DFC4s) to optimize the forwarding performance of the switch

SLOT 1

SLOT 2

SLOT 3

SLOT 4

SLOT 5

SLOT 6

SLOT 7

SLOT 8

SLOT 9

Dual Channels

SLOT 10

Dual Channels

SLOT 11

Dual Channels

SLOT 12

Dual Channels

Dual Channels

SLOT 13

Using a WS-X6908 w/DFC4 yields 60Mpps






Supervisor slot yields 30Mpps

Supervisor slot yields 30Mpps






Total: 720Mpps

6513-E

Dual Channels

Dual Channels

Dual Channels

Dual Channels

Dual Channels

Dual Channels

Dual Channels

Dual Channels

SWITCH FABRIC OVERVIEW



SWITCH DATA PLANE






SWITCH FABRIC

OVERVIEW

Agenda Topics

Catalyst 6500 Supervisor 720 The 720Gb Switch Fabric

- Integrated 720Gbps Switch Fabric

- Provides backplane interconnects between linecards

- Fabric Traces are distributed across each linecard slot

- Each Fabric Trace can run at 8Gb/sec OR 20Gb/sec

Switch Fabric

Catalyst 6500 Supervisor 2T The 2Tbps Switch Fabric

Switch Fabric

Integrated 2Tbps Switch Fabric

26 Channels to support the 6513-E

- Provides backplane interconnects between linecards

- Fabric Traces are distributed across each linecard slot

- Each Fabric Trace can run at 20Gb/sec OR 40Gb/sec

Each Slots has 2 channels

Catalyst 6500 Supervisors Switch Fabric

The Supervisor 720 and Supervisor 2T support a Switch Fabric which offers each connected linecard a set of discrete communication paths into the switch backplane

Linecard

Slot #3

Linecard

Slot #4

Supervisor

Slot #5

Linecard

Slot #6

Linecard

Slot #7

Linecard

Slot #2

Linecard

Slot #1

Linecard

Slot #9

Linecard

Slot #8

Data Flows

Catalyst 6500 Supervisor 720 Switch Fabric and the 6513 / 6513-E

SWITCH

FABRIC

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

The Switch Fabric has 18 channels which are spread across the available chassis slots - The 6503/6504/6506 and 6509 each get two fabric channels per slot - but what about the 6513 and 6513-E? How do we split 18 channels across 13 slots?

Slots 1 thru 8 each get a single fabric channel

Slots 9 thru 13 each get dual fabric channels

8 x 1 = 8

5 x 2 = 10

8 + 10 = 18

Total fabric channels

Catalyst 6513 / 6513-E Fabric Channel Assignment

Catalyst 6500 Supervisor 2T Switch Fabric and the 6513-E

The Supervisor 2T Switch Fabric has 26 channels which are spread across the available chassis slots - The 6503-E / 6504-E / 6506-E, 6509-E and 6509-V-E each get two fabric channels per slot - but what about the 6513-E ?

13 x 2 = 26

Catalyst 6513-E Fabric Channel Assignment

1

3

2

4

5

7

6

8

9

11

10

12

13

14

16

15

17

18

20

19

21

22

24

23

25

26

SWITCH

FABRIC

Slots 1 thru 13 each get dual fabric channels

Catalyst 6500 Supervisors The 32Gbps Bus

The 32Gbps Classic Bus is a legacy backplane that originated with the first release of the Catalyst 6500 back in 1999.

Supervisor

DBUS

RBUS

EOBC*

Linecard

Linecard

DBUS - Data Bus - path over which data is transferred between linecards

RBUS - Results Bus - path over which results of forwarding lookups by the Supervisor are passed back to linecards

EOBC - Ethernet Out of Band Channel - path Supervisor uses for internal communication with linecards

*E-Series Chassis have a dual EOBC

Catalyst 6500 Supervisors The Backplanes

Two forwarding backplanes exist in the Catalyst 6500, the Classic BUS and the Switch Fabric

Classic BUS

Switch Fabric

Supported by Sup2T

Yes

20Gbps, 40Gbps

Supported by Sup720

Supported by Sup32

Yes

8Gbps, 20Gbps

Yes

No

Full Duplex

Yes

Yes

Linecard Connection

Single Connection

Single or Dual Channel

Backplane is Shared Medium?

Yes - All modules connect to same BUS

No - Each module has discrete connection(s)

Supports Classic Linecard

Yes

No

Supports CEF256 Linecard

Yes

Yes

Supports CEF720 Linecard

Not for data traffic

Yes

Supports Linecard with DFC

No

Yes

Additional Information

Supervisor Comparison

http://bock-bock.cisco.com/~csolder/tools/sup-comparison-v212.xls

TME Supervisor Collateral

http://bock-bock.cisco.com/wiki/CSSTG_TechMarketing:6500_Supervisors

Supervisor 720-10G FAQ (Internal)

http://bock-bock.cisco.com/wiki/CSSTG_TechMarketing:6500_Supervisors:Sup720-10G_FAQ

Supervisor 720-10G FAQ (External)

http://www.cisco.com/en/US/partner/prod/collateral/modules/ps2797/qa_cisco_virtual_switching_supervisor_engine_720_with_10_gigabit_ethernet_uplinks_ps708_Products_Q_and_A_Item.html

Supervisor 720 Data Sheet

http://www.cisco.com/en/US/partner/prod/collateral/switches/ps5718/ps9336/product_data_sheet0900aecd806ed759_ps708_Products_Data_Sheet.html

Supervisor 720-10G Data Sheet

http://www.cisco.com/en/US/partner/prod/collateral/switches/ps5718/ps9336/product_data_sheet0900aecd806ed759_ps708_Products_Data_Sheet.htm

l

Documents

6500 part 2