1

CISCO CONNECT 2014

DATACENTER POWER SESSION: UNIFYING THE DATACENTER

George Boulescu, Consulting Systems Engineer, DC&V

gboulesc@cisco.com

15/05/2014

© 2013 Cisco and/or its affiliates. All rights reserved. 2

Impact of Virtualization on Network Complexity

2

“increased OpEx is

attributed to network

optimization to VM’s to

deliver application

SLA’s” Source: Zeus kerravala ZK

Research

“Customers often over-

provision the network to

address the complexity

further increasing

CapEx spend!” Source: Zeus Kerravala. ZK

Research

0

50

100

150

200

250

300

96 98 00 02 04 06 08 10 12

Power & Cooling Expense Virtual Servers - Mgnt & Admin Standalone Servers - Mgnt & Admin Server Spending

Server-Related Spend

(Capex+Opex)

Custo

me

r S

pe

nd

ing

$B

Source: IDC, 2011 “New Economic Model for the Datacenter”

2014 2006 2008 2010 2012

In the past 5 years, VM proliferation has

resulted in driving DC costs up

VM densities will increase 25% from

2010 to 2015

Rapid rise in VMs and mobility is forcing

customers to rethink infrastructure

requirements

And the trend is projected to continue

© 2013 Cisco and/or its affiliates. All rights reserved. 3

SERVER-RELATED SPEND (CAPEX+OPEX) WW Spending on Servers, Power & Cooling,and Mgmt. / Administration

OVERALL SPEND DISTRIBUTION

29%

22% 12%

11%

10%

7%

7% 2%

People Software

Energy / Facilities Servers

Networking Storage

Disaster Recovery Overhead

Source: Gartner—Cisco IT, “Data Center Cost Portfolio” Source: IDC, “New Economic Model for the Datacenter”

$0

$50

$100

$150

$200

$250

$300

199619971998199920002001200220032004200520062007200820092010201120122013

Power & Cooling Expense

Mgmt. & Administration—Virtual Servers Mgmt. & Administration—Standalone Servers Server Spending

High

OPEX

IDC, 2011

Cu

sto

me

r S

pen

din

g (

$B

)

© 2013 Cisco and/or its affiliates. All rights reserved. 4

Albert Einstein

© 2013 Cisco and/or its affiliates. All rights reserved. 5

1950’s Business Focus

Products, offerings

Customer service

Competitive Edge

Employee productivity

Bottom Line

Todays Business Focus

Products, offerings

Customer service

Competitive Edge

Employee productivity

Bottom Line Supporting Infrastructure

Same Questions Different Answers

© 2013 Cisco and/or its affiliates. All rights reserved. 6

Cloud

Physical

Virtual Unified

Data Center

Compute

Network

Security Storage

Mgm’t

IT Simplicity

Financial Efficiency

Business Agility

O P E N R E S I L I E N T S E C U R E S C A L A B L E

© 2013 Cisco and/or its affiliates. All rights reserved. 7

Cisco’s Cloud Strategy: Evolutionary Adoption

Federation / Workload Portability / Interoperability / Security

Internal Cloud

Public Cloud

Private Cloud

Public Cloud

Virtual Private Cloud

Open Cloud

Inter-Cloud

Public Cloud #1 Public Cloud #2

Inter-Cloud

Phase 1 Phase 2 Phase 3

© 2013 Cisco and/or its affiliates. All rights reserved. 8

Distributed

• Manual Provisioning

• Limited scaling

• Rack-wide VM mobility

Fabric Based

Cloud

• Policy-based Provisioning

• Scale Physical and Virtual/Cloud

• DC-wide/Cross-DC VM Mobility

Compute Compute Storage Storage Services Services

L2,

L3

Fabric

Cloud

Application Driven

• Service-centric Provisioning

• Flexible – Anywhere, Anytime

• Cross-cloud VM Mobility

Compute Compute Storage Storage Services Services

L2,

L3

Programmable Provisionable

Monitoring Apps

Provisioning Apps

Networking Apps

End-

User

Apps

Integrated Fabric and Cloud

World of Many Clouds

Predictive, Adaptive, Nimble

© 2013 Cisco and/or its affiliates. All rights reserved. 9

Fabric

App App App App

Integrated Intelligent Infrastructure

Fabric-Based Architecture Appliance Architectures

App

Specialized Infrastructure

App App App

App

Management Software

App App App

Commodity Server, Network and Security

Virtual Overlay Architecture Legacy Architectures

Operational Flexibility, Scalability Applic

ation,

Capacity,

Th

roughp

ut

and P

erf

orm

ance

• Distributed Control

Plane

• Decupling the 2

protocols that

• Enhanced Forwarding

• Any vm to any vm will

take the optimum hop

© 2013 Cisco and/or its affiliates. All rights reserved. 10

• With ACI, humans can make policy errors, but they can no longer make configuration errors

• Increase accuracy and consistency of provisioning and maintenance

• Policy changes are easily made, centrally

© 2013 Cisco and/or its affiliates. All rights reserved. 11

12

WHAT’S COMING ?

APPLICATION-CENTRIC INFRASTRUCTURE

APPLICATION POLICY INFRASTRUCTURE

CONTROLLER

APIC

OPEN STANDARDS OPEN SOURCE

NEXUS 9000 SERIES

INDUSTRY LEADING ECOSYSTEM

CHANGE

13

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

06 07 08 09 10 11 12 13

Datacenter Spending (%) Over Time

Server Spending Standalone Servers - Mgnt & Admin Virtual Servers - Mgnt & Admin Power & Cooling Expense

Source: IDC, 2011 “New Economic Model for the Datacenter”

“Increased OpEx is attributed

to network optimization to

VM’s to deliver application

SLA’s”

Source: ZK Research

Operating expenses

represent over 80%

of DC spending

Network optimization

for virtual servers is

driving OpEx spending

KEY DRIVER FOR ACI - MODERN DATA CENTERS DEMAND AGILE NETWORKING

14

$6.4 $5.9 $6.6

$6.5 $6.1

$5.6

$0.7 $1.9

$3.1 $3.7 $4.0

$4.0

$0.5

$0.8 $1.2 $2.1 $3.3

$0.3

$0.4 $0.5

$0.6 $0.6

$8.7

$9.7

$11.6

$12.4 $12.9

$13.6

2013 2014 2015 2016 2017 2018

100 Mbps 1000 Mbps 10 Gbps 40 Gbps 100 Gbps Software

Source:

Dell ‘Oro LAN Switching by Vertical Report, Feb, 2014

Dell ‘Oro Server quarterly report – Oct, 2013

Transitions Drive Data Center

Switching Growth

Data center switching ASP

• GE →10GE Server-Access

• 10GE → 40GE → 100GE

Aggregation Transition

• Invest protection of cabling – 40G

BiDi Optics

Software migration to ACI for lower

TCO and OpEx

Marketplace Inflection ACI + Transition from 1G to 1/10G & 10G to 40G/100G

15

DC

PODs

DC Core

Existing 3-TIER DESIGNS PROGRAMMABLE SDN OVERLAY MODEL

APIC

APPLICATION CENTRIC INFRASTRUCTURE

Open API - Programmability

Modernized Operating System

Nexus OS

Network Virtualization Application Centric Infrastructure

VXLAN Bridging & Routing

OpenFlow Support

No VM Tax – Any Hypervisor

Physical & Virtual

Open API’s & Controller

CLOUD DEPLOYMENTS - TOPOLOGIES FOR PHYSICAL & VIRTUAL

EMBRACING SDN AND MOVING BEYOND WITH ACI

Existing 2-Tier & 3-Tier Designs

16

OPEN RESTFUL APIS

CENTRALIZED POLICY MODEL

OPEN SOURCE

CONTROLLER

APIC

APPLICATION CENTRIC INFRASTRUCTURE COMPONENTS OPEN API’S, COMPLETE AUTOMATION, AND APPLICATION FOCUSED

POLICY MODEL

ACI

NEXUS 9500 and 9300

17

SPOTLIGHT ON THREE GAME-CHANGING DIFFERENTIATORS

APPLICATION-CENTRIC

POLICY MODEL PHYSICAL + VIRTUAL OPEN AND SECURE

• Operationally Simple

• Lowest TCO

• Zero-touch provisioning

• Health Metrics

• Visibility / Telemetry

• Troubleshooting

• Open APIs / Open Source

• Advanced Security

• 3rd Party Integration

1 2 3

18

DB APP ADC

WEB F/W

ADC

Physical Networking

L4–L7 Services

Multi DC WAN and Cloud

Compute Storage Hypervisors and Virtual Networking

APIC

#1 – APPLICATION CENTRIC POLICY MODEL

19

APP MOBILITY APP VISIBILITY

Latency

Health

Score

Isolation

Systems

Telemetry 25 Packets

dropped

#2: AGILITY—PHYSICAL, VIRTUAL AND CLOUD

Latency

Health

Score

Isolation

Systems

Telemetry 0 Packets

dropped

Tenant Application

20

#3: OPEN (AND SECURE!) FROM GROUND UP

OPEN SOURCE

OPEN STANDARDS

OPEN INTERFACES

OpFlex NSH VXLAN

JSON XML

WITH ADVANCED SECURITY

Auditing

Policy

RBAC

Encryption

Tenant Isolation

+

OpFlex REST

21 21

Switch architecture has

stabilized to the point where it

is no longer possible to drive

significant feature

differentiation at the silicon

level, March 27th, 2009 *

*http://www.aristanetworks.com/en/blogs/?p=85

Application Centric Infrastructure Merchant+

Merchant+

28 Nanometer ASIC 40 Nanometer ASIC

“Everything that can be

invented has been

invented" -- US Patent Office

commissioner, 1800's

• Scale - Penalty Free Caching,

Sharding for v4/v6, Encapsulation

Normalization

• Efficiency - Dynamic LB & Flow

Prioritization

• Telemetry - Atomic Counters,

Latency Metrics

• Optimization – Service Insertion,

Flood Elimination

• Application Policy - Line Rate

Policy Enforcement

• Extended Buffering

• 1/10/40G MAC

• Port Density

• Layer 2 & Layer 3

Forwarding

• Buffering

• Port Counters

22

CISCO: INNOVATION AND COST-OPTIMIZED DESIGN

Nexus 9500 Arista 7500

Traditional Merchant Only

Innovative Merchant Plus

No Backplane Connectors to

Upgrade for High Density 100G

3,500 components

per line card

Replace Backplane Connectors

for High Density 100G

13,000 components

per line card

55,996 Hours

System MTBF* 19,981 Hours

System MTBF* 2.8 X

23

Trunk Cabling

(100m)

Patch

panel

Jumper

Cable

10G Optical Link

Patch

panel

Jumper

Cable

40G BIDI OPTICS PRESERVE EXISTING 10G CABLING SIGNIFICANT TRANSCEIVER SAVINGS

$4,059 SAVINGS (LIST)

PER 40G LINK

Traditional 40G Optical Link—Complete Replacement

40G BiDi Optical Link—Reuse all 10G Cabling/Patch Panels +$2,200*

Source: Corning OM3 Cable & Patch Panel list prices, Cisco 40G BiDi list price, Competitors 40G SR4 list price

+$6,259*

24

SYSTEMS TELEMETRY

ACI: RAPID DEPLOYMENT OF APPLICATIONS ONTO NETWORKS WITH SCALE, SECURITY AND FULL VISIBILITY

ENABLED BY PHYSICAL AND VIRTUAL INTEGRATION

TENANT HEALTH SCORE

LATENCY

VISIBILITY

VMs

Physical

Application Delivery Controller

Firewall

Microsecond(s) 3

35

2

Packet Drops

0

SYSTEMS TELEMETRY

APPLICATION HEALTH SCORE

LATENCY

VISIBILITY

VMs

Physical

Application Delivery Controller

Firewall

Microsecond(s) 5

16

8

Packet Drops

25

25

100 150 200 250 300

ACI

Traditional Network

Time (s)

Case Study – Big Data Analytics

Based on common network load and link failure scenarios

INNOVATION DRIVING APPLICATION PERFORMANCE

Congestion Management

60% 60%

90%

Network Innovations

Dynamic Load Balancing

Dynamic Packet Prioritization

30% reduction

in application

completion time

Network Utilization

26

AGILITY: ANY APPLICATION, ANYWHERE—PHYSICAL AND VIRTUAL COMMON APPLICATION NETWORK PROFILE

ADC APP DB F/W

ADC WEB

APIC

HYPERVISOR HYPERVISOR HYPERVISOR

27

CISCO LEADS THE INDUSTRY IN TCO, OPEN, & RICH SUPPORT

ACI vs. SDN

75% Total Cost of

Ownership Savings

NETWORK

VIRTUALIZATION +

MERCHANT

SWITCHES

$40 OpEx*

$100

VM Tax

$14 Network

$25 OpEx

$15 Network

$154

$40

APP

CENTRIC

CISCO

• SW Only SDN Stops Here

• ACI = Apps.+Network+Security

• Open Source, API’s, & Open Stack

• ACI Extends to Enterprise & WAN

• VMTax is VMware NSX

• $14 cost is White box

CapEx

27%

OpEx

73%

Before ACI

ACI Network OpEx

35% OpEx savings

with ACI

28

NEW NEXUS 9000 PLATFORMS NEXUS 9000 MOMENTUM

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

15%

7%

26%

19%

13%

20% Other

APJC

EMEAR

US Commercial

US SP

US Enterprise

PIPELINE >800 CUSTOMERS

CUSTOMERS ACROSS DIFFERENT

SEGMENTS

RAPID CHANNEL PARTNER SCALE

ACI ECOSYSTEM UPDATE

NEW PARTNERS

APPLICTION CENTRIC INFRASTRUCTURE RELEVANCE AND IMPACT

Application Centric Infrastructure

New

9516 and 9504

APIC

29

Cisco Systems Nexus 9516 - Data Center Winner

Data Center Finalists

Arista Networks – Arista 7300x 10/40Gbe Data Center Switch and EOS

Cisco – Cisco Nexus 9516 Switch

Stratus Technologies – Stratus everRun Enterprise

Cisco Systems

Nexus 9516

THE INDUSTRY IS LISTENING

PERFORMANCE

VERIFIED

30

There is A LOT Going On!

• The Next Stop Is ACI

• Hardware

• NXOS

• Fabric

• Layer 4 – 7

• Virtualization

• Open Orchestration

NEXUS 9000 & APPLICTION CENTRIC INFRASTRUCTURE ROBUST ROADMAP

APIC

Nexus 9000 &

Application Centric Infrastructure

9300

9508

9516

9504

NXOS & Fabric

31

ENABLING SWITCHES, VIRTUAL SWITCHES AND SERVICES

TO INTEGRATE WITH CISCO ACI

OPEN ARCHITECTURE PLAYING A PIVOTAL ROLE

DATA CENTER

INTERCONNECT

APIC MULTI VENDOR

HYPERVISOR

OPFLEX

PROTOCOL +

ECOSYSTEM

OPEN SOURCE Open source implementation

available to anyone

OPFLEX

STANDARD Upcoming Opflex

standard through IETF

ECOSYSTEM Broad, growing

vendor support

including hypervisor,

network, and L4-7

32

APIC & OPFLEX DRIVES INNOVATION & SCALE OVER OVSDB

VMWARE / NSX MODEL

OVSDB

Policy Manager + Control Plane

DATA PLANE

CENTRALIZED

INTELLIGENCE

?

X

SDN

CONTROLLER

IMPERATIVE CONTROL

Makes Everything look like Open vSwitch

SDN LAN Emulation Model

Centralized Control - Bottleneck

Limited Innovation / Lowest Common Denominator

ACI MODEL

APIC

CONTROL + DATA PLANE

ADC FIREWALL HYPERVISOR

SWITCH

Policy Manager INTELLIGENCE

DEPLOYED AT

EVERY STAGE

OF THE NETWORK

WEB

APP

DB

OPFLEX

DECLARATIVE CONTROL

Supports all Devices – DC, Campus, WAN

Application & Policy Based Model

Distributed Control - Scale

Enables Vendor Innovation

33 © 2013-2014 Cisco and/or its affiliates. All rights reserved.

OPEN

Controllers,

OPEN Protocols

& OPEN API’s

Hypervisor &

Southbound

Device Integration

APIC

Nexus 9000

NXOS

Fabric OS

Bare

Metal

Open

Layer 4-7

WAN

& MPLS

NSX for vSphere

Cisco Systems

Advantage

No 3rd Party

Controllers

No Open

Flow

3rd Party

Hardware

Layer 4-7

Virtual Closed

OVSDB

Open API’s & Data Model

APIC – Policy Controller -

Not SDN LANE > scale

Secure Open Device

Packages for L4-L7

No VM Tax

Nexus 1000v

Widest device support

Broad Partner Ecosystem

DC, Campus & WAN

Published Model for Any

Device

OpFlex

VMWARE SDN: LAN EMULATION

34

DRIVING FEATURES AND POLICY BACK INTO INFRASTRUCTURE

NEXUS 1000v / HYPER-V KVM CEN KVM

Interfaces on the Hypevisor:

Data (probably 2 for redundancy

VMotion / Live Migration

Management

The Data Interfaces are the

only part of the SDN Story

What About The Other

Interfaces?

Application Centric Infrastructure

Moving from interfaces and networks to services

• DNS & DHCP

• VMotion / Live Migration

• Management

• Controllers

• Layer 2 Adjacency

35

ENABLING ACI – CLOUD-BASED POLICY & AUTOMATION

Network Storage Compute /

Virtualization Security

• Start Simple – EPG as a VLAN • ACI Evolves With The Application

CONNECTIVITY • STORAGE

• COMPUTE

• WAN

• ACCESS

SECURITY QOS FINE-GRAINED

APPLICATION

APPLICATION

L4-L7

SERVICES FUTURE

37

USE CASE – ENTERPRISE – L2, L3 , & OVERLAY NETWORKS

Technology

• Nexus 9300 and 9500

• VXLAN Bridging and Routing

• Layer 2 tunnels moving over Layer 3

Benefits

• Workload mobility – Any workload any where

• Simplify the physical topology – All Layer 3

• Scaling over existing VLAN model

• Programmability & Migration to ACI

Layer 2 & Layer 3 / VXLAN

38

USE CASE – ACI CLOUD HOSTING

Technology

• Cloud Stack

• Xen Servers

• Xen OVS

• Nexus 9508 and Nexus 9300

Multi-Tenant Overlay with Per Hop

Visibility

• 1000 of Tenants Per Leaf

Layer 2 Services

• Layer 2 and Layer 3 to traditional

switching and routing

Benefits

• 100% automation of tenant overlays

and networks

• Integration with CloudStack and

Existing networks

• ACI scale eliminates hypervisor

overlay

APIC APIC APIC

XEN Servers XEN Servers

Orchestration

Servers

leaf 1

N93128 leaf 2

N93128

leaf 3

N93128

leaf 4

N93128

leaf 5

N9396 leaf 6

N9396

Nexus

9500

UCS

VM’s &

Servers

May 2014

Production Target

39

EXTENDING POLICY ACROSS DC, WAN, AND ACCESS

APIC-

DC

Data Center

APIC-

DC

Data Center WAN

Service Provider

NFV

VPN

Cloud

APIC-

WAN

Access

APIC-

EM

Access

APIC-

EM

End-to-End

APIC

API

Unified Policy API

Across APIC Platform

Network Orchestration

40

HETEROGENEOUS HYPERVISOR ENVIRONMENT

POLICY AT THE VIRTUAL EDGE

ACI INVESTMENT PROTECTION - VIRTUALIZATION

APIC

NEXUS 1000v / HYPER-V KVM CEN KVM

Connectivity

Security

QoS

L4-7 Services

APPLICATION

NETWORK PROFILE

41

Leverage existing services, automate and provide improved visibility

L4..7 SERVICES - INVESTMENT PROTECTION

APIC

FIREWALL

ADC

IDS, IPS,

ETC.

NETSCALER

BIG-IP

ASA

42

Remote 9300 ToR

ACI - INVESTMENT PROTECTION FOR CUSTOMERS NEXUS INTEGRATION OVER EXISTING ENVIRONMENT

APIC Nexus 7000

43

CLOUD AUTOMATION WITH CISCO ACI

APIC

STORAGE L4-7 SERVICES VIRTUALIZATION COMPUTE

UCS Director

SINGLE PANE OF

MANAGEMENT FOR HYBRID

CLOUD

END-TO-END AUTOMATION OF

APPLICATION AND

LIFECYCLE MANAGEMENT

AUTOMATED PROVISIONING

OF COMPUTE, NETWORK,

STORAGE

SUPPORT FOR CONVERGED

INFRASTRUCTURE

45

10-20% Compute and

Storage

Optimization

58%

Reduce

Network

Provisioning

21%

Reduce

Management

Costs

45%

Reduce Power

and Cooling

Costs

25%

CAPEX

Reduction

“Cisco’s open standards approach

makes ACI even stronger. We

conducted testing on ACI … it fully

delivered everything we expected, and

proved to be quite stable and mature.” Nik Weidenbacher

Principal Engineer, SunGard

“Cisco ACI is an open, future-proofed

data center architecture that can

continue to grow as we enhance client

services.” Chuck Crane

Network and Security Architect, Axciom

“This will enable Telstra to deliver

service agility, security and performance

that our customers expect from an

enterprise grade cloud.” Erez Yarkoni

Executive Director, Telstra

Greater

Business Agility

Lower Capital

Expenses

Reduced Costs/

Complexity

Lower Operating

Cost

Resource

Optimization

NEXUS 9000 AND ACI DELIVERING BUSINESS OUTCOMES

46

THANK YOU