Network Services Benchmarking (NSB)

Xavier Simonart Nicholas Hamblin

Notices and disclaimers

Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more at www.intel.com.

Intel and the Intel logo, are trademarks of Intel Corporation in the U.S. and/or other countries.

*Other names and brands may be claimed as the property of others.

© Intel Corporation

2

Confid

en

tial

NFV Benchmarking

3

How to Benchmark and optimize NFVi & Network Services on these systems successfully today?

How to Benchmark and optimize NFVi & Network services in the future?

4

WHY NETWORK SERVICE Benchmarking?(NFV Community Driven Benchmarking)

4

General Lack of Telco Grade

Conformance/ Benchmarks

Unclear Network Workload

Dimensions and Stress Vectors

Missing System Level Capacity Requirements

Network Workload Scalability/ Agility Implications on NFV

Operators lack comprehensive information for TCO models to plan, procure and deploy NFV

NFV Ecosystem Acceleration

1

Dimension network workloads and stress vectors for different market segments

2

Deliver reference VNFs

3

Develop a common reference set of

benchmarks for VNFs

4

Contribute test suites to measure system level requirements for test

methodology and KPIs

5

Upstream/downstream adoption within open source communities

Confid

en

tial

NSB/Yardstick Benefits

5

Service Providers

✓ Easier TCO evaluation✓ ONE tool and methodology for NFVi and VNF performance evaluation✓ Reduced TTM for new services via improved onboarding process

SI✓ Easier TCO evaluation✓ ONE tool and methodology for NFVi and VNF performance evaluation✓ Reduced cost of onboarding process

ISVs OSVs

✓ Improved adoption of NFV technologies✓ Clear visibility of performance and applicability advantages

OEM ✓ Performance tweaks/BKM’s better exposed to industry

Confid

en

tial

What is NSB

No unified tool for VNF/NFVi Benchmarking

No unified methodology

Onboarding & Benchmarking process long

and effort prone

NSB is an Intel initiated Yardstick extension

helping out in automated onboarding and

characterization of NFVi’s & VNF’s under

consistent methodology

Industry Problem

What is NSB

6

One tool for three different environments

One tool to compare VNFs & NFVis

Integrated VNF, NFVi and network KPIs presentation

Scale up scenarios

Acceleration of characterization process

Solution offering

Scale up with cores and network ports

Openstack* context with SR-IOV support

Re-use of existing Openstack* VIM setup/run test cases

without destroying the VNF

New Features

Confid

en

tial

7

NSB Solution OfferingSupported VNFs

CG-NAT

ACL

Firewall

PE

SampleVNF

vRouter

Firewall

Commercial VNF

L2 FWD

L3 FWD

MPLS TAG

ACL

LB

Buffering

PROX(NFVi)

BNG

System Under TestSystem Under Test

OS, Hypervisor, Soft Switch

VNF

Instr

um

en

tatio

n

Hardware Platform

Receiver / Measurements

Receiver / Measurements

Instrumentation

Traffic GeneratorTraffic Generator

Instrumentation

Test Cases, VNFs, Test Vectors, KPIs

Control

Data collectionTREX

Pktgen

IXIA IxNetwork*

PROX

Supported Traffic Generators

8 8

NSB Program Path To Adoption

VNF Identification aligned VNF Identification aligned to Segment Business

KPI Selection

Test Case Definition

Framework Enhancements

Pilot Characterization report per Network Function

Scale out through engagements and marketing collateral

YARDSTICK

Iterative approach

to Network Function

enablement

within NSB

NSB Status

NFVi / VNF characterization Whitepapers with OSVs

Support for additional VNFs

Community contributing code to Yardstick NSB.

SPs evaluation of NSB

Agreement with key VNF Vendors on publication of Characterization Report

Support for vEPC and vCPE

Completed

In Progress

Future

✓ NFVi characterization support in framework

✓ vFW and vRouter VNF supported in framework

✓ Scale up supported in framework

✓ Agreements with OSVs, OEMs/ODMs on NFVi & VNF Characterization

✓ Service Agents onboarded (SIs)

9

Tieto, leading Nordic software & services

1968

Projects annually

Employing

3000

1.5Serving Nordic

clients since

900Around

customers

Turnover of

approximately

14 000experts globally,

in close to

20 countries

Servingcustomers in over

85

€ billion

countries

worldwide

Investments in technology

and services more than

130€ million*per year

*incl. capital expenditure and

operational costs

around

Confidentia

l

System integration with Tieto

Profit from our experience✓ Advisory consulting

✓ Evaluation, Benchmarking and Training

✓ Integration and Verification

✓ Platform, Open Source, VNF

✓ Multi Vendor integration

✓ Support & Maintenance

✓ R&D and customization services

✓ Lab capacity

11

COTS HW

NFV, SDN,Container Cloud

VNF Onboarding

Tieto experience base for NSB

Orc

he

stra

tion

Ec

os

ys

tem

What are we working on, right now…

12

NFV platform development

projects

Open source Software Defined Infrastructure

SmartNIC and FPGA

➢ Support for complex workloads (vEPC)

➢ Automated deployment of OVS-DPDK

➢ Automated scale-up and scale-out

➢ SRIOV context

➢ Sample VNFs configuration for high

performance

➢ Kubernetes support test cases

➢ Reporting

Tieto Experiences from using NSB

13

✓ Consistent Benchmarking methodology

✓ OpenSource solution

✓ Flexible workload modelling

✓ Easy to deploy

✓ Integrates Grafana

✓ Easy integration for commercial VNFs

✓ Good integration with Openstack*

Next Steps+

Tieto as Intel’s scaling partner for NSB

Initial & Extended Trainings

Enablement Integration and benchmarking

support

Full VNF & NFVi Characterization

support

VNF

NFVi

COTS HW optimization

NFVi and VNF NSB/Yardstick

Integration

Public Joint Benchmarking/Charact

erization reports

Commercial NFVi/VNF easier to onboard and benchmark by Industry

partnering Tieto with Customer

NS

B/Y

ard

stic

k N

SB

14

JOIN US

Engage with Industry projectsOPNFV*, Yardstick, Functest

Contribute to NSB withScenarios and use cases/KPIs

Test Harness development

Open Source VNFs

Need help with NSB enabling?

Engage with

16

MicroservicesHeading for Cloud Native

17

Traditional network function on proprietary infrastructure

Shift node into Virtual Machine

Cloud Native Microservices, distributed and decomposed

OS

NF

NF

OS

NF

NF

VNF

VM

VM

VNF

VM

VM

Benchmarking and installation

per node

Benchmarking of HW per nodeand VNF

MA

NO

OR

CH

ES

TR

AT

ION

Benchmarking per service or group of functions (on a Cloud or

specialized HW setup)

StatelessService Layer

Edge Region Central

Cont

VM

Cont

Cont

Network slice

Distrib. DB

Several large service providers, incl. AT&T, BT, CenturyLink, and Telefonica, have publicly embraced the move to a micro services architecture. AT&T has highlighted how micro services will play a role in their goal to virtualize 75% of their telco network by 2020.