DevOps Continuous Testing and LaaS – The Perfect Match for SDN

DevOps Continuous Testing and LaaS – The Perfect Match for SDN

Marc HornbeekSenior Solutions Architect

2Spirent Communications

Spirent and DevOps

Continuous Deployment

(CD)

Continuous Integration

(CI)

Plug

-ins

Plug

-ins

SUTTest Tools

Lab ManagementPhysical, Virtual, Hybrid Lab

Analytics ALM

Orchestration

Continuous Test (CT)CCM

Test toolsCT OrchestrationLab Management

Professional Services

3Spirent Communications

“Without continuous testing there is no continuous delivery”

=

4Spirent Communications

Shift Left – YES BUT -- CT spans the pipeline

“Shift Left”

5Spirent Communications

NextGen DevOps must work with complex topologies

NextGen software involve complex topologies

6Spirent Communications

NextGen Topology Example: SDN and NFV

EFFICIENCY, OPS, SAVINGS

2015-202044% CAGR

Virtual 16%-80%

7Spirent Communications

SDN and NFV Test Environment

Mixed physical / virtual topologies

8Spirent Communications

Example SDN and NFV Test Topologies

Traffic Control Plane

Instantiation Auto-ScalingCOST, INTEGRATION, SECURITY

9Spirent Communications

Topology-centric CT matters

• Resources• Connectivity• Setup time• Flexibility• Efficiency

10Spirent Communications

NextGen Topology-centric CT platform

1) Lab Management2) Lab-as-a-Service3) Lab automation4) Distributed test5) Aggregate results

11Spirent Communications

• Central Admin• Security• User Groups• Pooled resource inventory• Physical and virtual• Work-orders

Total Lab Management

12Spirent Communications

• Abstract topologies• Topology reservations• Topology orchestration• Topology work-orders

Lab-as-a-Service - LaaS

13Spirent Communications

Lab Admin Automation

Production

�Business ��Operations

Management

Faster Less Cost Repeatable

14Spirent Communications

Distributed Test

• Topology test creation• Interface protocols & APIs• Non deterministic

response mapping• Script-less test cases• Quick calls

15Spirent Communications

• Results repo, tags• Phased thresholds• Snapshots and trends• Subscriptions & notifications• Telescope logs for debug

Aggregate Relevant Results

16Spirent Communications

Case Study

360 developers, six sites

36 MLOC+, 100+ features

86 build targets complex

interdependencies200+ topologies12K test cases

80+ deployment packages (physical

and virtual)

1,280,000,000test possibilities

17Spirent Communications

The primary contributing factor was CT and CM !

CT Case Results

Metric

Major release (#months)

Minor release (#weeks)

# Features

DefectsIntegrations / day

Tests / dayAutomated tests

After

3

2

150

10100

1085%

Before

6

4

113

1260

0.50.35%

18Spirent Communications

Best Practices Assessment Tool simplifies the assessment process.

19Spirent Communications

Summary

NextGen software involve networked applications

Topology-centric CT tools simplify CT for networked applications

Benchmark against CT Best Practices Blueprint and DevOps Assessment.

20Spirent Communications

www.spirent.com/clear

1) CT Blueprint white papers2) CT eBook3) CT Assessment Tool

Take-aways

http://www.spirent.com/go/AMR

21Spirent Communications

How can Spirent help?:

Test toolsCT OrchestrationLab Management

Professional Services

22Spirent Communications

© Spirent Communications, Inc. All of the company names and/or brand names and/or product names and/or logos referred to in this document, in particular the name “Spirent” and its logo device, are either registered trademarks or trademarks pending registration in accordance with relevant national laws. All rights reserved. Specifications subject to change without notice.

spirent.com

Thank youDevOps Continuous Testing and LaaS – The Perfect Match for SDN

Marc HornbeekSenior Solutions Architect

Marc.Hornbeek@spirent.comTwitter: mhexcalibur