22
DevOps Continuous Testing and LaaS – The Perfect Match for SDN Marc Hornbeek Senior Solutions Architect

DevOps Continuous Testing and LaaS – The Perfect Match for SDN

Embed Size (px)

Citation preview

Page 1: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

DevOps Continuous Testing and LaaS – The Perfect Match for SDN

Marc HornbeekSenior Solutions Architect

Page 2: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

2Spirent Communications

Spirent and DevOps

Continuous Deployment

(CD)

Continuous Integration

(CI)

Plug

-ins

Plug

-ins

SUTTest Tools

Lab ManagementPhysical, Virtual, Hybrid Lab

Analytics ALM

Orchestration

Continuous Test (CT)CCM

Test toolsCT OrchestrationLab Management

Professional Services

Page 3: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

3Spirent Communications

“Without continuous testing there is no continuous delivery”

=

Page 4: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

4Spirent Communications

Shift Left – YES BUT -- CT spans the pipeline

“Shift Left”

Page 5: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

5Spirent Communications

NextGen DevOps must work with complex topologies

NextGen software involve complex topologies

Page 6: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

6Spirent Communications

NextGen Topology Example: SDN and NFV

EFFICIENCY, OPS, SAVINGS

2015-202044% CAGR

Virtual 16%-80%

Page 7: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

7Spirent Communications

SDN and NFV Test Environment

Mixed physical / virtual topologies

Page 8: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

8Spirent Communications

Example SDN and NFV Test Topologies

Traffic Control Plane

Instantiation Auto-ScalingCOST, INTEGRATION, SECURITY

Page 9: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

9Spirent Communications

Topology-centric CT matters

• Resources• Connectivity• Setup time• Flexibility• Efficiency

Page 10: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

10Spirent Communications

NextGen Topology-centric CT platform

1) Lab Management2) Lab-as-a-Service3) Lab automation4) Distributed test5) Aggregate results

Page 11: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

11Spirent Communications

• Central Admin• Security• User Groups• Pooled resource inventory• Physical and virtual• Work-orders

Total Lab Management

Page 12: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

12Spirent Communications

• Abstract topologies• Topology reservations• Topology orchestration• Topology work-orders

Lab-as-a-Service - LaaS

Page 13: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

13Spirent Communications

Lab Admin Automation

Production

�Business ��Operations

Management

Faster Less Cost Repeatable

Page 14: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

14Spirent Communications

Distributed Test

• Topology test creation• Interface protocols & APIs• Non deterministic

response mapping• Script-less test cases• Quick calls

Page 15: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

15Spirent Communications

• Results repo, tags• Phased thresholds• Snapshots and trends• Subscriptions & notifications• Telescope logs for debug

Aggregate Relevant Results

Page 16: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

16Spirent Communications

Case Study

360 developers, six sites

36 MLOC+, 100+ features

86 build targets complex

interdependencies200+ topologies12K test cases

80+ deployment packages (physical

and virtual)

1,280,000,000test possibilities

Page 17: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

17Spirent Communications

The primary contributing factor was CT and CM !

CT Case Results

Metric

Major release (#months)

Minor release (#weeks)

# Features

DefectsIntegrations / day

Tests / dayAutomated tests

After

3

2

150

10100

1085%

Before

6

4

113

1260

0.50.35%

Page 18: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

18Spirent Communications

Best Practices Assessment Tool simplifies the assessment process.

Page 19: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

19Spirent Communications

Summary

NextGen software involve networked applications

Topology-centric CT tools simplify CT for networked applications

Benchmark against CT Best Practices Blueprint and DevOps Assessment.

Page 20: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

20Spirent Communications

www.spirent.com/clear

1) CT Blueprint white papers2) CT eBook3) CT Assessment Tool

Take-aways

http://www.spirent.com/go/AMR

Page 21: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

21Spirent Communications

How can Spirent help?:

Test toolsCT OrchestrationLab Management

Professional Services

Page 22: DevOps Continuous Testing and LaaS – The Perfect Match for SDN

22Spirent Communications

© Spirent Communications, Inc. All of the company names and/or brand names and/or product names and/or logos referred to in this document, in particular the name “Spirent” and its logo device, are either registered trademarks or trademarks pending registration in accordance with relevant national laws. All rights reserved. Specifications subject to change without notice.

spirent.com

Thank youDevOps Continuous Testing and LaaS – The Perfect Match for SDN

Marc HornbeekSenior Solutions Architect

[email protected]: mhexcalibur