Continuous Delivery in the Real World

© 2014 LeftShift

Continuous Delivery in the Real World

David Silverstone

Solutions & Delivery Director

12 June 2014

© 2014 LeftShift | www.leftshiftit.com 2

LeftShift Introduction

• Specialists in Lifecycle Optimization

• Optimizing every aspect of the IT Change Delivery Lifecycle

• To Enable Faster, Safer and Repeatable IT Change

• We address the primary pain points at the root

• Deliver solutions which resolve these constraints

• We will own the problem and give you back the solution

• We implement rapid, repeatable IT change delivery capabilities, then enable your teams to take these forward, informed and empowered

Who are we


What we do

1. Service Virtualization

2. Automated Integration Testing

3. Coverage Calculation

4. Test Data Management

5. Dev Ops and Environment Management

6. Agile Integration – on the macro scale

7. Delivery Management – solving real problems, real time, sustainably

Specialists in:

Getting your change programs over the line, more quickly, to higher quality, leaving in place a repeatable, transferable and scalable IT Change Delivery capability.


Our Expertise

The Rational Suite for:

• Service Virtualization RTVS

• Automated Integration Testing RIT / RTW

• Performance Testing and Performance Test Enablement RPTSCreated the globally-adopted, Adept-Framework™ for Green Hat

“Green Hat” Experts

• Recognised industry leaders in Service Virtualization using ‘Green Hat’

• Recognised industry leaders in Automated, Agile Integration using ‘Green Hat’

• Over 5 years hands on experience implementing the above

• 100% successful track record for Adept / Green Hat implementations

• All Adept / Green Hat implementations are still in use – up to 5 years later

• IBM Rational Tier 1 partners

Depth of Experience


Session Focus – Accelerate IT Delivery

• Service Bus Virtualization Health Insurer

• Mortgages Platform Replacement Global Bank

• Payments Platform Replacement Global Bank

• Web Methods SAP Virtualization Beverage Retailer

The Power of Service Virtualization to transform IT Change Delivery

Service Virtualization is being used today, by industry leaders, across sectors to:

Customer Journeys

• Reduce overheads by up to 50%

• Accelerate Testing by up to 50%

• Accelerate IT Change Delivery by up to 50%


Why Service Virtualization?

1. Back End Systems

2. External Providers

3. Internal Providers – e.g. Service Bus

4. Data

Remove / Minimize Dependencies:

Reduce Overheads: Business Drivers:

1. Make agile real for Integration

2. Make agile real for QA Testing

3. Agile Design – modelling change

1. Environment Overheads

2. Data Set Up Overheads

3. Infrastructure

1. Testing

2. Defect Identification & Resolution

3. Overall delivery of change

Move Agile beyond Dev

1. More Change More Often

2. Do more with less

3. Faster Time to Market

4. Higher Quality

5. Lower Risk

6. Lower Total Cost of Change

7. Repeatable, Sustainable Change Delivery Capability

Left-Shift & Accelerate


What is Service Virtualization?

1. Service Virtualization can most easily be thought of as Accurate Simulation

2. With Green Hat & Adept, the simulation is exact, simple to set up & code free

3. Green Hat can ‘stand in for’ any component in the sample architecture below

4. To provide the correct input or response required to enable each test objective

Mobile

ANY

TELE

Portal

Desktop

Service Consumer ESB BPM ESBSOAP/

HTTPS

Business ServicesSecurity

JavaNET

COBOLPackaged

Atomic Services

Message Broker

MQ MQ

Data Layer

Member

Claim

Provider

Benefits

JDBC

IMS


Drivers & Responders – Responder Illustration

• Green Hat can be used as a ‘Driver’ or a ‘Responder’

• Here, Green Hat is acting as a ‘Responder’

• To enable standalone ‘front-end’ testing

Mobile

ANY

IVR/INI

Portal

Desktop


HTTPS


JavaNET

COBOLPackaged

Atomic Services

Message Broker

MQ MQ

Data Layer

Member

Claim

Provider

Benefits

JDBC

IMS

Provider Broker Pool

PlanSource

Green Hat Simulates ESB (RTVS) ESB is now a ‘Virtual Component’1. GH Receives the input 2. GH Provides the correct response

1

2


Using Green Hat to Automate and Drive Testing

• Automate Integration Testing & Services Testing

• Capture Test Actions as reusable, repeatable building blocks

• Data Drive all variations

Mobile

ANY

IVR/INI

Portal

Desktop


HTTPS


JavaNET

COBOLPackaged

Atomic Services

Message Broker

MQ MQ

Data Layer

Member

Claim

Provider

Benefits

JDBC

IMS


PlanSource

Green Hat (RIT)1. Injects Messages 2. Checks database

and audit logs3. Validates

Responses

1

3

2 2 2 2

2

2

2

2

2


Adept Principles: Getting the most out of SV

1. If I want to test GUI look and feel – I don’t need real Back End or Middleware

2. If I want to prove middleware and back end integration – I don’t need a GUI

3. If I want to prove that my middleware is behaving correctly – I don’t need a front end or a back end

4. If I want to test that my back end (e.g. batch) changes have been implemented successfully and correctly, I don’t need middleware or a GUI

SV provides the flexibility to satisfy discrete objectives earlier, and tackle the Testing in digestible chunks – Left-Shifting Risk & Quality

Successful use of SV requires:

Objectives could include, for example:

• Architecturally Informed Testing

• Objective Driven Testing – a clear set of discrete objectives to inform testing


How does it work? How do we ensure accurate replication?Primary Factors

1. Schema Consumption (Schema = message or interface specification)

2. Record and Playback

Schema Consumption

• Green Hat consumes (read and replicate) a schema – so it automatically creates a correct vanilla virtual component (stub) from a schema

• The virtual component can then be configured to respond as required

Record and Playback

• Green Hat can record real traffic between components via the GH Proxy

• Then replace one component and replicate the exact responses

Keys to Understanding SV

• SV does not seek to replicate application processing or logic

• GH provides the correct response or input to enable the interaction.


Record & Playback – Recording Traffic 1. The Green Hat proxy sits between interacting components

2. Traffic ‘passes through’ the GH Proxy unaffected

3. Green Hat records the responses

Front End Application

Green Hat Proxy

Actual Component

Virtual Component


Virtual Component ‘Replays’ Recorded Responses1. The Green Hat proxy now routes service calls to the Virtual Component

2. Virtual Component Provides identical responses

3. Testers / Initiating Component can tell no difference

Front End Application

Green Hat Proxy

Actual Component

Virtual Component


Health Insurance Giant – Virtualized Middleware Objectives: • Front end platforms are ready long before the ESB services

• Enable independent testing of Front End platforms for new services

• New and updated services can also be virtualized quickly and easily

Mobile

ANY

IVR/INI

Portal

Desktop


HTTPS


JavaNET

COBOLPackaged

Atomic Services

Message Broker

MQ MQ

Data Layer

Member

Claim

Provider

Benefits

JDBC

IMS


PlanSource

Green Hat Simulates ESB (RTVS)ESB is now a ‘Virtual Component’1. GH Receives the input 2. GH Provides the correct response

1

2


Health Insurance Giant

Senior IT Director: “For our use case, it took us 18 months to virtualize 6 services with CA Lisa. LeftShift used Green Hat (RTVS) to virtualize 115 services in less than 4 months”

Outcomes

• Adept Framework implemented within 6 weeks

• Usage & Adoption Model defined within 8 weeks

• 115 core services virtualized within 4 months

• ‘Consumer Portal in a box’ virtual environment created for customer demonstrations

• Set up schema-derived, data-driven virtual services to support the primary use case – i.e. virtualization of new and updated web services, to enable UI testing

• Defined the virtual service lifecycle, to integrate with the web service development lifecycle


Mortgage Platform Replacement

• Replacing Mortgage Servicing Platform – new Front End – last component to be ready • High business risk, Regulatory Time Pressure, Penalties for late delivery • Limited schedule ‘slots’ with external 3rd party providers for integration testing

Context

Sales Originations

ESBMessage Broker

Customer Mainframe

Mortgages Mainframe

Home Insurance

Fraud Check

Loan Insurance

FIRE

WALL


Isolated Component Testing - Mainframe

• Validate mainframe updates early, to enable downstream testing • Validate batch outputs to support regulatory reporting• Test each component as soon as its available

Objectives

Green Hat Virtualizes the ESBTo enable Targeted Back End Testing

1. Sends Input 2. Validates database 3. Validates Response

1 3

2


External Integrations – 3rd party Dependency

• Automate External Integration Testing• Find and fix all integration related defects

Objectives

Green Hat Virtualizes the ESB to test 3rd party integration1. Sends Input 2. Validates Audit Logs3. Validates Response

1

32


Virtual Initiating and 3rd party external systems

• Accelerate Integration Testing• Virtualize External Providers

Objectives

Green Hat Virtualizes the GUI 1. Sends Input 2. Validates database , logs5. Validates Response

Green Hat Virtualizes External Systems3. Receives input 4. Sends Response

1 5

2

2

34

2

1 5

2

2


Automated Sub-GUI Integration

• Accelerated Integration Testing

Objectives

Green Hat Virtualizes the GUI 1. Sends Input 2. Validates database , logs5. Validates Response

1 3

2

2 2

1 3

2

2


Isolated Component Testing – Front End

• Stabilise the Front End platform in a standalone environment • Automate GUI testing in a standalone environment • Conduct standalone performance testing of front end platform

Objectives

Green Hat Virtualizes the ESBTo enable Targeted Front End Testing

1. Receives Request 2. Sends ValidatResponse

1 2 1 2


Mainframe Virtualization

• Mitigate contention for availability of mainframe environments • Prove GUI and Middleware integration without back end dependency • More control over test data

Objectives

Green Hat Virtualizes the Back End 1. Receives Request 2. Sends ValidatResponse

1 2 1 2

Green Hat Virtualizes External Systems1. Receives input 2. Sends Response

1

2


Benefits Realised

• Adept Framework up and running within 4 weeks

• Integration defects identified and resolved 6 months earlier than planned

• Mainframe testing de-risked 6 months earlier than planned

• Batch testing de-risked 6 months earlier than planned

• Regulatory reporting tested 6 months earlier

• Integration defects identified before GUI build was even complete

• No penalties for missing slot with external providers for testing

• Repeatable, flexible change validation capability left in place

• Handed over to in-house team – still running today


Global Payments Platform Replacement - £200m

SWIFT

COLB

WOLB

ROLB

ESB

Global Payments Processing Platform

FXFraud

ESB

ESB

ESB

Funds Control

Account Data Feed

Customer Data Feed

£Accounts

Account Data

Customer Data

Business Rules

$ / €Accounts

Nostro

SWIFT Gateway

Vostro

Reconciliation

- Account Data Holding System

- External System

- Non Data Holding System


Global Payments Platform Replacement


- External System


SWIFT

COLB

WOLB

ROLB

ESB


FXFraud

ESB

ESB

ESB

Funds Control

Account Data Feed

Customer Data Feed

£Accounts

Account Data

Customer Data

Business Rules

$ / €Accounts

Nostro

SWIFT Gateway

Vostro

Reconciliation


- External System


Green Hat Virtualizes ‘real time’ Interacting Components

Green Hat VirtualizesInitiating Channels

Green Hat Validates Outputs from Payments Platform



SWIFT

COLB

WOLB

ROLB

ESB


FXFraud

ESB

ESB

ESB

Funds Control

Account Data Feed

Customer Data Feed

£Accounts

Account Data

Customer Data

Business Rules

$ / €Accounts

Nostro

SWIFT Gateway

Vostro

Reconciliation


- External System



Green Hat Virtualizes ‘real time’ Interacting Components




SWIFT

COLB

WOLB

ROLB

ESB


FXFraud

ESB

ESB

ESB

Funds Control

Account Data Feed

Customer Data Feed

£Accounts

Account Data

Customer Data

Business Rules

$ / €Accounts

Nostro

SWIFT Gateway

Vostro

Reconciliation


- External System





Benefits

Global Payments Platform Replacement Program:

• Service Virtualisation and Automated Integration Testing capability up and running in Green Hat (RTVS and RIT) within 6 weeks

• Over 80 different component interactions virtualized successfully using RTVS

• All STP testing fully automated – inputs and validations

• Agile Integration realized successfully following the Adept Method for Green Hat

• Integration Testing 3 months earlier – and then continuous

• Mitigation of 3 months critical path slip in development to go live on time

• Test Automation and Virtualization capability handed over to a ‘run team’ within the bank – still in active use


Acceleration of Middleware Testing Objectives

• Automatically Validate the transforms in the Web Methods middleware

• Automate & orchestrate inputs, outputs and validation


Automated Middleware Testing & Virtualization

• Green Hat virtualizes initiating channels• Green Hat virtualizes receiving SAP system – and validates WM outputs to SAP

Adept Framework


Benefits

• Fully Automated Capability up and running within 7 days

• Auto-calculated optimal coverage

• Auto-generated executable input data

• Auto-generated executable tests

• See ROI

Middleware Test Automation & Virtualization


Phase 1 ROI – Time Required per Activity (days)

20

10

5

10

15

20

Execute TestCycle/ Release

BaselineGH Enabled

0.125

0.006250

0.05

0.1

Validate WMOutputs/ File

BaselineGH Enabled

0.125

0.006250

0.05

0.1

Identify RootCause/ Defect

BaselineGH Enabled

1

0.006250

0.2

0.4

0.6

0.8

1

Retest Each Defect

BaselineGH Enabled

0.0625

0.00625

0

0.02

0.04

0.06

Reload &Retest/ Release

BaselineGH Enabled


SV - Benefits Summary• Teams enabled to work effectively in isolation – to consistent standards

• Dependencies minimised – internal, external, environments and data

• Better, earlier component testing

• Quicker, cleaner, more frequent releases

• Faster, Cleaner, Agile Integration

• Reduced overheads

• More change, more often, for less

• Risk addressed earlier and continuously – no ‘Big Bang’ at the end

• Higher Quality of change to Production

• Less issues in Production

• Faster Time to Market

• More Competitive Business


But how do I make it real for me?

• Invest – what is 50% increase in efficiency worth?

• Commit – this is a proven technology

• Make it Real - Solve real problems for real projects straight away

• Right Tools – we use the Rational Suite by choice

• Right Approach – ‘trial and error’ is not an optimal adoption method

• Right Expertise – the difference between 6 weeks and 6 months


Adept Framework – the art of virtualization

The Adept Framework is designed to enable rapid, sustainable and successful adoption of Service Virtualization and Automated Integration Testing

1. Captures your landscape in simple, extensible virtual service models

2. Captures each test action as reusable building block

3. Provides simplified data input models

4. Enables non technical users to define and execute virtual services

5. Maps virtual service requirements to the right SV method

6. Virtual Service version control model

7. Lifecycle alignment

8. Calculates optimal coverage for testing and virtualization

9. Enables auto-generation of executable tests (based on points 2 and 8)

10. Enables auto-generation of input and response data


The Rational Choice

The Rational Suite stands out from other Service Virtualization capabilities in the following ways:

1. Code Free - Service Virtualization, Automated Integration Testing and Performance Testing in the same tool set – all virtually code free

2. Support for multiple VS models (not just record and playback) code free

3. Whole lifecycle support for Service Virtualization – Design, Build, Test

4. Rational Suite – is part of a whole lifecycle enablement tool suite

5. Transports & Formats - supports the greatest breadth of transports and message formats out of the box, by far

6. Adoption & Scalability - Green Hat supports the creation of expert frameworks which enable non-technical users to create virtual services


THANK YOU!

Any Questions?

More information:www.leftshiftit.com@LeftShift IT

http://www.leftshiftit.com/

Technology

Continuous Delivery in the Real World