Adopting DevOps at Enterprise Scale

1

Presented by:

© IBM Corporation

Adopting DevOps at

Enterprise ScaleSanjeev SharmaCTO, DevOps Technical Sales and Adoption

IBM Distinguished Engineer

@sd_architect

https://twitter.com/sd_architect

2 © IBM Corporation

DevOps: Origins


DevOps in the Enterprise: Multiple Bottlenecks

Product Owner

Senior Executives

Users Domain ExpertsAuditors

Gold Owner Support Staff

External System

Team

Operations

Staff

Team MemberTeam Lead

Team MemberTeam Member

Line-of-business

Customer


DevOps approach: Apply Lean principles accelerate feedback and improve time to value

People

Process

Line-of-

businessCustomer

1

3

2

1. Get ideas into production fast

2. Get people to use it

3. Get feedback

Continuously Improve:

I. Application Delivered

II. Environment Deployed

III. Application and Environment Delivery

Process


Lean & Agile are at the heart of IBM’s DevOps approach

– Balance efficiency and effectiveness to

– deliver the right things right!

Reduce work

Eliminate

bottlenecks and

wasteFast response

times

Small batch sizes

Continuous

feedback

LEAN

AGILE

Efficiency

Effectiveness


Voice of the IT – Senior Application Development Executive

Steve Farley, VP Application

Development Center, Nationwide

Insurance

Carmen DeArdo, Director, Build

Technology Leader, Nationwide

Insurance


More executive perspectives on DevOps

Gareth Wharton,

CTO, Hiscox

Snehal Antani,

CIO CDF & CIO EA,

GE Capital Americas

“We built software and apps,

such as our award-winning bank

– GECapitalBank.com – from

scratch in weeks to months –

instead of months to years.”


Patterns of DevOps

Adoption


Patterns of DevOps Adoption

Three Key Business Drivers

1. Driving Business Agility

2. Scaling for the Enterprise

3. Driving Innovation


Adoption Pattern #1: Driving Business Agility


Adoption Pattern #1: Scenarios

Driving Business Agility

• Continuous Delivery

• Shift Left Test

• Shift Left Ops Engagement

• ‘Lean' Application Delivery


Where does DevOps Adoption Start?

ProductionDevelop Build Test DeployPlan

By the end of 2015, 75% of large organizations are

expected to have adopted agile DevOps practices (IDC)

Agile Adoption

Water-SCRUM-fall


Going from Agile to DevOps

End-to-End Delivery Pipeline

14 © IBM Corporation 14

Collaborative Development

• Continuous Integration

• ‘Single Source of Truth’ – Requirements, Source Code, Tests,

Deployable assets, Software Defined Environments

• Common Dashboards to show metrics


Deployment Automation

• Manage application

components and versions

• Manage configurations across

all environments

• Offer secure ‘self-service’ capabilities

• Increase transparency

• Ensure governance and compliancy


Databases Internal

Messages

Third-party

Services

virtual components

Simultaneously test

across multiple test

stages

Dev QA

Test

Virtualization

IBM UrbanCode

Deploy

Test Automation

integrated with

Test Environments

Dynamic Infrastructure

Deploy what is ready,

virtualize the rest

Continuously test in

production-like env.

Deploy private, secure right

sized test data

Test Data Management

Rational Test Workbench

Quality Management Manage quality across the

delivery lifecycle

Shift Left Test: Deploy what is ready, Virtualize the rest


Deploying Infrastructure is the biggest

bottleneck for the Delivery Pipeline

• Software Defined Environments enable

you to capture infrastructure as a software

artifact

Extending the Agile Manifesto:

Working software over comprehensive

documentation -> Working software (in

Production or production-like

environment) over comprehensive

documentation

‘Shift Left’ Ops Engagement

Application

Changes

Infrastructure

Changes


‘Lean’ Delivery Pipeline

Case Study: Large Bank

Challenge:

– Developers were creating daily builds

– QA team had a 3 – 5 day cycle time

Bottlenecks Identified:

– Large Sizes of Testing Deployments

– Lack of Deployment Automation

– Ticket based manual environment provisioning

– Lack of reliable source of Test Data

Solution:

– Deployment Automation with IBM UrbanCode Deploy

– Cloud hosted ‘on-demand’ environments with IBM

UrbanCode Deploy with Patterns

– Test Automation and Service Virtualization with IBM Rational

Test Workbench

– Test Data Management with IBM Optim Test Data

Management


End-to-end testing with Continuous Delivery and Test Virtualization

Databases Mainframe

applications

Third-partyServices

Rational Test Virtualization Server

Databases Mainframe

applicationsVirtualized Services

SCM Build

Deploy


Test

RTW

plugin

RTVS

plugin

Actual Services

Optim

plugin

Optim Test Data Management

UAT

UrbanCode Deploy

Extract Data,

Insert Data,

Convert/Mask Data

Update Data

Configure and start

Virtual Services

Deploy App and

Configure

Middleware

19

Cloud Platform

Test Data

Management


Adoption Pattern #2: Scaling for the Enterprise



Scaling for the Enterprise

• Release Automation for 2-speed IT

• Standardization across the

enterprise


Applications, teams and environments are “hybrid”: 2-Speed IT

Rapid iterations

Cloud

Slower iterations

Behind the firewall

AlignmentContinuous synchronization

and planning

Continuous testing

Continuous deployment

and monitoring

Plan Develop Build Test Deploy Production

Plan Develop Build Test Deploy Production


• Keep track of the inventory across the entire life cycle of the release

• Control the entire release lifecycle in an easy to use view

Orchestrating Complex Releases


Application Deployment to Hybrid Environments

IBM UrbanCode Deploy

with Patterns

IBM Bluemix

Cloud

Foundry

On-prem IaaS

On-prem Traditional IT

IBM Cloud OrchestratorIBM PureApplication System

IBM Cloud Manager with OpenStack

24

Virtual

Machines

DockerContainers

IBM UrbanCode Release

Systems of Engagement

Systems of Record


Adopting DevOps

for 2-speed IT

Case Study: Multinational Financial Services

Provider

Challenges:

– Delivering a Business Capability with multiple services and

applications across Hybrid Environments

Bottlenecks Identified:

– Lack of Release Planning

– Inability to test when needed, as services are not available/ready

– Coordinating complex Releases, made up of deployments across

Hybrid Environments

Solution:

– Release Planning with IBM UrbanCode Release

– Deployment Automation a cross Hybrid environments with IBM

UrbanCode Deploy with Patterns

– Test Automation and Service Virtualization with IBM Rational Test

Workbench

– Rapid Deployment across distributed datacenters with Aspera


IBM UrbanCode Release

Legacy Stack On-Prem Cloud


IBM UrbanCode Deploy with Patterns

ProvisionApplication

Infrastructure

Private Cloud

Pattern Engine

ProvisionApplication +Infrastructure

Platform as a Service(Public)

BlueMix

Infrastructure

System z and/or Distributed Applications

On-prem Customer Data Centers


IBM Cloud Orchestrator as a Service

Public Data Centers

AP

I Ga

tew

ay

CloudFoundry ‘Community’ Buildpacks

IBM DevOps

Services

APIs

APIs

Off-Prem Cloud

Infrastructure

IBM Cloud Orchestrator

Pattern Engine


Application Deployment for Hybrid environments

Aspera


Adoption Pattern #3: Driving Innovation



Driving Innovation

• Rapid Delivery for

Innovation/Experimentation

• Architecting for the Cloud


Innovation: Rapid Deployment and Feedback for

Experimentation

Line-of-

business Customer

1

3

2

1. Get ideas into production fast

2. Get people to use it

3. Get feedback

4. Improve and Iterate

• Canary Testing, A/B Testing

• Containerization

• Microservices


Build your apps, your wayBluemix is powered by a full open cloud architecture

Bluemix supports a wide diversity of workloads by offering developers a range of

choices associated with how they build and run their apps.

App-centric runtime

environments Flexible and powerful

VMs

Portable and consistent

containers

• Pure PaaS

• Support for node.js, Java, Go,

Python, Ruby, Ruby on Rails, .php

and includes the ability to bring

your own buildpack

• Focus on your code and your data,

the platform manages the rest

• Deploy and manage VMs

consistently for dedicated and

public clouds through a single

dashboard using open source

technologies.

• A user-specific repository of

images which are trusted and

secure

• High availability of the IBM-

hosted container images

• Integrated networking and

storage

IBM Bluemix


IBM Bluemix DevOps Services

Agile

Planning

Continuous

Integration

Web IDE

Hosted Git Jazz SCM

Monitoring

& Analytics

Mobile

Quality

Source Control

Plan and code

Feedback

Build and DeployContinuous Delivery


Static website Web frontend User DB Queue Analytics DB

Development

VMQA server Public Cloud Contributor’s

laptop

Docker – A shipping container system for code

Mu

ltip

licit

y o

f St

acks

Mu

ltip

licit

y o

f h

ard

war

e en

viro

nm

ents

Production

ClusterCustomer Data

Center

Do

services and

ap

ps in

teract ap

pro

priately?

Can

I migrate

smo

oth

ly and

q

uickly

…that can be manipulated using

standard operations and run

consistently on virtually any

hardware platform

An engine that enables

any payload to be

encapsulated as a

lightweight, portable, self-

sufficient container…


Dan the Developer

Worries about what’s

“inside” the container

• His code

• His Libraries

• His Package Manager

• His Apps

• His Data

All Linux servers look the

same

Why it works — DevOps Nirvana?

Oscar the Ops Guy

Worries about what’s “outside” the container

• Logging

• Remote access

• Monitoring

• Network config

All containers start, stop, copy, attach, migrate, etc. the same way


IBM’s Delivery Pipeline for Containers

IBM Container

Image Build

Service

Image

Registry


with Patterns


Creating a DevOps

Culture And now for the hard part…



It’s all about the people!

Building a DevOps Culture grounded

in lean and agile principles

• Everyone is responsible for Delivery

• Common measures of Success

• Setup a DevOps Center of Excellence

Product Owner

Senior Executives

Users Domain ExpertsAuditors

Gold Owner Support Staff

External System

Team

Operations

Staff

Team MemberTeam Lead

Team MemberTeam Member


Start Here:Value Stream Mapping for

Identifying and Addressing

bottlenecks


Bottlenecks in your Delivery Pipeline

Address issue of

congestion in

software delivery

1 per min 1 per min

4 per min 1 per min

4 per min 4 per min


Mapping your Delivery Pipeline

Idea/Feature/Bug Fix/

EnhancementProduction

Development Build QA SIT UAT Prod

PMO

Requirements/

Analyst

Developer

CustomersLine of Business

Build

EngineerQA Team Integration Tester User/Tester Operations

Artifact Repository

Deployment Engineer

Release Management

Code Repository

Deploy

Get Feedback

Infrastructure as Code/

Cloud Patterns

Feedback

Customer or

Customer Surrogate

Metrics - Reporting/Dashboarding

Tasks

Artifacts

Bottleneck: Rigid ‘One-size-

fits-all’ Development process

Solution: Agile Transformation with

‘Risk-Value’ based Process Variants

Bottleneck: Ticket Based

Environment Provisioning

Solution: Cloud Hosted

Developer ‘Self-Service’

Bottleneck: Weekend long

Deployments that often fail

Solution: Frequent Deployment

of Small Batches of ChangeBottleneck: Late Discovery of

Architectural Fragility

Solution: Agile ‘Shift Left’

Integration Testing to early in

LifeCycle


For Dummies books:

http://ibm.co/devopsfordummies

http://ibm.co/agilefordummies

http://ibm.co/ServiceVirtualizationForDummies

http://ibm.co/ARDfordummies

DevOps Lean Assessment (Beta):

http://bit.ly/IBMLeanAssess

IBM DevOps Page:

http://ibm.com/DevOps

IBM DevOps YouTube Playlist:

http://bit.ly/1fiDOtl

ResourcesContinuing your DevOps Adoption

journey

http://ibm.co/devopsfordummies

http://ibm.co/agilefordummies

http://ibm.co/ServiceVirtualizationForDummies

http://ibm.co/ARDfordummies

http://bit.ly/IBMLeanAssess

http://bit.ly/1wEkz72

http://ibm.com/DevOps

http://bit.ly/1fiDOtl


Questions?


Acknowledgements and disclaimers

© Copyright IBM Corporation 2013. All rights reserved.

–U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM, the IBM logo, ibm.com, Rational, the Rational logo, Telelogic, the Telelogic logo, Green Hat, the Green Hat logo, and other IBM products

and services are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or

both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these

symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may

also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and

trademark information” at www.ibm.com/legal/copytrade.shtml

If you have mentioned trademarks that are not from IBM, please update and add the following lines:

[Insert any special third-party trademark names/attributions here]

Other company, product, or service names may be trademarks or service marks of others.

Availability: References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries

in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided

for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any

participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided

AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise

related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating

any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license

agreement governing the use of IBM software.All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may

have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is

intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue

growth or other results.

http://www.ibm.com/legal/copytrade.shtml


© Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for

informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be

responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these

materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or

licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in

which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s

sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or

feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM

products and services are trademarks of the International Business Machines Corporation, in the United States, other countries

or both. Other company, product, or service names may be trademarks or service marks of others.

Thank You


Backup Slides



Databases Mainframe

applications

Third-partyServices


Databases Mainframe


SCM Build

Deploy


Test

RTW

plugin

RTVS

plugin

Actual Services

Optim

plugin


UAT

UrbanCode Deploy

Extract Data,

Insert Data,

Convert/Mask Data

Update Data

Configure and start

Virtual Services

Deploy App and

Configure

Middleware

46

Cloud Platform

Test Data

Management

IBM UrbanCode Deploy:• Continuous Delivery to Dev – Test

environments• Configure Middleware and

Environments• Configure Virtual Test Servers• Inventory Management • Security Management

Challenge Addressed: • Developer Self Service for end-

to-endTesting



Databases Mainframe

applications

Third-partyServices


Databases Mainframe


SCM Build

Deploy


Test

RTW

plugin

RTVS

plugin

Actual Services

Optim

plugin


UAT

UrbanCode Deploy

Extract Data,

Insert Data,

Convert/Mask Data

Update Data

Configure and start

Virtual Services

Deploy App and

Configure

Middleware

Deploy what is ready, virtualize the rest47

Cloud Platform

Test Data

Management

IBM Rational Workbench:

• Virtualize Services for testing

• Manage Virtualized Test

environments

• Integration testing

• Performance testing

• Security Testing with AppScan

Challenge Addressed:

• Early testing (Shift-left)

• Continuous end-to-end testing

• Remove dependencies on back-

end service availability for testing

• Remove dependencies on test

environment availability

• Virtualize expensive mainframe

services



Databases Mainframe

applications

Third-partyServices


Databases Mainframe


SCM Build

Deploy


Test

RTW

plugin

RTVS

plugin

Actual Services

Optim

plugin


UAT

UrbanCode Deploy

Extract Data,

Insert Data,

Convert/Mask Data

Update Data

Configure and start

Virtual Services

Deploy App and

Configure

Middleware

48

Cloud Platform

Test Data

Management

IBM InfoSphere Optim:• Test Data management• Mask and provide sets of test

data for Continuous Testing

Challenge Addressed: • Test Data Management



Databases Mainframe

applications

Third-partyServices


Databases Mainframe


SCM Build

Deploy


Test

RTW

plugin

RTVS

plugin

Actual Services

Optim

plugin


UAT

UrbanCode Deploy

Extract Data,

Insert Data,

Convert/Mask Data

Update Data

Configure and start

Virtual Services

Deploy App and

Configure

Middleware

49

Cloud Platform

Test Data

Management

IBM UrbanCode Deploy with Patterns:• Dev-Test-Prod Environment

Provisioning• Full Stack Deployment• Environment Portability

Challenge Addressed: • Full Stack Provisioning


Standardization Across the enterprise: Patterns and Templates

What to deploy?

Where to deploy (Physical or Cloud Resources) -Patterns

How to deploy?

Application Blueprints in


with Patterns

Documents

Adopting DevOps at Enterprise Scale