2014 GSE Nordic S502 Enterprise DevOps- Trends in ... - Enterprise DevOps... · S502 –Enterprise DevOps: Trends in continuous software delivery Gary Mazo Sr. Software Engineer [email protected]

S502 –Enterprise DevOps: Trends in continuous software

delivery

Gary Mazo

Sr. Software Engineer

[email protected]

Venkat

Balabhadrapatruni

Sr. Technical Staff

Member

[email protected]

IBM Software and

Systems Engineering,

Rational

GSE Nordic

June, 2014

Copenhagen

mailto:[email protected]

mailto:[email protected]

© Copyright IBM Corporation 2014. All rights reserved.

Information is confidential and must not be shared or redistributed without permission from IBM. Plans are based on best information available and may change in future.

DISCLAIMER

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

© Copyright IBM Corporation 2014. All rights reserved. 3

About the speaker

• Gary Mazo is a software engineer with IBM

Rational Software and Systems Engineering

• 1987 Graduate of Leningrad (now St.

Petersburg) Polytechnic University

• Joined IBM in 1988 in Fortran compiler

development

• Has been with Rational since 2005

• During rare free time enjoys photography and

model rocket building with his 3 children


Topics

4

Brief history of Enterprise software development

Introduction to Continuous Delivery concepts

Enabling DevOps in Enterprise – Drinking our own champagne

Summary and Questions


Topics

5






Transaction Systems

1960- 1990- 2010-

Web, e-business and SOA

Analytics, Mobile, Social, & Cloud

Pla

tfo

rms

Dedicated Systems

Single Database

Managed one Solution

Multiple Applications

Some shared data

Post Processing in Warehouses

Batch Processing

Time to Business Action

Interconnected Solutions

Action at real time speeds

Processing occurs NOW !!!

Business impact visualized

Action taken immediately

Strategic and Tactical differentiator

Time

accelerates its reporting process from 20 days to several hours and cuts reporting costs by 50 percent

Customer Insight through Social

Anaytics increased Site

revenue from product

recommendations by 70%

A new wave of business opportunities & IT challenges


Social, Local, Mobile

Smart Infrastructure Analytics

ERP DB

CRM HR

Manage workloads

and maintain security

Rapid innovation

in the cloud

User experience and

mobile management

New era systems integrate existing systems of record with new client-facing systems of engagement


54%

of companies believe software delivery is critical

25%

leverage software delivery effectively today

But only…

69%

outperform

those who don’t leverage

software delivery

effectively

Source: “The Software Edge: How effective software development drives competitive advantage,” IBM Institute of Business Value, March 2013

Software delivery is critical to success


Topics

9







Lack of continuous delivery impacts the

entire business

Costly, error prone manual processes and

efforts to deliver software across an enterprise

CHALLENGES

Upgrade risk due to managing multiple application configurations and versions

across servers

Slow deployment to development and test

environments leave teams waiting and unproductive

CHALLENGES

Operations/ Production

Development/ Test Customers

Business Owners

Software glitch costs

major trading firm

$440 million in 45

minutes

A bad software upgrade

at a global bank left

millions unable to access

money for four days

Major telecom provider paid out

$2.7 million to 47,000

customers overcharged after a

software glitch


dev·ops noun \'dev-äps\

Enterprise capability for continuous software delivery that enables clients

to seize market opportunities and reduce time to customer feedback

An approach for continuous delivery of software-driven innovation

Reduce time to obtain and

respond to customer feedback

Balance speed, cost,

quality, and risk

DevOps Lifecycle

Continuous Innovation, Feedback and Improvements

Accelerate software

delivery

Operations/ Production Customers Business owners Development/Test


IBM DevOps solution

DevOps Foundation

Open Lifecycle and Service Management Integration Platform

DevOps Lifecycle Operations/Production Development/Test Customers Business Owners


Ec

osy

ste

m

Bes

t Pra

ctic

es

Monitor and Optimize

Plan and Measure Develop and Test Release and Deploy

OSLC

Accelerating the delivery of multiplatform applications


DevOps in a multiplatform development environment

DevOps Foundation


DevOps Lifecycle Operations/Production Development/Test Customers Business Owners


Ec

osy

ste

m

Bes

t Pra

ctic

es



OSLC

GAP GAP GAP


Improve feedback responsiveness

Create Agile and Lean practices to connect

business and IT

Automate functional, regression, load and integration testing

Reduce provision burden on Operations

Rapid solution delivery and test

provisioning

Resolve transaction failures and performance

bottlenecks

Bottlenecks in software delivery can result in

long delays, unnecessary costs, and waste of resources

Break down silos by moving to an Agile team environment

Offload development and testing to reduce

MIPS

Leverage common tools to build multiplatform

apps


Create Agile and Lean practices to connect business and IT

Strategic

Drivers

Ideas &

Demand

Portfolios

Reviews

Resources

Finances

Risks,

Issues,

Changes

Collaboration & Communication

Governance Progress

Monitoring

Plan and Measure


Continuous Delivery

Improve visibility and transparency

• Better align investment decisions

with value and organizational

strategies and priorities

• Plan releases predictably driven by

the needs of the business

• Gain control of development

initiatives by improving visibility and

transparency

• Provide proactive portfolio

evolution and delivery governance

Enabling you to…

Rational Focal Point


Topics

16






Leverage common tools to build multiplatform apps

• Leverage common Eclipse-based

IDEs for all types of development

• Access broad coverage of

runtimes, languages, compilers,

and platforms

• Access via cloud-based

environments like SmartCloud

Enterprise+ (SCE+)

• Create agile services from

existing mainframe assets


Continuous Delivery

Boost developer productivity Rational Developer for the Enterprise IBM Worklight for MobileFirst platform

Enabling you to…

Develop and Test


Break down silos by moving to an Agile team environment

• Manage all types of source -

JavaScript to COBOL

• Create work items spanning

technologies and solutions

• Accelerate agile adoption on the

mainframe

• Integrate existing SCMs and

deployment tools, e.g. ChangeMan

and Endevor

• Use Lifecycle integration adapters

for third-party tools


Continuous Delivery

Project Managers /

SCRUM Masters Quality and Test

Agile Teams

Developers

Administrator

LoB / Business

Analyst

Maximize team productivity Rational Team Concert Rational Requirements Composer Rational Quality Manager

Enabling you to…

Develop and Test


Automate functional, regression, load, and integration testing

• Fully embrace automated testing

• Create test automaton of native

and hybrid mobile and mainframe

applications

• Run automated tests to validate

builds

• Take advantage of over 70

technologies and protocols out of

the box

Enabling you to…

System User Acceptance

Operability Unit / Integration

Improve application quality


Continuous Delivery

Includes

Green Hat

technology

Virtual

Component

Real

Implementation

Rational Test Workbench - leveraging Green Hat Technology

Develop and Test


Offload development and testing to reduce MIPS

Note: This Program is licensed only for development and test of applications that run on IBM z/OS. The Program may not be used to run production workloads of any kind, nor more robust development workloads including without limitation production module builds, pre-production testing, stress testing, or performance testing.

• Rapidly prototype new applications

• Develop and test System z

applications anywhere, anytime

• Free up mainframe development

MIPS for production workload

• Eliminate costly delays by reducing

dependencies on operations staff

• Try latest middleware, including CICS

5.1, IMS 12.1, and WebSphere 8.5

• System z Development and Test

Solution

RDz & ISPF

RDz

Improve development flexibility


Continuous Delivery

Rational Development and Test Environment for System z

Enabling you to…

Develop and Test

New



Continuous Delivery

Reduce provisioning burden on Operations

• Test in isolation with ‘stubbed’ or

‘mock’ services

• Virtualize CICS applications inside

the mainframe and Java applications

in the JVM

• Reduce development dependency

on operations

• Minimize subsystem dependency

during testing

• Reduce infrastructure costs and free

up MIPS for production use

Maintain test LPARs effectively Rational Test Virtualization Server - leveraging Green Hat technology

Includes

Green Hat

technology Enabling you to…

Develop and Test

Databases Mainframe applications

App Under Test

Third-party Services

Packaged apps, messaging services, etc.

Virtual Services

New


Rapid solution delivery and test provisioning

• Provision consistent images for test

environments, reduce rework, and

speed redeploy of application changes

• Quickly deploy multiple test instances in

minutes versus hours or days

• Support mainframes using zLinux and

z/OS native agent for Java applications

• Orchestrate and automate the

deployment and management of

applications, middleware configuration,

and databases

Application Blueprint

Deliver test environments in minutes IBM UrbanCode Deploy IBM UrbanCode Release IBM SmartCloud Orchestrator

Release and Deploy

Enabling you to…

New


• Collaborate between development

and operations with centralized

incident management and tracking

• Quickly determine the root cause of

critical cross-platform applications

• Easily determine application health

and quickly isolate the source of

any issues

Manage and optimize application and infrastructure performance

Gain actionable insights IBM SmartCloud Application Performance Management IBM SmartCloud Control DesK


Enabling you to…


• Increase visibility into the actual

customer experience

• Quickly diagnose and resolve

issues

• Easily quantify business impacts

• Perform real-time customer

analytics

Improve feedback responsiveness

Analyzing the customer experience challenges IBM Tealeaf IBM Digital Analytics


Enabling you to…

Analytics

Repository

Worklight

Server

Server Data

Client Logs

Interact

with the data


DEVELOPER VALUE

Increase Programmer Productivity

Bolsters overall benefits of CICS, IMS, DB2

Modernize Applications to work with web, cloud and mobile infrastructures

Increase Performance of Business Critical Applications

Enterprise COBOL for z/OS v5.1 The key to supercharging IBM System z Applications

Advanced technology designed to optimize COBOL programs and fully exploit z hardware

– Delivers greater than 10% performance improvement over Enterprise COBOL v4 for well structured, CPU-intensive batch applications on System z1

– Many numerically intensive programs have shown performance increases greater than 20%1

– Maintains compatibility with previous COBOL releases

New programming and application modernization capabilities

– Enables users to deliver enhancements to business critical applications quicker with less cost and lower risk

Allows users, who implement sub-capacity tracking, to reduce administrative overhead

"Our testing of COBOL V5 shows a significant performance improvement for math.

As a financial services company with a continually narrowing batch window, that

improvement is very important to us. It will help us meet our Service Level

Agreements and reduce cost driven by CPU utilization.”

Michael A Todd, Software Architect

where Tradition Meets Innovation…

1 Results are based on an internal compute-intensive test suite. Performance results from other applications may vary.

Supports the ecosystem of COBOL

development tools supplied by IBM

and ISVs



Develop and test capabilities for mobile applications

• Quickly design, code, build, test,

and deploy mobile apps that run on

a wide variety of mobile platforms

• Refactor and extend existing back-

end services to provide an optimal

mobile experience

• Stub out back-ends to simplify test

and development

• Automate testing for native and

hybrid mobile apps

Accelerate mobile application development Rational Test Workbench IBM Worklight for MobileFirst platform Rational Business Developer Rational Application Developer Rational Developer for the Enterprise

Enabling you to…

Deploy

Code

Test


Continuous Delivery

Construct, debug, and test mobile

and Web applications

Design

Refactor and extend existing logic as

mobile-consumable services

New

New

Develop and Test


Drinking our own champagne – Rational Developer Traveler Experiment


SaaS Software as a Service

Email,

Calendars,

ERP/CRM,

Communications,

End user application

development

tools

PaaS Platform as a Service

Operating System,

App, Web,

HTTP server,

Databases

Monitoring and

system ops

IaaS Infrastructure

Hardware and

HW virtualization:

Virtual machines

Servers,

Network,

RAM,

Disk and other

storage

Cloud clients:

Mobile, Web

Browser, API

Cloud application: concepts overview

28


SaaS Software as a Service

Email,

Calendars,

ERP/CRM,

Communications,

End user application

development

tools

PaaS Platform as a Service

Operating System,

App, Web,

HTTP server,

Databases

Monitoring and

system ops

IaaS Infrastructure

Hardware and

HW virtualization:

Virtual machines

Servers,

Network,

RAM,

Disk and other

storage

Cloud clients:

Mobile, Web

Browser, API

Cloud application: concepts overview

HTTP HTTP HTTP

29


Eclipse Orion

HTML

JavaScript

dojo

AJAX

System components – Rational Developer Traveler Experiment

zOS Resource

Server

Middle Tier –

WAS Liberty Profile

Core

Services

MVS Files

zFS Files

JES

Application

Container

Web

Container

REST API for

the Resource

Server

TCP/IP

REST

30

Persistence

and admin

services

HTTP


Drinking our own Champagne – RD Traveler Experiment challenges

Very different environments

Orion, JavaScript, CSS etc.

JavaSE, WAS Liberty/OSGi/JPA etc.

zOS C, HLASM, COBOL, ISPF

Dispersed team with different backgrounds

4 corners of North America (US and Canada)

Informal development process (“Lean Startup”)

Standard internal support for development

Very short release cycles (every ~2.5 months)


Drinking our own Champagne – How DevOps help RD Traveler respond to challenges

Very different operating environments

Use RDz to develop/test/debug across all components

Use RD&T to test

Dispersed team with different backgrounds

Use RTC and IBM Connections to communicate, plan,

design, document, track deliverables, bugs, progress

Informal development process (“Lean Startup”)

Use RTC to automate build and packaging

Plan to use UrbanCode uDeploy to deploy

Use IBM developerWorks to connect to clients


Topics

33






Summary

• There are challenges to delivering

software-driven innovation

• Disruptive technologies are driving

greater need to innovate

• DevOps is critical to your success

• IBM has first class DevOps solutions

and is continuing to invest and

improve upon these solutions

• DevOps is just as relevant, if not

more so, for System z as it is for

distributed environments


References

35

IBM Institute for Business Value (IBV) report on Continuous Software Delivery

http://www-935.ibm.com/services/us/gbs/thoughtleadership/softwareedge/

Software delivery challenges

http://gizmodo.com/5931284/software-glitch-costs-trading-firm-440-million-in-45-minutes

http://www.theregister.co.uk/2012/06/25/rbs_natwest_what_went_wrong/

http://business.scoop.co.nz/2011/10/19/telecom-makes-2-7m-settlement-for-incorrect-meter-readings/

DevOps and Mainframe – how they relate

https://www.youtube.com/watch?v=9vxzY8ADA6Y

RD Traveler Sandbox https://rdt1.demos.ibm.com/RDT/home/Home.html#

RD Traveler on IBM developerWorks http://ibm.co/rdtraveler

The Lean Startup http://leanstartup.pbworks.com/w/page/65946049/Intro%20to%20Lean%20Startup






https://rdt1.demos.ibm.com/RDT/home/Home.html

https://rdt1.demos.ibm.com/RDT/home/Home.html

http://ibm.co/rdtraveler

http://leanstartup.pbworks.com/w/page/65946049/Intro to Lean Startup

http://leanstartup.pbworks.com/w/page/65946049/Intro to Lean Startup


www.ibm/software/rational

36


FEEDBACK!

37

Please don’t forget to submit your session and speaker feedback!

Session S502

25/05/2014

© Copyright IBM Corporation 2014. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

38

www.ibm/software/rational

Documents

2014 GSE Nordic S502 Enterprise DevOps- Trends in ... - Enterprise DevOps... · S502 –Enterprise DevOps: Trends in continuous software delivery Gary Mazo Sr. Software Engineer [email protected]