Enabling DevOps in the cloud - Federal Cloud Innovation Center

© 2013 IBM Corporation

© 2013 IBM Corporation

Sanjeev SharmaIBM Worldwide Lead – DevOps Technical SalesExecutive IT Specialist, IBM Software [email protected]

Twitter: @sd_architectBlog: http://bit.ly/sdarchitect Author: DevOps For Dummies: http://ibm.co/devopsfordummies

Enabling DevOps for the Cloud

2 IBM Federal Cloud Innovation Center © 2013 IBM Corporation

Agenda

• DevOps – a Lean approach

• DevOps and Cloud – deploying to the cloud

• Codename: BlueMix and IBM DevOps Services

• Future Directions: OpenStack Cloud Pattern support


Agenda






DevOpsDevOpsTransformatioTransformatio

nn

The Hidden Factory Opportunity

WasteProductive

8080%

20%

5050%

50%

Hidden Factory= additional value you could create if you eliminated waste and redirected those resources at innovation

5 IBM Federal Cloud Innovation Center © 2013 IBM Corporation5

The Big Sources of Wasted Efforts: Find the Hidden Factory

Type of Waste Create Feature Deliver Feature

Unnecessary Overhead

Communicating ideas/knowledge Communicating between development and operations

Unnecessary Re-work

Tasks assigned back to developers from testing and usage

Tasks assigned back to developers from production rollbacks

Over-production Unnecessary functionality produced Unnecessary hardware, data center, personnel

Non-Value-added waste

Value-added production work

DevOpsTransformation


DevOps approach: Apply Lean principles accelerate feedback and improve time to value

Line-of-business

Customer

1

3

2

1. Get ideas into production fast2. Get people to use it3. Get feedback

Adopt DevOps approach to continuously manage changes, obtain feedback and , deliver changes to users

Change speed must be an asset, Not an anchor

1. Get ideas into production fast2. Get people to use it3. Get feedback

Adopt DevOps approach to continuously manage changes, obtain feedback and , deliver changes to users

Change speed must be an asset, Not an anchor

Non-Value-added waste

Value-added production work

DevOpsTransformation


The Artifact-Centric Supply Chain

Delivering software based features requires 2 kinds of artifacts

1. Primary Artifacts: Product deliverables• Design, Code, Test

– Working on primary artifacts is predominantly VALUE-ADDED work

2. Supporting Artifacts: Artifacts in support of the deliverables• Plans, specifications, models, documentation, training, test stubs/drivers, progress

reports, measurements, tradeoff studies, change requests, problem reports, compliance analyses, certifications.

– Working on supporting artifacts is predominantly OVERHEAD work

Moving, managing, monitoring and measuring, primary and supporting artifacts more efficiently is the key to tapping into the Hidden Factory

Improve Artifact-Centric Supply Chain FLOWImprove Artifact-Centric Supply Chain FLOW


Measure the Product Pipelines

Value is accrued as the product artifacts evolve, NOT by the activity performed or effort expended

Proposed

Committed

Used

Delivered

Operational

Simple product pipeline measures provide instrumentation for steering:Time: Volume: Cycle time Batch sizeMTTR Queue sizeQueue time Throughput

• Manage backlog/queues • Optimize work in progress (WIP) • Adjust capacity

Developed

Integrated

Understood

Tested

Validated


Business Outcomes and Operational Objectives

Faster Time to Value– Reduced cycle times

– Industrialization

Improved predictability – Operational excellence

– Uncertainty reduction

Improved customer satisfaction– Customer alignment

– Transparency in real time

Improved efficiency– Waste reduction, reduced overhead, rework, overproduction

– Capex / Opex optimization


The DevOps Adoption Framework uncovers Hidden Factory Opportunities

Fat efforts to minimize Waiting Training

Reporting TraceabilityLate rework

Duplicate effortsMetrics collection

Regression testingChange propagationDocument generationMeetings/CheckpointsSystem administrationResource accountingHuman inspections

Streamline or automate

More Valuable efforts to improveScoping LearningFeedback

RefactoringDesigningTeamingCodingTesting

PlanningEngineeringEmpoweringPredictionDecidingSteering

Facilitate or smarten


Priorities of Indian Global System Integrators (200 responses)

Fat efforts to minimize

Late rework Waiting

Regression testing Duplicate efforts

Reporting

Document generation Training

Metrics collection Change propagation

Traceability Human inspections

Meetings/Checkpoints System administration Resource accounting

Streamline or automate

More Valuable efforts to improve

Scoping Designing Planning Testing

Reusing

Deciding Steering Feedback Coding

Prediction Engineering

Learning Teaming

Refactoring

Facilitate or smarten


DevOps Adoption Model

Inefficient Leaner Leaner and Smarter

EfficiencyProductive : Waste

CollaborativeCollaborativeSilo-ed Silo-ed MoreContinuous

MoreContinuous

Process-basedProcess-based

Process-heavyProcess-heavy AgileAgile MorePredictable

MorePredictable

ManualManual AutomatedAutomated MoreTransparent

MoreTransparent

SteerPlan, decide, specify,

architect, senseand respond

Develop/TestDesign, code, build,

release internal,

test, and verify

OperateMonitor, tune,

and validate

DeployBuild, deliver external,

and validate

OptimizingOptimizingProduct-basedProduct-based …

…

…

…

http://bit.ly/IBMDevOpsAssess


Implementing a DevOps toolchain

SCM

Build / CI Server

Unit testingTest Automation

Test Stubbing

Delivery Pipeline

Environment Configuration

Automated Monitoring

Asset Repository


Release Automation with UrbanCode

Drive down cost

Remove manual effort and wasted resource time with push button deployment processes

Speed time to market

Simple, graphical process designer, with built-in actions to quickly create deployment automation

Reduce risk

Robust configuration management, coordinated release processes, audits, and traceability

Enabling clients to more rapidly deliver mobile, cloud, big data and traditional applications with high quality and low risk

IBM UrbanCode Deploy automates the deployment of applications, databases and configurations into development, test and production environments, helping to drive down cost, speed time to market with

reduced risk.

IBM UrbanCode Release is an intelligent collaboration release management solution that replaces error-prone manual spreadsheets

and streamlines release activities for application and infrastructure changes.

https://www.ibmdw.net/urbancode/


Continuous Delivery Pipeline


Agenda






IBM Cloud Offering

DevOps


DevOps and Cloud adoptionAutomating for faster delivery with DevOps and cloud

Networking Networking

Storage Storage

Servers Servers

Virtualization Virtualization

O/S O/S

Middleware Middleware

Mid Config Mid Config

Data Data

Applications Applications

Traditional On-Premises

Infrastructureas a Service

Manual

Customization; higher costs; slower time to valueCustomization; higher costs; slower time to value

Standardization; lower costs; faster time to valueStandardization; lower costs; faster time to value

Man/Auto

UC Deploy UC Deploy

Man/Auto

Networking

Storage

Servers

Virtualization

O/S

Middleware

Mid Config

Data

Applications

Platformas a Service

Codename: BlueMixPureApplication

System

SmartCloud Orchestrator

SoftLayer

JazzHub

(SaaS)


On the Cloud | to the Cloud | for the Cloud

Cloud Hosted EnvironmentsCloud Hosted Environments

Cloud Hosted Environments

Cloud Hosted Environments

Dev-Test (pre-Prod) Prod

On-Premises On Cloud

On Cloud On-Premises

On Cloud On Cloud

Private Clouds Hybrid Public Clouds




Storage Storage

Servers Servers


O/S O/S



Data Data




Manual



Man/Auto

UC Deploy UC Deploy

Man/Auto

Networking

Storage

Servers

Virtualization

O/S

Middleware

Mid Config

Data

Applications



System


SoftLayer

JazzHub

(SaaS)


Driving consistency with IBM’s patterns of expertise

What’s required…What the business wants… What a pattern automates…

Patterns of Expertise:

Proven best practices and expertise learned from decades of client and partner engagements

• Pre-defined architecture of an application or Cloud service

• Captures best practices for complex tasks• Optimized into a deployable form for private

or public cloud• Repeatable deployment with full lifecycle

management reducing operational costs


IBM UrbanCode Deploy

Artifact Library

Application Resource Template

Continuous Delivery with Cloud: IBM Cloud Platforms

SCMSCM Build AutomationBuild Automation

DEVDEV QAQA PRODPROD

Provision infrastructure Execute application deployment and manage settings across environments

Publish builds

Pull changes

IBM SmartCloud Orchestrator

IBM PureApplication System

Cloud Environments

Manage source code for apps under development

Execute provision with configuration settings

Application binaries (versioned)

Environment configurations (versioned)

Automate provisioning of environments as part of the end-to-end delivery process – Establish and automate deployment of Application Blueprint with resource templates imported from Cloud patterns.

Deploy early and often to ensure high quality and faster releases using repeatable, reliable, and managed automation - Seamless process flow for incremental, full stack provisioning and application deployment automation


Deployment Automation

BlueprintBlueprint

ApplicationApplication Resource TemplateResource Template

Continuous Delivery to IBM Cloud – Virtual System Patterns

Capture cloud pattern to be used for creating an Environment

Incremental deployment of application builds to cloud environments

Map the application to multiple cloud patterns

The freedom to provision a version of a full stack or incrementally deploy an application version into an already provisioned environment

Environments | Processes | Configurations

Create env from pattern

Deploy app QAQA PRODPRODDEVDEVDEVDEVDEVDEVDEVDEV

Import pattern

Cloud Platform


Application Deployment vs Environment ProvisioningWhat does the Cloud do?

Compute | Storage

Compute | Storage

OSOS

Packaged SoftwarePackaged Software

ApplicationApplication

MiddlewareMiddleware

Compute | Storage

Compute | Storage

OSOS

Packaged SoftwarePackaged Software

MiddlewareMiddleware

NetworkNetwork

Cloud

Provisioning (IBM PureApplication System, IBM SmartCloud, Softlayer)

Cloud Management


Capabilities

Security, approvals and promotion of applications through different stages.

Automated Deployment of all components of Application (DB, Web, Mobile)

Automated Middleware configuration required for Application Deployment

Discover MW Configuration for WAS

Virtual System Pattern Creation and Provisioning

Self Service Portal for VM Provisioning

Image Library (Search / Compare, Versioning, and SW Stacks)

Basic Single Image Composition, Manipulation of images with pre-configured middleware

Multi-tenancy, Isolation, Rapid , Scalable Provisioning

Cloud Administration

Fast Moving…

Slow Moving…


A “Continuous Delivery Pipeline” with Cloud

CLM / SCM

Cloud Provider

PROD Stage

Continuous Integration / Build Management

and Automation

ArtefactRepository

INT Stage`

QA Stage

Dev Stage`

Test Mgmt / Test Automation

DeplyomentAutomation

[triggers]

[get artifatcs]

[publish artifacts /trigger Deployment]

[provision environment / deploy into Cloud]

ServiceVirtualization

[store artifacts]

[setup]

RequirementsMgmt.

[plan work items / version source code]

Development

[specifyBusinessrequirements]

[get sources]


System on

A new model for application deployment & management in hybrid cloud

QAQAPRODPRODDEVDEVDEVDEVDEVDEVDEVDEV


BlueprintBlueprint

Application ComponentsApplication

ComponentsResource TemplateResource Template

Environments | Processes | Configurations

Databases Mainframe

applicationsThird-partyServices

Virtualized Services

HybridHybrid

Databases Test Templates

Scrambled

Test dataTest Data Management


Agenda








Storage Storage

Servers Servers


O/S O/S



Data Data




Manual



Man/Auto

UC Deploy UC Deploy

Man/Auto

Networking

Storage

Servers

Virtualization

O/S

Middleware

Mid Config

Data

Applications



System


SoftLayer

JazzHub

(SaaS)


DevOps Services

• Easy Access - Get started for free. With Git hosting and the built-in Web IDE, it's zero to code in seconds.

• Code Now - Use the built-in Web IDE, Eclipse, Visual Studio, or your tool of choice.

• Automated Deployment - Auto-deploy your applications to IBM's cloud platform, Codename BlueMix.

• Team Collaboration - Share your work and collaborate through expert tools for Agile Development.

Software development in the cloud


DevOps for BlueMix: Delivery pipelines as a Service

Developer

Running Application(Dev Space)Running Application(Dev Space)

Create & edit

Running Application(test)Running Application(test) Running Application

(Prod Space)Running Application (Prod Space)

Running Application(Test Space)Running Application(Test Space)

Everything is a service in the Cloud

Deploy & test

Build Publish build

Deploy

Promote

Test as a ServiceTest as a Service

Test

Monitoring as a ServiceMonitoring as a Service

Monitor

Dev as a ServiceDev as a Service Build as a ServiceBuild as a Service Deploy as a ServiceDeploy as a Service


IBM Codename: Bluemix - DevOps services

DevOps in the Cloud

From idea to production in minutes

Collaboration

Tracking

Planning

Platform as a Service

Runtimes &Frameworks

Application services

Explore Services

Test / Run

Operational services

Middleware services

Jazz SCM

or GitHub

Orion Web IDEEclipse IDE

Check in code

CLI, 3rd party

Continuous Integration

Continuous Deployment

Retrieve code

Submit defects

Mobile Quality Assurance

ApplicationCompositionEnvironment

Create & manage services

• Team Collaboration & Agile Project Management

• Continuous Delivery Pipeline

• Develop

DevOps

Services

Third Party

BlueMix


IBM DevOps Services for Cloud (SaaS)

Git hostingStore and manage the code for your application in the hosted Git repo.

Mobile qualityImprove mobile app quality through crash analytics, sentiment analysis, and feedback.

Integrated Development Environment

Agile planning & tracking, team collaboration

Performance monitoringIdentify the early occurrence and root cause of performance issues, not just the symptoms, throughout the application lifecycle. Conduct code level diagnostics to identify bottlenecks and optimize application performance.

Easily share work and collaborate with team members.

Use built-in Web IDE, Eclipse, Visual Studio or leverage your tool of choice.

Deployment automationInstantly deploy your applications.

Continuous IntegrationContinuously build, scan, and test code to improve quality and increase speed of delivery.

Open, integrated rapid development experience that scales

Planned Services


Agenda






Environments

QA PROD

Banking Application Banking Application

Banking Application

DEV


OpenStack HeatIBM Platform Resource Scheduler

Server StorageNetwork

Application Lifecycle

Applications

Heat Orchestration Template (HOT)Heat Orchestration Template (HOT)

OpenStack HeatIBM Platform Resource Scheduler

Server StorageNetwork

TEST

IBM Cloud Orchestrator

Moving to open technologies

PublicDedicated PrivateTraditional

IT

Application template

Infrastructure

template

Hardware


What is OpenStack?

35

OpenStack is a global collaboration of developers & cloud computing technologists working to produce an ubiquitous Infrastructure as a Service (IaaS) open source cloud computing platform for public & private clouds.

Platinum SponsorsPlatinum Sponsors


HEAT and HOT: The Future of Cloud ‘Templates’

36


Organic environments

Version-aware

Full-stack engineering

Composable content

Cloud agnostic

Organic environments

Version-aware

Full-stack engineering

Composable content

Cloud agnostic

Cloud Pattern Designer

HOT document editor & Environment lifecycle management tool

A full-stack engineering solution for designing, deploying, and managing environments

Components

Resources

Heat Templates (HOT)

Building Blocks

HOTHOTExecutes on

Next generation pattern development and lifecycle management

OpenStack Heat

Tool

Engine

Platforms


Resources:

DevOps Lean Assessment (Beta): http://bit.ly/IBMLeanAssess

IBM DevOps Page: http://ibm.com/DevOps

DevOps For Dummies Book: http://ibm.co/devopsfordummies

Release and Deploy For Dummies Book: http://ibm.co/1bplaQV

IBM DevOps YouTube Playlist: http://bit.ly/1fiDOtl


© Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

Technology

Enabling DevOps in the cloud - Federal Cloud Innovation Center