56
http://thoughtworks-studios.com / Scaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO Århus Jez Humble, ThoughtWorks Studios @jezhumble #continuousdelivery http://continuousdelivery.com /

Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

http://thoughtworks-studios.com/

Scaling DevopsBreaking Down the Barriers between Development and IT Operations

October 10, 2011, GOTO Århus

Jez Humble, ThoughtWorks Studios@jezhumble #continuousdeliveryhttp://continuousdelivery.com/

Page 2: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

business agility

“The main obstacles to improved business responsiveness are slow decision-making, conflicting departmental goals and priorities, risk-averse cultures and silo-based information.”

Economist Intelligence Unit: “Organisational agility:How business can survive and thrive in turbulent times”

Page 3: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

“the enterprise”

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Page 4: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

“the enterprise”

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Ping!

Page 5: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Let’s createa new

product

enterprise projects

Value stream

OperationsEngineeringBusiness

Page 6: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Let’s createa new

product

enterprise projects

Value stream

OperationsEngineeringBusiness

Page 7: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Let’s createa new

product

enterprise projects

Value stream

OperationsEngineeringBusiness

Page 8: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Ping!

Let’s createa new

product

enterprise projects

Value stream

OperationsEngineeringBusiness

Page 9: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Ping!

Let’s createa new

product

enterprise projects

Value stream

OperationsEngineeringBusiness

Page 10: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Ping!

Let’s createa new

product

enterprise projects

Value stream

OperationsEngineeringBusiness

Project D

Page 11: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Project D

We’re going agile!

Value stream

OperationsEngineeringBusiness

Page 12: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Project D

We’re going agile! Oh crap!Oh crap!

Value stream

OperationsEngineeringBusiness

Page 13: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Page 14: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Page 15: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Page 16: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Page 17: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Our test-driven code follows SOLID

principles

Page 18: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Our test-driven code follows SOLID

principles

Shame itdoesn’t work

Page 19: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Project D

Our test-driven code follows SOLID

principles

Shame itdoesn’t work

Changemanagement

Page 20: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

cultureautomation

measurementsharing

devops

Page 21: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

culture

• ops involved in inceptions, showcases, retrospectives

• devs go to weekly ops stand-ups

• devs rotate through ops

• devs carry pagers

• organize your incentives (Hawthorne e!ect)

Page 22: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

automation

• build, deploy, test release (deployment pipeline)

• provisioning & management of infrastructure and environments (infrastructure-as-code)

• database migrations and deployments

Page 23: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

measurement

• business metrics - revenue, # orders, # users

• ops metrics - changes, incidents, TTD, TTRS, TBF

• technical metrics - TPS, response time, hits

• root cause analysis - which changes break stu!?

Page 24: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

sharing

• celebrate success together (one team)

• knowledge

• tools and techniques (bdd, refactoring, continuous integration)

Page 25: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Page 26: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

developers write production-ready code

continuous delivery

Page 27: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

developers write production-ready code

everyone collaborates throughout lifecycle

continuous delivery

Page 28: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

faster feedback loops

developers write production-ready code

everyone collaborates throughout lifecycle

continuous delivery

Page 29: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

faster feedback loops

developers write production-ready code

everyone collaborates throughout lifecycle

lower-risk, more reliable releases

continuous delivery

Page 30: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

faster feedback loops

developers write production-ready code

everyone collaborates throughout lifecycle

done means released

lower-risk, more reliable releases

continuous delivery

Page 31: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

agile triangle

value(releasable product)

quality(reliable, adaptable product)

constraints(cost, schedule, scope)

Jim Highsmith: Agile Project Management

Page 32: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

do less

Far more than 50% of functionality in software is rarely or never used. These aren’t just marginally valued features; many are no-value features.

The Standish Group, reported in the IEEE conference 2002

Page 33: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

quality

“if we do not know who the customer is, we do not know what quality is”

the lean startup, ch. 6 - test

Page 34: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

build quality in

“Cease dependence on mass inspection to achieve quality. Improve the process and build quality into the product in the "rst place”

W. Edwards Deming

Page 35: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

ops still has all that legacy crap

but

Page 36: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

ops still has all that legacy crap

no way to rationally decide what to retire

but

Page 37: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

deciding what to do is command-and-control

ops still has all that legacy crap

no way to rationally decide what to retire

but

Page 38: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

deciding what to do is command-and-control

ops still has all that legacy crap

no way to rationally decide what to retire

people who can make the changes aren’t the ones feeling the pain

but

Page 39: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

You build it,You run it

werner vogels, cto, amazon

Page 40: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Project A

Project B

Project C

DBAs

Infrastructure team

Service desk

Value stream

OperationsEngineeringBusiness

Treat these servicesas if they were products

Page 41: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

Service desk

Value stream

OperationsProducts / Services

Ping!

think product

IaaS

Ops management

Page 42: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

teams can measure cost and value delivered per product

therefore...

Page 43: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

teams can measure cost and value delivered per productteams can rationally determine what to prioritize in their product backlog

therefore...

Page 44: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

teams can self-manage using the lean startup methodology

teams can measure cost and value delivered per productteams can rationally determine what to prioritize in their product backlog

therefore...

Page 45: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

teams can self-manage using the lean startup methodology

teams can measure cost and value delivered per productteams can rationally determine what to prioritize in their product backlog

architecture group responsible for regulating and monitoring system-level attributes

therefore...

Page 46: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

teams can self-manage using the lean startup methodology

teams can measure cost and value delivered per productteams can rationally determine what to prioritize in their product backlog

PMO regulates and measures to prevent “market failure” and manage externalities

architecture group responsible for regulating and monitoring system-level attributes

therefore...

Page 47: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

architecture group

organizational change

Page 48: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

architecture group

PMO

organizational change

Page 49: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

operations

architecture group

PMO

organizational change

Page 50: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

operations

architecture group

PMO

business

organizational change

Page 51: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

risk management

enterprise governance

Page 52: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

risk management

SOX, ITIL, COBIT

enterprise governance

Page 53: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

segregation of duties

risk management

SOX, ITIL, COBIT

enterprise governance

Page 54: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

segregation of duties

risk management

SOX, ITIL, COBIT

change management

enterprise governance

Page 55: Scaling Devops - gotocon.comScaling Devops Breaking Down the Barriers between Development and IT Operations October 10, 2011, GOTO rhus ... faster feedback loops developers write production-ready

segregation of duties

risk management

SOX, ITIL, COBIT

auditing and compliance

change management

enterprise governance