87
TUGA IT 2017 LISBON, PORTUGAL

La La Land of DevOps Integration (TugaIT)

Embed Size (px)

Citation preview

Page 1: La La Land of DevOps Integration (TugaIT)

TUGA IT 2017LISBON, PORTUGAL

Page 2: La La Land of DevOps Integration (TugaIT)

THANK YOU TO OUR SPONSORSPLATINUM

GOLD SILVER

Page 3: La La Land of DevOps Integration (TugaIT)

PARTICIPATING COMMUNITIESCLOUD PRO PT

Page 4: La La Land of DevOps Integration (TugaIT)

La La Land of DevOps Integration

Manuel Pais | Skelton Thatcher Consulting@manupaisable | skeltonthatcher.com

TugaIT 2017 / @tugaitconf / #tugait19 May 2017, Lisbon PT

Page 5: La La Land of DevOps Integration (TugaIT)

Continuous Delivery (Tooling) (Anti-)Patterns

Manuel Pais | Skelton Thatcher Consulting@manupaisable | skeltonthatcher.com

TugaIT 2017 / @tugaitconf / #tugait19 May 2017, Lisbon PT

Page 6: La La Land of DevOps Integration (TugaIT)

Today1. DevOps integration: two camps 2. Pattern #1: Best of breed tools3. Pattern #2: Pipeline = workflow4. Pattern #3: Own your golden logs

Page 7: La La Land of DevOps Integration (TugaIT)

About meManuel Pais

@manupaisable

Consultant at Skelton Thatcher Consulting

Page 8: La La Land of DevOps Integration (TugaIT)
Page 9: La La Land of DevOps Integration (TugaIT)

teamtopologies.com

Upcoming book:

Team Topologies for effective software systems

by Matthew Skelton & Manuel Pais

Page 10: La La Land of DevOps Integration (TugaIT)

releasabilitybook.com

Upcoming book:

Team Guide to Software Releasability

by Chris O’Dell & Manuel Pais

Page 11: La La Land of DevOps Integration (TugaIT)

Team-first digital transformation30+ organisations

UK, US, DE, PT, India, Chinaskeltonthatcher.com

Page 12: La La Land of DevOps Integration (TugaIT)

Today1. DevOps integration: two camps 2. Pattern #1: Best of breed tools3. Pattern #2: Pipeline = workflow4. Pattern #3: Own your golden logs

Page 13: La La Land of DevOps Integration (TugaIT)

“integrating various tools in software

delivery is very hard”

“a toolchain is a design pattern that everybody

can agree on”

Page 14: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Tool

In the left corner…

Page 15: La La Land of DevOps Integration (TugaIT)

Integrated DevOps

Toolchain

In the right corner…

Page 16: La La Land of DevOps Integration (TugaIT)

Integrated DevOps

Toolchain

Integrated DevOps Tool

Page 17: La La Land of DevOps Integration (TugaIT)

Integrated DevOps

Toolchain

Integrated DevOps Tool

Page 18: La La Land of DevOps Integration (TugaIT)

Quick setup, familiarity

Less to worry about

Integrated DevOps Tool

Page 19: La La Land of DevOps Integration (TugaIT)

Long term ownership

Best tool for (each) job

Integrated DevOps Toolchain

Page 20: La La Land of DevOps Integration (TugaIT)

tool choices…are trade-offs

Page 21: La La Land of DevOps Integration (TugaIT)

the problem is not being aware of those trade-offs

Page 22: La La Land of DevOps Integration (TugaIT)

some patternsbecome extremely hardwith integrated tools…

Page 23: La La Land of DevOps Integration (TugaIT)

Today1. DevOps integration: two camps 2. Pattern #1: Best of breed tools3. Pattern #2: Pipeline = workflow4. Pattern #3: Own your golden logs

Page 24: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Tool

Page 25: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Toolchain

Page 26: La La Land of DevOps Integration (TugaIT)

single-purpose toolsneed APIs to survive

Page 27: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Tool

Page 28: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Toolchain

Page 29: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Toolchain

Page 30: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Toolchain

Page 31: La La Land of DevOps Integration (TugaIT)

a flexible toolchain standardizes practices,

not tools

Page 32: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Tool

Page 33: La La Land of DevOps Integration (TugaIT)

Integrated DevOps Tool

Page 34: La La Land of DevOps Integration (TugaIT)

tooling should evolvewhen YOU need it

Page 35: La La Land of DevOps Integration (TugaIT)

Limit blast radius

Page 36: La La Land of DevOps Integration (TugaIT)

tightly coupled tooling

Page 37: La La Land of DevOps Integration (TugaIT)

tightly coupled tooling

Page 38: La La Land of DevOps Integration (TugaIT)

tightly coupled tooling

Page 39: La La Land of DevOps Integration (TugaIT)

tightly coupled tooling

Page 40: La La Land of DevOps Integration (TugaIT)

limit blast radius

Page 41: La La Land of DevOps Integration (TugaIT)
Page 42: La La Land of DevOps Integration (TugaIT)

poorly understood concepts

Page 43: La La Land of DevOps Integration (TugaIT)

poorly understood concepts

Page 44: La La Land of DevOps Integration (TugaIT)

Today1. DevOps integration: two camps 2. Pattern #1: Best of breed tools3. Pattern #2: Pipeline = workflow4. Pattern #3: Own your golden logs

Page 45: La La Land of DevOps Integration (TugaIT)

what’s missing?

Page 46: La La Land of DevOps Integration (TugaIT)

what’s missing?we tend to care about

technical bits only…

Page 47: La La Land of DevOps Integration (TugaIT)
Page 48: La La Land of DevOps Integration (TugaIT)
Page 49: La La Land of DevOps Integration (TugaIT)

painful bottlenecksin team interactions

Page 50: La La Land of DevOps Integration (TugaIT)

bottlenecks = silos

time is lost in queues, not execution

Page 51: La La Land of DevOps Integration (TugaIT)

automating hand-offs requires trust… which in

turn requires time

Page 52: La La Land of DevOps Integration (TugaIT)

breaking down silos is HARD!

Page 53: La La Land of DevOps Integration (TugaIT)

extra credit…

Page 54: La La Land of DevOps Integration (TugaIT)

non-technical stakeholdersare part of delivery too

Page 55: La La Land of DevOps Integration (TugaIT)

pipeline = (real) workflow

highlight bottlenecks => build bridgestrust requires time => automate gradually

not just technical => include everyone

Page 56: La La Land of DevOps Integration (TugaIT)

pipeline = (real) workflow

highlight bottlenecks => build bridgestrust requires time => automate gradually

not just technical => include everyone

Page 57: La La Land of DevOps Integration (TugaIT)

pipeline = (real) workflow

highlight bottlenecks => build bridgestrust requires time => automate gradually

not just technical => include everyone

Page 58: La La Land of DevOps Integration (TugaIT)

Today1. DevOps integration: two camps 2. Pattern #1: Best of breed tools3. Pattern #2: Pipeline = workflow4. Pattern #3: Own your golden logs

Page 59: La La Land of DevOps Integration (TugaIT)

the problem with logs

Page 60: La La Land of DevOps Integration (TugaIT)

111.222.333.123 HOME -[01/Feb/1998:01:08:39 -0800] "GET /bannerad/ad.htm HTTP/1.0" 200 198 "http://www.referrer.com/bannerad/ba_intro.htm" "Mozilla/4.01 (Macintosh; I; PPC)"

Page 61: La La Land of DevOps Integration (TugaIT)

the (other) problem with logs

Page 62: La La Land of DevOps Integration (TugaIT)

the (other) problem with logs

too much information

information hiding

Page 63: La La Land of DevOps Integration (TugaIT)

the (other) problem with logs

information hiding

Page 64: La La Land of DevOps Integration (TugaIT)

the (other) problem with logsintegrated tools

information hiding

Page 65: La La Land of DevOps Integration (TugaIT)

the (other) problem with logs

too much information

information hiding

Page 66: La La Land of DevOps Integration (TugaIT)

the (other) problem with logs

too much information

Page 67: La La Land of DevOps Integration (TugaIT)
Page 68: La La Land of DevOps Integration (TugaIT)

difficult to use log aggregation to diagnose pipeline issues with an integrated DevOps tool

Page 69: La La Land of DevOps Integration (TugaIT)
Page 70: La La Land of DevOps Integration (TugaIT)

information hiding should not be the reason why you can’t diagnose

Page 71: La La Land of DevOps Integration (TugaIT)

the problem with error messages

Page 72: La La Land of DevOps Integration (TugaIT)

generic error messages

Page 73: La La Land of DevOps Integration (TugaIT)

generic error messages

“VM could not be started”

Page 74: La La Land of DevOps Integration (TugaIT)

generic error messages

“VM could not be started”

“Deployment failed”

Page 75: La La Land of DevOps Integration (TugaIT)
Page 76: La La Land of DevOps Integration (TugaIT)

without correct error information you can’t

diagnose/improve

Page 77: La La Land of DevOps Integration (TugaIT)

log aggregation

own your logsquickly find correlated events

don’t depend on generic error messagesextract pipeline metrics (bonus)

Page 78: La La Land of DevOps Integration (TugaIT)

Today1. DevOps integration: two camps 2. Pattern #1: Best of breed tools3. Pattern #2: Pipeline = workflow4. Pattern #3: Own your golden logs

Page 79: La La Land of DevOps Integration (TugaIT)

Tomorrow

tooling choices are trade-off choices

Page 80: La La Land of DevOps Integration (TugaIT)

Tomorrow

tool chain ownership supports evolution

Page 81: La La Land of DevOps Integration (TugaIT)

Tomorrow

visualize real workflow to break down silos

Page 82: La La Land of DevOps Integration (TugaIT)

Sources• Betty Zakheim, 2017, ‘How Difficult Can It Be to Inte-

grate Software Development Tools? The Hard Truth’,https://www.infoq.com/articles/tool-integration-hard-truth

• Damon Edwards, 2014 ‘DevOps is an Enterprise Concern’,https://www.infoq.com/interviews/interview-damon-edwards-qcon-2014

• Don G. Reinertsen, 2009, ‘The Principles of Product Development Flow: Second Generation Lean Product Development’ https://www.youtube.com/watch?v=L6v6W7jkwok

Page 83: La La Land of DevOps Integration (TugaIT)

thank you

Manuel Pais@manupaisable

skeltonthatcher.com

Page 84: La La Land of DevOps Integration (TugaIT)

La La Land of DevOps Integration

Manuel Pais | Skelton Thatcher Consulting@manupaisable | skeltonthatcher.com

TugaIT 2017 / @tugaitconf / #tugait19 May 2017, Lisbon PT

Page 85: La La Land of DevOps Integration (TugaIT)

PLEASE FILL IN EVALUATION FORMSFRIDAY, MAY 19th SATURDAY, MAY 20th

https://survs.com/survey/cprwce7pi8 https://survs.com/survey/l9kksmlzd8

YOUR OPINION IS IMPORTANT!

Page 86: La La Land of DevOps Integration (TugaIT)

THANK YOU TO OUR SPONSORSPLATINUM

GOLD SILVER

Page 87: La La Land of DevOps Integration (TugaIT)

Short and Wide Pipeline