From managing to leading test improvement...Iterave RAD TDD ATDD BDD W‐model XP Con9nuous Integraon/Delivery MBT

From managing to leading

test improvement

Ruud Teunissen

Lesson # 1

www.eurostarconferences.com

The Evolu2on of IT and Tes2ng

Pioneering

Structured

Op9mal


Prototyping

Waterfall Agile/Scrum

V-‐model Spiral model DEVOPS

Itera9ve RAD TDD ATDD BDD

W-‐model XP Con9nuous Integra9on/Delivery

MBT

Exploratory CDT RST RSTM

TMap ISEB ISTQB TMap-‐Next

Packages SOA Devices Social media

Virtualiza9on Cloud Mobile Internet of Things

Web Localiza9on Big Data

The Evolu2on of IT and Tes2ng


SPI and TPI Ini2a2ves

ISO IEEE MIL-STD CMM PSP TSP TMM TI4Agile CMMI TMMI Juran SEI STEP TPI BS 5750 TSM V2M2 TI4Auto CTPI TPI-Next TQC Deming IDEAL ISO9000-9126 TIM TOM STEP TOGA Cloutest CTP ……


Prototyping





MBT






Challenge: Current TPI-‐models don’t match


Current & future test improvement has to be…

Situa9onal – Con9nuous – Joint effort – Resilient

Fast Flexible

Lean Effec9ve

People Driven – Prac9cal – Sustainable

Test

Process

Improvement

Lesson # 2


Innova2on of test improvement

•  Learning from the past

•  Using successful “recent” innova9ons –  Agile

–  Scrum

–  Kanban

–  Exploratory

–  Context Driven

–  Collabora9ng

–  Con9nuous

•  Good prac9ces

Improvement

backlog Improvement ac9ons

Assessment tasks

Improvement tasks

Test Improvement Intake (Objec9ve – Scope – Approach)

Assessment Improvement

‘Plan’

Lesson # 3

Con9nuous Test Improvement at two levels

Architecture

Implementa9on

Lesson # 4


Test Improvement Intake

•  Objec9ves –  Time, Cost, Q(Product), Q(Test), …

•  Scope –  Area, Size, Test, Development, …

•  Resources –  Budget, Time, TI-‐skills, …

•  Culture

•  Context

•  Maturity (best guess)


Prototyping





MBT









•  Objec9ves –  Time, Cost, Q(Product), Q(Test), …

•  Scope –  Area, Size, Test, Development, …

•  Resources –  Budget, Time, TI-‐skills, …

•  Culture

•  Context

•  Maturity (best guess)

Sugges2on # 1


Select the right model / approach

•  Bound

–  TPI Next

–  TMMI

–  STEP

–  CTP

–  GQM

–  ……

•  Focused –  TI4Agile

–  TI4Automa9on

–  CTPI

–  SFAI-‐web

–  Belbin

–  ……



•  Unbound –  Experience based

–  Heuris9c •  Ques9oning

•  Discussing

–  Implicit knowledge

–  Exploring

–  Idea raising sessions

–  Out-‐of-‐the-‐Box

–  Mind mapping

–  Good Prac9ces

•  Bound

–  TPI Next

–  TMMI

–  STEP

–  CTP

–  GQM

–  ……


–  TI4Automa9on

–  CTPI

–  SFAI-‐web

–  Belbin

–  ……


Using heuris2cs

How do you feel?

Ever felt this before?

How about your work?

Doing sports?

How is your family?

In the morning?

When was that?

Need to walk?

At what level?

Simular complaints?

Before breakfast?

…

…

…

…


Addi2onal Approaches



•  Discussing


–  Exploring

–  Mind mapping




•  Bound

–  TPI Next

–  TMMI

–  STEP

–  CTP

–  GQM

–  ……


–  TI4Automa9on

–  CTPI

–  SFAI-‐web

–  Belbin

–  ……


Mind mapping & Idea raising session

•  Organize a mee9ng –  Lean, informal, 3-‐10 people,

< 2 hours, coffee, post-‐it’s

•  Kick-‐off –  Define objec9ves

–  Set the right focus

•  Ideas –  Individual “brain dump”

–  Use post-‐it’s

–  Explain, explore, ques9on, discuss

–  Cluster and group ideas, …

–  Use Mind-‐mapping

•  Priori9ze according to objec9ves –  E.g. term, costs, impact

•  List results, ac9ons, epics, stories, … –  Who, what, why, …





•  Discussing


–  Exploring

–  Mind mapping




–  …

•  Bound

–  TPI Next

–  TMMI

–  STEP

–  CTP

–  GQM

–  ……


–  TI4Automa9on

–  CTPI

–  SFAI-‐web

–  Belbin

–  ……


Combine whatever contributes



•  Discussing


–  Exploring

–  Mind mapping




–  …

•  Bound

–  TPI Next

–  TMMI

–  STEP

–  CTP

–  GQM

–  ……


–  TI4Automa9on

–  CTPI

–  SFAI-‐web

–  Belbin

–  ……

Lesson # 5


Combine whatever contributes

•  Bound

–  TPI Next

–  TMMI

–  STEP

–  CTP

–  GQM

–  ……


–  TI4Automa9on

–  CTPI

–  SFAI-‐web

–  Belbin

–  ……



•  Discussing


–  Exploring



–  Mind mapping


Hybrid


Bound (Focused) Unbound

Asses according to the model Assess by means of

Collect improvement sugges9ons

…

Interviews

Idea raising sessions

Heuris9cs

Study

…

…

Walk around

Test along

Ajend mee9ngs

Feedback and react

…

Test Improvement Intake (Objec9ve – Scope – Approach)

Assessment Improvement

‘Plan’

Sugges2on # 1

Improvement Epics & Stories

Improvement

Architect

Improvement SCRUM Master

Owner Team Member

Improvement Backlog

Sprint Backlog

2 - 4 weeks

Sprint

Improvement increment

(Bi)

Weekly

DoD


Improvement Epics & Stories

As product manager,

I want to increase the release frequency of new and changed features,

so that we will be more compe88ve

As senior IT-‐director,

I want to increase dev & test efficiency,

so that we can dev & test more with the same effort

As scrum team member,

I want to automate the regression tests,

so that we can test more new and changed features during a sprint


Towards Improvement Sprint Backlog

•  Refine and priori9ze –  In line with the objec9ves (Time, Cost, Q(Product), Q(Test), …)

–  Respec9ng the scope (Area, Size, Test, Development, …)

•  The team defines tasks, effort, …

–  Inves9gate open source tools for regression tes9ng

–  Assess the level of unit tes9ng

–  Implement a tes9ng dashboard

–  Hire a test automa9on specialist

If I tell you, you will forget

If I show you, you’ll remember

If I involve you, you will understand

Confucius

Lesson # 6

Sugges2on # 2

Integrate improvement & Business as Usual

Improvement

Business as Usual

Improvement Backlog

Sprint Backlog

2 - 4 weeks

Sprint

Improvement increment

(Bi)

Weekly

DoD

Product Backlog

Sprint Backlog

2 - 4 weeks

Sprint

Working increment

Daily

DoD

Sugges2on # 2 Business as Usual

Improvement

Improvement & Product Backlog

Sprint Backlog

2 - 4 weeks

Sprint

Working &/ Improvement

increment

Daily

DoD

Improvement Backlog

Product Backlog


Conclusion

•  The situa9on sets the improvement approach

•  Integrate improvement with BAU using Scrum

From managing to leading Test Improvement

The manager administers, the leader innovates

The manager maintains, the leader develops

The manager relies on systems and tools, the leader on people

The manager counts on control, the leader counts on trust

The manager does things right, the leader does the right thing

Lesson # 8


Ruud Teunissen

Senior Test Consultant

Polteq Test Services BV [email protected] – @RuudTeunissen

Ques9ons?

red velvet whoopie pies

Documents

From managing to leading test improvement...Iterave RAD TDD ATDD BDD W‐model XP Con9nuous Integraon/Delivery MBT