35
T19 Test Management 5/5/16 15:00 Finding Success with Test Process Improvement Presented by: Gitte Ottosen CapgeminiSogeti Denmark Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 8882688770 9042780524 [email protected] http://www.stareast.techwell.com/

Finding Success with Test Process Improvement

Embed Size (px)

Citation preview

Page 1: Finding Success with Test Process Improvement

   

     T19  Test  Management  5/5/16  15:00              

Finding  Success  with  Test  Process  Improvement  

 Presented  by:  

 

Gitte  Ottosen  

Capgemini-­‐Sogeti  Denmark    

Brought  to  you  by:        

   

   

350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073    888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  [email protected]  -­‐  http://www.stareast.techwell.com/      

 

Page 2: Finding Success with Test Process Improvement

       

Gitte  Ottosen  Capgemini-­‐Sogeti  Denmark    Gitte  Ottosen  is  a  managing  consultant  at  Capgemini-­‐Sogeti  Denmark,  a  company  that  delivers  test  consultancy.  Â  As  a  career  tester,  Gitte  has  twenty  years’  experience  in  test  engineering,  test  management,  and  process  improvement  in  both  traditional  and  agile  contexts.  She  has  worked  in  test  process  improvement,  first  as  a  test  architect/manager  and  more  recently  as  a  test  coach  in  shipping,  the  public  sector,  and  health  care.  As  as  elf-­‐confessed  test  evangelist  who  preaches  the  need  for  a  structured  and  committed  approach  to  testing,  Gitte  is  a  strong  advocate  for  a  context-­‐driven  approach,  a  role  requiring  profound  professional  insight,  passion,  and  persistence.      

   

Page 3: Finding Success with Test Process Improvement

Improving the Test Process

Gitte Ottosen

[email protected]

godtesen

Page 4: Finding Success with Test Process Improvement

© CapgeminiSogeti 2

A bit about me

Gitte Ottosen

Capgemini Sogeti Danmark A/S

[email protected]

+45 52189711

Education

Corporal in the Royal Danish Airforce

Certifications

SCRUM master, ISEB foundation/practitioner,

CAT trainer, CABA, Tmap Test Engineer,

Tmap Test Manager, TPI Next foundation

Experience

• 20 years in the IT business

• 4 years in Capgemini Sogeti

Focus

Test management, test engineering, SCRUM,

process improvement, LEAN, agile, context

driven test, change management

Agile Experience

Customers: Systematic, Maersk Line IT,

DONG, KMD, TDC

Network

Test20/Tecpoint, CAT trainer network

Fellow Sogeti Labs

Page 5: Finding Success with Test Process Improvement

© CapgeminiSogeti

Going on a roadtrip

3

Page 6: Finding Success with Test Process Improvement

© CapgeminiSogeti

A Generic Change Process

4

Evaluate and redirect

Implement actions

Make a plan of action

Define improvements

(generate) Awareness

Determine goal, scope

and approach

Assess current situation

Reference model

Page 7: Finding Success with Test Process Improvement

© CapgeminiSogeti

Two Model Based Approaches

• Proces Model: Process models define generic bodies of testing best practice and how to improve different aspects of testing in a prescribed step-by-step manner.

– TMMI

– TPI

• Content Model: Content models are non-prescriptive; they do not require that improvements occur in a specific order. Instead, they define specific activities which can benefit a test process if applied well.

– STEP (Systematic Test and Evaluation Process)

– CTP (Critical Testing Process)

5

ISTQB Expert level Test Proces Improvement Syllabus

Page 8: Finding Success with Test Process Improvement

© CapgeminiSogeti

TMMI

6

Page 9: Finding Success with Test Process Improvement

© CapgeminiSogeti

The TMMI Maturity Levels

Level 1 – Initial

• Chaotic and undefined

Level 2 – Managed

• Managed process separated from development

• Existing practices retained

Level 3 – Defined

• Testing fully integrated into the project lifecycle

• Starting as early as requirements definition

Level 4 – Management and Measurement

• Testing thoroughly designed

• Well founded and measured

• Quantitative objectives for product quality

Level 5 – Optimisation

• Fully defined and continually self improving

• Controlling cost and effectiveness of testing

7

Page 10: Finding Success with Test Process Improvement

© CapgeminiSogeti

TMMI – Proces for Use

8

Page 11: Finding Success with Test Process Improvement

© CapgeminiSogeti

Guidelines for Rating

• Guidelines for the assessment team when rating:

– >85% = Fully Achieved

– <=85% >50% = Largely Achieved

– <=50% >15% = Partially Achieved

– <15% = Not Achieved

To achieve maturity level ALL process areas MUST be rated as

FULLY achieved

9

Page 12: Finding Success with Test Process Improvement

© CapgeminiSogeti

The TPI Next Model

Page 13: Finding Success with Test Process Improvement

© CapgeminiSogeti

16 Checkpoints

11

• Stakeholder Relations

• Test Management

• Test Profession

1. Stakeholder commitment

2. Degree of involvement

3. Test strategy

4. Test organisation

5. Communication

6. Reporting

12. Methodology practice

13. Tester professionalism

14. Test case design

15. Test tools

16. Test environment

7. Test process management

8. Estimating & planning

9. Metrics

10. Defect management

11. Testware management

Page 14: Finding Success with Test Process Improvement

© CapgeminiSogeti

TPI NEXT

12

Initial Controlled Efficient Optimizing

“Do the right thing” “Do things

right now”

“Do things right

In the future”

Page 15: Finding Success with Test Process Improvement

© CapgeminiSogeti

Business Driven Focus

13

Tool: http://www.tmap.net/tpi-downloads

Page 16: Finding Success with Test Process Improvement

© CapgeminiSogeti

Comparing TPI Next and TMMI - Differences

14

Rik Marselis and Geoo THompson

Page 17: Finding Success with Test Process Improvement

© CapgeminiSogeti

Comparing TPI Next and TMMI - Similarities

15

Rik Marselis and Geoo THompson

Page 18: Finding Success with Test Process Improvement

© CapgeminiSogeti

The Deming Cycle

William Edwards Deming

http://www.mindtools.com

http://www.management30.com

16

PLAN

DO

CHECK

ACT

Page 19: Finding Success with Test Process Improvement

© CapgeminiSogeti

Kaizen – Continuous Improvement

17

Define the problem

Document the current situation

Visualize the ideal situation

Define measurement targets

Brainstorm solutions to the problem

Develop Kaizen plan

Implement plan

Measure, record and compare results to targets

Prepare summary documents;

Create short term action plan, on-going standards and sustaining plan

Kaizen Institute: kaizen.com

Page 20: Finding Success with Test Process Improvement

© CapgeminiSogeti

Waste – The 7 Wastes of Software Development

1. Partially Done Work (the “inventory” of a development process)

2. Extra Processes (easy to find in documentation-centric development)

3. Extra Features (develop only what customers want right now)

4. Task Switching (everyone should do one thing at a time)

5. Waiting (for instructions, for information)

6. Handoffs (tons of tacit knowledge gets lost)

7. Defects (at least defects that are not quickly caught by a test)

18

Tom and Mary Poppendieck

Page 22: Finding Success with Test Process Improvement

© CapgeminiSogeti

How to Eat an Elephant...

20

One bite at the time!

Page 23: Finding Success with Test Process Improvement

© CapgeminiSogeti

The Brown Paper Exercise – As Is Process

Our Brown paper exercise

– Different stakeholders - internal

– The flow

– The challenges

– Dreams and wishes

– Brownpaper

21

?

!

!

!

?

?

Page 24: Finding Success with Test Process Improvement

© CapgeminiSogeti

The ”as-is” Process Identified

• Present the process to others

• Visible in the office for a while

• Feedback on post-its

22

Page 25: Finding Success with Test Process Improvement

© CapgeminiSogeti

Swimlanes as Process Visualisation – ”as is” proces

23

Page 26: Finding Success with Test Process Improvement

© CapgeminiSogeti

Ensure Involvement and Ownership

• Involve other stakeholders than test

• Discus outcome of initial drawing

• Amend with input

• Agree on current proces

24

Page 27: Finding Success with Test Process Improvement

© CapgeminiSogeti

Future Proces

• Swimlane - Input from pink and blue post-its

• A number of reviews and discussions

– Test team

– Product owner team

– Technical team

– Management

– Senior management

• This is the target – the beacon

25

Page 28: Finding Success with Test Process Improvement

© CapgeminiSogeti

Create the Backlog – and Follow-up

26

Proces Area

Proces Area

Proces Area

Prioritized In progress Pilot/review Done

Not started

I

Page 29: Finding Success with Test Process Improvement

© CapgeminiSogeti

Remember the Elephant?

27

Page 30: Finding Success with Test Process Improvement

© CapgeminiSogeti

Roadmap

28

Competences

Q4 2016 H1 2017 H2 2017 Q3 2016 Q2 2016

Tools

Process

TCoE QC

responsible

Test

automation

feasibility

study

50/50 TCoE

pro tester/

business tester

Measure

projects

on quality

KPI´s

Analyze test

environment

optimization

Environment

and data

Enforce

policy

through

governance

structure

Standardized

use of QC

Test

policy in

place

TCoE

Build test

professionals

with preferred

test partner

Templates

& more

Testdata

strategy

Implement

improvements

Performance test

build or buy

Testautomation

Standardized

processes

TPI

assesment

TPI

assesment

Page 31: Finding Success with Test Process Improvement

© CapgeminiSogeti

Remember the People

29

Page 32: Finding Success with Test Process Improvement

© CapgeminiSogeti

ADKAR

The People dimension of change

• Awareness

• Desire

• Knowledge

• Ability

• Reinforcement

Prosci 1998

http://www.change-management.com

http://www.management30.com

30

Page 33: Finding Success with Test Process Improvement

© CapgeminiSogeti

Improvement Starts with... You

31

Page 34: Finding Success with Test Process Improvement

© CapgeminiSogeti

Sources

• TPI Next – Business Dirven Test Process Improvement : by Rik Marselis, gerrit de Vries, Ben Vissser, Loek Wilhelmus, Alexander van Ewijk, Marcel van Oosterwijk, Bent Linker.

• Test Maturity Model Integration TMMi: by Erik van Veenendaal and Brian Wells

• How to change the world : by Jurgen Appelo

• Lean Software Development, An agile toolkit: By Mary and Tom Poppendieck

• ISTQB Expert Level Syllabus for Test Proces Improvement: http://www.istqb.org/downloads/category/12-expert-level-documents.html

• TPI Presentation: http://www.slideshare.net/RikMarselis/increasing-business-success-with-tpi-next-and-pointzero/33 by Rik Marselis

• Presentation on process improvement: http://www.slideshare.net/RikMarselis/why-would-youwanttoimproveyourtestprocess/17 by Rik Marelis and Geoff Thompson

32

Page 35: Finding Success with Test Process Improvement

© CapgeminiSogeti

Thank You

33