The Future Tester at Suncorp - A Journey of Building Quality In Through Agile

The Future

Tester at

Suncorp:

A Journey of

Building Quality

In Through Agile

Craig Smith

Adrian Smith with

Dallas Thorneycroft

3

Welcome…

Image: © Walt Disney Pictures / Pixar http://st-listas.20minutos.es/images/2008-07/26818/342659_640px.jpg?1216524692 A C

4

Welcome…

Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg

Not

Related…

C

5 Image: © Universal Pictures http://www.picalls.com/redimensionador/1920x1440/1920x1440.php?src=/1920x1440/./data/media/4/Back_to_the_Future.jpg&w=1024&h=768&zc=0

First, let’s go

back in time

C

6 Image: http://images.jbrains.ca/theory_of_bdd/royce_diagram.jpg

Waterfall

…1970

C

7 Image: http://blogs.kcls.org/librarytalk/vintage%20boy%20reading.jpg

Read past

page 2!

C

8 Image: http://spaghettitesting.files.wordpress.com/2009/04/fad.png?w=396&h=296

1980’s… 1990’s…

C

9 Image: http://spaghettitesting.files.wordpress.com/2009/04/fad.png?w=396&h=296

One TPS report

too many…

C

10

2001

XP

C

11 Image: Beck, Kent – Extreme Programming Explained: Embrace Change

XP: Extreme

Programming

C

12 Image: http://upload.wikimedia.org/wikipedia/commons/b/bd/Scrum-1.JPG

XP: Extreme

Programming

Scrum

A

13 Image: http://www.mountaingoatsoftware.com/system/asset/file/17/ScrumLargeLabelled.png

Scrum

A

14 Image: http://www.flickr.com/photos/trektrack/2389559700

Agile: An

Umbrella Term

A

15 Image: David Jackmanson on Flickr http://www.flickr.com/photos/djackmanson/350383099/sizes/z/in/photostream/

Then… in

Suncorp land

A

16 Image: © SlatteryIT

A leader with a vision

C

21 Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ C

Speed

to cool

22

Thumbs up…

Cool!

Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 C

23

Choke...

Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg C

24

CSI: Software

Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg C

25 Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG

Agile &

Testing

C

26

We reflect work like

this...

To Do Analysis Develop Test Done

C

27

Which is really

working like this...

To Do

Analysis

Develop

Test

Done

C

28

Remind you of

something?

Image: Craig Smith C

30

Testers in an agile team

Analyst /

Customer

Developer Tester Automation

Elaboration /

Specification Acceptance

Criteria

High

Performing

AGILE

Project

Manager

C

31

Testers in an agile

team

Developer

Tester

Analyst

More

Technical

Less

Technical

Co

de

De

sig

n

Un

it T

es

t

Au

tom

ate

d

Fu

nc

tio

na

l /

Sp

ec

iali

st

Te

sts

Ma

nu

al

Te

st

Ex

plo

rato

ry

Te

st

Re

qu

ire

me

nts

Cu

sto

me

r

Co

lla

b.

Developers need

more testing involvement

Testers need more

technical involvement

Analysts need more

testing involvement

C

32 Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg

Everyone likes to be

seen to value

quality

C

33

Quality is everyone’s

responsibility

Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg C

34 Image: http://www.handheldgpsinformation.com/wp-content/uploads/2010/06/iStock_000001211274XSmall.jpg

The

Journey

C

35 Image: http://www.mintvinyl1972.cc.cc/img/product/2009/200912/20091204/279589_0_Journey_Greatest_Hits_Lp_Cbs_4.jpg

Number 1 Problem

C

36 Image: http://s1.hubimg.com/u/781000_f520.jpg

Slow Expensive

C

37 Image: http://rpmedia.ask.com/ts?u=/wikipedia/commons/thumb/b/b2/US_Navy_080730-N-5277R-003_A_Commander%2C_Naval_Forces_Japan_firefighter_douses_a_fire_on_a_dummy_aircraft_during_the_annual_off-station_mishap_drill_at_Naval_Support_Facility_Kamiseya.jpg/250px-US_Navy_080730-N-5277R-003_A_Commander%2C_Naval_Forces_Japan_firefighter_douses_a_fire_on_a_dummy_aircraft_during_the_annual_off-station_mishap_drill_at_Naval_Support_Facility_Kamiseya.jpg

Fighting Fires

C

38

Problem & Proposed Solution

A

39

Building Quality

In

Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg A

Training &

Coaching Comms &

Change

40

Agile

assessment tool

for software

quality and

testing maturity

Processes &

Practices

Roles &

Responsibility Tools &

Infrastructure

Up-skill existing

Agile coaches in

testing practices

Create Agile

quality/testing

champions

Update courses

and training

guides

Create central

repository for

QA artefacts

Create central /

agreed QA

strategy

Create standard

templates

Create BVC

template

Create glossary

Create Agile

software QA

one-pagers

Define minimum

skill set

Create software

QA hiring guide

Define skills for

Agile team

members in

relation to QA

Review position

descriptions and

career roadmap

for testing roles

Define skills for

speciality testing

roles

Preferred tools

vs technology

matrix

Investigate

opportunities to

simplify test

data and

environments

Create ready-to-

go test tool

packages

Create working

example of

acceptance

driven

development

Tester

Survey

Invigorate

testing

community

Internal /

External

Comms

Strategy

Assist in-flight

projects

Streams... A C

41 Image: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg

Processes

& Practices

A

42

Success sliders

1 2 3 4

Cost Scope Quality Time

X

X X

X

Fixed

Flexible

A

43

1 2 3 4

Cost Scope Quality Time

X

X X X

Fixed

Flexible

Your

Turn!

Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A

44

1 2 3 4

Cost Scope Quality Time

X

X

X

X

Fixed

Flexible

Quality almost

always at number 3

A

47

Defining Quality

Quality Advocates

What does quality mean to the different roles in

the team?

Quality Taxonomy

What are quality attributes?

Quality Prioritisation

How do we know what quality attributes to

include?

Quality Tradeoff Risks

What are risks with the quality attributes we are

trading off?

Quality Measurement

How do we test and measure quality?

Success Sliders

How does quality relate to the sliders?

Quality Definition

What does quality mean?

Next Steps How do we apply

quality to our work

1

2

3

4

5

6

7

8

C

48

Quality Definition

C

49 Image: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg

Shared understanding

of quality

C

52

Simple QA

Test Strategy & Plans

A

HEALTH

DEVELOPMENT

TESTING

USER

0

1

2

3

4

5

0

1

2

3

4

5

6

7

1 2 3 4 5 6 7 8

New

Ris

ks &

Issues R

ais

ed

Num

ber

of

Ris

ks &

Issues

Iteration TEST

COVERAGE

0

5

10

15

20

25

0

1

2

3

4

5

6

7

8

9

1 2 3 4 5 6 7 8

Num

ber

of

Tests

Num

ber

of

Defe

cts

Iteration

MAINTAINABILITY PERFORMANCE 0

200

400

600

800

1000

1200

1400

1600

1800

4700

4800

4900

5000

5100

5200

5300

5400

5500

5600

5700

1 2 3 4 5 6 7 8

Lin

es o

f T

est C

ode

Lin

es o

f C

ode

Iteration

OVERALL

$-

$5

$10

$15

$20

$25

$30

0

1

2

3

4

5

6

7

8

9

1 2 3 4 5 6 7 8

Busin

ess V

alu

e

Num

ber

of

Featu

res

Iteration

Reporting

A

PROJECT

60

Tools &

Infrastructure

Image: http://www.datenform.de/blog/uploaded_images/tools-709754.jpg A

Discuss Discuss feature

requirements

Distill Distill into stories with acceptance

criteria

Develop Develop the code and

instrument tests

Demo Demonstrate feature

and verify using exploratory testing

Identify Identify new features

or requirements Refactor

Red Green

TDD

Cycle

ATDD Lifecycle

Feature

Stories

Software

SME BA Test Dev

BA Test Dev

Test Dev

SME BA Test Dev

ATDD / Specification by example

A

Living Documentation ATDD /

Specification by example

C

65

Preferred Tools

Good (Automation)

Better (ATDD / BDD)

Best (Specification

by Example)

Traditional / Isolated (Manual Tester Focussed)

C

66

Training &

Coaching

Image: http://www.travelsmartsunshinecoast.com.au/image/image_gallery?uuid=cb59e826-c472-427d-bc6c-e6186ef30a5e&groupId=849750&t=1296775495173 C

67

Training

C

68 Image: http://niche-desktop-testing.s3.amazonaws.com/wp-content/uploads/2010/11/WINNER-Secondary-Live-Action.jpg

Testing Champions

C

69 Image: © Little Britain Productions / BBC Productions http://www.latimes.com/media/photo/2011-06/62506401.jpg

In-flight Project

Assistance

C

70 Image: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg A

Quality Maturity

71

Agile Quality

Practices

A

72

Team Self-

Assessment

A

73

Quality Requirements

A

74

Quality Development

A

75

Quality Testing

A

76 Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png

Quality Team

A

77

Your

Turn!

Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A C

No agreed approach to testing

Tests are not considered a valuable asset

An agreed approach to testing that is aligned to a definition of quality

Tests are considered a valuable asset that can be reused as features

are progressively implemented

Test strategy is agreed and understood by the team and includes

targets (coverage, defects, …)

Test strategy is documented and visible as a BVC used by the team

Non-functional requirements are agreed and included in the test

strategy

Test planning is based on risk (technical complexity and business

impact)

Test artifacts are treated with the same importance as code and are

properly maintained and refactored

The relevant ____ility and security tests form part of the test strategy

-1

1

2

3

4

Test Planning

A C

80 Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg

ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF

RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O

F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH

Roles &

Responsibilities

C

81

Automation:

I work with developers to

automate tests that provide

business value and identify

system risks

Collaboration:

I work with analysts and SMEs to

ensure that testable acceptance

criteria are created for all stories

Strategy & Planning:

I am involved in the project at all

stages to ensure that testing

provides the greatest value and

quality objectives are achieved

Tools & Techniques:

I use both manual and

automated techniques using the

preferred testing tools based on

the situation

Architecture:

I have an understanding of the system

architecture and can create tests that

verify individual components and the

system as a whole Development:

I take an interest in

development practices and

monitor code quality metrics

Estimating:

I am involved in developing

estimates for projects at a story

level, for tools and infrastructure

and also for deployment/release

activities

Reporting:

I provide metrics that give

insight into project health and

system quality

Agile:

I understand Agile project delivery

and the differences between testing

in the different phases of an phase

Qualifications & Training:

I have recognised qualifications in

testing and continually update and

maintain my skills

Recruitment & Development:

I am attracted to the organisation

because testing is a cool career path

that offers heaps of opportunities and a

way of continually developing my skills

Community & Teams:

I am part of a community of

testers that are embedded

within teams but share

common values

Future tester A C

82

Transition Plan

New Software Test

Engineer Role

New Graduates,

Recruits, Consultants &

Partners

BA

SME

Other

Up

Skill

As

se

ss

me

nt

Current Test Analysts

Capable + Current Skills + Desire

Capable + Desire

Not Capable + No Desire

Not Capable + Desire

**Assessment = Technical Test + Interview**

A C

87 Image: http://dallasmorningviewsblog.dallasnews.com/megaphone-kid-cropped.jpg

Communications

& Change C

89

Internal / External Communications

Strategy

Image: C

90

Invigorate Testing

Community

Image: http://2.bp.blogspot.com/_rtqJH_Y4QDw/TTYsl0ieGbI/AAAAAAAABDQ/cMRXApOgV9U/s1600/brent_judd-791018.JPG C

Case Study

Regroup

Image: http://www.philparkertraining.com/data/uploads/team%20discussion.jpg

MAF

Test

Scenarios

Story +

Acceptance

Criteria

Test Case

Capture

MAF for

MainFrame

Selenium

for Web

Executable

Specification

Continuous

Integration

Automation Process - TAF

96 Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg

Wrap

Up

C

97

Agile testing is a journey

Image: http://goldeneaglesofamerica.com/wp-content/uploads/2011/04/yellow-brick-2.jpg A

98 Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423

Measure, Improve and

keep improving your approach

C

99 Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Photos-csi-miami-8507515-1999-1315.jpg

Testing skills are still really,

really, important

C

100 Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg

Are you hunting

down best practices?

A

101

Testers need to be viewed

as super heroes

Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg A

102

Don’t forget to use

(or improve) our quality templates

C

103

Testing needs to be cool

Image: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard# C

104

Questions

???

Craig Smith

http://www.suncorp.com.au

http://www.agileacademy.com.au

http://www.craigsmith.id.au

craig.smith@suncorp.com.au

@smithcdau

Dr. Adrian Smith

http://www.ennova.com.au

http://www.agileengineeringdesign.com

adrian.smith@ennova.com.au

@adrianlsmith

105

The Agile Academy is the next wave in Agile learning and collaboration. Designed for

IT professionals, the Agile Academy is a knowledge hub that promotes Agile related

learning, knowledge sharing and capability development across the IT industry. We

offer an integrated curriculum of leading edge courses across the entire solution

development life cycle, covering all roles at varying levels.

(http://www.agileacademy.com.au)

Suncorp is one of Australia and New Zealand's largest diversified financial services

providers, supplying banking, insurance and wealth management products to around

9 million customers through well-established and recognised brands such as AAMI,

Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, as

well as Suncorp and GIO. Today, Suncorp is Australia's fifth largest bank and second

largest domestic general insurance group, with over 16,000 staff. Suncorp has

representation in 450 offices, branches and agencies throughout Australia and New

Zealand. (http://www.suncorp.com.au)

Ennova is an technology company that has focused on providing the engineering and

construction industries with innovative products and services that improve project

execution and operational efficiency. Ennova base their the project delivery approach

on combination of Lean and Agile principles and practices. This provides clients with

a high level of transparency and real value for money. Consulting engagements are

undertaken using a pragmatic and common sense approach that is aimed at

increasing the client's internal capability and building business agility.

(http://www.ennova.com.au)