42
#atlassian

Quality at Speed - Penny Wyatt

Embed Size (px)

DESCRIPTION

How can a team of 65 developers build and rapidly ship a high-quality product with only six QA engineers? At Atlassian, we’ve introduced the Quality Assistance model that changes the developer QA mindset, and engages developers in exploratory testing so software is developed right the first time. After all, the cheapest time to fix a bug is before it's written. Join us as we walk through the theory, history, and practice of the model, while busting some of the myths about developers and QA. Reject the tradeoff of time, scope, and quality, and finally have your cake and eat it too.

Citation preview

Page 1: Quality at Speed - Penny Wyatt

#atlassian

Page 2: Quality at Speed - Penny Wyatt

NOTES:

• Your main title goes in the large blue

font.

• If you have a title that naturally splits

into a subtitle, use the smaller green font

for the subtitle. If not, delete the subtitle

PHOTO

1. Place your photo at around the same

size as the example photo

2. (Keynote users:) Move your photo

onto the blue shape below Select both

photo and shape and then choose

“Mask with selected shape” from the

menu. Double click the photo to edit the

scale and crop position.

PENNY WYATT • SENIOR QA TEAM LEAD • ATLASSIAN • @pennozewyatt

Quality at Speed

Page 3: Quality at Speed - Penny Wyatt

More QA ≠ More Quality"

Page 4: Quality at Speed - Penny Wyatt

More QA ≠ More Quality"

Page 5: Quality at Speed - Penny Wyatt

Today’s Topics"

•  Why? •  Quality at Speed

•  How? •  Quality Assistance

Page 6: Quality at Speed - Penny Wyatt

NOTES:

• If you want to divide your talk

into chapters, use this slide for

Chapter titles

Quality at Speed

Page 7: Quality at Speed - Penny Wyatt

Speed

Scope Quality

Page 8: Quality at Speed - Penny Wyatt

Waterfall"

Development

Time Release

Bugfix

Testing

Page 9: Quality at Speed - Penny Wyatt

Development

Time

Release

Bugfix

Testing

Waterfall"

Page 10: Quality at Speed - Penny Wyatt

Development / Bugfix

Time

Release

Testing

Agile"

Page 11: Quality at Speed - Penny Wyatt

Development

Time

Release

Testing

Agile"

Bugfix

Page 12: Quality at Speed - Penny Wyatt

Development

Time

Release

Testing

Agile"

Bugfix

Page 13: Quality at Speed - Penny Wyatt

Rejecting the Tradeoff"

•  Build it, test it, fix it, ship it •  Why are devs and testers different people?

Page 14: Quality at Speed - Penny Wyatt

Development

Time

Release

If Devs Could Test"

Page 15: Quality at Speed - Penny Wyatt

“But Devs Can’t Test!”"

•  Testing is a skill and a mindset •  Many devs have neither •  Many of them think they have both!

Page 16: Quality at Speed - Penny Wyatt

“But Devs Can’t Test!”"

Page 17: Quality at Speed - Penny Wyatt

The Enemy Within"

Page 18: Quality at Speed - Penny Wyatt

Half an Engineer"

Page 19: Quality at Speed - Penny Wyatt

Missing: Quality Mindset"

Users would never do that!

Edge case!

We can fix that later... maybe

The spec didn’t mention that.

Page 20: Quality at Speed - Penny Wyatt

Missing: Testing Skills"

Automation solves

everything.

Manual testing is obsolete

Works on my machine.

My part works fine.

Page 21: Quality at Speed - Penny Wyatt

Missing: Knowledge"

That’s configurable?

I’m not a security expert

I only learn from my own mistakes

All databases behave the same way

Page 22: Quality at Speed - Penny Wyatt

Development

Testing

Side-by-Side"

Bugfix

Time

Release

Page 23: Quality at Speed - Penny Wyatt

Is there hope?"

Page 24: Quality at Speed - Penny Wyatt

Development

Time

Release

Reintegrated"

Page 25: Quality at Speed - Penny Wyatt

NOTES:

• If you want to divide your talk

into chapters, use this slide for

Chapter titles

Quality Assistance

Page 26: Quality at Speed - Penny Wyatt

Quality Assistance"

•  Short-term – Protect our customers •  Long-term – Educate our developers

Page 27: Quality at Speed - Penny Wyatt

Skeptical?"

Page 28: Quality at Speed - Penny Wyatt

Measuring Progress"

100%

30%

15%

7% 4%

0%

20%

40%

60%

80%

100%

2009 2011 2012 2013 2014

Story Rejection Rate

Page 29: Quality at Speed - Penny Wyatt

Shifting a Culture"

Page 30: Quality at Speed - Penny Wyatt

Stage 0 of 6 – No QA"

•  Automation only •  Functional correctness

Coding Done

Page 31: Quality at Speed - Penny Wyatt

Stage 1 of 6 – QA Testing"

•  QA does exploratory testing

Coding Done Testing

Page 32: Quality at Speed - Penny Wyatt

Stage 2 of 6 – DoTing"

•  DoT = Developer On Test •  Devs test each other’s stories

Coding Testing

DoTing Done

Release Testing

Page 33: Quality at Speed - Penny Wyatt

Stage 3 of 6 –Demos and Notes"

•  DoTs test all stories •  QA demo once story is done •  QA writes testing notes

Coding DoTing Done Demo

Page 34: Quality at Speed - Penny Wyatt

Stage 4 of 6 – QA Kickoffs"

•  Prevention > Detection •  QA kickoff before story is started

Coding DoTing Done Demo Kickoff

Page 35: Quality at Speed - Penny Wyatt

Review

Stage 5 of 6 – Private Kickoffs"

•  Devs do their own kickoffs •  QA reviews testing notes

Coding DoTing Done Demo Kickoff

Page 36: Quality at Speed - Penny Wyatt

Review

Stage 6 of 6 – No More DoTing"

•  DoTing creates bugs! •  Still unofficial safety nets

Coding/ Testing

Done Demo Kickoff

Page 37: Quality at Speed - Penny Wyatt

Review

Current Process"

•  All testing done by devs •  Two QA input points on each story

Done Demo Kickoff Coding/ Testing

Page 38: Quality at Speed - Penny Wyatt

NOTES:

• Use Chrome browser

• 1 tab open, unless tabs help

illustrate

• Browser extensions & bookmarks

bar is hidden

• Screenshot fills entire screen

• You can download the “Window

Resizer” Chrome extension to set

your window at 1280x1024 so that it

fills this aspect ratio

Page 39: Quality at Speed - Penny Wyatt

Reintegration"

Page 40: Quality at Speed - Penny Wyatt

Reintegration"

Page 41: Quality at Speed - Penny Wyatt

NOTES:

• If you have short reminders or

highlights that you want people to

tweet, use this. •  Software quality comes from people, not code. •  Improvement comes from questioning

assumptions. •  Constantly experiment. •  Have fun!

Key takeaways: #atlassian

Page 42: Quality at Speed - Penny Wyatt

Thank you!

PENNY WYATT • SENIOR QA TEAM LEAD • ATLASSIAN • @pennozewyatt