32
Agile Test Automation: Truth, Oxymoron or Lie? George Wilson Original Software

Agile Test Automation: Truth, Oxymoron or Lie?

Embed Size (px)

DESCRIPTION

It can be confusing for everyone in an agile team to understand when or what to test, when there isn't a test phase or any formal documented requirements. Whatever your agile methodology, projects require a change in the way QA and development work together. The use of technology and automation are much more difficult and finding a practical approach to testing is critical for successful agile projects. In the Webinar presentation, George Wilson explored how testing in agile is different and revealed pragmatic advice to ensure that application quality, within an agile environment, isn't compromised. Listen to the archive Webinar discussion on the techniques for quickly getting control of manual testing and progressing to automated testing in agile, which will leave you with fresh thinking to resolve or prevent any testing dysfunctions in your agile teams. - See more at: http://www.origsoft.com/webinars/agile_testing/

Citation preview

Page 1: Agile Test Automation: Truth, Oxymoron or Lie?

Agile Test Automation: Truth, Oxymoron or Lie?

George WilsonOriginal Software

Page 2: Agile Test Automation: Truth, Oxymoron or Lie?

Agenda

Why Agile?

ProcessTech-nology

Data

Page 3: Agile Test Automation: Truth, Oxymoron or Lie?

Quick Poll

Are you currently using Agile methodologies?

Yes – for all projectsYes – for some projectsThinking about itNot at all

Page 4: Agile Test Automation: Truth, Oxymoron or Lie?

AGILE!

Why Agile?

Page 5: Agile Test Automation: Truth, Oxymoron or Lie?

Process

GAP

Traditional

Page 6: Agile Test Automation: Truth, Oxymoron or Lie?

Parallel Teamwork

Dev Test Business

Page 7: Agile Test Automation: Truth, Oxymoron or Lie?

Why Test AutomationMay Fail

Extensive ramp-up timeLower on-going value

Skills Acquisition

Build Script Library

Automation partially available

Script Maintenance Cycles

Benefit ‘Black-outs’Shelf-ware Warning

Benefit

Effort

Time

Effo

rt

4-8+ months

Programmatic Test Tools

Page 8: Agile Test Automation: Truth, Oxymoron or Lie?

Falling Back to Manual Testing

Less challengingMore effort

Skills Acquisition

Build Script Library

Automation partially available

Script Maintenance Cycles

Benefit ‘Black-outs’Shelf-ware Warning Benefit

Effort

Time

Effo

rt

4-8+ months

Programmatic Test Tools

Fall Back to Manual Testing

Page 9: Agile Test Automation: Truth, Oxymoron or Lie?

Tech-nologyAgileEco-system

Page 10: Agile Test Automation: Truth, Oxymoron or Lie?

Agile Eco-System

OrganisationCooperationWork allocationTraceabilityMetrics

Page 11: Agile Test Automation: Truth, Oxymoron or Lie?

Agile Testing Success

Build tests in parallelFirst time manualIssuesAutomationData

Page 12: Agile Test Automation: Truth, Oxymoron or Lie?

Automation is Essential

Manual is slowFaster feedbackConsistencyEmpower testersConfidenceAvoid toxic debtDocumentation

Page 13: Agile Test Automation: Truth, Oxymoron or Lie?

Inhibitors

Rapid changeAttitudeInitial investmentSweat and painFear

Page 14: Agile Test Automation: Truth, Oxymoron or Lie?

Traditional Automation Pyramid

Application

Automation

High Risk

Manual

Page 15: Agile Test Automation: Truth, Oxymoron or Lie?

Evolving Automation

Automation

Page 16: Agile Test Automation: Truth, Oxymoron or Lie?

Too Late, too slow

Sp 1 Sp 2 Sp 3 Sp 4 Build regression

Not a separate sprint.

Sp 1 Sp 2 Sp 3 Sp 4

Regn Regn Regn

Not overflowing the sprint.

Page 17: Agile Test Automation: Truth, Oxymoron or Lie?

Regression Deliverable

Des

Code

FT

RT

Sprint 1 Sprint 2 Sprint 3

ReF

Des

Code

FT

RT

ReF

Des

Code

FT

RT

ReF

Design

Code, TDD

Refactor

Functional Test

Regression Test

Regression in each sprintEasy, FlexibleAvoid toxic debt – bugs and scripts

Page 18: Agile Test Automation: Truth, Oxymoron or Lie?

ManualAuto

Table effectsUI – Db validationData Rules

Start: ManualTesting

Progress: AutomatedTesting

Test Cycles

Evolutionary Testing

Unit TestingIntegrationSimulation

Tibco, Software AG, Web Methods, Websphere…

OracleSQLServerDB2

Page 19: Agile Test Automation: Truth, Oxymoron or Lie?

SOA & Middleware

Code-freeTestStubSimulateDrive

Page 20: Agile Test Automation: Truth, Oxymoron or Lie?

Testers view…

Stories

Test Cases

Manual Tests

Defects

Auto Regrs’n Adapt

Heal

Data

Explore

Page 21: Agile Test Automation: Truth, Oxymoron or Lie?

Daily Regression

Cross platformMulti actionBranchingError recovery

Page 22: Agile Test Automation: Truth, Oxymoron or Lie?

Agile AQM model

Page 23: Agile Test Automation: Truth, Oxymoron or Lie?

Control – Electronic Whiteboard

Page 24: Agile Test Automation: Truth, Oxymoron or Lie?

Testing is all about data

Input Process Output

Data Process ResultData Process ResultData

Data

Page 25: Agile Test Automation: Truth, Oxymoron or Lie?

Setup & Tear-Down

Raise order Despatch Invoicing GL processing

Incremental Roll-back

Automated Test Processes

Page 26: Agile Test Automation: Truth, Oxymoron or Lie?

Testing the Database

Pol Last Claim Claim Curr Tot Claim Name

1203301 00.11.2006 Y GBP 1266.61 Jackson

1203302 10.11.2006 C EUR 505.20 Henderson

Wilks1203303 01.01.2006 N GPB

1203301 12.01.2006 420.00

1203301 08.11.2006 761.42

1203302 10.11.2006 505.20GBP Pounds SterlingEUR EuroUSD US Dollars

Rules based validation

Page 27: Agile Test Automation: Truth, Oxymoron or Lie?

Re-use is key

ProcessKnowledgeResultsData

Automation meaningless without re-use

Page 28: Agile Test Automation: Truth, Oxymoron or Lie?

Agile Test Automation

Why Agile?

ProcessTech-nology

Data

Page 29: Agile Test Automation: Truth, Oxymoron or Lie?

Agile Test Automation

Essential

Truth?

Oxymoron?

Lie?

Page 30: Agile Test Automation: Truth, Oxymoron or Lie?

Essential

User InterfaceFast build for UICode free

Middleware & ServicesStub and simulateTest component interaction

DatabasePlan dataManage data

Page 31: Agile Test Automation: Truth, Oxymoron or Lie?

Dilbert says...

Page 32: Agile Test Automation: Truth, Oxymoron or Lie?

Questions?

[email protected]