Automation on the go ict

INDIUM SOFTWAREAn Independent Software Testing Firm

Automation on the Go - ICT

“Business Assurance through Quality Assurance”

© 2014 Indium Software

ENHANCING SOFTWARE QUALITY

Agenda

2

Out

line

Industry Expectations

Overview

Automation in Agile Environment

Approach – ICT (In Cycle Testing)

Phases in ICT

Metrics

Value Additions

Conclusion



3

Industry Expectations

• Increased Test Coverage

• Test More

• Test Fast

• Defect Free System

• Improved Accuracy



4

Overview

Maintenance – Points of Concern

Solution

Frequent releases - Increased need of regression executionExtensive regression suite – Unfeasible test effortLess regression time – Reduced test coverage / Defect leakage

Manual

Hurried development – Fragile non scalable scriptsLast minute modifications – Costly to fixFrequent change in requirements - Unstable tests

Automation

An automation suite thatgrows in parallelhas control over current featuresensures additional test coverage of new features

The only way out is

AUTOMATION ON THE GO



5

Automation in Agile Environment

Usually automation happens at the end but with quick turnaround time required forfrequent release testing becomes strenuous. That means just manual testing maynot suffice.

Application Updates

Write Functional Test cases

Execute Functional Test cases

Analyze test results &

Report Defects

Code Freeze & Deployment

Identify Test case for

Automation

Develop & Execute Test

script

Add the Script to Existing

Suite



6

Approach – ICT (In Cycle Testing)

Why not automate as soon as the test cases are identified and written?

.

Application Updates

Write Functional Test cases

Execute Functional Test cases

Analyze test results &

Report Defects

Code Freeze & Deployment

Identify Test case for

Automation

Develop & Execute Test

script

Add the Script to Existing

Suite



Merge

7

• Tester = Automation + ManualRole

• Testing = Automation + ManualProcess



8

Phases in ICT

• IM prioritizes requirements

• ICT Automation QA assesses requirements for ICT feasibility

Kick Off

Effort Estimation & Schedule

Planning

Functional Verification

Automation Script Development

Automation Script Sign-Off

Script Integration

Script Execution

ICT

1

2

1

2

3

4

5

6

7

8

3

45

6

7

8



9

Phases in ICT

Planning




Script Integration

Script Execution

ICT

1

2

3

4

5

6

7

8

Kick Off

• ICT Automation QA provides estimation for Automating

• QA Lead / IM schedules and prioritizes

Effort Estimation & Schedule2

1

1

2

3

45

6

7

8



10

Phases in ICT




Script Integration

Script Execution

ICT

1

2

3

4

5

6

7

8

Kick Off

2

1


• ICT Automation QA identifies / writes manual tests

• ICT Automation QA emails Developers & BAs to review the tests

Planning31

2

3

45

6

7

8



11

Phases in ICT



Script Integration

Script Execution

ICT

1

2

3

4

5

6

7

8

Kick Off

2

1


• BA signs off

• ICT Automation QA begins testing

Functional Verification4

Planning31

2

3

45

6

7

8



12

Phases in ICT


Script Integration

Script Execution

ICT

1

2

5

6

7

8

Kick Off

2

1


• ICT Automation QA begins script development

• QA Lead coordinates with ICT Automation QA on issues / concerns

Automation Script Development5

Planning3


1

2

3

45

6

7

8



13

Phases in ICT

Script Integration

Script Execution

ICT

1

2

5

6

7

8

Kick Off

2

1


• Peer reviews are conducted

• ICT Automation QA modifies scripts if any

Automation Script Sign-Off6

Planning3



1

2

3

45

6

7

8



14

Phases in ICT

Script Execution

ICT

1

2

5

6

8

Kick Off

2

1


• Regression Automation QA integrates ICT

Automation scripts with existing regression scripts

Script Integration7

Planning3




1

2

3

45

6

7

8



15

Phases in ICT

ICT

1

2

7

Kick Off

2

1


• Regression Automation QA executes ICT

scripts before regression scripts

Script Execution8

Planning3




Script Integration7

1

2

3

45

6

7

8



16

Metrics

Schedule

R95 R96 R97 R98 R99 R100 R101 R102 R103 R10402468

1012141618

1412

1416 15

7 6 7 8 8

Releases

# Sc

ript

s

Backlog Scripts

R95 R96 R97 R98 R99 R100 R101 R102 R103 R1040123456789

10

7 8 79

8

54 4

54

Releases

# D

ays

With ICT

Without ICT

R95 R96 R97 R98 R99 R100 R101 R102 R103 R1040

5

10

15

20

25

30

35

2 31 2 3

1820

15

20

13

22

29 30 3028

85

74 5

Defect Detection

Releases#

of D

efec

ts

Defects found in the QA environment

Defects found in the BA environment



17

Value Additions

Key Levers With ICT Value Addition Before After

Test Execution Faster by 30% Delivery ahead of schedule

8 – 10 Days 5 – 7 Days

Retesting Effort Decreased by 40%

Multiple execution of automation scripts 2 – 3 Days Less than 1

Day

Backlog Decreased by 50% Increased productivity 12 – 14 Scripts

per Release6 – 8 Scripts per Release

Regression Effort

Decreased by 35%

Instant Sign-OffStable Code 3 – 5 Days 1 – 3 Days

Defect Catch Rate Faster by 60% High quality service

delivery25 – 30 Defects

in QA5 – 8 Defects

in QA



18

Conclusion

Clean and Rapid

Delivery

Good Framework

Coding Standards

Stable Process

Reusable Code



19

Thank You

USA: [email protected]

EMEA & APAC: [email protected]@indiumsoft.com

INDIA: [email protected]

SunnyvaleSuite 210, 1250 Oakmead ParkwaySunnyvale, CA – 94085.Phone: +1(408) 501-8844Fax: +1(408) 501-8808

Atlanta Crown Office Suites1870 The Exchange, Suite 100 Atlanta, GA 30339Phone: +1 (678) 608-0809, +1(770) 989-7302

New DelhiF-1/5 Okhla Industrial Area Phase-I, New Delhi – 110 020.Phone: +91-11-6613 0400

BengaluruSRS Plaza, No. 246, 2nd & 3rd Floor13th Cross, Indira Nagar 2nd StageBengaluru – 560 038.Phone: +91-80-4914 7777

ChennaiVDS House41, 2nd Floor, Cathedral RoadChennai – 600 086.Phone: +91-44-2811 6330Fax: +91-44-4210 4033

mailto:[email protected]




https://www.facebook.com/pages/Indium-Software/290116636922

http://www.linkedin.com/company/82503

https://twitter.com/indiumsoft

Technology

Automation on the go ict