Trends in software testing by Eka TechServ

Dr. Prakash Mutalik

1

Founder and CEO of Eka TechServ Over 39 years in IT industry Worked AT & T, Wipro & HP Consulted in SW Quality Co-founded RelQ Was Test Director in EDS/HP Founded a Test / KM technology company Advisor to several funds

2

Testing established is one of the lines of businesses in IT◦ There is no IT player who is not in testing

Customers accept that their key applications need to be tested

Engineers are willing to consider testing as a career

Outsourcing of Testing is established Global testing service market : 20-22B; Indian

share : 10b. Growing rapidly, 20 % margin.

3

ConvinceCustomer that Testing needs to be done

ProvideTest resources

ManageTestProjects

BuildTCoEs

Build/Adopt new Tech/Models

Focus onTest Auto.Perform.Testing

4

Customer is too demanding Software is getting more complex and is

often mission critical We don’t have resources/skills/models to

meet the demands Investment , courage and innovativeness is

required to change the paradigm

5

Testing is an after thought; not willing to give enough time or importance

6

Market /Economic

Compulsions

CustomerExpectations

ITChanges

ImpactOn

Testing

Impact on Testing Business

What itMeans to

you

7

IT vendor has to reduce the cost Vendor delivers services / products of

highest Quality Vendor adds value to his business

8

Reduce cost of development◦ Improve productivity◦ Reduce manpower cost◦ Reduce testing cost; push it to developers

Improve the Quality◦ Build Q into software. Focus on process, QA tech◦ Automate◦ Re-use tested modules

Understand Customer’s business◦ Train existing staff◦ Hire from customer’s Industry

9

Slashed Testing budget Need to reduce cost Create newer cost effective models for

testing Need to retrain testers and reposition

testing Look for market repositioning

10

Availability of cloud based test tools Cloud based virtual test environment Cloud based test service Prime factor is to drive the cost factor down

11

Testing area What cloud can offer

Sales and customer acquisition Sales portals / applications may help

Distributed testing (multi location testing)

Possible

Test Life Cycle Frameworks with built in TLC are appearing

Test teams Crowd sourcing

Test effort estimation/ planning Tools and frameworks

Test cases and test scripts Needs to be manually done

Test Environment (platforms, network, storage,… )

IaaS, PaaS can provide

Defect reporting, Functional/test automation, Performance testing and other tools…

Tools available , TaaS

Payment Pay as you use

12

Growth of cloud computing is outstripping many predictions. The growth is based on some compelling value proposition : speed to market, agility to bring forward or retire service, chance to move capex to opex. For testing, cloud offers range of opportunity to take up certain kind of projects, opportunity to reduce cost

13

To make effective use of cloud, you need to employ experts. The current team needs to be retrained.

Lack of standardization among different clouds is hurting

Cloud service providers are not yet providing clear SLA

If required infrastructure is not available with one provider, you may have difficulty in integrating cloud infrastructures

Lack of robust security of data is hurting the growth of CC. Though hybrid clouds are supposed to provide some relief, it is not very easy to configure hybrid clouds.

Difficult virtualize certain systems (legacy systems )

14

Take one step at a time You need to have a team of cloud experts in

your company Test automation and performance testing

are very good starting points Look for frameworks which run on cloud,

which can interface with some popular tools Retrain your engineers Set right management expectations

15

16

17

18

Agile/ Scrum project management

Project Initiation•Get an understand-ing of the project

Release planning•Plan the sprints,• Test Plan

Iterations / sprints Release Tests

•Performance/Load•Installation/ compatibility•UAT•Complete regression •Release documentation

Story Tests

Automation Tests

ManualTests

ReleaseReady checks

Go toReleaseTests

19

Testers are first class citizens on agile teams and part of the “whole team” supporting customers, business stakeholders, developers and other team members

Testers support quality infusion through entire team and product cycle

Test tasks and stories are planned and executed like development tasks and stories

Automate where possible and use session-based testing for exploratory testing

Communicate through information radiators

20

21

Software is becoming increasingly complex and mission critical

Many projects fail or inordinately late Poorly tested software costs customer. In TDD, test is written first, and code is

developed to meet the tests For more details on TDD, see:

http://en.wikipedia.org/wiki/Test-driven_developmenthttp://www.agiledata.org/essays/tdd.html

22

Industry standards, legal regulations are often made mandatory. Recent regulations show that not meeting these stds could cost companies their business.

Companies are expecting that the test teams check for this compliance

Banking , health care and data security are becoming very strict.

We expect that this compliance testing will only become more and more important in the coming years

23

24

Build a valuable and efficient Test Organization

Explore newer test delivery models, platforms such as “Cloud”

Use initiatives such as Knowledge Management to improve test productivity and test organiztion

25

Improve the image of Test Organization in the company. Convince the management that Testing is a specialized skill and is necessary.

Assess your Testing needs, current state of Testing and Establish Test processes. Have a focus on Estimation, re-use of Test artifacts, automation tools

Train your test professionals in processes, tools, domains.

Take initiatives to improve test productivity.

26

Testing is not just supplying bodies. There are other models : projects, building TCoE, value added services such as Automation, performance testing.

Explore “cloud based services” , “cloud sourcing”, and other models

Expand your business and expertise in several domains / verticals.

Examine building skills to add value to customer business.

27