STC JULY 2014

HOA LE

Apply Automation once Executing Ad-Hoc Testing

Agenda

Ad-hoc Testing

Automation Testing

Apply Automation once executing Ad-hoc testing

2

What does Ad-hoc Testing mean?

No Explicit Planning

No Test Design

No Test Case

3

When we use it

4

• Limited time

• Supplement to formal tests

• Team having strong product experience

Benefits of Ad-hoc Testing

5

• Find more bugs

• Cover areas where there are lack of test cases

• Increase confidence software of product

Forms of Ad-hoc Testing

Buddy Testing

6

Pair Testing

Monkey Testing

To be Ad-hoc Testing effectively

7

• Have good domain knowledge

• Have good test strategy

• Have good tools

Agenda

Ad-hoc Testing

Automation Testing

Apply Automation once executing Ad-hoc testing

8

Automation Testing

“Automation testing is the use of tools or software to perform or support test activities (management, test design, test execution and results checking)”

• Characteristics:

Reliable

Reusable

Repeatable

9

When we use it

10

• Limited time

• Reuse scripts for large amount of data

• Execute after function/modules is stable

Benefits of Automation Testing

11

• Increase coverage

• More powerful and versatile

• Execute performance and load test easily

Common test Automation Frameworks

12

What do we need to have?

Good programing skills

Ability to define important data

Ability to analyze report

13

Agenda

Ad-hoc Testing

Automation Testing

Apply Automation once executing Ad-hoc testing

14

Case Study - A

15

ffgh Situation: Execute Ad-hoc testing for purchasing some devices on the web-ecommerce with some steps as below: 1. Search devices (automation) 2. Selected some devices to order them (automation) 3. Display selected devices successfully (automation) 4. Delete them in database (manual) 5. Research them in site(manual)

Case Study - B

16

ffgh

Another Situation: Ad-hoc testing for view the color of car in cars purchasing website. 1. Search a car (automation) 2. View car information (automation) 3. Change the color for car (360 degree view function in flash) (automation) 4. Verify whether the color is displayed correctly (manual)

Benefits

Execute many scenarios in a short time

Execute scripts on multiple-browsers and multiple-platforms

Get the right log for reporting

17

Advantages

18

Speed up test cycle

Utilize available test cases and test suites

Increase test coverage

Utilize current automation framework

Support regression team

Disadvantages

19

Take time to debug

Analyze incorrectly report

Be dependent on automation factors

Challenges

20

Need programing skills

Need in-depth knowledge of the system under test

Need strong framework

Need clearly workflow process

Need strong testing skills

21

Important Notes

22

• More tasks in each test cycles

• More test coverage criteria

• Have a framework for automation

23

References

24

Sathyan Sethu Madhavan, “A Guide For Test Automation”, 19 March 2012 (http://www.thoughtworks.com/insights/articles/guide-test-automation) Linda G. Hayes, “The Automated Testing Handbook”, March 1, 2004 (http://www.softwaretestpro.com/itemassets/4772/automatedtestinghandbook.pdf) Sanjay Kumar, "Ad-hoc Testing: An important Process of Software Testing" (http://qa.siliconindia.com/qa-expert/Adhoc-Testing-An-important-Process-of-Software-Testing-eid-134.html)

© 2014 HCMC Software Testing Club

THANK YOU

26

Email: hoale@hcmc-stc.org My Blog: http://howtesting.blogspot.com/