Keyword-driven Test Automation FrameworkConcept, features, architecture

Misha Suboch

2

Topics Covered

Features

Workflow

Future

Test Automation Framework

Architecture

TAF is a program which helps to perform automation testing effectively. Let us see TAF:

3

Presentation agenda

1. Features and Advantages

2. Usage Workflow

3. Architecture

4. Artifacts

5. Implementation in Your Project

6. TAF Core Features

4

Features and Advantages1

5

Features

Keyword-Driven1

Product-independent2

Tool-Independent3

Maintainability4

• Business Logic• GUI Objects• Steps• Utilities

6

Advantages

Keyword-driven

Product-independent

Compatible with any automation tools on the market

Aligned with Continuous Integration Frameworks

(single entry point, unified test reports, etc.)

7

Workflow2

8

Automation with TAF

Initialization1

Usage • Run Test Scenarios• Create New Test Scenarios

Development

• Study Application• Mock up Test Scenarios• Implement Scenarios• Debug /Verify

3

Maintainability • Tune for New Build• Implement New Steps

4

2

9

Architecture3

10

High-Level Architecture

TAF Core

Bug List

Test Scenario 1

Test Scenario 2

Test Scenario NTestComplete TAF

Custom Automation tool

Another Automation tool

Run TAF.exe

Test Reports

XML

HTML

Tool Specific

Test

11

Detailed Architecture

12

TAF Core, Responsibilities

Read ConfigsRead Test Suite/Unified Test ScenarioRead Bug ListLoad DataConstant variables• Stores• Substitute• Calculate Expressions

Create Execution ListRun Automation Tool TAFExecution Optional (Cleanup) CommandCreate Reports

13

TAF.exe Config

14

TAF Core Source Code

TAF Core code is generated using Test-Driven Development approach, it is very well structured and covered by unit tests (more than 300 passed unit tests validates TAF Core quality).

15

Detailed Architecture

16

Communication between TAF Core and Automation Tool TAF

1.When scenario is read and parsed, TAF Core generate Execution List and run Automation Tool TAF.

2.After executing all tests, Automation Tool TAF generates Test Results Summary and exits.

3.TAF Core reads Test Results Summary and generates final results.

Automation Tool TAFTAF Core

ExecutionList.txt

TestResultsSummary.txt

17

Automation Tool TAF

18

Automation Tool TAF

Driver Controller

Test Cases

Actions

Verifies

ScreensFrames

Utilities

Scripts

Test Scenarios

Tool Status of TAF support

SilkTest Supported

TestComplete Supported (TAF Core)

Quicktest Pro Supported (TAF Core)

Watir Supported (TAF Core)

Selenium Supported (TAF Core)

19

Controller in TestComplete

20

Step Implementation

21

TestComplete, TAF Detailed Log

22

Artifacts4

23

Unified Test Scenario

24

Test Result Report for Scenario

Metrics Summary, Passed

25

Test Result Report for Scenario

Summary, Failed

Summary, Failed with Bug Link

Summary, Known Issue

26

Implementation in Your Project5

27

How to Proceed and Take Advantage of TAF

Get Test Complete TAF / Watir TAF / QTP TAF

Develop test scenarios

Implement steps

Automation with TestComplete, Watir or QTP:

Automation with another tool:

Implement controller

Develop test scenarios

Implement steps

28

TAF Core Features6

29

TAF Core Features: Overview

1. Unique keywords in test scenarios allow you to generate unique text and numbers in specified format

2. Ability to run several test scenarios at once, even if written in different automation tools

3. Ability to use the same test scenario for different automation tools, when one tool could not cover all test configurations (browsers/OS).

4. Unified test results (in .xml) across different automation tools/projects/applications provide integration options with external tools (like Cruise Control).

5. Ability to mark failed test cases as known issue and link to related bugs in test results.

6. Keywords Feature: Load/Repeat keywords allow to create data-driven test cases. Application keyword allow you to work in one test scenario (or even in one test case) with different applications.

30

TAF Core Features:

Overview8. Arithmetic expressions calculation and Variables

values substitution. Ability to exchange variables values between different test scenarios, automation tools or even when different test scenarios should be run one by one on different servers.

9. Unified test scenario could be easily accessed for review by customer or business analyst (no programming knowledge required)

10. Working with results: Auto-archiving of previous test results. Test results contains information about what workstation/server was used for scripts run, when and which TAF Core version they were generated by.

11. Extensive configuration features: execution (run selected tests/complete scenario), results output, logging, etc.

Test Automation Framework

Misha Subochmisha.suboch@gmail.com

31