Welcome to the Testing Stream

Sponsored by:

Test Automation at Richemont Dierk Hoeft – Isabelle Bour

Birmingham, November 2013

Agenda – Test automation

Context

Objectives

The Solution ⁻ Our project

⁻ Technical solution

⁻ Night scheduling

Benefits

Questions

CONTEXT OF THE PROJECT Context of the project Test Automation

Richemont Organization

The Maisons

Use of SAP at Richemont Strategy Foundations

Favor Integration and Use of SAP Components – Avoid Interfaces and Replication whenever possible

4 Tier Landscape

Central Master Data Management for Articles and other key master data objects

Central Governance

Scope of applications – SAP applications : ERP, Planning and WMS

– Web applications : Usage for B2E, B2B and B2C

– Java applications : POS System

System frequently modified and extended – Regular Bug Fixing -> daily risk

– Maintenance cycle -> every 15 days risk

– Additional Enrichments -> every 6 months risk

– Support Packages -> every year risk

– Yearly Upgrades -> every year risk

Technical Context & Change Management

OBJECTIVES Objectives

Limit the risk of regressions, avoid impact on Operations

Improve reliability of overall Solution

Limit effort linked to manual Testing

Objectives of Test Automation Project

THE SOLUTION The solution, the tools

Our Test Automation Project

2011 - Proof Of Concept

3 machines

2012 - Deployment

5 machines

≈ 70 hours of daily lights-out testing

2013 – Industrialization

10 machines

≈ 140 hours of lights-out testing

2014 – Next steps

+ 20 machines

+ 250 hours

How ?

2 Tools :

SAP Solution Manager for Test Management

Worksoft Certify for Test script

Certify

Test script

- Generation

- Execution

Solution Manager

Test Management Test Plan

Test Package

Tester Assignment

Test Configuration

How ?

Test Management Approach

Test Plan

Test Package

Test Package

Test Package

Project

Template

Project

Test plan n Variants

Central

documentation

Upgrade, Roll out,

Maintenance,

Enhancement

Projects

Session of Tests

IT tests, KU tests

Teams

Business area

Test Configuration

Data set n Manual Test cases

n Automated Test cases

Tester

Test configuration

Test Plan

Test Configuration

Scenario

Process

Flow

Data of

automated test

1 script Steps of a process

Where process

is executed

For example 20 customers

Test Data Container 1

Test Data Container n

1 Automated Test cases

1 System

n Variants

For example

30 materials

What do we test ?

End to End processes

Cross applications

User simulation

Data stored and managed in Solution Manager

Script stored and managed in Certify

HTML UI

SAPGUI

Application Java

HTML

SAPGUI

HTML

Where ?

Pre-Prod

ERP

PreP SAP APO

QA ERP

QA

SAP Portal Q SAP Portal V

Prod ERP

Prod

SAP Portal P

Config P Config. V

Dev ERP

Dev

SAP Portal D

Config. D

When ?

For Regression Tests

Every night

Unattended tests

10 machines

For Projects

On demand

Until success

During the day

Dedicated data / Variants

Autotest

_06

Autotest

_01

Autotest

_02

Central access

to machines

Infrastructure

Autotest Autotest Autotest Autotest Autotest Autotest Autotest

Scheduler

Test automation process

Business Consultant Analysis Status Report Solution Manager & Certify Viewer

Test

Automation

Team

Test Message

Communication

Damaged Message

Correction of Script

Email Notification

Test Plan Owner

Test Package Owner

Tester assigned

Other Teams

Video - Log collectif depuis slm.avi Lights-out Testing 4 PM – 8 AM

BENEFITS Benefits

Test Types and Use of Test Automation (TA)

Potential Saving of at least 2800 MDs / year

Change Type Risk Manual Test Effort per Year

Target TA Coverage in %

Saving in FTE

Bi-Weekly Maintenance

Support Medium 2000 MDs 80 % 7.3

Bi-Annual Release Enrichment High 2400 MDs 30 % 3.3

Annual Upgrade Upgrade Very High 750 MDs 30 % 1

Projects Rollout Medium 2400 MDs 10 % 1.1

Benefits of Test Automation

Risk Mitigation by Permanent Unintended Test Execution – Issues are detected before they are reaching production

– Automation increases reliability

Saving by Reduction of Manual Test Effort

Increased Coverage of Complexity – More Variants are possible

– Scenarios with very high complexity can be covered

Benefits of Test Automation

Speed of Test Execution and Coverage – Important for time critical Projects

– Schedule can be easily adjusted

Improved Quality of Project Delivery – Test Automation allows to efficiently prepare Test Phases

– Resources can focus on Manual testing of complex Flows, Training and Change Management

QUESTIONS, COMMENTS ? Questions ?