Testing the SAP way

©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Session ID: BTOT-WE-1000/8Twitter hashtag #HPSWU

©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

Speaker Name: Benjamin Alloul, SAPDate: 01/12/2010Session ID: BTOT-WE-1000/8

Testing the SAP wayReducing effort and risk using SAP end-to-end testing solutions

SAP as Business Innovation Platform

– How do I identify opportunities to improve my processes?• When a new process becomes available, how quickly can I integrate the process

into my business and begin realizing benefits from it

• How can I decrease the time required to implement system changes and events?

• How can I proactively determine if our end-users are executing in the SAP application as designed and tested?

• How do I improve implementation performance, mitigate risks, leverage accelerators, and measure adoption?

Change EventsBusiness drivers Changed business processes M&A re-organizations New products, vendors…Compliance drivers Governance Risk management ComplianceTechnology drivers New functionality Upgradesh

Transforming software change control into business change control – company-wide, across SAP and non-sap landscapes

…establish a quality platform to minimize time/cost of change event efforts

Consolidation

New Implementation

UpgradesEff

ort

Ongoing ChangeEvents

New Processes

Time

DiscreteChangeEvents

CustomDev. Custom

Dev.

Custom Dev.

Hot Packs

SupportPack

SupportPack

3 BTOT-WE-1000/8 : Testing the SAP way

“Quality & Testing” - Biggest pain point of upgrades

83%

17%

% Members

In the Process of upgrading

Not upgrading

Major Cost and Time Factors during Upgrade or Implementation, % Customers

QA & Testing

Change Mgmt.

Planning

Training & Doc.

Resource Mgmt.

Complexity

Project schedule

n=52

0%

5%

7%

12%

16%

30%

75%Testing and coverage is the #1 stated pain point for all customers

Over 86% of customers are concerned about risks due to lack of comprehensive testing

Complexity and project schedule are rated much lower compared to the rest

Source: ASUG Test influence council member survey4 BTOT-WE-1000/8 : Testing the SAP way

SAP Solution Manager The SAP Platform for Application Lifecycle Management

ALM Processes enabled with SAP Solution Manager


Require-ments

Design

Deploy

Build & Test

Optimize

Operate

SAP Solution Manager

Solution Documentation• Central documentation of processes, system landscape,

custom code, partner applications, …

Template Management• Standardize configuration across

multiple projects

Innovation Management• Discover and realize enhanced

business functionality• Avoid disruption of business

Test Management• Change impact analysis• End-to-end test management

Technical Operations• Central monitoring & alerting infrastructure • Unique End-User Experience monitoring• Central administration tools

Change Control Management• Integrated quality management• Synchronized transports of various components• Controlled and documented adjustment of business

processes incl. approval process

Maintenance Management• Management of corrective software packages

Business Process Operations• Ensure business continuity• Provide Business KPIs• Business process benchmarking

Application Incident Management• Integrated service desk• Involvement of partners in problem resolution • Provide root-cause analysis for complex

landscapes with diverse technology stacks

Upgrade Management• Comprehensive project support

for release transitions

SAP Quality PlatformEnd to End Test Management for SAP Solutions

The SAP Quality PlatformComplete solution of products and professional services

Plan Execute Evaluate

End-to-end project road-mapping and blueprinting

SAP enterprise business process modeling

Further time and cost savings via drag-and-drop test case creation

Unique SAP offering enabled by SAP core business process expertise

Detailed test planning and management

Test case management

Visibility into the overall testing process

Comprehensive dashboards

Closed loop from blueprint to test results like status, incidents, and defects

Bi-directional integration between Solution Manager and Quality Center for role-based usage

SAP Solution Manager Adapter

Performance test and tune SAP and non-SAP applications

Comprehensive performance dashboards

Deep diagnostics for SAP Business Suite and SAP NetWeaver

SAP LoadRunner by HP

SAP Solution Manager

SAP Test Acceleration &

Optimization (TAO)

SAP Quality Center by HP

Test data migration server Create consistent and small QA and development environments

SAP Test Data Migration Server (TDMS)

Test Center Implementation Service Functional Implementation

QuickstartSAP Professional Services

Performance Automation QuickStart

...

SAP Quality Center by HP & SAP Test Acceleration & Optimization (TAO)

Test Scope Identification

Type of change

Business Blueprint

Change Impact Analysis

Test Planning Apply changes to productive system

New SAP Solution

SAP Solution Update

Test Execution

Solution ManagerBusiness Blueprint Setup of business process

catalog Business requirements

Solution ManagerBusiness Process Change

Analyzer Identification of process

affected by code/customizing changes

SAP TDMSTest Data Migration Server

Setup of test data in QA systems

Test Automation Tools

HP Quick Test Professional

UI Based Testing Business Process Components Testing

HP Quality Center Test

Requirements Test Planning Business Process

Testing (Design)

HP Quality Center Requirements Risk Based

Testing Test Set Execution Business Process Testing

(Execution)

SAP TAO - Test Acceleration & Optimization

Test Components Generation Test Components Maintenance

E2E Integration Testing of SAP Solutions (Functional)

Test Systems Preparation


ASAP Methodology v7.0Define how to use HP Quality Center and SAP Test Acceleration & Optimization (TAO) with SAP

Solution Manager

Test Process ManagementKeeping the alignment between the SAP Project Team and the Quality Team

SAP Solution Manager ProjectWhat is in a SAP Solution Manager Project and where do we link to the Quality Center project

Scope

Template and Roadmap selection

Industry selection

Country selection

Project Team

System Landscape

Including location of test cases

Milestones

Organizational Units

Project Standards

Link to SAP Quality Center by HP

1 - Solution Manager Project

Project Implementation

Customizing activities

Assignment of test cases to business process and transaction

3 - Configuration

Project requirements

SAP Documentation

Customer-specific process documentation

Transactions

Requirements for SAP Quality Center by HP

2 - Business Blueprint


SAP Solution Manager Adapter for HP Quality Center S

olu

tion

M

an

ag

er

Pro

ject

Business Blueprint

Requirement document

Test Results

Solution Manager

Service Desk

Qu

ality

C

en

ter

Test

Pro

ject

Reporting &

Dashboard

Requirements

Tests Results Defects

Sync ReportCollect


Full & integrated traceability from Business Process to Test Requirements, Test Cases, Test Results and Defects

SAP Test Acceleration & OptimizationSemi automated approach for accelerated Test Case Composition & maintenance

SAP Test Automation


The Evolution of Testing – Stages of Testing

Manual Testing Highly time-intensive. No capacity for re-use

Record and Replay Unattended rapid repetitive execution Capacity to test many more conditions Scripts creation and maintenance requires skilled automation engineers

Business Process Testing Componentized testing by the enablement of composition of test cases by Drag&Drop Still requires maintenance and automation scripting support in the background

Test Acceleration Test Component generation based on metadata from program sources Predefined library of reusable standard components Ongoing maintenance simplified by scanning of transactions and automated updating of

components

SAP Test Acceleration & Optimization (TAO)

SAP Solution Manager BPCA

HP Business Process Testing HP QuickTest Professional

Test Scope Identification

Type of change

Change Impact Analysis

Test Planning Apply changes to productive system

SAP Solution Update

Test Execution

Test Automation Tools

HP Quick Test Professional

Business Process Components Execution

HP Quality Center Test Set Execution Business Process Testing

Components

SAP Test Acceleration & Optimization

Test Components Generation Test Components Maintenance

Solution ManagerBusiness Process Change

Analyzer Identification of process

affected by code/customizing changes

Automated testing the SAP way with SAP TAO


Test Automation with SAP TAO


Approach for Test Case Composition

3 - Test Case Execution2 - HP Quality Center1 - Test Case Composition

SAP TAO triggered execution of SAP Business Process by Business User to create Test Components, Test Case and Test Data structure

Business Analyst

SAP TAO - Process Flow Analyzer

Generation

TAO Component L ibrary

TAO Test Components library for each SAPGUI sub-screens with parameters for all fields. Components use QTP Scripting Technology

BPT Test Case composed out of Test Components with parameters for all input fields

Excel File with Test Data for each input parameter

SAP TAO created QC BPT Test Case are assigned to Test Sets

HP QuickTest Professional executes the Test Cases

QC Test Case Results Reporting



A few screenshots



Key Features

Composition/Modification of automated test cases via standard functionality of HP Quality Center

Automatic generation of test components and test case for SAP business processes

Tightly controled deployment of software changes to SAP Solution

SAP TAO Integration with BPCA*

23 BTOT-WE-1000/8 : Testing the SAP way * BPCA : Business Process Change Analyzer is a functionality of SAP Solution

Manager

Accelerated repair of damaged TAO test components and test cases

1 BPCA: Change Impact Analysis of software changes on (critical) business process

2 SAP TAO: BPCA-Analysis result triggers re-generation of damaged test components

3 SAP TAO: Maitenance of affected test components and test cases

4 SAP TAO: Risk-based recommendation for regression tests based on BPCA analysis

SAP Test Acceleration & Optimization with BPCA


A few screenshots

SAP TAO integration with BPCA


Key Features

Accelerated repair of damaged test cases

Precise identification of impacted business processes and test cases

Risk-based recommendation for regression tests

Integration into SAP Solution Manager standard functionalities

SAP TAO : Cost–effective automated testing


HP Quality Center

SA

P S

olu

tio

n M

an

ag

er

Test Acceleration & Optimization(TAO)

200

300

400

500

600

700

800

900

1 2 3 4 5 6 7 8 9 10

Traditional AutomationROI within 5 test cycles

Manual

Traditional Automation

SAP TAO

# of Test Cycles

Ag

gre

ga

ted

Eff

ort

(h

ou

rs)

Total Effort Per Approach (Hours) (Assumption: 35 Business Processes)

SAP TAOROI within 2 test cycles

Typically 3 Test Cycles within an Upgrade

Case StudyHow does “testing the SAP way” enable our client to deliver applications and changes on time and with much higher quality

SAP Solution Manager Adapter


(TAO)

HP Quality Center

Solutions

Client


“There are two ways to write error-free programs; only the third one works.”

— Alan J. Perlis

Continue the conversation with your peers at the HP Software Community hp.com/go/swcommunity

Documents

Testing the SAP way