1
Copyright © CTG, Inc.
ERP en SAP® Testing in Theorie en Praktijk
CTG Belgium NVWoluwelaan 140A bus 3
B-1831 Diegem, BelgiumTel:+32 (0)2 720 51 70
Fax: +32 (0)2 725 09 20http://www.ctg.be
[email protected]@ctg.com
Copyright © CTG, Inc.
Outline
IntroductionTesting SAP® in theory:
ProcessPeopleTechnology
Testing SAP® in practice: case
2
Copyright © CTG, Inc.
But what is SAP® ?Systems, Applications, Products: ERP package providing business solutions and applications for automating business processes
Copyright © CTG, Inc.
Look & Feel - example
3
Copyright © CTG, Inc.
Look & Feel - example
Copyright © CTG, Inc.
Look & Feel - example
4
Copyright © CTG, Inc.
Look & Feel - example
Copyright © CTG, Inc.
Look & Feel - example
5
Copyright © CTG, Inc.
Why structured testing SAP® ?
SAP® systems:Are ‘always’ customized, Are often linked to other legacy systems and other software packages,Often require different local (customized) implementations,Often involve the migration of data between systems, Regularly need ‘changes’ due to legal requirements,Often require functional improvements,Regular upgrades and hot fixes after deployment are a ‘MUST’Often control the complete business process
Copyright © CTG, Inc.
Different situations
ImplementationsMajor upgradesConsolidationsMaintenance
Hot fixesChange requests
6
Copyright © CTG, Inc.
Outline
IntroductionTesting SAP® in theory:
ProcessPeopleTechnology
Testing SAP® in practice: case
Copyright © CTG, Inc.
STBoxTM Testing Methodology
7
Copyright © CTG, Inc.
GO LIVE &SUPPORT
PROJECTPREPARATION
BUSINESSBLUEPRINT
REALIZATION DEVELOPERTESTING
FINAL PREPARATION
IN-STREAMTESTING
CROSS-STREAMTESTING
ACCEPTANCETESTING
TRANSACTIONTESTING
CTG’s V-Model for SAP®
Copyright © CTG, Inc.
Developer Testing
Developer Testing: Technical tests of low-level components (e.g. a conversion module)
8
Copyright © CTG, Inc.
Transaction Testing
Transaction Testing: Testing a single transaction (e.g. VA01 Create Sales Order). Transaction testing shall be conducted to confirm the operation of transactions + configuration checks (e.g. default values, mandatory fields etc.)
Copyright © CTG, Inc.
In-Stream Testing
In-Stream Testing: Testing of a flow within 1 single process. In-Stream Testing is testing chains of transactions that flow together and which reflect important business process and scenarios.
9
Copyright © CTG, Inc.
Cross-Stream Testing
Cross-Stream Testing: End-to-end testing of integrated processes through execution of predefined business flows (within SAP or collaboration between SAP and legacy systems).
Copyright © CTG, Inc.
Acceptance Testing
Acceptance Testing: In-Stream or Cross-Stream Tests by the user community with the objective of formal acceptance. In some cases, and for practical reasons, the Acceptance Tests are combined with Cross- or even In-Stream Tests.
10
Copyright © CTG, Inc.
Used methodology: STBoxTM ModelTEST PROJECT PREPARATION
TEST
MANAGEMENT
DETAILED TEST PLANNING
TEST BUILD
TEST EXECUTION
For every Iteration / Test Level /Test Type: QUALITY
MANAGEMENT
TEST PROJECT CLOSURE
Copyright © CTG, Inc.
Outline
IntroductionTesting SAP® in theory:
ProcessPeopleTechnology
Testing SAP® in practice: case
11
Copyright © CTG, Inc.
STBoxTM Testing Methodology
Copyright © CTG, Inc.
Testing Roles
Test CoordinatorTester
System & Integration TestersAcceptance Testers
Test Tool Specialist
12
Copyright © CTG, Inc.
Test Coordinator
! For a Test Coordinator, it is important to combine ‘in depth test knowledge’ with ‘high-level SAP®knowledge’ (has to know the core business flows of an organization)
Ability to set up a test process,Compose the overall planning,Define the high-level test requirements,Coordinate and follow up the testing activitiesCoordinate and follow up testers
Knowledge of Test Management ToolsKey-Role in the test process
Copyright © CTG, Inc.
Challenges Test Coordinator
Complexity: for E2E Acceptance Testing you need coordinate different user groups and you have to put them in a logical business chainMostly there is an external developer/integrator. Testing is not their core capability.Implementations can be on different locationsIntegration with other packages and legacy systemsDifferent processes within SAP® that need to be integrated.
13
Copyright © CTG, Inc.
System & Integration Testers
Structured testing specialist ‘preferably’ with SAP®knowledge
Representatives of the IT-department
Intermediary between developers and users
Copyright © CTG, Inc.
GO LIVE &SUPPORT
PROJECTPREPARATION
BUSINESSBLUEPRINT
REALIZATION DEVELOPERTESTING
FINAL PREPARATION
IN-STREAMTESTING
CROSS-STREAMTESTING
ACCEPTANCETESTING
TRANSACTIONTESTING
IT-D
ep.
Bus
ines
s D
ep.
CTG’s V-Model for SAP®
14
Copyright © CTG, Inc.
Acceptance testers
Acceptance testers usually are users
Experts in a specific domainFinanceMarketingHRMEtc...
Need to be guided in their testing tasks
Copyright © CTG, Inc.
GO LIVE &SUPPORT
PROJECTPREPARATION
BUSINESSBLUEPRINT
REALIZATION DEVELOPERTESTING
FINAL PREPARATION
IN-STREAMTESTING
CROSS-STREAMTESTING
ACCEPTANCETESTING
TRANSACTIONTESTING
IT-D
ep.
Bus
ines
s D
ep.
CTG’s V-Model for SAP®
15
Copyright © CTG, Inc.
Test Tool Specialist
General SAP® knowledge
Specialized tool knowledgePerformance toolsAutomation tools
Development skills
Structured testing principles
Copyright © CTG, Inc.
Outline
IntroductionTesting SAP® in theory:
ProcessPeopleTechnology
Testing SAP® in practice: case
16
Copyright © CTG, Inc.
STBoxTM Testing Methodology
Copyright © CTG, Inc.
Types of test tools
Test management toolsPerformance test toolsTest automation tools
17
Copyright © CTG, Inc.
Test management tools
Centralized test mgt
TestView
Centralized test mgt
TestDirector / Quality center
Centralized test mgt
QACenter
Copyright © CTG, Inc.
Performance test tools for SAP®
Performance testing
Forecast
Performance testing
Sucid Load
Performance testing
Silk performer
Performance testing
Rational performance tester for SAP®
Load testingLoadRunner
Performance testing
QALoad
18
Copyright © CTG, Inc.
Test automation tools for SAP®
Functional testing of SAP® GUI
Rational robot
Functional and regression testing
Quick test professional
Functional and regression testing
QARun/Testpartner
Testing suiteE-CATT
Analysis toolsSOLO/LiveModel/LiveCapture/LiveCompare/Assessor
Copyright © CTG, Inc.
Conclusion
SAP® specificEnd to endV-modelTesting knowledge underestimatedImportance of system and integration testingTester is test specialist (pref. with SAP® knowledge)
GenericTest coordinator key roleTest process
19
Copyright © CTG, Inc.
Outline
IntroductionTesting SAP® in theory:
ProcessPeopleTechnology
Testing SAP® in practice: case
Copyright © CTG, Inc.
Goal of projectCreation of a test strategy for maintenance projectsRegression testing for all new releases:
New/modified functionalityRollout new sitesVersion upgradesHot packs/legal packs
Set up structured test approach for all future SAP®maintenance projects
20
Copyright © CTG, Inc.
Used methodology: STBoxTM ModelTEST PROJECT PREPARATION
TEST
MANAGEMENT
DETAILED TEST PLANNING
TEST BUILD
TEST EXECUTION
For every Iteration / Test Level /Test Type: QUALITY
MANAGEMENT
TEST PROJECT CLOSURE
Copyright © CTG, Inc.
1. Generic Test PlanningTEST PROJECT PREPARATION
TEST
MANAGEMENT
DETAILED TEST PLANNING
TEST BUILD
TEST EXECUTION
For every Iteration / Test Level /Test Type: QUALITY
MANAGEMENT
TEST PROJECT CLOSURE
21
Copyright © CTG, Inc.
Phase 1: Generic Test Planning
Determine scope of projectSAP® testing in maintenance projectDefine regression test approach
Determine high level test strategy-> Test strategy matrix per SAP ® module
List all SAP® transactions in logical business/testing flowInventory of (available) test scenarios and ancestor test scenariosInventory of relevant SAP® documentation: business flow, work instructions, business process proceduresGeneric priority analysis: SLA rating and usageAnalysis cross-module impactListing of tester profile per transaction
Copyright © CTG, Inc.
Phase 1: Generic Test Planning
Test strategy matrix: content:One test strategy matrix per SAP® module Different worksheets per matrix
The test strategy matrixSLA rating of each transactionUsage of each transaction Transactions with roles: list of simple roles in SAP® against transactions per module -> for authorization testing
Only useful for the completion of the test strategy matrix
22
Copyright © CTG, Inc.
Phase 1: Generic Test Planning
Copyright © CTG, Inc.
GO LIVE &SUPPORT
PROJECTPREPARATION
BUSINESSBLUEPRINT
REALIZATION DEVELOPERTESTING
FINAL PREPARATION
IN-STREAMTESTING
CROSS-STREAMTESTING
ACCEPTANCETESTING
TRANSACTIONTESTING
CTG’s V-Model for SAP®
23
Copyright © CTG, Inc.
Phase 1: Generic Test Planning
Authorization analysis-> Authorization analysis
List of simple roles in SAP® R/3 against the individual transactions / module
Copyright © CTG, Inc.
Phase 1: Generic Test Planning
Create generic test plan-> generic test plan
Identify test assignment and scopeList test object and test basis List high level Features To Test and Features not To TestDiscuss approach used in this test project:
Test methodology Test automation?Reviews and inspectionTest strategyDefect trackingMeetings and reportingDifferent test level
24
Copyright © CTG, Inc.
Phase 1: Generic Test Planning
Create generic test plan: cont’d
List item pass/fail criteriaList suspension and resumption requirementsList testing tasks and deliverablesDescribe IT system landscapeDescribe responsibilitiesInclude chapter on staffing and training needsInclude test schedule
Copyright © CTG, Inc.
2. Detailed Test PlanningTEST PROJECT PREPARATION
TEST
MANAGEMENT
DETAILED TEST PLANNING
TEST BUILD
TEST EXECUTION
For every Iteration / Test Level /Test Type: QUALITY
MANAGEMENT
TEST PROJECT CLOSURE
25
Copyright © CTG, Inc.
Phase 2: Detailed Test Planning
Determine detailed test strategy
Analyze scope of maintenance project (upgrade, minor implementation, support pack…)Decide on relevant test levelsPerform impact analysisIdentify FTT’s based priority (impact * SLA * usage) = test effortExtract in scope test plan from test matrixIdentify missing documentation
Copyright © CTG, Inc.
Phase 2: Detailed Test Planning
26
Copyright © CTG, Inc.
Phase 2: Detailed Test Planning
Create test data plan-> test data plan
To support execution of test scenariosFabricated and loaded data
Copyright © CTG, Inc.
Next StepsTEST PROJECT PREPARATION
TEST
MANAGEMENT
DETAILED TEST PLANNING
TEST BUILD
TEST EXECUTION
For every Iteration / Test Level /Test Type: QUALITY
MANAGEMENT
TEST PROJECT CLOSURE
27
Copyright © CTG, Inc.
Outline
IntroductionTesting SAP® in theory:
ProcessPeopleTechnology
Testing SAP® in practice: case
Copyright © CTG, Inc.
Conclusion
Inventory of FTT’s with priorityTest strategy matrix
Complete and consistentExtensive and reusable basis Minimize risksAchieve higher maturity level in test approachHigher quality through structured testing
SAP maintenance testing: focus on preparation and planning