Embed Size (px)
Citation preview
Test Management Prepare, Plan and Execute User Acceptance Tests
Active Global Support
July 2012
© 2012 SAP AG. All rights reserved. 2
Test Option
1
Test Option
2
Test Option
3
SAP Quality Center by HP
Test Workbench
Work Center TM
SAP Solution Manager SAP Solution Manager
Test Automation Framework
integrated ISV test automation tools
Quality Manager, ReqPro, RFT, ...
Business Blueprint
BPCA SAP TAO
Business Blueprint
Test Planning
Test System Setup Test Execution
Change
Deployment
Change Impact Analysis SAP Solution
Update
New SAP
Solution
new
new
advanced advanced
advanced
SAP Test Management Options for SAP Customers based on SAP Solution Manager 7.1
Test Scope Identification Type of Change
© 2012 SAP AG. All rights reserved. 3
SAP Test Management Capabilities of Test Option 1 with SAP Solution Manager 7.1
Business Blueprint
Test Planning
Test System Setup Test Execution
Change
Deployment
Change Impact Analysis
Business Blueprint
Business Process
Change Analyzer
(BPCA)
Test Workbench Test Workbench
- manual Tests
- automated Tests
SAP TDMS
Test Planning
eCATT
Test Workbench
Work Center
BW Reporting
Partner Reports
Certifiable Interfaces
Test Status Reporting
Test script creation
Test system assignment
Test data assignment
Test Automation Framework
Test Case Setup
other 3rd party test automation tools
Test Scope Identification
Test Execution
HP QTP
SAP Solution Manager 7.1
Test Data Provisioning
© 2012 SAP AG. All rights reserved. 4
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
© 2012 SAP AG. All rights reserved. 5
Test Preparation Facilitates the preparation for your test activities
Benefits: Improved transparency as all project documents are managed in the same context including Test Cases
Same handling for Manual Test Cases and Automated Test Cases for Test Planning, Execution and Reporting
Reduced effort for upcoming Test activities (e.g. Test Case selection via Attributes)
Create, upload and maintain Test Cases
Manual Test Cases
Automated Tests
eCATT
3rd party (e.g. HP Quick Test Professional, Worksoft Certify, Micro Focus TestPartner, ..)
Business Process attributes and Test Case attributes to allow systematic Test Planning and Reporting
Priority
Status
Keywords / Customer attributes e.g. relevance for legal requirements, Test Phases, …
Responsible Person
Links e.g. Connect Test Case to Test Object , Process description to allow traceability
Time Required (Expected Test Effort)
Features for Test Preparation: Assign/Upload Test Cases to Business Processes
Test Case Description
based on customer
specific template:
© 2012 SAP AG. All rights reserved. 6
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
© 2012 SAP AG. All rights reserved. 7
Test Planning Systematic approach to distribute Test Scope to Tester
Test Plans Test Packages
Repository for Test Cases
Reusable for several Test Cycles during Implementation/ Upgrade Projects and for Regression Tests
Selection of Test Cases for specific Phase
Could be used to reflect other aspects like Business Area, Country, etc.
Relevant for Reporting
Selection of Test Cases to be assigned to one or more testers
Typically used to reflect further organizational aspects like department, user-role, etc.
Test Sequences can be defined within Test Packages
optional: Test Sequences
Project
© 2012 SAP AG. All rights reserved. 8
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
© 2012 SAP AG. All rights reserved. 9
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
© 2012 SAP AG. All rights reserved. 10
Completely Mail and Browser based Test Workflow with SAP Solution Manager 7.1
Mail-Notification contains link
to relevant Test Package
List of Test Cases in
Test Package
Test Cases display with embedded
Test Description and Status
maintenance
© 2012 SAP AG. All rights reserved. 11
Test Workbench - Test Execution Improved Integration with IT Service Management
Set Status und create Message
in the Test Case context
Inbox to monitor and process
Defect Messages
• Integration allows smooth collaboration between different parties e.g. Tester, Service Desk (1st level),
Developer (2nd level) and SAP.
• Allows to Report on test related messages and their status
• Enhanced traceability regarding Test Defects and efficient follow-up
© 2012 SAP AG. All rights reserved. 12
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
With Defect
Message
Successful
Test
© 2012 SAP AG. All rights reserved. 13
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
© 2012 SAP AG. All rights reserved. 14
Different Roles require different views
Quality Manager Test Manager Project Lead
• Suitable reporting capabilities for each role
• SAP Solution Manager offers different views
and different entry points (Test Plan, Project,
Solution) for reporting purposes
• Possibility to drill-down to single Test Cases
and Error Messages
• Solution Manager BI integration provides
graphical based reports
Test Reporting Reporting for Test Results, Progress and Defect Messages
© 2012 SAP AG. All rights reserved. 15
Use Cases for Test Reporting
Test Case Coverage
for documented
Business Processes /
Transactions?
Check for outdated
Test plans
Expected Test Effort?
Coverage of Test
Cases in Test Plans
and Test Packages?
Test Status
and Progress?
Actual Test Effort?
Detected Errors and
related messages?
Test Completeness?
Message resolution?
Test documentation due to legal requirements
Test Preparation
Solution Documentation Test Planning Test Execution
Apply Changes
to Production
Change Impact
Analysis
Test Scope Definition Sign-Off
Test Plans
Sign-Off
Test Scope
Sign-Off
Test Execution
Availability of
TBOMs
© 2012 SAP AG. All rights reserved. 16
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Create/Update Test Cases based on Business
Requirements
Report on current Test Status
Evaluate progress of test execution and
related effort
Report on defect messages based on status
and priority
Test Manager
Key-User / Tester
Test Manager
Get E-Mail Notification
Access Tester Worklist
Perform manual Test
Document Result
Create Test Plan
Create Test Packages
Assign Tester
Release Test Plan – Sign Off
© 2012 SAP AG. All rights reserved. 17
SAP Test Management Capabilities of Test Option 2
Test Option 2
SAP Quality Center by HP SAP Quality Center by HP + QTP
Business Blueprint
Test Planning
Test System Setup Test Execution
Change
Deployment
Change Impact Analysis SAP Solution
Update
New SAP
Solution
SAP TDMS
Test Scope Identification Type of Change
SAP Solution Manager
Business Blueprint
SAP Solution Manager
Business Process Change
Analyzer
SAP TAO
SAP Load Runner
© 2012 SAP AG. All rights reserved. 18
SAP Solution Manager SAP Solution Manager Adapter for SAP Quality Center by HP
SAP Solution Manager SAP Quality Center by HP*
GOAL Exchange of business processes, business requirements, test assets, defects and test
results between SAP Solution Manager and Quality Center
* additional license required
Business Process Hierarchy
Business and Test Requirements
Test Defects
Test Results
Adapter*
© 2012 SAP AG. All rights reserved. 19
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Transfer Business Process Hierarchy,
Business Requirements and
Test Requirements to SAP QC by HP
Test Manager
Key-User / Tester
Transfer Test Results to SAP Solution Manager
Evaluate Test Result in SAP Solution Manager
Perform manual Test
Document actual results
Convert Requirements to Tests
Defines Test Steps and expected results
Create Test Sets
Test Manager
Project Lead
© 2012 SAP AG. All rights reserved. 20
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Transfer Business Process Hierarchy,
Business Requirements and
Test Requirements to SAP QC by HP
Test Manager
Key-User / Tester
Transfer Test Results to SAP Solution Manager
Evaluate Test Result in SAP Solution Manager
Perform manual Test
Document actual results
Convert Requirements to Tests
Defines Test Steps and expected results
Create Test Sets
Test Manager
Project Lead
© 2012 SAP AG. All rights reserved. 21
Prepare User Acceptance Test
Test Planning
Test Execution
Test Reporting
Typical Process for User Acceptance Test
BP Expert
Quality Expert
Transfer Business Process Hierarchy,
Business Requirements and
Test Requirements to SAP QC by HP
Transfer Test Results to SAP Solution Manager
Evaluate Test Result in SAP Solution Manager
Test Manager
Key-User / Tester
Test Manager
Project Lead
Perform manual Test
Document actual results
Convert Requirements to Tests
Defines Test Steps and expected results
Create Test Sets
© 2012 SAP AG. All rights reserved. 22
SAP Solution Manager Adapter for SAP QC by HP Comprehensive Project Status Analysis
Project
Lead
Project Status Analysis
Project Preparation
Business Blueprint
SAP Implementation Project
Configuration
Test
Project Sign-Off
SAP Quality Center by HP
Requirements
Test Planning
Test Execution
Defects
Transfer of test results
and defects
