Upload
suhail-ahmad-khan
View
221
Download
0
Embed Size (px)
Citation preview
8/8/2019 Automation Frame Work
1/16
Test Automation Framework for SOA Applications
Ganesh MoorthyHarish Perumal
Sreeja Unnikrishnan
8/8/2019 Automation Frame Work
2/16
2
Table of Contents
Introduction SOA Architecture SOA Testing Our Automation Framework for SOA
Methodology Key components Benefits
Q & A
8/8/2019 Automation Frame Work
3/16
3
Introduction According to a Gartner report, SOA will be used in more than 50
percent of new mission-critical operational applications and business processes designed in 2007 and in more than 80 percent by 2010.
SOA is an evolutionary trend Applications converted to services
interfacing or logic Interoperable, managed, independent or dependent and interactive
Accelerated and unplanned development and deployment of services leads to unplanned and insufficient testing
The need of the hour is to have a test automation framework Well-defined methodology with a measurable process incorporating
early lifecycle testing The right automation tool
8/8/2019 Automation Frame Work
4/16
4
SOA Landscape
SOA comprises of threemajor entities
Service providers Provide access to business
functionalities or systems
Service consumers Utilize service components
to fulfil transactions
Service Governance
Defines, manage andmonitors interactionsbetween providers andconsumers
8/8/2019 Automation Frame Work
5/16
5
SOA Components Business processes
Defines workflow model for businessfunctionalities
Service Provides independent functionality
Service adapters
Provides wrapper service Service integration layer
Manage service interaction andintegration
Service contract Describe properties of hosted service
Data Actual message in the request to the
service and the response
8/8/2019 Automation Frame Work
6/16
6
SOA testingTesting SOA applications is different from traditional testing
approaches. Besides regular functional or regression testing, we alsoneed to ensure Service Level test
Unit testing of service components against specifications Integration test
Test service contracts, service interoperability and service binding Orchestration test
Test service workflow defined for business functionality by monitoringservice calls and Fault injection testing
QoS test Test for performance, reliability, availability and scalability against SLA
Governance test Validating standards and policies by monitoring service calls
Client test Test response from service consumers in a near production environment
8/8/2019 Automation Frame Work
7/167
SOA testing lifecycle
Governance and Regression Testing should be incorporated into all life cycle phases
8/8/2019 Automation Frame Work
8/168
SOA Test Automation Framework Automation Feasibility Matrix
Service level Test stage level Tool suitability
Automation strategy Top-down Bottom-up
Automation Design Tool set up Transaction modeling Scenario creation Test script generation
Automation execution and reporting Metrics based
8/8/2019 Automation Frame Work
9/169
SOA Test Automation Framework
Automation StrategyAutomation Strategy Top-downTop-down
Bottom-upBottom-upAutomation DesignAutomation Design
Tool SetupTool Setup Transaction ModelingTransaction Modeling Scenario creationScenario creation Test script generationTest script generation
Automation Execution andAutomation Execution andReportingReporting
Metrics basedMetrics based
Automation Feasibility Analysis Service level Test Stage level Tool suitability
Service_Stage
feasibility analysis
SOA applications need differentapproach and parameters for feasibility analysis
Home-grown or external tools need tobe evaluated to identify the best fit for the automation requirement withreduced customization cost
Tool suitabilityanalysis
8/8/2019 Automation Frame Work
10/1610
SOA Test Automation Framework
Automation Feasibility AnalysisAutomation Feasibility Analysis
Service levelService level Test Stage levelTest Stage level Tool suitabilityTool suitability
Automation DesignAutomation Design Tool SetupTool Setup Transaction ModelingTransaction Modeling Scenario creationScenario creation
Test script generationTest script generationAutomation Execution andAutomation Execution andReportingReporting
Metrics basedMetrics based
Automation StrategyAutomation Strategy Top-downTop-down Bottom-upBottom-up
Top-down approach involves full fledgedtest automation without the need for aproof of concept. It is successful whenthere is prior experience in SOA testingand a readily available tool requiring nocustomizations.
Bottom-up approach necessitates aproof of concept usually undertaken for Green-field projects and if tool fitmentanalysis was inconclusive or the
automation tool requires a lot of customizations
8/8/2019 Automation Frame Work
11/1611
SOA Test Automation FrameworkIn top-down or bottom-up approach, the strategy is followed by a testing
lifecycle using the tool as depicted below:
8/8/2019 Automation Frame Work
12/1612
SOA Test Automation Framework
Automation Feasibility AnalysisAutomation Feasibility Analysis Service levelService level Test Stage levelTest Stage level Tool suitabilityTool suitability
Automation StrategyAutomation Strategy Top-downTop-down Bottom-upBottom-up
Automation Execution andAutomation Execution andReportingReporting
Metrics basedMetrics based
Automation DesignAutomation Design Tool SetupTool Setup Transaction ModelingTransaction Modeling Scenario creationScenario creation Test script generationTest script generation
Tool Setup:
Setting up the communication parameters byconfiguration or building custom components Transaction Modeling:
Understanding transaction activities andproviding the necessary input / outputparameters and message standards
Scenario Creation: Map Transactions with appropriate
communication parameters and sequencetransactions to complete an end-to-endscenario.
Include business rules for workflowenablement, data propagation or
transformation between sequenced activities Test Script Generation:
Specify data for input and generate test scriptsautomatically and store it in centralizedrepository
8/8/2019 Automation Frame Work
13/1613
SOA Test Automation Framework
Automation Feasibility AnalysisAutomation Feasibility Analysis Service levelService level Test Stage levelTest Stage level Tool suitabilityTool suitability
Automation StrategyAutomation Strategy Top-downTop-down
Bottom-upBottom-upAutomation DesignAutomation Design
Tool SetupTool Setup Transaction ModelingTransaction Modeling Scenario creationScenario creation Test script generationTest script generation
Automation Execution andAutomation Execution andReportingReporting
Metrics basedMetrics based
Execute in iterative mode to isolate
configuration, message or dataissues with each atomictransaction
batch mode to run the scenarios inan uninterrupted manner
Perform regression testing bybaseline test results and comparingoutput of subsequent runs
Perform non-functional/QoS testing Generate atomic and aggregate
reports
8/8/2019 Automation Frame Work
14/1614
Automation framework benefits
Effective Test Managementleading to lower time tomarket
In-Build dashboardreporting
Utility Reporting requiringadditional scripts for aggregate dashboard
Effective Testing leading tolower cost of quality
Workflow basedexecution
Silo based execution
Accurate Scope CoverageEnhancementRequirementsTraceability
UnsynchronizedRequirements and Scripts
Increased Productivity,Enhancement ChangeManagement
Centralized Script andData Storage
Disparate Storage of Scripts
Increased ProductivityCollaborative ScriptGeneration
Silo Based ScriptGeneration
Measurable Quantitativeresults
Planned Script DesignDemand Driven Scriptdesign
BenefitsAutomationFramework
Traditional UtilityScripts
8/8/2019 Automation Frame Work
15/16
8/8/2019 Automation Frame Work
16/16
Thank You
For any details, please [email protected][email protected][email protected]
mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]