PowerPoint Presentation

PROJECT PRESENTATION

Prof: Daniel Amyot

Presented ByANVESH ALUWALAGURPREET SINGH DHADDA

Evaluation of Load Testing ToolsWebLOAD Professional Vs NeoLoad 3.1AgendaBusiness contextOur Goal in the projectLoad TestingMethodologyList of CriteriaDescription to WebLOAD Professional & NeoLoad 3.1Final Recommendation

Our Business ContextCompany: weexcel Inc.Developers: 25QA Testers: 4

The company planned to launch an web application and they want to Load Test the application before deploymentThe company needs a recommendation of the tool that meets the maximum goals set by the companyOur one and only GoalRecommend the tool that best serves the organizations purpose to test their web applications before deployment

Intro to Load TestingAlthough both Load Testing and Performance Testing seem similar, their goals are different.Load testing operates at a predefined load level, usually the highest load that the system can accept while still functioning properly.On the other hand, performance testing uses load testing techniques and tools for measurement and benchmarking purposes and uses various load levels.We can generally call the Load Testing as the subset of Performance testing.Load TestingLoad Tests determine the applications behavior under load, up to and including its limits (not just at its limits).

Load tests specifically refer to the load size (number of concurrent users) and related values.

MethodologyWe compare two tools: WebLOAD Professional & NeoLoad 3.1We use an E-Commerce website for creating the test process.It will be a quantitative analysis.Each criteria will have a specific range.Both the tools will be marked for each criteria within the specific range.The tool which scores high overall will be recommended. CriteriaMinimal criteria

Scope for automation.Detect performance bottlenecks.Display response times under variable loads.Must support HTTP/S, SOAP and TCP/IP Internet protocols.MS Windows compatible.Criteria(Contd.)Good to have criteria

Cost and License.Ease of use.Steadiness of the tool.Documentation available for the tool.Variety of reports provided by the tool.Support scripting for scenario generation.Customer support.Reputation of the tool in market.

Range for each criteriaCRITERIARANGEScope for automation0-10Detect performance bottlenecks0-10Display response times under variable loads0-10Must support HTTP/S, SOAP and TCP/IP Internet protocols0-10MS Windows compatible0-10Cost and License0-5Ease of use0-10Steadiness of the tool0-5Quality of reports provided by the tool0-10Support scripting for scenario generation0-5Customer support0-5Documentation available for the tool.0-5Reputation of the tool in market0-5TOTAL100WebLOAD ProfessionalThis tool is from the family of Radview

Testing process:Creating and editing scriptsCreating and running Load TestsAnalyzing Load Test results

Scripts can be added in JavaScript languageAlso provides script correlation, script validations and script parameterizationScreenshotsCreating agenda

ScreenshotsRunning Test

13ScreenshotsAnalyzing results

NeoLoad 3.1This tool is from NeotysTesting process:Record -Capture a scenarioDesign -Graphical interface -Defining dynamic parameters -Defining logical options(delay, loops, try catch, etc) -Checking the virtual users

NeoLoad 3.1Testing process(contd.)Monitors -Create monitoring machine(select OS, Databases and Web EJB Architecture) -Select performance counters System(CPU User, CPU system, CPU idle, etc.) Memory(memory used, memory free)Runtime -Select load generator -Select durationAnalyze results

Screenshotscreating scenario

Screenshots...runtime

Screenshotsanalysis

Marking of tools on each criteriaScope for automation: The test cases should run automatically after defined time intervals. WebLOAD: This tool supports automation of test cases NeoLoad: Even this tool supports automation of running test cases by specifying the time interval in the duration policy

Detect performance bottlenecks: should specify an alert message when the system is in critical stage WebLOAD: Gives a detail report of the errors NeoLoad: Gives a quick alert message and details regarding that error

Marking of tools on each criteriaDisplay response times under variable loads WebLOAD: The reports generated specify clearly the response times for different loads NeoLoad: We can track the response times at every instance during the run time of the test process

Must support HTTP/S, SOAP and TCP/IP Internet protocols WebLOAD: Wide range of protocols are supported NeoLoad: Wide range of protocols are supportedMarking of tools on each criteriaMS Windows compatible: The tool must mainly support MS Windows OS but support for other platforms is considered as an advantage. WebLOAD: Supports MS Windows OS NeoLoad: Supports Linux, Solaris, IBM AIX, HP-UX and VMWare other than MS Windows OS

Cost and License: The competitive price matters a lot in evaluation. WebLOAD: Cost is over $5000 for 100 virtual users NeoLoad: Cost is cheaper when compared to WebLOAD

Marking of tools on each criteriaEase of use: Usability is important. The tool should be easy to learn for the testers. WebLOAD: Little tricky to create the script parameters and validations NeoLoad: Self-explanatory and easy to use

Steadiness of the tool: The tool should not crash or hang up in between. WebLOAD: Little bit slow in runtime NeoLoad: Runs perfect on threshold loads too

Marking of tools on each criteriaQuality of reports provided by the tool: At the end, the reports on the test should be precise and of variety of representation types WebLOAD: Need not be a performance analyst in order to examine the test results. NeoLoad: Provides enough charts to represent the results efficiently

Support scripting for scenario generation WebLOAD: This supports scripting NeoLoad: This is only GUI based

Marking of tools on each criteriaCustomer support WebLOAD: The Radview team provides excellent service NeoLoad: The Neotys team are equally helpful

Documentation for the tool WebLOAD: Precise documentation available NeoLoad: Well formatted documentation is available

Reputation of the tool in market WebLOAD: Captured 3% of the market share NeoLoad: New tool, but good competitor for WebLOAD. Final marking of the toolsCRITERIARANGEWebLOADNeoLoadScope for automation0-101010Detect performance bottlenecks0-101010Display response times under variable loads0-10910Must support HTTP/S, SOAP and TCP/IP Internet protocols0-101010MS Windows compatible0-10910Cost and License0-535Ease of use0-10710Steadiness of the tool0-535Quality of reports provided by the tool0-101010Support scripting for scenario generation0-550Customer support0-555Documentation available for the tool.0-544Reputation of the tool in market0-554TOTAL1009093Final RecommendationAfter the quantitative analysis of both the tools we recommend NeoLoad 3.1 and the detailed results and evaluation to choose this tool will be explained in the final report.

Thank U for kind attention