Automating your Website Testing

11 © ALP International CorporationMarch 2001 MD-CFUG

Andrew L. Pollner and Lei WangAndrew L. Pollner and Lei Wang

ALP International CorporationALP International Corporation

Why Load Test?

To Simulate Multiple Users on a SystemTo Simulate Multiple Users on a System To Measure end-to-end performanceTo Measure end-to-end performance To Measure Server Performance:To Measure Server Performance:

– Database (Oracle)Database (Oracle)– Application (CF)Application (CF)– Middleware (Web Logic)Middleware (Web Logic)– Web (Netscape)Web (Netscape)

When Should Loadtesting Occur?

When sizing a serverWhen sizing a server After Application Has StabilizedAfter Application Has Stabilized When other users are not on the systemWhen other users are not on the system After notifying Sys Admin.s, DBA’s, Test After notifying Sys Admin.s, DBA’s, Test

ManagersManagers

What’s Needed for Loadtesting?

Knowledge of:Knowledge of: ApplicationApplication DatabaseDatabase EnvironmentEnvironment LoadRunner!LoadRunner!

Loadtesting Concepts - Part I

TransactionTransaction

RendezvousRendezvous

Measured event (i.e. Time it takes to Measured event (i.e. Time it takes to return data to a screen after a return data to a screen after a QUERY button is pressed)QUERY button is pressed)

Synchronized point where Synchronized point where transaction is to occur transaction is to occur simultaneouslysimultaneously

Loadtesting Concepts - Part II

Vuser Vuser

SgroupSgroup

ScenarioScenario

A defined user type which A defined user type which

executes a specific testexecutes a specific test

A group of Vusers which with a A group of Vusers which with a

characteristic profilecharacteristic profile

A combination of sgroupsA combination of sgroups

Types of Vusers

WebWeb C/S GUIC/S GUI Terminal EmulationTerminal Emulation SQLSQL

Using LoadRunner - Web

Record HTTP ScriptRecord HTTP Script Generalize traceGeneralize trace Add Transaction points:Add Transaction points:

– start_transaction(“ClaimWriteback”)start_transaction(“ClaimWriteback”)– end_transaction(“ClaimWriteback”, PASS)end_transaction(“ClaimWriteback”, PASS)

Add Rendezvous:Add Rendezvous:– rendezvous(“Login”) rendezvous(“Login”)

rendezvous(“ClaimWriteback”)rendezvous(“ClaimWriteback”)

Enter Data

Save Data

Enter Data

Save Data

Enter Data

Save Data

Rendevouz 1 ==>

Rendevouz 2 ==>

Rendevouz 3 ==>

Start Synchronization

Enter Data

Save Data

Enter Data

Save Data

Enter Data

Save Data

Rendevouz 1 ==>

Rendevouz 2 ==>

Rendevouz 3 ==>

Step Synchronization

Using LoadRunner - DB

Get SQL traceGet SQL trace Generalize SQL traceGeneralize SQL trace Add Transaction points:Add Transaction points:

– start_transaction(“ClaimWriteback”)start_transaction(“ClaimWriteback”)– end_transaction(“ClaimWriteback”, PASS)end_transaction(“ClaimWriteback”, PASS)

Add Rendezvous:Add Rendezvous:– rendezvous(“Login”) rendezvous(“Login”)

rendezvous(“ClaimWriteback”)rendezvous(“ClaimWriteback”)

Product Categories

GUI/Web vusersGUI/Web vusers– Netscape BrowserNetscape Browser– IE BrowserIE Browser– Client ServerClient Server

RTE vusersRTE vusers– Terminal EmulationTerminal Emulation

SQL (dB) vusersSQL (dB) vusers– Client ServerClient Server

LoadRunner Family of Products

Both Client Both Client ANDAND Server Load Testing Server Load Testing Wide range of platformsWide range of platforms

– Win 2000Win 2000

– NTNT

– Win95/98Win95/98

– UNIXUNIX

ReportingReporting– Automatically for each userAutomatically for each user

– By transactionBy transaction

Single point of control: ControllerSingle point of control: Controller

Client AND Server Load TestingTesting the Site

WAN/Internet

SYBASE SERVER

NTSQLSERVER

Single point of control: ControllerSingle point of control: Controller Drive multiple Drive multiple realreal NT GUI clients :End-to-End NT GUI clients :End-to-End

SYBASE SERVER

SQLSERVER

WAN/Internet

Single point of control: ControllerSingle point of control: Controller Drive multiple Drive multiple realreal NT GUI clients : End-to-End NT GUI clients : End-to-End Stress SQL Server with multiple Stress SQL Server with multiple virtualvirtual NT clients NT clients

SYBASE SERVER

SQLSERVER

WAN/Internet

Single point of controlSingle point of control Drive multiple Drive multiple realreal clients clients Stress SQL Server Stress SQL Server virtualvirtual clients NT clients NT Stress Sybase: Stress Sybase: virtualvirtual clients NT/UNIX clients NT/UNIX

Client AND Server Load TestingTesting the Enterprise

SYBASE SERVER

NT/UNIX

NT WAN/Internet

Advanced Loadtest Measurement

Mean vs. MedianMean vs. Median 90% Percentile90% Percentile Performance under loadPerformance under load System Performance MeasurementSystem Performance Measurement

– CPUCPU– SWAPSWAP– DISKDISK

Analyzing Loadtest Results - ICLIENT LAN WAN

ApplicationProtocol SQL Server

Total System Performance: Client, LAN, SQL Server, WAN, Sybase

Sybase

SERVERSERVER

Client

Transaction Performance: LAN, SQL Server, WAN & Sybase

Analyzing Loadtest Results - IICLIENT LAN WAN

ApplicationProtocol SQL Server Sybase

SERVERSERVER

Client

Server

Analyzing Loadtest Results - IIICLIENT LAN WAN

ApplicationProtocol SQL Server

Transaction Performance: WAN, Sybase

Sybase

SERVERSERVER

Client

Server

Analyzing Loadtest Results - IVCLIENT LAN WAN

SERVERSERVER

Transaction Performance: SYBASE

Client

Server

Analyzing Loadtest Results - VCLIENT LAN WAN

SERVERSERVER

Client

Server

Transaction Response Time: Client

Transaction Response Time: LAN, SQL Server

Conclusions

Loadtesting:Loadtesting: Is a necessary component in testing an Is a necessary component in testing an

application and its environmentapplication and its environment Has multiple purposesHas multiple purposes Comes in many flavorsComes in many flavors Is an extension to Functional testingIs an extension to Functional testing Is complex!Is complex!

Virtual User Generator

LoadRunner Controller

Controller Vusers

Vuser Protocol

Transaction Report

Page Faults Graph

On-line Monitors

Automating your Website Testing

Documents

Xamarin Test Cloud – Automating Testing Effectively

Automating Testing with Telelogic DOORS @ NXP...Telelogic User Conference 2008 – France (November 26, 2008) Automating Testing with Telelogic DOORS @ NXP – ©Bernd@GRAHLMANN.net

Game On: Automating Sports Video Game Testing

Automating Performance Testing JMeter Luba Ilieva

Automating Software Testing - Myths, Benefits and Tools

Automating Emergency Power Supply System Testing in …static.schneider-electric.us/assets/pdf/healthcare/whitepapers... · Automating Emergency Power Supply System Testing in Hospitals

Automating is Adapting Testing Mobile Apps Differently

Automating Performance Testing with JMeter - devbg. · PDF fileLuba Ilieva, Senior QA Engineer Musala Soft Ltd. 15.February.2007 Automating Performance Testing with JMeter

[XCode] Automating UI Testing

Automating Testing with Open Source Tools.ppt - Confluence - Sakai

Automating JFC UI application testing with Jemmy

Automating SQL testing with Vmware, JMeter, JProfiler ...davidjyoung.com/cmg/hdp25.pdf · Automating SQL testing with Vmware, JMeter, JProfiler, LoadRunner and Django. Figure 3 –

Automating sap testing with qtp10 & qc10

1 © ALP International CorporationMarch 2001 MD-CFUG Automating your Website Testing By Andrew L. Pollner and Lei Wang ALP International Corporation

Automating Development and Testing Through Virtualization

Automating Software Testing Using Program Analysis

Challenges and approaches to automating testing of software

Automating Software Testing at Siemens MPpeople.cs.aau.dk/~bnielsen/MBTV07/material/mtv-smp.pdf · Automating Software Testing at Siemens MP Brian Nielsen, Ph.D. bnielsen@cs.auc.dk

Automating Emergency Power Supply System Testing · PDF fileAutomating Emergency Power Supply System Testing in ... is usually done weekly or monthly and depending ... Automating Emergency

AUTOMATING A CANNABIS TESTING LABORATORY