Embed Size (px)
DESCRIPTION
Training For Selenium, soapUI, Sahi, TestMaker Performance Testing. Slide deck from the free Webinar titled "Technical Training On The Agile Open Source Way To Load Test, Scalability Test, and Stress Test." Learn the Agile Open Source Testing way to load and performance test your Web applications, Rich Internet Applications (RIA, using Ajax, Flex, Flash, Oracle Forms, Applets,) and SOAP and REST Web services. This free Webinar delivers a testing methodology, tools, and best/worst practices.
Citation preview
Agile Open Source Performance Testing
Frank Cohen, +01 (408) 871-0122, [email protected]
January 5, 2012
The Agile Performance Test Methodology and Tools
A Workshop For Developers, Testers, IT Ops
Open Source Test Automation
About PushToTest‣Our Mission: Test, To Make A More Reliable World
‣Make It Easier To Move From Manual To Automated Testing
‣Support Advanced Testing, including Agile, Load, Integration
‣Open Source Testing (OST) For Everyone
2
Open Source Test Automation
When OST Is Your Best Choice
3
‣Modern Agile Software Development Techniques
‣Highly-Usable, Highly-Functional Applications for Web Deployment
‣Complex Data, Sophisticated User Interaction, Application Business Logic (Workflow)
http://www.pushtotest.com/10-ways-to-build-and-test-rich-internet-applications-ria.html
Open Source Test Automation
Agile Repurposing‣Agile Delivers More Projects Faster
‣Requires Repurposing Between Teams
‣Treats Tests As Business Asset (Version Control, Sharing, Reuse)
4
DevTest
Biz
IT
Business Requirements to LaunchIntegration Test and SLA Compliance
Functional Tests Repurposed AsLoad and Performance Tests
Open Source Test Automation
OST Architecture
5
Functional
Test
Production
Monitor
Load Test
Continuous Integration
Repository Bug TrackerTest
ManagementMonitoring
Test Authoring
SoapUI (Pro)
Sahi (Pro)
JUnit Class Framework
Eclipse Java IDE
Fitness
Languages: Java, Python
Wiki Collaboration
Application Under TestWeb, RIA, BPM, SOA
PTTMonitorCPU, Net, Memory
Test Injector
BundlesMySQL, HtmlUnit
ScriptRunnersSahi, Selenium, SoapUI, Java
Data Production Librariescsv files, rdbms queries
Test Operation Console
RepositoryMySQL RDBMS
Results AnalysisBusiness Intelligence Tool
DesignerRecord/Playback
Grid and CloudTest Deployment
Open Source Test Automation
Component Approach
6
Data Production
Log-In
Component
setUp
runTest
tearDown
ApplicationTestScenario
Test Use Case
Product Search
Order Product
Log-Out
RDBMS DPL
CSV DPL
Custom DPL
Load Test
100 Users 500 Users 1000 Users
Log-In
Component
Component
Development
Database
QA Regression
Database
Load Test
Database Confirm Order
Production
Database
Open Source Test Automation
7
Repurposing
Open Source Test Automation
Test Authoring and Scale
8
Approach Advantages and Disadvantages Scale
Protocol Level Testing1000+ VUs per TestNodeScript-level codingExtra code for JavaScript
1000+ VUs
HTTP Archive (HAR)1000+ VUs per TestNodeScript-less Test AuthoringAutomatic for JavaScript
1000+ VUs
SeleniumHtmlUnit Record/PlaybackOperates client-side logic 20-200 VUs
Browser Functional TestingSame Test ScriptVisual Test DebuggingSlow Test Operation
2-4 VUs
Open Source Test Automation
TestMaker Demonstration‣Fun And Easy Test Script Creation
‣Selenium and TestMaker
‣Repurposing A Single Test
‣Functional Test, Load and Performance Test, Production Monitor
‣Results Analysis
‣Chart Engine
9
Next let’s talk about
Open Source Test Automation
Calibration Testing
‣Test Environment Scalability
‣Early Look At Results
10
Open Source Test Automation
Calibration Testing
11
Open Source Test Automation
Expensive For Time
12
Open Source Test Automation
Start In The Middle
13
Open Source Test Automation
Work Down or Up
14
Open Source Test Automation
Load Testing Timing‣TestScenario Options Tab
‣Ramp up speed
‣Sleep Time
15
Open Source Test Automation
Individuals and Organizations
‣ Functional Testing with TestMaker Object Designer
‣ Repurposing Selenium, soapUI Sahi and unit tests into data-driven functional tests, load and performance tests, and business service monitors
‣ Load Testing To 50 Virtual Users
‣ Data-driven tests using CSV files.
‣ 25 Charts and Reports
‣ Community Support and access to all documentation16
‣ Load Testing to Millions of Virtual Users
‣ Cloud and Grid Test Deployment
‣ Collaborative Test Object Repository
‣ Data-driven tests, RDBMS Data Production Libraries
‣ Collaborative Results Analysis Repository
‣ Flex/Flash 3.0, 4.0, AMF
‣ 1000+ Charts and Reports
‣ Support, QuickStart, Training, Consulting
For the individual tester needing a no-cost test tool to test Web and RIA for functionality, load and performance, and monitoring.
For organizations running large scale business-critical Web, RIA, SOA, BPM and needing world-class tools, methodology, training, and support.
Open Source Test Automation
Avoid Retreats‣Load Test Shows: 3,230 Success, 12 Failures
‣Avoid The Urge For Perfection
‣Even The Best Managers Sometimes Go Back To Functional Testing
‣Even Failed Transactions Generate Load
‣Sometimes the whole point is...
17
Open Source Test Automation
18
Open Source Test Automation
19
Alex: load test is running fineInga: Coolio!Alex: Uh ohAlex: Success: 3210, Failure: 15Alex: Success: 3210, Failure: 204Alex: Success: 3210, Failure: 483Inga: What’s up?Alex: The whole application failedInga: Yep, avail threads = 0Alex: Back to the drawing board
Open Source Test Automation
20
Fear NotWe get paid to break things.
When you break it you understand it.When you understand it you can fix it.
Open Source Test Automation
Slides on Twitter‣http://twitter.com/fcohen
‣Please retweet
‣Please follow me
‣#ost
21
Open Source Test Automation
Where To Go From Here‣Watch A Screencast and Tutorial
‣http://www.pushtotest.com/screencastcentral
‣Attend An Open Source Test Workshop
‣http://workshop.pushtotest.com
‣Ask For A Proposal on Licenses, Training, Support, Consulting
‣Call +01 408 871 0122, [email protected]
22
