Embed Size (px)
Citation preview
1© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Modern Load Testing: How to Move from the Past to the Present
Make realistic load testing a collaborative & continuous effort.
Webinar
2© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load testing is a team sportIn This Webinar
TODAY’S SOASTA PRESENTERS
Ed Salazar: Brad Johnson:CloudTest Product Manager VP Product marketing
Agenda: • User Experience is King• Testing for global, front to back, mobile and web users• Production is real. Use it to test and for data
Questions: Submit in chat box during event
3© 2013 SOASTA CONFIDENTIAL - All rights reserved.
User Expectations Are DifferentModern App Development Is Changing
Rapid Delivery
Agile development
Continuous deliveryDevOps
principles
Mobile and Web
Online everythingMobile commerce
Legacy modernization
Complexity
Composite apps
3rd party services
API proliferation
Unprecedented Scale
100’s to millionsLocal to
global100%
availability
4© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Legacy Approaches Fall ShortDesigned for a different era
o Not built for real time feedback across complex tiers
o Assumes slow iterations and long cycle times
o Not focused on the global user experience
o Expensive license and HW dependencies
o Built for the test lab, but locked out of production
5© 2013 SOASTA CONFIDENTIAL - All rights reserved.
The Modern Quality ApproachDelivers Speed, Scale and Affordability
Fast time to results.
SPEED
Hundreds to Millions.
SCALE
Continuously.
AFFORDABILITY
6© 2013 SOASTA CONFIDENTIAL - All rights reserved.
How Cloud Testing Changes the Game
The Old Way
The New Way What would YOU do with more time?
7© 2013 SOASTA CONFIDENTIAL - All rights reserved.
s
Memory leaks
Test Scale
Sta
ge /
Team
Dev & Test
Release& Deploy
Network& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Top Areas We Find IssuesPerformance validation from development to production
Continuous tuning for full-scale…and well beyond
8© 2014 SOASTA CONFIDENTIAL - All rights reserved.
The New Load Testing Standards
o Frequent testing from development through production
o Realism and accuracy from the user’s view to the last server
o Real time analytics and integrated monitoring
o End to end optimization from app to infrastructure
o Test cycle acceleration and optimization
Better tests, faster, more often
9© 2014 SOASTA CONFIDENTIAL - All rights reserved.
New Things to Consider
o Include real mobile devices and their “system” metrics
o Test in the production environment
o Test to 2-3x the expected peak traffic levels
o Test across geographies
o Test corner cases
o Measure in real time
Performance is everywhere
http://www.soasta.com/knowledge-center/whitepapers/
10© 2012 SOASTA. All rights reserved. May 22, 2012
Two Fronts in the Performance War Which Comes First?
What good is reliability if the average page load time is 10 seconds?
Who cares if the page load time is 2 seconds if only 10 people can hit the site?
Page Speed Reliability
BOTH.
11© 2012 SOASTA. All rights reserved. May 22, 2012
Real User Monitoring Reveals “What To Test”mPulse completes the DevOps feedback loop
Ops
Tested apps roll into production
Real user performance,
usage & traffic levels
mPulseCloudTest
Dev. & Test
TouchTest
12© 2012 SOASTA. All rights reserved. May 22, 2012
CloudTestPerformance
(Patent)
PRE-PRODUCTIONTest Build & Editing
TouchTest
Functionality(Patent filed)
mPulseReal User
Measurement
PRODUCTION Dev/Test Feedback Loop
SOASTA Core DNA
SOASTA’s Platform
SOASTA Global Test CloudWorld’s Largest Test Automation Platform
SOASTA Command & Control
Test & Measurement Automation Grid(Patent)
Real time, Contextual & Actionable
Intelligence
Engineered for Speed, Scale & Affordability
SOASTA Analytic EngineIn-Memory Performance Analytics
(Patent filed)
13© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Ed Salazar
(Demonstration)Load Testing the Modern Way
14© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Summary
Mobile & web user behavior is driving pace & scale
End-to-end load testing should be available everyday
Testing is about rapid, repeatable, real time results
Thanks
Contact SOASTA:www.soasta.com/cloudtest/
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Next Webinar: June 26“’Tis The Season – Holiday 2014 eCommerce Quality Checklist.”
Register: Webinars future and past:
http://www.soasta.com/knowledge-center/webinars/
Want to evaluate a TouchTest Private Device Cloud?- email [email protected]
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com
