Secrets to Realistic
Load Testing
© 2015 SOASTA. All rights reserved. January 21, 2015 2CONFIDENTIAL – Not for Distribution
1. Build performance tests which will
model real user behavior on your site
2. Tie business metrics (ROI) to website
performance metrics and real user data
3. Correlate data analytics so you can
troubleshoot bottlenecks and improve
performance.
In this webinar you will learn to:
© 2015 SOASTA. All rights reserved. January 21, 2015 3CONFIDENTIAL – Not for Distribution
Presenters
Craig Combs
Technical Director,
Performance Engineering
Mike Ostenberg
Solution Engineer
Moderator: Kathy Lam
Product Marketing
© 2015 SOASTA. All rights reserved. January 21, 2015 4CONFIDENTIAL – Not for Distribution
How fast should your site be?
© 2015 SOASTA. All rights reserved. January 21, 2015 5CONFIDENTIAL – Not for Distribution
Speed costs money…
© 2015 SOASTA. All rights reserved. January 21, 2015 6CONFIDENTIAL – Not for Distribution
…and how much load should it handle?
© 2015 SOASTA. All rights reserved. January 21, 2015 7CONFIDENTIAL – Not for Distribution
Your customers will be your guide…
Survey
© 2015 SOASTA. All rights reserved. January 21, 2015 9CONFIDENTIAL – Not for Distribution
mPulse
How fast is my site?
What locations?
From where?
Which pages?
Which flows?
CloudTest
Full scale load
From any location
Going through
real user flows
With real-time
analytics
Real-Time Analytics with Real User Measurement
© 2015 SOASTA. All rights reserved. January 21, 2015 10CONFIDENTIAL – Not for Distribution
• Tying Business Metrics to (ROI) with website
performance metrics and real user data
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
Building performance tests that model user
behavior on your site
First you need to determine the workload for the test.
How are companies doing that today?
• Guessing.
• Logs.
• 3rd Party tools.
What if I have a new system?
© 2015 SOASTA. All rights reserved. January 21, 2015 12CONFIDENTIAL – Not for Distribution
o What information I need?
● When is your peak second/minute/hour/day?
● What is your peak volume? (active sessions, unique users, page
visits, orders, ...)
● What is the median session length?
● What is the distribution of user paths?
● What is the distribution of devices?
● What is the distribution of locations?
o Good Test Data
● Search Terms
● Product Distribution
● Browse Distribution
● Cart Size
● Order Size
How to get a realistic load testFactors to consider
© 2015 SOASTA. All rights reserved. January 21, 2015 13CONFIDENTIAL – Not for Distribution
Use real user data to model real user tests
ROI of Performance
Focus on the ROI of Performance
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
“What If” : Why we testPredict the future with mPulse!
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
Sunburst charts shows the most common session
paths of real users
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
Data Science Workbench Analyze mPulse beacons to build the RIGHT performance and load tests!
© 2015 SOASTA. All rights reserved. January 21, 2015 19CONFIDENTIAL – Not for Distribution
Now you are ready to test
© 2015 SOASTA. All rights reserved. January 21, 2015 20CONFIDENTIAL – Not for Distribution
Test how you want, when you want,
where you want
© 2015 SOASTA. All rights reserved. January 21, 2015 21CONFIDENTIAL – Not for Distribution
1. Let your users help you determine your
performance goals
2. Tie business metrics, (conversion rates, length of
engagement, etc) to calculate costs of
performance vs revenue gain
3. Use data analytics to review site performance
data to isolate bottlenecks, which can guide your
performance investments
Summary
© 2015 SOASTA. All rights reserved. January 21, 2015 22CONFIDENTIAL – Not for Distribution
© 2015 SOASTA. All rights reserved. January 21, 2015 23CONFIDENTIAL – Not for Distribution
Mike OstenbergDirector Solutions Engineering
Email: [email protected]
Craig CombsTechnical Director, PE
Email: [email protected]
Twitter: CCdiddy
Recommended
