Secrets to Realistic Load Testing
© 2015 SOASTA. All rights reserved. April 18, 2023 2CONFIDENTIAL – Not for Distribution
1. Build performance tests which will model real user behavior on your site
2. Tie business metrics (ROI) to website performance metrics and real user data
3. Correlate data analytics so you can troubleshoot bottlenecks and improve performance.
In this webinar you will learn to:
© 2015 SOASTA. All rights reserved. April 18, 2023 3CONFIDENTIAL – Not for Distribution
Presenters
Craig Combs Technical Director,
Performance Engineering
Mike OstenbergSolution Engineer
Moderator: Kathy LamProduct Marketing
© 2015 SOASTA. All rights reserved. April 18, 2023 4CONFIDENTIAL – Not for Distribution
How fast should your site be?
© 2015 SOASTA. All rights reserved. April 18, 2023 5CONFIDENTIAL – Not for Distribution
Speed costs money…
© 2015 SOASTA. All rights reserved. April 18, 2023 6CONFIDENTIAL – Not for Distribution
…and how much load should it handle?
© 2015 SOASTA. All rights reserved. April 18, 2023 7CONFIDENTIAL – Not for Distribution
Your customers will be your guide…
Survey
© 2015 SOASTA. All rights reserved. April 18, 2023 9CONFIDENTIAL – Not for Distribution
mPulse
How fast is my site?What locations?From where?Which pages?Which flows?
CloudTest
Full scale loadFrom any locationGoing through real user flowsWith real-timeanalytics
Real-Time Analytics with Real User Measurement
© 2015 SOASTA. All rights reserved. April 18, 2023 10
CONFIDENTIAL – Not for Distribution
• Tying Business Metrics to (ROI) with website performance metrics and real user data
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
Building performance tests that model user behavior on your site
First you need to determine the workload for the test.
How are companies doing that today?• Guessing.• Logs. • 3rd Party tools.
What if I have a new system?
© 2015 SOASTA. All rights reserved. April 18, 2023 12
CONFIDENTIAL – Not for Distribution
o What information I need?
● When is your peak second/minute/hour/day?● What is your peak volume? (active sessions, unique users,
page visits, orders, ...)● What is the median session length?● What is the distribution of user paths?● What is the distribution of devices?● What is the distribution of locations?
o Good Test Data● Search Terms● Product Distribution● Browse Distribution● Cart Size● Order Size
How to get a realistic load testFactors to consider
© 2015 SOASTA. All rights reserved. April 18, 2023 13
CONFIDENTIAL – Not for Distribution
Use real user data to model real user tests
ROI of Performance
Focus on the ROI of Performance
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
“What If” : Why we testPredict the future with mPulse!
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
Sunburst charts shows the most common session paths of real users
CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015
Data Science Workbench Analyze mPulse beacons to build the RIGHT performance and load tests!
© 2015 SOASTA. All rights reserved. April 18, 2023 19
CONFIDENTIAL – Not for Distribution
Now you are ready to test
© 2015 SOASTA. All rights reserved. April 18, 2023 20
CONFIDENTIAL – Not for Distribution
Test how you want, when you want, where you want
© 2015 SOASTA. All rights reserved. April 18, 2023 21
CONFIDENTIAL – Not for Distribution
1. Let your users help you determine your performance goals
2. Tie business metrics, (conversion rates, length of engagement, etc) to calculate costs of performance vs revenue gain
3. Use data analytics to review site performance data to isolate bottlenecks, which can guide your performance investments
Summary
© 2015 SOASTA. All rights reserved. April 18, 2023 22
CONFIDENTIAL – Not for Distribution
GET STARTED RIGHT AWAY
© 2015 SOASTA. All rights reserved. April 18, 2023 23
CONFIDENTIAL – Not for Distribution
Questions?
Mike OstenbergDirector Solutions Engineering
Email:[email protected]
Craig CombsTechnical Director, PE
Email: [email protected]
Twitter: CCdiddy