Secrets to Realistic Load Testing

  • Published on
    15-Jul-2015

  • View
    737

  • Download
    1

Embed Size (px)

Transcript

Slide 1

Secrets to Realistic Load Testing

Build performance tests which will model real user behavior on your siteTie business metrics (ROI) to website performance metrics and real user dataCorrelate data analytics so you can troubleshoot bottlenecks and improve performance.

In this webinar you will learn to: 2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distribution2PresentersCraig Combs Technical Director, Performance Engineering

Mike OstenbergSolution EngineerModerator: Kathy LamProduct Marketing

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionTodays presenters will be: Craig Combs & Mike Ostenberg.

Craig is the Technical Director of Performance Engineering for SOASTA. He has a CloudTest Black Belt, has run Performance Engineering engagements at major retailers like Target, Sears, Best Buy and JCPenney

MikeOstenberg, Director of Solutions Engineering at SOASTA has over 15 years of experience in enterprise software.

How fast should your site be?

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionWhat are your performance objectives..4Speed costs money

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distributionand how much load should it handle?

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionYour customers will be your guide

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionSurvey

mPulseHow fast is my site?What locations?From where?Which pages?Which flows?CloudTestFull scale loadFrom any locationGoing through real user flowsWith real-timeanalyticsReal-Time Analytics with Real User Measurement 2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distribution9Tying Business Metrics to (ROI) with website performance metrics and real user data

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distribution10CONFIDENTIAL Not for Distribution 2015 SOASTA. All rights reserved. January 13, 2015Building performance tests that model user behavior on your siteFirst you need to determine the workload for the test.

How are companies doing that today? Guessing. Logs. 3rd Party tools.

What if I have a new system?

What information I need?

When is your peak second/minute/hour/day?What is your peak volume? (active sessions, unique users, page visits, orders, ...)What is the median session length?What is the distribution of user paths?What is the distribution of devices?What is the distribution of locations?

Good Test DataSearch TermsProduct DistributionBrowse DistributionCart SizeOrder Size

How to get a realistic load testFactors to consider 2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionUse real user data to model real user tests

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionROI of Performance

14Focus on the ROI of Performance

15CONFIDENTIAL Not for Distribution 2015 SOASTA. All rights reserved. January 13, 2015What If : Why we testPredict the future with mPulse!

CONFIDENTIAL Not for Distribution 2015 SOASTA. All rights reserved. January 13, 2015

Sunburst charts shows the most common session paths of real usersCONFIDENTIAL Not for Distribution 2015 SOASTA. All rights reserved. January 13, 2015Data Science Workbench Analyze mPulse beacons to build the RIGHT performance and load tests!

Now you are ready to test 2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionTest how you want, when you want, where you want

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for DistributionLet your users help you determine your performance goalsTie business metrics, (conversion rates, length of engagement, etc) to calculate costs of performance vs revenue gain Use data analytics to review site performance data to isolate bottlenecks, which can guide your performance investments

Summary 2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distribution21GET STARTED RIGHT AWAY

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distribution22Questions?Mike OstenbergDirector Solutions Engineering

Email:mostenberg@soasta.com

Craig CombsTechnical Director, PE

Email:ccombs@soasta.comTwitter: CCdiddy

2015 SOASTA. All rights reserved.January 21, 2015#CONFIDENTIAL Not for Distribution23

24