Performance Warrior Tales: Cloud Load Testing the Retail Giants

1© 2012 SOASTA. All rights reserved.

Performance Warrior Tales: Cloud Testing the Retail Giants.

Webinar

Presents

Tips and Tricksfrom Large-Scale Retail Performance Engineers

2© 2012 SOASTA. All rights reserved. May 22, 2012

Preparing for the best case retail scenarios

In This Webinar

TODAY’S SOASTA PRESENTERS

Paul Korenevsky: Engagement Manager, Load Testing SME - AkamaiCraig Combs: Principal Performance Engineer – Giant Retailer Mike Ostenberg: Sr. Solution Architect – SOASTA Moderator - Brad Johnson: VP Product & Channel Marketing - SOASTA

Agenda: • Intro & Poll question• Meet Paul from Akamai• Meet Craig from a Top 5 retailer• Panel Questions• CloudTest demo for Retail

Questions: Submit in chat box during event

3© 2012 SOASTA. All rights reserved. May 22, 2012

Poll Question

4© 2012 SOASTA. All rights reserved. May 22, 2012

Paul Korenevsky

Load Testing @ Akamai

Engagement Manager, Load Testing SME

©2013 AkamaiAkamai Confidential Faster ForwardTM

The Akamai Intelligent Platform: What is it?

Scale & Breadth

• 120,000+ servers

• 1,100+ networks

• 750+ cities

• 1,700+ locations

• 74 countries

The leading Internet Cloud platform for enabling secure, high-performing user experiences on any device, anywhere.

Web Traffic

• 500 billion hits per day

• 19+ million hits per second

• 100+ million streams per day

• 1M+ concurrent streams

• 5.5+ Terabits per second peak

• 15 – 30 % of all Web traffic

©2013 AkamaiAkamai Confidential Faster ForwardTM

The Akamai Solution Family

Inspire Innovation

©2013 AkamaiAkamai Confidential Faster ForwardTM

How Akamai Works

Customer Origin

Users Akamai Edge Server

closest to Origin Server

Akamai “SureRoute” protocol optimizes routes and reduces

round trips

High Performance Global Overlay

Network

Edge Region close to End

User

Web Server

Security embedded into Akamai Edge

Servers

It All Starts in the Cloud – at the Edge

©2013 AkamaiAkamai Confidential Faster ForwardTM

Preparing for Peak Traffic

1. Inventory potential Availability and Performance risks, such as failures at the:

• Web(servers/LBs)• App (servers/db/cache)• Back end (OMS, inventory, fraud prevention, tokenization…)• Network (ISP, pipe, DNS, LBs …)• Security (firewall, WAF, IPS/IDS)• CDN (unless its Akamai, of course)• 3rd Party (translation/adaptation, recommendations, reviews, a/b testing, analytics, …)

2. Evaluate each risk• Stress testing• Load testing• Penetration testing

3. Mitigate each risk, prioritizing based on evaluation • Define and implement proactive mitigations• Prepare and test reactive mitigations

©2013 AkamaiAkamai Confidential Faster ForwardTM

Typical load provides little insight into issues thatarise under peak load

OriginInfrastructure

©2013 AkamaiAkamai Confidential Faster ForwardTM

Stress test the origin

OriginInfrastructure

©2013 AkamaiAkamai Confidential Faster ForwardTM

Why Performance Matters

Consumers are becoming less patient - 40% of shoppers will abandon after 3 seconds

8 Seconds

4 Seconds

3 Seconds

0 2 4 6 8 10Response Time

Site Abandonment Threshold

Zona Research, 1998

Jupiter Research, 2006

Forrester Research, 2009

10 Seconds

Nielsen, 1996

Webpage Load Time

Seconds

4

2

6

8

10

2

4

6

8

10

Seconds

Consumer Patience

©2013 AkamaiAkamai Confidential Faster ForwardTM

Load test through Akamai for realistic performance results

OriginInfrastructure

13© 2012 SOASTA. All rights reserved. May 22, 2012

Craig Combs

Performance Tips from the Retail Giants

Principal Performance Engineer

RetailerA

14© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

15© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

16© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

17© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

18© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

19© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

20© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

21© 2012 SOASTA. All rights reserved. May 22, 2012

Critical Things for Load and Performance Testing Retail sites

Test for spikes

Test what you think doesn’t need to be tested

Test expecting failure

If you can’t test it, virtualize it

Don’t forget about the user experience

Monitor everything

Don’t wait until just before the holidays

Test in production

22© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

23© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

1. What are the two primary goals for seasonal

testing?

24© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

1. What are the two primary goals for seasonal

testing?

2. Which critical user-scenarios should be tested

first?

25© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

1. What are the two primary goals for seasonal

testing?

2. Which critical user-scenarios should be tested

first?

3. How do you create realistic conditions

26© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

1. What are the two primary goals for seasonal

testing?

2. Which critical user-scenarios should be tested

first?

3. How do you create realistic conditions

4. When should you stress your CDN?

27© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

1. What are the two primary goals for seasonal

testing?

2. Which critical user-scenarios should be tested

first?

3. How do you create realistic conditions

4. When should you stress your CDN?

5. Should you be hammering on live production

systems?

28© 2012 SOASTA. All rights reserved. May 22, 2012

Questions for the ProsGet your notepad app ready!

1. What are the two primary goals for seasonal

testing?

2. Which critical user-scenarios should be tested

first?

3. How do you create realistic conditions

4. When should you stress your CDN?

5. Should you be hammering on live production

systems?

29© 2012 SOASTA. All rights reserved. May 22, 2012

CloudTest

SOASTA CloudTest Demo

Actionable intelligence

Scale

Speed

The Leading Cloud-Based Load & Performance Test Solution

30© 2012 SOASTA. All rights reserved. May 22, 2012

Thanks

Contact SOASTA:www.soasta.com/cloudtest/

info@soasta.com866.344.8766

Follow us:

twitter.com/cloudtest

facebook.com/cloudtest

Knowledge Center• White Papers• Webinar Recordings• Case Studies

RESOURCES

www.SOASTA.com

CloudLink Community• Support• Tutorials• Video