Top Tips for Successful Capacity Testing - Travel Sites
A brief presentation on successful capacity testing delivered at the Akamai Holiday Readiness event in London, Sept. 24th 2014.
Slide 1Top Tips forSuccessful Capacity TestingSimon Hearnesimon.firstname.lastname@example.orgAbout me1Holidays2Business travel3High valueHigh emotionsHigh stressBooking travel is inherently high-stress and a very emotional thing.4100% Online?And more of it relies on the web. Call-centres use a web portal, brokers and agents use a web portal, customers use a web portal.All of these rely on a huge delivery stack to ensure that performance is optimal.5Customers are fickle, if the call-centre is experiencing delays or the website fails to load quickly enough, they will leave and spend their money elsewhere.6Maximised valuePositive emotionsMinimised stressSo, our job is to maximise the value for the customer and for us, create a positive customer experience and do this while minimising our stress.And obviously capacity testing helps us to do this.But it is not as easy as some would believe.7Know what youre testing.Third parties, endpoints, front-ends, delivery, GDS8Get the frontend(s) right.Getting the front-end right first is one of the easiest ways to improve capacity and ensure a positive customer experience.Reducing the load that each customer creates means you can squeeze more out of your existing infrastructure.Live holiday website example:5.5s to show anything.13.5s to onLoad227 assets2.75MB95.5s render start227 assets2.75MB2s render start32 assets0.5MBGetting the front-end right first is one of the easiest ways to improve capacity and ensure a positive customer experience.Reducing the load that each customer creates means you can squeeze more out of your existing infrastructure.Live holiday website example:5.5s to show anything.13.5s to onLoad227 assets2.75MB10Find out whos involved.Who is responsible for each part of the delivery, do they know that youll be testing them?11Trust the data.To know what success looks like you need to know the data. If 25,000 page impressions per minute is your target, how do you measure that.To ensure performance and customer satisfaction you need to emulate a client under controlled conditions and put tight constraints around what makes a good experience.12Know what success looks like.When you are testing, what are you trying to achieve.Having a goal based on what you are testing based on real traffic and predictions allows you to measure success.Success should be measured by customer experience under load, using tightly controlled test parameters.Real load comes from real customers, when testing your infrastructure you need to ensure that you are testing externally to ensure that every part of the delivery stack is performing.13Have a plan for when it goes wrong.If all the previous steps are in place, you know what youre testing and whos involved, you trust the data, you should be able to remediate against the results of testing.This will allow rapid iterations, direct evaluation of changes and hopefully lead to a successful round of testing and an application capable of meeting your success criteria.14Successful Capacity TestingSimon Hearnesimon.email@example.comKnow what youre testingGet the frontend(s) rightFind out whos involvedTrust the dataKnow what success looks likeHave a plan for when it goes wrong15