Transcript
Page 1: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Optimizely for Online Retail

Essential Features & Customer Stories

Thursday, August 29, 13

Page 2: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Tweet what you learn to win a

copy of our book3 chances to win!

#abtestingessentials@Optimizely

Thursday, August 29, 13

Page 3: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

What we’ve covered so far.

How to avoid pitfalls that can arise when testing.

Recordings on optimizely.com/ecommerce-ab-testing and SlideShare

A framework for prioritizing what to test.

1 2

3How to use a testing platform to execute these ideas.

Thursday, August 29, 13

Page 4: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

It’s all part of a bigger picture.

Thursday, August 29, 13

Page 5: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

It’s all part of a bigger picture.

Understand our website visitors...

Thursday, August 29, 13

Page 6: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

It’s all part of a bigger picture.

Understand our website visitors...

...and translate our understanding into better experiences for those visitors.

Thursday, August 29, 13

Page 7: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Meet Jodie Ellis

Thursday, August 29, 13

Page 8: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Meet Junan Pang

Thursday, August 29, 13

Page 9: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

1

2

3

4

5

Thursday, August 29, 13

Page 10: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

Targeting1

2

3

4

5

Thursday, August 29, 13

Page 11: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

Targeting

Multi-page Experiments

1

2

3

4

5

Thursday, August 29, 13

Page 12: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

Targeting

Multi-page Experiments

Redirect Tests

1

2

3

4

5

Thursday, August 29, 13

Page 13: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

Targeting

Multi-page Experiments

Redirect Tests

Goal Setting

1

2

3

4

5

Thursday, August 29, 13

Page 14: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

Targeting

Multi-page Experiments

Redirect Tests

Goal Setting

Segmentation

1

2

3

4

5

Thursday, August 29, 13

Page 15: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

In Real Life Online Optimizely

Thursday, August 29, 13

Page 16: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

In Real Life Online Optimizely

Thursday, August 29, 13

Page 17: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

In Real Life Online Optimizely

Thursday, August 29, 13

Page 18: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

What you’ll walk away with...

Thursday, August 29, 13

Page 19: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

How are you addressing specific visitor populations that come to your site?

Thursday, August 29, 13

Page 20: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Targeting In Real Life: Show Your Student ID

Thursday, August 29, 13

Page 21: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Are they mobile?

Are they Mac or PC?

Are they new or returning?

Did they click an ad or a search result?

Targeting IRL Online Optimizely

Thursday, August 29, 13

Page 22: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Original

Targeting IRL Online Optimizely

Thursday, August 29, 13

Page 23: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Variation

Targeting IRL Online Optimizely

Thursday, August 29, 13

Page 24: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Variation

Targeting IRL Online Optimizely

Original

Thursday, August 29, 13

Page 25: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Variation

Targeting IRL Online Optimizely

Original

+23.7% purchases

Thursday, August 29, 13

Page 26: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Original Variation

Targeting IRL Online Optimizely

Thursday, August 29, 13

Page 27: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Who and where are you testing?New features

URL Query Parameters

Marketing campaigns

Adwords

Browser Type

Mobile vs. Non-mobile

Location

Targeting IRL Online Optimizely

Thursday, August 29, 13

Page 28: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

How are you enhancing the visitor experience across many pages?

Thursday, August 29, 13

Page 29: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Multi-page In Real Life: A Theme Park Ride

Thursday, August 29, 13

Page 30: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Product Detail Page

Shopping Cart

Checkout Page

Thank You Page

Multi-page IRL Online Optimizely

Thursday, August 29, 13

Page 31: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Multi-page IRL Online Optimizely

Thursday, August 29, 13

Page 32: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Multi-page IRL Online Optimizely

Thursday, August 29, 13

Page 33: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

How do you try a completely di!erent experience from the one you have today?

Thursday, August 29, 13

Page 34: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Redirects In Real Life: A Pilot Store

Thursday, August 29, 13

Page 35: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Redirects In Real Life: A Pilot Store

Thursday, August 29, 13

Page 36: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Redirects IRL Online Optimizely

Variation A Variation B

URL 1 URL 2

Website Visitors

50%50%

Thursday, August 29, 13

Page 37: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Original

Variation

Redirects IRL Online Optimizely

Thursday, August 29, 13

Page 38: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Original

Variation

Redirects IRL Online Optimizely

-3% conversions

Thursday, August 29, 13

Page 39: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Redirects IRL Online Optimizely

Thursday, August 29, 13

Page 40: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Redirects IRL Online Optimizely

Thursday, August 29, 13

Page 41: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

How do you measure the value of a new experience?

Thursday, August 29, 13

Page 42: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Goal Setting In Real Life: Macro goal = Revenue

Micro goal = Theater Views

Thursday, August 29, 13

Page 43: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Goal Setting IRL Online Optimizely

Original - Exact Match Variation - Fuzzy Match

Thursday, August 29, 13

Page 44: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Goal Setting IRL Online Optimizely

Original - Exact Match Variation - Fuzzy Match

+9.6% result selections

Thursday, August 29, 13

Page 45: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Goal Setting IRL Online Optimizely

Original - product video Variation - 360 degree image

Thursday, August 29, 13

Page 46: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Goal Setting IRL Online Optimizely

Original - product video Variation - 360 degree image

+10.4% RPV

Thursday, August 29, 13

Page 47: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

How do you define success?

•Revenue

•Pageviews

•Clicks

Goal Setting IRL Online Optimizely

Thursday, August 29, 13

Page 48: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

How do you listen to what di!erent types of visitors want?

Thursday, August 29, 13

Page 49: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Segmentation In Real Life: Payment Method

Thursday, August 29, 13

Page 50: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Categorize your visitors to filter your results

• Browser

• Campaign

• Mobile vs. Non-mobile

• Source Type

• Custom Segment (aka anything else!)

Segmentation IRL Online Optimizely

Thursday, August 29, 13

Page 51: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

5 Testing Tactics to Know and Use

Targeting

Multi-page Experiments

Redirect Tests

Goal Setting

Segmentation

1

2

3

4

5

Thursday, August 29, 13

Page 52: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

A freebie for youDownload chapter 3 for free!!

pages.optimizely.com/book

Thursday, August 29, 13

Page 53: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Questions?Tweet @Optimizely

#abtestingessentials

Thursday, August 29, 13

Page 54: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Learn moresupport.optimizely.com

Thursday, August 29, 13

Page 55: Optimizely for Online Retail: Essential Features and Customer Stories

#abtestingessentials @Optimizely

Thank you!

Thursday, August 29, 13