Streamline Your A/B Tests

Learn how to do smarter A/B tests

inspired by remote user research

Remote User Research

Research in which participants and researchers

do not interact in-person with users.

2/32

Quick Poll

Who used remote user research tools before?

3/32

Business Need

Where do you get ideas for AB Testing?

4/32

AB Testing Takes Time

5/32

http://www.chasedumont.com/images/a-b-test-0.jpg

Solution

1. Ask - engage users and find out

more about their needs, pain points

6/32

Solution

1. Ask - engage users and find out

more about their needs, pain points

2. Observe - see your website from the

users’ perspective and learn from

their behavior

7/32

Other Ways of Getting Ideas

• Web Analytics

• Visual Analytics

• Moderated Usability Testing

• In-Depth Interviews

• Customer Issue Categorization

• Brainstorming

8/32

Remote User Research Benefits

• Context-driven

• Cheap

• Simple

• Fast

• Flexible

9/32

The Process

1. Design the study

2. Recruit participants

3. Launch

4. Analyze results

5. Include results in AB Testing project

10/32

Data Source & Approach

11/32

What people do

(behavior)

What people say

(opinions)

Why & how to fix

(qualitative)

How many & how much

(quantitative)

Data Source & Approach

12/32

What people do

(behavior)

What people say

(opinions)

Why & how to fix

(qualitative)

How many & how much

(quantitative)

Automated LiveModerated

Self-Moderated

Automated Static

Feedback Widgets

Data Source & Approach

13/32

What people do

(behavior)

What people say

(opinions)

Why & how to fix

(qualitative)

How many & how much

(quantitative)

Automated LiveModerated

Self-Moderated

Automated Static

Feedback Widgets

Basic Categories

• Moderated

• Self-moderated

• Feedback Widgets

• Automated Live

• Automated Static

14/32

Moderated

15/32

Moderated

Overview:

• Live interviews with sound and audio

• You see how users perform tasks in natural environment

• You can talk with users while they’re using your website

Services:

16/32

Self-Moderated

17/32

Self-Moderated

Overview:

• Recorded sessions with sound and audio

• You see how users perform tasks in natural environment

• Results are delivered quickly

Services:

18/32

Feedback Widgets

19/32

Feedback Widgets

20/32

Feedback Widgets

Overview:

• Continuously measure and improve visitor satisfaction

• Good for collecting bugs and suggestions

• Feedback forms are fully customizable

Services:

21/32

Automated Live

22/32

Automated Live

23/32

Automated Live

24/32

Automated Live

25/32

Automated Live

Overview:

• Evaluate web usability by testing large quantities of people

• Metrics: task completion rates, number of clicks, time on task

• Benchmark your website against competition

Services:

26/32

Automated Static

27/32

Automated Static

Overview:

• Collect feedback on layouts, mockups, marketing creations

• You can be very precise about what you ask

• Great for testing out ideas before implementation

Services:

28/32

There’s More…

29/32

Useful Tips

1. Combine different methods

2. Test continuously

3. Define relevant participants

4. Keep it short and simple

5. You never know what you don't know

6. Always look for an inspiration

30/32

Always Look For an Inspiration

31/32

http://uxmag.com/sites/default/files/uploads/livefyre-images/004Usabilla-adding-questions.jpg

Special for Today’s Attendees

Coaching session with UsabilityTools expert

Topics:

• Kick Start Your Conversion Rate Optimization

• Shape up User Experience of Your Website

b.mozyrko@usabilitytools.com

32/32