59
HI, LET’S TALK ABOUT USABILITY TESTING @quiffboy @hyperisland 15 July 2015

Hyper Island teaching notes: usability testing

Embed Size (px)

Citation preview

Page 1: Hyper Island teaching notes: usability testing

HI, LET’S TALK ABOUT USABILITY TESTING@quiffboy @hyperisland 15 July 2015

Page 2: Hyper Island teaching notes: usability testing

Leisa is Head of User Research @ GDS, GOV.UK

@quiffboy

Page 3: Hyper Island teaching notes: usability testing

“…testing with customers…” Customers have a monetary value

@quiffboy

Or

Page 4: Hyper Island teaching notes: usability testing

@quiffboy

Hola!

Page 8: Hyper Island teaching notes: usability testing

https://twitter.com/ladyxtel/status/483439786967838720

@quiffboy

Page 9: Hyper Island teaching notes: usability testing

Northern User Experience Manchester ~ Leeds ~ Newcastle ~ Liverpool

nuxuk.org ~ @nuxuk

@quiffboy

Page 10: Hyper Island teaching notes: usability testing

1. Moderated lab testing 2. Remote testing 3. Eye tracking 4. Guerrilla testing

4 common types of usability testing

@quiffboy

Page 11: Hyper Island teaching notes: usability testing

“Observe people using the product to discover…how well test subjects respond in four areas: efficiency, accuracy, recall, and emotional response.” - Wikipedia

1. Moderated lab testing

@quiffboy

Page 12: Hyper Island teaching notes: usability testing

@quiffboy

Page 13: Hyper Island teaching notes: usability testing

@quiffboy

Page 14: Hyper Island teaching notes: usability testing

2. Remote usability testing

@quiffboy

Page 15: Hyper Island teaching notes: usability testing

“Eye tracking is the process of measuring either the point of gaze (where one is looking) or the motion of an eye relative to the head.” - Wikipedia

3. Eye tracking

@quiffboy

Page 16: Hyper Island teaching notes: usability testing

Not so scary anymore…

Complex & intrusive hardware, right?

@quiffboy

Page 17: Hyper Island teaching notes: usability testing

Generate lots of complex graphs and diagrams Needs experience to interpret results Can be time consuming & expensive

Eye tracking: findings are still scary though

@quiffboy

Page 18: Hyper Island teaching notes: usability testing

You should test your stuff with real people

But it’s a no brainer, right?

@quiffboy

Page 19: Hyper Island teaching notes: usability testing

http://econsultancy.com/uk/reports/user-experience-survey-report

http://nuxuk.org/2013/09/05/ux-challenge-choose-right-approach-guest-blog-ian-franklin-freelance-ux-consultant/

User Experience Survey 2013

@quiffboy

Page 20: Hyper Island teaching notes: usability testing

Why test?

@quiffboy

Page 21: Hyper Island teaching notes: usability testing

@quiffboy

Why test?

Improve decision making

Remove guesswork

Remove experience

bias

Page 22: Hyper Island teaching notes: usability testing

So why don’t we always test?

@quiffboy

Page 23: Hyper Island teaching notes: usability testing

@quiffboy

So why don’t we always test?

Too expensive

Time or resource

consuming

Not a primary concern

Page 24: Hyper Island teaching notes: usability testing

“But recruiting people is tricky…”

@quiffboy

Page 25: Hyper Island teaching notes: usability testing

http://www.petbucket.com/blog/61984/scaredy-cat-how-to-handle-a-frightened-feline.html

@quiffboy

Page 26: Hyper Island teaching notes: usability testing

5 users ≈ 85% problems

@quiffboy

Page 27: Hyper Island teaching notes: usability testing

tinyurl.com/mhr8emm

Caveats, caveats, caveatsSummary: The answer is 5, except when it's not. Most arguments for using more test participants are wrong, but some tests should be bigger and some smaller.

@quiffboy

Page 28: Hyper Island teaching notes: usability testing

.com

@quiffboy

Page 29: Hyper Island teaching notes: usability testing

£15 for15 minutes!!

HOW IT WORKS:We ask you to carry out a couple of simple tasks using a new website, and we learn if we've designed it correctly. It will take no more than 15 minutes of your time and as a thank you we'll give you £15 cash.

WHEN:Monday 17th November // Time slots available 12-1.30pm and 2.30-4pm

WHERE:Amaze, 1st Floor, Royal Liver Building

We're looking for a few people to help us test a new website.

INTERESTED?Participants must be female and use a smartphone to browse the internet.Email [email protected] with your current make of smartphone, and preferred testing slot.

@quiffboy

Page 30: Hyper Island teaching notes: usability testing

http://businessupperhand.com/how-to-open-a-coffee-shop/

@quiffboy

Page 31: Hyper Island teaching notes: usability testing

Ask nicely

@quiffboy

Page 32: Hyper Island teaching notes: usability testing

Consent forms

Loads of templates available on the web

Download one and tweak accordingly

@quiffboy

Page 33: Hyper Island teaching notes: usability testing

I will do this for you

You will film me, and I'm ok with that

I won’t tell anyone what I've seen

You won’t put this on youtube or (publicly) laugh about it later

You’ll give me some stuff* to say thanks

All consent forms cover the same basic areas:

@quiffboy* Exact nature of stuff may vary

Page 34: Hyper Island teaching notes: usability testing

Participant signs & dates it, you put it in a drawer… forever.

@quiffboy

Page 35: Hyper Island teaching notes: usability testing

Tell them if anyone’s watching or listening

@quiffboy

Page 36: Hyper Island teaching notes: usability testing

@quiffboy

Page 37: Hyper Island teaching notes: usability testing

“But writing the report takes ages…”

@quiffboy

Page 38: Hyper Island teaching notes: usability testing

@quiffboy

Page 39: Hyper Island teaching notes: usability testing

1) Make it a one-pager

@quiffboy

Page 40: Hyper Island teaching notes: usability testing

2) Bullet-point list, not reams of copy

@quiffboy

Page 41: Hyper Island teaching notes: usability testing

3) Structure the report by task/user journey

@quiffboy

Page 42: Hyper Island teaching notes: usability testing

4) Make your findings actionable

@quiffboy

Page 43: Hyper Island teaching notes: usability testing

5) Do highlight when a test passes…

@quiffboy

Page 44: Hyper Island teaching notes: usability testing

6) …but focus on the things you can fix

@quiffboy

Page 45: Hyper Island teaching notes: usability testing

Keep it brief Make your report a one-pager

Bullet-point list not reams of copy

Structured by task/user journey

Make findings actionable

Highlight when a test passes

Focus on the things you can fix

@quiffboy

Page 46: Hyper Island teaching notes: usability testing

@quiffboy

Page 47: Hyper Island teaching notes: usability testing

A few tips…

@quiffboy

Page 48: Hyper Island teaching notes: usability testing

1) Avoid recruiting experts

@quiffboy

Page 49: Hyper Island teaching notes: usability testing

2) Test small, test early,test often

@quiffboy

Page 50: Hyper Island teaching notes: usability testing

3) If you can, test in real environments

@quiffboy

Page 51: Hyper Island teaching notes: usability testing

4) Focus on what needs fixing (or refining)

@quiffboy

Page 52: Hyper Island teaching notes: usability testing

5) Set tasks, don’t give instructions

@quiffboy

Page 53: Hyper Island teaching notes: usability testing

6) Rotate order of tasks

@quiffboy

Page 54: Hyper Island teaching notes: usability testing

7) Your prototype’s fidelity matters, but it’s not critical

@quiffboy

Page 55: Hyper Island teaching notes: usability testing

8) Five people’s opinions are not conclusive proof

@quiffboy

Page 56: Hyper Island teaching notes: usability testing

9) People say the darndest things

@quiffboy

Page 57: Hyper Island teaching notes: usability testing

10) “Testing with 1 person is 100% better than testing with none”

@quiffboy

Steve Krug: Rocket Surgery Made Easy

Page 58: Hyper Island teaching notes: usability testing

Anyone Can Usability Test, Part 1: On a ShoestringChris Atherton

How Many Test Users in a Usability Study?Jakob Nielson

The Art of Guerrilla Usability TestingUX Booth

New to Usability Testing? You’re not alone!Jennifer Aldrich

User Experience Survey 2013Econsultancy & WhatUsersDo

UX Challenge: how to choose the right approach to user researchWhatUsersDo & Ian Franklin

“Don’t make me think” & “Rocket Surgery Made Easy” and more…Steve Krug

@quiffboy

“But you should probably read more” Tony Wilson

Page 59: Hyper Island teaching notes: usability testing

HI, ANY QUESTIONS?

@quiffboy @hyperisland 15 July 2015