Usability Testing Workshop

Joan WinchesterPlain Talk in Complex TimesSeptember 22, 2011

Usability Spigot

• http://video.google.com/videoplay?docid=-7301605255558498262

What is Usability Testing?

Usability testing is a method of evaluating a website or document by observing users as they use it.

Usability testing can measure

• Ease of use• Readability• Visual consistency• Task time• Ability to meet

intended purpose • Ability to accomplish

user’s goal • Appeal

Is it user friendly?Is it easy to understand?Is the design good?How long does it take?Does it do what it is

supposed to?Can the user get what he

needs from it?What does the user think of

it?

Why do usability testing?

• To find out the site or document works

• To make sure it is readable, easy to use and friendly

• To use the findings to make changes

• To save money

Save money?

How is usability testing done?

First, figure out what you want to know.

Is it clear? Can the user navigate easily?Can the user fill in the boxes correctly?Is it easy to read?Is the vocabulary too high level?Is the tone welcoming and friendly?

• http://www.cdc.gov/

• http://www.lingscars.com/

Websites

The Introduction: Why

• We would like to know how easy or hard it is to fill out this application.

• We want to see how people will use this site.

What

• I am going to ask you to read this form and answer some questions.

• I’ll have you fill out a section or two while I watch. Feel free to think out loud!

How

Remember, it’s OK to get something wrong or have trouble – we are trying to find out whether this document/site is easy or hard to use!

How long

This will take about 45 minutes.

How much

At the end of our session, I will give you $35 in cash.

The Questions

• Focus on three or four major problems or issues• Decide if you want just the “big picture” or detailed

information • Ask the right questions to get the information you need

The home page

As they go

• What are you thinking? • What are you looking at/doing now?• What would you do next?• Is that what you expected to happen when you clicked

that?• Can you tell me why you decided to do that/go there?

For a document • Read this sentence out loud. Can you tell me in your

own words what it is saying?

Please indicate for EACH person listed on this application any health coverage, including Medicare or Medicaid, in effect within 24 months prior to the proposed effective date of this coverage. Each person applying for coverage must be listed below. If no health care coverage was in effect within the past 24 months, please indicate NONE. If coverage is provided for a dependent from a previous marriage or relationship, please attach a copy of the court documentation showing who is responsible for the dependent(s)’ health care coverage so that the insurer can determine whose coverage is primary.

Tasks and Scenarios

• Find• Order• Fill in• Pretend you are applying for• What if you need to?• You are trying to

Test the vocabulary

• What would you do here? NOT • Can you complete the section below?

Be supportive and encouraging

This is exactly what we need.

Your comments are very helpful.

Do you like this or that?

Recruiting test participants

DO decide how much domain knowledge is necessaryDO recruit the right people DO plan how much and how you will pay DO know what you will do about no shows or extrasDO make all necessary arrangements and schedules

DON’T recruit people who have worked on the site or

document or know it wellDON’T think you need large samples

Remember

"It takes only five users to uncover 80%of high-level usability problems"

Jakob Nielsen

How should you prepare for testing?

• Make it easy to take notes • Use check boxes • Leave space for comments• Keep everything together • Assemble materials and cash envelopes

Good facilitators get good results!

A good facilitator… • Is friendly and welcoming • Puts the participant at ease • Has a professional demeanor• Focuses on exactly what the designers / writers want to

know• Probes and clarifies • Keeps the participant on task• Avoids leading the participant or supplying answers• Keeps the test interesting – and keeps it moving• Will not let personal opinions or beliefs about the

product influence results• Finishes each test in the allotted time • Is consistent across testing, doing it the same way every

time

Before you test

Practice!

Where should you test?

Have a schedule

TESTING INTERVIEW SCHEDULE

TIME ROOM 1 ROOM 2

9:00 Sally Jones Sam Smith

10:00 Meg Green Bill Taylor

11:00 R Garcia Ty Willis

12:00 Lunch Lunch

1:00 Mrs. Elliott Harry Lauder

What should you do with the results?

• Plan how you'll disseminate the results• Write a quick list when the session is fresh in your mind• Analyze the data• Draw conclusions• Create your final report – including quotations and

suggestions

"Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.”

Antoine de Saint Exupery