125 FINAL PDF Agile UX Research.pdf

8/10/2019 125 FINAL PDF Agile UX Research.pdf

1/55

Agile UX Research Practices

in AndroidGoogle I/O 2013

Bethany Fong, UX Designer

Miki Konno, UX Researcher


2/55

Miki Konno

Android User Experience Researcher

Bethany Fong

Android User Experience


3/55

Agenda

Challenges of UX testing for Agile Development

Case studies:

Heuristic Evaluation

RITE Study with Prototypes

Cafe Study

Pulse study

Deep dive

Wrap up


4/55

Challenges of UX Research for

Agile Development


5/55

$1 : $10 : $10


6/55


7/55


8/55

Traditional UX Research Study Timeline

Week 1 2 3 4 5

Development

cycle

2 weeks 2 weeks


9/55

BEFOREcodingfeedback NOW

analyze QUICKLY

NO TIMEfor everything


10/55Source: Brian Legate, Flickr


11/55

Qualitative

Insights

B

Wh

Goals and

Attitudes

What people say

Quantitative

Validation

Field

Diary study

Cafe study

Usability study

(Pulse, Heuristic Eval, RITE)

Log analysis

Eye-tracking

A-B Testing

Large N-Quant survey

Focus groups

In-depth interviews


12/55

Case studiesHeuristic evaluationRITE study with prototypes

Cafe study

Pulse study


13/55


14/55

Heuristic Evaluation

Expert review againa set of principles

1-2 hours


15/55

Heuristic Evaluation Process

A measurable

question

How long

does setup

take fornew tablet X?

Choose

heuristics

Choose speed-

based heuristics

Measure

against

heuristics

Set up with team

observing

Summarize

measurements

Email

report

Assign action

items

Reprioritize

work


16/55

0USERS

1RESEARCHER

Quanti!ed Eviden

CONFER

2hrs


17/55

RITE Study with Prototypes


18/55

RITE Study with prototypes

Rapid IterativeTesting & Evaluation

1-2 days


19/55

RITE Study Process

Need quick

feedback

Write script,

prep proto,

gather team

Conduct study Repeat

with every user


20/55

RITE Study Process: One day

9 am

Design v0.1

11 am

Design v0.2

1 pm

Design v0.3

3 pm

Design v0.4

5 pm

Design v0.5

Conduct study


21/55

RITE Study Process: Two days

9 am

Design v0.1 11 am

Design v0.1 1 pm

Design v0.1

9 am

Design v0.2 11 am

Design v0.2 1 pm

Design v0.2

Day 1 Day 2


22/55

Focused Change

99hrs

5USERS 1RESEARCHER 1DESIGNER

USABILITY


23/55

Cafe Study


24/55

Cafe Study

Fresh eyes on smallisolated usability

issuesHalf day


25/55

Cafe Study Process

A usability/

discoverability

question

Can a user

unlock their

devicesuccessfully?

Write script,

prep prototype

Got several

phones ready

Conduct study

at cafe

5 min

per person,

taking notes

Summarize

observations

Email report

Assign action

items

Changes to

prototype,

back out formore testing


26/55


27/55

Pulse Study


28/55

Pulse study

Sprint cadenceuser studies

1 week


29/55

Pulse Study Process

Participant

review

Decide method

+

Draft tasks

Write script +

proto setup

Run 3 users +

Debrief with

team

Debrief +

File bugs +New work to

backlogs

Monday Tuesday Wednesday Thursday F

Researcher

Team Help with

prep

Scrum: Discuss

what to test

this week

Help with

prep


30/55

Flexible researchframework

96

USERS

1RESEARCHER

XOBSERVERS

USABILITY

9 hrsx

5 days


31/55

Pulse Study Deep Dive


32/55

What are we testing?

Pulse Study Step 1: Preparation


33/55

Sprint build

by product manager

Prototype

by UX designer

O

by industr


34/55

San Diego Air and Space Museum A

Who are we inviting?

Pulse Study Step 1: Preparation


35/55

Inte

ExteTarg

San Diego Air and Space Museum


36/55

Who is doing what?

source: arcweb.archives.gov/arc/action/Ex

Pulse StudyStep 1: Preparation

Researcher Observ
http://arcweb.archives.gov/arc/action/ExternalIdSearch?id=535579http://arcweb.archives.gov/arc/action/ExternalIdSearch?id=535579http://nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58359~162203http://nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58359~162203


37/55

source: arcweb.archives.gov/arc/actio

Note-taker

P l S d S 2 L b S
http://arcweb.archives.gov/arc/action/ExternalIdSearch?id=535579http://arcweb.archives.gov/arc/action/ExternalIdSearch?id=535579http://nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58359~162203http://nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58359~162203


38/55

Where are we testing

Pulse StudyStep 2: Lab Setup


39/55


40/55


41/55


42/55

Or,

P l St d St 3 E t


43/55

Pulse Study Step 3: Execute

GO!source: nasaimages.org/luna/servlet/detai
http://nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58359~162203http://nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58359~162203


44/55

I have a user in fro

of me! What do I doHi, thank you for helping us!

Were not testing you, were testing the product.

What did you mean by that?


45/55

What do I notdo?Isnt this a great product?Seriously, I cant believe you didnt know that.

Thats still wrong. You have to keep trying.


46/55

Did user notice the button?

Did user discover the icon?

Did user use the tool?

Use checkboxes

Pulse Study Step 4: Debrief with Team


47/55


What happened and

what can we do abou

Pulse StudyStep 4: Debrief with Team

List


48/55

List

Reporkey !n

Notin

!xes

Filing bugs


Pulse Study Step 5: Communication


49/55

Pulse StudyStep 5: Communication

What should we

remember?


50/55

Quick summary by email +

Brief presentation to wider team

Source: www.chives.si.edu/ipac20/ipac.jsp?&pro!

le=all&source=~!siarchives&
http://www.chives.si.edu/ipac20/ipac.jsp?&profile=all&source=~!siarchives&uri=full=3100001~!306366~!0#http://www.chives.si.edu/ipac20/ipac.jsp?&profile=all&source=~!siarchives&uri=full=3100001~!306366~!0#


51/55

Wrap up


52/55

FAQ


53/55

$1 : $10 : $10


54/55

Thank You!

Stop by our o"ce hours after the talk to get

started on conducting your own study!

Bethany FongMiki Konno#Androiddesign on Google+


55/55

Documents

125 FINAL PDF Agile UX Research.pdf