Extremely Rapid Usability Extremely Rapid Usability TestingTesting
(ERUT)(ERUT)
When you can’t do anything do something… its better than nothingWhen you can’t do anything do something… its better than nothing
(K. Holtzblatt)(K. Holtzblatt)
What is ERUTWhat is ERUT
Discount usability methodDiscount usability method Evaluation vs discovery methodEvaluation vs discovery method Mash up of informal HCI methodsMash up of informal HCI methods
– QuestionnairesQuestionnaires– Co discoveryCo discovery– Storyboards Storyboards – Usability testingUsability testing
Short time framesShort time frames– Less than 20 minutesLess than 20 minutes
Provides insights onlyProvides insights only
GoalGoal
Narrow Focus onlyNarrow Focus only Two objectives:Two objectives:
– Assess the usefulness of the core functionality Assess the usefulness of the core functionality of the productof the product
– Find major usability problems in that core Find major usability problems in that core functionality functionality
The MethodologyThe Methodology
Recruit participants on the flyRecruit participants on the fly Prescreen questionnairePrescreen questionnaire Core tasks that reflect the product USPCore tasks that reflect the product USP Run the testRun the test Record results using storyboardsRecord results using storyboards Post test interviewPost test interview
Recruit participantsRecruit participants
Advantage of ERUT in a trade booth contextAdvantage of ERUT in a trade booth context– Broad brush of users in one place at one timeBroad brush of users in one place at one time– They are in the booth willinglyThey are in the booth willingly– A “hallway methodology” attracts them to the A “hallway methodology” attracts them to the
boothbooth
Prescreen QuestionnairePrescreen Questionnaire
Short questionnaire that screens for that Short questionnaire that screens for that target audiencetarget audience
Find the users three core tasksFind the users three core tasks– Compare to products USP tasksCompare to products USP tasks
Define three core tasksDefine three core tasks
Representative of the core functionality of Representative of the core functionality of the productthe product
One task should reflect the heart of the One task should reflect the heart of the products USPproducts USP
Tasks need to be motivationalTasks need to be motivational Product should be able to do these tasksProduct should be able to do these tasks
Run the testRun the test
Run one task onlyRun one task only– Ask the participant to choose the task of interestAsk the participant to choose the task of interest
Co – discoveryCo – discovery– If participants know each other than test in pairsIf participants know each other than test in pairs– Equally or more important to observe comments Equally or more important to observe comments
Active Intervention or coaching if single Active Intervention or coaching if single participantparticipant
Recording results using StoryboardsRecording results using Storyboards
Use hardcopy screenshots to record the Use hardcopy screenshots to record the story of where users traveled through the story of where users traveled through the interface to complete the taskinterface to complete the task
- Paper is cheaper and does not require the - Paper is cheaper and does not require the hours of reviewing video tape.hours of reviewing video tape.
Post Test InterviewPost Test Interview
Clarify and follow up on any remaining Clarify and follow up on any remaining questionsquestions
Key is to make the questions fit the trade Key is to make the questions fit the trade booth atmospherebooth atmosphere– Work them into the conversationWork them into the conversation– Expect not to ask them allExpect not to ask them all
Test Artifacts for AnalysisTest Artifacts for Analysis
Prescreen QuestionnairePrescreen Questionnaire– Identifies target audience, core tasks and Identifies target audience, core tasks and
indicates alignment with products USPindicates alignment with products USP
Storyboard screensStoryboard screens– Records task, task success, user comments, Records task, task success, user comments,
visual picture of paths taken visual picture of paths taken
Post test surveyPost test survey– optionaloptional
ERUT AdvantagesERUT Advantages
Narrow focus on Business goals and core Narrow focus on Business goals and core functionality produces valuable insightsfunctionality produces valuable insights
Rapid gathering of good quality user Rapid gathering of good quality user feedbackfeedback
Easy access to broad brush of usersEasy access to broad brush of users Fluid –adaptable to changeFluid –adaptable to change
ERUT DisadvantagesERUT Disadvantages
Narrow FocusNarrow Focus Rapid hectic environmentRapid hectic environment Participants are in a trade show frame of Participants are in a trade show frame of
mind and their comments are not reflective mind and their comments are not reflective of their real world.of their real world.
SummarySummary
Valuable methodology to have in your tool Valuable methodology to have in your tool kit when conference or trade show kit when conference or trade show opportunity arisesopportunity arises
Insights onlyInsights only Useful when faced with something is better Useful when faced with something is better
than nothingthan nothing