Embed Size (px)
DESCRIPTION
Innovative techniques to make Heuristic Evaluations and Expert Reviews more valuable for business and technical stakeholders
Citation preview
Expert ReviewsUsing the VIMM Model to Communicate to Stakeholders
Michael Rawlins, Certified Usability Analyst Presented to the Connecticut Chapter of Usability Professionals
August, 2009
About me...Michael RawlinsDirector, User Experience, Open Solutions Inc.
•Certified Usability Analyst since 2003•Led UCD teams at major Fortune 100 companies•Performed 100’s of Expert Reviews
2
Power of the VIMM Model
3 Credited to Human Factors International
Definition of VIMMReducing:
Visual Clutter
Intellectual Complexity
Memory load (short & long term)
Motor load (and inconsistency)
4
Credited to Human Factors International
Key takeaways...VIMM is as an organizing principle
VIMM to communicate findings
VIMM helps you establish a common language with a stakeholder (leverage their mental model - their mindset)
5
Stakeholder Mindset...
6
Stakeholder Need...Data that communicates the level of risk and exposure to business failure
Easy to understand metrics and frameworks that can be trended over time
Their agendas satisfied - often times they are not as interested in learning a discipline like Usability
7
Definitions...An Expert Review (ER) is an evaluation of the status of an existing device, application or website. A single reviewer (or team of reviewers) examines the user interface in a very specific context or construct (example: apply a checklist of generally accepted *heuristics)
*Heuristics are “rules of thumb” 8
ER’s Generate Quick Wins...
Planning tool - evaluate existing web site or application
Establish a common language - when preparing for a major redesign
Support Usability Testing Cycle - identify critical issues
Post-Mortem Tracking Mechanism - post release assessment tool to identify design additional issues
9
The typical ERIdentify heuristic violations (severity and impact)
Feature annotated screens illustrating issues
Outline of short & long term recommendations
Action plan, highlighting critical changes for improving application or website
10
Simple ERChecklist
Rating Scale
Comments area
11
More Structured ER
Credited to Xerox12
Categories
Applicability
Comments
ER with a set of Heuristics•Structure•Visual Layout•Text•User Interface Metaphor•Information Content•User Assistance•Navigation•Consistency & Standards•Mental Workload•Graphics & Animation•Errors•Feedback•Flexibility & Efficiency•Initial Experience •Accessibility
Credited to IBM13
Communication is Key...Position ER’s with your stakeholder as a Preventive Measure - an assessment tool that helps mitigate risk of costly usability issues
Provide positive and negative usability issues (always lead with the positive)
Only a diagnostic tool - does not represent actual behaviors of target users
14
Innovations...
15
Organize with VIMM Model
Credited to Human Factors International16
Add Scorecards and GraphsScorecards illustrate trends
0
7.5
15
22.5
30
20072008
2009StructureDesignLayoutInteraction
Scorecard Credited to Human Factors International17
Add Impact Matrixes Communicate the risk of not fixing
18
Create Action Plans
19
Add Risk Assessment
20
Rationalizing Findings...
21
http://www.measuringusability.com/problem_discovery.php#estp
ER’s cannot be measured unless you
collaborate with multiple reviewers.
Multiple reviewers often results in multiple
findings.This tool helps rationalize.
Credited to Jeff Sauro - Measuring Usability
Planning tool “How many reviewer will it take to find 85% of the problems”
Justifying Results...
22
Increase Predictability: communicate to stakeholders that science is involved
Credited to Jeff Sauro - Measuring Usability
SummaryStakeholders need evidence that usability issues exist
ER’s capture evidence quickly & effectively
ER’s inspire collaboration with your peers
Innovate ER’s using VIMM model
Present to stakeholders using charts, graphs, to stakeholder support decisions
23
Reading...Jacob Nielson and Robert L. Mack (editors), Usability Inspections Methods, John Wiley & Sons, 1994
Wendy Yee, (whitepaper) The Value of an Expert Review and 5-Step Review Checklist, Human Factors International, 2002
Usability toolkit http://www.stcsig.org/usability/resources/toolkit/toolkit.html
24
thank you...
26
