View
31
Download
0
Category
Tags:
Preview:
Citation preview
AGENDA
1. Primary question
2. Persona
3. UX Flowchart
4. Guerrilla Testing
5. Recommendations
6. Conclusion
Freeman Khalandi Khani
Alzheimer’s Association (2014, October 13). Retrieved from UX Design: http://alz.org/
PRIMARY QUESTION
Did the redesign of alz.org improve
the user’s ability to find the answers
to the 14 questions?
Freeman Khalandi Khani
Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion
Primary Method: Users navigating through the
prototype as they would naturally
PRIMARY QUESTION
Did the redesign of alz.org improve
the user’s ability to find the answers
to the 14 questions?
Freeman Khalandi Khani
Secondary Method: Users starting their navigation from the
home page to answer each question
Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion
• Three main deliverables
1. Persona
2. UX Flowchart – web and mobile
3. Guerilla testing – web and mobile
PRIMARY QUESTIONMAIN DELIVERABLES
Freeman Khalandi Khani
Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion
PRIMARY QUESTIONMAIN GOALS
• Goal achieved through our main objectives
1. Persona based design
o What is important to a caregiver?
2. Create a alz.org prototype
o Address issues found during previous usability tests
o Web and mobile interfaces
3. Guerilla testing
o Ensure users can find the answers to all the tasks
o Ensure users can get to the answers within 2 clicks
Freeman Khalandi Khani
Primary Question Persona UX Flowchart Guerilla Testing Recommendation Conclusion
PERSONA“Personas bring the absent user to the table” 1
1 Freeman, J. (2014, October 13). Synching the perception of the audience to conceptual design. Retrieved from UX Design: http://ux.justinrfreeman.com/
PERSONA How we did it
• Interviews
o Alzheimer’s patient caregiver
o Nursing home administrator
• Web search
• Consolidated findings to identify commonalities in user
attributes
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
PERSONA RESULT
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
PERSONA RESULT
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
PERSONA RESULT
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
PERSONA RESULT
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
PERSONA RESULT
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
PERSONA RESULT
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTHOW WE DID IT
1. Card sorting
2. Create the information architect of our site
3. Create a UX flowchart
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTHOW WE DID IT: CARD SORTING
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
UX FLOWCHARTHOW WE DID IT: INFORMATION ARCHITECT
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTHOW WE DID IT: INFORMATION ARCHITECT
Freeman Khalandi Khani
Home
Local chapters
Calendar
Support
Phone #
Address
Alzheimer’s
What is Alzheim
er’s10
warning signsLife
expectancy
(prognosis)Stages of
Alzheimer’sIssues to
expect with
Alzheimer’s
Dementia
Types of Dementi
aEducatio
n program
s
Care
Long-term careCommun
ication with
Alzheimer’s
patient
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: PC LEGEND
Freeman Khalandi Khani
User Desired
action
Computer screen
User actio
n
Page chang
e
End of
task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: PC BROWSER “DEMENTIA”
Freeman Khalandi Khani
What other diseases, besides
Alzheimer’s, can cause dementia?
Turns on computer and
goes to alz.org
alz.org - Homepag
e Scans home page then clicks on “dementia” tab
alz.org – Dementia
Page Chan
ge
Dementia Tab: Types &
Education Programs
User Selects
“Types of Dementia
”Dementia: “Types
of Dementia”Closes Browse
r
Accordion
menu drops down
types of dementia
Reads various
User Desired action
Computer screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
1. Identified web design parameters to meet Ronda
needs
2. Create a PC and a mobile prototype
3. Conduct guerrilla testing on the prototypes
o Test the users in their natural environments
Coffee shops
Grocery stores
Work
GUERRILLA TESTINGHOW WE DID IT
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
GUERRILLA TESTINGHOW WE DID IT: DESIGN PARAMETERS
Identified web design parameters based
on
“Don’t Make Me Think! A Common Sense
Approach to Web Usability”
by Steve Krug
Freeman Khalandi Khani
GUERRILLA TESTINGHOW WE DID IT: DESIGN PARAMETERS
1. Name of things must be intuitive
2. Links and buttons are obviously clickable
3. Clear visual hierarchy on each page
4. Minimize noise
5. Persistent navigation one each page
6. You are here – give clear visual indicators of location of the site
7. Breadcrumbs – navigation path from home page to present page
8. Make it easy to recover from errors
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1. Find the name of the Alzheimer’s Association Chapter near you
2. Address of your local Alzheimer’s office
3. Local chapter phone number
4. Difference between Alzheimer’s and dementia
5. Diseases/conditions other than Alzheimer’s that cause dementia
6. 10 warning signs of Alzheimer’s
7. “Calendar of Events”
8. Educational programs specifically for individuals with dementia
9. Support groups
10. Information regarding finding a long term care home for someone with Alzheimer’s
11. Alzheimer’s prognosis
12. Three problems one should expect as Alzheimer’s disease progresses
13. Stages of Alzheimer’s and describe last stage
14. Effective ways to communicate with someone who has Alzheimer’s
Freeman Khalandi Khani
GUERRILLA TESTINGMETHODS: TASKS
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Team members conducted guerrilla tests individually
1. Approached random people and asked them to participate in our study
2. Explained the study to the participant
3. Explained and signed IRB
4. Demographic questionnaire was completed
5. Completed 14 tasks - found answers to questions using prototype
6. Satisfaction questionnaire was completed
7. Thanked individuals for their participation
Freeman Khalandi Khani
GUERRILLA TESTINGMETHODS
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGMETHODS
Total of 8
participants
Primary method Secondary method
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGMETHODS
Primary method
Secondary method
4 tested PC
Prototype
4 tested Mobile
Prototype
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1. Efficiency – Time on task
2. Effectiveness – Number of clicks/taps
3. Errors
4. Completion rate
5. Satisfaction questionnaire (9 questions)o Combination of ease of use and frustration questions (4 questions)
Identify most difficult and easiest task
Identify most frustrating and least frustrating task
o Likert scale satisfaction questions (4 questions)
Freeman Khalandi Khani
GUERRILLA TESTINGMETHODS: MEASURES
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: PRIMARY METHOD PARTICIPANT DEMOGRAPHICS
Average Age38.7
Age Range26 - 66
Caregivers0 / 6
Own smartphones6 / 6
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFICIENCY
1 2 3 4 5 6 7 8 9 10 11 12 13 140
20
40
60
80
100
120
140
160
180
200
Average Time on Task
PCMobile
Tasks
Avera
ge T
ime o
n T
ask (
seconds)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFICIENCY
0
20
40
60
80
100
120
27.5
41.9
Average Time on Tasks
PCMobile
Avera
ge T
ime o
n T
ask (
seconds)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFICIENCY
PC Mobile
Tasks N1P C1P Average Std.Dev N1M N2M Y1M Y2M Average Std.Dev
1 23 10 16.5 9.2 16 60 102 137 78.8 52.4
2 9 3 6.0 4.2 2 10 49 10 17.8 21.2
3 5 13 9.0 5.7 12 6 30 2 12.5 12.4
4 62 76 69.0 9.9 23 165 120 62 92.5 62.6
5 30 2 16.0 19.8 20 1 250 42 78.3 115.7
6 11 61 36.0 35.4 10 14 30 44 24.5 15.6
7 25 34 29.5 6.4 118 11 5 68 50.5 53.2
8 45 1 23.0 31.1 10 12 10 159 47.8 74.2
9 6 1 3.5 3.5 0 42 40 160 60.5 69.1
10 10 1 5.5 6.4 13 10 20 15 14.5 4.2
11 19 16 17.5 2.1 6 26 35 27 23.5 12.3
12 3 90 46.5 61.5 1 5 89 20 28.8 41.0
13 6 70 38.0 45.3 8 10 22 19 14.8 6.8
14 45 94 69.5 34.6 47 11 30 82 42.5 30.2
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFICIENCY
1 2 3 4 5 6 7 8 9 10 11 12 13 140
20
40
60
80
100
120
140
160
180
200
Average Time on Task
PCNMYM
Tasks
Avera
ge T
ime o
n T
ask (
seconds)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFICIENCY
0
10
20
30
40
50
60
70
Average Time on Tasks
PCNMYM
Avera
ge T
ime o
n T
asks (
seconds)
0
20
40
60
80
100
120
27.5
41.9
Average Time on Tasks
PCMobile
Avera
ge T
ime o
n T
ask (
seconds)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFECTIVENESS
1 2 3 4 5 6 7 8 9 10 11 12 13 140
2
4
6
8
10
12
14
Number of Clicks/Taps
PCMobile
Tasks
Num
be r
of
Clicks /
Taps
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFECTIVENESS
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
Number of Clicks/Taps
PCNMYM
Tasks
Num
be r
of
Clicks /
Taps
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFECTIVENESS
-1
0
1
2
3
4
5
6
Number of Clicks/Taps
PCMobile
Avera
ge N
um
ber
of
Clicks/T
aps
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: EFFECTIVENESS
0
0.5
1
1.5
2
2.5
3
Number of Clicks/Taps
PCNMYM
Avera
ge N
um
ber
of
Clicks/T
aps
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: ERRORS
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
Error
PCMobile
Tasks
Num
ber
of
Err
or
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: ERRORS
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
7
8
9
Error
PCNMYM
Tasks
Num
ber
of
Err
or
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: ERRORS
0
5
10
15
20
25
30
Number Errors
PCMobile
Num
ber
of
Err
ors
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: ERRORS
0
5
10
15
20
25
30
Number of Errors
PCNMYM
Num
ber
of
Err
ors
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: COMPLETION RATE
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
20%
40%
60%
80%
100%
Accurate Task Completion (%)
PCMobile
Tasks
% A
ccura
te C
om
ple
tion
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: COMPLETION RATE
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
20%
40%
60%
80%
100%
Accurate Task Completion (%)
PCNMYM
Tasks
% A
ccura
te C
om
ple
tion
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: COMPLETION RATE
0123456789
10111213
11.5
12.75
Average # of Completed Tasks per Participant
PCMobile
Avera
ge #
of
Com
ple
ted T
asks p
er
Part
icip
ant
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: COMPLETION RATE
0123456789
10111213
11.512.5
13
Average # of Completed Tasks per Participant
PCNMYM
Avera
ge #
of
Com
ple
ted T
asks p
er
Part
icip
ant
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION
1 2 3 4 50
1
2
3
4
5
6
7
8
Tasks Identified as Most Difficult/Frustrating
Most FrustratingMost Difficult
Tasks
Num
ber
of
Identi
ficati
on T
imes
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION
1 2 3 40
1
2
3
4
5
6
7
8
Tasks Identified as Easiest/Least Frustrating
Least FrustratingEasiest
Tasks
Num
ber
of
Identi
ficati
on T
imes
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – LIKERT SCALE
0
1
2
3
4
5
6
7
8
Satisfaction Likert Scale (1=Strongly Disagree, 7=Strongly Agree)
Overall SatisfactionTime SatisfactionSupport Information Satisfaction
Avera
ge R
ati
ng
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – FUNCTIONALITY
of participants thought the site
functioned as expected
100%
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – USER COMMENTS
C1P “nothing but couldn't find calendar of events”
N1P “Finding the differences between Alzheimer's and dementia required comparing two sections. one would have made it easier.”
N1M “None”
Y1M “revisit the questioning on task 5, as it was personally misleading.”
N2M “I don't know if a ‘FAQ’ tab was on the site, but that would have been helpful.”
Y2M “educational programs for Alzheimer's should be under Alzheimer's tab.”
Q: Based on your experience, what is the first thing you would change
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
Freeman Khalandi Khani
Did the redesign of alz.org improve
the user’s ability to find the answers
to the 14 questions?
Primary Method: Users navigating through the
prototype as they would naturally
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
• Goal of 2-click tasks
o Was met for the PC and NM groups (averagepc = 1.96; std.devpc =
1.91 and averageNM = 1.64; std.dev NM = 1.37)
o Was not met for the YM group (average YM = 2.68; std.dev YM =
2.82)
• Our results are being compared to a usability study
conducted on the current alz.org website
o The test compared the difference between association’s website
and brochure
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
• Redesign of the alz.org website improved user’s
o Improved the completion rate of Tasks 1, 2, 4, 5, 6, 9, 11, 13 and
14
o Completion rate of tasks 3 and 10 remained consistent
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
20%
40%
60%
80%
100%
Accurate Task Completion (%)
Current StudyPrevious Study
Tasks
% A
ccura
te C
om
ple
tion
HOW THESE RESULTS ANSWER OUR QUESTION
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
• Redesign of the alz.org website improved user’s
o Time on task
Freeman Khalandi Khani
Previous study
Current study
Rate of change
Average TOT (sec) 1136.4 27.5 -41.3
Std. Dev (sec) 563.4 28.9 -19.5
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
20%
40%
60%
80%
100%
Accurate Task Completion (%)
Current StudyPrevious Study
Tasks
% A
ccura
te C
om
ple
tion
HOW THESE RESULTS ANSWER OUR QUESTION
• However, it diminished the user’s
o Completion rate on tasks 7, 8 and 12
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
Freeman Khalandi Khani
Did the redesign of alz.org improve
the user’s ability to find the answers
to the 14 questions?
Primary Method: Users navigating through the
prototype as they would naturallyYES
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD PARTICIPANT DEMOGRAPHICS
Average Age47.5
Age Range43 - 52
Caregivers0 / 2
Own smartphones2 / 2
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFICIENCY
1 2 3 4 5 6 7 8 9 10 11 12 13 14
-20
-10
0
10
20
30
40
50
60
70
80
Average Time on Task (comparing primary and secondary PC methods)
Secondary MethodPrimary Method
Tasks
Tim
e o
n T
ask (
seconds)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFICIENCY
-10
0
10
20
30
22.3
27.5
Average Time on Task per Method
SPCPPC
Avera
ge T
ime o
n T
ask (
seconds)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFECTIVENESS
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
Average Clicks per Task (comparing primary and secondary PC methods)
Secondary MethodPrimary Method
Tasks
Avera
ge C
licks
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD EFFECTIVENESS
2
2
2
2.2
2.0
Average Number of Clicks per Method
SPCPPC
Avera
ge N
um
ber
of
Clicks)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD ERROR
1 2 3 4 5 6 7 8 9 10 11 12 13 140
1
2
3
4
5
6
Error per Task
Secondary MethodPrimary Method
Tasks
Num
ber
of
Err
ors
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD ERROR
0
1
2
3
4
5
6
7
8
9
6
8
Error per Method
SPCPPC
Num
ber
of
Err
ors
)
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD COMPLETION RATE
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Accurate Completion per Task (%)
Secondary MethodPrimary Method
Tasks
% A
cucura
te c
om
ple
tion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SECONDARY METHOD COMPLETION RATE
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
0.0
2.0
4.0
6.0
8.0
10.0
12.0
14.0
13.0
11.5
Average # of Completed Tasks
SPCPPC
Avera
ge #
of
Com
ple
ted T
asks
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION
1 20
0.2
0.4
0.6
0.8
1
1.2
Tasks Identified as Most Difficult/Frustating
Most FrustratingMost Difficult
Tasks
Num
ber
of
Identi
ficati
on T
imes
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – DIFFICULTY & FRUSTRATION
1 20
0.5
1
1.5
2
2.5
Tasks Identified as Most Difficult/Frustating
Least FrustratingEasiest
Tasks
Num
ber
of
Identi
ficati
on T
imes
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – LIKERT SCALE
0
1
2
3
4
5
6
7
8
Satisfaction Likert Scale (1=Strongly Disagree, 7=Strongly Agree)
Overall SatisfactionTime SatisfactionSupport Information Satisfaction
Avera
ge R
ati
ng
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – FUNCTIONALITY
of participants thought the site
functioned as expected
100%
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
GUERRILLA TESTINGRESULTS: SATISFACTION – USER COMMENTS
Q: Based on your experience, what is the first thing you would change
C2P “nothing made make the calendar of events larger”
C3P “not having to go to home screen after each task”
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
Freeman Khalandi Khani
Did the redesign of alz.org improve
the user’s ability to find the answers
to the 14 questions?
Secondary Method: Users starting their navigation from the
home page to answer each question
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
• Goal of 2-click tasks
o Was not met (Average = 2.2; Std.Dev = 1.2)
• Our results are being compared to a usability study
conducted on the current alz.org website
o The test compared the difference between association’s website
and brochure
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
• Redesign of the alz.org website improved user’s
o Improved the completion rate of Tasks 1, 2, 4, 5, 6, 8, 9, 11, 13
and 14
o Completion rate of tasks 3 and 10 remained consistent
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
20%
40%
60%
80%
100%
Accurate Task Completion (%)
Current StudyPrevious Study
Tasks
% A
ccura
te C
om
ple
tion
HOW THESE RESULTS ANSWER OUR QUESTION
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
• Redesign of the alz.org website improved user’s
o Time on task
Freeman Khalandi Khani
Previous study
Current study
Rate of change
Average TOT (sec) 1136.4 22.3 -50.9
Std. Dev (sec) 563.4 27.2 -20.7
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
1 2 3 4 5 6 7 8 9 10 11 12 13 140%
20%
40%
60%
80%
100%
Accurate Task Completion (%)
Current StudyPrevious Study
Tasks
% A
ccura
te C
om
ple
tion
HOW THESE RESULTS ANSWER OUR QUESTION
• However, it diminished the user’s
o Completion rate on tasks 7 and 12
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
HOW THESE RESULTS ANSWER OUR QUESTION
Freeman Khalandi Khani
Did the redesign of alz.org improve
the user’s ability to find the answers
to the 14 questions?
Secondary Method: Users starting their navigation from the
home page to answer each questionYES
Primary Question Persona UX FlowchartGuerrilla Testing Recommendation Conclusion
RECOMMENDATIONS
Simplifying the website design and content will improve
website’s usability
• Make the “Calendar of events” more noticeable
• Difference between dementia and Alzheimer’s need to
be more readily available
• The website content needs to be restructured
• Enhance the mobile platform design
Freeman Khalandi Khani
Primary Question Persona UX Flowchart Guerrilla TestingRecommendat
ion Conclusion
CONCLUSION
• Our prototype did not improve the usability of all the
14 tasks
• Improvements with prototype
o PC: Improvement in 9 of the 14 tasks
o Mobile: Improvements in 10 of the 14 tasks
• http://7xedgj.axshare.com
o Password protected
Freeman Khalandi Khani
Primary Question Persona UX Flowchart Guerrilla Testing Recommendation Conclusion
CONCLUSIONLESSONS LEARNED
• How to properly create a persona
• Difference between IA and UX Flowchart
• How to properly create an IA and a UX Flowchart
• How do you spell Guerrilla (Guerilla?)
• Team communication skills
• Time management
• Users don’t always do what you ask them to
Freeman Khalandi Khani
Primary Question Persona UX Flowchart Guerrilla Testing Recommendation Conclusion
QUESTIONS?
Click icon to add picture
Speak now or forever hold your peace…
PERSONAWHAT IS A PERSONA?
“A persona represents a cluster of users who exhibit
similar behavioral patterns in their purchasing decisions,
use of technology or products, customer service
preferences, lifestyle choices, and the like.” 2
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
2 O’Connor, K. (2014, October 13). Personas: The foundation of a great user experience. Retrieved from UX Magazine: http://uxmag.com/articles/personas-the-foundation-of-a-great-user-experience
PERSONA WHY WE DID IT
• Users have certain goals & expectations when interacting with a
product
• Understanding the user goals, behaviors, and patterns
o Help define the important attributes users possess
• Personas aim to capture those attributes
• We wanted to create a prototype that better met the user’s needs
Freeman Khalandi Khani
Primary QuestionPersona UX Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
“Personas bring the absent user to the table” 1
1 Freeman, J. (2014, October 13). Synching the perception of the audience to conceptual design. Retrieved from UX Design: http://ux.justinrfreeman.com/
UX FLOWCHARTWHY WE DID IT
• Define how all the objects and actions of our prototype
should interrelate
• Keep our prototype inline with our persona’s needs and
wants
• Provided our team with a common vision for our
prototype
• Help achieve our 2-click per task goal
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
UX FLOWCHARTWHAT IS A FLOWCHART?
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
A UX flowchart binds an application together in a way that
supports the conceptual models of its target users. 3
3 Nieters, J. (2014, October 13). Defining an Interaction Model: The cornerstone of application design. Retrieved from UX Matters: http://www.uxmatters.com/mt/archives/2012/01/defining-an-interaction-model-the-cornerstone-of-application-design.php
UX FLOWCHARTHOW WE DID IT: CARD SORTING
1. Card sorting
o A method used to help design (or evaluate)
the information architect of a site 4
o Categorized our tasks into four main groups
In your area
Alzheimer’s
Dementia
Care
2. Create an information architect of
our site
3. Create a UX flowchart
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
4 C
ard
Sortin
g (2
014
, Octo
ber 1
3). R
etrie
ved fro
m U
sab
ility.gov:
http
://ww
w.u
sab
ility.gov/h
ow
-to-a
nd
-tools/m
eth
ods/ca
rd-so
rting
.htm
l
UX FLOWCHARTHOW WE DID IT: INFORMATION ARCHITECT
1. Card sorting
2. Create an information architect of our site
o “IA focuses on organizing, structuring and labeling content in an
effective and sustainable way” 5
o Using categories created from card sorting exercise
o Create subcategories
o Ensure users can complete tasks
3. Create a UX flowchart
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
5 In
form
atio
n A
rchite
cture
Basics (2
014
, Octo
ber 1
3). R
etrie
ved fro
m U
sab
ility.gov: h
ttp://w
ww
.usa
bility.g
ov/w
hat-a
nd-w
hy/in
form
atio
n-
arch
itectu
re.h
tml
UX FLOWCHARTHOW WE DID IT: UX FLOWCHART
Freeman Khalandi Khani
Primary Question PersonaUX
Flowchart Guerrilla Testing Secondary Question Recommendation Conclusion
UX FLOWCHARTRESULTS: MOBILE LEGEND
Freeman Khalandi Khani
User Desired
action
Computer screen
User actio
n
Page chang
e
End of
task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: PC BROWSER “IN YOUR AREA”
Freeman Khalandi Khani
Does the Alzheimer’s
association have a local chapter
near me?
Turns on computer and
goes to alz.org
alz.org - Homepag
e Searches for local chapter
by state: Missouri
alz.org – In your area
Page Chan
ge
Locations in MO – 3 options
Documents Prairie
Village, KS chapter
Locations: Columbia, MO; St. Louis, MO;
Prairie Village, KS
Closes Browse
rUser Desired
actionComputer
screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: PC BROWSER “ALZHEIMER’S”
Freeman Khalandi Khani
Are there any warning signs
for Alzheimer’s disease?
Turns on computer and
goes to alz.org
alz.org - Homepag
e Scans page. Clicks on “10 Warning signs” under Alzheimer’s section
alz.org – Alzheimer’s
Page Chan
ge
Alzheimer’s: “10 Warning Signs”
Scrolls through the 10 warning signs
of Alzheimer’s
Alzheimer’s: “10 Warning Signs”
Closes Browse
rUser Desired
actionComputer
screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: PC BROWSER “CARE”
Freeman Khalandi Khani
Are there recommended communication methods to use
with Alzheimer’s patients?
Turns on computer and
goes to alz.org
alz.org - Homepag
e Scans home page. clicks on “Long-term Care” under Care tab
alz.org – Care
Page Chan
ge
Care Tab: Long-term Care
Reads about available long-term
care options
Care: “Long-term Care”
Closes Browse
rUser Desired
actionComputer
screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: MOBILE “ALZHEIMER’S”
Freeman Khalandi Khani
Are there any warning signs for
Alzheimer’s disease?
Unlock phone and
goes to alz.org
alz.org - Homepag
eSkims home
page and taps on
Alzheimer’s Tab
alz.org – Alzheimer’s Tab
In Your area page opens
Alzheimer’s Tab
taps on “10
Warning Signs”
10 Warning
Signs
Locks
Phone
Accordion
Menu opens
User Desired action
Computer screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: MOBILE “IN YOUR AREA”
Freeman Khalandi Khani
What is the address of the
Alzheimer’s association
chapter near me?
Unlock phone and
goes to alz.org
alz.org - Homepag
eSkims home
page and taps on map under In your
Area
alz.org – Map
In Your area page opens
In Your Area Tab
Scrolls down
and taps on
Missouri on
the Map
Address: Columbia, MO; St. Louis, MO;
Prairie Village, KS
Locks
Phone
Local Chapte
rs page opens
Village
address
Documents Prairie
User Desired action
Computer screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: MOBILE “DEMENTIA”
Freeman Khalandi Khani
What other diseases, besides Alzheimer’s, can cause dementia?
Unlock phone and
goes to alz.org
alz.org - Homepag
eScrolls down the home page. taps
“Types of Dementia” under Dementia Tab
alz.org – Dementia Tab
“Typ
es o
f Dem
entia
” pa
ge
open
s
Dementia Tab –
“Types of Dementia”
Scrolls down the page and find types of
dementia
10 Warning
Signs
Locks
Phone
User Desired action
Computer screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
UX FLOWCHARTRESULTS: MOBILE “CARE”
Freeman Khalandi Khani
Are there any long-term care
options for Alzheimer’s
patients?
Unlock phone and
goes to alz.org
alz.org - Homepag
e
Dementia Tab –
“Long-Term Care”
Scroll down to see Long=term
Care information
“Long-Term Care”
Locks
Phone
Scrolls down the home page. taps “long-term care”
under the care tab
alz.org – Care Tab
“long-
term Care
” page open
s
User Desired action
Computer screen
User actio
n
Page change
End of task
Primary Question PersonaUX
Flowchart Guerrilla Testing Recommendation Conclusion
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Secondary Question Recommendation Conclusion
GUERRILLA TESTINGWHAT IS GUERRILLA TESTING?
“Guerrilla research methods are faster, lower-cost
methods that provide sufficient enough insights to make
informed strategic decisions.” 5
5 Unger, R. & Wafgel, T. (2014, October 13). Getting Guerrilla With It. Retrieved from UX Magazine: http://uxmag.com/articles/getting-guerrilla-with-it
• It is a fast way to test a prototype
• Test the users in their natural environments
o Coffee shops
o Grocery stores
o Work
• Understand if the prototype meets the user’s goals
and needs
Freeman Khalandi Khani
Primary Question Persona UX FlowchartGuerrilla Testing Secondary Question Recommendation Conclusion
GUERRILLA TESTINGWHY WE DID IT
Recommended