Embed Size (px)
Citation preview
Human Factors in the Design and Evaluation of Bioinformatics Tools
Naelah Al-Ageel, Areej Al-Wabil, Ghada Badr, Noura AlOmar
College of Computer and Information SciencesKing Saud University, Riyadh, Saudi Arabia
Bioinformatics domain
Growing complexity of biological data
Interdependencies in biological data
Revolutionary domain
Large volumes of biological data sets
Less structured data
1
2
3
4
5
2
Properties of Bioinformatics Systems
Bioinformatics systems:
• Integrate data from many sources
• Present data in different forms
• Process a variety of file formats
• Visualize biological data at molecular andgenome levels
3
Usabilityconsiderations
Responsiveness
Learnability
Accessibility
Understandability
Ease to useEffectiveness
Efficiency
Scalability
Platform independency
4
Contribution
Defining a criteria for building usable bioinformatics systems that takes into consideration:
1. Computational metrics
2. Cognitive and perceptual abilities of the users
Conducting a heuristic evaluation on bioinformatics systems
Conducting a comparative evaluation of many Usability Evaluation Methods
5
Usability Inspection of Existing Bioinformatics Online Motif Discovery
and Localization Tools
“Heuristics Evaluation Study”
First Impression
Interacting with Results & Visualization
Query\ Results Forms
Ideal Heuristics
Bioinformatics
Usability
Cross-domain
Target Experts
Sequential Motif Localization
“FIMO Tool”
Sequential Motif Discovery
“MEME Tool”
Structural Motif Localization
“RNAMST”
Structural Motif Discovery
“RNAPromo”
Bioinformatics Tools Evaluation Surveys7
Study Results
Functional Recommendations
User Interface Recommendations
Usability Issues/Problems Good Usability Features
8
Usability Issues
Minor
“1”
Serious
“2”
Major
“3”
Critical
“4”
Failure
“5”Total
MEME 16 7 4 0 1 28
FIMO 11 14 4 2 5 36
RNAMST 10 9 11 1 3 34
RNAPromo 19 6 2 2 0 29
Total 56 36 21 5 8 126
99
Effectiveness of Heuristics Evaluation in Bioinformatics
The heuristic evaluation was shown to be an effective usabilityevaluation method for the usability assessment ofbioinformatics tools and identifying usability issues that impactthe users’ satisfaction.
It doesn't produce fixes to the usability problems.
Easy to generate design recommendations according to experts’suggestions after interacting with the systems or beingintroduced to the tools in interactive sessions.
10
The Need for Applying Usability in Bioinformatics Tools
Improved interaction design - decreasing processing time
Easing the transition to new versions of existing systems
Improving human performance and productivity
Ensuring better quality of work
Minimizing the impact of user error in data entry
11
Usability Goals and Metrics
Cognitive Perspective Computational Perspective
• Time to Complete a Task
• Number of Achromous
• Number of Feedback Functions per site
• Home Page Reference
• Layout Complexity
• Overall Density
• Number of Font Types used
• Number of Ways to Perform a Task
• Percent of Favorable User Comments
• User Subjective Rating
• Ease of use
• Overall satisfaction
• Number of Mouse Clicks to complete
the task
• Completion rate efficacy
• Number of commands used
• Error Frequency
• Task Effectiveness
• Task Completion
• Broken Link Count
• Rate of Error Messages
• Number of reusable components
13
Usability Evaluation Methods(UEMs)
Aims of the Usability Evaluation Methods
Investigate the usability of Bioinformatics tools by systematicallyanalyzing user perception and behavior acquired in task-basedusability sessions.
Perform this experimental evaluation study based on theinteraction mode(s) of the proposed system.
Improve the quality of bioinformatics tools by conducting acomparative review of the expected outcomes.
Check whether the system meets functional and non-functionalrequirements.
15
Examples of the Usability Evaluation Methods Applied in Bioinformatics Tools
# Type of UEM Features
1 Morae StudyAudio, screen recorder, and usability analysis system in Morae manager
2 Eye Tracking StudyTracking eyes movements, usability
analysis system in Tobii SW
3 Observation Interaction with the system
4 Direct questions Opinions and recommendations
5 Post-test questionnaire Positive and negative feedback
16
Conclusion
• Designing usable bioinformatics systems will help in:– Reducing the cognitive overload of the users– Increasing the responsiveness of these systems– Obtaining satisfactory user experiences
Thank You!
Human Factors in the Design and Evaluation of Bioinformatics Tools
Naelah Al-Ageel, Areej Al-Wabil, Ghada Badr, Noura AlOmar
College of Computer and Information SciencesKing Saud University, Riyadh, Saudi Arabia
