Embed Size (px)
Citation preview
MULTISENSORY INTERACTION DESIGN: DESIGNING USER INTERFACES FOR
HUMAN SENSES Ta3ana Aires Tavares
Professor, Federal University of Paraiba, Paraiba, Brazil Visi3ng Scholar, State University of New York, USA
Agenda
Research Background
Gaps (desire x design x users)
Proposal (multisensory design interaction)
Questions
• Working with applica3ons development in places where people are not designing products… – Telemedicine Systems – Accessibility Solu3ons – Interac3ve TV applica3ons
Research Background
Surgery live transmission
Doctor is manipula3ng 3D models using Kinect
Videowall showing the video streams (a), an exam (b) and
the 3D model (c)
(a)
(a) (c)
(b)
Arthron for Telemedicine
Educa3onal Content
LIBRAS legend for content (sign language interpreter)
EDULIVRE – e-‐learning portal
Comments
Interac3ve Content
Simple Resources (TV set + Ginga)
Interac3ve applica3ons for all
• Key issue = user interface (design). • User is the focus, not just users’ needs. • Evalua3on with end-‐users is when the gaps pop up.
Gaps (desire x design x user)
Users are changing, aren't we?
h`p://www.youtube.com/watch?v=aXV-‐yaFmQNk
Proposal: Multisensory Design Interaction
+
HUMAN SENSES
Proposal: Multisensory Design Interaction
+
HUMAN SENSES
Proposal: Multisensory Design Interaction
+
HUMAN SENSES
Proposal: Multisensory Design Interaction
+
HUMAN SENSES
Proposal: Multisensory Design Interaction
+
HUMAN SENSES
Proposal: Multisensory Design Interaction
!
Proposal: Multisensory Design Interaction
!
Digital Convergence... Mobile “tech stuff”... InformaFon is everywhere... InformaFon anyFme... Users want mobility... A world of devices.... For having fun or working, users are always connected...
Proposal: Multisensory Design Interaction
!
UI is capable of being transformed by itself... Fluid interfaces... Who are the users? What users want? What users need? How user interfaces can please users desires?
Proposal: Multisensory Design Interaction
!
CogniFve ability considers how all this informa3on is absorbed by users. To do this, designers need to think about the users senses, percepFon capabiliFes and also emoFons.
Proposal: Multisensory Design Interaction
!
Proposal: Multisensory Design Interaction
• What is different when we think about senses? – User Interfaces use medias (mul3media). – Medias are perceived by human senses. – Percep3on and sensa3on are inputs for user interface design.
• Where can we apply MID concepts ? – Accessibility – Telemedicine (eHealth) – Human-‐Robots Interac3on – Art and Technology
• Synesthe3c Art (ChromestheFc PainFngs)
Questions
Questions
[ChromestheFc PainFng InteracFons (SUNY-‐IPAC)]
[Robots short movies (SUNY-‐HCI/RMIT)]
