Upload
others
View
3
Download
0
Embed Size (px)
Citation preview
Asım Evren Yantaç / [email protected] Çorlu / [email protected] Fjeld / [email protected] Kunz / [email protected]
Exploring Diminished Reality (DR) Spaces to Augment the Attention of Individuals with Autism
29.09.15 _ IWDR2015 _ Fukuoka, Japan
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 472
Background
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 473
YOU
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 474
SURROUNDINGin 1910s
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 475
SURROUNDINGTODAY
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 476
We are now surrounded by data everywhere.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 477
Accessibility is the degree to which a product, device, service, or environment is available to as many people as possible.
OTHERS
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 478
Accessibility is the degree to which a product, device, service, or environment is available to as many people as possible.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 479
PEOPLE with DISABILITIES
The concept often focuses on people with disabilities or special needs and their right of access...
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4710
_ communication disorders;_ hearing impairments;_ visual impairments;_ mobility impairments;_ learning disability or impairment in mental functioning.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4711
_ Agoraphobia_ Social anxiety disorder_ Panic disorder_ Alzheimer_ Bipolar disorder_ Autism_ Asperger_ Attention - deficit hyperactivity disorder_ Oppositional defiant disorder_ Anti-social personality disorder
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4712
_ Agoraphobia_ Social anxiety disorder_ Panic disorder_ Alzheimer_ Bipolar disorder_ Autism_ Asperger_ Attention - deficit hyperactivity disorder_ Oppositional defiant disorder_ Anti-social personality disorder
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4713
Autism and Interaction Design...
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4714
Reasons for autism
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4715
Why Autism?_ communication_ socialisation_ imaginationdisorders.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4716
Different sets of SAPTs:Senses / Perceptions / Abilities / Thinking Systems
Stimulus > Sensation > Interpretation (perception) > Comprehension (Concept)
There are 2 ways to look at things;- non-autistic- and autistic way. “our task should be to understand the second.”
Autistic perception has been learned from;- testimonies of high-funtioning autistics- close observation of autistic children.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4717
Possible sensory autistic experience:(1) Literal perception (perceiving without interpretation)(2) Inability to distinguish fore/background(3) Hyper/Hypo sensitivity or white noise(4) Inconsistency of perception (flactuation)(5) Fragmented perception (6) Distorted perception(7) Sensory agnosia(8) Delayed perception(9) Vulnerability to sensory overload
Stimulus > Sensation > Interpretation (perception) > Comprehension (Concept)
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4718
Perceptual Styles:(1) mono processing(2) peripheral perception(3) system shutdown(4) compensating for unreliable sense(5) resonance
Stimulus > Sensation > Interpretation (perception) > Comprehension (Concept)
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4719
Cognitive Styles:(1) subconcious / un - pre concious cognition(2) preconscious VS. conscious style(3) attention(4) memory(5) concept formation(6) perceptual thinking(7) inertia (executive function def.)(8) imagination
Stimulus > Sensation > Interpretation (perception) > Comprehension (Concept)
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4720
Overload on visual and auditory sensory causes; - bending head down, - repetitive gestures, - cannot socialize, - cannot have eye contact. - throws into tantrum.
Unable to develop causality; - cannot sense the emotional states, - facial expressions, - actions within procedures.
Preoccupation to certain things.
Bad with time planning.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4721
Some individuals are good with - structural information processing- focusing to specific things.
This makes them potentially - good users of machines and technology.
They have - better visual perception than auditory - different types of autistics have different visual representation tendecies (objects, realistic image, realistic illustrations, text).
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4722
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4723
INDIVIDUAL with AUTISM
SURROUNDING without TECH.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4724
SURROUNDING with PEOPLE
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4725
SURROUNDING with PEOPLEand TECHNOLOGY
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4726
Study
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4727
Our research focus: everyday life problems of individuals with autism.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4728
We ran design workshops with interaction designers and autism experts
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4729
The insights gathered are presented next to designers of AUIs as targeted readership:
(R1) In most HCI uses, the environment “disables” the user. Human Factor research deals with the subject with an approach claiming that better interaction can be achieved by considering disabling environment factors.
(R2) Particular individuals with attention disorder are even more affected by distractors in their environment, even in their everyday life situations without using technology.
(R3) There are interactive assistive communication solutions for ASD individuals to help them with education. But not many of these studies try to find everyday life solu-tions.
(R4) These individuals are sometimes good with technology and mechanical abilities. Interactive technologies can make their life easier. This is also a valuable case study for interactive media design.
(R5) AUI is one paradigm that can help us build smart systems watching our needs and regulating the interaction in both disabled conditions and information bombard-ment situations.
(R6) DR is an emerging technique to optimize communication in HCI.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4730
Evaluating these requirements, the workshops generated a set of seven criteria (C1-C7):
(C1) ASD individuals have problems in perception and attention that leads to impair-ment in social communication. Assistive technologies can be used to optimize commu-nication in their everyday life.
(C2) They confront many distractors in their everyday life. Sometimes they dislike spe-cific colors, objects, or people. Filtering out irrelevant information might help with aug-menting attention.
(C3) They spend most of their time in classrooms, living rooms or in room-like offices and prefer sameness in environments. Therefore, the solution should help with organiz-ing the information in their space.
(C4) Autistics do not like attachments to their bodies. The solution should not be a pros-thetic solution like a head-mounted AR device but can be a see-through or reflecting plane.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4731
Evaluating these requirements, the workshops generated a set of seven criteria (C1-C7):
(C5) ASD individuals cannot understand mental states, facial expressions, abstract meanings of messages, or cause-effect relationships. Assistive technology can optimize these expressions and messages so that they can be perceived.
(C6) ASD individuals do not like eye contact with other people. The solution might help communication without the need for eye contact. It is preferable to stay away from gaze-contingent interaction techniques.
(C7) Different ASD individuals might have different perceptual abilities. For instance, some might be better than others with visual, auditory or verbal messages. Systems should support multi-modal communication abilities.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4732
Design Ideas Based on the Criteria
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4733
Not only technology, but information overload generallydistracts Individuals with Autism.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4734
Research question;
How can we change the world they sense
so that it doesn’t overload?
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4735
How about using a mirror like environment, which captures the room
and regulates the information to be presented.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4736
CAMERA
AUTISTIC 1 AUTISTIC 2
DIFFERENT AUTISTICSSEE WITH THEIR
REPRESENTATION TYPES
PROJECTOR
VIEW POINT
BACK PROJECTED TANGIBLE MIRROR
Mediated Reality Diminished Reality /We can make use of;
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4737
But how?Here in this paper, we explore ideas on how to use diminished reality with a mirror concept for improvedattention of autistic individuals.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4738
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4739
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4740
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4741
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4742
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4743
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4744
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4745
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4746
As a result of eight participatory design workshops,
we came up with some design solutions of
an interactive DR space with surfaces that filter out irrelevant visual data
present in the environment before it reaches the eye, or augmenting the
surroundings by projecting assistive information onto different types of sur-
faces.
We are now working on building the prototype of this system.
29.09.15 _ IWDR2015 _ Fukuoka, Japan / 4747
Thanks for your interest.Asım Evren Yantaç / [email protected] Çorlu / [email protected] Fjeld / [email protected] Kunz / [email protected]