Embed Size (px)
DESCRIPTION
Nuclei is an interactive table application concept
Citation preview
A tangible interaction project byAlexander Morosow and Valeria Querini
THE CHALLENGE
OUR PROCESS
BRAINSTORMING
RESEARCHAND INSPIRATIONS
THE CONCEPT
CONVERSATIONS AS NUCLEI
CONTEXT
TECHNOLOGY
PROTOTYPE EVOLUTION
THE FINAL RESULT
1
2
4
7
14
16
18
21
25
37
INDEX
Nuclei was ideated and developed during the 2013/2014 edition of the Tangible Interaction Research course at BTK.
Our goal was to come up with a design based on the idea of “the beauty of waiting”.
THE CHALLENGE 1
OUR PROCESS 2
We approached the task with a media neutral vision of the problem, extensively researching the subject.
Since we consider the aestethic and informational dimensions to be equally important in our design, we focused our efforts in both directions.
OUR PROCESS 3
BRAINSTORMING 4
Waiting
Invisible Design
Psychology
Emotions
Social Science Group Dynamics
Biofeedback
Experience Design
Interior DesignAdaptive Lighting
Sound Design
Interactive FurnitureSpeech Recognition
Passive Interaction
Our initial brainstorming session touched various fields and subjects, we then focused on waiting situations set in different spaces and on the activities that people carry out in those contexts.
BRAINSTORMING 5
5 Senses
FingerS
Smooth / SoFt
ComFort
experienCeobServe
Looking gLaSS
See
FeeL
touCh
grip
hand
SaFety
outSide
exCLuded
hidden
not moving
Stagnation
moving
Queue
boredom
LighthouSe paSSion
media
ConSuming
advertS
interaCtionmovieS
SoundtraCkS
muSiCaL inStrumentS
JazzWaiting Loop
paSSive
gameS
entertainment
media
meta
WorrieS
Fear
SiLenCe
ConverSation
reLaxed
LoSt
“Where am i?“
path
guiding
Light
meditation
reFLeCtion
death
Waiting
BRAINSTORMING 6
7RESEARCH AND INSPIRATIONS
During the research phase we looked at academic investigations of the topic and considered already existing designs in both the experimental and commercial realm.
We also researched the possibilities of existing and developing speech recognition technologies to indentify the ideal way to implement our concept.
RESEARCH AND INSPIRATIONS 8
MIND BROWSER - Kim Haagenhttps://vimeo.com/76508027
9RESEARCH AND INSPIRATIONS
Re:MARK - Golan Levin & Zachary Liebermanhttp://www.flong.com/projects/remark/
10RESEARCH AND INSPIRATIONS
HIDDEN WORLDS OF VOICE AND NOISE- Golan Levin & Zachary Liebermanhttp://www.flong.com/projects/hwnv/
11RESEARCH AND INSPIRATIONS
REFLECT - Khaled Bachour http://www.computer.org/csdl/trans/lt/2010/03/tlt2010030203.html
12RESEARCH AND INSPIRATIONS
SKYPE VISUALIZATION - Onformativehttps://www.prote.in/en/feed/2011/06/conversation-visualization
13RESEARCH AND INSPIRATIONS
The concept beyond Nuclei comes from an interest we developed in exploring how conversations emerge during the waiting time as actions that become possible in the land of “in-between” created by the waiting moment.
This project is meant to contrast the intagibility and transience of oral language, giving further meaning to human social interactions.
THE CONCEPT 14
THE CONCEPT 15
The design of Nuclei features two levels of interactions: a passive one and an active one.
The passive interaction level is carachterized by an aestethic approach and the display of basic informations. It consists in the generative visualization of current conversations.
The active interaction level allows a deeper eploration of the informations and consists in the possibility to expand the visualization and generate further associations by retrieving data from external sources.
16CONVERSATIONS AS NUCLEI
We explored different design solutions to represent on the screen how conversations are generated and how they exist in space and influence each other.Ultimately we came up with the idea of thinking about conversations as composed by nuclei of meaning around which the single parts of speech spin around.
CONVERSATIONS AS NUCLEI 17
CONTEXT 18
Nuclei is an application that can be run on a variety of devices but is especially thought for touch devices that are situated in a particular physical and social space and that allow a multi-user experience.
The contexts in which it could be implemented include (but are not restricted to):
• Hotels halls• Museums• Conferences• Cafès• Exhibitions
CONTEXT 19
CONTEXT 20
TECHNOLOGY 21
credits: multitouch | www.instructables.com
The Nuclei prototype was developed to show a possible implementation of our ideas in a functional environment.Processing was used as the prototyping framework. http://processing.org
The prototype was presented at “In Bewegung” in February 2014.http://www.btk-fh.de/in-bewegung-14
TECHNOLOGY 22
TECHNOLOGY 23
Spoken word Microphone
Word
Word noun
Speech to Text (Google Speech)
Natural Language Processingwith Apache OpenNLP
The words rotate around nuclei, during which they are being processed.The diagram on the right shows the steps for each individual word.
After some time, the words collapse -
On touch these collapsed items open and display content.
Wordnoun
Wikipedia ContentAND
Wiktionary Definition
Touch
Query to wikipedia.org to get the first line of an associated articleANDRetrieve definition of the word from a wiktionary database via JWKTL
Resources
TECHNOLOGY 24
Processing 2………………………… processing.org
Toxiclibs …………………………… toxiclibs.org
Simple Multi-Touch Toolkit ……… vialab.science.uoit.ca/SMT/
STT …………………………………… stt.getflourish.com
Apache OpenNLP ………………… opennlp.apache.org
JWKTL ……………………………… www.ukp.tu-darmstadt.de/software/jwktl/
Gson ………………………………… code.google.com/p/google-gson/
jsoup ………………………………… http://jsoup.org
Mediawiki API …………………… www.mediawiki.org/wiki/API:Main_page
PROTOTYPE EVOLUTION 25
26PROTOTYPE EVOLUTION
27PROTOTYPE EVOLUTION
28PROTOTYPE EVOLUTION
29PROTOTYPE EVOLUTION
30PROTOTYPE EVOLUTION
31PROTOTYPE EVOLUTION
32PROTOTYPE EVOLUTION
33PROTOTYPE EVOLUTION
34PROTOTYPE EVOLUTION
35PROTOTYPE EVOLUTION
36PROTOTYPE EVOLUTION
A working prototype of Nuclei was presented in February 2014 during “In Bewegung 2” an interaction design exhibition organized by BTK in Berlin.
THE FINAL RESULT 37
Alexander MorosowInteraction [email protected]
Valeria QueriniCommunication [email protected]
Start a conversation with us:
Thanks for watching!
