tangible interaction - LTH · Tangible Interaction Perspectives Hornecker and Buur(2006) 1. tangibility and materiality 2. physical embodiment of data 3. bodily interaction 4. embeddednessin

2016-04-06

1

Tangible InteractionAVANCERAD INTERAKTIONSDESIGN

Héctor CaltencoCertec, Inst. för Designvetenskaper, [email protected]

Agenda

Héctor Caltenco, Avd. för Rehabiliteringsteknik, Designvetenskaper2016-04-06 2

• “Tangible” Senses• Tangible Interaction• TI Perspectives (4)

• Video Examples (3x4)

• Physical computing• Prototyping (4)• Arduino

• Mobile Device Interaction• Beyond the Mobile Device

• Wearables• Wearable Application Areas• Prototyping Wearables

• Video Examples

2016-04-06

2

The ”Tangible” Senses

Somatosensory• Touch• Temperature• Proprioception• Nociception

Motor• Movement• Skill (gross, fine)• Control (feedback, coordination, reflex)


Tangible Interaction & Tangible User Interfaces


2016-04-06

3

Tangible Interaction PerspectivesHornecker and Buur (2006)

1. tangibility and materiality 2. physical embodiment of data3. bodily interaction4. embeddedness in real spaces

and contexts.


1. Tangibility and Materiality• Materiality of digital artifacts• Tactile qualities, but also other

“sensory” qualities• Audio/visual à Multi-sensory Uis• Exploratory• “Graspability”• Material, physical and social


2016-04-06

4

1.1 TangibilityShape/stiffness changing

2016-04-06 Héctor Caltenco, Avd. för Rehabiliteringsteknik, Designvetenskaper 7

• LineFORM– https://vimeo.com/161292317

• HydroMorph– https://vimeo.com/144931231

•

2. Embodiment of Data


• Physically embodied• Digital information in

physical representation• Physical artifacts or

environments

• graspables

2016-04-06

5

2.1 EmbodimentRipple


2.2 EmbodimentPhysical represetation of data

• Tangible answering machine– https://vimeo.com/19930744

• Playing with media– https://vimeo.com/6698128

• Music

– https://vimeo.com/24362286– http://www.youtube.com/v/0h-RhyopUmc


2016-04-06

6

3. Whole-body Interaction

• Gestural control• Movement• Use of own body to

transfer digital information


3.2 Whole-bodySID Project

• WaterBed https://vimeo.com/120150511• ActiveCourtain https://vimeo.com/120140951• HugBag https://vimeo.com/113388775• Musii https://vimeo.com/84153017• Helium Crayon (potential)

• https://www.facebook.com/thisisinsiderdesign/videos/243802912628012/


2016-04-06

7

4. Embeddedness in Real Spaces and Contexts

• Focus on interaction• Social / collaboration• Education / rehabilitation


4.1 Embeddedness in Real Contexts

• LineFORM– https://vimeo.com/144931231

• Physical Telepresence– https://vimeo.com/108402837

• Tangible programming / education

– https://youtu.be/yBJWKbv589Q


2016-04-06

8

4.2 Embeddedness... Rehabilitation


4.2 Embededdness in Real ContextContext-aware interfaces

Combine digital world with natural behavior of touch• Open hotel door by grabbing handle• Purchase by touching cashier• Exchange buisness cards• Pairing by wearing

• Print by touching printer


2016-04-06

9

Physical computing

Interactive physical systems that sense and respond to physical world• Automatic traffic control• Interactive factory automation• Interactive museums

• Smart home appliances• Gaming• …


Prototyping Physical computing

1. Sensousness (input and feedback)2. Graduality (More than a button?)3. Tightness (Where and when?)4. Behavior and adaptation


2016-04-06

10

Physical computing:Sensousness


Physical computingGraduality

• More than a button?• How much?• Weak vs Strong (On/off vs

Gradual)• Both: Input and output response


2016-04-06

11

Physical computingTightness

• Where

• When


Physical computingBehaviour and Adaptation

Predictability and randomness– Too predictable à boring

– Too random à confusing

Over-time adaptation

Mood– Does it get tired?

– Does it get angry?


2016-04-06

12

Physical computing withArduino

• Open hardware/software• Sensors à [] à Actuators• World-wide community• 3rd party ”Shields” and

libraries

• Simple


Interaction with Mobile Devices


2016-04-06

13

Mobile device contextInteraction Around the Tablet

• Portico– https://vimeo.com/29359319


Mobile device contextBeyond the device


2016-04-06

14

Mobile device contextArduino ADK Demo

• https://youtu.be/PS7Iwp1FUVw


Wearables

2016-04-06 28

Why do bodies matter?

2016-04-06

15

Wearables• Watches• Armbands• Clothes• Hats• Glasses

• Jewelry

2016-04-06 Héctor Caltenco, Avd. för Rehabiliteringsteknik, Designvetenskaper 29

Weareable Application Areas• Sensory integration• Health monitoring• Communication

tools• Augmented reality

• Networking• Context sensing


2016-04-06

16

Wearable gestural interface

• Increasing number of wearable cameras…• SixthSense

– http://youtu.be/ZfV4R4x2SK0


Prototyping Wearables withArduino Lilypad

Arduino for wearables• Small• Can be sewn• Conductive thread• Lilypad sensors & actuators


2016-04-06

17

Wearable MIDI Controller

• DJ jacket– https://youtu.be/yJt0NMxhweo

• Remidi– https://youtu.be/IKBHI1WTCiM


Wearable: Bands and Gloves

• Secret Handshake– http://vimeo.com/7742617

• Myo Armband– https://youtu.be/te1RBQQlHz4

• Cicret Bracelet

– https://youtu.be/9J7GpVQCfms


2016-04-06

18

Wearables… BiohackingNFC implant

– Identification

– Access

– Payment– https://vimeo.com/78136289

– http://www.bionyfiken.se/biohacking-i-media/


Documents

tangible interaction - LTH · Tangible Interaction Perspectives Hornecker and Buur(2006) 1. tangibility and materiality 2. physical embodiment of data 3. bodily interaction 4. embeddednessin