¿Gestos Universales para Controlar Equipos Electrónicos? Un estudio en 18 paises

¿Gestos universales para controlar equipos electrónicos? Un estudio en 18 países.

Gonzalo J. Auza y Nicolás JaureguiberryUX2013 – Jornada Académica - Buenos Aires 3 de diciembre de 2013

Consultora de UX con base en Buenos Aires. Fundada en 2005. Diseñamos servicios, productos y estrategias centrados en la

persona. Nos especializamos en:

Design Thinking Diseño de Experiencia de Usuario Diseño Centrado en el Usuario Co-creación User driven innovation

Diseño | Investigación | Consultoría | Capacitación Miembros de UX Fellows

Introducing UX Fellows

● Worldwide user experience research● 25 partner companies ● Joint quality levels and processes ● UX expertise + local culture expertise

High quality UX research in 35+ countries

Gesture technology is entering our lives

What is a gesture?

What kind of gestures are we interesting in?

Let’s play a game…


Say hello…


Say hello…Goodbye…


Say hello…Goodbye…That door…


Say hello…Goodbye…That door…Email me later…


Say hello…Goodbye…That door…Email me later…Move the chair near to the door…

Pointing gestures

Semantic gestures

● Gestures with an associated meaning● No need for an additional GUI● Potentially more efficient

Challenges● Presumably influenced by local cultures● Some cultures might be more predisposed to the use of

gestures than othersSemantic gesture for mission control on a Mac

The UX Fellows Gesture Study (video)

The UX Fellows Gesture Study

Which semantic gestures would people from various cultures spontaneously use to control consumer electronic devices?

● Country differences?● Country clusters?● Underlying metaphors?● Acceptance?

We compared spontaneous gesture behavior in 18 countries.

RU

CN

IN

AUAR

CA

US

MX

ESFR

UK

IT

FI

DENLBE

KRTR

Setting 15 min Warm-up: everyday gestures

Examined Commands

Switch on deviceVolume upChannel upContext info for current programChannel downShare current programVolume downMute volumePause current programHomepageEPG

backward navigation in menusConfirm on-screen dialog (OK)Deny on-screen dialog (cancel)Pause video-on-demand (VOD)Restart VODFast forward VODRewind VODSkip chapter VODPrevious chapter VODStop VODSwitch off device

P+

P-

Sample

Persons who are able to imagine a gesture-control scenario for a TV.

● Regular usage of a recent HD flat TV (max. 5-6 years of age) and other CE devices and services

● High interest in consumer electronics● Regular usage of a touch device● No Xbox Kinect and gesture-enabled TV users● Potential buyers of international "premium" CE brands

(no national, retailer or "no name" brands)

Sample

sample

soci

o-ec

onom

icba

ckgr

ound

country

Sample

51%49%

16

65 years

32

18 countries x 20 subjects = 360 participants

min

max

mean

The Results

Elaboration

Commonality of gestures

Volume down

Volume up

Pause

VOD

Pause

curre

nt program

Rewind VOD

Confirm on-sc

reen dialog (OK)

Fast f

orward

VOD

Channel u

p

Stop VOD

Channel d

own

Mute volume

Backward

s navig

ation in

menus

Deny on-screen dial

og (cance

l)

Skip ch

apter VOD

Switc

h on device

Previous c

hapter V

OD

Restart

VOD

Switc

h off device

Share cu

rrent p

rogra

m EPG

Context in

fo for c

urrent p

rogra

m

Homepage

02468

1012141618

no. of countries with the same main gesture

no. o

f cou

ntrie

s

high medium low

Commands with high commonality

Volume downVolume upPause VODPause current programRewind VODFast forward VODConfirm on-screen dialog (OK)



Commonality 18 of 18

Difficulty (1-5) 1.8

Q: How do you turn down the volume?





Q: How do you turn up the volume?





NL

Q: How do you pause viewing a film?





NL

Q: How would you pause the current TV program?





AU, UK

NL

Q: How do you rewind? (with an image being shown)



AU, UK

NL

Q: You are watching a boring scene, how do you fast-forward (with an image being shown)?







CN, IT, KR

Q: You have chosen a film from an online video library. The TV asks you "do you really want to buy the film?" How do you answer "yes"?

Commands with medium commonality

Channel upChannel downStop VOD Mute volumebackward navigation in menusDeny on-screen dialog (cancel)Skip chapter VOD



P+

AU, ES, KR, US

CA

Q: You are zapping through the TV programs: How do you change from channel 15 to channel 16 for example?





AU, ES, KR, UK, US

CA

P-

Q: You are zapping through the TV programs: How do you change from channel 16 to channel 15 for example?





CN, KR

FI, RU

NLQ: How would you stop watching the film altogether (because you want to do something different)?





AU, CN, MX

BE

UK

FI, RU

Q: How do you set the volume to "mute"?




Channel upChannel downStop VOD Mute volumeBackward navigation in menusDeny on-screen dialog (cancel)Skip chapter VOD

AU, BE, CA

AR, RU

ES, MX, US

Q: Imagine that you were looking for a film in an online video library. You have gone to the comedies section and have chosen the description of a single movie. Now you want to return to the previous set of options (all of the comedies). Which gesture would you use for that?





AU, CN, RU, TR

KR

AR, BE, IT, MX

Q: How do you express that you don’t want to buy it?

Commonality 9 of 18




BE, CN, ES, FI, FR, IN, MX, UK

NL

Q: How would you skip to the next chapter of the film?

Commonality 9 of 18


Commands with low commonality

Switch on deviceSwitch off devicePrevious chapter VODRestart VODShare current programEPGContext info for current programHomepage



BE, FR, US

KR

DE, IT

TR

CNCA

FI

Q: How would you switch on the TV?

Commonality 8 of 18




ES, MX, NL

CA

IN, KR

RU

AR TRQ: How would you switch off the TV? Note: No common gesture in Italy

Commonality 7 of 18




BE, CN, ES, FI, FR, MX, NL

UK

IN, USQ: How would you return to the previous chapter of the film?

Commonality 8 of 18




AU, ES, KR, MX AR, DE

BE

NL RU

USQ: How do you start it (film) again? Note: No common gesture in UK

Commonality 7 of 18




CN, FR, IN

FI

AR, TR

MX

NL

KR

RU

USQ: How would you share with your friends what you are currently watching or listening to? Note: No common gesture in UK

Commonality 6 of 18




AU, US CN, FI, IN, KR, RU

BE, UK TRNL

MX

Q: You'd like to see an overview of tonight's TV programs of the main channels (EPG). How do you activate this function with a hand gesture? Note: No common gesture in Italy

Commonality 5 of 18




FR, KR, RU

AU, FI

CN, IN, TR

AR

DE

BE

ES US

UKQ: How would you get more information for the running TV program?

Commonality 4 of 18




AR, AU, MX

DENL, UK

FI

BE, IN

US

CA, ES, TR

Q: Now you want to go to the initial set of options - that means the first options you see when you switch on the device.Note: No common gesture in Italy

Commonality 4 of 18


Direct vs. abstract gestures

We observed two kinds of gestures.

● "Direct" gestures o strongly influenced by touch devices

● Abstract gestures o basis in language, iconography and metaphorso associated with more complex taskso lower intercultural commonality

Some general insights

Average gesture difficulty by country

TR FR MX AR IN FI CN RU NL DE AU US BE ES CA IT KR UK1.0

1.5

2.0

2.5

3.0

Everyday gestures CE gestures

diffi

culty

min

max 5,0…

Average gesture difficulty by country

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR1.0

1.5

2.0

2.5

3.0

CE gestures

diffi

culty

min

max 5,0…

Gesture difficulty by countries

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KRVolume down

Pause VODChannel down

Rewind VODVolume up

Deny on-screen dialog (cancel)Channel up

Confirm on-screen dialog (OK)Switch off device

Fast forward VODSwitch on device

Restart VODMute volume

Previous chapter VODPause current program

Stop VOD Skip chapter VOD

backward navigation in menus

Context info for current programEPG

HomepageShare current program

Gesture difficulty by countries

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Mean

Volume down 1.2 1.2 1.3 1.6 1.3 1.1 1.3 1.6 1.3 1.4 1.6 1.5 1.5 1.6 1.0 1.5 2.2 2.2 1.5

Pause VOD 1.3 1.5 1.1 1.3 1.1 1.3 1.6 1.2 1.5 1.4 1.4 1.7 1.5 1.4 1.7 1.5 2.2 2.9 1.5

Channel down 1.1 1.4 1.5 1.4 1.4 1.1 1.5 1.7 1.7 2.0 1.8 1.8 1.6 1.8 1.0 1.6 2.3 2.1 1.6

Rewind VOD 1.0 1.6 1.3 1.8 1.8 1.8 1.3 1.8 1.6 1.4 1.5 2.0 1.5 2.5 1.2 2.0 2.4 2.5 1.7

Volume up 1.4 1.8 1.8 1.4 1.3 1.6 1.3 1.9 1.4 1.9 1.6 1.6 1.9 2.0 1.9 2.2 2.5 2.3 1.8

Deny on-screen dialog (cancel) 1.3 1.8 2.1 1.3 1.2 1.7 1.3 1.5 1.6 1.5 1.7 1.8 1.8 2.4 2.6 1.9 2.5 2.5 1.8

Channel up 1.2 1.5 1.5 1.7 1.5 1.8 1.5 2.1 1.8 2.0 2.2 1.7 2.4 1.8 1.4 2.2 2.5 2.2 1.8

Confirm on-screen dialog (OK) 1.7 2.1 2.2 1.3 1.8 1.8 1.3 1.5 1.7 2.1 1.8 2.1 2.1 1.4 2.4 1.9 2.3 2.3 1.9

Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9

Fast forward VOD 1.9 1.6 1.5 2.1 1.8 2.0 1.4 1.7 1.6 1.6 1.8 2.1 1.7 2.1 2.3 2.2 2.6 2.5 1.9

Switch on device 2.1 1.3 1.4 1.7 1.4 1.6 2.2 1.4 1.9 2.0 2.1 1.9 2.4 2.7 2.5 1.9 2.3 2.6 2.0

Restart VOD 1.8 1.5 1.7 1.9 1.5 1.9 1.6 1.6 2.1 1.4 2.5 1.7 1.9 2.4 2.7 2.1 2.5 3.0 2.0

Mute volume 1.4 1.7 1.3 1.5 1.7 1.8 2.3 1.8 1.7 2.1 1.9 2.2 2.4 2.5 2.4 2.4 2.0 2.7 2.0

Previous chapter VOD 1.0 1.7 1.7 1.7 2.2 1.8 1.4 2.0 2.1 1.7 1.8 2.0 2.0 2.3 1.3 3.0 2.7 3.3 2.0

Pause current program 2.1 1.6 1.5 1.7 1.4 1.7 2.5 1.6 1.9 2.2 2.0 2.2 2.1 2.2 2.6 2.4 2.2 3.1 2.0

Stop VOD 2.3 1.9 2.3 1.7 2.0 1.7 1.3 1.4 2.0 1.9 1.9 2.1 2.0 2.1 2.8 2.2 2.4 3.3 2.1

Skip chapter VOD 1.7 1.7 1.7 2.1 2.3 2.1 1.4 2.1 2.3 2.0 2.2 2.1 2.6 2.8 1.6 2.9 3.1 3.4 2.2

backward navigation in menus 1.4 2.1 2.1 1.9 2.5 2.0 1.3 2.3 2.5 2.1 2.7 2.3 2.2 2.2 3.6 2.9 2.2 3.4 2.3

Context info for current program 2.7 2.3 2.5 2.2 2.5 2.4 2.6 3.1 2.4 2.8 2.7 2.5 3.2 2.9 3.2 3.4 3.8 3.2 2.8

EPG 2.4 2.2 2.6 2.4 2.8 3.5 3.7 2.4 2.4 2.6 2.7 2.9 2.9 2.7 3.2 3.2 3.0 3.9 2.8

Homepage 3.7 2.2 2.3 2.2 2.7 2.4 3.8 3.1 2.0 2.9 2.7 3.0 3.0 3.3 3.7 3.4 3.3 3.7 2.9

Share current program 2.4 2.1 1.9 2.4 3.3 2.4 3.9 2.9 3.4 3.5 3.8 3.7 4.2 2.6 4.2 3.8 4.5 3.2 3.2

Mean 1.7 1.7 1.7 1.8 1.9 1.9 1.9 1.9 1.9 2.0 2.1 2.1 2.2 2.3 2.3 2.4 2.6 2.8

General acceptance

● Our 360 tech-savvy participants responded very positively to the idea of semantic gesture input for TVs.

"fun to use", "convenient", "coolness factor"● Participants would like to use gestures to control other

devices as well (e.g. audio).

Operation

Many participants felt that voice and sound could be a good support for gesture input.

waking up the device with a sound

Can the TV hear me?

Gesture type preference

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR

Semantic

PointingMany users would prefer switching between gesture types.

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ

Semantic 15

Pointing

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ

Semantic 15

Pointing 9associated with more advanced

commands

Typical concerns of users

● Learning and retention of gestures (but: would be easy if based on implicit behavior repertory)

● Sensitivity and accuracy of devices● Interference by other gestures in the room● Compatibility with lean-back disposition

Conclusions

Conclusions

1. For basic CE commands a common language for semantic gestures already exists across cultures.

2. More complex commands could be realized by either

a. customizing these gestures for each individual market

b. customizing individually

c. proposing a set of semantic gestures that need to be learned (the study provides some suggestions)

d. switching to pointing gestures in combination with a GUI

3. It is necessary to consider cultural differences at a country level when it comes to designing advanced gesture control for globally marketed devices.

Download complete reports: www.uxfellows.com Find us: [email protected]

[email protected]

Thumbs up to the audience!

http://www.uxfellows.com/

Pueden bajar todas las conclusiones en: www.uxfellows.com Pueden: [email protected]

[email protected]

Thumbs up to the audience!

http://www.uxfellows.com/

Technology

¿Gestos Universales para Controlar Equipos Electrónicos? Un estudio en 18 paises