¿Gestos universales para controlar equipos electrónicos? Una investigación en 18 países

¿Gestos universales para controlar equipos electrónicos? Un estudio en 18 países.

Diseñamos servicios, productos y estrategias centrados en la persona. Design Thinking | Human-‐Centered InnovaHon User Experience (UX) | Customer Experience (CX)

§  Pioneros en UX e innovación en ArgenHna y LaHnoamérica. §  +10 años de acHvidad. §  Diseño | InvesHgación | Consultoría | Capacitación

● Worldwide user experience research ● 27 partner companies ● Joint quality levels and processes ● UX experHse + local culture experHse ● UX Research in 35+ countries

What is a gesture? What kind of gestures are we interesHng in?

Let’s play a game…

Please say: Hello…

Please say: Hello… Goodbye…

Please say: Hello… Goodbye… That door…

Please say: Hello… Goodbye… That door… This chair

Please say: Hello… Goodbye… That door… This chair… Put this chair near the door…

Please say: Hello… Goodbye… That door… This chair… Put this chair near the door… Email me later…

Please say: Hello… Goodbye… That door… This chair… Put this chair near the door… Email me later… Take a picture to this guy

Please say: Hello… Goodbye… That door… This chair… Put this chair near the door… Email me later… Take a picture to this guy Share this image in Facebook…

Gesture technology is entering our lives

Touch gestures

PoinHng gestures

SemanHc gestures

●  Gestures with an associated meaning ●  No need for an addiHonal GUI ●  PotenHally more efficient

Challenges ●  Presumably influenced by local cultures ●  Some cultures might be more predisposed to the use of

gestures than others SemanHc gesture for mission control on a Mac

The UX Fellows Gesture Study

Which seman8c gestures would people from various cultures spontaneously use to control consumer electronic devices?

●  Country differences? ●  Country clusters? ●  Underlying metaphors? ●  Acceptance?

We compared spontaneous gesture behavior in 18 countries.

RU

CN

IN

AU AR

CA

US

MX

ES FR

UK

IT

FI

DE NL BE

KR TR

The UX Fellows Gesture Study (video)

Seing 15 min Warm-‐up: everyday gestures

Examined Commands

Switch on device Volume up Channel up Context info for current program Channel down Share current program Volume down Mute volume Pause current program Homepage EPG

backward navigaHon in menus Confirm on-‐screen dialog (OK) Deny on-‐screen dialog (cancel) Pause video-‐on-‐demand (VOD) Restart VOD Fast forward VOD Rewind VOD Skip chapter VOD Previous chapter VOD Stop VOD Switch off device

P+

P-‐

Sample

Persons who are able to imagine a gesture-‐control scenario for a TV. ●  Regular usage of a recent HD flat TV (max. 5-‐6 years of age) and

other CE devices and services ●  High interest in consumer electronics ●  Regular usage of a touch device ●  No Xbox Kinect and gesture-‐enabled TV users ●  PotenHal buyers of interna8onal "premium" CE brands

(no naHonal, retailer or "no name" brands)

Sample

sample

socio-‐econ

omic

backgrou

nd

country

Sample

51% 49%

16

65 years

32

18 countries x 20 subjects = 360 par8cipants

min

max

mean

The Results

ElaboraHon

Difficulty of TV-‐related gestures

1,0

1,5

2,0

2,5

3,0

3,5

Self-‐reported difficulty, 5 = very difficult, 1 = very easy, n = 360 tech-‐savvy CE consumers in 18 countries

difficulty

Commonality of gestures

0 2 4 6 8 10 12 14 16 18

no. of countries with the same main gesture

no. of cou

ntrie

s

high medium low

Commands with high commonality

Volume down Volume up Pause VOD Pause current program Rewind VOD Fast forward VOD Confirm on-‐screen dialog (OK)



Commonality 18 of 18

Difficulty (1-‐5) 1.8

Q: How do you turn down the volume?





Q: How do you turn up the volume?





NL

Q: How do you pause viewing a film?





NL

Q: How would you pause the current TV program?





AU, UK

NL

Q: How do you rewind? (with an image being shown)



AU, UK

NL

Q: You are watching a boring scene, how do you fast-‐forward (with an image being shown)?







CN, IT, KR

Q: You have chosen a film from an online video library. The TV asks you "do you really want to buy the film?" How do you answer "yes"?

Commands with medium commonality

Channel up Channel down Stop VOD Mute volume backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD



P+

AU, ES, KR, US

CA

Q: You are zapping through the TV programs: How do you change from channel 15 to channel 16 for example?





AU, ES, KR, UK, US

CA

P-‐

Q: You are zapping through the TV programs: How do you change from channel 16 to channel 15 for example?





CN, KR

FI, RU

NL Q: How would you stop watching the film altogether (because you want to do something different)?





AU, CN, MX

BE

UK

FI, RU

Q: How do you set the volume to "mute"?




Channel up Channel down Stop VOD Mute volume Backward navigaHon in menus Deny on-‐screen dialog (cancel) Skip chapter VOD

AU, BE, CA

AR, RU

ES, MX, US

Q: Imagine that you were looking for a film in an online video library. You have gone to the comedies secHon and have chosen the descripHon of a single movie. Now you want to return to the previous set of opHons (all of the comedies). Which gesture would you use for that?





AU, CN, RU, TR

KR

AR, BE, IT, MX

Q: How do you express that you don’t want to buy it?

Commonality 9 of 18




BE, CN, ES, FI, FR, IN, MX, UK

NL

Q: How would you skip to the next chapter of the film?

Commonality 9 of 18


Commands with low commonality

Switch on device Switch off device Previous chapter VOD Restart VOD Share current program EPG Context info for current program Homepage



BE, FR, US

KR

DE, IT

TR

CN CA

FI

Q: How would you switch on the TV?

Commonality 8 of 18




ES, MX, NL

CA

IN, KR

RU

AR TR Q: How would you switch off the TV? Note: No common gesture in Italy

Commonality 7 of 18




BE, CN, ES, FI, FR, MX, NL

UK

IN, US Q: How would you return to the previous chapter of the film?

Commonality 8 of 18




AU, ES, KR, MX AR, DE

BE

NL RU

US Q: How do you start it (film) again? Note: No common gesture in UK

Commonality 7 of 18




CN, FR, IN

FI

AR, TR

MX

NL

KR

RU

US Q: How would you share with your friends what you are currently watching or listening to? Note: No common gesture in UK

Commonality 6 of 18




AU, US CN, FI, IN, KR, RU

BE, UK TR NL

MX

Q: You'd like to see an overview of tonight's TV programs of the main channels (EPG). How do you acHvate this funcHon with a hand gesture? Note: No common gesture in Italy

Commonality 5 of 18




FR, KR, RU

AU, FI

CN, IN, TR

AR

DE

BE

ES US

UK

Q: How would you get more informaHon for the running TV program?

Commonality 4 of 18




AR, AU, MX

DE NL, UK

FI

BE, IN

US

CA, ES, TR

Q: Now you want to go to the iniHal set of opHons -‐ that means the first opHons you see when you switch on the device. Note: No common gesture in Italy

Commonality 4 of 18


Direct vs. abstract gestures

We observed two kinds of gestures. ●  "Direct" gestures

o  strongly influenced by touch devices

●  Abstract gestures o  basis in language, iconography and metaphors o  associated with more complex tasks o  lower intercultural commonality

Some general insights

Average gesture difficulty by country

1,0

1,5

2,0

2,5

3,0

TR FR MX AR IN FI CN RU NL DE AU US BE ES CA IT KR UK

Everyday gestures CE gestures

difficulty

min

max 5,0 …

Average gesture difficulty by country

1,0

1,5

2,0

2,5

3,0

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR

CE gestures

difficulty

min

max 5,0 …

Gesture difficulty by countries

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Volume down

Pause VOD Channel down Rewind VOD Volume up

Deny on-‐screen dialog (cancel) Channel up

Confirm on-‐screen dialog (OK) Switch off device Fast forward VOD Switch on device

Restart VOD Mute volume

Previous chapter VOD Pause current program

Stop VOD Skip chapter VOD

backward navigaHon in menus

Context info for current program EPG

Homepage Share current program

Gesture difficulty by countries

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Mean

Volume down 1.2 1.2 1.3 1.6 1.3 1.1 1.3 1.6 1.3 1.4 1.6 1.5 1.5 1.6 1.0 1.5 2.2 2.2 1.5

Pause VOD 1.3 1.5 1.1 1.3 1.1 1.3 1.6 1.2 1.5 1.4 1.4 1.7 1.5 1.4 1.7 1.5 2.2 2.9 1.5

Channel down 1.1 1.4 1.5 1.4 1.4 1.1 1.5 1.7 1.7 2.0 1.8 1.8 1.6 1.8 1.0 1.6 2.3 2.1 1.6

Rewind VOD 1.0 1.6 1.3 1.8 1.8 1.8 1.3 1.8 1.6 1.4 1.5 2.0 1.5 2.5 1.2 2.0 2.4 2.5 1.7

Volume up 1.4 1.8 1.8 1.4 1.3 1.6 1.3 1.9 1.4 1.9 1.6 1.6 1.9 2.0 1.9 2.2 2.5 2.3 1.8

Deny on-‐screen dialog (cancel) 1.3 1.8 2.1 1.3 1.2 1.7 1.3 1.5 1.6 1.5 1.7 1.8 1.8 2.4 2.6 1.9 2.5 2.5 1.8

Channel up 1.2 1.5 1.5 1.7 1.5 1.8 1.5 2.1 1.8 2.0 2.2 1.7 2.4 1.8 1.4 2.2 2.5 2.2 1.8

Confirm on-‐screen dialog (OK) 1.7 2.1 2.2 1.3 1.8 1.8 1.3 1.5 1.7 2.1 1.8 2.1 2.1 1.4 2.4 1.9 2.3 2.3 1.9

Switch off device 1.5 1.9 1.1 1.9 1.5 2.3 1.6 1.8 2.0 2.0 1.6 2.1 2.2 2.0 2.3 2.0 2.2 2.4 1.9

Fast forward VOD 1.9 1.6 1.5 2.1 1.8 2.0 1.4 1.7 1.6 1.6 1.8 2.1 1.7 2.1 2.3 2.2 2.6 2.5 1.9

Switch on device 2.1 1.3 1.4 1.7 1.4 1.6 2.2 1.4 1.9 2.0 2.1 1.9 2.4 2.7 2.5 1.9 2.3 2.6 2.0

Restart VOD 1.8 1.5 1.7 1.9 1.5 1.9 1.6 1.6 2.1 1.4 2.5 1.7 1.9 2.4 2.7 2.1 2.5 3.0 2.0

Mute volume 1.4 1.7 1.3 1.5 1.7 1.8 2.3 1.8 1.7 2.1 1.9 2.2 2.4 2.5 2.4 2.4 2.0 2.7 2.0

Previous chapter VOD 1.0 1.7 1.7 1.7 2.2 1.8 1.4 2.0 2.1 1.7 1.8 2.0 2.0 2.3 1.3 3.0 2.7 3.3 2.0

Pause current program 2.1 1.6 1.5 1.7 1.4 1.7 2.5 1.6 1.9 2.2 2.0 2.2 2.1 2.2 2.6 2.4 2.2 3.1 2.0

Stop VOD 2.3 1.9 2.3 1.7 2.0 1.7 1.3 1.4 2.0 1.9 1.9 2.1 2.0 2.1 2.8 2.2 2.4 3.3 2.1

Skip chapter VOD 1.7 1.7 1.7 2.1 2.3 2.1 1.4 2.1 2.3 2.0 2.2 2.1 2.6 2.8 1.6 2.9 3.1 3.4 2.2

backward navigaHon in menus 1.4 2.1 2.1 1.9 2.5 2.0 1.3 2.3 2.5 2.1 2.7 2.3 2.2 2.2 3.6 2.9 2.2 3.4 2.3

Context info for current program 2.7 2.3 2.5 2.2 2.5 2.4 2.6 3.1 2.4 2.8 2.7 2.5 3.2 2.9 3.2 3.4 3.8 3.2 2.8

EPG 2.4 2.2 2.6 2.4 2.8 3.5 3.7 2.4 2.4 2.6 2.7 2.9 2.9 2.7 3.2 3.2 3.0 3.9 2.8

Homepage 3.7 2.2 2.3 2.2 2.7 2.4 3.8 3.1 2.0 2.9 2.7 3.0 3.0 3.3 3.7 3.4 3.3 3.7 2.9

Share current program 2.4 2.1 1.9 2.4 3.3 2.4 3.9 2.9 3.4 3.5 3.8 3.7 4.2 2.6 4.2 3.8 4.5 3.2 3.2

Mean 1.7 1.7 1.7 1.8 1.9 1.9 1.9 1.9 1.9 2.0 2.1 2.1 2.2 2.3 2.3 2.4 2.6 2.8

General acceptance

●  Our 360 tech-‐savvy parHcipants responded very posi8vely to the idea of semanHc gesture input for TVs.

"fun to use", "convenient", "coolness factor" ●  ParHcipants would like to use gestures to control other

devices as well (e.g. audio).

OperaHon

Many parHcipants felt that voice and sound could be a good support for gesture input.

waking up the device with a sound

Can the TV hear me?

Gesture type preference

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR

Seman8c

Poin8ng Many users would prefer switching between gesture types.

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ

Seman8c l l l l l l l l l l l l l l l 15

Poin8ng

FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR Σ

Seman8c l l l l l l l l l l l l l l l 15

Poin8ng l l l l l l l l l 9

associated with more advanced commands

Typical concerns of users

●  Learning and reten8on of gestures (but: would be easy if based on implicit behavior repertory)

●  Sensi8vity and accuracy of devices ●  Interference by other gestures in the room ●  Compa8bility with lean-‐back disposi8on

Conclusions

Conclusions

1.  For basic CE commands a common language for semanHc gestures already exists across cultures.

2.   More complex commands could be realized by either

a.   customizing these gestures for each individual market

b.  customizing individually

c.  proposing a set of semanHc gestures that need to be learned (the study provides some suggesHons)

d.   switching to poin8ng gestures in combinaHon with a GUI

3.  It is necessary to consider cultural differences at a country level when it comes to designing advanced gesture control for globally marketed devices.

Download complete reports: www.uxfellows.com

Find us at: gonzalo.auza@inter-‐cultura.com inter-‐cultura.com

Thumbs up to the audience!

Thumbs up to the audience!