The medium is the message. This is merely to say that the personal and social consequences of any medium - that is, of any extension of ourselves - result from the new scale that is introduced into our affairs by each extension of ourselves, or by any new technology.

Overview

• B eing social

• F ace to face conversations

• R emote conversations

• Tele-presence

• C o-presence

• S hareable technologies

www.id-book.com 2

C onversational mechanisms

• Various mechanis ms and ‘rules ’ are followed when holding a conversation, e.g. mutual greetings

A: Hi there B : Hi! C : Hi A: All right? C : G ood, how’s it going? A: F ine, how are you? C : OK B : S o-s o. How’s life treating you?

www.id-book.com 3

F 2F coordinating mechanisms

• Talk is central

• Non-verbal also used to emphas ize and as substitute

– e.g. nods , shakes , winks , glances , gestures and hand-rais ing

• F ormal meetings

– explicit s tructures such as agendas , memos, and minutes are employed to coordinate the activity

www.id-book.com 4

C onversational rules

• S acks et al. (1978) work on conversation analys is describe three bas ic rules : R ule 1: the current speaker chooses the next speaker

by asking an opinion, question, or request R ule 2: another person decides to s tart speaking R ule 3: the current speaker continues talking

www.id-book.com 5

C onversational rules

• Turn-taking used to coordinate conversation

– A: S hall we meet at 8? – B : Um, can we meet a bit later?

– A: S hall we meet at 8? – B : Wow, look at him?

– A: Yes what a funny face! – B : Um, can we meet a bit later?

• B ack channelling to s ignal to continue and

following

– Uh-uh, umm, ahh

www.id-book.com 6

More conversational rules

• F arewell rituals

– B ye then, see you, yeah bye, see you later….

• Implicit and explicit cues – e.g. looking at watch, fidgeting with coat and bags

– explicitly saying “Oh dear, must go, look at the time, I’m late…”

www.id-book.com 7

B reakdowns in conversation

• When someone says something that is misunderstood:

– S peaker will repeat with emphasis :

A: “this one? ” B : “no, I meant that one!”

– Also use tokens :

E h? Quoi? Huh? What?

www.id-book.com 8

What happens in social media conversations?

• Do s ame conversational rules apply?

• Are there more breakdowns?

• How do people repair them for:

– P hone? – email? – Instant messaging? – texting? – S kyping?

www.id-book.com 9

R emote conversations

• Much research on how to support conversations when people are ‘at a distance’ from each other

• Many applications have been developed

– e.g., email, videoconferencing, videophones , ins tant mes s aging, chatrooms

• Do they mimic or move beyond existing ways of convers ing?

www.id-book.com 10

Conversational UIs Every community, marketplace, on-demand service, dating app, social game or e-commerce product has or will soon have messaging as part of the experience (engagement, retention and transaction volume). The command line was the original conversational interface.

...like a conversation, back and forth, with the user telling the computer what to do, the computer doing it, and coming back with a result or an additional question ...you had to either know what to input or had to ask the computer for options. Even in these early days, messaging applications existed as humans didn’t only want to converse with a machine, but also with other humans... but the interaction was limited to text.

Instant messaging applications became more visual and began to support richer media for conversations such as emoticons, photos, video and mini applications like games or quizzes. The first wave of these apps included MSN and Yahoo! messenger, popular in the late 90’s.

conversational commerce asking a conversational commerce app “Do you have any Onitsuka Tigers?” can return a text list of items and photos, or it can return a rich card with a carousel to scroll through results, with a buy button on each result that immediately triggers a payment.

Early videophone and visualphone

www.id-book.com 14

VideoWindow system (B ellcore, 1989)

• S hared space that allowed people 50 miles apart to carry on a conversation as if in same room drinking coffee together

• 3 x 8 ft ‘picture-window’ between two s ites with video and audio

• P eople did interact via the window but s trange things happened (K raut, 1990)

www.id-book.com 15

S ketch of VideoWindow

www.id-book.com 16

F indings of how VideoWindow S ystem was used

• Talked constantly about the system

• S poke more to other people in the s ame room rather than in other room

• When tried to get closer to someone in other place had oppos ite effect - went out of range of camera and microphone

• No way of monitoring this

www.id-book.com 17

S kype success • G lobal household name

• S eeing others on screen enables more intimacy than audio phone

• E nables people to get to know each other better

• Less awkward for young children

– Like “to show, not tell” (Ames et al, 2010)

www.id-book.com 18

B eing social

• Are F 2F conversations being superseded by our social media interactions?

• How many friends do you have on F acebook, LinkedIn,etc vs real life?

• How much overlap? • How are the ways we live and interact with one

another changing? • Are the established rules and etiquette s till

applicable to online and offline?

www.id-book.com 19

3D virtual worlds

• S econd Life (2007) – Over 8 million users

• What kinds of conversation take place in thes e

environments?

• VoIP vers us chatroom talk? – Which is preferred and why?

www.id-book.com 20

Telepresence

• New technologies des igned to allow a person to feel as if they were present in the other location

– projecting their body movements , actions , voice and facial express ions to the other location or person

– e.g. superimpose images of the other pers on on a workspace

www.id-book.com 21

Hypermirror (Morikawa and Maesako, 1998)

– allows people to feel as if they are in the s ame virtual place even though in phys ically different spaces

(woman in white s weater is in a different room to the other three)

P eople in different places are

s uperimposed on the s ame s creen

to make them appear as if in s ame s pace

www.id-book.com 22

C reating personal space in Hypermirror

2) Two in this room are invading the ‘virtual’ pers onal s pac e of the other pers on by appearing to be phys ic ally on top of woman in white s weater

3) Two in the room move apart to allow pers on in other s pac e more ‘virtual’ pers onal s pac e

www.id-book.com 23

E veryone happy

www.id-book.com 24

B iR eality

www.id-book.com 25

T he P eople’s B ot attending C HI

www.id-book.com 26

A telepresence room

www.id-book.com 27

How much realism?

• Is needed in telepresence to make it compelling?

• Telepresence rooms try make the remote people appear to be life-like by us ing multiple high def cameras with eye-tracking features and directional microphones

• Is S kype just as good?

www.id-book.com 28

C oordination mechanisms

• When a group of people act or interact together they need to coordinate themselves

– e.g., playing football, navigating a ship

• T hey use:

– verbal and non-verbal communication

– schedules , rules , and conventions

– shared external representations

www.id-book.com 29

C o-presence

• Technologies that enable co-located groups to collaborate more effectively

– when working, learning and socializing

• E xamples : S martboards , S urfaces , Wii and K inect

www.id-book.com 30

Awareness mechanisms

• Involves knowing who is around, what is happening, and who is talking with whom

• P eripheral awareness

– keeping an eye on things happening in the periphery of vis ion

– Overhearing and overs eeing - allows tracking of what others are doing without explicit cues

www.id-book.com 31

Lo tech awareness mechanism

www.id-book.com 32

Designing technologies to support awareness

• P rovide awareness of others who are in different locations

• Workspace awareness : “the up-to-the-moment understanding of another pers on’s interaction with the shared workspace” (G utwin and G reenberg, 2002)

• E xamples : R eacTable and R eflect Table

www.id-book.com 33

T he R eactable experience

www.id-book.com 34

T he R eflect Table

www.id-book.com 35

T he Dynamo system

www.id-book.com 36

Keeping aware of what others are doing and letting others know what you are doing are important aspects of collaborative working and socializing

S ococo – shows who is where and who is meeting with whom

www.id-book.com 37

What next?

• B es ides perpetual sharing and broadcasting of information, knowledge, and personal content?

• Lifelogging

– recording everything in one’s life and s haring

• Micro-chatting

– beyond twitter and snapchat?

www.id-book.com 38