32
Pierre-Louis Xech [email protected] Partenariats Recherche Microsoft France http://www.microsoft.com/france/msdn/annuaire/xml/plxech. xml http://research.microsoft.com/~plxech/ Desktop 2015: libérez les fenêtres!

Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Embed Size (px)

Citation preview

Page 1: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Pierre-Louis [email protected] Partenariats RechercheMicrosoft France

http://www.microsoft.com/france/msdn/annuaire/xml/plxech.xml http://research.microsoft.com/~plxech/

Desktop 2015: libérez les fenêtres!

Page 2: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Topics

Zero codeReflections on (Interaction Design) researchHistoric perspectiveBeyond WIMP interactions

Overcoming constraints of “point and clik” interactionsMulti touch interactions, interactive surfaces & computer vision techniques

Illustration from (some) Microsoft Research projects (and from somewhere else too)Form factor issues and devices

Page 3: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Microsoft Research 2007http://research.microsoft.comFounded in 1991Staff of over 800 covering 55 areas

Core research facility for entire company

Centrally funded, sets own agendaInternationally recognized research teamsStrong engagement with Microsoft product groups

Research labsRedmond, WashingtonSan Francisco, CaliforniaMountain View, CaliforniaCambridge, United KingdomBeijing, People’s Republic of ChinaBengalore, India

Joint Labs

Page 4: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

« Le présent est indéfini, le futur n’a de réalité qu’en tant qu’espoir présent, le passé n’a de réalité qu’en tant que souvenir présent. » Jorge Luis Borges

Fictions

Page 5: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

5

2001

2057

Fiction

Page 6: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

1968

2007

Research

Page 7: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

1968 …"I don't know why we call it a mouse. It started that way and we never changed it.“

Doug Engelbart, Stanford University, 1968 The mother of all demos

complete recording at http://sloan.stanford.edu/mousesite/1968Demo.html

Page 8: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

… 2015?

8

Page 9: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

9

ChallengesLarge displays«Hiding» computersPeripheral awareness«Augmenting» surfacesSeamless transitionsMore natural interactionsMulti-touch interactionsCollaborationNew kind of devicesPerceived affordances

Page 10: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

10

Emerging research domains

Ubiquitous computing (Ubicomp) integrates computation into the environment, rather than having computers which are distinct objects

Augmented reality (AR) is a field of computer research which deals with the combination of real world and computer generated data

Mixed Reality (MR) is the merging of real world and virtual worlds to produce a new environment where physical and digital objects can co-exist and interact

Tangible User Interface (TUI) is a User interface in which a person interacts with digital information through the physical environment

Page 12: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Reinventing mouse

The Soap devicePatrick BaudischMicrosoft Research Redmond

Page 13: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Multi-touch interactions

Page 14: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Sensing surfaces

Rear projection sheet

Glass

IR Filter

CameraProjector

IR lightIR light

Objects on surface of table

Page 15: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Augmenting Surfaces

Page 16: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

PlayAnywhere

Short-throw projector, very wide angle lens on the cameraLens distortion & projective transform correction for camera-projector alignmentOff-axis IR LED illuminant

Very few assumptions about the appearance of the surfaceAll calibration is done at the “factory”

Page 17: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

17

Table top interactions

Play Anywhere Andy WilsonMicrosoft Research, Redmond

Page 18: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Wall size display interactions

« Touchlight »Andy Wilson

Microsoft Research Redmond

18

Page 19: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Collaboration

Play TogetherDaniel C. Robbins, Andy WilsonMicrosoft Research, Redmond

Page 20: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Interacting with photos

Page 21: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Surface ecology

21

The Picture BowlShahram Izadi, Alex TaylorMicrosoft Research, Cambridge

Page 22: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Interacting with music

The ReacTable & the MediaTableSergi Jordà & al.Universitat Pompeu Fabra, Barcelona

http://www.iua.upf.es/mtg/reacTable/ http://www.youtube.com/watch?v=0h-RhyopUmc

Page 23: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

24

http://mrl.nyu.edu/~jhan/ftirtouch/

Surface computing (Other)

Jeff Han – New-York University

Page 24: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Interactive surfaces for all?

25

Page 25: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

The Future

Page 26: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Display Technology

Page 27: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Laser Projection

Page 28: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Conclusions

It took almost 15 years before the mouse became mainstreamEverything is best for something and worst for something else!Emerging user experience concepts and techniques

Multi-touch interactionsTable-top and wall display sensingRobust computer vision techniques

Promising new devices and technology29

Page 29: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

… Tomorrow!

30

Page 30: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

ReferencesTangible bits project, MIT Media Lab

http://tangible.media.mit.edu/projects/

Doug Engelbart’s 68 demohttp://sloan.stanford.edu/mousesite/1968Demo.html

Microsoft Researchhttp://research.microsoft.comhttp://research.microsoft.com/research/vibehttp://research.microsoft.com/~awilson http://research.microsoft.com/cml/

The ReacTablehttp://www.mtg.upf.edu/reactable/

Flat & rollable displayshttp://www.camfpd.comhttp://www.polymervision.nl

Laser projectionhttp://www.lightblueoptics.com/http://www.symbol.com

Page 31: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

Questions?

Page 32: Zero code Reflections on (Interaction Design) research Historic perspective Beyond WIMP interactions Overcoming constraints of “point and clik” interactions

© 2007 Microsoft France

Votre potentiel, notre passion TM