Touching The Future

04/08/2023 1Joe Fletcher MIX09, Las Vegas

Chris KoenigDeveloper Evangelist, Microsoft Corporation

Touching the Future



Touch is not good

for everythingIt is not an end all solution

Touch is a computing evolution

It is an addition element for users to interact with their

content in new and unique ways

Touch is great for specific aspects

New technology has enabled touch systems, which can enhance certain activities


TouchThe act of directly touching your digital content

GestureHand motions to take an action

ManipulationAlteration or freeform movement of digital content using touch

Natural User InterfaceThe combination of these and other elements the create a unique way to interact with your digital content


Why Evolve?


Command Line Interface (CLI)


Graphic User Interface (GUI)


Natural User Interface (NUI)


Natural User Interface (NUI)


NUI vs.

Web 2.0


NUI & Touch should not be a novelty



Tap is not the new click

≠


Input Ecology

Keyboard

Good forAccuracy

ConLimited

Mouse

Good forMoving across the screen efficiently

ConIndirect

Stylus

Good forFreeform input

ConLow accuracyNeed large controls

Single point

Good forDirect object selection

ConNot for quick inputLow accuracyNeed of large controlsMis-hits from fingernails of perceived hit area

Multi point

Good forManipulating objectsSocial

ConNot for inputLow accuracyNeed large controlsSupport of hands and screen


[Partial] Touch Ecology

Multi point (screen)

Reacts to direct input

Multi Touch(screen)

Reacts to multiple inputs

Orients UI to the direction of the touch

Spatial recognition of system

NUI(Gesture & Physical/Digital)

Reacts to multiple inputs

Spatial Recognition - Orients UI to the direction of the touch

Object recognition - Blurring physical and digital


Context, task, and use define the solution


Context, task, and use define the solution

Touch is not a solution in search of a problem


Surface Massive Multi-touch, Multi-user

Windows 7

PC’s, Form Factors, Technology

Unique Spot


Microsoft Surface

Microsoft Surface is a revolutionary computer that responds to natural hand gestures and real-world objects, creating unique new ways for people to collaboratively interact with digital content.


Microsoft Surface and NUI

Microsoft Surface computing uses sensing and display technology to infuse

everyday surfaces with digital content and is comprised of the following

unique attributes:

Object recognitionDirect interaction Multi-touch Multi-user



Building Surface Applications

demo…


Windows 7


Windows 7

http://windowsteamblog.com/cfs-file.ashx/__key/CommunityServer.Blogs.Components.WeblogFiles/windows7/surface_5F00_globe_5F00_1DA06BA0.png


Touch Scenarios And Windows 7

Scenarios

Navigating the web Reading & sorting email Viewing photos Casual games Music and video Navigating files Arranging windows Using Office applications

All focused on consumption

Areas of investment

Developer Platform

UI Enhancements

Gestures

Applications


Building Windows 7 Applications

demo…


Surface HardwareWindows 7

Surface HardwareWindows VistaWindows 7

NativeWin32

Application

Touch Development Roadmap

WPF 3.5

Surface SDK 1.0

Managed Wrapper and Interop

WinForms Application

Windows 7 ReleaseNET 4.0 / Surface 2.0 Release

WPF 3.5 x WPF 4.0

Surface SDK 2.0

WPF Application

Multi-Touch API

Surface Application

Multi-Touch Controls

Multi-Touch API

Surface Multi-Touch

Controls & API

Multi-Touch API

Multi-Touch API and Controls

NET 3.5 / Surface 1.0 Release


Challenge Form Factor & Technology


Touch Hardware Ecology



Capacitive Capacitive Infrared Vision system Stylus



CapacitiveN-Trig (2-10)

CapacitiveN-trig (2-10)

InfraredHP (2)

Vision systemSurface (52)

StylusWacom (1)


Challenge Patterns


FireFoxSwipe Left: Go back in history

Swipe Up: Go to the top of the page


Apple iPhoneSwipe Left: Go Forward in History

Swipe up: Go to the bottom of a page


Challenge Orientation


Horizontal Vertical


Challenge Cardio Effect

http://www.sxc.hu/browse.phtml?f=download&id=1136556


Challenge Paradigms


To button or

not to button


Challenge Getting people to touch


Exploration Instruct


Challenge Visualizing Touch


Is it working?


Your effort to remain what you are is what limits youGhost in the Shell


Debating the future of touch is useless


Creating the future is more interesting


Touch is not good for

everything

Touch is an evolution

Touch is great for specific

aspects


Take advantage of Microsoft Surface

•Available from the Surface Community site

Download SDK Workstation Edition

•Learn how to build applications from scratch on Surface by viewing videos on Surface.com

Develop for Surface

•Interested in purchasing a Surface? Email to [email protected]

Purchase a Surface


Future Vision

2019


Thank you!

Chris [email protected]

http://blogs.msdn.com/chkoenig

@chriskoenig