40
Ubiquitous Computing: Beyond platforms, beyond screens; the invisible computer Shwetak N. Patel http://ubicomplab.cs.washington.edu/

Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

  • Upload
    builiem

  • View
    221

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Ubiquitous Computing: Beyond platforms,

beyond screens; the invisible computer

Shwetak N. Patel

http://ubicomplab.cs.washington.edu/

Page 2: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 2

Page 3: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 3

Topics for Today

Review the history of ubiquitous computing (ubicomp)

Fundamental concepts

Important research themes

Ubicomp as an industry

Page 4: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Ubiquitous Computing Fundamentals

Shwetak N. Patel - University of Washington 4

Page 5: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 5

The Plateau

Time

Use

r Pro

duct

ivity

Batch

Command Line

WIMP (Windows)

1940s – 1950s 1980s - Present 1960s – 1970s

?

?

Page 6: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 6

Paradigm: Ubiquitous Computing Person is no longer user of single device but

occupant of computationally-rich environment

Computers everywhere Desktops, laptops, tablets, mobile phones

Can no longer neglect macro-social aspects

Page 7: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 7

Innovator: Mark Weiser

CTO of Xerox PARC

Introduced notion of “calm technology” It’s everywhere, but recedes quietly into

background

“The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.”

Page 8: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 8

Ubiquitous Computing

Move beyond the desktop

Computing is embedded everywhere in the environment

Technology supports a task The task should be the focus…not the

technology

Page 9: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

9

Crucial Elements

Location “If a computer knows merely what room it is in, it

can adapt it behavior in significant ways without requiring even a hint artificial intelligence.”

Scale

“Ubiquitous computers will also come in different sizes, each suited to a particular task.”

Shwetak N. Patel - University of Washington

Page 10: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

10

Scales of devices

Tabs Inch scale

Pads Foot scale

Boards Yard scale

Shwetak N. Patel - University of Washington

Page 11: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

11

Already a Reality

Shwetak N. Patel - University of Washington

Page 12: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

12

Head Mounted Displays

Micro optical displays

Shwetak N. Patel - University of Washington

Page 13: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

13

Three Research Themes in Ubicomp

1. Automated capture and access

2. Context-awareness

3. Natural/Implicit interaction

Shwetak N. Patel - University of Washington

Page 14: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

14

1. Automated Capture

Motivation Record-taking is hard

Multiple streams of information need to be captured

Machines are better at some of these things than we are

Shwetak N. Patel - University of Washington

Page 15: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

15

Examples

Meeting capture (e.g. Weiser,Xerox PARC)

Classroom 2000

Shwetak N. Patel - University of Washington

Page 16: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

16

LiveBoard

Shwetak N. Patel - University of Washington

Page 17: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

17

Classroom 2000

Shwetak N. Patel - University of Washington

Page 18: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

18

2. Context-Aware Computing

Computing services sense the environment (location, user emotion,…) and tailor provided services

Walk into a meeting, phone is silenced

Requires sensor innovation Shwetak N. Patel - University of Washington

Page 19: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

19

Examples

Active Badge & PARCTab

Temperature adjusted automatically

Shwetak N. Patel - University of Washington

Page 20: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - CSE 599U - Advanced Topics in Ubicomp 20

Sensing Techniques for Mobile Interaction

Page 21: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Energy Monitoring

Page 22: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

22

Augmented Reality

Shwetak N. Patel - University of Washington

Page 23: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

23

The Georgia Tech Aware Home

Shwetak N. Patel - University of Washington

Page 24: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

24

3. Natural/Implicit Interfaces

Making computing interfaces more natural interaction tools Pen input

Speech

Gesture

Tangible interfaces

Shwetak N. Patel - University of Washington

Page 25: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

25

Examples

Pen applications

H. Ishii’s tangible UI work

Shwetak N. Patel - University of Washington

Page 26: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

26

Hollywood Visions

Shwetak N. Patel - University of Washington

Page 27: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

27

Ubicomp is…

Computing everywhere

Mobile computing

Wearable computing

Augmented reality

It is NOT virtual reality.

Shwetak N. Patel - University of Washington

Page 28: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

28

Dangling String

Shwetak N. Patel - University of Washington

Page 29: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 29

Where are we now?

Machine learning

Cloud computing

Mobile computing is a given

New opportunities for designers

Lots of sensors

Page 30: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 30

Environmental vs. Local Processing

Environmental Lower cost, lower power

Local Supports mobility

Privacy preserving

Page 31: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

31

Remaining Challenges

Ease of deployment/install

Security/privacy

Power

Engineering challenges At odds with traditional engineering practices

Shwetak N. Patel - University of Washington

Page 32: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

32

Page 33: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

33

Battery Trends

Shwetak N. Patel - University of Washington

Page 34: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Low-power Wireless Sensing

Page 35: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

35

Power Harvesting

Mechanical Inertial/Motion-based Magnetic Inductive coupling RF power harvesting Thermoelectrics Piezoelectrics Resonator

Shwetak N. Patel - University of Washington

Page 36: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Leverage Existing Sensors and Infrastructure

Page 37: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 37

Home Health Mobile Health

Page 38: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

38

Smartphones

Shwetak N. Patel - University of Washington

Page 39: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

39

Internet of Things (IOT)

Shwetak N. Patel - University of Washington

Page 40: Ubiquitous Computing: Beyond platforms, beyond screens ...uwdata.github.io/hcid520/15wi/lectures/UbiComp-Patel.pdf · Ubiquitous Computing: Beyond platforms, beyond screens; the invisible

Shwetak N. Patel - University of Washington 40

Questions?

Thanks!