Handhelds in the Automobile:The Denali Navigation System

Human Computer Interaction Institute Human Computer Interaction Institute School of Computer ScienceSchool of Computer Science

Carnegie Mellon UniversityCarnegie Mellon University

Brad A. Myersbam@cs.cmu.edu

http://www.cs.cmu.edu/~pebbles

Brad Myers 2Talk for General Motors – 4/02/04

General Idea How can a handheld augment the

operation of an automobile? Not just using a PDA while in a car PDA augments and

interoperates with car Not for driving Examples:

Setting functions, controls Specifying destination for navigation systems

Brad Myers 3Talk for General Motors – 4/02/04

Pebbles Project

This research is part of the Pebbles project Overall goal: investigate use of handhelds

at the same time as PCs and other computerized devices “Multi-Machine User Interfaces”

Assumption: handhelds will frequently be in close interactive communication with each other and other computers Wireless and wired technologies

Brad Myers 4Talk for General Motors – 4/02/04

Other Domains for Pebbles

Also created applications to study use of PDAs in: Classrooms Offices Meeting rooms Command Post of the Future Homes For the Handicapped

Brad Myers 5Talk for General Motors – 4/02/04

Personal Universal Controller Two-way communication

Appliance describes its functions Personal Universal Controller then:

Automatically creates user interface Controls the appliance Displays feedback about appliance status

Specifications

Control

Feedback

Brad Myers 6Talk for General Motors – 4/02/04

Current PUC Specification Language

XML Full documentation for the

specification language and protocol

Has been used to specify many appliances Stereo, MP3 player,

camera, VCR, room lights, elevator, etc.

Brad Myers 7Talk for General Motors – 4/02/04

Previously Reported

Modeling theGMC Yukon DenaliSUV Has a sophisticated

Driver InformationConsole system

Three-zone HVAC system LCD screen-based navigation system

Brad Myers 8Talk for General Motors – 4/02/04

Simulator

Navigation System 50+ screens covering most navigation features

Limited direct interaction with the map (e.g. scrolling) Based on interacting with real device

Brad Myers 9Talk for General Motors – 4/02/04

Navigation Simulator, cont.

Brad Myers 10Talk for General Motors – 4/02/04

New Work More parts of the Navigation Simulator

Audio functions Various settings

Specification of the Navigation System’s functions in XML Exercises advanced features of PUC

specification language Automatic generation of (parts of) Navigation

System on PocketPCs

Brad Myers 11Talk for General Motors – 4/02/04

Future Work Future Work on Simulator

Simulate XM radio Conduct a comparison user study

Similar to our previous comparison study Measure time/errors for users using both the physical

unit and handheld remote control Automatic generation with user consistency

Text Input Using EdgeWrite

Human Computer Interaction Institute Human Computer Interaction Institute School of Computer ScienceSchool of Computer Science

Carnegie Mellon UniversityCarnegie Mellon University

Brad A. Myersbam@cs.cmu.edu

http://www.cs.cmu.edu/~pebbles

Brad Myers 13Talk for General Motors – 4/02/04

Input while physically unstable

GM has sponsored research and patent on a new text entry technique called EdgeWrite™

First aimed at people with motor impairments Unable to make Graffiti or Jot gestures Physical edges provide physical stability

Instability might be a property of the environment, not just the person e.g., on a bus, while walking, or in a car

Brad Myers 14Talk for General Motors – 4/02/04

Stylus EdgeWrite™

Move along plastic edges inside square hole Recognition based on order corners are hit

OK if the path is jittery No need for:

Shift or caps lock Separate areas for

numbers and letters

Brad Myers 15Talk for General Motors – 4/02/04

Character Chart

Three subsets: Alphanumerics

(e.g., abc, 123) Punctuation

(e.g., !?#$*) Extended

characters (e.g., ®¶Øç)

144 characters with 306 forms

Brad Myers 16Talk for General Motors – 4/02/04

Stylus EdgeWrite™ Results After 15 minutes of practice, able-bodied novices:

18% more accurate than Graffiti About the same in speed (~7 WPM with each)

Note: Tasks included numbers and punctuation

Motor-impaired users were vastly more accurate 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s)

Brad Myers 17Talk for General Motors – 4/02/04

Joystick EdgeWrite™ Could be useful for game consoles, mobile

phones, or on power wheelchairs Compared EdgeWrite to Date Stamp and

Selection Keyboard Tested with unmodified COTS joystick

Brad Myers 18Talk for General Motors – 4/02/04

Touchpad EdgeWrite™

Use elevated edges around a Synaptics touchpad May be easier for people with motor impairments Maybe mount on the steering wheel or arm-rest?

Brad Myers 19Talk for General Motors – 4/02/04

Touchpad Pilot Study Two factors

Output visible Touchpad visible

Touchpad visibility a complete non-factor!

Not seeing output doesn’t degrade performance very much

02468

1012141618

WPM Error %

NeitherTouchpadOutputBoth

One subject: 22.61 WPM (maximum)

Brad Myers 20Talk for General Motors – 4/02/04

Using Joystick on Wheelchair

Custom hardware andsoftware to interfaceto commercial joystick

Informally evaluated with 7disabled power-wheelchair users 6 with Cerebral Palsy, 1 with Multiple Sclerosis Compared to on-screen keyboard and using

EdgeWrite on a touchpad

New!

Brad Myers 21Talk for General Motors – 4/02/04

Results

Touchpad worked betterthan wheelchair joystick

Brad Myers 22Talk for General Motors – 4/02/04

EdgeWrite.com

Download EdgeWrite software Find abridged and full character charts Find publications Order plastic templates See http://www.edgewrite.com/ or

http://www.cs.cmu.edu/~edgewrite/ Same web site

Brad Myers 23Talk for General Motors – 4/02/04

Future EdgeWrite™ work

Mouse/text disambiguation on touchpad Keyboard/mouse replacement for

people with disabilities Custom (non-commercial) joystick

implementation Cell phone implementation More user tests!

Human Computer Interaction Institute Human Computer Interaction Institute School of Computer ScienceSchool of Computer Science

Carnegie Mellon UniversityCarnegie Mellon University

Brad A. Myersbam@cs.cmu.edu

http://www.cs.cmu.edu/~pebbles