1Aura Project© 2001 Carnegie Mellon University
Wearable Computer Wearable Computer Architecture and Architecture and
ApplicationsApplications
Daniel P. SiewiorekDaniel P. SiewiorekCarnegie Mellon UniversityCarnegie Mellon University
October 30, 2001October 30, 2001
Boeing
3Aura Project© 2001 Carnegie Mellon University
Five Generations of Wearable Computers
Navigator 2 used for aircraft maintenance
VuMan 1 VuMan 2 Navigator 1
VuMan 3 Navigator 2
Left, a look through the head mounted display.The user not only sees the aircraft maintenance interface, but also their work environment.
5Aura Project© 2001 Carnegie Mellon University
Wearable Applications and Architecture
Procedures - upload at completion Work Orders - incremental updates Collaboration - real time interaction
» Client-Server
– Thin Client Legacy Systems
– Interactive Electronic Technical Manuals (IETMs)
6Aura Project© 2001 Carnegie Mellon University
Time Rate of Change of Data Taxonomy
Procedures. Maintenance and plant operation applications are characterized by a large volume of information that varies slowly over time.
A typical request consists of approximately ten pages of text and schematic drawings. Changes to the centralized information base can occur on a weekly basis.
7Aura Project© 2001 Carnegie Mellon University
Savings Using Tactical Information Assistants in Marine Heavy Vehicle MaintenanceCurrent Practice
Current Practice
SAVINGS FACTOR
VuMan 3 Field Trials
VuMan 3 Field Trials
Personnel
2:1
Inspection time
40% less
SAVINGS FACTOR
8Aura Project© 2001 Carnegie Mellon University
Final SystemMock-up System Prototype SystemInitial visit Story Boards
Month
0 1 2 3 4
Four Month Design Cycle
9Aura Project© 2001 Carnegie Mellon University
Time Rate of Change of Data Taxonomy
(continued)
Work Orders. The trend is towards more customization in systems.
Manufacturing or maintenance personnel receive a job list that describes the tasks and includes text and schematic documentation. This information can change on a daily or even hourly basis.
11Aura Project© 2001 Carnegie Mellon University
Time Rate of Change of Data Taxonomy
(continued)
Collaboration. An individual often requires assistance. In a “Help Desk” an experienced person is contacted for audio and visual assistance. The Help Desk can service many people simultaneously.
Information can change on a minute-by-minute and sometimes even a second-by-second basis.
12Aura Project© 2001 Carnegie Mellon University
Integrated Technical Information
for the Air Logistics Centers (ITI-ALC)
Integrated Technical Information
for the Air Logistics Centers (ITI-ALC)
Technology DemonstrationTechnology DemonstrationTechnology DemonstrationTechnology Demonstration
14Aura Project© 2001 Carnegie Mellon University
Problem
Outdated, cumbersome maintenance information capability
» Paper-based products
» Independent, uncoordinated computer information systems
15Aura Project© 2001 Carnegie Mellon University
ITI-ALC TechnologyITI-ALC TechnologyDemonstration Demonstration
ArchitectureArchitecture
InspectorInspectorPentiumPentiumLaptopLaptop
InspectionInspection
CollaborationCollaborationOracleOracleDBDB
WindowsWindowsNT ServerNT Server
MechanicMechanic
Wireless LANWireless LAN
Engineer’sEngineer’sWorkstationWorkstation
16Aura Project© 2001 Carnegie Mellon University
Evaluation & Inventory
1. Select aircraft2. Select region3. Pick-up 173’s4. Check freq. defect list5. Get tools6. Conduct inspection7. Check-off defect list8. Stamp 173’s9. Write up new defects10. Access parts info.11. Access TO’s12. Access HowMal codes13. Write new defects in U-book14. Stamp U-book15. Enter data into database
CurrentCurrent ITI-ALCITI-ALC
1. Login
2. Hangar
3. 173 List
4. 173 Signoff
5. 173 History
4. Record Defects
5. Add New Defect
6. Submit Defects
7. Defect History
20Aura Project© 2001 Carnegie Mellon University
Engineering Assistance
1. Mechanic finds skin defect2. Mechanic obtains Form 202 3. Fills in fields of Form 202A 4. Views tech. data 5. Makes a rough sketch 6. Form to Scheduler 7. Form to Planner 8. Form to Engineering 9. Engineer reviews Form 202A10. Engineer researches problem11. Engineer goes to hangar for visual 12. Engineer fills in Form 202B 13. Reverse routing/logging above 14. Mechanic reads 202B15. Mechanic is ready to enact repair
1. Login Screen
2. Hangar Screen
3. Form 202A
4. Confirmation Screen
3a.Parts Screen
3d. Sound Tool
3c. Sketch Tool
3b. Take Picture
CurrentCurrent
ITI-ALCITI-ALC
1. ELogin 3. Form 202B
4. Confirmation Screen
2. 202B Selection Screen
22Aura Project© 2001 Carnegie Mellon University
Wearable PC Runs Inmedius Web-based IETM Software
Server
Web Server
IETM Engine
Client
database schema
database schema
Web Browser
database schema
IETMAuthoring
incremental updates
incremental updates
Authoring IncrementalDistribution
WebRuntime
incrementalupdates
F/A-18 Fleet Support Organization Fleet Operating Sites
IETM Authoring/Maint.
Organizations
23Aura Project© 2001 Carnegie Mellon University
IETM Display by Mobile Computer -
IBM Concept Model is an Example ThinkPad 560X Equivalent High Spec
» Full Function Portable PC in IBM High Density Package
Ultimate Portability » Headphone Stereo Size System Unit, 2/3lbs (299g)
IBM MicroDrive » 1" Disk, 5mm Thickness, 20g, 340 MB Capacity
Transparent Head Mount Display » Invented by IBM T.J. Watson Research
24Aura Project© 2001 Carnegie Mellon University
F-18 Inspection Application: Production vest fits under “Float Coat”
25Aura Project© 2001 Carnegie Mellon University
11 Mbs wireless LAN connects Wearable Computer to server
28Aura Project© 2001 Carnegie Mellon University
Academic andAdministrative
Buildings
Residence Halls, Parking, etc
Wireless Campus as of June 2000
300+ basestations
29Aura Project© 2001 Carnegie Mellon University
Aura Thesis
The most precious resource in computing
is human attentionAura Goals
•reduce user distraction
•trade-off plentiful resources of Moore’s law for human attention
•achieve this scalably for mobile users in a
failure-prone, variable-resource environment
30Aura Project© 2001 Carnegie Mellon University
Context Aware Computing
Applications that use context to provide task-relevant information and/or services
Context is any information that can be used to characterize the situation of an entity (person, place, or physical or computational object)
Contextual sensing, adaptation, resource discovery, and augmentation
Examples of Context Aware applications» Matchmaking
» Proactive assistant
31Aura Project© 2001 Carnegie Mellon University
Example Agents
Notification Agent» Alert a user if they are passing within a certain distance of a
task on their to do list.
Meeting Reminder Agent» Alerts a user if they are in danger of missing a meeting.
Activity Recommendation Agent» Recommends possible activities/meetings that a user might
like to attend based on their interests.
32Aura Project© 2001 Carnegie Mellon University
Context Aware Computing Platform: The Spot Architecture
35Aura Project© 2001 Carnegie Mellon University
Research Challenges
• User interface models—new application metaphors require experimentation
• Input/output modalities—accuracy and ease of use
• Quick Interface Evaluation Methodology—to use during design
• Match capability with application—resist “highest performance” temptation