Smart Goggles

Electrical and Computer Engineering

Smart Goggles

To Chong

Ryan Offir

Matt Ferrante

James Kestyn

Advisor: Dr. Tilman Wolf

Team Wolf

2Electrical and Computer Engineering

Augmented Reality Glasses

Virtually superimpose graphics onto real environment Context-specific information supplied to users real-time

Electrical and Computer Engineering

Gaming

4Electrical and Computer Engineering

Gaming Industry Advancement

5Electrical and Computer Engineering

3D View of our system

Tunnel Creek Board & Battery

Sensor Board

6Electrical and Computer Engineering

Specifications for Augmented Reality

System Refresh Rate: 20 Hz• Human visual frame rate: 10-12 FPS

Location Accuracy σL: ±2 feet• Average Walking Speed = 4.4 ft/s• Average Running Speed = 22 ft/s

Orientation Accuracy σθ: ±5°

Angle Update Speed: 80 deg/s• Captures “typical” human movement

7Electrical and Computer Engineering

Block Diagram

8Electrical and Computer Engineering

Sensing

9Electrical and Computer Engineering

Sensor Board Design

10Electrical and Computer Engineering

Prototyping

Arduino + SparkfunSensors and GPS

11Electrical and Computer Engineering

Technical Challenges – Data Accuracy

0

2

4

6

8

10

12

14

16

18

20

Chart TitleD

eg

rees

Gyroscope Drift Measured Over Five Minutes

Time

12Electrical and Computer Engineering

Technical Challenges – Data Accuracy

-150

-100

-50

0

50

100

150

Accelerometer Angle

Measured Angle

True Angle

De

gre

es

13Electrical and Computer Engineering

Technical Challenges – Data Accuracy

-150

-100

-50

0

50

100

150

Accelerometer Angle

Kalman Filtered Angle

Measured Angle

True Angle

De

gre

es

14Electrical and Computer Engineering

Measuring Kalman Filter Performance

SLOW TURN – 10 degrees per second

15Electrical and Computer Engineering

Measuring Kalman Filter Performance

FAST TURN – 50 degrees per second

16Electrical and Computer Engineering

Computation

17Electrical and Computer Engineering

Technical Challenges – Image Alignment

BAD

GOOD

18Electrical and Computer Engineering

OpenGL

Draws whole environment Call simple functions to update

camera location Example:

OpenGL only changes camera position since environment is already computed

// rotate 45 in z dirglRotatef(45.0f, 0.0f, 0.0f, 1.0f);

model->Draw();glFlush();

19Electrical and Computer Engineering

OpenGL

Camera

// rotate 45 in z dirglRotatef(45.0f, 0.0f, 0.0f, 1.0f);

Camera

Actual View Actual View

20Electrical and Computer Engineering

Display

21Electrical and Computer Engineering

Goggle-Based Display

http://www.microvision.com

22Electrical and Computer Engineering

Pico Projector Displays

• Image -> Electrical Signals• Electrical Signals drive RGB laser light: intensity & information• RGB + Combiner Optic = single modulated light path• Light output + MEMS Scanning Mirror = Image

23Electrical and Computer Engineering

Cost Schedule

Component Price Price per 1000

Sensor board components - GPS $35.00 $27.02 - Gyroscope $12.95 $6.35 - Microcontroller $10.25 $5.72 - Accelerometer/Compass $8.43 $3.97 - Other parts $14.37 $10.00 Total $81.00 $53.06

PCB Manufacturing $450.00 $150.00

Battery $50.00 $25.00

Total $581.00 $228.06

24Electrical and Computer Engineering

Timeline

25Electrical and Computer Engineering

Work in Progress

Developing Kalman Filter Testing/Debugging Sensor Board Developing final application

26Electrical and Computer Engineering

FPR

Final Application: PACMAN Sensor Board

• 3D Filter• Displacement

27Electrical and Computer Engineering

Demo Pictures

Tilt Right Tilt Left

28Electrical and Computer Engineering

Demo Pictures

Tilt Down Tilt Up

29Electrical and Computer Engineering

Demo Video

30Electrical and Computer Engineering

Questions