The Eye Mouse

John Guy Electrical EngineeringBrian Figueroa Computer EngineeringJeff Tott Computer EngineeringBrian Reed Electrical EngineeringJames Loftus Computer Engineering

Technical Approach

Electrodes

The retina is electrically active compared to the rest of the eyeball, so there is a measurable potential difference between it and the cornea. Electrodes will be placed on the skin around the eye socket, and measures of changes in the orientation of this potential differences will be made In combination with software and an optical approach described below it is hoped the accuracy of responses to eye movements can be heightened.

Optical Processing

In combination with the electrodes a non-contacting camera that observes the eyeball plus image processing techniques to interpret the picture will be used. By tracking a visible feature of the eyeball the position of the eyeball can be identified. This can be done with sophisticated image processing and pattern recognition techniques.

Abstract

Use of the human eye as a input device for personal computing remains a largely untapped field. This design project shall attempt to explore this field further by developing a low-cost input device to be usable by an average PC user. The team shall attempt to combine electro-oculography (EOG, or potential difference across the face) measurements and optical image processing to emulate a basic PC mouse.

An apparatus shall be designed and built to perform this tracking and emulate a standard PC mouse via serial, PS/2, or USB interface. This device will comprise electrodes attached to the subject’s face to measure potential difference changes along with a camera component to provide auxiliary data to a signal-processing box. Hopefully, such an apparatus will allow for alternative pointer control options for the PC.

Introduction

General Background

This project is intended to develop a computer “mouse” system that is controlled by the user’s eye movement. The envisioned system will allow a person to use applications such as Microsoft Word to perform usual tasks easily and efficiently.

Technical Problem• System accuracy

• Implementation of auto-recalibration

• Head movement

• How to analyze and interpret data optimally from electrodes

Operating Environment• Normal household conditions

• Personal computer running Microsoft Windows

Intended Users and Uses• Handicapped and non-handicapped users

• Take place of an ordinary mouse

Assumptions and Limitations• User has eyes that can be detectable by imaging device

• Imaging device does not have infinite refresh rate

Design Requirements

Design Objectives• Emulation of PC mouse

• Cost effective hardware

• Combine electro-oculography with image processing

• Intuitive / automatic calibration routines

Functional Requirements• Movement of cursor via eye tracking alone

• Method of “clicking” the mouse

• Interface for calibration/configuration

Design Constraints•Comfortable for long-term use

•Suitable for office use

Measurable Milestones•Capture electro-oculography data to PC

•Add calibration routines

•Add image processing component

•Polish software and hardware for release

End-Product Description

The “eye mouse” tracking device will offer a viable alternative to traditional manual mice for manipulation of popular PC graphical user interfaces. The device shall utilize both direct measurement of movement of a user’s eyes as well as a vision camera system to track movements visually and shall interface to common PCs via USB, PS/2 or serial ports. The end product will consist of electrodes, a camera fixture, and a external box containing signal processing and PC interface components.

Testing Approach

•The software will be tested before integration with eye tracking device

•Eye movements will be tested to see affects on cursor movements

•Testing on affect of head movement will be made

Budget and Personnel Effort

Personnel Effort (Total = 384 hrs)

65 70 75 80 85

John Guy

James Loftus

Jeff Tott

Brian Figueroa

Brian Reed

Estimated Total Cost

$400

$50$50 $100

Software

Equipment & Parts

Printing

Telephone & Postage

Vertical Axis

Horizontal Axis

Client: Senior DesignProject: May 03-24

Faculty Advisors:Dr. J. Davidson, CprEDr. A. Dogandžic, CprE