ContentsContents

What is What is BlueEyeBlueEye technology ? technology ? What is What is BlueEyesBlueEyes ? ? System designingSystem designing System overviewSystem overview DAUDAU CSUCSU Data securityData security IBM researchIBM research ConclusionConclusion

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign•System implementation•Futureimprovements•Project worksummary•Systemdemonstration

What is blue eye What is blue eye technology ?technology ? The BLUE EYES technology The BLUE EYES technology

aims at creating aims at creating computational machines that computational machines that have perceptual and sensory have perceptual and sensory ability like those of human ability like those of human beings.beings.

  

How can we make How can we make computers “see” and computers “see” and “feel” ?“feel” ? Blue eyes uses sensing technology to Blue eyes uses sensing technology to

identify a user’s actions and to extract identify a user’s actions and to extract key information.key information.

Information is then analyzed to Information is then analyzed to determine the user’s physical, determine the user’s physical, emotional, or informational state.emotional, or informational state.

What is What is BlueEyesBlueEyes ? ? The complex solution for human-operator monitoring:The complex solution for human-operator monitoring:

– Visual attention monitoringVisual attention monitoring– Physiological conditionPhysiological condition– Operator’s position detectionOperator’s position detection– Wireless data acquisition using bluetoothWireless data acquisition using bluetooth– Recorded data playbackRecorded data playback

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign•System implementation•Futureimprovements•Project worksummary•Systemdemonstration

DesigningDesigning A personal area network for A personal area network for

linking all the operators and the linking all the operators and the supervising systemsupervising system

Two major units Two major units - DAU (data acquisition unit )DAU (data acquisition unit )- CSU (central system unit )CSU (central system unit )

•Motivation

•Physiological foundations•Systemdesign•System implementation•Futureimprovements•Project worksummary•Systemdemonstration

System overviewSystem overviewCentral System UnitData Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

ConnectionManager

Data Analysis

VisualizationModuleBluetooth Bluetooth

Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.

DataLogger

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign

•System implementation•Futureimprovements•Project worksummary•Systemdemonstration

•Objectives•System overview•DAU•CSU

ID card

DAU - componentsDAU - components

MC 145483PCM codec

ID cardinterface

Simplekeyboard

Jazz Multisensor

Beeper

LCD display

LED indicators

Atmel 89C52microcontroller

UART MAX232

UART

Bluetoothmodule

microphoneearphone

DAU - featuresDAU - features

LightweightLightweight Runs on batteries - low Runs on batteries - low

power consumptionpower consumption Easy to use - does not Easy to use - does not

disturb the operator disturb the operator workingworking

ID cards for operator ID cards for operator authorizationauthorization

Voice transmission using Voice transmission using hardware PCM codechardware PCM codec

Data Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

Bluetooth

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign

•System implementation•Futureimprovements•Project worksummary•Systemdemonstration

•Objectives•System overview•DAU•CSU

CSU – componentsCSU – components CONNECTION MANAGER – main task to CONNECTION MANAGER – main task to

perform low-level blue tooth communicationperform low-level blue tooth communication DATA ANALYSIS MODULE – performs the DATA ANALYSIS MODULE – performs the

analysis of the raw sensor data in order to analysis of the raw sensor data in order to obtain information about operator’s obtain information about operator’s physiological conditionphysiological condition

DATA LOGGER MODULE – provides support DATA LOGGER MODULE – provides support for storing the monitored data.for storing the monitored data.

VISULAIZATION MODULE – provides user VISULAIZATION MODULE – provides user interface for the supervisors interface for the supervisors

CSU - featuresCSU - featuresCentral System Unit

ConnectionManager

Data Analysis

VisualizationModuleBluetooth

Connection Connection managementmanagement

Data Data processingprocessing

VisualizationVisualization Data recordingData recording AccessAccess

verification verification

ConnectionManager

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign

•System implementation•Futureimprovements•Project worksummary•Systemdemonstration

ystem overview•DAU•CSU

DataLogger

Data securityData security

Only registered mobile devicesOnly registered mobile devicescan connect to the systemcan connect to the system

Bluetooth connection authenticationBluetooth connection authentication Access rights restrictionsAccess rights restrictions Personal and physiological data Personal and physiological data

encryptionencryption

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign

SecurityFutureimprovements

•Project worksummary•Systemdemonstration

Current DevelopmentsCurrent Developments BLUE EYE – EMOTIONAL MOUSEBLUE EYE – EMOTIONAL MOUSE MAGIC pointingMAGIC pointing

BLUE EYE enabled SUITOR BLUE EYE enabled SUITOR Becomes active when the user makes Becomes active when the user makes an eye contact and automatically an eye contact and automatically detect users area of interest and start detect users area of interest and start searching it.searching it.

ConclusionConclusion In the near future, ordinary In the near future, ordinary

household devices- such as household devices- such as television, refrigerators, ovens television, refrigerators, ovens may be able to do their jobs when may be able to do their jobs when we look at them and speak to we look at them and speak to them.them.

Future applications of blue eye Future applications of blue eye technology is limitlesstechnology is limitless

QUESTIONS

Thank you Thank you

BlueEyes BlueEyes TechnologyTechnology

•Motivation•What isBlueEyes ?•Physiological foundations•Systemdesign•System implementation•Systemdemonstration •Futureimprovements•Project worksummary