Saya Web Interface Project

Edward Rafaelov &

Vladimir Postel

DEC. 2007

Advisors: Prof. Shlomi Dolev & Michael Orlov

IntroductionThe goals of our project are: Remote control some of Saya’s features and

devices. Remote communication with Saya: Present video and audio captured from the

camera that is located inside the left eye and microphone that connected to Saya.

Provide possibility to send messages to Saya Increase popularity of Saya project by:

Providing information about the Saya project. Make some of the features accessible to everyone.

ImplementationThe site was created by using several development tools: Html / Dhtml and CSS for creation and design of web pages. Javascript PHP was used for ssh2 and socket TCP/IP connections, some

of the functions were implemented in PHP. Java – JMF and RTP: audio and video transmission servers,

capturing and transferring media streams to users.

TCP/IP servers on the computers of Saya that communicate with the web site.

RxTx java library - Connection to neck and eyes DC motors via RS232

Java Applet - receiving and presenting video and audio streams from camera and microphone in real time.

Architecture of Audio And Video transmission Architecture of Audio And Video transmission processesprocesses..

5) Audio is transmitted to clients IP.

3) Client’s IP is sent to the transmitting computers.

6) The applet runs, and presents the streams, (audio and video), from both transmitters.

1) Client enters the site that is on the server.

2) The Applet is downloaded to client’s host.

RTP R

TP

server

user

4) Gets message with client’s IP, creates connection & start transmitting. When client exits closes the connection.

Saya1Saya2

Audio

Video

Saya1Sentry

Eyes Compressor

Com2

Rx-Tx

Architecture of connection to Sentry, Execution of commands and eyes initialization

User

2) Commands that client chooses are executed on sentry

1) Client enters the site that is on the server, Opens a page that provides control over Sentry.

Site on apache

3) Server that runs on Saya1 gets eyes initialization request, connects to eyes via com2 port and runs initialization commands.

status

Video

Site on apache

Architecture of 'Communication' with SayaArchitecture of 'Communication' with Saya

Answer

Message

to Saya

Saya 2

1) 1) Client enters the site,Client enters the site,Opens a page that Opens a page that provide ability to send provide ability to send messages to Saya.messages to Saya.

2) Message is received by 2) Message is received by the server on Saya2 the server on Saya2 and processed by Saya2and processed by Saya2

user

Audio & speech recognition

Conclusion Humanoid robots are very attractive. Most people are

excited by communicating with the robots. Making Saya more realistic and practical will receive

more attention and interest, so many additional helpful features could be developed.

For future development of the project, additional options can be added: Ability to recognize people who have Bluetooth technology cell

phones, by managing a database of people with cell phone numbers.

When a person with Bluetooth passes near Saya, his name can be found in the data base and he will be greeted by Saya.

The site can grow to a portal. Links to other projects about Saya can be added. Control and Configuration of Saya’s features can be done via

the web.

ScreenShotsSentrySentry – power controller of eyes and compressor.

Functions: turning on & off, rebooting, status.

Media galleryMedia gallery - containing pictures, Press releases and TV videos about Saya.

Video & Audio display (applet)