Java-Based In-Car Cell Phone Integration

By: Chris KellerGreg NehusMatt Odille

High-Level View

Project Summary

Project Summary

• There continues to be many accidents attributed to cell phone use while driving

• Text messaging is perhaps the most dangerous

• Our project improves safety of communication while driving– Streams phone conversations– Accepts commands via voice– Dictates text messages

• We will implement the software and a GUI

Project Summary

• Primary Research:– Bluetooth in Java– Bluetooth Protocol– AT Commands– Java Speech API

• Why we chose this:– To learn how Bluetooth is implemented– To deepen our Java knowledge– To build something tangible that works

Specific Aims

Specific Aims

• Four main goals of the project1) To learn how Bluetooth communications

are implemented2) To investigate how Bluetooth is already

being used in automobiles3) Implement and improve the preexisting

uses (via text message dictation and synthesizing)

4) Improve safety of driving while using cell phones

Background and Motivation

Background and Motivation

• All group members are Computer Engineering majors with focus on software

• Relevant Courses:– COE 401, Intermediate Programming

using Java– COE 445, Data Structures– COE 1501, Algorithm Implementation– COE 1186, Software Engineering– COE 1185, Computer Systems Interfacing

Background & Motivation

• We’re motivated to do more than small Java applications

• Co-op experience– Greg - ANSYS– Matt - Vocollect– Chris – ANSYS

• We’re interested in cell phone, Bluetooth, and automobile technology

Preliminary Work/Design Possibilities

Preliminary Work/Design Possibilities

• Combine our code with preexisting technologies– BlueCove Java Bluetooth Libraries– CloudGarden TalkingJava SDK– Broadcom’s Widcomm Bluetooth Software

Design Approach

Design Approach

• Java Setup– Java is a general-purpose, class-based,

object-oriented language– Must install the following on all

development computers:• Java Runtime Environment• Java Development Kit

– This gives us the software to develop and run Java applications

Design Approach

• Integrated Development Environment (IDE)– Using the same IDE will make combining

individual code easier– We will be using NetBeans 6.5

• Editor• Version Control integration• Syntax highlighting• Etc.

Design Approach

• Version Control

Design Approach

• Bluetooth Communication– Prerequisite: BlueCove Java Bluetooth

Library• Java does not come packaged with any

libraries that allow interfacing with the computer’s Bluetooth stack. The BlueCove library will give us that capability.

Design Approach

• Bluetooth Communication– Five parts to the anatomy of a Bluetooth

application1) Stack Initialization2) Device Discovery3) Device Management4) Service Discovery5) Communication

Design Approach

1) Stack Initialization– Must be done prior to any attempts at

Bluetooth communication– Initializes

• Port• Baud Rate• Bluetooth mode

Design Approach

2) Device Discovery– Allows the computer to get a list of

nearby Bluetooth devices (our phone).– Example code:

Design Approach

3) Device Management – Allows the computer to access properties

of the phone– This piece of code obtains the MAC

Address a BT device– Example code:

Design Approach

4) Service Discovery– Determine what services and protocols

are available on the phone

5) Communication– At this point, a Bluetooth connection is

established and communication can begin.

– To control the cell phone, we will use AT Commands

Design Approach

• Example dialogue of communication via AT commands– Phone:

• +CMTI: <mem>,<index> • “I have a new text message”

– PC:• AT+CMGR=<index> • “Give me it!”

– Phone would then return the text message in a PDU encoded form. We must decode this in our application

Design Approach

• Speech-to-Text (STT)– Improved safety with hands-free control

over cell phone– Interprets voice commands– Whole companies exist based on writing

STT algorithms (Vocollect)– We will utilize the Java-based

CloudGarden software development kit

Design Approach

• Text-to-Speech (TTS)– This will also be accomplished by utilizing

the CloudGarden software

Milestones and Schedule

Management Plan

Management Plan• Week 1

– Chris: Finish preliminary research and project proposal

– Matt: Finish preliminary research and project proposal

– Greg: Finish preliminary research and project proposal

• Week 2– Chris: Progress report on non-technical issues– Matt: Create use case diagrams– Greg: Begin rudimentary communication

between computer and phone

Management Plan

• Week 3– Chris: Testing of established

communication between computer and phone

– Matt: Install and learn basics of CloudGarden voice software

– Greg: Finish communication between computer and phone

Management Plan

• Week 4– Chris: Utilize CloudGarden to begin

implementing voice commands, progress report technical issues

– Matt: Begin GUI design and coding, progress report technical issues

– Greg: Utilize CloudGarden to begin implementing voice commands, progress report technical issues

Management Plan

• Week 5– Chris: Finish implementation of voice

commands– Matt: Finish GUI– Greg: Begin incorporation of Broadcom

• Week 6– Chris: Begin final report– Matt: Test design at this stage– Greg: Finish Broadcom incorporation

Management Plan

• Week 7– Chris: Finish final report– Matt: Any remaining technical tasks– Greg: Begin final presentation

• Week 8– Chris: Final Presentation– Matt: Final Presentation– Greg: Final Presentation

Expected Problems and Solutions

Expected Problems & Solutions

• Voice Recognition Accuracy– Problem: Speech dictations are not

always 100% accurate.– Solution: Use Levenshtein Distance

Algorithm for string similarity calculations.

– Example code:

Expected Problems & Solutions

• Software Compatibility Issues with CloudGarden– Problem: The CloudGarden TalkingJava

SDK installation requires a specific outdated version of the Java Runtime Environment (JRE).

– Solution: Uninstall any existing versions of Java and temporarily install JRE 1.4.2.

Expected Problems & Solutions

• Incorporating Broadcom software– Problem: Streaming phone calls or

stereo audio over Bluetooth is an extremely difficult task. Solutions exist, by companies such as Broadcom, but even their development kit fails to state how this is accomplished.

– Solution: We will utilize Broadcom’s existing application to accomplish the task of passing audio from a phone call to the computer’s speakers.

Estimated Costs

Estimated Costs

• Software:– TalkingJava SDK License (academic) =

$14 per license

• Hardware:– Microphone - $10– Bluetooth adapter - $12– Computer for developing and testing –

N/A– Bluetooth-enabled cell phone – N/A

• Total Estimated Cost = $64

Thank you for your time.

- Chris Keller Greg Nehus Matt Odille