Using Google's Speech API

for Language Instruction

Paul DanielsKochi University of Technology

Outline Web Speech API

voice recognition

speech synthesis

learning activities o web-based recordero speech assessmento voice shadowingo chatbot

implementation & limitations

API – application programming interface

Your learningwebsite

• Share data between different applications

• Add new features to existing applications

Google’s APIs

Google API key

https://console.developers.google.com

Google Web Speech API

voice recognition

speech to text

speech synthesis text

to speech

Web-based speech synthesis

Chrome extensionsspeech synthesis

Human pronunciation

https://ssl.gstatic.com/dictionary/static/sounds/de/0/serendipitous.mp3

https://ssl.gstatic.com/dictionary/static/sounds/de/0/density.mp3

https://ssl.gstatic.com/dictionary/static/sounds/de/0/circumference.mp3

https://ssl.gstatic.com/dictionary/static/sounds/de/0/diameter.mp3

https://ssl.gstatic.com/dictionary/static/sounds/de/0/area.mp3

Voice recognition (speech-to-text)

Google Web Speech API

Google voice search

Web-based audio capture

Language learning applications

Web speech API & Audio capture

Web speech API & VoiceShadowing

Computerized speech assessment listen & record

Computerized speech assessment adding items

Computerized speech assessment speech analysis

Web Speech API & Chatbot

https://learn.core.kochi-tech.ac.jp/clever/

Speaking assessment

1. Listen: What is the diameter of the earth?

2. Record: The diameter of the earth is 12,742 km.

3. Speech-to-text: The diameter of the earth is 12,742 km.

4. Compare: Sample answers & speech-to-text results.

5. Feedback: You said “XXX” but the best answer is “YYY”.

Voice recognition & speaking assessment

http://learn.core.kochi-tech.ac.jp/speakingtext/index.html

Speech recognition games

http://iandevlin.com/examples/speechapi-video/

https://www.talater.com/annyang/

Sample code// Create the webkitSpeechRecognition object (speech interface)

var rec = new webkitSpeechRecognition();

// listening continuously,

rec.continuous = true;

// Start recognizing

rec.start();

When the recogniser has results, it returns data via an event accessed by the onresult handler:

rec.onresult = function(e) { for (var i = e.resultIndex; i < e.results.length; ++i) { if (e.results[i].isFinal) { } } }

Abstract

• Using Google’s Speech API, voice recognition (speech-to-text) and speech synthesis (text-to-speech) can be added to language learning activities. The presenter will demonstrate sample language learning activities that utilize the speech API including a web-based audio recorder, a voice shadowing app with speech recognition and an app that allows learner to practice speaking with a chatbot.

• http://updates.html5rocks.com/2013/01/Voice-Driven-Web-Apps-Introduction-to-the-Web-Speech-API

• http://updates.html5rocks.com/2014/01/Web-apps-that-talk---Introduction-to-the-Speech-Synthesis-API