Embed Size (px)
Citation preview
VOICE INTERFACESSW MOBILE - MARCH 2016
THE FUTURE OF UI
AS SOFTWARE BECOMES MORE AND MORE PART OF OUR DAILY LIVES SO THE INTERFACES NEED TO SEAMLESSLY INTEGRATE
VOICE WILL NOT REPLACE PHYSICAL INPUTS
▸ Voice is not a replacement for keyboards and mice
▸ You won’t be writing your CV with voice anytime soon
▸ However the use cases like ordering a pizza or controlling lights are ideally suited to voice.
FORGET EVERYTHING YOU KNOW ABOUT INTERFACES
DON’T REPLACE MENUS BUTTONS AND FORMS WITH VOICE
▸ Voice interfaces need to be re-thought from the initial use case
▸ Right now the base model is that of an assistant instead of a form.
▸ Most of the engines use natural language parsing so a user can phrase a command many ways
PLATFORMS
SIRI
▸ Launched Oct 2011
▸ iOS Only
▸ Still a closed platform
▸ Main use is controlling iPhone functions
▸ Only integrations are via Home Kit
GOOGLE NOW (OK GOOGLE)
▸ Launched July 2012
▸ Android, iOS and Chrome
▸ “Personalised Search”
▸ Now On Tap can interact with the phones current screen, Apps can also create their own cards
CORTANA
▸ Launched April 2014
▸ Windows, Xbox, Android*, iOS* - *US Only
▸ PA for Microsoft Systems and Services
▸ Limited ‘Partner’ 3rd Party Integration
THESE PLATFORMS ARE ALL CENTERED AROUND A VIRTUAL PA
THIS IS WHERE WE ARE TODAY WITH VOICE
ALEXA
▸ Amazons Platform
▸ Originally Just the Echo
▸ Built as a Home Assistant not part of a phone.
▸ Probably the most ‘open’ platform today
ALEXA VOICE SERVICE
▸ Amazon Developer API’s to add an Alexa Client to ‘anything’
▸ Record Speech
▸ Send to API
▸ Playback Response
▸ Still in ‘Developer Preview’
“THE $10 ECHO”
▸ Used a CHIP with the mic mod along with a basic button to create a client for the Amazon Echo
▸ Python script watching GPIO for button press, then record audio and post to Amazon AVS
▸ Playback response from amazon via speaker.
▸ Now Ported to The Raspberry Pi as AlexaPi
ALEXAWEB & CALL ALEXA
▸ Alexa running in a browser using WebRTC technology to grab voice
▸ https://alexaweb.herokuapp.com
▸ Alexa on the end of a Phone
▸ Call 07520 615900
OTHER NOTABLE MENTIONS
▸ Jasper - Raspberry Pi Open Source Project to control ‘anything’
▸ Vaani - Mozilla Project for connected devices.
▸ Jarvis - Open Source PA project
ALEXA SKILLS KIT
▸ These are Alexa’s ‘Apps’
▸ Launched Aug 2015
▸ The store still has very limited functionality
▸ Orchestration of Multiple Apps on one Alexa account is not quite right yet
ALEXA SKILLS KIT
▸ Skills are best built on Lambda but can be your own HTTPS server
▸ Alexa passes the app a JSON object with commands
▸ App returns text to be spoken or audio file
