Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building...

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Building Smart Applications with Conversational Interfaces and Language ServicesAlex Casalboni

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

About me

• Software Engineer & Web Developer• Startupper for 4.5 years• Serverless Lover & AI Enthusiast• ServerlessDays Organizer• AWS Customer since 2013

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Put machine learning in the hands of every developer

Our mission

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Our Approach

Customer-focusedroadmap (90%+)

Most popular frameworks (Tensorflow, MXNET)

200+ new launchesduring 2018

Wide range of services in production

Security and analytics capabiities

Embedded Research & Development

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

M L F R A M E W O R K S &

I N F R A S T R U C T U R E

Amazon ML Stack

A I S E R V I C E SR E K O G N I T I O N

I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N

V I D E O

Vis ion Speech Chatbots

A M A Z O N S A G E M A K E R

B U I L D T R A I N

F O R E C A S TT E X T R A C T P E R S O N A L I Z E

D E P L O YM L S E R V I C E S

F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e

E C 2 P 3 & P 3 d n

E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I CI N F E R E N C E

Language Forecast ing Recommendat ions

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

AI capabilitiesVision

Speech-to-Text (STT)

Text-to-Speech (TTS)

Natural Language Understanding

Language Translation

Uniform programming interfacefor text and voice apps

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

AI capabilities on AWS *Vision

Speech-to-Text (STT)

Text-to-Speech (TTS)

Natural Language Understanding

Language Translation

Chatbot Interface

Amazon Rekognition

Amazon Transcribe

Amazon Polly

Amazon Comprehend

Amazon Translate

Amazon Lex

* and more!

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Audio Input

End-to-end workloads (media)

trigger

store

in cascade

call aggregate analyze

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Add intelligent image and videoanalysis to your applications

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Deep Learning-Based Image and Video Analysis

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Optical Character Recognition (OCR)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Object & Scene Detection

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Facial Analysis

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Face Search/Comparison

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Marinus Analytics uses facial recognition to stop human trafficking

“Now with Traffic Jam’s FaceSearch, powered by

Amazon Rekognition, investigators are able to take effective action by

searching through millions of records in seconds to find

victims.”

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Discover insights and relationships in text

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

NLU Functionalit ies

Sentiment Entities LanguagesKeyphrases Topic

modeling

Syntax

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

EnglishItalianFrench

GermanPortuguese

Suppor ted Languages

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Syntax detection$ aws comprehend detect-syntax

--language-code 'en' --text 'I love cloud!’{

"SyntaxTokens": [

{

"TokenId": 1,

"Text": "I",

"BeginOffset": 0,

"EndOffset": 1,

"PartOfSpeech": {

"Tag": "PRON",

"Score": 0.9999802112579346

}

},

...

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Sentiment Analysis$ aws comprehend detect-sentiment

--language-code 'en' --text 'I love cloud!’

{

"Sentiment": "POSITIVE”,

"SentimentScore": {

"Mixed": 0.012617903761565685,

"Positive": 0.9599817991256714,

"Neutral": 0.021758323535323143,

"Negative": 0.005641999188810587

}

}

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

« Amazon Comprehend helps us analyzethe key sentiments, objects, and geos in our30 million plus reviews & testimonies. Nowwe are able to discover new insights into theunique experiences available at eachproperty, so our customers can make thebest decision possible for their travel.”

Matt Fryer, VP and Chief Data Science Officer, Hotels.com

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Extract health information from patient notes, clinical trial reports, and other electronic health records

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Turn text into lifelike speech using deep learning

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Amazon Polly

• Content creation• Mobile & desktop

applications• Internet of Things (IoT)• Education & e-learning• Telephony• Game development

Use cases

• 58 voices across 28 languages

• Lip-syncing & text highlighting

• Fine-grained voice control• Custom vocabularies• Available in 17 AWS Regions

Key features

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

“With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices

available on the market.”

Severin HackerCTO, Duolingo

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Yes, natural language translation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Supported languages *

ArabicSimplified Chinese

FrenchGermanSpanish

Portuguese

JapaneseTraditional Chinese

ItalianRussianTurkishCzech

* 417 translation combinations

DanishDutchFinnishSwedishPolish

Hebrew

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

«We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believethat Amazon Translate presents a quick, efficient and most importantly, accuratesolution. »

Matt Fryer, VP and Chief Data Science Officer, Hotels.com

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Turn speech into text

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

EnglishItalianFrenchSpanish

Portuguese

Suppor ted Languages

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Use cases

Call centers

Subtitles for VOD

Broadcast closed captions

Transcribe meetings

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

ringDNA• End-to-end communications platform for

sales teams. • Hundreds of enterprise organizations

use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate.

Speech to Text"A critical component of RingDNA’s Conversation AIrequires best of breed speech-to-text to delivertranscriptions of every phone call. RingDNA isexcited about Amazon Transcribe since itprovides high-quality speech recognition at scale,helping us to better transcribe every call to text "

Howard Brown, CEO & Founder, RingDNA

https://www.youtube.com/watch?v=1ZJ_f1bDdog

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Conversational interfaces for your applications powered by the same deep learning technologies as Alexa

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Amazon Lex

End to End

Speech to Intent

ASR+NLU integrated into one

API

Dialog Management

Native support &maintains context

Text to Speech

Amazon Polly integrated into API

Business Logic

Native integration with AWS Lambda

Deployment

One click deployment

Security

Encrypted data in transit & at rest

Scale

Completely managed service

Analytics

Monitor and improve

End to End

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

OCR++ service to extract data from virtually any document(No ML experience required)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Amazon Textract: How it works

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Accurate time-series forecasting service(No ML experience required)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

The perils of poor predictions in forecasting

TIME

SALES

FORECAST

SALES

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Historical dataSupply chain, inventory, etc.

Customized forecasting API

Inspect data

Identify features

Selectfrom 8

algorithms

SelectHyperparameters

Host models

Loaddata

Trainmodels

Optimizemodels

Related “causal” dataWeather, special offers, product

details

Amazon Forecast

Amazon Forecast: How it works

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Real-time personalization and recommendation service(No ML experience required)

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

Activity stream from app

Views, signups, conversion, etc.

InventoryArticles, products,

videos, etc.

Demographics (optional)

LOAD DATA(EMR Cluster)

INSPECT DATA

IDENTIFY FEATURES

SELECTALGORITHMS

SELECTHYPERPARAMETERS

TRAINMODELS

OPTIMIZEMODELS

HOST MODELS

BUILD FEATURESTORE

CREATEREAL-TIME

CACHES

Customizedpersonalization &recommendation

API

F u l l y m a n a g e d b y A m a z o n P e r s o n a l i z e

Amazon Personalize

Age, location, etc.

Amazon Personalize: How it works

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.