AWS re:Invent 2017 ML re:Cap - Amazon Web Servicesaws-de-media.s3-eu-west-1.amazonaws.com/images/Startup... · 2017-12-12 · Open source deep learning interface which allows developers

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Christian Petters, Solutions Architect

December 2017

AWS re:Invent 2017 ML re:Cap

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Frameworks &

Infrastructure

AWS Deep Learning AMI

GPU(P3 Instances)

MobileCPUIoT

(Greengrass)

Vision:

Rekognition Image

Rekognition Video

Speech:

Polly

Transcribe

Language:

Lex Translate

Comprehend

Apache

MXNetPyTorch

Cognitive

ToolkitKeras

Caffe2

& CaffeTensorFlow Gluon

AWS ML Stack

Application

Services

Platform

Services

Amazon Machine

Learning

Mechanical

Turk

Spark &

EMR

Amazon

SageMakerAWS

DeepLens

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Frameworks &

Infrastructure

AWS Deep Learning AMI

GPU(P3 Instances)

MobileCPUIoT

(Greengrass)

Vision:

Rekognition Image

Rekognition Video

Speech:

Polly

Transcribe

Language:

Lex Translate

Comprehend

Apache

MXNetPyTorch

Cognitive

ToolkitKeras

Caffe2

& CaffeTensorFlow Gluon

AWS ML Stack

Application

Services

Platform

Services

Amazon Machine

Learning

Mechanical

Turk

Spark &

EMR

Amazon

SageMakerAWS

DeepLens

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon RekognitionImage Recognition and Analysis powered by

Deep Learning allows search, verification,

and organization millions of images

Potential Use Cases

Searchable Image Library Detect Inappropriate Content in Images

Face-based User Verification Sentiment Analysis

Facial Recognition Celebrity Identification

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Rekognition Video Analysis Service

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Continuous Feature Releases

Real-Time Face Recognition

Crowd-Mode Face Detection

Support for Recognition of Text

Improved Face Detection

Image Moderation

Celebrity Detection

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon PollyTurn text into lifelike speech using deep

learning technologies to synthesize

speech that sounds like a human voice

Potential Use Cases

Content Creation Education & E-learning

Mobile & Desktop Applications Customer Contact Center

Internet of Things (IoT) Accessibility

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Language ServicesSeveral new services launched to

speed the development of language

processing and translation in

applications

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Transcribe (Preview)Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for

developers to add speech to text capability to their applications

Time StampsSupport for both

regular & telephony

audio

Punctuation

& formatting

§

S3 Integration Recognize

Multiple

Speakers

Custom

Vocabulary

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Comprehend: Natura l Language

Process ing

😃

Sentiment Entities Languages Key phrases Topic modeling

POWERED BY DEEP

LEARNING

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A m a z o n . c o m , I n c . i s l o c a t e d i n

S e a t t l e , W A a n d w a s f o u n d e d J u l y

5 t h , 1 9 9 4 b y J e f f B e z o s . O u r

c u s t o m e r s l o v e b u y i n g e v e r y t h i n g

f r o m b o o k s t o b l e n d e r s a t g r e a t

p r i c e s

N a m e d E n t i t i e s

• A m a z o n . c o m : O r g a n i z a t i o n

• S e a t t l e , W A : L o c a t i o n

• J u l y 5 t h , 1 9 9 4 : D a t e

• J e f f B e z o s : P e r s o n

K e y p h r a s e s

• O u r c u s t o m e r s

• b o o k s

• b l e n d e r s

• g r e a t p r i c e s

S e n t i m e n t

• P o s i t i v e

L a n g u a g e

• E n g l i s h

A m a z o n C o m p r e h e n d : E x t r a c t I n s i g h t f r o m Te x t

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Translate: Machine Translation

Neural Machine Translation between English and:

• Spanish

• Portuguese

• Chinese

• French

• German

• Arabic

… with more languages to follow

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

F u l l y m a n a g e d T o p i c

m o d e l i n g s e r v i c e

E x t r a c t u p t o 1 0 0 t o p i c s

f r o m a c o r p u s o f d o c u m e n t s

A u t o m a t i c a l l y o r g a n i z e s

d o c u m e n t s i n t o t h e t o p i c s

Amazon Comprehend: Topic Model ing

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Example of translating between languages:

Context aware: knows not to

translate “Amazon” to

“Amazonas“ (Amazon Jungle)

Learns to re-order words &

phrases according to the

grammar of each language

"Amazon Web Services is a collection of cloud computing services"

“Amazon Web Services es una colección de servicios de computación en la nube”

Amazon Translate: Machine Translation

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon LexConversational interfaces for your

applications, powered by the same

Natural Language Understanding

(NLU) & Automatic Speech Recognition

(ASR) models as Alexa

Potential Use Cases

Appointment Booking Customer Support

Informational Services Access Enterprise Data

Chatbots Voice Assistant

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Frameworks &

Infrastructure

AWS Deep Learning AMI

GPU(P3 Instances)

MobileCPUIoT

(Greengrass)

Vision:

Rekognition Image

Rekognition Video

Speech:

Polly

Transcribe

Language:

Lex Translate

Comprehend

Apache

MXNetPyTorch

Cognitive

ToolkitKeras

Caffe2

& CaffeTensorFlow Gluon

AWS ML Stack

Application

Services

Platform

Services

Amazon Machine

Learning

Mechanical

Turk

Spark &

EMR

Amazon

SageMakerAWS

DeepLens

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon SageMaker

A fully managed service that enables data scientists and developers to quickly and

easily build machine-learning based models into production smart applications.

1 2 3 4

I I I I

Notebooks Service Algorithms Training Service Hosting Service

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Sagemaker: High Performance ML Algorithms

• Many of the current ML algorithms do not scale well

• Managing DL algorithms at scale is a different challenge

• Our goal: Provide common ML algorithms that outperform

current implementations by 10x (faster). Algorithms such as:

• Matrix Factorization, Regression, Principle

Component Analysis, K-Means Clustering, Gradient

Boosted Machines, and more

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

A new way to learn

Custom built for deep learning

Broad Framework Support

Deploy models from Amazon SageMaker

Integrated with AWS

Full programmable with AWS Lambda

AWS DeepLens ( G A)W o r l d ’ s f i r s t d e e p l e a r n i n g e n a b l e d v i d e o c a m e r a f o r d e v e l o p e r s

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Vision:

Rekognition Image

Rekognition Video

Speech:

Polly

Transcribe

Language:

Lex Translate

Comprehend

AWS ML Stack

Application

Services

Frameworks &

Infrastructure

AWS Deep Learning AMI

GPU(P3 Instances)

MobileCPUIoT

(Greengrass)

Apache

MXNetPyTorch

Cognitive

ToolkitKeras

Caffe2

& CaffeTensorFlow Gluon

Platform

Services

Amazon Machine

Learning

Mechanical

Turk

Spark &

EMR

Amazon

SageMakerAWS

DeepLens

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Support for all major frameworks

AWS Deep Learning AMI

Apache MXNet

Torch

Cognitive

ToolkitKeras

TheanoCaffe2

& Caffe

TensorFlow

Amazon EC2

AnacondaIntel MKL

Nvidia CUDA &

cuDNN

Python2 &

Python3

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Open source deep learning interface which allows

developers to easily and quickly build machine learning

models, without compromising performance

Provides a clear, concise API for defining machine

learning models using a collection of pre-built, optimized

neural networks

Developers will find this interface familiar, since machine

learning models can be defined and manipulated just

like any other data structure

Data scientists and researchers will value the ability to

build prototypes quickly and utilize dynamic neural

network graphs for entirely new model architectures

AWS and Microsoft

announced Gluon

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Model

Training

Inference

in the Cloud

Inference

at the Edge

Infrastructure to support model build and deploy

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Train model in the cloud Run model at the edge

AWS

Greengrass

AWS IoT

Tesla V100

120 TFLOPS

Amazon

EC2

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Fully integrate ML services into your applications, leveraging your

existing business data assets, your streaming data, your data lakes,

and your operational systems

Use blueprints for what has been done to achieve what is possible...

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Questions!