of 26/26
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Christian Petters, Solutions Architect December 2017 AWS re:Invent 2017 ML re:Cap

AWS re:Invent 2017 ML re:Cap - Amazon Web Servicesaws-de-media.s3-eu-west-1.amazonaws.com/images/Startup... · 2017-12-12 · Open source deep learning interface which allows developers

  • View
    0

  • Download
    0

Embed Size (px)

Text of AWS re:Invent 2017 ML re:Cap - Amazon Web...

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Christian Petters, Solutions Architect

    December 2017

    AWS re:Invent 2017 ML re:Cap

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Frameworks &

    Infrastructure

    AWS Deep Learning AMI

    GPU(P3 Instances)

    MobileCPUIoT

    (Greengrass)

    Vision:

    Rekognition Image

    Rekognition Video

    Speech:

    Polly

    Transcribe

    Language:

    Lex Translate

    Comprehend

    Apache

    MXNetPyTorch

    Cognitive

    ToolkitKeras

    Caffe2

    & CaffeTensorFlow Gluon

    AWS ML Stack

    Application

    Services

    Platform

    Services

    Amazon Machine

    Learning

    Mechanical

    Turk

    Spark &

    EMR

    Amazon

    SageMakerAWS

    DeepLens

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Frameworks &

    Infrastructure

    AWS Deep Learning AMI

    GPU(P3 Instances)

    MobileCPUIoT

    (Greengrass)

    Vision:

    Rekognition Image

    Rekognition Video

    Speech:

    Polly

    Transcribe

    Language:

    Lex Translate

    Comprehend

    Apache

    MXNetPyTorch

    Cognitive

    ToolkitKeras

    Caffe2

    & CaffeTensorFlow Gluon

    AWS ML Stack

    Application

    Services

    Platform

    Services

    Amazon Machine

    Learning

    Mechanical

    Turk

    Spark &

    EMR

    Amazon

    SageMakerAWS

    DeepLens

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon RekognitionImage Recognition and Analysis powered by

    Deep Learning allows search, verification,

    and organization millions of images

    Potential Use Cases

    Searchable Image Library Detect Inappropriate Content in Images

    Face-based User Verification Sentiment Analysis

    Facial Recognition Celebrity Identification

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Rekognition Video Analysis Service

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Continuous Feature Releases

    Real-Time Face Recognition

    Crowd-Mode Face Detection

    Support for Recognition of Text

    Improved Face Detection

    Image Moderation

    Celebrity Detection

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon PollyTurn text into lifelike speech using deep

    learning technologies to synthesize

    speech that sounds like a human voice

    Potential Use Cases

    Content Creation Education & E-learning

    Mobile & Desktop Applications Customer Contact Center

    Internet of Things (IoT) Accessibility

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Language ServicesSeveral new services launched to

    speed the development of language

    processing and translation in

    applications

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon Transcribe (Preview)Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for

    developers to add speech to text capability to their applications

    Time StampsSupport for both

    regular & telephony

    audio

    Punctuation

    & formatting

    §

    S3 Integration Recognize

    Multiple

    Speakers

    Custom

    Vocabulary

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon Comprehend: Natura l Language

    Process ing

    😃

    Sentiment Entities Languages Key phrases Topic modeling

    POWERED BY DEEP

    LEARNING

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    A m a z o n . c o m , I n c . i s l o c a t e d i n

    S e a t t l e , W A a n d w a s f o u n d e d J u l y

    5 t h , 1 9 9 4 b y J e f f B e z o s . O u r

    c u s t o m e r s l o v e b u y i n g e v e r y t h i n g

    f r o m b o o k s t o b l e n d e r s a t g r e a t

    p r i c e s

    N a m e d E n t i t i e s

    • A m a z o n . c o m : O r g a n i z a t i o n

    • S e a t t l e , W A : L o c a t i o n

    • J u l y 5 t h , 1 9 9 4 : D a t e

    • J e f f B e z o s : P e r s o n

    K e y p h r a s e s

    • O u r c u s t o m e r s

    • b o o k s

    • b l e n d e r s

    • g r e a t p r i c e s

    S e n t i m e n t

    • P o s i t i v e

    L a n g u a g e

    • E n g l i s h

    A m a z o n C o m p r e h e n d : E x t r a c t I n s i g h t f r o m Te x t

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon Translate: Machine Translation

    Neural Machine Translation between English and:

    • Spanish

    • Portuguese

    • Chinese

    • French

    • German

    • Arabic

    … with more languages to follow

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    F u l l y m a n a g e d T o p i c

    m o d e l i n g s e r v i c e

    E x t r a c t u p t o 1 0 0 t o p i c s

    f r o m a c o r p u s o f d o c u m e n t s

    A u t o m a t i c a l l y o r g a n i z e s

    d o c u m e n t s i n t o t h e t o p i c s

    Amazon Comprehend: Topic Model ing

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Example of translating between languages:

    Context aware: knows not to

    translate “Amazon” to

    “Amazonas“ (Amazon Jungle)

    Learns to re-order words &

    phrases according to the

    grammar of each language

    "Amazon Web Services is a collection of cloud computing services"

    “Amazon Web Services es una colección de servicios de computación en la nube”

    Amazon Translate: Machine Translation

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon LexConversational interfaces for your

    applications, powered by the same

    Natural Language Understanding

    (NLU) & Automatic Speech Recognition

    (ASR) models as Alexa

    Potential Use Cases

    Appointment Booking Customer Support

    Informational Services Access Enterprise Data

    Chatbots Voice Assistant

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Frameworks &

    Infrastructure

    AWS Deep Learning AMI

    GPU(P3 Instances)

    MobileCPUIoT

    (Greengrass)

    Vision:

    Rekognition Image

    Rekognition Video

    Speech:

    Polly

    Transcribe

    Language:

    Lex Translate

    Comprehend

    Apache

    MXNetPyTorch

    Cognitive

    ToolkitKeras

    Caffe2

    & CaffeTensorFlow Gluon

    AWS ML Stack

    Application

    Services

    Platform

    Services

    Amazon Machine

    Learning

    Mechanical

    Turk

    Spark &

    EMR

    Amazon

    SageMakerAWS

    DeepLens

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Amazon SageMaker

    A fully managed service that enables data scientists and developers to quickly and

    easily build machine-learning based models into production smart applications.

    1 2 3 4

    I I I I

    Notebooks Service Algorithms Training Service Hosting Service

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Sagemaker: High Performance ML Algorithms

    • Many of the current ML algorithms do not scale well

    • Managing DL algorithms at scale is a different challenge

    • Our goal: Provide common ML algorithms that outperform

    current implementations by 10x (faster). Algorithms such as:

    • Matrix Factorization, Regression, Principle

    Component Analysis, K-Means Clustering, Gradient

    Boosted Machines, and more

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    A new way to learn

    Custom built for deep learning

    Broad Framework Support

    Deploy models from Amazon SageMaker

    Integrated with AWS

    Full programmable with AWS Lambda

    AWS DeepLens ( G A)W o r l d ’ s f i r s t d e e p l e a r n i n g e n a b l e d v i d e o c a m e r a f o r d e v e l o p e r s

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Vision:

    Rekognition Image

    Rekognition Video

    Speech:

    Polly

    Transcribe

    Language:

    Lex Translate

    Comprehend

    AWS ML Stack

    Application

    Services

    Frameworks &

    Infrastructure

    AWS Deep Learning AMI

    GPU(P3 Instances)

    MobileCPUIoT

    (Greengrass)

    Apache

    MXNetPyTorch

    Cognitive

    ToolkitKeras

    Caffe2

    & CaffeTensorFlow Gluon

    Platform

    Services

    Amazon Machine

    Learning

    Mechanical

    Turk

    Spark &

    EMR

    Amazon

    SageMakerAWS

    DeepLens

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Support for all major frameworks

    AWS Deep Learning AMI

    Apache MXNet

    Torch

    Cognitive

    ToolkitKeras

    TheanoCaffe2

    & Caffe

    TensorFlow

    Amazon EC2

    AnacondaIntel MKL

    Nvidia CUDA &

    cuDNN

    Python2 &

    Python3

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Open source deep learning interface which allows

    developers to easily and quickly build machine learning

    models, without compromising performance

    Provides a clear, concise API for defining machine

    learning models using a collection of pre-built, optimized

    neural networks

    Developers will find this interface familiar, since machine

    learning models can be defined and manipulated just

    like any other data structure

    Data scientists and researchers will value the ability to

    build prototypes quickly and utilize dynamic neural

    network graphs for entirely new model architectures

    AWS and Microsoft

    announced Gluon

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Model

    Training

    Inference

    in the Cloud

    Inference

    at the Edge

    Infrastructure to support model build and deploy

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Train model in the cloud Run model at the edge

    AWS

    Greengrass

    AWS IoT

    Tesla V100

    120 TFLOPS

    Amazon

    EC2

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Fully integrate ML services into your applications, leveraging your

    existing business data assets, your streaming data, your data lakes,

    and your operational systems

    Use blueprints for what has been done to achieve what is possible...

  • © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

    Questions!