37
Machine Learning using Google Technology Machine Learning Group | November 7th, 2017 Brian Vinson Customer Engineer

Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Machine Learning using Google Technology Machine Learning Group | November 7th, 2017

Brian VinsonCustomer Engineer

Page 2: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Data is EverythingHow well you use your data determines the degree of your success

Page 3: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

© 2017 Google Inc. All rights reserved.

Page 4: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

How does a machine learn?

Page 5: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

How does a machine learn?

PREDICTING HOUSE SALE PRICES

Sq. Footage Price

1,000 $100,000

3,000 $300,000

How much would a 2,000 sq ft. house sell for?

Page 6: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

How does a machine learn?

PREDICTING HOUSE SALE PRICES

Sq. Footage Price

1,000 $100,000

3,000 $300,000

2,000 $200,000

Page 7: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

1Look at the Data

Sq. FootagePr

ice

1,000 2,000 3,000

100,000

200,000

300,000

Page 8: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

2Find a pattern

Sq. FootagePr

ice

1,000 2,000 3,000

100,000

200,000

300,000

Page 9: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

3Predict

Sq. FootagePr

ice

1,000 2,000 3,000

100,000

200,000

300,000

Page 10: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

A better dataset

PREDICTING HOUSE SALE PRICES

Sq. Footage

Crime Rate (1-100)

School Rating (1-5)

Price

1,000 1 5 $300,000

2,000 50 3 $200,000

4,000 80 1 $100,000

How much would a 3,000 sq ft. house with a crime rate of 30 and a school rating of 2 cost?

Page 11: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

It's not who has the best algorithm who wins, it's who has the most data.

— Andrew Ng , Co-Founder of Google Brain

“”

Page 12: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Google’s Mission

Eight cloud products with

ONE BILLIONusers each

Page 13: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

© 2017 Google Inc. All rights reserved.

San Francisco

New York

Page 14: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

14

Gmail—Smart Reply Inbox

Proprietary + Confidential

10%of all responses sent on mobile

April 1, 2009: April Fool’s Day joke

Nov 5, 2015: Launched Real Product

Page 15: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Proprietary + Confidential

SearchSearch RankingSpeech Recognition

AndroidKeyboard and Speech Input

PlayApp Recommendations Game Developer Experience

GmailSmart ReplySpam Classification

DriveIntelligence in Apps

ChromeSearch by Image

PhotosPhotos Search

YouTubeVideo Recommendations Better Thumbnails

MapsStreet View ImageParsing Local Search

TranslateText, Graphic and Speech Translations

CardboardSmart Stitching

AdsRicher Text AdsAutomated Bidding

Self Driving Car1.5MM miles driven

Data Center Power UsageReduced cooling energy 40%

Alpha GoFirst AI to beat a world Go champion (2016)

Google is the world leader in applying Machine Learning to real-world situations, inside and outside of Google.

Page 16: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Rule #1 of Machine Learning: Don’t build a model if you don’t have to

Page 17: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Custom ML models Pre-trained ML models

Machine Learning Engine

TensorFlow

Vision API

Translation API

Natural Language API

Speech API Jobs API

Two Flavors of Machine Learning

Video Intelligence API

Page 18: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

● State of the art machine learning models built by Google experts

● Pre-Trained on massive datasets using Google scale infrastructure

● Work out of the box. No machine learning expertise required

Machine Learning APIs

Page 19: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Vision API

Detect broad sets of categories within an image, ranging from modes of transportation to animals.

Analyze facial features to detect emotions: joy, sorrow, anger.

Detect logos.

Detect and extract text within an image, with support for a broad range of languages, along with support for automatic language identification.

Extract text

Detect different types of inappropriate content from adult to violent content. Powered by Google Safe Search

Detect inappropriate contentObject Recognition Facial sentiment & logos

TRY THE API

Page 20: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Speech API

Powered by deep learning neural networking to power your applications..

No need for signal processing or noise cancellation before calling API. Can handle noisy audio from a variety of environments.

Noise Robustness

Can provide context hints for improved accuracy. Especially useful for device and app use cases.

Word HintsSpeech Recognition

TRY THE API

Recognizes over 80 languages & variants. Can also filter inappropriate content in text results

Over 80 languages

Can stream text results, returning partial recognition results as they become available. Can also be run on buffered or archived audio files.

Real-time results

Page 21: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Translation API

Supports more than 100 languages and thousands of language pairs.

Behind the scenes, Translation API is learning from logs analysis and human translation examples. Existing language pairs improve and new language pairs come online at no additional cost.

Sometimes you don’t know your source text language in advance. Can automatically identify languages with high accuracy.

Automatic language detection

The Premium edition is tailored for users who need precise, long-form translation services (e.g. livestream translations, high volume of emails, detailed articles and documents)

Premium edition BETAText Translation Continuous Updates

TRY THE API

Page 22: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Natural Language API

Identify entities and label by types such as person, organization, location, events, products and media.

Enables you to easily analyze text in multiple languages including English, Spanish and Japanese.

Extract tokens and sentences, identify parts of speech (PoS) and create dependency parse trees for each sentence.

Syntax analysisEntity Recognition Multi-Language Support

TRY THE API

Understand the overall sentiment expressed in a block of text.

Sentiment Analysis

Page 23: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Video Intelligence API

Detect entities within the video, such as "dog", "flower" or "car".

You can now search your video catalog the same way you search text documents..

Extract actionable insights from video files without requiring any machine learning or computer vision knowledge.

Enable Video Search

More features will be added to the Video Intelligence API during the BETA period.

More to come ... BETALabel Detection Insights From Videos

Page 24: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of
Page 25: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of
Page 26: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Cloud Detection in Satellite Images

Page 27: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of
Page 28: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

11%of images

Error rate

3%of images

Development time

3months

YearsPreviously

Today

Page 29: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Data Loss Prevention (DLP) API

DLP lets GCP users scan for and redact sensitive data

● Find sensitive data stored in GCP● Redact sensitive data to comply with

regulations or policies● Safely unlock more of the cloud

Automatically discover and redact sensitive data everywhere

RawData

Machine Learning

Secure Sharing

App DevelopmentRedact Data

DLP API

Classify Data

Montoring

Data Governance

Page 30: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of
Page 31: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of
Page 32: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

TensorFlowWorld’s Most Popular Machine Learning Framework

Page 33: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

TensorFlow

● Tensorflow is what we use for our own internal machine learning projects, and now it’s available to you!

● Powers over 100 Google services

● Tutorials to get started at https://www.tensorflow.org

Page 34: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

As of 6-24-2017

Most Popular Machine Learning Framework

FrameworkG

itHub

Sta

rsTensorFlow

10,000

20,000

30,000

0

40,000

SKLearn Caffe CNTK MXnet Torch

50,000

60,000

Page 35: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Cloud TPU

● 180 TFlops, 9x faster than NVIDIA P100 GPU

● Faster time to market for new applications

● Train, iterate, and predict faster

● Reduce the cost of Machine Learning work

Page 36: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

DEMO!!

Page 37: Customer Engineer Brian Vinson Machine Learning Group ... · Machine Learning Engine TensorFlow Vision API Translation API Natural Language API Speech API Jobs API Two Flavors of

Brian VinsonGoogle Cloud Customer Engineer

[email protected]

Thank You!