View
580
Download
1
Category
Preview:
Citation preview
Machine Learning for DevelopersDanilo Poccia, Technical Evangelist
@danilop
Batch
Report
Real-time
Alerts
Prediction
Forecast
Predictions
Data Predictions
ModelData Predictions
ModelData
BatchPredictions
Real-timePredictions
Machine Learning
SupervisedLearning
Machine Learning
UnsupervisedLearning
The task of inferringa model
from labeledtraining data
The task of inferringa model
to describehidden structure
from unlabeled data
ClusteringUnsuperv
ised
Learning
ClusteringUnsuperv
ised
Learning
ClusteringUnsuperv
ised
Learning
Regression
Binary Classification
Multi-class Classification
Supervise
d
Learning
Validation
Supervise
d
Learning
Training from Labeled DataSuperv
ised
Learning
Training
Validation
70%
30%
Cross-ValidationSuperv
ised
Learning
Be Careful of OverfittingSuperv
ised
Learning
Be Careful of OverfittingSuperv
ised
Learning
Be Careful of OverfittingSuperv
ised
Learning
Better ModelSuperv
ised
Learning
Better ModelSuperv
ised
Learning
Adding a Test PhaseSuperv
ised
Learning
Training
Validation
Test
60%
20%
20%
?Data Model
Data Model
Resilient Distributed Datasets (RDDs)
Memory
Fast Processing
Large Quantity of Data
Disk
Hadoop
MapReduce
Spark
?
Amazon EMRwith Spark (MLib)
Data Model
<demo>...
</demo>
Amazon EMRwith Spark (MLib)
Data Model
Data Scientists“Scalability”
AmazonMachine Learning
(Amazon ML)
Data Model
Machine learning is the technology that automatically finds patterns in your data and uses them to make
predictions for new data points as they become available
Your Data + Machine Learning= Smart Applications
What is Machine Learning?
AmazonMachine Learning
(Amazon ML)
Machine learning (ML) can help you use historical data to make better business decisions.
ML algorithms discover patterns in data and construct predictive models using these patterns. Then, you can use the models to make predictions
on future data.
What is Machine Learning?
AmazonMachine Learning
(Amazon ML)
Integrated with AWS Services for Easy Data Access (Amazon S3, Amazon Redshift, Amazon RDS)
Data visualization and exploration
Model Evaluation and Interpretation Tools
Binary Attributes (Binary Classification) Categorical Attributes (Multi-class Classification)
Numeric Attributes (Regression)
Key Features
AmazonMachine Learning
(Amazon ML)
Data Transformations
Modeling APIs
APIs for Batch and Real-time Predictions
Fully Managed
Pay per Use
Key Features
AmazonMachine Learning
(Amazon ML)
AmazonMachine Learning
(Amazon ML)
Data Model
AmazonMachine Learning
(Amazon ML)
Data Model
BatchPredictions
AmazonMachine Learning
(Amazon ML)
Data Model
BatchPredictions
Real-timePredictions
<demo>...
</demo>
AmazonMachine Learning
(Amazon ML)
Data Model
BatchPredictions
Real-timePredictions
Choose Where to Spend Your Time
Pay Only For What You Use
Danilo PocciaTechnical Evangelit @danilop
Recommended