INNOVATION TECHNOLOGYMEETUP @ BEEVA

Deploy Spark and Tensorflow Models: From Notebook Dev to Microservice Prod

Madrid - November 16, 2016

Thank You, BEEVA!http://pipeline.io http://beeva.com

WHO AM I?

Chris Fregly--------

Research Scientist @ PipelineIO(Formerly Netflix and Databricks)

--------http://pipeline.io

WHO ARE YOU?

-- Local Techies --

FUN WORKSHOP ON SATURDAY!(HERE IN MADRID)

http://pipeline.io#upcoming-workshops

SOURCE CODE AND DOCKER IMAGES

• Github Repo: 900 Stars, 300 Forks

• DockerHub Repo: 6,200 Pulls

WHAT IS PIPELINE.IO?

Extending Your ML Pipelines into Production

100% Open Source!

http://pipeline.io

BRAINSTORMING AND VALIDATING

• Major Gaming Company

• Large Ride Sharing Service

• Popular Q & A Site

• Online Clothing Retailer

• Dominant Video Streaming

PIPELINE.IO FOCUS

• Model Deploying and Testing

• Model Scaling and Serving

• Online Model Training

• Dynamic Model Optimizing

MODEL DEPLOYING AND TESTING

Continuously Test and Deploy Models

in Production!

MODEL SCALING AND SERVING

ONLINE MODEL TRAINING

• Continuous, Incremental, and Partial Training

• Kafka + Spark Streaming + Spark ML

• Real-time, Dynamic Recommendations

DYNAMIC MODEL OPTIMIZING

Generate OptimizedCode from Spark ML!

BECOME A CONTRIBUTOR!

PIPELINE.IO PLAN FOR 2017

• Performance

• Code Generation: CPU and GPU

• Continued Global Expansion

MORE WORKSHOPS IN 2017

http://pipeline.io#upcoming-workshops

WE’RE HIRING!!

• Kafka, Spark ML, and TensorFlow Contributors

• Systems Engineers

• GPU/CUDA Engineers

• C++, Java, Scala, Python

WE ONLY HIRENICE PEOPLE!!

DEMO!

Circuit Breakers and Request Batching

DEMO!

Deploy Spark ML DecisionTree to Production

Deploy to Cloudor On-Premise!

DEMO!

Dynamic Code Generation of DecisionTree

DEMO: TENSORFLOW SERVING

THANK YOU!!

http://pipeline.io http://beeva.com