76

Machine Learning at Netflix

Embed Size (px)

Citation preview

Page 1: Machine Learning at Netflix
Page 2: Machine Learning at Netflix

Some background...

Page 3: Machine Learning at Netflix
Page 4: Machine Learning at Netflix
Page 5: Machine Learning at Netflix
Page 6: Machine Learning at Netflix
Page 7: Machine Learning at Netflix
Page 8: Machine Learning at Netflix
Page 9: Machine Learning at Netflix
Page 10: Machine Learning at Netflix
Page 11: Machine Learning at Netflix

Research At Netflix

Page 12: Machine Learning at Netflix

But first… why?

Page 13: Machine Learning at Netflix

1999 Started work on recommendations

(DVDs)

2006-2009 Launched Netflix Prize, 1M prize to

improve predicted ratings

2007-2011 Transitioned to streaming

2014 300+ people working on content discovery, $150m per year investment.

Aish Fenton
Is there a more research focused version of this I can use?
Page 14: Machine Learning at Netflix

The value of research?● Business Value

● Consumer <-> Producer

Page 15: Machine Learning at Netflix

How much is 0.1% worth? 83,000,000 members + modest growth$10 * 12 months---~5-100+ million a year

Page 16: Machine Learning at Netflix

The value of research?● Business Value

● Consumer <-> Producer

Page 17: Machine Learning at Netflix
Page 18: Machine Learning at Netflix
Page 19: Machine Learning at Netflix

Our approach

Page 20: Machine Learning at Netflix

Freedom and Responsibility

Page 21: Machine Learning at Netflix

If you want to build a ship, don't drum up people to collect wood and don't assign them tasks and work, but rather teach them to long for the endless immensity of the sea. Antoine de Saint-Exupéry, The Little Prince

Page 22: Machine Learning at Netflix
Page 23: Machine Learning at Netflix

Some examples of WIP:

Page 24: Machine Learning at Netflix

1.Understanding tastes

Page 25: Machine Learning at Netflix

Finding the right target audience for titles

Inform our content create/purchase decisions

Page 26: Machine Learning at Netflix

R ≈ UM

Page 27: Machine Learning at Netflix

R ≈ UM

Page 28: Machine Learning at Netflix

Implicit data (e.g. count data)Non-negative constraintsDifferent matrix normsDifferent generative assumptionsFully bayesian treatment...

Page 29: Machine Learning at Netflix

K

U

Pα θ φz r

β

Page 30: Machine Learning at Netflix

Convex combination of topics proportions and movie proportions within topic

Page 31: Machine Learning at Netflix

φ3φ2

φ1

User

Page 32: Machine Learning at Netflix
Page 33: Machine Learning at Netflix
Page 34: Machine Learning at Netflix

2. Beyond Recommenders

Page 35: Machine Learning at Netflix
Page 36: Machine Learning at Netflix

WhichGenre

s

Page 37: Machine Learning at Netflix

Ordering

Page 38: Machine Learning at Netflix

Dedupe

Page 39: Machine Learning at Netflix

Diversity

Page 40: Machine Learning at Netflix
Page 41: Machine Learning at Netflix

2 3 4 51 6 7 8

Worth more

Page 42: Machine Learning at Netflix
Page 43: Machine Learning at Netflix
Page 44: Machine Learning at Netflix
Page 45: Machine Learning at Netflix
Page 46: Machine Learning at Netflix
Page 47: Machine Learning at Netflix

3. Going Global

Page 48: Machine Learning at Netflix

Jan 6th, 2016

Page 49: Machine Learning at Netflix

??

? ??

?? ?

?

Page 50: Machine Learning at Netflix

??

? ??

?? ?

?

A B C

Page 51: Machine Learning at Netflix

??

? ??

?? ?

?

Page 52: Machine Learning at Netflix

??

? ??

?? ?

?A

B

Page 53: Machine Learning at Netflix
Page 54: Machine Learning at Netflix
Page 55: Machine Learning at Netflix
Page 56: Machine Learning at Netflix
Page 57: Machine Learning at Netflix
Page 58: Machine Learning at Netflix

4. Image Optimization

Page 60: Machine Learning at Netflix

Pop Quiz !

Page 61: Machine Learning at Netflix
Page 62: Machine Learning at Netflix

CONTROL

14% ▲ 6% ▲

Page 63: Machine Learning at Netflix
Page 64: Machine Learning at Netflix

Anatomy of a boxart...

Page 65: Machine Learning at Netflix
Page 66: Machine Learning at Netflix
Page 67: Machine Learning at Netflix
Page 68: Machine Learning at Netflix
Page 69: Machine Learning at Netflix
Page 70: Machine Learning at Netflix
Page 71: Machine Learning at Netflix
Page 72: Machine Learning at Netflix

Scaling it UP

Page 73: Machine Learning at Netflix

Visualization

Page 74: Machine Learning at Netflix

Search

Page 75: Machine Learning at Netflix

Testing

Page 76: Machine Learning at Netflix

Stream Optimization