Embed Size (px)
DESCRIPTION
Growth hackers rely on A/B testing to validate their improvement, but A/B testing is slow and inefficient. How do we make it faster? By solving the bandit problem! Bandit algorithms provide an alternative to A/B testing that is faster and more efficient, allowing more tests in less time. Video of the talk: http://www.youtube.com/watch?v=h7SG_Wo8sPQ Myna: http://mynaweb.com/?utm_source=awareness&utm_medium=slideshare&utm_campaign=Growth%2BHacker
Citation preview
GROWTH HACKING AND
THE BANDIT PROBLEM
Starring Noel Welsh A Production
Friday, 8 February 2013
WHAT DO
GROWTH HACKERS DO?
Friday, 8 February 2013
GROW!Friday, 8 February 2013
Metric(sign-ups, revenue, etc)
Friday, 8 February 2013
Make this happen
Friday, 8 February 2013
HOW?Friday, 8 February 2013
Build
MeasureLearn
Friday, 8 February 2013
Build
Friday, 8 February 2013
Build
Measure
Friday, 8 February 2013
Build
MeasureLearn
Friday, 8 February 2013
FASTER IS BETTER
Friday, 8 February 2013
HOWDO WE MEASURE &
LEARN?
Friday, 8 February 2013
A/BFriday, 8 February 2013
MeasureBuild Learn
Friday, 8 February 2013
Build
MeasureLearn
Friday, 8 February 2013
Build
Measure/Learn
Friday, 8 February 2013
Build Measure / Learn
Friday, 8 February 2013
THE BANDIT PROBLEM(EST 1952 ... OR 1933)
Friday, 8 February 2013
k arms (or variants)
Friday, 8 February 2013
Select a variant
Friday, 8 February 2013
Receive a reward
Friday, 8 February 2013
REPEAT
Friday, 8 February 2013
MAXIMISE TOTAL REWARD
Friday, 8 February 2013
Friday, 8 February 2013
HOW?Friday, 8 February 2013
DISPLAY VARIANT WITH
HIGHEST AVERAGE REWARD
Friday, 8 February 2013
Good Variant Bad Variant
Friday, 8 February 2013
Good Variant Bad Variant
Views: 1Reward: 0Average: 0
Friday, 8 February 2013
Good Variant Bad Variant
Views: 1Reward: 0Average: 0
Views: 1Reward: 1Average: 1
Friday, 8 February 2013
OOPS!Friday, 8 February 2013
Good Variant Bad Variant
Views: 1Reward: 0Average: 0
Views: 1Reward: 1Average: 1
WILL NEVER TRY THE
GOOD VARIANT AGAIN!
Friday, 8 February 2013
BALANCE EXPLOIT
AND EXPLORE
Friday, 8 February 2013
EXPLOITTRY THE VARIANT THAT HAS WORKED BEST IN
THE PAST
Friday, 8 February 2013
EXPLORE TRY OTHER VARIANTS
TO SEE IF THEY’RE BETTER
Friday, 8 February 2013
E-GREEDYFriday, 8 February 2013
10% EXPLORE
90% EXPLOITDon’t like 10% and 90%? Change it.
Friday, 8 February 2013
MORE INTRICATE BALANCING IS POSSIBLE.
SEE UCB-1, THOMPSON SAMPLING, etc.
Friday, 8 February 2013
Friday, 8 February 2013
DOES IT
WORK?
Friday, 8 February 2013
Friday, 8 February 2013
REAL WORLD
CONSIDERATIONS
Friday, 8 February 2013
WORKFLOW
Friday, 8 February 2013
DEFINING
REWARDS
Friday, 8 February 2013
STABLE PREFERENCES
Friday, 8 February 2013
THANK YOU!NOW GO FORTH AND
ENGAGE IN BANDITRY
Friday, 8 February 2013
CREDITSPhotos and artwork by the following people were used in
this presentation:
Moyan Brenn http://www.flickr.com/photos/aigle_dore/Suicine http://www.flickr.com/photos/bigmikeyeah
ankakay http://www.flickr.com/photos/ankakay/Cdr Aitch http://www.flickr.com/people/hjsouthgate/
StJost http://stjost.deviantart.com/
Friday, 8 February 2013
