25
science and sensibility hilary roberts, senior product manager at skyscanner thoughts on experimentation and growth

Hilary Roberts — Science and Sensibility: Thoughts on Experimentation and Growth (Turing Festival 2016)

Embed Size (px)

Citation preview

science and sensibility

hilary roberts, senior product manager at skyscanner

thoughts on experimentation and growth

learn buildminimisetotal time

through the loop

measure

lean startup

50M80040

users per month

people

product managers

L B

M

startup enterprise

L B

M

L B

M

L B

M

L B

M

L B

M

L B

M

startup at scale

0

50

100

150

200

250Experiment iterations

0

50

100

150

200

250Experiment iterations Hypotheses

hypothesis: based on insight, we predict that product change

will cause impact.

L B

M

two possible outcomessuccessful

failed

L B

M

two four possible outcomes

L B

M

invalidflailed

successfulfailed

case study returning users redirected to hotels home page instead of flights

Skyscanner you are really annoying me with your hotels and car hire options! You are not called HotelScanner or CarHireScanner. You are Sky as in aeroplanes!

If you want to diversify into other services then you should have thought of that before calling your website SKYscanner. Imagine Compare The Market had limited themselves by calling it Compare The Car Insurance Market!

They can now ease into the Travel Insurance market with no issue because they didnt specify which market they are comparing. You cant! and please stop defaulting me to Hotels I'm here for flights!!

letter from a passionate skyscanner user

Verdict

invalid

case study increasing propensity to search from news pages

verdict

flailed

case study the right metric for travellers

British Airways!

successful

“Any time a team attempts to justify its failures by resorting to learning as an excuse, it is engaged in pseudoscience.”The Lean Startup (page 279)

http://codevoyagers.com

Hilary Roberts