Learning to Persuade with AI

Embed Size (px)

Citation preview

Some people like itnice, quick and cheap:

Reinforcement Learning for debt collection

Jorge Davila-ChaconData Scientist

Mindspace Data Science Meetup September 2016

10 min

What is RL?

10 min

What can RL do?

5 min

Learning to persuade

5 min

Take away

What is RL?

Artificial Intelligence

Machine Learning

Reinforcement Learning

Artificial Intelligence

The nerdy definition:

Flexible rational agent that perceives its environment and takes actions that maximize its chance of success at an arbitrary goal.

- S. Russell and P. Norvig

Artificial Intelligence

The simple definition:

Machine able to perform tasks normally requiring human intelligence, such as:

Perceiving, planning and decision-making.

Machine Learning

Data

Program

Output

Data

Output

ProgramTraditionalMachine Learning

Machine Learning

Reinforcement Learning

Perception-Action Loop

Reference: Sutton and Barto. Introduction to Reinforcement Learning.1998 https://webdocs.cs.ualberta.ca/~sutton/book/ebook/the-book.html

Exploration vs Exploitation

Continuous Adaptation

What can RL do?

Learning to Fly

Learning to Walk

Learning to Play

Learning to Fly

Reference: Abbeel et al. An Application of Reinforcement Learning to Aerobatic Helicopter Flight. NIPS, 2007.

Learning to Walk

Reference: Kolter et al. Hierarchical Apprenticeship Learning with Application to Quadruped Locomotion. NIPS, 2007.

Learning to Play

Reference: V. Mnih et al. Human-level control through deep reinforcement learning. Nature, 2015.

Learning to Play

Learning to Play

Learning to persuade

Be nice

Be quick

Be cheap

Be nice

Be quick

Q-Values

Recommended Times

Be cheap

Take away

All truth passes through three stages.

First, it is ridiculed.

Second, it is violently opposed.

Third, it is accepted as being self-evident.

-Arthur Schopenhauer

Wrap Up

Learn from interaction

Learn fast

Learn continuously

Take Away

AI is more than just statsIts a lesson from nature

Be careful with technology hypesBut dont be afraid if you see someone fail

Unleash the beast!Sprinkling your business with AI might not be enough

Danke fr eure Aufmerksamkeit!

Jorge Davila-Chacon

Data Scientist

collect.ai