16
DSS + Stan Bayesian Data Science

DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

DSS + StanBayesian Data Science

Page 2: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

2 FormationEquancy 11,18,19/2/2016

A data science workflow

Data Acquisition &

Understanding

Data Preparation

Model Creation

Evaluation Deployment

Dataset 1

Scored dataset

Scored dataset

Iteration 1Iteration 2

Iteration n

Dataset 2

Dataset n

Business / Scientific Understanding

Adapted from the CRISP-DM methodology

Page 3: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

3 FormationEquancy 11,18,19/2/2016

A data science workflow

Page 4: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

4 FormationEquancy 11,18,19/2/2016

A data science workflow

Page 5: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

5 FormationEquancy 11,18,19/2/2016

A data science workflow

Page 6: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

6 FormationEquancy 11,18,19/2/2016

Today’s DemoTopic Modeling of Tweets

+ +

Page 7: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Topic Modeling

Page 8: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Topic ModelingA brief intro

News

Pop culture

Marketing

WordsTopicsDocument

Trump

Award

Video

Report

Product

Page 9: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Topic ModelingA brief intro

News

Pop culture

Marketing

WordsTopicsDocument

Trump

Award

Video

Report

Product

Page 10: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Topic ModelingA brief intro

News

Pop culture

Marketing

WordsTopicsDocument

Trump

Award

Video

Report

Product

Page 11: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Bayesian Topic Modeling

News

Pop culture

Marketing

WordsTopicsDocument

Trump

Award

Video

Report

Product

20%

70%

10%

Page 12: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Bayesian Topic Modeling

News

Pop culture

Marketing

WordsTopicsDocument

Trump

Award

Video

Report

Product

40%

40%

20%

5%

5%

Page 13: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Bayesian Topic Modeling

News

Pop culture

Marketing

WordsTopicsDocument

Trump

Award

Video

Report

Product

20%

70%

10%

40%

40%

20%

5%

5%

Page 14: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

Topics are “hidden”

Topic 1

Topic 2

Topic 3

WordsTopicsDocument

Trump

Award

Video

Report

Product

20%

70%

10%

40%

40%

20%

5%

5%

Page 15: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

WorkflowOutputsAlgorithmDocuments

X

Tweets

Latent DirichletAllocation

Distribution of topics for each document

Distribution of words for each topic

Page 16: DSS + Stan - Dataiku · 2017-10-10 · Topic 1 Topic 2 Topic 3 Document Topics Words Trump Award Video Report Product 20% 70% 10% 40% 40% 20% 5% 5%. Workflow Documents Algorithm Outputs

To DSS!