How to hack into the big data team

How to Hack into the Big Data Team?

Komes ChandavimolData Scientist

Data Science Lab, [email protected]

Better software day by Thailand SpinSoftware Park Thailand

April 29,2016

Big Data

http://www.adweek.com/prnewser/how-many-times-do-the-worlds-social-media-users-click-every-minute/117427

https://www.domo.com/learn/data-never-sleeps-3-0

Internet of Things

http://topmanagement.com.mx/innovacion-social-y-empresarial-objetivo-de-hitachi/

4http://www.adweek.com/prnewser/how-many-times-do-the-worlds-social-media-users-click-every-minute/117427


The Growth of Data

5http://www.adweek.com/prnewser/how-many-times-do-the-worlds-social-media-users-click-every-minute/117427


What is Big Data?

6http://blogs.forrester.com/category/hadoophttp://solutions.forrester.com/Global/FileLib/webinars/Big_Data_-_Gold_Rush_or_Illusion.pdf

The Big Data Tools

http://blogs.forrester.com/category/hadoop

http://solutions.forrester.com/Global/FileLib/webinars/Big_Data_-_Gold_Rush_or_Illusion.pdf

7http://hortonworks.com/blog/optimize-your-data-architecture-with-hadoop/

Traditional Data Management Architecture

8http://hortonworks.com/blog/optimize-your-data-architecture-with-hadoop/

New Data Management Architecture

9

https://www.digitalnewsasia.com/business/forget-data-warehousing-its-data-lakes-now

Data Lake

How the Data Lake works?

10http://www.clearpeaks.com/blog/category/tableau

Traditional Enterprise Data warehouse

11

What you consume from Data Lake?


12

Volume? Variety? Velocity?


13

Value


14

Big Data + Analytics = Values


Big Data Analytics

15http://hortonworks.com/blog/big-data-refinery-fuels-next-generation-data-architecture/

16

How to do Big Data Analytics?


Data

New Analytic Insights(Information, knowledge, data story)

Data Product+ Visualization

Mass Analytic Tools

Recommender systems

Machine Learning

Complex Event Processing Data Science Team

Data ScientistPicture:http://www.clipartpanda.com/categories/scientist-clip-art

The Roles of Data Science

Doing Data Science by O'Neil et al (2013)

DatascienceTh.com

Datafication

Data Science Experience Sharing, Big Data Challenge #2,Bangkok Thailand

http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram

What is Data Science?

The Rise of Data Scientist

19

http://flowingdata.com/2009/06/04/rise-of-the-data-scientist/

2009

https://hbr.org/

20http://hrb.org

http://www.anlytcs.com/2014/01/data-science-venn-diagram-v20.html

2014

The Rise of Data Scientist

Data Science Experience Sharing, Big Data Challenge #2,Bangkok Thailand

http://www.anlytcs.com/2014/01/data-science-venn-diagram-v20.html

2014

The Data Science

22

The Solution, Data Science Team

23

Data Science Team

Doing Data Science by O'Neil et al

(2013)

24

Data Science Team

Doing Data Science by O'Neil et al

(2013)

25

Doing Data Science by O'Neil et al (2013)

Data Science Team

Analyzing the Analyzers, Harris (2013)

Data Science Team

26

Data Science TeamData Scientist & Data Engineer

http://www.kdnuggets.com/2015/11/different-data-science-roles-industry.html

27

Data Science TeamData Scientist & Data Engineer

http://www.kdnuggets.com/2015/11/different-data-science-roles-industry.htmlhttps://www.facebook.com/DataScienceTh/posts/931828353527079:0

28

Data Science Professionals

http://www.kdnuggets.com/2015/11/different-data-science-roles-industry.html

29

Data Science for Dummies Pierson

(2015)

∗Build In-house Team

• Train existing employee

• Train existing employee and hire experts

• Hire experts

∗Outsourcing requirements to private DS consultants

• Outsourcing for comprehensive DS Strategy development

• Outsource for DS Solutions to specific problem

∗Leverage Cloud-based platform solutions

How to build DS Team?

30

Data Science for Dummies Pierson (2015)

How to Start?

31http://www.clearpeaks.com/blog/category/tableau

Traditional Enterprise Data warehouse

Where to Start?

32

Questions ?

Datascienceth.com

#PAaDS

Technology

How to hack into the big data team