Prof. Wei-Guang Teng (鄧維光 )Dept. of Engineering Science

National Cheng Kung University

2013/3/18

DataKnowledge

Learning&

MiningCrowd

2

Let’s Start with “Data”

• Data– Known facts that can be recorded and have an

implicit meaning

• Database– A collection of related data

Data

BigData

What Are

?

4

Big Data

Data

• Exabyte (EB or 1018 bytes)– 1 EB = 1,000 PB = 1,000,000 TB

• See Big Data - Big Opportunity– http://www.youtube.com/watch?v=e6K0VHz6FVc

5

Problem of Data Overloading

• We are drowning in data, but starving for knowledge!

Data

How to Solve this Problem?

7

Possible Solutions!

Data

Learning&

Mining

8

Machine Learning (機器學習 )

• Machine learning, a branch of artificial intelligence, is about the construction and study of systems that can learn from data

• Example 1: OCR (optical character recognition)– Printed characters are recognized automatically based on

previous examples

• Example 2: Spam Detection– A machine learning system could be trained on email messages

to learn to distinguish between spam and non-spam messages. After learning, it can then be used to classify new email messages into spam and non-spam foldersData

Learning&

Mining

9

Data Mining (資料探勘 )

• To extract interesting patterns from large databases– Interesting: non-trivial, implicit, previously unknown & potentially useful– Patterns: association rules, classification, clustering, ...

Data

Learning&

Mining

10

ML vs. DM

• Machine learning focuses on prediction, based on known properties learned from the training data

• Data mining focuses on the discovery of (previously) unknown properties on the data

Data

Learning&

Mining

11

To Work Together

• See What is Predictive Analytics / Data Mining?– http://www.youtube.com/watch?v=BjznLJcgSFI

Data

Learning&

Mining

Why Collective Intelligence,

not Personalized ?

13

Social Network

• A social structure made up of a set of actors and the dyadic ties between these actors– Social network analysis is to identify local and global patterns,

locate influential entities, and examine network dynamics

Data

Learning&

MiningCrowd

14

Media, Management & Marketing ...

• See A Day in the Life of Social Media– http://www.youtube.com/watch?v=iReY3W9ZkLU

• See The Social Media Revolution 2012-13– http://www.youtube.com/watch?v=0eUeL3n7fDs

Data

Learning&

MiningCrowd

What’s Next?

16

Crowdsourcing (群 外包眾 )

• See Crowdsourcing Evolution– http://www.youtube.com/watch?v=OKMOI9PSQwo

DataKnowledge

Learning&

MiningCrowd

17

Amazon Mechanical Turk

DataKnowledge

Learning&

MiningCrowd

18

Types of Tasks

DataKnowledge

Learning&

MiningCrowd

Questions?