Course Overview for Web Computing J. H. Wang Sep. 19, 2011

Web Computing, Fall 2011

NTUE 1

Course Overview for Web Computing

J. H. WangSep. 19, 2011

Web Computing, Fall 2011

NTUE 2

Instructor

• Instructor– J. H. Wang ( 王正豪 )– Assistant Professor, CSIE, NTUT– Office: R1534, Technology Building, NTUT– E-mail: jhwang@csie.ntut.edu.tw– Tel: (02) 27712171 ext. 4238– Office Hours: 8:00-10:00am every

Tuesday, 10:00am-14:00pm every Wednesday

Web Computing, Fall 2011

NTUE 3

Course Description• Time: 14:25-17:20pm, Mon.• Classroom: F308• Textbook:

– Christopher D. Manning, Prabhakar Raghavan and Hinrich Schuetze, Introduction to Information Retrieval, Cambridge University Press, 2008. (International Student Edition, 開發圖書 )

– available online: http://nlp.stanford.edu/IR-book/ • References:

– Documents on Web services: • API specification: Google APIs, Yahoo APIs• Protocol specification: HTTP, XML, JSON

– Documents on network programming: socket (BSD, WinSock, or Java Socket)

– Other documents and papers

Web Computing, Fall 2011

NTUE 4

Additional References

• References books on information retrieval: – Ricardo Baeza-Yates and Berthier Ribeiro-Neto,

Modern Information Retrieval: The Concepts and Technology behind Search, Addison-Wesley, 2011.

• This is the second edition of their book Modern Information Retrieval in 1999. ( 華通 )

– Stefan Buettcher, Charles L.A. Clarke, and Gordon V. Cormack, Information Retrieval: Implementing and Evaluating Search Engines, MIT Press, 2010.

– Bruce Croft, Donald Metzler, and Trevor Strohman, Search Engines: Information Retrieval in Practice, Addison-Wesley, 2010. ( 全華 )

Web Computing, Fall 2011

NTUE 5

Additional References

• More information– http://en.wikipedia.org/wiki/

World_Wide_Web – http://en.wikipedia.org/wiki/Web_service

• Course Web page– http://www.ntut.edu.tw/~jhwang/

WebComp/

Web Computing, Fall 2011

NTUE 6

Intended Audience

• An introductory course of Web computing for undergraduates – Juniors/seniors

• Prerequisite – Basic knowledge of data structures and

discrete mathematics – Programming experience is necessary

for completing the homework assignments and projects

Web Computing, Fall 2011

NTUE 7

Teaching

• Lectures: mostly in slides• Labs: about 3-4 in-class labs• Homework assignments: about 2

assignments• Programming exercises: about 2-3

assignments– Assignments should be turned in within two

weeks

• Exams: 1 midterm exam• Projects: 1 term project/presentation

Web Computing, Fall 2011

NTUE 8

Grading Policy

• Homework assignments and programming exercises: 40%

• Mid-term exam: 30%• Final project or presentation: 30%

Web Computing, Fall 2011

NTUE 9

Programming Exercises and Final Project

• At least two programming exercises – Team-based (at most 2 persons per team)– Writing your own code or reusing existing open

source code would be fine– Topics: (more on this later…)

• One final project– Either team-based (the same as programming

exercise)– Or Web-related academic paper presentation

• But, your should do it on your own (only 1 person), NOT team-based

– A proposal is needed around midterm (Dec. 2011)

• Introduction, methods used, experiment designs

Web Computing, Fall 2011

NTUE 10

What’s NOT Included in this Course

• How to use Web (2.0) clients or tools• How to install/configure/manage Web

servers• How to design homepages• How to write a program (in C, Java,

Javascript, Perl, Python, PHP, …)

Web Computing, Fall 2011

NTUE 11

What’s Web Computing?

• World Wide Web– Internet application: client-server

• Web protocols: HTTP • Web document formats: HTML, XML,

JSON, …• Web servers: CGI, databases, • Web clients (browsers): user interface,

security, …• Web programming languages:

Javascript, Python, PHP, Ajax, …

Web Computing, Fall 2011

NTUE 12

What’s Web Search

Web Computing, Fall 2011

NTUE 13

In Wikipedia

Web Computing, Fall 2011

NTUE 14

Related Events

Web Computing, Fall 2011

NTUE 15

Web Computing, Fall 2011

NTUE 16

Web Computing, Fall 2011

NTUE 17

In Google News

Web Computing, Fall 2011

NTUE 18

In Blogs

Web Computing, Fall 2011

NTUE 19

Or Related Keywords

• Sendai• Miyagi• Tsunami• Nuclear power plant• …

Web Computing, Fall 2011

NTUE 20

What if We Search in Chinese

Web Computing, Fall 2011

NTUE 21

And More…

• 東日本大地震 • 三一一大地震• 宮城縣• 仙台• 海嘯• 核危機• …• And other languages…

Web Computing, Fall 2011

NTUE 22

Major Topics to be Covered

• Web search and information retrieval– (And Web mining if time permits)

• Network programming• Web services• Web API programming

Web Computing, Fall 2011

NTUE 23

Organization of the Textbook

• Basics in IR – Inverted indexes for Boolean queries (Ch.1-5)– Term weighting and vector space model (Ch. 6-7)– Evaluation in IR (Ch. 8)

• Advanced Topics– Relevance feedback (Ch. 9)– XML retrieval (Ch. 10)– Probabilistic IR (Ch. 11)– Language models (Ch. 12)

• Machine learning in IR– Text classification (Ch. 13-15)– Document clustering (Ch. 16-18)

• Web Search– Web crawling and indexes (Ch. 19-20)– Link analysis (Ch. 21)

Web Computing, Fall 2011

NTUE 24

Tentative Schedule (1/2)

• Before midterm– Course Overview (1 wk)– Web search and related

applications (2 wks)– Information Retrieval concepts (5

wks)• Indexing• Vector space model and scoring• Ranking and evaluation

– Network programming (2 wks)

Web Computing, Fall 2011

NTUE 25

Tentative Schedule (2/2)

• Before end of semester– Web services: overview (2 wks)– Web services programming (4-5 wks)

•Google APIs: Web, blog, news, Maps•Yahoo APIs: Web, term extraction•Others

– Term project presentation (1-2 wks)

Web Computing, Fall 2011

NTUE 26

A Big Picture

Web Computing, Fall 2011

NTUE 27

Programming Exercises

• Network programming– Sending/receiving packets– Connecting to specific (IP, port) using some

protocol– Response parsing: HTTP

• Web services programming– Calling Google & Yahoo APIs: Web, news, map,

term extraction, …– Response parsing: JSON, XML

• (Details to be announced…)

Web Computing, Fall 2011

NTUE 28

Possible Topics for Term Project

• Design and implement a new Web service by combining existing Web services, e.g.– Meta-search engine– Translation assistant– Name finder– Location-based service– …

Web Computing, Fall 2011

NTUE 29

Thanks for Your Attention!

• Any question or comment?