Course Overview for Web Computing J. H. Wang Sep. 19, 2011

Web Computing, Fall 2011

NTUE 1

Course Overview for Web Computing

J. H. WangSep. 19, 2011


NTUE 2

Instructor

• Instructor– J. H. Wang ( 王正豪 )– Assistant Professor, CSIE, NTUT– Office: R1534, Technology Building, NTUT– E-mail: [email protected]– Tel: (02) 27712171 ext. 4238– Office Hours: 8:00-10:00am every

Tuesday, 10:00am-14:00pm every Wednesday


NTUE 3

Course Description• Time: 14:25-17:20pm, Mon.• Classroom: F308• Textbook:

– Christopher D. Manning, Prabhakar Raghavan and Hinrich Schuetze, Introduction to Information Retrieval, Cambridge University Press, 2008. (International Student Edition, 開發圖書 )

– available online: http://nlp.stanford.edu/IR-book/ • References:

– Documents on Web services: • API specification: Google APIs, Yahoo APIs• Protocol specification: HTTP, XML, JSON

– Documents on network programming: socket (BSD, WinSock, or Java Socket)

– Other documents and papers


NTUE 4

Additional References

• References books on information retrieval: – Ricardo Baeza-Yates and Berthier Ribeiro-Neto,

Modern Information Retrieval: The Concepts and Technology behind Search, Addison-Wesley, 2011.

• This is the second edition of their book Modern Information Retrieval in 1999. ( 華通 )

– Stefan Buettcher, Charles L.A. Clarke, and Gordon V. Cormack, Information Retrieval: Implementing and Evaluating Search Engines, MIT Press, 2010.

– Bruce Croft, Donald Metzler, and Trevor Strohman, Search Engines: Information Retrieval in Practice, Addison-Wesley, 2010. ( 全華 )


NTUE 5

Additional References

• More information– http://en.wikipedia.org/wiki/

World_Wide_Web – http://en.wikipedia.org/wiki/Web_service

• Course Web page– http://www.ntut.edu.tw/~jhwang/

WebComp/


NTUE 6

Intended Audience

• An introductory course of Web computing for undergraduates – Juniors/seniors

• Prerequisite – Basic knowledge of data structures and

discrete mathematics – Programming experience is necessary

for completing the homework assignments and projects


NTUE 7

Teaching

• Lectures: mostly in slides• Labs: about 3-4 in-class labs• Homework assignments: about 2

assignments• Programming exercises: about 2-3

assignments– Assignments should be turned in within two

weeks

• Exams: 1 midterm exam• Projects: 1 term project/presentation


NTUE 8

Grading Policy

• Homework assignments and programming exercises: 40%

• Mid-term exam: 30%• Final project or presentation: 30%


NTUE 9

Programming Exercises and Final Project

• At least two programming exercises – Team-based (at most 2 persons per team)– Writing your own code or reusing existing open

source code would be fine– Topics: (more on this later…)

• One final project– Either team-based (the same as programming

exercise)– Or Web-related academic paper presentation

• But, your should do it on your own (only 1 person), NOT team-based

– A proposal is needed around midterm (Dec. 2011)

• Introduction, methods used, experiment designs


NTUE 10

What’s NOT Included in this Course

• How to use Web (2.0) clients or tools• How to install/configure/manage Web

servers• How to design homepages• How to write a program (in C, Java,

Javascript, Perl, Python, PHP, …)


NTUE 11

What’s Web Computing?

• World Wide Web– Internet application: client-server

• Web protocols: HTTP • Web document formats: HTML, XML,

JSON, …• Web servers: CGI, databases, • Web clients (browsers): user interface,

security, …• Web programming languages:

Javascript, Python, PHP, Ajax, …


NTUE 12

What’s Web Search


NTUE 13

In Wikipedia


NTUE 14

Related Events


NTUE 15


NTUE 16


NTUE 17

In Google News


NTUE 18

In Blogs


NTUE 19

Or Related Keywords

• Sendai• Miyagi• Tsunami• Nuclear power plant• …


NTUE 20

What if We Search in Chinese


NTUE 21

And More…

• 東日本大地震 • 三一一大地震• 宮城縣• 仙台• 海嘯• 核危機• …• And other languages…


NTUE 22

Major Topics to be Covered

• Web search and information retrieval– (And Web mining if time permits)

• Network programming• Web services• Web API programming


NTUE 23

Organization of the Textbook

• Basics in IR – Inverted indexes for Boolean queries (Ch.1-5)– Term weighting and vector space model (Ch. 6-7)– Evaluation in IR (Ch. 8)

• Advanced Topics– Relevance feedback (Ch. 9)– XML retrieval (Ch. 10)– Probabilistic IR (Ch. 11)– Language models (Ch. 12)

• Machine learning in IR– Text classification (Ch. 13-15)– Document clustering (Ch. 16-18)

• Web Search– Web crawling and indexes (Ch. 19-20)– Link analysis (Ch. 21)


NTUE 24

Tentative Schedule (1/2)

• Before midterm– Course Overview (1 wk)– Web search and related

applications (2 wks)– Information Retrieval concepts (5

wks)• Indexing• Vector space model and scoring• Ranking and evaluation

– Network programming (2 wks)


NTUE 25

Tentative Schedule (2/2)

• Before end of semester– Web services: overview (2 wks)– Web services programming (4-5 wks)

•Google APIs: Web, blog, news, Maps•Yahoo APIs: Web, term extraction•Others

– Term project presentation (1-2 wks)


NTUE 26

A Big Picture


NTUE 27

Programming Exercises

• Network programming– Sending/receiving packets– Connecting to specific (IP, port) using some

protocol– Response parsing: HTTP

• Web services programming– Calling Google & Yahoo APIs: Web, news, map,

term extraction, …– Response parsing: JSON, XML

• (Details to be announced…)


NTUE 28

Possible Topics for Term Project

• Design and implement a new Web service by combining existing Web services, e.g.– Meta-search engine– Translation assistant– Name finder– Location-based service– …


NTUE 29

Thanks for Your Attention!

• Any question or comment?