Text Information Retrieval and Applications – Advanced Topics

Text Information Retrieval and Applications – Advanced

TopicsBy J. H. WangMay 27, 2009

Outline

• Advanced Retrieval Technologies– Cross-Language Information Retrieval– Multimedia Information Retrieval– Semantic Retrieval

• Applications to IR– Advanced Google– Meta Search– Search Result Clustering

Advanced Retrieval Technologies

• Cross-Language Information Retrieval (CLIR)

• Multimedia IR (image, speech, music, video)

• Semantic retrieval (XML, Semantic Web)

Cross-Language Information Retrieval

• Cross Language Information Retrieval (CLIR) -- A technology enabling users to query in one language and retrieve relevant documents written or indexed in another language

Cross Language Web Search

• A technology enabling users to query in one language and retrieve relevant Web pages written or indexed in another language

Why “Cross-Language”?

• Source: Global Reach (global-reach.biz/globstats)

Internet World Users by Language

Top Ten Languages Used in the WebSource: Internet World Stats (Mar. 31,

TOP TEN LANGUAGESIN THE INTERNET

Internet Usersby Language

InternetPenetrationby Language

Growthin Internet

( 2000 - 2008 )

Internet Users% of Total

World Populationfor this Language(2008 Estimate)

English 463,790,410 37.2 % 226.7 % 29.1 % 1,247,862,351

Chinese 321,361,613 23.5 % 894.8 % 20.1 % 1,365,138,028

Spanish 130,775,144 32.0 % 619.3 % 8.2 % 408,760,807

Japanese 94,000,000 73.8 % 99.7 % 5.9 % 127,288,419

French 73,609,362 17.8 % 503.4 % 4.6 % 414,043,695

Portuguese 72,555,800 29.7 % 857.7 % 4.5 % 244,080,690

German 65,243,673 67.7 % 135.5 % 4.1 % 96,402,666

Arabic 41,396,600 14.2 % 1,545.2 % 2.6 % 291,073,346

Russian 38,000,000 27.0 % 1,125.8 % 2.4 % 140,702,094

Korean 36,794,800 51.9 % 93.3 % 2.3 % 70,944,739

TOP 10 LANGUAGES 1,337,527,402 30.4 % 329.2 % 83.8 % 4,406,296,835

Rest of the Languages 258,742,706 11.2 % 424.5 % 16.2 % 2,303,732,235

WORLD TOTAL 1,596,270,108 23.8 % 342.2 % 100.0 % 6,710,029,070

Top Ten Languages Used in the Web( Number of Internet Users by Language )

More and more non-English users!

English Japanese German French Dutch Finnish Spanish Chinese Swedish

Language (estimated by domain)

Web Content

Source: Network Wizards Internet Domain Survey (Jan 99 )

More and more non-English pages

Chart of Web Content (by Language)

• Total Web pages: 313 B – English 68.4% – Japanese 5.9% – German 5.8% – Chinese 3.9% – French 3.0% – Spanish 2.4% – Russian 1.9% – Italian 1.6% – Portuguese 1.4% – Korean 1.3% – Other 4.6%

[Source: Vilaweb.com, as quoted by eMarketer (Feb. 2001)]

Language Percent of Public Sites

• English 72% • German 7% • Japanese 6% • Spanish 3% • French 3% • Italian 2% • Dutch 2% • Chinese 2% • Korean 1% • Portuguese 1% • Russian 1% • Polish 1%

[Source: OCLC, 2002]

Web Users and Pages (10 years ago)

Area Users Web Pages Time World-wide 150M 800M 7/99 China 4M 2.5~3M 7/99 Taiwan 4M 3M 7/99

Challenge of Scalability !

Total Users: 800MChinese Users: 110M

Including 87M (CN), 4.9M (HK), 11.6M (TW), 2.9M (MY), 2.14M (SG), 1.5M (US), and others.

Source: Global Reach, 2004

10,030,000,000 pages

Scalability Problem !

Number of Chinese Web Pages

Number of Web Pages

The world’s largest search engine ?

Billions Of Textual Documents Indexed

December 1995-September 2003

KEY: GG=Google, ATW=AllTheWeb, INK=Inktomi, TMA=Teoma, AV=AltaVista.

Source: Search Engine Watch (Nov. 2004)

SearchEngine

ReportedSize

PageDepth

Google 8.1 billion 101K

MSN 5.0 billion 150K

Yahoo4.2 billion(estimate)

AskJeeves

2.5 billion 101K+

Number of Web Pages

• Estimated size:– Web pages in the world: 19.2 billion pages

(indexed by Yahoo as of August 2005)– Websites in the world: 70,392,567 websites

(indexed by Netcraft as of August 2005)– Web pages per website: 273 (rounding to

the nearest whole number)• Updated estimate:

– 231,510,169 distinct websites (as found by the Netcraft Web Server Survey in April 2009)

– 63.2 billion [Source: http://news.netcraft.com/archives/web_server_survey.html]

[Source: http://www.boutell.com/newfaq/misc/sizeofweb.html]

Number of Web Pages

• 1 trillion unique URLs (We knew the web was big, by Jesse Alpert & Nissan Hajaj, Software Engineers, Web Search Infrastructure Team, 25 July 2008)

• 19,200,000,000 pages (Mayer, Tim, 8 August 2005, Our Blog is Growing Up And So Has Our Index)

• 320,000,000 pages (World Wide Web is 320 million and growing, BBC News Sci/Tech, 3 April 1998.)

• 1,000,000,000 pages (Internet. How much information? 2000. Regents of the University of California.)

• 800,000,000 pages (Maran, Ruth, and Paul Whitehead. "Web Pages." Internet and World Wide Web Simplified, 3rd ed. Foster City: IDG Books Worldwide, 1999. )

• 8,034,000,000 pages (Miller, Colleen. web sites: number of pages. NEC Research, IDC.)

[Source: http://hypertextbook.com/facts/2007/LorantLee.shtml]

Challenge of Cross-Language Web Search

• Existing CLIR systems mostly rely on bilingual dictionaries and dictionary lookup

• 81% of the search terms could not be obtained from common English-Chinese translation dictionaries

中央處理器 (CPU), 電子商務 (E-commerce),

個人數位助理 (PDA), 雅虎 (Yahoo), 太空總署 (NASA), 星際大戰 (Star War),非典型肺炎 (SARS), …

Challenge

• Existing CLIR systems mostly rely on bilingual dictionaries and dictionary lookup

• 81% of the search requests could not be obtained from common English-Chinese translation dictionaries

• How to find effective translations automatically for query terms not included in a dictionary ?

Query Translation & CLIR in DL

Chinese Query Mono-Lingual

Document Search

Mono-Lingual Document

Search瓷器 Chinese Digital

Libraries

Chinese Digital

Libraries

Possible global use

English Query

Porcelain

Document Search

Libraries

Chinese Digital

Libraries

Need for CLIR services

English Query

Porcelain

Document Search

Libraries

Chinese Digital

Libraries

Query Translation

瓷器 / 瓷 / 陶瓷

English Query

Porcelain

Document Search

Libraries

Chinese Digital

Libraries

Query Translation

Cost-ineffective to construct translation dictionaries

English Query

Porcelain

Document Search

Libraries

Chinese Digital

Libraries

Query Translation

Taking the Web as online corpus to deal with translation of

unknown terms

English QueryNational

Palace Museum

Document Search

Libraries

Chinese Digital

Libraries

Query Translation

故宮 / 故宮博物院

Online Term Translation Suggestions

Auto-generated

Translation Lexicons

English/Japanese/Korean Queries

Document Search

Libraries

Chinese Digital

Libraries

Query Translation

• Conventional approach to query translation – Parallel documents as the corpus– Assume long queries

• Problems of CLIR in digital libraries– No corpus for cross-lingual

training– Short queries

“Out-of-dictionary” terms– Ex: proper nouns, new

terminologies, …

English Terminologies

Chinese Translation

mechanical strain 機械應變viscous damping 黏滯阻尼Richard Feynman 費曼Hyoplastic Left Heart Syndrome

左心發育不全症候群

NII Japan 國立情報學研究所

SARS 嚴重急性呼吸道症候群

Extracorporeal Shock Wave Lithotripsy

震波碎石

Davinci 達文西

Translation Lexicon Construction for CLIR

• To use the Web as the corpus for query translation– Web mining techniques

• Anchor-text-based [ACM TOIS ‘04, ACM TALIP ‘02]• Search-result-based [JCDL ‘04]

• To extract terms from real document collections as possible queries– Term extraction method [SIGIR ‘97]

Web Mining Approach to Term Translation Extraction

• LiveTrans: http://wkd.iis.sinica.edu.tw/LiveTrans/

LiveTrans Engine

Academia SinicaAnchor textsAnchor texts

Search resultsSearch results

The Web

中央研究院 / 中研院

Source query

Target translations

National Palace Museum vs. 故宮博物院Search-Result Page

• Mixed-language characteristic in Chinese pages• How to extract translation candidates?• Which candidates to choose?

Noises

Yahoo vs. 雅虎 -- Anchor-Text Set

• Anchor text (link text)– The descriptive text of a

link on a Web page

• Anchor-text set– A set of anchor texts

pointing to the same page (URL)

– Multilingual translations− Yahoo/雅虎 /야후− America/美国 /アメリカ

• Anchor-text-set corpus– A collection of anchor-

text sets

Yahoo Search Engine

美国雅虎雅虎搜尋引擎

Yahoo! America

Taiwan

야후 -USA

アメリカの Yahoo! http://www.yahoo.com

Term Translation Extraction from Different Resources

Extraction

Source Query

TargetTranslation

Search-ResultPages

SearchEngineSearchEngine

SimilarityEstimationSimilarityEstimation

National Palace Museum

國立故宮博物院 , 故宮 , 故宮博物院

Anchor-Text

Corpus

WebSpiderWeb

Spider

LiveTrans: Cross-language Web Search

More Examples

Multimedia IR

• Different forms of information need• Image retrieval• Speech information retrieval• Music information retrieval• Video information retrieval

Image Retrieval

• Content-based– Query by image content

• Query by example ( 以圖找圖 )

– Similarity in visual features• Color, texture, shape, …

– Relevance feedback

• Text-based– Annotation

Content-Based Image Retrieval (CBIR)

• Example systems– CIRES (Content-based Image Retrieval

System): http://amazon.ece.utexas.edu/~qasim/research.htm

– SIMPLIcity: http://www-db.stanford.edu/IMAGE/– National Museum of History:

http://210.201.141.12/cgi-bin/cbir-query.cgi?tid=-1

– …

Similarimages(no RF)

Relevance Feedback (RF)Source: Dr. Cheng

Similar Images Using Relevance Feedback

Similarimagesusing RF

Automatic Image Annotation

Keywords?

white bear snow tundra polar bears snow fight

polar bear ice snow

Visual Similarity

Problem 1

Image Banks with Annotations

Spoken Document Retrieval

• Spoken document retrieval– Indexing speech messages using speech recognition– Retrieving relevant messages for a text/speech

• Techniques– Document Processing: acoustic change detection,

speech/non-speech detection, Mandarin/non-Mandarin detection, story segmentation, speaker recognition/clustering

– Speech Recognition– Indexing/Retrieval

SoVideo

http://slam.iis.sinica.edu.tw/demo.htm

Music Information Retrieval

• Finding a song by similar melody– Query by singing – Query by humming

• Singer identification– Background noise– Singer voice model

• Demo:– http://slam.iis.sinica.edu.tw/demo.htm

Video Information Retrieval

• Difference with CBIR– Temporal information– Structural organization– Complexity of querying system

• Techniques– Video segmentation– Keyframe identification

Semantic Retrieval

• HTML vs. XML• Semantic Web (Agent, Ontology,

Common Language of the Web

• HTML– Link: Pi Pj

– URL (URI), anchor text• Part-of

National Taiwan University

http://www.ntu.edu.tw/

Link Analysis –Hubs & Authorities in PageRank

Current Web Search

• Keyword-based search (e.g., Google)– Full text indexing – Page authority (link analysis)– Page popularity (query log and user’s click)

• Problems– Not specific

• Data in pages have no semantic annotations• Yo-yo Ma’s most recent CD

– No topic disambiguation• Documents with different topics mix together• Yo-yo Ma’s CDs, concerts, biography, gossips,…

Search on Semantic Web

• Metadata search– To increase precision and flexibility

• Topic-based search– To help contextualize queries and

overlay results in terms of a knowledge base

XML (Extensible Markup Language)

• More flexible tags• DTD (Data Type Definition)

– Definition of the tags

XML Search

• XML Text Search Engines– Amberfish (Etymon)– X3 (X-cubed) (DocSoft)– UltraSeek (Verity)

• XML Structured Query Engines– Fxgrep– Cheshire II (UC Berkeley)

• XML Query Languages– XQuery (W3C XMLQuery)– XQL– XML-QL

Semantic Web

• "The Semantic Web is an extension of the current Web in which information is given well-defined meaning, better enabling computers and people to work in cooperation." -- Tim Berners-Lee, James Hendler, Ora Lassila, The Semantic Web, Scientific American, May 2001

Semantic Web

ontology

Semantic Web

• RDF (Resource Description Framework)– Common language

• Ontology – Knowledge representation

• Agent

Why Semantic Web?

• Standardizing knowledge sharing and reusability on the Web

• Interoperable (independent of devices and platforms)

• Machine readable—enabling intelligent processing of information

An Example of Semantic Relation

author

publisherpublish

written by

What is a Software Agent?

• A paradigm shift of information utilization from direct manipulation to indirect access and delegation

• A kind of middleware between information demand (client) and information supply (server)

• A software that has autonomous, personalized, adaptive, mobile, communicative, social, decision making abilities

What is Ontology?

• An ontology is a formal and explicit specification of shared conceptualization of a domain of interest (T. Gruber)– Formal semantics– Consensus of terms– Machine readable and processible– Model of real world– Domain specific

What is Ontology?(2)

• Generalization of– Entity relationship diagrams– Object database schemas– Taxonomies– Thesauri

• Conceptualization contains phenomena like– Concepts/classes/frames/entity types– Constraints– Axioms, rules

Agents and Ontology

• Agents must have domain knowledge to solve domain-specific problems

• Agents must have common sharable ontology to communicate and share knowledge with each other

• The common sharable ontology must be represented in a standard format so that all software agents can understand and communicate

Agents and Semantic Web

• Semantic Web provides the structure for meaningful content of Web pages, so that software agents roaming from page to page will carry out sophisticated tasks– An agent coming to a clinic’s web page will

know Dr. Henry works at the clinic on Monday, Wednesday and Friday without having the full intelligence to understand the text…

– Assumption is Dr. Henry make the page using an off-the-shelf tool, as well as the resources listed on the Physical Therapy Association’s site

Knowledge Representation on the Web

• The challenge of the Web is to provide a language to express both data and rules for reasoning about the data [meta-data] that allows rules from any existing knowledge representation system to be exported onto the Web

• Adding logic to the Web means to use rules to make inference, choose actions and answer questions. The logic must be powerful enough but not too complicated for agents to consider a paradox

Language Layers on the Web

XHTML SMIL RDF

Declarative Languages:OIL, DAML+Ont

Semantic web infrastructure is built on RDF data model

DAML-L (logic)

Languages on the Web

• HTML+URL• XML+DTD (Data Type Definition)• RDF+RDF schema

Statements: RDF

• The basic structure of RDF is object-attribute-value

• In terms of labeled graph: [O]-A->[V]

Semantic Web Search Engine

• Swoogle: http://swoogle.umbc.edu/ [CIKM 2004]

• SHOE (Simple HTML Ontology Extensions): http://www.cs.umd.edu/projects/plus/SHOE/search/

• SWSE: http://www.swse.org/• http://

www.semanticwebsearch.com/

Applications to IR

• Advanced Google• Meta Search• Search Result Clustering

What do Users Really Want?

• Topic-based vs. keyword-based– “NTU”

• How to improve current search engines?

• Resources about Search Engines – Search Engine Watch:

http://searchenginewatch.com/ – Research Buzz: http://researchbuzz.com/

Advanced Google

• Is Google good enough?– “NTU”– “NTU university”– “NTU university Singapore”

• More and more Services– Google Web, Image, News, Video, Google Desktop Search ,

…– Google Groups, Gmail, Google Talk, Google Calendar, …– Google Mobile, Google SMS, Google Local, …– Google Print (Book Search), Google Maps, Google Earth, …– Google Scholar, Translate, Finance, Docs, Reader, …

• More about Google Services– http://www.google.com/options/– Google Labs: http://labs.google.com/

Text Information Retrieval and Applications – Advanced Topics

Documents

Bonus Text Topics

WMES3103 : INFORMATION RETRIEVAL TEXT OPERATIONS

Text Retrieval Oodb

Special Topics in Computer Science Advanced Topics in Information Retrieval Chapter 3: Goals: Retrieval Evaluation Alexander Gelbukh

Information Retrieval. Topics Information Retrieval (IR) – What is it – Inverted Indexes – Web search

1 Text Information Retrieval and Applications – Advanced Topics By J. H. Wang May 27, 2009

Content-Based Image Retrieval Rong Jin. Content-based Image Retrieval Retrieval by text Label database images by text tags Image retrieval as text retrieval

PARALLEL TEXT RETRIEVAL ON TEMPORALLY VERSIONED DOCUMENT ... · PARALLEL TEXT RETRIEVAL ON TEMPORALLY VERSIONED DOCUMENT COLLECTIONS a thesis ... PARALLEL TEXT RETRIEVAL ON TEMPORALLY

The Text REtrieval Conferences (TRECs)

Probabilistic Retrieval of OCR Degraded Text Using …ccc.inaoep.mx/~villasen/bib/Probabilistic Retrieval of...Probabilistic Retrieval of OCR Degraded Text Using N-Grams S.M. Harding

Special Topics in Computer Science The Art of Information Retrieval Chapter 7: Text Operations Alexander Gelbukh

Information Retrieval & Text Mining - Intranet DEIBhome.deib.polimi.it/.../DMTM/DMTM1112_TextMining.pdf · 2012-06-13 · Information Retrieval & Text Mining Data Mining and Text

Text Indexing and Retrieval

1 Text Retrieval and Applications – More Advanced Topics J. H. Wang May 20, 2008

CS6007 - INFORMATION RETRIEVAL UNIT V …CS6007 - INFORMATION RETRIEVAL UNIT V DOCUMENT TEXT MINING Information filtering; organization and relevance feedback – Text Mining -Text

CS276A Text Retrieval and Mining

Text Analysis - CORE · Text Analysis Exploring latent semantic models for information retrieval, ... resenting the documents as mixtures of these topics, enabling the user ... be

Text Based Information Retrieval - Text Mining PKB - Antonie

Special Topics in Computer Science The Art of Information Retrieval Chapter 7: Text Operations

Text Retrieval