Semantic Wikipedia The missing links

Denny VrandečićAIFB, Universität Karlsruhe (TH)Semantics 2006Vienna, November 28th, 2006

Universal Access toAll Knowledge

MarryingWikipedia and the Semantic Web

Overview

Background Wikis, Wikipedia, and the Semantic Web

Semantic Wikipedia Idea, How it looks like, Advantages

Challenges and Opportunities Web ecosystem, Open issues, Next steps

Long, long time ago…

Using Pattern Languages for Object Oriented Programming, OOPSLA87

Design Patterns

Design Patterns Web Page

Simple SyntaxH

Wikis Everyone can edit

Technology allows to edit Syntax is easy to learn

History of edits Recent changes Community building / Attribution

Easy to revert Important for fighting vandalism No fear of breaking the system

Wikipedia

A new encyclopedia

Created March 2000 Free, web based encyclopedia

Everyone can read Expert authors and editors Extensive formal peer review Until January 2001: 22 articles Side project: wiki-based Nupedia

Created March 2000 Free, web based encyclopedia

Everyone can read Expert authors and editors Extensive formal peer review Until January 2001: 22 articles Until January 2002: 20,342 articles in

17 languages, 17,307 in English

January 2001

Wikipedia growth

Year Articles English Languages

2002 20,342 17,307 17

Wikipedia growth

2002 20,342 17,307 17

2003 133,129 98,475 25

Wikipedia growth

2002 20,342 17,307 17

2003 133,129 98,475 25

2004 420,562 189,124 52

Wikipedia growth

2002 20,342 17,307 17

2003 133,129 98,475 25

2004 420,562 189,124 52

2005 1,311,697 438,289 162

Wikipedia growth

2002 20,342 17,307 17

2003 133,129 98,475 25

2004 420,562 189,124 52

2005 1,311,697 438,289 162

2006 3,100,360 893,237 197

Wikipedia growth

2002 20,342 17,307 17

2003 133,129 98,475 25

2004 420,562 189,124 52

2005 1,311,697 438,289 162

2006 3,100,360 893,237 197

11/2006 5,565,830 1,462,910 250

Wikipedia users

2.7 Mio registered users About 70,000 contributors 2% (1,400) make 73.4% of all edits

Most content from wide user base Clean up / “gardening” by small group

[English Wikipedia, study by Aaron Swartz]

Wikipedia’s problems

But it can’t work!

Everyone can edit Repairing is easier than breaking

No special status for experts Community building

Nature study on quality 4 / 3 error rate Wikipedia / EB Controversial

Quality

Hard to discover factual errors Focusing on quality Repeated facts Big number of lists But still not all “interesting” lists

Coverage by language

English: 1.5 Mio German: 0.5 Mio 10 more languages: 100.000+ 40 more languages: 10.000+ But what about other languages?

Semantic Web

Angola Africalocated in

Zambia

located in

borders

Country Continent

http://wiki.ontoworld.org/index.php/_Angolahttp://wiki.ontoworld.org/index.php/_Africa

http://wiki.ontoworld.org/index.php/_Relation-3ALocated_in

http://wiki.ontoworld.org/index.php/_Zambia

http://w

iki.ontoworld

.org/index.p

hp/_Relation-3ALoca

ted_in

http://wiki.ontow

orld.org/index.php/_Relation-3A

Borders

http://wiki.ontoworld.org/index.php/_Category-3ACountry

http://wiki.ontoworld.org/index.php/_Category-3AContinent

http://w

iki.ontoworld

.org/index.p

hp/_Relation-3ALoca

ted_in

http://wiki.ontow

Borders

Angola

http://www.w3.org/2000/01/rdf-schema#label

Africa

Located in

Zambia

Country

Borders

Continent

Zambia

located in

borders

Country Continent

Zambia

located in

borders

Country Continent

Semantic Wikipedia: Idea

Wikipedia today

Brač is a Croatian island in the Adriatic Sea. The island has a population of 13,000, living in numerous little towns, ranging from the 'main town' Supetar, with more than 2,500 inhabitants, to Novo Selo, where only a dozen people live.

Today, Brač lives mostly on tourism, but fishing and agriculture (especially wine and olives) are very important too, as is selling its precious, white stone (which was used in building Diocletian's Palace in Split, and is built into the White House in Washington, DC, too).

Category: Croatian Island

BračBrač

CroatiaCroatia

Adriatic SeaAdriatic Sea

ItalyItaly

tourismtourism

ZagrebZagreb SplitSplit

MontenegroMontenegro

How are they linked?

Brač Croatia

Brač Adriatic Sea

Brač Supetar

Brač Novo Selo

Brač tourism

Brač fishing

Brač agriculture

Brač belongs to Croatia

Brač Adriatic Sea

Brač Supetar

Brač Novo Selo

Brač tourism

Brač fishing

Brač agriculture

Brač located in Adriatic Sea

Brač Supetar

Brač Novo Selo

Brač tourism

Brač fishing

Brač agriculture

Brač has town Supetar

Brač has town Novo Selo

Brač tourism

Brač fishing

Brač agriculture

Brač has town Supetar

Brač has town Novo Selo

Brač lives on tourism

Brač lives on fishing

Brač lives on agriculture

Brač is a

[[Croatia]]n island with an area of 396 km².

Brač is a

[[belongs to::Croatia]]n island with an area of [[area:=396 km²]].

Typed links Extend wiki with typed links So the computer “understands” it

Brač Croatiabelongsto

area396 km²

How does it look like?

Advantages

Many pages answer questions list of female tennis players asteroids named after people countries sorted by area, population, …

They can be generated automatically Less maintenance tasks Higher consistency

Automatic tables and lists

Inline queries<ask>[[Category:Country]][[located in::Africa]][[population:=>1,000,000]][[population:=<10,000,000]][[population:=*]][[area:=*km²]][[borders::*]]

</ask>

Inline query results

Ontoworld

Does every country have one capital? Is there a person with more than one

mother? Is every person born before dying? Does the population density fit to

population and size?

Hand crafted checks

Multilinguality

Automatic check of consistency over language boundaries

Generating pages for smaller Wikipedias?

Browsing information in different languages

Web ecosystem

Wikipedia as a vocabulary

Semantic Wikipedia as a resource of URIs Maintaining good URIs is hard

Documented Multilingual labels Enables easier mapping

Reuse for common terms Helps in mapping the rest structurally

ChrissieChrissieRobertJordan

RobertJordan

TillTill

14,95 €14,95 €

Wheel ofTime

fsuggestT

ill lo

€Scenario: looking for gifts

Wikipedia as knowledge base

Tools already integrate Wikipedia articles

Bits of knowledge make more sense!

Amarok with knowledge import instead full articles?

Use Semantic Web tools

Integration of data Querying

SPARQL endpoints Browsing

Faceted browsers Visualization

Timeline

SMW installations Ontoworld sem’base WWW2006 & ESWC2006 Wiki Semantic Karlsruhe KM Bible wiki Esoteric knowledge wiki Wikicompany JurisPedia …

Open issues

Convergence of vocabulary

Consistency of vocabulary Author of, has written, creator…

Documentation of all types Visual feedback: red and blue links

Queries: consistent vocabulary needed Autocompletion? UI hints?

NLP and Semantic Wikipedia

Suggestion / learning of relationships Based on patterns Statistical Background knowledge

Good playground for evaluations

Simpler User Interface

WYSIWYG Interface for MediaWiki is in development

How to integrate with Semantic Extension?

Lack of expressivity

How to say “Ronald Reagan was US president from 1980 to 1988”?

What about relations between relations, like inverses?

What about transitivity, symmetry? What about constraints like class

disjointness?

Next steps

Marry Wikipedia and Semantic Web Need to run stress tests

Wikipedia at 12,000 hits per second Scalability,

scalability, scalability Show cool apps Multilinguality Tons of details

Conclusions

Very flexible system for creating data “Soft” introduction

People often scared about Semantic Web You can still use it as a standard wiki Immediate benefit

“The simplest database that could work” Data is there – play with it! Kickstart the Semantic Web

Universal Access toAll Knowledge

Thank you!

ontoworld.org

Conclusions

Very flexible system for creating data “Soft” introduction

People often scared about Semantic Web You can still use it as a standard wiki Immediate benefit

“The simplest database that could work” Data is there – play with it! Kickstart the Semantic Web

Backup slides

Technicalities

MediaWiki

Runs Wikipedia Active development Scalable Easy to use and powerful PHP / MySQL Not many SemWeb tools here

Mapping of OWL to SMW

owl:Individual Article

owl:Class Category

owl:ObjectProperty Relation, Link type

owl:DatatypeProperty Attribute

Object property instance Typed link [[property::object]]

Datatype property instance [[property:=value]]

rdf:type class Class instantiation

[[Category:class]]

(on article page)rdfs:subClassOf class

Subsumption

[[Category:class]]

(on category page)

Reuse vocabulary

Existing vocabulary can be mapped Wiki directly usable as data source

No external mapping required Define vocabulary and mapping But: no complex mappings

Reuse in a Webpage

Zambia

located in

borders

Country Continent

http://w

iki.ontoworld

.org/index.p

hp/_Relation-3ALoca

ted_in

http://wiki.ontow

Borders

http://w

iki.ontoworld

.org/index.p

hp/_Relation-3ALoca

ted_in

http://wiki.ontow

Borders

Angola

Africa

Located in

Zambia

Country

Borders

Continent

Zambia

located in

borders

Country Continent

http://w

iki.ontoworld

.org/index.p

hp/_Relation-3ALoca

ted_in

http://wiki.ontow

Borders

Angola

Africa

Located in

Zambia

Country

Borders

Continent

SPARQL : RDF Query LangPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>PREFIX thing: <http://wiki.ontoworld.org/index.php/_>PREFIX relation: <http://wiki.ontoworld.org/index.php/_Relation-3A>

SELECT ?labelWHERE { thing:Angola relation:Located_in ?c . ?c rdfs:label ?label}

http://w

iki.ontoworld

.org/index.p

hp/_Relation-3ALoca

ted_in

http://wiki.ontow

Borders

Angola

Africa

Located in

Zambia

Country

Borders

Continent

<html> <body> Angola is in <?php define("RDFAPI_INCLUDE_DIR", "path/api/"); include(RDFAPI_INCLUDE_DIR . "RDFAPI.php");

$model = ModelFactory::getDefaultModel(); $model->load("full URI/ExportRDF/Angola"); $result = $model->sparqlQuery('SPARQL'); $value = $result[0]['?label']; echo $value->getLabel(); ?> </body></html>

Angola is in Africa.

TBox engineering

Full TBox engineering?

Not meant for it, but possible Does not capture semantics Does not propagate to categories

Reified ontologies

SubclassOfAxiom1

meta:Populated

meta:City

refers

subclass

subclass of

refers

Populated place

meta:subclassO

Reified ontologies

SubclassOfAxiom1

meta:Populated

meta:City

subclass

subclass of

Populated place

meta:subclassO

owltools

Everything can be discussed

All pages have a discussion page All individuals, classes, properties have

a page With reification, even axioms may have

a page Very fine grained discussion possible

Opinions can be formalized explicitly

Ontology import

Reuse existing ontologies Upload mapped ontologies Kickstart a wiki Circumvent empty sheet problem Enrich an existing wiki

Only the simple parts

owl:Individual Article

owl:Class Category

owl:ObjectProperty Relation, Link type

owl:DatatypeProperty Attribute

Object property instance Typed link [[property::object]]

Datatype property instance

[[property::value]]

rdf:type class Class instantiation

[[Category:class]]

On article page

rdfs:subClassOf class

Subsumption

[[Category:class]]

On category page

Reasoning wikis

Dynamics

SemanticMediaWiki

SemanticMediaWiki KAON2KAON2User

Browser

UserBrowser

edit articlecheck for consistency

consistent?

warn if inconsistent

Example:-wife of has domain Woman-Woman and Man are disjoint

Mockup screen

Automatic classification

Infer categories from statements Based on background ontology and

wiki knowledge Automatic classification of articles Can be reused in queries

Mockup screen

URI crisis resolved?

URIs for everything

Uniform Resource Identifiers Based on known protocols

Linked data: resolve URI for description Maintaining URIs is hard

Clutter namespace Setting up descriptions Persistence Reuse and mapping

Romeo and JulietRomeo and Juliet

URI crisis

Is “Romeo and Juliet” the book, or the article about the book?

One URI for each Mind the gap! Redirects in

browser

Shakespeareauthor

JSmith 42

author

http://en.wikipedia.org/wiki/Romeo_and_Juliet

http://en.wikipedia.org/wiki/_Romeo_and_Juliet

Bug status: still open

Slides index – Backup slides

103 – Technicalities111 – Reuse in webpages124 – TBox engineering129 – Ontology import132 – Reasoning in wikis137 – URI crisis resolved

19 – Wikipedia 49 – Semantic Web 56 – Basic idea 74 – Advantages 91 – Open issues101 – Conclusions

Semantic Wikipedia The missing links

Documents

Mapping on MediaWiki › wikipedia › commons › 3 › ... · Presentation outline Maps Semantic Maps Concept Coordinate data type Queries Forms And even more awesomeness

Hunting for semantic clusters - OCLC€¦ · Hunting for semantic clusters ... Mapping from di erent formats and vocabularies to a shared data model may cause information missing

An efficient Wikipedia semantic matching approach …bigdata.ustc.edu.cn/paper_pdf/2017/Zongda-Wu-ISci.pdfIn the WMDC approach, the semantic reference space is constructed on a large

Introduction to Data Warehousing and OLAPweb.uettaxila.edu.pk/CMS/seADMSbsSp09/notes\ADBMS-Lecture-10 Data...– Data type differences – Missing fields – Semantic differences

Towards a Semantic Wikipedia: WikiData

Detecting Promotional Content in Wikipediabenking/resources/reading... · Automatic Vandalism Detection in Wikipedia with Web-based Shallow Syntactic-Semantic Modeling (COLING 2010)

WiGiPedia: Visual Editing of Semantic Data in Wikipediaholl/pubs/bostandjiev-2011-VISSW.pdf · WiGiPedia: Visual Editing of Semantic Data in Wikipedia ... Led Zeppelin, Pink Floyd,

A Semantic Best-Effort Approach for Extracting Structured Discourse Graphs from Wikipedia

Extracting Semantic Relationships between Wikipedia Articles › ~jkalita › papers › 2009 › StoutenburgS... · progress toward extracting semantic information from Wikipedia,

Simulating Computer Architectures - Semantic Scholar · Simulating Computer Architectures Nice picture is missing! HenkMuller. i Simulating Computer Architectures ... Marnix Vlot,

A Random Graph Walk based Approach to Computing Semantic Relatedness Using Knowledge from Wikipedia Presenter: Ziqi Zhang OAK Research Group, Department

A wikipedia-based semantic relatedness framework for ...Keywords Online reputation management · Semantic relatedness · Wikipedia · Reputation dimensions 1 Introduction The area

Semantic Wikipedia -

Probabilistic Semantic Similarity Measurements for Noisy Short Texts Using Wikipedia Entities

A semantic approach for question classification using WordNet and Wikipedia

01/06/15Sergey Chernov 1 Extracting Semantic Relationships between Wikipedia Categories By Sergey Chernov, Tereza Iofciu, Wolfgang Nejdl, Xuan Zhou, Michal

Ned Kock - Semantic Scholar · 2015-07-28 · 2 Single missing data imputation in PLS-SEM Ned Kock Full reference: Kock, N. (2014). Single missing data imputation in PLS-SEM.Laredo,

Knowledge Derived from Wikipedia for Computing Semantic ...semantic relatedness is deﬁned as the inverse score of the semantic distance (pl henceforth). Since the edge counting approach

AIFB Denny Vrandečić AIFB, Universität Karlsruhe (TH) Semantics 2006 Vienna, November 28th, 2006 Semantic Wikipedia The missing links

Contributing to Wikipedia - Wikimedia...reliable source that covers it better than the Wikipedia article. Now comes the fun part. Click the Edit button! Add some of what is missing