View
294
Download
0
Category
Tags:
Preview:
DESCRIPTION
Exploratory Search and Intelligent Recommendations, CrEDIBLE 2014 Workshop, Sophia-Antipolis, France, 08-10.10.2014
Citation preview
The Journey is the Reward
-Explorative Semantic
Search based on Linked Open Data
Sophia Antipolis, 09. October 2014
Dr. Harald SackHasso-Plattner-Institute for IT Systems Engineering
University of PotsdamDonnerstag, 9. Oktober 14
Hasso Plattner Institute for IT Systems EngineeringSemantic Technologies & Multimedia Retrieval Research Group
Donnerstag, 9. Oktober 14
• Research Topics□ Semantic Web Technologies□ Knowledge Discovery□Ontological Engineering□Multimedia Analysis & Retrieval□ Social Networking□Data/Information Visualization
• Research Projects:
Hasso Plattner Institute for IT Systems EngineeringSemantic Technologies & Multimedia Retrieval Research Group
Donnerstag, 9. Oktober 14
Overview
(1) Search & Retrievaland why we are not always content with it...
(2) Semantic Analysisto better „understand“ the content
(3) Explorative Semantic Searchswitching from „retrieval“ to „discovery“
(4) Intelligent Recommendation variatio delectat - variation is delectable
The Journey is the RewardExplorative Semantic Search based onLinked Open Data
Donnerstag, 9. Oktober 14
Search & Retrieval today...
Donnerstag, 9. Oktober 14
Autocompletion
Google Knowledge Graph
Donnerstag, 9. Oktober 14
Query by Example
Visual Analysis
RecommendationsDonnerstag, 9. Oktober 14
The Ordinary Archive is a Small World...
Jules Verne
Donnerstag, 9. Oktober 14
Information Retrieval Paradigm
(Salton,G., McGill, M.J.: Introduction to Modern Information Retrieval. McGraw-Hill, New York 1983)
Set of Documents
Files of records
Set of Queries
Information requests
queryDocument
Index
based on “similarity“
IndexingQuery
Formulation
String Matching
Donnerstag, 9. Oktober 14
Let‘s assume you are looking for something and you don‘t know how to phrase your search
correctly....Donnerstag, 9. Oktober 14
moon
Donnerstag, 9. Oktober 14
moon spaceflight
Donnerstag, 9. Oktober 14
moon spaceflight impact
Donnerstag, 9. Oktober 14
moon spaceflight impact silent movie
Donnerstag, 9. Oktober 14
moon spaceflight impact silent movie
Donnerstag, 9. Oktober 14
• sometimes simple query matching with text content or metadata alone is not sufficient to fulfill the user‘s information needs
• what is missing are often the relational connections and circumstances, i.e. contextual information is needed to answer the query
• in order to achieve this the content must be „understood“
Semantic Analysis
Donnerstag, 9. Oktober 14
Overview
(1) Search & Retrievaland why we are not always content with it...
(2) Semantic Analysisto better „understand“ the content
(3) Explorative Semantic Searchswitching from „retrieval“ to „discovery“
(4) Intelligent Recommendation variatio delectat - variation is delectable
The Journey is the RewardExplorative Semantic Search based onLinked Open Data
Donnerstag, 9. Oktober 14
• Authoritative• structured data• semi-structured data• natural language text
• Non-authoritative• (free) user tags and comments• restricted vocabularies
• (Media) Analysis• low level features• high level features
How to Determine the Meaning of (Meta)data?
SemanticAnalysis
reliability
context
pragmatics
location dependency
accuracy
timedependency
level ofabstraction
(Meta)data Source
Donnerstag, 9. Oktober 14
From Raw (Text) Data to Semantic Entities
Neil Armstrong
Neil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
Astronaut
rdf:type
SpaceMissiondbpedia-owl:crewMember
Person
rdfs:subClassOf
stringdbpedia-owl:birth_name
datedbpedia-owl:birth_date
Event
rdfs:subClassOf
integerdbpedia-owl:crewSize
Entities
Ontologies
tag
text
image annotation
Donnerstag, 9. Oktober 14
Web of Data = Linked Open Data
Neil Armstrong
Astronaut
rdf:type
Person
rdfs:subClassOf
SpaceMissiondbpedia-owl:crewMember
stringdbpedia-owl:birth_name
datedbpedia-owl:birth_date
Event
rdfs:subClassOf
integerdbpedia-owl:crewSize
Donnerstag, 9. Oktober 14
Named Entity Resolution
Neil ArmstrongNeil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
text
image annotation
Donnerstag, 9. Oktober 14
Text
(1) Determine possible Entity Candidates
Neil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
• linguistic analysis (POS tagging)• n-gram analysis• normalization (stemming)• encoding and spelling• language dependent spellings• abbreviations & acronyms• type dependent spellings• alternative names and synonyms• fuzzy string mapping• ...
Named Entity Resolution
Donnerstag, 9. Oktober 14
Text
Neil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
• Named Entity Tagging• Persons• Locations• Organization• Time• Date• Money• ...
(2) Subsequent Filtering of Entity Candidates
Named Entity Resolution
Donnerstag, 9. Oktober 14
(3) Disambiguation of Correct Entity
• Which entity candidate to choose depends on the context• Context Analysis
• takes into account Ambiguity, Accuracy, and Reliability of source data and mapping
TemporalContext
SpatialContext
Context Item
SocialContext
Contextual Description
ClassDiversity
Level of Structure
SourceReliability
SourceDiversity
Context Dimensions
Ambiguity Accuracy
influences influences
Relevance
determines
N.Steinmetz, H.Sack: Semantic Multimedia Information Retrieval Based on Contextual Descriptions, ESWC 2013
Donnerstag, 9. Oktober 14
Neil Armstrong Tranquility Base
Houston
(3) Disambiguation of Correct Entity
• Determine Candidates for all Entities within the given contextEarth
Commander
EagleMission Control
Donnerstag, 9. Oktober 14
Tranquility Base
Neil Armstrong
(3) Disambiguation of Correct Entity
• look for existing connections/relations among entity candidates within the given context
Mission Control
Donnerstag, 9. Oktober 14
(3) Disambiguation of Correct Entity
• Link Graph AnalysisNeil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
Donnerstag, 9. Oktober 14
(3) Disambiguation of Correct Entity
• Link Graph AnalysisNeil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
Tranquility Base
Neil Armstrong
Mission Control
Houston
Eagle
Earth
Donnerstag, 9. Oktober 14
NeilArmstrong Houston Tranquility
BasemissioncontrolearthEagle Term
Entities
(3) Disambiguation of Correct Entity
• Link Graph Analysis• identify connected components that cover the most term partitions• only one node per partition should be covered• strongly connected components consolidate the disambiguation
Donnerstag, 9. Oktober 14
(3) Disambiguation of Correct Entity
• for our example Neil Armstrong, the 38-year-old civilian commander, radioes to earth an the mission control room here: „Houston, Tranquility Base here, The Eagle has landed.“
Donnerstag, 9. Oktober 14
Overview
(1) Search & Retrievaland why we are not always content with it...
(2) Semantic Analysisto better „understand“ the content
(3) Explorative Semantic Searchswitching from „retrieval“ to „discovery“
(4) Intelligent Recommendation variatio delectat - variation is delectable
The Journey is the RewardExplorative Semantic Search based onLinked Open Data
Donnerstag, 9. Oktober 14
Search vs. Exploration
Donnerstag, 9. Oktober 14
Search vs. Exploration
V E R N E, Jules:From the Earth to the Moon, Direct in 97 Hours 20 Minutes and a Trip Round It, Sampson Low, Marston&Company, London (1873),viii, 323 p. plates.
GRC C.194.a.659, 12516.g.20
Donnerstag, 9. Oktober 14
• Find another („comparable“) book, (that will interest me...)
• Find books on related topics?• How did the author / the topic develop over time? • What else would I like to read?
Search vs. Exploration
Donnerstag, 9. Oktober 14
• Find another („comparable“) book, (that will interest me...)
• Find books on related topics?• How did the author / the topic develop over time? • What else would I like to read?
Search vs. Exploration
Exploratory Search
Donnerstag, 9. Oktober 14
(Traditional) Libraries also enable Exploratory SearchDonnerstag, 9. Oktober 14
(Traditional) Librarians enable „intelligent“ RecommendationsDonnerstag, 9. Oktober 14
Overview
(1) Search & Retrievaland why we are not always content with it...
(2) Semantic Analysisto better „understand“ the content
(3) Explorative Semantic Searchswitching from „retrieval“ to „discovery“
(4) Intelligent Recommendation variatio delectat - variation is delectable
The Journey is the RewardExplorative Semantic Search based onLinked Open Data
Donnerstag, 9. Oktober 14
Exploratory Search based on Linked Open Data
http://dbpedia.org/resource/From_the_Earth_to_the_Moon
Donnerstag, 9. Oktober 14
Exploratory Search based on Linked Open Data:From_the_Earth_to_the_Moon
:Jules_Verne
dbpedia-owl:author
:H._G._Wells
dbpedia-owl:influenced
dbpedia-owl:Bookrdf:type
category:1865_novels
category:Frence_science_fiction_novels
category:Novels_by_Jules_Verne
category:Moon_in_fiction
category:Fictional_rivalries
category:Novels_set_in_Florida
category:1860s_science_fiction_novels
...
dcterms:subject
:In_Search_of_the_Castaways
dbprop:preceded_by
Donnerstag, 9. Oktober 14
Similar Results ➞ belong to consistent categories
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Donnerstag, 9. Oktober 14
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Similar Results ➞ belong to consistent categories
Donnerstag, 9. Oktober 14
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Problem: too „similar“ Recommendations (in the long run)
Similar Results ➞ belong to consistent categories
Donnerstag, 9. Oktober 14
Donnerstag, 9. Oktober 14
Serendipity helps to improve the Quality of Discovery & Exploration
Serendipity:
• finding a solution to a problem that is relevant but not intentionally thought of
• a recommended item is a seredipitious discovery if it is interesting and positively surprising because one was not in search for any of its kind
Relevance Unexpectedness+=
Serendipity Donnerstag, 9. Oktober 14
Serendipity helps to improve the Quality of Discovery & Exploration
Relevance:
• In the general case, often referenced (cited) facts are considered more relevant
• In the special case, the relevance of a fact must be adapted to the current (personal) context
Unexpectedness:
• the likelyhood of co-occurrence should be low
combine • similarity based recommendations • with serendipitiuos but relevant findings
ExplorationDonnerstag, 9. Oktober 14
Serendipity: Skip most comon (similar) categories (classes)
category:1865_novels
category:Frence_science_fiction_novels
category:Novels_by_Jules_Verne
category:Moon_in_fiction
category:Fictional_rivalries
category:Novels_set_in_Florida
category:1860s_science_fiction_novels
...
most comon (similar) category for a specific entity • contains the most similar entities for this specific entity
dcterms:subject
Donnerstag, 9. Oktober 14
Similarity ≈ Sharing comon Properties
dbpedia-owl:Bookrdf:typerdf:type
dbpedia:Science_Fictiondbpedia-owl:literaryGenre dbpedia-owl:literaryGenre
dbpedia-owl:author dbpedia-owl:author
dbpedia:Jules_Verne
dbpedia:Voyages_Extraordinairesdbpedia-owl:series dbpedia-owl:series
Francedbprop:country dbprop:country
category:Moon_in_fictiondcterms:subject dcterms:subject
category:French_science_fiction_novelsdcterms:subject dcterms:subject
Donnerstag, 9. Oktober 14
Serendipity: Skip most comon (similar) categories (classes)
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Donnerstag, 9. Oktober 14
Serendipity: Skip most comon (similar) categories (classes)
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Donnerstag, 9. Oktober 14
Serendipity: Skip most comon (similar) categories (classes)
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Donnerstag, 9. Oktober 14
Serendipity: Skip most comon (similar) categories (classes)
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Donnerstag, 9. Oktober 14
Serendipity: look for the least expected yet relevant...
Donnerstag, 9. Oktober 14
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Serendipity: look for the least expected yet relevant...
Donnerstag, 9. Oktober 14
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Serendipity: look for the least expected yet relevant...
Donnerstag, 9. Oktober 14
• category:French_science_fiction_novels• category:Moon_in_fiction• category:Novels_by_Jules_Verne• category:American_Civil_War_novels• category:Novels_set_in_Florida• category:1860s_science_fiction_novels• category:1865_novels• category:Fictional_rivalries
Serendipity: look for the least expected yet relevant...
Donnerstag, 9. Oktober 14
Content-Based Recommendations
Industry Project: cENTERTAIN.me video recommendationhttp://mediaglobe.yovisto.com:8080/c.me-gui-0.0.1-SNAPSHOT2/
Donnerstag, 9. Oktober 14
Overview
(1) Search & Retrievaland why we are not always content with it...
(2) Semantic Analysisto better „understand“ the content
(3) Explorative Semantic Searchswitching from „retrieval“ to „discovery“
(4) Intelligent Recommendation variatio delectat - variation is delectable
The Journey is the RewardExplorative Semantic Search based onLinked Open Data
Dr. Harald SackHasso-Plattner-Institut für Softwaresystemtechnik, Universität PotsdamProf.-Dr.-Helmert-Str. 2-3, D-14482 Potsdam
Donnerstag, 9. Oktober 14
Recommended