Integrating Social Web & TV with help of semantics

Lora Aroyo & Guus Schreiber Computer Science

VU University Amsterdam

Semantic Web @ VU Amsterdam

•  40 people, two groups: Web & Media (Schreiber), Knowledge Representation & Reasoning (van Harmelen)

•  A few ongoing projects: –  europeana.eu: EU culture portal –  NL projects on access to cultural heritage: CHIP,

Agora –  EU NoTube: Web & TV semantic integration –  PrestoPrime: user-generated annotations and

content for TV archives –  EU LarKC: platform for massive distributed

incomplete reasoning

The Linked Data Web: typed resources and links

URL URL

Web link

ULAN

Henri Matisse

Dublin Core

creator

Painting “Woman with hat

SFMOMA

Architecture of a Linked Data application

Web pages, databases collections, tables,

converters scrapers

RDF store

RDF files

RDF query & inferencing

Application

Demo using linked data (RPI, Hendler)

The power of simple alignments “Tokugawa”

SVCN period Edo

SVCN is local in-house ethnology thesaurus

AAT style/period Edo (Japanese period) Tokugawa

AAT is Getty’s Art & Architecture Thesaurus

http://e-culture.multimedian.nl/demo/search

Europeana Thought Lab cloud

From metadata to semantic metadata

1. Make vocabulary interoperable

2. Align metadata schema

3. Enrich metadata

4. Align vocabulary

SKOS EDM

Enriching the metadata

Resulting semantic annotation

Learning vocabulary alignments

•  Example: learning relations between art styles in AAT and artists in ULAN through NLP of art historic texts –  “Who are Impressionist painters?”

Personalized Rijksmuseum

•  Interactive user modeling

• Recommendations of artworks and art topics

Mobile museum tour

Video tagging games

NoTube slogan: Putting the user back in the

driving seat

Observations: •  Personalized services are now common •  But: user data is still under control of

separateapplications •  Result: user is faced with multitude of

distributed personal data, hidden in tons of inaccessible cookies

NoTube building blocks (1)

1. TV metadata services EPG metadata grabbers – from 170+ channelsr (issue: channel URLs) – metadata format⎝TV Anytime – real‐time service05‐06 May 2010NoTube 1st

review20Building blocks: 2. Metadata enrichment

Add links to external Web vocabularies and repositories: Lupedia service

NoTube building blocks (2) 3. Linked Open Data for TV

–  Access services to major vocabularies –  Alignment services between major vocabularies,

where needed (e.g. genre typologies) 4. User activity streams

–  Standard for activity stream representation •  based on Open Social

–  Access services to activity streams •  YouTube, Twitter, ....

–  Trusted access to “friend” information •  implementation of standard like OAuth 2.o

NoTube building blocks (3)

•  user profiling• Services for generating user preferences – “Beancounter” – abstractions from activity stream• User‐model representation based on FOAF05‐06 May 2010NoTube 1st review24Building blocks: recommenders• Collaborative recommenders – preferences of friends• Content‐based recommenders – program about Alma Mahler⎝program aboutWalter Gropius • Experiment with mix of these recommenders

Usage scenario & demo

A world of opprtunities is opening!

Thenk you Questions?