59
2010.12.03 Semantic Technology: The State of the Art and Research Directions Sung-Kook Han

Semantic Technology: State of the arts and Trends

Embed Size (px)

DESCRIPTION

Overview of the current state of the arts of semantic technology and future trends Linked Open Data + Context-aware Services = Killer Apps of Semantic Technology

Citation preview

Page 1: Semantic Technology: State of the arts and Trends

2010.12.03

Semantic Technology:The State of the Art and Research Directions

Sung-Kook Han

Page 2: Semantic Technology: State of the arts and Trends

Outline

Review of Semantic Technology

Hot Issues:

Linked Data

Context-aware

Future Research Trends and Conclusions

Page 3: Semantic Technology: State of the arts and Trends

Semantic Technology

Semantic technology has been a distinct research field for more than 40 years.

Formal Logic (since Russell and Frege)

Knowledge Representation Systems in AI

Semantic Networks and ATN (William Woods, 1975)

DARPA and European Commission programs in information integration

Development of simple tractable logics

Relational Algebras and Schemas in Database Systems

Library Science (classifications, thesauri, taxonomies)

New challenges of Semantic Technology: Semantic Web

A massive store of information that computers cannot use

A way to get around needing the “big data warehouse”

Another place where “a little semantics can go a long way”...

cf: The Relationship Between Web 2.0 And the Semantic Web - Dr. Mark Greaves, Vulcan, Inc.

Page 4: Semantic Technology: State of the arts and Trends

2010-11-27 [email protected] 4

Ontology Spectrum

Animal

Mammal ReptileBird

SnakeDog Cat

Cocker

Spaniel

Lady

Technologieshas_experience_in

Programsworks

Personnel

S1

Agent

Company

illusion

has WISO

Department

am

AS ASAS

LeoPaulnderleez

IntelligenceNavy

BradAnn

Howard

AssistantDirectorReza

Director

Technical

ManagementProject

TelecommunicationTask

Program

EcDARPA

Request

SemanticInteroperability

KnowledgeRepresentation

NaturalLanguage

Is Disjoint Subclass

of with transitivity

property

Modal Logic

Logical Theory

ThesaurusHas Narrower Meaning Than

TaxonomyIs Sub-Classification of

Conceptual ModelIs Subclass of

DB Schemas, XML Schema

UML

First Order Logic

Relational

Model, XML

ER

Extended ER

Description Logic

DAML+OIL, OWL

RDF/SXTM

Syntactic Interoperability

Structural Interoperability

Semantic Interoperability

weak semanticsweak semantics

strong semanticsstrong semantics

Based on Leo Obrst, The Ontology Spectrum & Semantic Models

Page 5: Semantic Technology: State of the arts and Trends

Semantic Technology

OntologyOntology

MetadataMetadata

controlled vocabularycontrolled vocabulary

Web resourcesServices

Web resourcesServices

ImageAudio/Video

ImageAudio/Video

DocumentsDocuments

IntegrationIntelligence Interoperability

Semantic

Technology

Semantic

Technology

Machine-processibleSemantics

DigitalInformation Resources

Page 6: Semantic Technology: State of the arts and Trends

Web Technology

Web of machine-processible Data

Common vocabularies: Metadata and Ontology

Query and reasoning

Web of Services

Internet of ServicesClassic Web

Social Web

Connect human-being

Web as a platform

Programmable APIs and proprietary interfaces

Mashups based on a fixed set of data sources

Web of Documents

HTML as document format

HTTP URLs as globally unique IDs

Hyperlinks to connect everything

Page 7: Semantic Technology: State of the arts and Trends

Semantic Web

Standardizations Trio of Semantic Web

Metadata / Ontology: RDF, RDF, OWL

Query Language: SPARQL

Rule Language: RIF (SWRL)

SKOS, RDFa, GRRDL, WSMO,…

SOAP/ REST

Tools and Systems Authoring, Reasoning Engines,…

835 items in Sweet Tools

Best Practices Linked Open Data

Semantic MediaWiki

NEPOMUK, SIOC, Garlik

W3C Semantic Web Use cases

Sweet Tools: http://www.mkbergman.com/new-version-sweet-tools-sem-web/

W3C Semantic Web Case Studies and Use Cases: http://www.w3.org/2001/sw/sweo/public/UseCases/

2010-11-27 7Sung-Kook Han

Page 8: Semantic Technology: State of the arts and Trends

Semantic Applications

Semantic Wave 2008, Industry Roadmap to Web 3.0, Project10X

http://www.mkbergman.com/new-version-sweet-tools-sem-web/

Page 9: Semantic Technology: State of the arts and Trends

Web 2.0

Resharpen the way of viewing the WebWeb as the platform

Web as the social media

Web as the collaboration tool

Web as ……

Web 2.0 Manifestation Openness / Sharing

Participation / Collaboration

Web 2.0 Syndrome Library 2.0

Government 2.0

Enterprise 2.0

……

New Web applications wiki, blog, RSS,…

2010-11-27 9Sung-Kook Han

Page 10: Semantic Technology: State of the arts and Trends

Web 2.0 Developers

Page 11: Semantic Technology: State of the arts and Trends

Semantic Web Today

Major future issues:

• Vocabularies • Scalability• Provenance• Personal Infospheres• Mobile and Real World Networks

Page 12: Semantic Technology: State of the arts and Trends

Web 2.0 APIs Today

MashUp

WebAPI

WebAPI

WebAPI

A CB

No Single global space:

• Mashups of APIs are proprietary.• No links between data.

Web APIs slice the Web into Walled Gardens.

Christian Bizer: Pay-as-you-go Data Integration (21/9/2010)

Page 13: Semantic Technology: State of the arts and Trends

The Web is Dead??

http://www.wired.com/magazine/2010/08/ff_webrip/

Page 14: Semantic Technology: State of the arts and Trends

Long Live the Web !

http://www.scientificamerican.com/article.cfm?id=long-live-the-web

Page 15: Semantic Technology: State of the arts and Trends

Lessons Learned

Data is more important than API code.

Data is the Intel Inside.

Open data is more important than open source

Structured data is more valuable than unstructured.

We should seek to structure our data well.

Metadata will play a core role of data structure.

A little semantics goes a long way.

Beware the usefulness of shallow ontology shown in LOD.

Linking data and services are essential.

Link every thing.

Rich user experiences are the key for adaption.

We should consider mobile computing and personalization.

Visualize and navigate.

Page 16: Semantic Technology: State of the arts and Trends

Linked Open Data

Page 17: Semantic Technology: State of the arts and Trends

Web of Documents

A global file systems of documents (document silos on the

Web).

Implicit semantics of content and links

Designed for human consumption

Disconnected data

Page 18: Semantic Technology: State of the arts and Trends

Linked Data: Web of Data

Goal: Web-scale Data Integration

Alternative to classic data integration systems in order to cope with growing

number of data sources.

Querying Across Data Sources

Global distributed database

Extend the Web with a single global data space

Giant Global Graph (GGG)

Demonstrate the possibility of Semantic Web

By using RDF to publish structured data

By setting links between data

RDF

RDF

RDF

RDF

RDFRDF

singleuniversal

information space.

Page 19: Semantic Technology: State of the arts and Trends

Semantic Web: Web of Data

The vision of a Semantic Web:

building a global Web of machine-readable data

Berners-Lee, Hendler & Lassila, 2001; Marshall & Shipman, 2003

Linked Data Foundation

can lower the barrier to reuse, integration and application of data from multiple,

distributed and heterogeneous sources.

the more sophisticated proposals associated with the Semantic Web vision,

such as intelligent agents, may become a reality.

The first step is putting data on the Web in a form that machines can naturally understand, or converting it to that form. This creates what I call a Semantic Web - a web of data that can be processed directly or indirectly by machines. Therefore, while the Semantic Web, or Web of Data, is the goal or the end result of this process, Linked Data provides the means to reach that goal. -- Tim Berners-Lee, et al., http://linkeddata.org/docs/ijswis-special-issue, Jan, 2009

The first step is putting data on the Web in a form that machines can naturally understand, or converting it to that form. This creates what I call a Semantic Web - a web of data that can be processed directly or indirectly by machines. Therefore, while the Semantic Web, or Web of Data, is the goal or the end result of this process, Linked Data provides the means to reach that goal. -- Tim Berners-Lee, et al., http://linkeddata.org/docs/ijswis-special-issue, Jan, 2009

Page 20: Semantic Technology: State of the arts and Trends

Linked Data Principles

Use URIs as names for things.

Use HTTP URIs so that people can look up those names.

When someone looks up a URI, provide useful RDF information.

Include RDF statements that link to other URIs so that they can discover related things.

Community effort to

publish existing open license datasets as Linked Data on the Web

interlink things between different data sources

develop clients that consume Linked Data from the Web

Page 21: Semantic Technology: State of the arts and Trends

Linked Data Model

http://.../isbn/46316

The Lord of the rings

English novels

dbpidia:Allen&Unwin

fb:guid…..92df7London

J.R.R. Tolkien

wkp-en:J.R.R.Tolkien

Marivie

83 Alexander St 83 Alexander

Flexible graph-based model: RDF graph

URI: global primary key

skos:subject = http://www.w3.org/2004/02/skos/core#subject dbp-prop:title = http://dbpedia.org/property/title

The HTTP protocol brings together identification

and retrieval again.

Deeper into the Web

dbp-prop:title

skos:subject

dbp-prop:author

dbp-prop:name

foaf:homepage

dbp-prop:publisher

opencyc:headquarterdbp-prop:city

fb:creator

fb:street_address

Page 22: Semantic Technology: State of the arts and Trends

Browsing Data Model

Page 23: Semantic Technology: State of the arts and Trends

Summary: the Web of Linked Data

A global, distributed database built on a simple set of

standards

RDF, URI, HTTP

Explicit semantics of content and links

Resources are connected by semantic links.

creating a single global data graph that span data sources

enables the discovery of new data sources

Provides for data co-existence

Anyone can publish data to the Web of Linked Data

Data publishers are not constrained in choice of vocabularies with

which to represent data.

Designed for computer first, humans later

Page 24: Semantic Technology: State of the arts and Trends

LOD Data sets on the Web

http://richard.cyganiak.de/2007/10/lod/lod-datasets_2010-09-22_colored.svg

25 billion RDF triples, which are interlinked by around 395 million RDF links (Sep. 2010).

Page 25: Semantic Technology: State of the arts and Trends

Supporting Technologies

Linked Data Browsers

Provide for navigating between data sources and for exploring the dataspace.

Tabulator Browser (MIT, USA), Marbles (FU Berlin, DE), OpenLink RDF

Browser (OpenLink, UK), Zitgist RDF Browser (Zitgist, USA), Disco

Hyperdata Browser Berlin, Fenfire (DERI, Irland)

Web of Data Search Engines

Crawl the data space and provide best-effort query answers over crawled data.

Falcons (IWS, China), Sig.ma (DERI, Ireland), Swoogle (UMBC, USA),

VisiNav (DERI, Ireland), Watson (Open University, UK), TAP, Sindice

Page 26: Semantic Technology: State of the arts and Trends

Supporting Technologies

Describing data set

the discovery and usage of linked datasets

voiD, Ding

Registry

an open registry of data and content packages

CKAN

Linking tool

discovering relationships between data items within different Linked Data sources

SILK

Mapping tool

mapping database to RDF triples

Triplify, D2R Server

LOD platform D2R Server, Virtuoso Universal Server,

Talis Platform, Pubby, …

Page 27: Semantic Technology: State of the arts and Trends

Data.Gov

Page 28: Semantic Technology: State of the arts and Trends

Europeana

European digital library: Europeana: This European Commission initiative

encompasses not only libraries but also museums, archives and other holders of cultural

heritage material.

http://version1.europeana.eu/web/europeana-project

Page 29: Semantic Technology: State of the arts and Trends

Linked Library Cloud

Libraries have been producing

metadata for ages.

Libraries (often) produce high-

quality metadata.

Library develops many metadata

standards such as DC, SKOS,

BIBO, OAI-ORE including

MARC 21, MODS, FRBR,..

Integrate Library Catalogues on

global scale

http://code4lib.org/conference/2010/singer

Page 30: Semantic Technology: State of the arts and Trends

Linking Open Drug Data

linking the various sources of

drug data together to answer

interesting scientific and

business questions.

Survey publicly available data

sets about drugs

Publish and interlink these data

sets on the Web

Explore interesting questions that

could be answered if the data sets

are linked.

8 million RDF triples, which are

interlinked by more than

370,000 RDF links (As of

August 2009)

Page 31: Semantic Technology: State of the arts and Trends

BBC Semantic Project

Publish program / music data as RDF/XML or RDFa

Build semantically linked and annotated web pages about artists and

singers whose songs are played on BBC radio stations.

semantically interconnected

Page 32: Semantic Technology: State of the arts and Trends

DBpedia Mobile

Show map with information about nearby locations

Linked data browser

GPS + Google Maps + Dbpedia + Flickr + Revyu

Page 33: Semantic Technology: State of the arts and Trends

Attention by Search Engines

Yahoo!

crawls Linked Data in its RDFa serialization as well as Microformat

Yahoo Search Monkey to make search results more useful and visually

appealing

Google

use Social Graph API

is developing Google Squared and Google Fusion Table

merged MetaWeb

manage Freebase, a DBpedia/YAGO competitor

Page 34: Semantic Technology: State of the arts and Trends

Linked Open Commerce

Page 35: Semantic Technology: State of the arts and Trends

LOD: Next Step

Linking, Integration and Fusion

by Semantic Technology

Page 36: Semantic Technology: State of the arts and Trends

Research Agenda

User Interfaces and Interaction Paradigms

Application Architectures

Schema Mapping and Data Fusion

Link Maintenance

Licensing

Trust, Quality and Relevance

Privacy

• see more details in IJSWIS Special Issue on Linked Data (http://www.ijswis.org/)

Page 37: Semantic Technology: State of the arts and Trends

Context-Aware

Page 38: Semantic Technology: State of the arts and Trends

???

Objects (including users) embody the establishing meaning.

The meaning arises according to the context in the course of action.

The services should be autonomously provided by means of the context.

Shoes !!!

Services…Objects…

Context: Concepts

Page 39: Semantic Technology: State of the arts and Trends

Service Cloud

Search and find if you want!!

• Developers’ view

You may need these.I will deliver them.

• Users’ view

Context: Concepts

Page 40: Semantic Technology: State of the arts and Trends

ContextContext

Web of Data Web of Services

Linked Open DataLinked Open Data

Domain OntolgiesDomain Ontolgies

IaaSIaaS

SaaSSaaS

PaaSPaaS

Multi-tenant, ubiquitous rich experience devices

CKAN

voiD

SIndice WSMO

USDL

Context: Usability

Page 41: Semantic Technology: State of the arts and Trends

Gartner's top10 technologies for 2011

Context-aware Computing

Page 42: Semantic Technology: State of the arts and Trends

Context: Definition

Context:

Context is any information that can be used to characterize the situation

of an entity. An entity is a person, place, or object that is considered

relevant to the interaction between a user and an application, including

the user and application themselves. [A. Day and G. Abowd, 1999]

Typically , Location information, Proximity to devices, Places, Time,

Personal information, Environment factors as weather, temperature,

traffic, Status information of devices, Behavior of the user (e.g. talking,

sleeping, walking, …), User preferences, Personal fitness / health, Tasks,

Business process, …

Context is a essential, foundational information in human-computer interaction.Context is a essential, foundational information in human-computer interaction.

Page 43: Semantic Technology: State of the arts and Trends

Context: Examples

Page 44: Semantic Technology: State of the arts and Trends

Context Modeling

Context Model

Define and store context data in a machine processable form

Properties of context information

may come from disparate sources and has a relatively transient lifetime.

exhibits a range of temporal characteristics.

Static vs. dynamic

may be imperfect.

Out of date

Faulty information from sensors

Unknown (due to disconnection)

has many alternative representations

is highly interrelated and dependent

sometimes should be persistence

Long lived context (history,...) vs. Short lived context (temperature,..)

Page 45: Semantic Technology: State of the arts and Trends

Context Modeling Language

Context Modeling Language (CML): a tool to assist designers with the

task of exploring and specifying the context requirements of a context-

aware application.

CML is based on Object-Role Modeling (ORM), which was developed for

conceptual modeling of databases.

CML provides a graphical notation designed to support the software engineer

in analysing and formally specifying

The model captures:

the different classes and sources of context facts

dependencies between context fact types

imperfect information using quality metadata and the concept of alternatives

for capturing conflicting assertions

associations between users and communication channels and devices;

histories for certain fact types and constraints on those histories.

Page 46: Semantic Technology: State of the arts and Trends

Context Modeling Language

Page 47: Semantic Technology: State of the arts and Trends

Standard Ontology For Pervasive Computing

SOUPA: Standard Ontology for Ubiquitous and Pervasive Applications

FOAF : People Profile, and Relationship

DAML-Time: Time, and Scheduling

RCC, OpenCyc: Description, Analysis Place and context

MoGATU-BDI, COBRA-ONT: Display and Analysis of Knowledge

Policy ontology (Rei): High Level Rules, Access Control

Page 48: Semantic Technology: State of the arts and Trends

Context-aware Applications

A cell phone will always vibrate and never beep in a

concert, if the system can know the location of the

cell phone and the concert schedule.

A coffee machine that senses the user can make

coffee according to preferences.

A t-shirt automatically adjusts the ambient

temperature of the room by sensing body

temperature.

An airline check-in count automatically issues the

board pass according to the passenger context.

When you visit Berlin at first time, your smart

phone connects Facebook users who have already

been there to ask the best way to West Bahnhoff.

Argument Reality

Conference Assistant Location Aware Information Delivery

A Context-Aware Recommender System

Tourist Guides & Navigation Systems

Office Awareness Systems

Emergency services

Telematics services

Workflow management

Smart workspace

Context aware advertisements

Package tracking services

Page 49: Semantic Technology: State of the arts and Trends

Issues: Context-aware

Specific Context Definition to General Context Definition

Non-Flexible Context Models to Flexible and Extensible Context Model

Domain-specific Applications to General Frameworks

Provide Rich User Experience through diverse mobile devices

Service-oriented system based on Context Ontology

Page 50: Semantic Technology: State of the arts and Trends

Research Directions

Real interaction: beyond the desktop and into the larger real world where we live and act. Real interaction: These technologies move the site and style of interaction beyond the desktop and into the larger real world where we live and act.

Real-world services: environment. ContextReal-world services: The desktop is a well-understood, well-controlled environment. Context-aware computing is for the real world services.

Page 51: Semantic Technology: State of the arts and Trends

Summary: Context-aware

Catalyst and enabler to make semantic technology real… Catalyst and enabler to make semantic technology real…

Gun for killer apps of semantic technology…Gun for killer apps of semantic technology…

Real human-computer interactionReal human-computer interaction

Unlimited opportunities ahead…Unlimited opportunities ahead…

Page 52: Semantic Technology: State of the arts and Trends

Wrap up and Conclusions

Page 53: Semantic Technology: State of the arts and Trends

Semantic Technology

Semantic Technology

EnergyEnergyAero-SpaceAero-Space ManufacturingManufacturing

HealthcareHealthcare TelecomTelecom AutomotiveAutomotiveLife ScienceLife ScienceEducationEducation

BusinessBusinessBankingBanking LibraryLibraryCultureCulture

FoodFoodPublishingPublishing LawsLaws Human RelationsHuman Relations

Usability InteroperabilitySemantic Semantic

AggregationIntelligence

Ontologies usually are application domain-dependent.Ontologies usually are application domain-dependent.

Scalability PersonalizationPersonalization Context-aware

2010-11-27 53Sung-Kook Han

Page 54: Semantic Technology: State of the arts and Trends

Industries

Public Resources

ServiceRepository

Service Cloud

SemanticSemanticService

Discovery

ServiceMashup

ServiceServiceDeliveryMan’mt

ServiceServicePartnerMan’mt

ServiceServiceAccessControl

KnowledgeConstruction

KnowledgeRegistry

SemanticSearch

Web-ScaleReasoning

KnowledgeManagement

Open Semantic Data Service Framework

Public DB

Government

R&D Education

Healthcare

Culture

Users

Delivery

Layer

Service

Layer

Core

Layer

Resource

LayerGlobal Open Knowledge base

Rich ExperienceUbiquitous

InnovationCreativity

InteroperabilityReuse

OpennessSharing

Open Semantic Data Services

Page 55: Semantic Technology: State of the arts and Trends

Open Semantic Data Services

Page 56: Semantic Technology: State of the arts and Trends

Research Strategy

Leave the Top-Down path.Leave the Top-Down path.

Demonstrate Performance.Demonstrate Performance.

A little semantics goes a long way.A little semantics goes a long way.

Remember the community.Remember the community.

Beware the usefulness of shallow ontology shown in LOD.Focus on the domain ontology.Be convinced of the benefit of Semantic Technology.

Beware the usefulness of shallow ontology shown in LOD.Focus on the domain ontology.Be convinced of the benefit of Semantic Technology.

No Grand semantic theory, No Grand upper ontologyDo not be overconfident about Semantic Technology.Do not oversell the Semantic Technology.

No Grand semantic theory, No Grand upper ontologyDo not be overconfident about Semantic Technology.Do not oversell the Semantic Technology.

Early release is the key.Show the power of Semantic Technology even though it is smallDo not oversell the Semantic Technology.

Early release is the key.Show the power of Semantic Technology even though it is smallDo not oversell the Semantic Technology.

Open and Share your ontologies, tools and platforms.Make it standard.Wikipedia is all about semantics.

Open and Share your ontologies, tools and platforms.Make it standard.Wikipedia is all about semantics.

2010-11-27 56Sung-Kook Han

Page 57: Semantic Technology: State of the arts and Trends

Foundation Core Technologies Applications

Context:• Context modeling• Knowledge-in-context• Context ontology• Emotion ontology

Ontology• Ontology mapping/matching

Knowledge• Knowledge extraction• Knowledge mining

Semantic Repository• Automatic LOD population• Linking relational DB to LOD (D2RQ, D2R,)

• Scalable LOD store and repository

• Semantic index (Sindice, SIRE)

Large-scale reasoning• Large-scale reasoner (Larkc, SILK)

• Spatial/temporal reasoning• Parallel implementation of reasoner

Query processing• SPARQL engine• SPARQL/SQL integrator

Semantic Services• Semantic service• Semantic service platform (Talis)• Semantic service mashup

Semantic services• Semantic search/discovery• Semantic social network/semantic graph/semantics for Internet of things

• Context-aware service (location-based service, emotion-based service, personalized service)

Rich user experience• Personalized knowledge manager/Semantic browser (Siri, Nepomuk)

• Semantic augmented reality (semantics+mobile+service)

Embedded semantics• Green It using semantic sensor network

• Context-aware robot

Domain applications• Semantic business process management

• Semantic e-commerce• Semantic e-government• Semantic e-learning

R&D Agenda

Page 58: Semantic Technology: State of the arts and Trends

Conclusions

Semantic Technologies need to go where the data is !

Long Live Semantic Technology !

Ontology is the common shared conceptualization.

Ontology is the common vocabulary to communicate.

We are live in the networked planet.

Connection, Cooperation and Collaboration !

Early adaptation of Semantic Technology is the king !

Link, Integrate,

Embed Semantic Technology!

2010-11-27 58Sung-Kook Han

Page 59: Semantic Technology: State of the arts and Trends

Semantic Technology

Your World, Your Way

[email protected]