23-28 September 2012, BARCELONA, SPAIN23-28 September 2012, BARCELONA, SPAIN

USER-assisted SEMANTIC INTEROPERABILITY USER-assisted SEMANTIC INTEROPERABILITY in INTERNET of THINGSin INTERNET of THINGS

Authors: Authors: Oleksiy KhriyenkoOleksiy KhriyenkoVagan Terziyan Vagan Terziyan

Olena KaikovaOlena Kaikova

Industrial Ontologies Group

University of JyväskyläUniversity of Jyväskylä

OntologyOntologyOntologyOntology

Presenter: Presenter: Oleksiy Khriyenko Oleksiy Khriyenko oleksiy.khriyenko@jyu.fi

IARIA the Sixth International Conference on Mobile IARIA the Sixth International Conference on Mobile Ubiquitous Computing, Systems and TechnologiesUbiquitous Computing, Systems and Technologies

UBICOMM 2012UBICOMM 2012

OutlineOutlineOutlineOutline

Towards new era Internet of Things Thing integration infrastructure Human-powered Service Ecosystem Visual ontology alignment Visually-enriched semantic annotation Conclusions

2 of 9

Towards new era Internet of Things Towards new era Internet of Things Towards new era Internet of Things Towards new era Internet of Things

nowadays, society requires new innovative services and applications that make the life more comfortable and interactive;

industry requires new intelligent systems to better perform maintenance and do better automation of product development and product operation processes.

Demands of Society and Businesses

unwillingness of vendors to provide open, flexible and interoperable solutions; lack of infrastructure for third party application and services development; unavailability of appropriate business model that brings benefits to end-users through fair open

competitive environment of thing vendors.

Challenges of interoperable Web of Things

we are going to be surrounded by amazingly huge amount of smart devices and entities that do a lot of invisible work for us, but bring really useful added value;

various sensors constantly produce huge amount of data measuring and logging various parameters of the environment, devises, systems, and of cause people;

having such variety of data and contextual information, intelligent systems are able to provide new innovative services that were impossible to even imagine before.

Thing infrastructure

3 of 9

Thing Integration InfrastructureThing Integration InfrastructureThing Integration InfrastructureThing Integration Infrastructure

Thing Integration PlatformThing Integration PlatformThing Integration PlatformThing Integration Platform

Vendor 1Vendor 1

Vendor 2Vendor 2 VendorVendor 33Service/SystemSubnet of devices

Subnet of devices

Vendor 5Vendor 5Device, sensor,

etc.

Vendor NVendor NApplication

……

Vendor 4Vendor 4Application

UsersUsers

OntologyOntologyOntologyOntology

4 of 9

Human as a part of Technology WorldHuman as a part of Technology WorldHuman as a part of Technology WorldHuman as a part of Technology World

Systems

Devices/sensors

Applications

ApplicationsServices

(Service Provider) Expert User (Service Consumer)

People are great asset to be utilized in servicing, service support and creation process.In the context of open solutions and free services development, people (as end-users) are the most interested party. Therefore, people should take active position and be a part of the service they want to utilize, make it smarter, personalized, and able to provide appropriate data, features and capabilities. Human should not be considered only as a user (service consumer) anymore. Human should be involved to the process as an expert – valuable part of a service ecosystem that provides own knowledge and expertise, and adds value to technology evolution.

To be able to utilize the power of people, we have to concentrate our efforts on development of user-oriented tools and technique that involve people to the process, teach and help them to access and manipulate with information and capabilities in easy and handy for human way, utilize people knowledge and expertise for the common welfare of society. 5 of 9

OntologyOntologyOntologyOntology

OntologyOntologyOntologyOntology OntologyOntologyOntologyOntology

UserUser

Vendor BVendor BVendor AVendor A

Visual Ontology AlignmentVisual Ontology Alignment

Human-powered Service Ecosystem:Human-powered Service Ecosystem: Visual Ontology AlignmentVisual Ontology Alignment

Human-powered Service Ecosystem:Human-powered Service Ecosystem: Visual Ontology AlignmentVisual Ontology Alignment

6 of 9

Visually-enriched Semantic AnnotationVisually-enriched Semantic AnnotationVisually-enriched Semantic AnnotationVisually-enriched Semantic Annotation@prefix : <http://www.example.org/sample.rdfs#> .@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>.@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>.

rdfs:visSemanticsvisSemantics rdf:type rdf:Property; rdfs:domain rdfs:Resource;

rdfs:range rdfs:Literal.

:FloorHeatingSystem rdfs:subClassOf :HeatingSystem; rdfs:visSemanticsvisSemantics ”www.example.org/FHSystem.jpeg”.

VendorVendorProduces

Service/System

Service/System

Service/System

Scenario 1

Scenario 2

Provides visually enriched annotation of

the Service/System

VendorVendor

Provides annotation of the Service/System

VendorVendor

OntologyOntologyOntologyOntology V

V

Service/System

VisAnnotation

VisOntologyCreates domain ontology

Ontology/Domain ExpertOntology/Domain Expert

Creates visual ontology

Ontology/Domain ExpertOntology/Domain Expert

OntologyOntologyOntologyOntology

OntologyOntologyOntologyOntologyV

Visually enriched ontology

V

OntologyOntologyOntologyOntology

Visually enriched annotation

7 of 9

ConclusionsConclusionsConclusionsConclusions

With the aim to elaborate an environment that enables integration of heterogeneous “things” and intelligent distributed systems within the Internet of Things framework, we addressed the mechanism of human-assisted simplification of semantic matching to allow interoperability of entities in IoT.

We proposed a way to make end-user be not only consumer of thing-based solutions, but also be an expert capable to compose and establish interoperability among the things.

The question that stays open… How to encourage vendors to provide appropriate semantic annotation of things and how to help them by automating this process?

8 of 9

Thank youThank youThank youThank you

Questions and comments…Questions and comments…

9 of 9