Semantic Web Technologies’ role in Smart Environments

Semantic Web Technologies’ role in Smart Environments

Faisal Razzak

Politecnico di TorinoDip. Automatica e Informatica

Torino, ItalyOTM Workshops 2012

September 10-11, 2012, Rome, Italy

Semantic Web Technologies' role in Smart Environments

2

Outline Context and Motivation

Semantic Web Technologies Smart Environments

User goal modeling in Smart Environments Domotic Effects

Linked Data aspects in Smart Environments Web of Domotics SEIPF Publishing LO(D)D

Conclusions

OTM Workshops 2012

The promise of Intelligent Web Semantic Web?

Web 2.0 or Web 3.0 or beyond …

“Logic + reasoning” approach by AI community

OTM Workshops 2012Semantic Web Technologies' role in Smart Environments

3

Semantic Web Architectures


4

Horrocks, I., Parsia, B., Patel-Schneider, P., Hendler, J.: Semantic web architec-ture: Stack or two towers? Principles and Practice of Semantic Web Reasoning pp.37–41 (2005)

Architectures by Berners-Lee (W3C)


5

Antoniou, G., Van Harmelen, F.: A semantic web primer. the MIT Press (2004)

Two towered architecture


6

Horrocks, I., Parsia, B., Patel-Schneider, P., Hendler, J.: Semantic web architec-ture: Stack or two towers? Principles and Practice of Semantic Web Reasoning pp.37–41 (2005)

CFL Architecture


7

Comprehensive, Functional, Layered Architecture (CFL Architecture)

Aurona Gerber, Alta van der Merwe, and Andries Barnard A functional semantic web architecture, In:The Semantic Web: Research and Applicationspp. 273-287(2005)

Some Mapping examples


8

Post 2006 … What is static (perceived necessary and

foundational) in all the architectures? Representation and Structure.

RDF (Basic Data model) RDFS OWL (Ontology) SPARQL

What is expanding? Linked Data.


9


10

Smart Environments

OTM Workshops 2012

Smart Sensing and Measuring Environments

Smart Homes Smart FactoriesSmart Grid

Sensor and Actuator Networks

Smart Appliances

Affordable and efficient sensors

Environment monitoringSocial mobile applications


11

Smart Environments

OTM Workshops 2012


Smart Appliances


energy (active, reactive, reverse, kVAr, ...)

acceleration compass GPS proximity microphone camera BT Scan

accelerationcompassair pressure temperature light


12

Smart Environments

OTM Workshops 2012



Smart Appliances

Motion

Proximity

SmokeGyroscope

PressureRFID

2D codes

Research Focus (Goals) Address common problems in the domains of

smart environment and energy management systems, under the umbrella of Ambient intelligence.

The potential role of semantic web technologies’ is explored., i.e., technologies that lie at the foundation of semantic interoperability and that provide global scale integration. RDF RDFS OWL SPARQL Linked Data


13

Categorization (For my work) Higher Level Modeling. Lower Level Modeling.

Or

Environment interaction modeling. Environment set-up modeling.


14

Research methodology A. Identify artifacts/concepts and their inter

relationships and model them using the ontologies.

A. The ontologies should be modular in nature.

B. Design and develop ontology powered frameworks.

A. Ontologies act as a knowledge base. B. While, the processing, reasoning and decisions,

depends upon specific application requirements.

C. Use Linked Data principles to share informationOTM Workshops 2012Semantic Web Technologies' role in Smart Environments

15


16

Relationship between frameworks and their ontologies

HLM LLM None

Publisher

DogOnt DogPower

None X LO(D)D Web of Domotics SEIPFDogEffects X X Domotic Effects Intelligent

Energy Optimizatio

n


17

User Goal Modeling in Smart Environments:

Domotic Effects


18

Problem Definition• Modeling of environment interaction (Device

centric).

• Modeling of environment set-up.

• Human intelligible state and goal modeling (Often Missing or Neglected).

• Intelligible states and goals may relate to environmental variables (illumination or temperature, …) or to more abstract conditions such as Security and Energy Saving. OTM Workshops 2012Semantic Web Technologies' role in

Smart Environments19

What is Domotic Effects Modeling Framework?• It provide AMI designers with an abstraction

layer that enables defining generic goals inside the environment,

in a declarative way.

• The high-level nature allows the residents to program their personal, office or work

spaces as they see fit.

• Define different achievement criteria for a particular generic goal, by using domain-specific operators.

• Two types: Simple and ComplexOTM Workshops 2012Semantic Web Technologies' role in



21

Requirements• Formal definition

• Domain dependency

• Modularity

• Evaluation Support

• Enforcement Support

• Advanced intelligence (Energy optimization)

• Human IntelligibilityOTM Workshops 2012Semantic Web Technologies' role in


Formal Modeling: DogEffects Ontology (1/2)


23

Formal Modeling: DogEffects Ontology (2/2)


24

Domotic Effects (DE)s: Evaluation• It is the ability to determine the value of each DE defined in an environment when

any device changes its state, in near-real time.

• It helps monitor the overall state of the environment, also considering historical traces.

• An Effect Node Network (ENN) is created from DE and Zero Delay Simulation algorithm is used to solve the network.


25

ENN Example


26

Results


27

Results


28

Domotic Effects: Enforcement• The problem of finding at least one

configuration g that satisfies the user request and use the automation system to bring the home devices into a satisfying state.

• In the case of Boolean valued domotic effects, the user request R is the subset of DEi that the user wants to be active (true) at a given instant.

• Satisfying user request amounts to:


29

Results: Usecase1. Secure Home (CEA)

2. Bathroom Illumination (CEB)

3. Home Illumination (CEC)

4. Afternoon Lunch Cooking (CED)

5. Air Passage (CEE)

6. Morning Wakeup (CEF)OTM Workshops 2012Semantic Web Technologies' role in


Results


31

Energy Optimization Each device, in each operating state,

consumes some amount of electrical power, that is represented as a real-valued Simple Effect The instantaneous power consumed by the whole environment is therefore represented as a Complex Effect aggregating all individual power measurements:

To compute the minimum value of P(g), while satisfying the user request R. This correspond to a constrained optimization of P(g) subject to the Boolean constraint FR(g).OTM Workshops 2012Semantic Web Technologies' role in


DogPower Ontology (Energy Profile Ontology)


33

Proposed Heuristic


34

Results


35

Smart Environments and Linked Data:

Web of Domotics


36

What is Web of Domotics (WoD)• WoD combines the concepts of Internet of Things

and Domotics.

• Enables mobile users to access and to control devices in a ubiquitous manner, without any a priori knowledge of device controllers from any network or location.


37

Abstract• It exploits several Internet and Web standard

technologies to provide following features: • Proximity-based device identification. • Network-based detection of service access

points (through DNS based device dereferencing). • User identification through Open ID.• Open data exchange, service/device

description through Linked Open Data formats .

• Device operation through REST-based interaction.


38

Issues1. Domotic Device Identification

• 2. Domotic Device Control

3. Access to Controller

4. Universal Authentication


39

Conceptual Modeling


40

Features• UAID is encoded through QR Code because the decoding process is quick and many modern mobile phones are by default equipped with software to decode QR Code

• During setup phase, MAP (Mobile Access Provider) registers the UAID associated with the device with the domain address of the Controller that controls the device


41

Features• The mobile application provides a user with an interface to interact with the devices present in the environment. It communicates with the controller responsible for the devices on behalf of the user.

• User authentication is provided through Open ID. Open ID is a decentralized standard based on Single Sign-On (SSO) paradigm to authenticate the users.


42

Features• The Controller offer information about devices by

exploiting the increasingly popular Linked Open Data format.

• Dog is an ontology-powered Domotic OSGi Gateway that is able to expose different domotic networks as a single, technology neutral, home automation system.

• The three new units are: HTTP-Access, Authentication and Authorization Unit and UAID Mapping Unit..


43

Features• The Controller adhere to the Linked Data vision by exposing device information through RDF or RDFa.

• The user can request pure RDF description of a device or RDFa (XHTML) as a response user interface.


44


SEIPF (Semantic Energy Information Publishing Framework)


45

What is SEIPF? Provide ability to expose energy consumption

information from the residential gateways in a machine understandable format, to achieve intelligent negotiation and consumption coordination.

Issues: Energy Consumption Information

DogPower Ontology ( previously Energy Profile Ontology)

Machine understandable format. Linked Data principles.


46

Architecture


47

Experiments


48

Experiments


49


Publishing LO(D)D


50

Motivation Applications need to

access information from multiple environments

Standard way to publish and consume information About accessible

environments About available

applicances, sensors and their characteristics

About the actual data measured by sensors


51

Environment

Appliances

sensors

Environment

Appliances

sensors

Environment

Appliances

sensors

Application Application

Approach Applications need to

access information from multiple environments

Standard way to publish and consume information About accessible

environments About available

applicances, sensors and their characteristics

About the actual data measured by sensors


52

Adopt Semantic Web «Linked Open Data

(LOD)» approach

Static information:Can be encoded in RDF according to a public

Ontology

Dynamic information:

New approach to represent streams of

RDF events

General LO(D)D Architecture


53

Producer Applicati

on

Smart Environment

Static informatio

n about sensor

streams

publishes

E

GF monitors



54

Producer Applicati

on

Smart Environment

Static informatio

n about sensor

streams

Sensor data

channelSensor data

channelSensor data

channel

describes

updates

publishes

E

GE

E

G

G

G

G

EE

F

F

F

F

monitors



55

Producer Applicati

onConsum

er Applicati

on

Smart Environment

Consumer

Application

Static informatio

n about sensor

streamsConsum

er Applicati

onSensor data

channelSensor data

channelSensor data

channel

describes

updates

publishes

receives

subscribes

E

GE

E

G

G

G

G G

G

EE E

E

E

E

F

F

F

F F

monitors

Publisher and Consumer APIs Publisher Library

Creates PID file an offers it on http Creates channels onto cloud service Sends updates to channel, encoding it in RDF

Consumer Library Parses PID file and provides channel information Subscribes to one or more channels Notifies application whenr new data is available,

decoding it from RDF Same application may be producer and

consumer at the same time Applications need not manage RDF explicitly


56


57

P

Building InfrastructurePolitecnico di Torino poliEner

gyPID

Publishes

• 126 Electrical Meters.

• Take reading every 15 minutes

Preliminary Experiment

OTM Workshops 2012


58

P

Building InfrastructurePolitecnico di Torino

CP

poliEnergyPID

poliEnergy

AggregatorPID

Publishes


• Take reading every 15 minutes • Aggregates

reading into 3 ranges.

• Publishes using 3

channels


OTM Workshops 2012


59

P

Building InfrastructurePolitecnico di Torino

CP

C

poliEnergyPID

poliEnergy

AggregatorPID

Publishes


• Take reading every 15 minutes • Aggregates

reading into 3 ranges.

• Publishes using 3

channels


OTM Workshops 2012


60

My Publications International Journals

Fulvio Corno, Faisal Razzak Intelligent Energy Optimization for User Intelligible Goals in Smart Home Environments. In: IEEE TRANSACTIONS ON SMART GRID. - ISSN 1949-3053 (In Press)

Dario Bonino, Fulvio Corno and Faisal Razzak(2011) Enabling Machine Understandable Exchange of Energy Consumption Information in Intelligent Domotic Environments. In: ENERGY AND BUILDINGS, vol. 43/6, pp. 1392-1402. - ISSN 0378-7788 OTM Workshops 2012

http://porto.polito.it/2501975/


http://porto.polito.it/view/publication/IEEE_TRANSACTIONS_ON_SMART_GRID.html






http://porto.polito.it/view/publication/ENERGY_AND_BUILDINGS.html


61

My Publications Proceedings

Fulvio Corno, Faisal Razzak (2012) Publishing LO(D)D: Linked Open (Dynamic) Data for Smart Sensing and Measuring Environments. In: PROCEDIA COMPUTER SCIENCE, vol. 10C, pp. 381-388. - ISSN 1877-0509

Faisal Razzak (2012) Spamming the Internet of Things: A possibility and its probable solution. In: PROCEDIA COMPUTER SCIENCE, vol. 10C, pp. 658-665. - ISSN 1877-0509

Faisal Razzak, Dario Bonino and Fulvio Corno(2010) Mobile Interaction with Smart Environments through Linked Data. In: IEEE International Conference on Systems, Man, and Cybernetics, Istanbul, Turkey, October 10-13. pp. 2922-2929

Emiliano Castellina, Faisal Razzak and Fulvio Corno(2009) Environmental Control Application compliant with Cogain Guidelines. In: COGAIN 2009: Gaze Interaction For Those Who Want It Most, COGAIN 2009, Copenaghen, Denmark, 26/05/2009.

OTM Workshops 2012



http://porto.polito.it/view/publication/PROCEDIA_COMPUTER_SCIENCE.html


http://porto.polito.it/view/publication/PROCEDIA_COMPUTER_SCIENCE.html





Conclusion For papers: Google Scholar “Faisal Razzak”. Slides: http://www.slideshare.net/konware Email: [email protected]

[email protected] Research Profile:

http://www.researchgate.net/profile/Faisal_Razzak/


62

Thank you!

Questions?

http://www.slideshare.net/konware

mailto:[email protected]

mailto:[email protected]



Documents

Semantic Web Technologies’ role in Smart Environments