21
City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart City Applications CityPulse- Small or medium-scale focused research project (STREP) project 1 st Annual Review – 19 th November 2014

City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Embed Size (px)

Citation preview

Page 1: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

City Pulse: 609035 1st Annual Review – Brussels, 19th November 20141

CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart City Applications

CityPulse- Small or medium-scale focused research project (STREP) project

1st Annual Review – 19th November 2014

Page 2: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Outline of this session

• An introduction to Linked Data concepts and how and why they should be used in the context of Smart Cities and IoT related studies.

• Using practical examples we will explore what data sets are already available in cities and how they can be used to answer questions in the context of Smart Cities.

• We will also explore how signal processing tools and results can be described as structured data.

• We will demonstrate how Smart City related sensory structured data can be validated with an SSN Validator.

• Finally, we will demonstrate tools and best practice for researchers who wish to publish their own data sets on the Semantic Web in a Linked Data fashion.

Page 3: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Virtualisation of Smart City and IoT data

• Data in smart cities is collected by sensor devices and also crowd sensing sources. • The data is time and location dependent.• It can be noisy and the quality can vary.• It is continuous - streaming data

• Overall CityPulse information models focus on developing a framework in the scope of the CityPulse project for real-time IoT stream annotation that employs a knowledge-based approach to represent data streams and to support mashups.

Page 4: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

CityPulse ArhitectureWP3- Large Scale Data Analysis Component The Information Flow of WP3

Page 5: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

CityPulse Information Models Workflow

Describing a stream annotation work flow using the Stream Annotation Ontology (SAO), Complex Event Service Ontology, and Quality Ontology.

• Less complexity vs Expressibility

• Existing vocabulares: W3C SSN, Prov, OWL-S

Page 6: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Stream Annotation Ontology (SAO)

The SAO allows representation of aggregated stream data and temporal characteristics. It is based on the SSN Ontology and Timeline Ontology.

Page 7: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Quality Ontology (QO)

The Quality Ontology is used to represent the quality of information for data streams in smart cities

Page 8: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Complex Event Service Ontology (CES)

Overview of complex event service ontology

Page 9: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

What can we do with these ontologies now?• Describing sensory data, quality, and events on multiple

timelines, linking together IoT objects• ...and well, that's about all we need!• The CityPulse Ontologies subsumes all these ontologies to

deal with smart city-related information

Page 10: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Exemplification

• The following is an exemplification of an annotated stream based on SAO Ontology, where it describes a traffic observation of a sensor feature called, "Average Speed", for a pair of sensors that are provided by the City of Aarhus via Open Data Aarhus Platform.

Page 11: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Progress and Results - Activity 3.3

A visual representation of geographical coordinates on Google Map for a pair of road traffic sensors provided by city of Aarhus, Denmark.

Page 12: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Traffic data annotation (1) - Sensor

prefix ssn: <http://purl.oclc.org/NET/ssnx/ssn#> .

prefix tl: <http://purl.org/NET/c4dm/timeline.owl#> .

prefix sao: <http://purl.oclc.org/NET/UNIS/sao/sao#> .

prefix ct: <http://www.insight-centre.org/ct#> .

:cityofaarhus a foaf:Organisation, prov: Agent .

<trafficData158324> a ces:PrimitiveEventService , ssn:Sensor ;

ssn:observes <Property-001> , <Property-002> , <Property-003> , <Property-004> , <Property-005> ;

prov: wasAttributedTo :cityofaarhus .

Page 13: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Traffic data annotation – Sensor feature of interest (2) <http://unis/trafficData158324FoI-001>

ct:hasFirstNode [ a ct:Node ;

ct:hasCity "Hinnerup"^^xsd:string ;

ct:hasLatitude "56.23172069428216"^^xsd:double ;

ct:hasLongtitude "10.104986076057457"^^xsd:double ;

ct:hasStreet "Ãrhusvej"^^xsd:string

] ;

ics:hasSecondNode [ a ct:Node ;

ct:hasCity "Hinnerup"^^xsd:string ;

ct:hasLatitude "56.22579478256016"^^xsd:double ;

ct:hasLongtitude "10.116589665412903"^^xsd:double ;

ct:hasStreet "Ãrhusvej"^^xsd:string

] .

Page 14: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Traffic data annotation – Sensor Property (3):Property-001

a ct:Measured_Time ;

ssn:isPropertyOf :FoI-001.

:Property-002

a ct:Estimated_Time;

ssn:isPropertyOf :FoI-001.

:Property-003

a ct:Congestion_Level;

ssn:isPropertyOf :FoI-001.

:Property-004

a ct:Vehicle_Count;

ssn:isPropertyOf :FoI-001.

:Property-005

a ct:Average_Speed;

ssn:isPropertyOf :FoI-001.

Page 15: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Traffic data annotation – Sensor Observation (4)<http://unis/trafficData158324Observation-001> a sao:Point , ssn:Observation ;

sao:hasUnitOfMeasurement <http://unit1:seconds>;

sao:value "141.0"^^xsd:double ;

sao:time [ a tl:Instant ;

tl:at "2014-09-30T06:00:00"^^xsd:dateTime ;

tl:duration "PT5M"^^xsd:duration

] ;

ssn:observedBy <trafficData158324> ;

ssn:observedProperty <http://unis/trafficData158324Property-001> .

prov:wasAsscoatedWith :cityofaarhus .

Page 16: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Representation of Aggregated Sensory Data

Source: S. Kolozali, M. Bermudez-Edo, D. Pushmann, P. Barnaghi, “A Knowledge-based Approach for Real-Time IoT Data Stream Annotation and Processing“, in Proc. of IEEE International Conference on Internet of Things (iThings 2014), Sep. 2014.

@prefix sao: <http://example.com#> .@prefix ssn: <http://purl.oclc.org/NET/ssnx/ssn#> .@prefix qoi: <http://example.com/QoSQoI.owl#> .@prefix tl: <http://purl.org/NET/c4dm/timeline.owl#> .

:government a foaf:Organisation, prov: Agent .:sefki a foaf:Person, prov:Agent ;

foaf:givenName "Sefki" ;foaf:mbox <mailto:[email protected]>prov:actedonBehalfOf :ccsrSurrey ; .

:sensorRec1 a sao:StreamData, ssn:SensorObservation ;prov: wasAttributedTo :government .

:sensorRec2 a sao:StreamData, ssn:SensorObservation ;prov: wasAttributedTo :government .

:traffic-sensor-recording-619 a sao:StreamEvent ; prov:used [ a sensorRec1; sensorRec2] ; sao:time [a tl:Interval; tl:at "2014-02-13T08:25:00"^^xsd:dateTime; tl:duration "PT15H30M"^^xsd:duration; ] ; prov:wasAsscoatedWith :sefki ; .:freshness-traffic-619 a qoi:Freshness ;

qoi:value "2014-02-13T08:25:00"^^xsd:dateTime .:sax_AverageSpeedSample a SymbolicAggregateApproximation;

rdfs:label "The sax representation of the traffic sensor recording obtained from Aarhus City.";sao:value "bbbbacdd";sao:alphabetsize "4"^^xsd:int ;sao:segmentsize "8"^^xsd:int ;prov:wasGeneratedBy traffic-sensor-recording-619;

qoi:hasQoI freshness-traffic-619 .

Real time average speed data obtained from a pair of sensor points is mapped into SAX word, ”bbbbacdd”, with the segment size of “8” and alphabet size of “4” for 176 samples.

An excerpt from an RDF data annotated for a set of sensor recordings based on Stream Annotation Ontology.

Page 17: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Reference Datasets (1)

17

http://iot.ee.surrey.ac.uk:8080/datasets.html

Page 18: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Reference Datasets (2)

~120GB

• Vehicle traffic - Aarhus

• Pollution Measurement - Aarhus

• Weather Data - Aarhus

• Social media (Twitter) - Aarhus

• Webcasted events – Surrey

• Cultural Events - Aarhus

Page 19: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Hands on Session with SAOPYhttp://iot.ee.surrey.ac.uk/citypulse/ontologies/sao/saopy

Page 20: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

Hands on session with SSN validation service

• To check RDF descriptions• To enable user to validate an

ontology or Linked Data• Undefined classes and properties• Poorly formed namespaces• Problematic prefixes• Literal syntax validation and other

optional heuristics• Validation CityPulse

The Validation of Sensory Linked Data

Source: S. Kolozali, T. Elsaleh, P. Barnaghi, “A Validation Tool for the W3C SSN Ontology based Sensory Semantic Knowledge“, in Proc. of the 13th International Semantic Web Conference (ISWC), Oct. 2014.

http://iot3.ee.surrey.ac.uk/SSNValidation/

Page 21: City Pulse: 609035 1 st Annual Review – Brussels, 19 th November 2014 1 CityPulse: Real-Time IoT Stream Processing and Large-scale Data Analytics for Smart

City Pulse: 609035 1st Annual Review – Brussels, 19th November 2014

• Sefki Kolozali, Maria Bermudez-Edo, Daniel Puschmann, Frieder Ganz, Payam Barnaghi, "A Knowledge-based Approach for Real-Time IoT Data Stream Annotation and Processing", in Proc. of the 2014 IEEE International Conference on Internet of Things (iThings 2014), Taipei, Taiwan, September 2014.

• Kolozali S, Elsaleh T, Barnaghi P. (2014) “A Validation Tool for the W3C SSN Ontology based Sensory Semantic Knowledge”. The 13th International Semantic Web Conference

• Stefan Bischof, Athanasios Karapantelakis, Cosmin-Septimiu Nechifor, Amit Sheth, Alessandra Mileo and Payam Barnaghi, "Semantic Modeling of Smart City Data", Position Paper in W3C Workshop on the Web of Things: Enablers and services for an open Web of Devices, 25-26 June 2014, Berlin, Germany.

• R. Tönjes, P. Barnaghi, M. Ali, A. Mileo, M. Hauswirth, F. Ganz, S. Ganea, B. Kjærgaard, D. Kuemper, S. Nechifor, D. Puiu, A. Sheth, V. Tsiatsis, L. Vestergaard, "Real Time IoT Stream Processing and Large-scale Data Analytics for Smart City Applications", poster session, European Conference on Networks and Communications 2014.

References