BUTLER project presentation

PROJECT PRESENTATION

Bertrand Copigneaux - inno TSD

2

uBiquitous, secUre inTernet-of-things with Location and

contEx-awaReness

FP7 call: FP7-ICT-2011-7

Integrated Project

October 2011 September 2014

15 M€

1234 man.months

High level objective

Design and demonstrate prototype of a

comprehensive, pervasive and effective Context-

Aware information system, which will operate

transparently and seamlessly across various

scenarios towards a unified Smart Life environment.

3

4

Vertical IoT

SmartHealth

- Monitoring medicine intake- Personalized diabetes assistance- Providing training tips- …

!

SmartTransport

- Promoting carpooling- Minimizing taxi delays- Avoiding traffic jams- …

SmartHome

- Monitoring and controlling- Saving Energy comfortably- Interacting with appliances-…

SmartCity

- Managing parking space- Lighting up a city efficiently- Monitoring Air Quality- …

SmartShopping

- Managing sparkdeals- Getting advice on buying goods- Retrieving discount- …

Expectations

5

Congestion

LatencyPollution

Poverty

Crimes Privacy violation

StressDiseases

Squandering

inefficiency

SmartHome

SmartHealth

SmartCity

SmartTransportSmartShopping

6

What should Smart Life be?

One Day In 2020 Scenario

7

Market ?

IoT requires multi-stakeholders cooperation

Industrials

Needs & Expectations

Supporting Infrastructures

Fin

ance

SMEs Start-Ups

Society

Vision

Data Provider

Regulators Research

Technologies Test-bedsSmart Cities

Utilities…

Supporting Legislation

Buzzing Ecosystem50 Million

Connected Devices

Market

Killer Apps

8

Horizontal Scenario

The Case for a Horizontal Platform

8

SmartHome SmartShoppingSmartTransportSmartHealth SmartCity

Unified, Open, Horizontal Platform

• Access, exchange, sharing of resources• Possibility of unified user experience• Better understanding situations: context awareness

!

9

Shared Scientific ChallengesSmartHome SmartShoppingSmartTransport


SmartHealth




SmartCity


Geo-Temporal Localization

Security and Privacy

Context Awareness and Semantic Support

!

10

Shared Technological NeedsSmartHome SmartShoppingSmartTransport


SmartHealth




SmartCity


Geo-Temporal Localization

Security and Privacy

Context Awareness and Semantic Support

Open Architecture Model

Standards & Interoperability

!

11

Today: Domain-centric smart solutionsSmartHome SmartShoppingSmartTransport


SmartHealth




SmartCity


12

Tomorrow: horizontal smart solutions

SmartLife

Context

awarenessService

architecture

Business vision Behaviour

modelling

ACTIVITIES OVERVIEW

14

Project Objectives

Vertical and horizontal use-

cases

Specification and development

15

Project organisation

WP1Use case and Requirements

WP2Enabling

Technologies

WP3Architecture

WP5Field Trials

WP7Project Management

WP6Dissemination, Standardization, Education, Exploitation

Functional andNon Functional Requirements

analysisWP4

Implementation

Integration and testing

USE CASES AND REQUIREMENTS

BUTLER Requirements

From Vertical Use Cases to Requirements

17

Smart Transport

SmartHealth / Wellness

SmartHome /Office

SmartShopping SmartCity

HorizontalUCs

HorizontalUCs

HorizontalUCs

HorizontalUCs

HorizontalUCs

70+ UseCases, 40+ Actors

Smart Live Concept: Horizontal Story Line

Aggregated results from Verticals

Ethics & Privacy

External Member Group

Vertical Field Trials

User Acceptance

Customers Interviews (60+)

Technologies Architecture PlatformBusiness Models

ENABLING TECHNOLOGIES

Privacy and Security (1/2)User shall be able to manage its distributed user profile.

• Control of identity sharing over distributed applications. • Control of data duplication – when and where• Implementation of regulation• Controlling dynamic inference of user data - identity, current

behavior, system computed user profile.

Defining security and privacy requirements to be taken into account as design level.• Design and implementation of BUTLER privacy and security

framework.• Framework integrates user dynamic data (location, behavior, …) in

security protocols• Application shall integrate such framework

Privacy and Security (2/2)

Static andDynamic

Distributed User Profile

Application 1

Application 2

1. Main objective: user controls/manages its profile

2. Applications use/update

Behavioural modelling and mining (1/3)

Recognize context-aware intent through external observation• Behavior• Decisions• Typical course of actions • Corresponding events and context

Extract meaningful information from distributed event streams• Purposeful and meaningful abstractions for daily life activities• Interactions between a few individuals and mass behavior• Algorithms and software components for aggregation,

classification, learning, predicting and anticipating users’ behavior and activities

• Metrics to assess quality or trustworthiness of information


Behavior

Profile &Preferences

Context Intentions

Tasks

Actions

eventsevents

events1. Model

2. Observe and learn

3. Anticipate


New event-based modeling abstractions• Represent both individual and group behavior• Explore feasibility of hybrid models combining statistical and

relational models, task trees, workflow and markov models, dynamic bayesian networks, …

• Semantic modeling abstractions to describe domain knowledge in relevant (patterns of) events

New processing and synthesis techniques• Context-aware and semantic event pattern recognition• Causality detection to anticipate human behavior• Learning and data stream mining based on complex event

processing techniques (CEP)

Geo-Temporal Contextualization (1/2)

Aim to develop algorithms for the seamless acquisition of geo-temporal information in heterogeneous networks, clearly defined as following objectives.

Objectives – Identification of the forms of geo-temporal context information– Tracking and localize the context information securely – Simultaneous localization and mapping through cooperative P2P links,

with new location-dependent security mechanisms – Energy/time-efficient indoor localization within heterogeneous

networks

24

Geo-Temporal Contextualization (2/2)

Workflow – Concrete algorithms be developed to enhance acquire geo-temporal

context with the help of objects, topology, etc…– Development of corresponding algorithms on real platforms

Domain Specific Objectives– Provide ambient information about metro platforms when the user

reaches the station entrance, for users located on station platforms. – Schedule planner - plan the user departure according to user's

agenda, traffic conditions and parking availability.

25

Contextual networking

26

Aim is to develop algorithms to provide contextual information at a macro-perspective, focusing on contextualized networking strategies, behavior synthesis (crowd management, incentives) and “contextual games” model to predict users’ behaviors.

Generic workflow– Cooperate with the other tasks and create the use cases for the applications

and services;– Create concrete algorithms to be utilized in such use cases; – Algorithms brought forward to the implementation tasks;– Results validations by using the prototypes generated in the implementation

tasks

Domain specific objectives– Shopping environment related modelling of consumer groups– To be able affect consumer behaviour via context based targeted advertising

and offers– Other objectives: to be further studied

27

Scientific Dissemination Status• Goal: 80 publications (DOW) • M1-M12: Goal 12 publications

– Achievement:• 17 Conferences• 5 Journals

• M12-M24: Goal 24 publications– Achievement

• 19 Conferences• 6 Journals

• M25-M36: Goal 24 publications– Already Achieved (11/2013):

• 11 Conferences• 2 Journals

• Current Status: 60 publications (13 joint publications)• Several best paper awards and prizes

27

Ericsson Spain6% CEA

12%

OULU6%

ISMB12%

iHOMELab18%

UL6%

KU LEUVEN24%

TST6%

JacobsUni12%

Conf.Y1

OULU10%

iHOMELab20%

KU LEUVEN60%

JacobsUni10%

Jour.Y1

Inno3%

CEA21%

OULU3%

ISMB18%

iHOMELab5%

UL18%

KU LEUVEN13%

TST5%

JacobsUni13%

OULU10%

ISMB20%

KU LEUVEN20%

JacobsUni50%

Conf.Y2 Jour.Y2

ARCHITECTURE AND PLATFORM

BUTLER Architecture - overview

29

Communications

Data/Context Management

Sys

tem

/Dev

ice

Man

agem

ent

predicted behavior user data

rich context information

precise location information

actions on actuators

sensor data user data

raw context datalocation related dataactions

Services

BUTLER Horizontal Architecture

30

User Connectivity Manager

…

SYSTEM/DEVICE MANAGEMENT

DATA/CONTEXT MANAGEMENT

User Profile Manager

Resource Access

Localization Manager

Simple Event Processing

User Behavior Capture

Complex Event Processing

Context/Behavior Information

Provider

Device Data Collector / Actuator

Generic Notification / Actuation Mechanism

PersistentStorage

3GPP Wifi Ethernet

COMMUNICATIONS

User Authentication

User Device Directory

Server Connectivity Manager

Server Authentication

Server Directory

Device Monitoring

IoT Protocol Adapters

Device Directory

Device Authentication

Network Monitoring

CoAP Zigbee KNX NFC InternetInternetBluetooth …HTML5

Authorization Server

SERVICES

DATA EXPOSITION SERVICES

Localization Exposition

Resource Exposition

Context Exposition

User Profile Exposition

Behavior Exposition

USER PORTAL

Context Management Portal

Data Management & Marketplace Portal

DATA AND SERVICE DIRECTORY

Service Registration

Service Composition

Data Discovery

Service(Re-binding)

Service Discovery

BUILT-IN CONTEXT-AWARE SERVICES & APPLICATIONS

Energy Service

Multimedia Service

Application Repository

SYSTEM MANAGEMENT

Service Monitoring

Software Update

DeploymentSmartObject Management

Portal

BUTLER APPLICATIONS

Device Discovery

BUTLER platforms interactions

31

Platform Functional Components (WP3)

BUTLER APIs

local

SmartServer Platform

App

cloud

3rd party Applications

App

SmartServerSmartServer

SmartServer

App App

Mob App

Mobile OS APIs

SmartMobile Platform

Mob App

SmartMobile Middleware

Phone Sensors

SmartObject (GW)

SmartObject Platform

Diff

ere

nt

com

m.

pro

toco

ls

IoT

Se

nso

rs a

nd

A

ctu

ato

rs

SmartObjects (IoT)

App App

Internet

Local wireless

Notification APIRequest

Integration protocols (RESTfull, streaming, etc.)

32

SmartObject/Gateway Platform

The SmartObject Gateway allows interconnection of different networks to achieve access and communication among embedded devices, servers and mobile

terminals

Smart Gateway

33

SmartServer Platform

SmartServer provides reusable services putting the smartness in the IoT

BUTLER Cloud

34

SmartMobile Platform

SmartMobile is a framework that allows services developers to make their apps available to end-users

PROOF OF CONCEPTS AND TRIALS

Smart Home – energy awareness

36

Smart Home – multimedia follow-me

37

Smart Healthcare

38

ISMBGateway

ZIGPOSGateWay

ISMBPositioning

ZIGPOSPositioning

LocalizationServer

ContextExposition

Server

BehaviorModeling

Server

User ProfileManager

SmartMobileDiabetes

Application

AccelerometerSensor Fitbit

LOCATION ACTIVITY

Glucometer

SmartphoneSensors

Smart parking by TST

39

SmartSantander Car-Detection Sensors

GPRS

3GWiFi

SmartObject

NFC))) )))

SmartMobile

Lighting System

SmartServer

SmartSantanderInfrastructure

Smart transport, Zigpos in Glacier Express

40

Smart Healthcare (Tecnalia)

41

500+ users total

60+ users in lab environment

Smart City - Parking (TST)

42

Vehicle DetectionSensor

Lighting System

SmartMobile

SmartObject

Parking AppCommunication

Interfaces

SmartServer

Parking AppGUI

Accounting &

Billing

Context Manager

CommunicationInterfaces

CommunicationInterfaces

• Integration to the BUTLER Platform• Export TST devices as BUTLER smart objects• Smart Parking applications make use of BUTLER smart

services (security, user profile management, localisation)

400+ device deployed4000+ potential users

Smart City - Shopping (TST, Banco Santander, Santander city)

43

SmartShopping

Users- Customers

Context-Information

Commerce Campaign

• Integration to the BUTLER Platform

• Export Santander infrastructure devices as BUTLER smart objects

• Smart Shopping application makes use of BUTLER smart services (security, context-awareness, user profile management, localisation)

400+ device deployed4000+ potential users

Smart Office (TIL, Inno, IHL)

44

T° Sensor

Smart Servers

Smart Mobile

Users

Office Coffee

Machine / Social Place

Smart Gateway

Smart Mobile

Push Data

Display Information

Push Information

Smart Plug

• Integration to the BUTLER Platform• Export Office devices as BUTLER smart objects• Smart Office application makes use of BUTLER smart services

(security, context-awareness, localisation)

50+ users

Technology

BUTLER project presentation