19
Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto Scientific Director, NSERC SAVI Research Network [email protected] 1

Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Software-Defined Fabrics for IoT at Scale

Alberto Leon-Garcia University of Toronto

Scientific Director, NSERC SAVI Research Network [email protected]

1

Page 2: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Context ¡ The Challenge ¡ By 2050 ¡ Over 70% of world population will live in cities ¡ Occupy 2% of landmass ¡ Consume 75% of resources

¡ The Opportunity ¡ To enable livable and sustainable cities and urban

regions ¡ economic, environmental, social

¡ Our Focus ¡ Platforms to enable Smart City Applications ¡ Converged Cloud computing, SDN, and IOT

2

Page 3: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

IOT at Scale 3

Sensor and Actuator Gossamer

? ¡  Real-time Situational Awareness

¡  Continuous Monitoring ¡  Data Collection & Historical Record ¡  Flexibile & Extensible data types

¡  Learning and Intelligence ¡  Analytics & Machine Learning ¡  Standard & Custom Reporting

¡  Visualization ¡  System Dashboard Available on Demand

¡  Anytime, Anywhere, Authorized ¡  Trending & Forecasting ¡  KPI Analysis

¡  Smart Applications Enablement

¡  APIs provide real-time, historical, value-add data

¡  Incident Management, Emergency Response

¡  Event Planning & Management

¡  Control, Planning, Optimization

¡  Requirements ¡  Secure and Private ¡  Responsive ¡  Scalable ¡  Cost-effective

Page 4: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

A Layered Architecture 4

Phys

. R

eso

urc

es

Cloud Controllers (SD) Network Controllers Access/Things Controllers

SDI Resource Management SDI Manager Topology Manager Monitoring &

Analytics

Mu

lti-T

ier

Soft

wa

re D

efin

ed

In

fra

stru

ctu

re

PaaS End-To-End, Multi Domain, Orchestration

Information-Centric Data Dissemination

BIaaS Publish/Subscribe Overlay

Algorithmic Engines

Analytics Engines

APIs

SaaS Portal Custom

KPIs Urban

Planning Congestion

pricing 3rd Party

Apps …

Page 5: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Traditional ITS Data Flow

• Traffic Cameras • Lane Usage Status Road Authorities

• Bus Movement Information Transit Operators

• Accident Reports Public Safety Agencies

• Construction Incidents Municipalities

• Weather Conditions Environment Canada

• Road Conditions Road Sensors

Traffic

Management Center

Page 6: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Supporting Public & Private Providers

Public App Provider:· ITS Services

Private App Provider:· Traveler Assistance· Personalized Routing

· Fleet Management

Content-based Routing (Publish/Subscribe)

Content-based Router

Clients (publisher/subscriber)

Server Farm

Computers

Computers

Workstation

Laptops

Switch

Database

BV2V

Cluster

A

C

Truck

RoadSensors

Sensing

Intelligence

Control

Page 7: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Demo: CVST Portal of Greater Toronto Area Traffic

¡  http://portal.cvst.ca

Page 8: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

A Layered Architecture 8

Phys

. R

eso

urc

es

Cloud Controllers (SD) Network Controllers Access/Things Controllers

SDI Resource Management SDI Manager Topology Manager Monitoring &

Analytics

Mu

lti-T

ier

Soft

wa

re D

efin

ed

In

fra

stru

ctu

re

PaaS End-To-End, Multi Domain, Orchestration

Information-Centric Data Dissemination

BIaaS Publish/Subscribe Overlay

Algorithmic Engines

Analytics Engines

APIs

SaaS Portal Custom

KPIs Urban

Planning Congestion

pricing 3rd Party

Apps …

Page 9: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Application-Enablement in Multi-tier Clouds ¡ Mul$-TieredCloud:Core,SmartEdges,Access,vCPE,fog

•  Management of Software-Defined Multitier Cloud •  Computing, Networking, FPGAs, GPUs, Software-Defined Radio •  Integrated real-time resource measurement and monitoring

•  Software-Defined Network Services •  Integrated secure networking over SDN and legacy networks

•  vCPE/Sensors •  virtual Customer Premises Edge (vCPE) and sensors, local resources at

customer premises, managed from the Smart Edge •  Application Platform:

•  E2E orchestration of applications across federated infrastructures •  Spanning core, Internet, smart edge, programmable access, and sensors

Page 10: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

SAVI Testbed

¡  Cross-Canada Testbed; L2 backbone

¡  Federated with GENI in the USA, Two SAVI nodes in US, L2 connectivity

¡  One SAVI node in Korea

10

C & MU of T Edge U of T Core

C & M

ORION CANARIE CANARIE

SAVI Testbed Network

C & MMcGill Edge

C & MCarlton Edge

C & MVictoria Edge

C & MCalgary Edge

C & M

Waterloo Edge

C & M

YorkU Edge

Virtual Network

Virtual Network

Application XResources

Application YResources

C & M

Carleton Edge

Page 11: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

SAVI SDI Architecture & JANUS Manager

Converged Heterogeneous Resources

Resource Controller A Resource Controller B

External Entities

Resource Type A

Resource Controller C

SDI Resource Management

System

Resource Type B Resource Type C Physical resource

Virtual resource

SDI Manager Topology Manager Monitoring & Analytics Control & Management

Open Interfaces

•  Eachresourcetypecontrolledbyspecializedcontrollers•  EachcontrollercommunicateswithlogicallycentralC&Mframework

•  SDIManager,TopologyManager,andMonitoringandAnaly5cs

•  Exposesopeninterfacesforexternalusersanden$$es

Page 12: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

NetworkControlModule

Port&Flavorinfo.

FlowStore

SDIGraphTopologyManager

Open APIs

TopologyInfo. Graph

Man

ager

Path

Setup

Access

Man

ager

ARP

Hand

ler

AppFlow

Man

ager

NetworkControllerDrivers

OpenFlowController1

FlowStoreCache

OpenFlowControllern

FlowStoreCache

Nova/NeutronJanusPlugins

Janus Network Control Module

•  NoBroadcast•  RouterlessIP•  Non-IPTraffic

•  QualityofService•  NFVServiceChaining•  Security

Page 13: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

13

Flexible Creation of Smart Apps on virtualized Customer Premises Edge

SAVI Smart Edge

Integrated Management

JanusOrchestration

MonArchMonitoring/Analytics

Cloud + SDN

Management Portal !!Apps!!

S martH ome

P rivateN etwork

V ideoS treamer

SAVI vCPE

Page 14: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Small SAVI vCPE ¡  Supports compute and networking

virtualization

¡ Able to host multiple applications

¡ Connected to the SAVI Smart Edge with VPN technology

¡  Has all the capabilities provided from the virtualized system in SAVI (e.g. tenant isolation)

¡ Capable of leveraging advanced Features of SAVI SDI (e.g. NFV Service Chaining)

Janus&SDI&Manager&OpenStack&and&OpenFlow&

Customer&Premise&

SAVI&Very&Small&Edge&

SAVI&Small&Edge&

Control&

Smart&Edge&

Page 15: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

SAVI vCPE Use Cases

¡ Gateway for Internet of Things devices

¡ Web acceleration and service delivery point ¡ NFVs such as proxy, firewall, IDS/IPS and VPN services

¡ Smart home and office

¡ Connected vehicles

¡ Smart Transportation

¡ Smart Cities (lighting, air quality, … , carbon footprint)

Page 16: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Monitoring CO2

¡  Sensor nodes: consists of a carbon dioxide sensor and radio module

¡  Relay nodes: responsible for forwarding any received packet toward the destination

¡ Control Room: destination of sensor data and data aggregation point

Page 17: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Research Agenda ¡  IoT Virtualzation ¡  Sensors, Actuators, Networks

¡  SD Fabrics for City-Scale Infrastructure ¡  Virtual Slices: Core + Smart Edge + vCPE + vIoT ¡  Synergy with fiber-based broadband access ¡  Synergy with wireless access: LTE, 5G, and more

¡  IoT-scale data gathering and dissemination ¡  Software-defined Information Centric Networking ¡  Distributed storage, processing and aggregation ¡  Security and Privacy ¡  Low-latency and QoS where needed

¡  Intelligence at Scale ¡  Distributed analytics and deep learning

17

Page 18: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Conclusion ¡ The SAVI multitier cloud based on SDI can provide

flexibility, performance, scalability and cost effectiveness to support smart city applications

¡ CVST application platform supports creation of smart transportation applications

¡ Together SAVI & CVST provide a template for smart city application platforms

18

Page 19: Software-Defined Fabrics for IoT at Scale€¦ · Software-Defined Fabrics for IoT at Scale Alberto Leon-Garcia University of Toronto ... ¡ System Dashboard Available on Demand ¡

Thank You!

19