44
#IoTinActionMS Kolding June 12, 2018 IoT Reference Architecture Dmitry Teteruk Cloud Solution Architect

IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

  • Upload
    others

  • View
    20

  • Download
    0

Embed Size (px)

Citation preview

Page 1: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

#IoTinActionMS

KoldingJune 12, 2018

IoT Reference ArchitectureDmitry TeterukCloud Solution Architect

Page 2: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Sources: 1McKinsey, How IoT Can Support A Dynamic Maintenance Program, 20162IDC, 2016

~80%margin1

driven by apps,analytics, andservices in 2020

Average increase in income for the most digitally transformed enterprises

$100M

2020

200930B

Things

Income

Intelligence

“Every business will become

a software business, build

applications, use advanced

analytics and provide

SaaS services.“ Satya Nadella 2

2

Page 3: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 4: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Systems of Intelligence

Transform your products

Engage your customers

Optimize your operations

Empower your employees

Digital Transformation

Page 5: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Challenging to

scale over time

Difficult to maintain cohesive security

Time-consuming to get started

Incompatible with

existing infrastructure

However…IoT projects can be complex

Page 6: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT Device Management Lifecycle

Plan

Provision

Configure

Monitor

Retire

Replace or decommission devices after failure, upgrade

cycle or service lifetime

Group devices and control

access according to your

organization's needs

Provide updates, configuration and

applications to assign the purpose

of each device

Securely authenticate devices,

on-board for management

and provision for service

Monitor device inventory, health

and security while providing

proactive remediation of issues

Page 7: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT solution Target & Microsoft positioning

• Consumer IoT?

• Professional IoT?

• IoT Devices?

• IoT Cloud?

Page 8: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Solution PortalProvisioning API

Identity & Registry Stores

Stream Event Processor

Analytics/

Machine

Learning

Data

Visualization &

Presentation

Device State Store

Gateway/

Edge

Storage

IP capable

devices

Existing IoT

devices

Low power

devices

Presentation Device and Event ProcessingData Transport

Devices and

Data Sources

Cloud

Gate-

way

Agent

Libs

Agent

Libs

Control System Worker Role

Agent

Libs

https://azure.microsoft.com/da-dk/updates/microsoft-azure-iot-reference-architecture-available/

Page 9: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 10: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Microsoft Azure IoT Device Catalog

Page 11: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Learn to deploy

Basic scenarios learning

Start thinking of functional customization

More scenario learning

Deep into functional customization

Infrastructure

customization

Architect

Developer

Operator

IT Pro

Key target

persona

IoT Solution Offering Overview

Basic Operator Scenarios Deployment

Advanced Operator ScenariosDevice Connectivity

Scenarios

Basic Customization Tutorials

Advanced Customization Tutorials

Deployment &

Infrastructure

Customizations

Docs

GitHub

Docs

Azure IoT Solution Accelerator Learning Map & Role definition

Page 12: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Overview(docs.msft)

Get Started(docs.msft)

How To(docs.msft)

Advanced

Customization(docs.msft + GitHub)

Microsoft and IoT

IoT Offerings

PCS Overview

Deploy RMv2Operate RMv2

Manage and

configure

devices

Advanced

monitoring

Use Rules to

detect issues

Troubleshoot

and remediate

Connect

Devices

(W + L)

Initial

Customization(docs.msft + GitHub)

Customize

deployments

Customize

infrastructure

Repos

OverviewTop 10

customization

options

Architecture Add Custom

Device to

Simulation

Learn to deploy

Basic scenarios learning

Start thinking of functional customization

More scenario learning

Deep into functional customization

Infrastructure

customization

Architect

Developer

Operator

IT Pro

Key target

personaAzure IoT Solution Accelerator journey map –

remote Monitoring V2

UI

Mods

Rules

Processing

Customization

Microservice

Changes –

Akka, etc

Device

Behavior

Customization

Connectivity

Management

(ex. SIM)

TSI

Integratio

n

Page 13: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT architecture challenges

• Network and protocol

• Security, privacy, and trust

• Heterogeneity

• Device HW+SW

• Serialization and market

• Streaming throughput

• Cost

• Data volume

• Auto-discovery

• Legacy and fragmentation

Page 14: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT architecture characteristics/variables

• Message type

• Message speed

• Message frequency

• Device volume

• Message volume

• Connectivity level

• Data structure

• Communication direction

Page 15: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT real-life use cases and scenariosIndustry Use case Scenarios patterns

Manufacturing

Connected vehicle

Food traceability

Production asset mgmt

Manufacturing operations

Connected field service

Device connectivity and management

Multi-protocol support

Connect legacy devices without replacing existing infrastructure

Remote monitoring

Command and control

Service customer equipment

Edge computing

Security and environmental monitoring

Real-time analytics

Data transformation and routing

Predictive maintenance

Role-based access control

Alerts and notification

Data visualization

Integration with other business services

Process atomic and batch data stream

Manage intermittent-connected devices

Data security from connectivity to storage

Geo-availability

ConsumerHome security

Smart appliances

Government

Automated public transit

Environmental monitoring detection

Public infrastructure asset mgmt

Public safety and emergency response

Healthcare

Remote health monitoring

Clinical care

Personal wellness

Connected medical device

RetailIn-store consumer digital offer

Personalized promotion

TransportationAir traffic monitoring

Asset fleet management

Freight monitoring

UtilitySmart grid

Smart building

Page 16: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 17: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Connectivity Data AnalyticsThings Action

Re-Defining Internet of Things

Page 18: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Comprehensive set of capabilities for IoT solutions

Azure Time Series Insights

Azure Machine Learning

Azure Stream Analytics

Cosmos DB Azure Data Lake

Azure Data Lake Analytics

Azure HD Insight

Azure Event Hubs

Microsoft Flow

Azure Logic Apps

Notification Hubs

Azure Websites

Microsoft Power BI

Azure Active Directory

Azure IoT Hub

Azure IoT Hub Device Provisioning

Service

Azure IoT Edge

Azure Monitor

PaaS S

erv

ices

&

Devi

ce S

up

po

rt

Edge SupportDevice Support

Azure IoT Device SDK

Certified DevicesAzure Certified

for IoT

Security Program for

Azure IoT

IoT Services Data & Analytics Services Visualization & Integration Services

PaaS

SaaS Microsoft IoT Central

IoT SaaS

Remote Monitoring Predictive Maintenance Connected factory

Windows 10 IoT Core

Azure IoT Suite

So

lutio

ns

Tech

no

log

ies

Page 19: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 20: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Azure IoT Hub

Bi-directional communication Enterprise scale & integration End-to-End Security

Page 21: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Custom Cloud Gateway

Custom Cloud Gateway

Field Gateway

Device

VPN/ExpressRoute

OPC, HTTP, CoAP,…

Custom Protocols

Client SDK

IoT Edge

Management appDevice registry/ManagementMonitoringSend commands

Service SDK

Management appDevice registry/ManagementMonitoringSend commands

Service SDK

Cloud protocol gateway sample

Cloud protocol gateway sample

AMQP, MQTT, HTTPS

Applications- Companion apps- Dashboards- Controllers- …

CoAP, AllJoyn, OPC,…

Device

Device

CoAP, AllJoyn, OPC, …

Device

Device

Device

IoT Hub

Field Gateway

Azure IoT Hub

MQTT

MQTT over

WebSocket

Use on all devices that do not

require to connect multiple

devices (each with its own per-

device credentials) over the same

TLS connection.

AMQP

AMQP over

WebSocket

Use on field and cloud gateways

to take advantage of connection

multiplexing across devices.

HTTPSUse for devices that cannot

support other protocols.

AMQP, MQTT, HTTPS

Page 22: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Azure IoT Analytics Patterns

Apache Storm/Spark

Devices

RTO

S, L

inu

x, W

ind

ow

s, A

nd

roid

, iO

S

Gateway

On-Gateway

Analytics

On-Device App Analytics

In-Cloud Analytics

In-Cloud Hot-Analytics

In-Cloud Cold-Analytics

In-Cloud Analytics

Page 23: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 24: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT HUB Basic & Standard

Features Messages/day and costs

Page 25: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 26: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Azure IoT Hub Device Provisioning Service

Azure IoT Hub

Device Provisioning Service

IoT Hub US IoT Hub Germany IoT Hub China

Page 27: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Azure IoT Hub

Device Provisioning Service

Available: Azure IoT Hub Device Provisioning Service

Page 28: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 29: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Secure

Cloud managed

Cross-platform

Portable

Extensible

Azure IoT Edge

Page 30: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Straightforward

Business Logic

Smart Building

Protocol

Translation

Industrial

IoT Adapters

Autonomous

Driving

Straightforward

Filtering

Batch Data

Processing

Home Automation

Hubs

Smart

Meeting Solutions

w/ People Recognition

Custom Code Requirements

Reli

ab

ilit

y R

eq

uir

em

en

ts

Low

M

ediu

m H

igh

Typical Hardware Requirements

Interactive Tier (Single CPU, 128MB Memory) Gateway Tier or Higher

Edge Processing Scenarios & Requirements

Low

Portable Modules / FunctionsMedium

E.g.: Custom Code in Containers

High

E.g.: ML/DNNs in Containers

Page 31: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Azure IoT Edge IoT Hub

Devi

ces

Local Storage

Azure Machine

Learning

(Container)

Functions

RuntimeContainer

Management

Azure IoT Edge

Device

Twin

Device

Twin

Azure Stream

Analytics

(Container)

Azure Functions

(Container)

Cognitive Services

(Container)

Custom Code

(Container)

Module

Twin

Module

Twin

Module

Twin

Module

Twin

Module

Twin

Module

TwinModule

TwinModule

TwinModule

TwinModule

Twin

Page 32: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 33: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

What you get with a solution acceleratorshttps://www.azureiotsolutions.com/Accelerators

Page 34: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 35: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each
Page 36: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Working with Azure IoT Central offers significant advantages

Comprehensive

portfolio

Only hyperscale cloud vendor to offer SaaS,

PaaS, and hybrid options for IoT, and a

commitment to continual innovation

Extensive partner

ecosystem

Industry leaders ready to collaborate with

your business

Industry-leading

security and privacy

From endpoint and connection through

to data and the cloud

Large-scale SaaS

experience

Experience of running and

managing powerful, user-friendly, scalable

solutions used by millions of users

worldwide

Open

platform

Any device, OS, data source, software, or

service

Page 37: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Connectivity Hub & Telemetry ingestion

Device management

Analytics & dashboards

Rules engine

Time-series insights

Digital twin management

User and identity management

Features

Page 38: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

#IoTinActionMS

What else I should think about?

Page 39: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Driving Security Innovation: 7 Properties of Device Security

https://www.microsoft.com/en-us/research/project/sopris/

Page 40: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Long Range Connectivity (in no specific order)Technology Available Low Power Lock-in? Band Notes

2/3G Cellular Yes - Mobile Operator GSM 900, GSM 1800,

UMTS 900, UMTS 2100

4G Cellular LTE Limited in Rural

Areas

- Mobile Operator LTE 800, LTE 900, LTE 1800,

LTE 2100, LTE 2600

50-100ms Latency

ADSL Yes - Telco

Fiber Yes - Telco

ExpressRoute Yes - ER Partner

LoRaWAN Yes Yes Open 868/933 MHz Whitespace 1-249 Bytes/Message

Sigfox Yes Yes Sigfox 868/933 MHz Whitespace 12 Bytes/Message

144 times per day

NB-IOT/LTE-M/Cat-M1 Very Limited (Test

Networks)

Yes Mobile Operator In-Band, Guard Band of

LTE (4G)

1.6s-10s Latency *

5G Future (2022) - Mobile Operator 28, 38, and 60 GHz 5ms+ Latency, 3x base

station density compared to

3G

Satellite Yes - Operator (Iridium,

Inmarsat,

LightSquared, Thuraya)

1525-1661 MHz Extreme Costs, Indoor use

not possible

Page 41: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Azure Calculation referral point

• Unless your company is, as instance, a LSP (licensing Solution Partner) and/or a CSP (Cloud Solution Provider),

use this service as referral point to get an “idea” on possible costs.

• Be careful: depending on Customer contracts, costs may vary - refer to an official reseller to understand final

Azure subscription costs

Page 42: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

General Architecture Considerations - Summary

Page 43: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

IoT Implementation Success – Overall suggestions

Do

• Secure senior business sponsorship

• Focus on business requirements

• Start small, think big (MVP)

• Build multi-disciplinary teams

• Engage the right experience

• Keep security central in all you do

• Use agile development processes

• Design for flexibility and change

• Take a ecosystem approach to IoT

Do not

• Confuse data with insights

• Build a solution for all your needs

• Over-pivot on the technology

• Focus on future requirements

• Develop your own IoT infrastructure

• See middleware as the IoT solution

• Think connectivity is not a problem

• Underestimate the importance of quality sensors

• Forget that IoT is devices (HW) and software

Microsoft Learnings from Real Customer cases; 10 reasons why your IoT project will fail, Derek du Preez;

https://diginomica.com/2017/09/13/10-reasons-iot-project-will-fail/

The dos and don’ts of IoT, Jon Reed;

https://diginomica.com/2016/06/09/the-dos-and-donts-of-iot-a-customer-panel-shares-internet-of-things-progress/

Page 44: IoT Reference Architecture Koldingazurebootcampdk.azurewebsites.net/Presentations/Tech 1...MQTT over WebSocket Use on all devices that do not require to connect multiple devices (each

Mange tak!(Thank you!)