Iot ecosystem-challenges-daeyoungkim-auto-id-labs-kaist

사물인터넷 생태계 실현을 위한 기술과 전략

Daeyoung Kim

Nov. 17, 2014

Professor, Computer Science Department, KAIST

Director of Auto-ID Lab at KAIST • [email protected], http://oliot.org, http://autoidlab.kaist.ac.kr, http://resl.kaist.ac.kr http://autoidlabs.org http://gs1.org

mailto:[email protected]

http://oliot.org/

http://autoidlab.kaist.ac.kr/

http://resl.kaist.ac.kr/

http://autoidlabs.org/

http://gs1.org/

© Auto-ID Lab Korea / KAIST

Slide 2

목차

• 사물 인터넷과 그 생태계의 정의

• 사물 인터넷의 비전과 시장 분석

• 발표자의 사물인터넷 분야 경험 (1998 ~ 현재); 편견? 도움?

• 사물 인터넷의 선구자격인 RFID/USN 국가 사업에서 배울 점

• 국내 및 국제 사물 인터넷 기술 관련 동향

• 도전 이슈와 기술, CASE STUDY: Auto-ID Labs, KAIST

• 그리고 정책 제안


Slide 3

사물인터넷 (Internet of Things)


Slide 4

What are things?, but not limited

Passive Things Active Things Wireless Sensors/Actuators

Smart Devices

Consumer Electronics

Knowledge


Slide 5

What are things?, but not limited


Slide 6

사물인터넷 이전의 Internet 생태계


Slide 7

사물인터넷 생태계, Evolution or Revolution?


Slide 8

사물인터넷 생태계, Evolution or Revolution?

So many connections, So much Opportunities


Slide 9

The Internet of Things Market

Source: IDC Worldwide IoT Market Forecast, May 2014


Slide 10

Internet of Things Ecosystem



Slide 11

IoT Ecosystem Revenues of

Asian Pacific except Japan



Slide 12

발표자의 사물인터넷 분야 경험 (1998 ~ 현재)

1998 2002 2005 2006 2007 2008 2011 2014 2003 2009 2004 2013 1999


Slide 13

RFID/USN 2007 vs. IoT 2014


Slide 14

(RFID/)USN 이 글로벌화되지, 활성화 되지 못한 이유?

고부가 가치 센서의 부재

학술적 결과에 바탕을 둔 산업적 접근 정부주도형 공공사업 우선

국내 표준 집중

IT 산업계 주도형 편중

사일로 / 상호호환성 부재


Slide 15

(RFID/)USN 이 글로벌화되지, 활성화 되지 못한 이유? (사일로/상호호환성 부재의 파급)

[1] Track & Tracing & Recall [2] Smart Agriculture (Sensors & Actuators)

[3] Global Access

[4] Processed Foods

[5] Smart Services & BigData


Slide 16

New Wireless Network for Home

• IPv6/6LoWPAN based • Secure wireless mesh network for home and

its products • Support for many application layers with low

bandwidth • New security architecture • 250+ per network • Runs on 802.15.4 silicon • Designed for very low operation • Reliable for critical infrastructure

Overview Target Application

System Messaging Model Thread Group

Cloud Connectivity • Control when not at home • Within the home, device go

direct to gateway

Border Router • Forwards data to

cloud • Provides Wifi

connectivity in the home

Device Communication • Device to device communication in

the home

7 companies founded the Thread Group

• Not another standard body • A market education group offering • product certification • Promoting Thread’s use in connected products for the

home • Offer rigorous product certification to ensure security

and interoperability • The Thread Group now open to any company who

wishes to join

Designed for al sorts of products in the home

• Appliances • Access control • Climate control • Energy management • Lighting • Safety • Security

Classification

• Normally Powered • Powered or battery • Normally Battery

글로벌 기업의 도전 Google’s Thread Project


Slide 17

글로벌 기업의 도전 Apple’s HealthKit/HomeKit

HealthKit

• The new Health app puts data in one place, accessible with a tap, giving you a clear and current overview of your health. (Heart rate, calories burned, blood sugar, cholesterol, etc)

• We can control devices and accessories in our home easily via smartphone(in this case, iphone), iPad, iWatch, and so on.

• Smartphone is connected with all of accessories in home, and then could control them remotely.

HomeKit


Slide 18

글로벌 기업의 도전 ARM’s mbed


Slide 19 19

• AllJoyn connects, manages, and interoperates smart things together

글로벌 기업의 도전 Qualcomm’s ALLSEEN / AllJoyn


Slide 20

글로벌 표준의 도전 OneM2M (Machine to Machine)

- Use cases and requirements for a common set of Service Layer capabilities; - Service Layer aspects with high level and detailed service architecture, in light of an access independent view of end-to-end services; - Protocols/APIs/standard objects based on this architecture (open interfaces & protocols); - Security and privacy aspects (authentication, encryption, integrity verification); - Reachability and discovery of applications; Interoperability, including test and conformance specifications; - Collection of data for charging records (to be used for billing and statistical purposes); - Identification and naming of devices and applications; Information models and data management (including store and subscribe/notify functionality); - Management aspects (including remote management of entities); and - Common use cases, terminal/module aspects, including Service Layer interfaces/APIs between:

Application and Service Layers; Service Layer and communication functions


Slide 21

글로벌 표준의 도전 GS1

In 1999, the Internet of Things" was first coined by Kevin Ashton who cofounded the Auto-ID Center at the MIT


Slide 22

글로벌 표준의 도전 Industrial Internet Consortium

Accelerating Innovation In Connected, Intelligent Machines And Processes Imagine a highway where cars are able to safely navigate to their destinations without a driver. Imagine a home where an elderly patient’s health is closely monitored by her hospital physician. Imagine a city that significantly reduces waste through sensor-embedded water pipes, buildings, parking meters and more.


Slide 23

국가적 총력 도전 EU-FP7 & IERC (IoT European Research Cluster)

Ideas

Capacities

People Cooperation

Euratom

JRC

ETC.

Coordination and Support Action for Global RFID-related Activities and Standardisation.

Universal Integration of the Internet of Things through an IPv6-based Service Oriented Architecture enabling heterogeneous components interoperability.

Internet of Things at Work.

Internet of Things Architecture.

Internet of Things Initiative.

Internet Connected Objects for Reconfigurable Ecosystems.

Internet of Things Environment for Service Creation and Testing.


Slide 24

Identification of Things & Services

Outnumbered?

Global access!

Heterogeneity Ambiguity

• 다양한 현재의 ID 체계

• Uniform Resource Identifier (URI): http://myflowerpot.iot.kr/temperature

• Universally Unique Identifier (UUID): 550e8400-e29b-41d4-a716-446655440000

• Digital Object Identifier (DOI): 10.1000/182

• Global Trade Item Number (GTIN): urn:epc:id:sgtin:0614141.112345.400

• IDENFITICATION SYSTEM for the Internet of Things?

ID is registered to Identity provider and is used with associated party

GTIN+ on the WEB

http://myflowerpot.iot.kr/temperature


Slide 25

Smart Sensors

고부가가치/진보된 센서 기술 개발

Machine Learning / Artificial Intelligence 기능 부가 센싱 기술 개발


Slide 26

Networking

멀티 프로토콜 게이트웨이 / Access Point/ 가정용 유무선 공유기

BLE / IEEE 802.15.4 SoC

6lowPAN over BLE / IEEE 802.15.4


Slide 27

IoT Platform

IoT 독자 플랫폼

IoT As a Cloud Service

Passive Tags

(e.g., passive

tags, barcode)

Sensor & Actuator Networks(e.g., ZigBee, 6LoWPAN, Mobile phone, BLE,

AllJoyn, lwM2M etc.)

Active Tags (e.g.,

Wireless ID and Sensor

Networks)

RFID Middleware

LLRP LLRP Sensor & actuator protocols Sensor & actuator protocols

Domain-specific capturing application

Domain-specific accessing applications

Sensor Interface

Sensor interface

EPC Information Service

(static and dynamic information)

ALE

Actuation Interface

Sensor & Actuator Middleware

Object

Name

Service

Discovery

Service

ZigBee6LoWPAN/

CoAPMQTT

Web

service-*REST

Other

Comm.

RFID stream processing

Logical RFID

reader

Reader

Management

Sensor stream

processing

Sensor & actuator

Management

ID-Sensor stream

processing

IoT 표준 플랫폼

Big Data 분석


Slide 28

Standards

International (or De facto) Standard Domestic Standard Proprietary (Open)


Slide 29

Killer Applications Domains

스마트폰 기반 IoT 마켓/ Wearables, Accessories

Food Safety Systems

유통물류

스마트홈 의료/헬스케어


Slide 30

IT to Industry Practice (Domain Knowledge)

Monitoring Block Whereabouts?

2006

IT 산업계 주도형 편중


Slide 31

Introduction to KAIST’s …

SeaHaven Project

GPGPU Cloud Project

BuddyThing IoT Browsing

As a Service

IoTMashup As A Service


Slide 32

GS1 Philosophy and Internet of Things

Humans and things


Slide 33

GS1 Member Organizations


Slide 34

GS1 - Essentials

ECG measurement device (GRAI)

Patient ID in hospital

(GSRN)

Surgical tools (GIAI)

The Component / Part Identifier (CPID)


Slide 35

GS1/EPCglobal Standards Global Product Classification (GPC)

• Global Product Classification (GPC) • http://www.gs1.org/1/productssolutions/gdsn/gpc/browser/index.html


Slide 36

GS1/EPCglobal Standards Electronic Product Code (EPC)

• EPC • universal identifier that provides a unique identity for any physical

object


Slide 37

GS1/EPCglobal Standards GS1/EPCglobal Architectural Framework


Slide 38

GS1/EPCglobal Standards GS1/EPCglobal Architectural Framework

Identification

& sensing

Data filtering

& grouping

Data store and

share

Item Discovery &

Information search

GS

1 E

lem

en

t S

trin

g

01

80

61

41

41

12

345

821

678

9


Slide 39

Eg.) Extending EPCIS (EPC Information Service) Internet of Things Global Data Repository

Everyday Object

TDS – Unification of GS1 Codes

Attaching

EPC Tag

Attaching

Bar Code

RFID Reader & Antenna

Barcode Reader

ALE – Event Capturing

EPCIS – Visibility Event Data

Capturing Interface

Query Interface

Business Apps.


Slide 40


RFID Reader

& Antenna

Everyday

Object

EPCIS for IoT

RFID

Tag

IoT Devices Support

Environmental

Sensor Medical Device Healthcare Device Smart Appliance

Gateway Server Mobile Device

Event

Processing

EPCIS Event Sensor Event, Medicare Event, …


Slide 41


• Extended Event for IoT in a case of Medical/Healthcare • Complying EPCglobal Standard

• Supporting various sensor devices

EEG

Blood Pressure

ECG

BreathingGlucometerOxygen

Static/Medical Sensors

Accelerometer

Skin Response Temperature

Mobile/Healthcare Sensors

Wristband Headset

ScaleChestband

Oliot Distributed Storage

Need! Extended Event with Extended Voc.

Why not?


Slide 42


• Extended Event for IoT in a case of Tunnel and Bridge Construction and Management

Why not?


Slide 43

Federated Object Naming Services

Korea

Japan China

Taiwan

Australia

USA

Brazil

France

German

Sunchon Univ.

GS1 Korea

Samsung

KAIST

Local ONS Name Servers

onsepc.kr

Globally Federated ONS Peer Roots

UAE, Saudi Arabia


Slide 44

• Open Language for IoT (Oliot) is an ID-based IoT framework.

• Based on GS1 standard ID (e.g., URI-convertible GTIN)

• Smart Thing Information Service (STIS) since 2005, 2011

• Expand GS1 EPCglobal Network to integrate various sensor network protocols

• Successor of EPC Sensor Network

• ZigBee, 6LoWPAN/CoAP/Obix integration

• Complex Event Processing, etc.

Open Language for the Internet of Things

Passive Tags

(e.g., passive

tags, barcode)

Sensor & Actuator Networks(e.g., ZigBee, 6LoWPAN, Mobile phone, BLE,

AllJoyn, lwM2M etc.)

Active Tags (e.g.,

Wireless ID and Sensor

Networks)

RFID Middleware

LLRP LLRP Sensor & actuator protocols Sensor & actuator protocols

Domain-specific capturing application

Domain-specific accessing applications

Sensor Interface

Sensor interface

EPC Information Service

(static and dynamic information)

ALE

Actuation Interface

Sensor & Actuator Middleware

Object

Name

Service

Discovery

Service

ZigBee6LoWPAN/

CoAPMQTT

Web

service-*REST

Other

Comm.

RFID stream processing

Logical RFID

reader

Reader

Management

Sensor stream

processing

Sensor & actuator

Management

ID-Sensor stream

processing


Slide 45

Oliot Open Source & Community Project (released on July 7, 2014, http://oliot.org)

• We are looking for collaborators:

• developing open sources together such as GS1 source, GS1 digital, Alljoyn, oneM2M, SAMI, Apple Healthkit/Homekit, MQTT, Thread, etc.

• companies who do business with our oliot project

• architecting IoT world including food SCM and safety systems, healthcare/medicare, retail systems, and etc.

http://oliot.org • July 7 2014 – oliot 1.0 (latest

implementation of EPCglobal framework, run on any cloud and supporting mysql and cassandra)

• 4Q 2014 – oliot 1.1 (provide EPCIS 1.1, strengthened to support food industry)

• 2015 – oliot 2.0 (support internet of things, merging auto-id lab, KAIST’s Epc sensor network, STIS and more)

http://oliot.org/


Slide 46

Regulation EU No 1169/2011 Food Information Regulation


Slide 47

• Food Safety Modernization Act (FSMA) was signed on January 4, 2011and aims to ensure the U.S. food supply is safe by shifting the focus from responding to contamination to preventing it

• Foodborne illness is a significant burden

• About 48 million (1 in 6 Americans) get sick each year

• 128,000 are hospitalized

• 3,000 die

Food Safety Modernization Act (FSMA)

http://www.fda.gov/Food/GuidanceRegulation/FSMA/ucm247546.htm




Slide 48

GS1 – UDI Code for Medical Devices


Slide 49

GS1 Digital (To: Naver, Daum KAKAO)

• The GS1 Digital is a new GS1 “Share” technology for communicating the GS1 GTIN and other keys and attributes in computer-readable formats across the World Wide Web.

• The GS1 Digital includes standards and guidelines for companies to publish product data on web pages that allow their consumers to more effectively search for, compare, buy, share information about, and get the most out of the products and services that meet their needs.

Source: Enabling the “digital” revolution in retail (McKinsey, 2013)

• GS1 US McKinsey study (2012~2013) • Interviews w/ > 60 stakeholders: Top 3 use cases:

• GS1 want to solve those pain points

• #1: GTIN+ on the Web

• #2: GS1 Source

• #3 : GPC

Category hierarchy: Create standard hierarchy to structure on-line commerce sites

Trusted source of data: create database of trusted product attributes to facilitate

one-to-many communication and consumer analytics

Unique online product identifier: Use GTINs to improve accuracy in online/mobile

search and prevent digital out of stocks #1

#2

#3

• GS1 Digital official homepage

http://www.gs1.org/digital

• GS1 Digital @ University of Cambridge Auto-ID labs

http://www.autoidlabs.org.uk/GS1Digital/index.html

http://www.gs1.org/digital

http://www.autoidlabs.org.uk/GS1Digital/index.html


Slide 50

IoT Connectivity – SNAIL(Sensor Networks for All IP World) Project Since 2007

Internet of Things

SNAIL Border Router (6LBR)

SNAIL Node (6LN)

SNAIL Node (6LN)

SNAIL Node (6LN)

SNAIL Node (6LN)

IEEE 802.15.4

Btle

IEEE 802.15.4

Btle

Entertainment & Social Net. ServiceDevice Browsing & Mashup

Big Data AnalysisUser Experience with IoT Service

• SNAIL (Sensor Networks for an All-IP worLd)

• an IP-based Wireless Sensor Networks platform

• Supported Protocols

• Interoperability between IPv4/v6 domains and the IEEE 802.15.4

• Lightweight IPv6, ICMPv6, MIPv6, NEMO, UDP, TCP, SSL

• Dual-Mode gateway for WiFi AP and IP-WSN edge router

• CoAP, HTML5, Web browsing (HTTP/TCP)

• Mesh routing in adaptation layer, Addressing

• DTLS/BLE ongoing


Slide 51

IoT Connectivity – SNAIL(Sensor Networks for All IP World) Project Since 2007


Slide 52

Web-based Visualization/WOT PAAS

• Smart devices and consumer electronics are equipped with web/CoAP servers that can response

directly to requests from the Internet

• Presentation Cloud provides rich web contents to support those embedded web servers

• Sensing data and Actuation commands/results are retrieved directly from web browser and display

on top of rich web interface, either in numbers or in

graphs (HTML5)

Nam Giang, Minkeun Ha, and Daeyoung Kim, "Cross Domain Communication in the Web of Things, A New Context for the Old Problem," The 23rd International World Wide Web Conference (WWW) 2014, Demo Session, Seoul, S. Korea, Apr. 2014.

No app. Download Any medical devices and Sensors either old or new


Slide 53



Slide 54



Slide 55

IoT Mashup As a Service; IoT App.

Problem Approach


Slide 56

IoT Mashup As a Service; IoT App.


Slide 57

Seahaven - Visual Sensor Networks Platform


Slide 58

Seahaven - Visual Sensor Networks Platform


Slide 59

System Architecture as of now

VPN

RTSP

FFMPEG

Segmenter

...

GlusterFS

...

Zone B

Unified filesystem

... Flexible

Cinder Cinder

Vol

Webserver

database

Network

Visual processing

Frontend

RTSP MJPEG

Streamer

LDAP

Auth/DNS

Secure Network

Storage Server

HLS/DASH

RTSP /MJPEG

Sensor data

event stream

Zero configuration

Storage Server

Storage Server

Storage Server

Vol

GlusterFS


Slide 60

GPGPU Cloud for Seahaven

60

Biology

Chemistry

Earth

Mathematics

Space

Medicine

Physics

과학

연구

HPC 자

원 요

청

Infiniband

2. 가상화된 GPU 자원 지원 클라우드 플랫폼 개발

3. 중앙집중식GPU 자원 할당 기술 연구

4. 분산식 GPU 자원 할당 기술 연구

1. 과학연구 HPC 클라우드 플랫폼 관련 기술 동향 조사 및 분석

“5. 벤치마크 테스트” ▶ 기존 클라우드 플랫폼과의 비교 분석

“5. 벤치마크 테스트” ▶ 기존 가상화 기술 및 자원 할당 기술과의 비교 분석

LonestarGPU Parboil

사이언스 고성능 컴퓨팅 가상화 환경 구축


Slide 61

GPU Computing Resource 기반의 빅데이터 클라우드 플랫폼 기술 적용방안

61

Embedded Sensor data

Data fusion

Pattern recognition Machine

learning

Process Feedback

Visual Perception

Archive


Slide 62

We are trying to integrate all of them to build an IoT eco system

SeaHaven Project

GPGPU Cloud Project

BuddyThing IoT Browsing

As a Service

IoTMashup As A Service


Slide 63

Open Source 정책과 크라우드 펀딩

1. 소비자들은 특정 제조사에 종속되지 않은 다양한 기기

를 원하며,

2. 제조사들도 자신들의 기기를 지원하는 생태계가 댜양해지길 원함

3. 플랫폼 제조사들도 다양한 기기들을 특정한 노력 없이 연결 및 통합시키기를 원함

4. 응용 개발자들도 다양한 기기들을 가지고 응용을 만들길 원함

5. 글로벌한 생태계의 Winner 들은 대부분 오픈소스 정책을 채택하고 있음.

6. 제품의 완성도를 높이며, 롱런할 수 있음.

7. 기술 사장을 막으며, 정부 연구비 지원 결과의 투명성 및 활용성 증대


Slide 64

사물인터넷 대국민 홍보 및 상상 생산소 운영

가정에서, 학교에서, 산업현장에서 새로운 아이디어가 창출되길

하드웨어 생산소 운영 / 하드웨어 제작자 보조금 지원에 따른, 개인/기업의 하드웨어 제작 부담 감소


Slide 65

글로벌 진출 / 마케팅 및 전문가 / 젊은이에게 기회를


Slide 66

국가적 차원에서의 전략?


Slide 67

Thank you!

Software

Iot ecosystem-challenges-daeyoungkim-auto-id-labs-kaist