31
Scheduling at the Edge for Assisting Cloud Real-Time Systems Lorenzo Corneo and Per Gunningberg Communication Research group (CoRe) Uppsala University TOPIC 2018 2018 2018 Dept. of Information Technology -1- Lorenzo Corneo and Per Gunningberg

Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Scheduling at the Edge for Assisting CloudReal-Time Systems

Lorenzo Corneo and Per Gunningberg

Communication Research group (CoRe)Uppsala University

TOPIC 2018

2018

2018 Dept. of Information Technology - 1 - Lorenzo Corneo and Per Gunningberg

Page 2: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Introduction

Cloud computing

• Offloading computation from battery powered devices• Very scalable• Faraway from controlled systems• Induced communication latency• Physical resource access delay

Edge computing

• Cloud functionality at smaller scale• Located in proximity of the controlled system• Ensure low latency

Sensor network

• Duty-cycled for energy saving

Real-Time applications

• Have timing requirements• Run in a cloud-hosted environment

2018 Dept. of Information Technology - 2 - Lorenzo Corneo and Per Gunningberg

Page 3: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Introduction

Cloud computing• Offloading computation from battery powered devices• Very scalable

• Faraway from controlled systems• Induced communication latency• Physical resource access delay

Edge computing

• Cloud functionality at smaller scale• Located in proximity of the controlled system• Ensure low latency

Sensor network

• Duty-cycled for energy saving

Real-Time applications

• Have timing requirements• Run in a cloud-hosted environment

2018 Dept. of Information Technology - 2 - Lorenzo Corneo and Per Gunningberg

Page 4: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Introduction

Cloud computing• Offloading computation from battery powered devices• Very scalable• Faraway from controlled systems• Induced communication latency• Physical resource access delay

Edge computing

• Cloud functionality at smaller scale• Located in proximity of the controlled system• Ensure low latency

Sensor network

• Duty-cycled for energy saving

Real-Time applications

• Have timing requirements• Run in a cloud-hosted environment

2018 Dept. of Information Technology - 2 - Lorenzo Corneo and Per Gunningberg

Page 5: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Introduction

Cloud computing• Offloading computation from battery powered devices• Very scalable• Faraway from controlled systems• Induced communication latency• Physical resource access delay

Edge computing• Cloud functionality at smaller scale• Located in proximity of the controlled system• Ensure low latency

Sensor network

• Duty-cycled for energy saving

Real-Time applications

• Have timing requirements• Run in a cloud-hosted environment

2018 Dept. of Information Technology - 2 - Lorenzo Corneo and Per Gunningberg

Page 6: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Introduction

Cloud computing• Offloading computation from battery powered devices• Very scalable• Faraway from controlled systems• Induced communication latency• Physical resource access delay

Edge computing• Cloud functionality at smaller scale• Located in proximity of the controlled system• Ensure low latency

Sensor network• Duty-cycled for energy saving

Real-Time applications

• Have timing requirements• Run in a cloud-hosted environment

2018 Dept. of Information Technology - 2 - Lorenzo Corneo and Per Gunningberg

Page 7: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Introduction

Cloud computing• Offloading computation from battery powered devices• Very scalable• Faraway from controlled systems• Induced communication latency• Physical resource access delay

Edge computing• Cloud functionality at smaller scale• Located in proximity of the controlled system• Ensure low latency

Sensor network• Duty-cycled for energy saving

Real-Time applications• Have timing requirements• Run in a cloud-hosted environment

2018 Dept. of Information Technology - 2 - Lorenzo Corneo and Per Gunningberg

Page 8: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Cloud-Edge-Sensor architecture

Cloudk

Cloudl

Appk,j

Appl,jInternet

2018 Dept. of Information Technology - 3 - Lorenzo Corneo and Per Gunningberg

Page 9: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Cloud-Edge-Sensor architecture

Cloudk

Cloudl

Appk,j

Appl,jInternet

Unpredictablehigher latency

Boundedlow latency

2018 Dept. of Information Technology - 3 - Lorenzo Corneo and Per Gunningberg

Page 10: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Cloud-Edge-Sensor architecture

Cloudk

Cloudl

Appk,j

Appl,jInternet

Unpredictablehigher latency

Boundedlow latency

A “digital twin” sensor is a cached copy of the most recentsensor update.

2018 Dept. of Information Technology - 3 - Lorenzo Corneo and Per Gunningberg

Page 11: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Research question

Can we use an edge device for helping real-time applications infulfilling their timing requirements?

2018 Dept. of Information Technology - 4 - Lorenzo Corneo and Per Gunningberg

Page 12: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Real-time model

We introduce additional parameters at application side:

texec : application execution timeσ: delay before starting of texectc : minimum required execution time for computationτ∆: Age of Information requirement

Ta

texec

tc

Figure: Real-Time parameters.

2018 Dept. of Information Technology - 5 - Lorenzo Corneo and Per Gunningberg

Page 13: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Age of Information (AoI)

Age of Information is a metric that measures data freshness.

Definition

∆(t) = t − u(t), where t is the current time and u(t) is thegeneration time of the latest sensor update.

2018 Dept. of Information Technology - 6 - Lorenzo Corneo and Per Gunningberg

Page 14: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Validity of sensor update

Definition

The validity of the i:th sensor update, vi , is defined as theintersection between execution time interval and AoI (whensmaller than τ∆).

2018 Dept. of Information Technology - 7 - Lorenzo Corneo and Per Gunningberg

Page 15: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Execution time: texec (1/3)

dse+dect

u0 u2 ui ui+1r0 r1 r2 ri ri+1texec

Ta

u1dse

Figure: Execution time and Age of Information in a scenario with nocommunication delay variability.

2018 Dept. of Information Technology - 8 - Lorenzo Corneo and Per Gunningberg

Page 16: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Execution time: texec (2/3)

vi

Figure: Age of Information and reduced execution time due tocommunication delay variability dv ,i .

2018 Dept. of Information Technology - 9 - Lorenzo Corneo and Per Gunningberg

Page 17: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Execution time: texec (3/3)

vi

Figure: Age of Information and reduced execution time due tocommunication delay variability dv ,i and AoI constraint τ∆.

2018 Dept. of Information Technology - 10 - Lorenzo Corneo and Per Gunningberg

Page 18: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Scheduling policies

We propose two scheduling policies performed at the edgedevice:

AITE: Age in the Edge. The edge pushes sensor updatestowards the digital twin in the cloud according toapplication period.

AITC: Age in the Cloud. The edge pushes sensor updatesupon reception as close as possible to the applicationperiod.

We will analyze both of them and decides which is mostsuitable for reaching our objectives.

2018 Dept. of Information Technology - 11 - Lorenzo Corneo and Per Gunningberg

Page 19: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Scheduling policies

We propose two scheduling policies performed at the edgedevice:

AITE: Age in the Edge. The edge pushes sensor updatestowards the digital twin in the cloud according toapplication period.

AITC: Age in the Cloud. The edge pushes sensor updatesupon reception as close as possible to the applicationperiod.

We will analyze both of them and decides which is mostsuitable for reaching our objectives.

2018 Dept. of Information Technology - 11 - Lorenzo Corneo and Per Gunningberg

Page 20: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

AITE: Age in the Edge

Figure: Execution time and Age of Information for AITE.

2018 Dept. of Information Technology - 12 - Lorenzo Corneo and Per Gunningberg

Page 21: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

AITC: Age in the Cloud

Figure: Execution time and Age of Information for AITC.

2018 Dept. of Information Technology - 13 - Lorenzo Corneo and Per Gunningberg

Page 22: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Evaluation setup

We evaluate the aforementioned scheduling policies throughsimulation. We choose the following parameters:

Latency sensor-edge, dse = 1ms

Latency edge-cloud, dec = 100ms

Application deadline, τ∆ = 210ms

Sensor update period, Ts = 100ms

Application period, Ta = 190ms

Application execution time, texec = 152ms

Communication delay variability: Pareto distribution withmaximum value 161ms and average value 14ms.

We collected 5000 samples both at the cloud and theapplication for every simulation instance.

2018 Dept. of Information Technology - 14 - Lorenzo Corneo and Per Gunningberg

Page 23: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Evaluation setup

We evaluate the aforementioned scheduling policies throughsimulation. We choose the following parameters:

Latency sensor-edge, dse = 1ms

Latency edge-cloud, dec = 100ms

Application deadline, τ∆ = 210ms

Sensor update period, Ts = 100ms

Application period, Ta = 190ms

Application execution time, texec = 152ms

Communication delay variability: Pareto distribution withmaximum value 161ms and average value 14ms.

We collected 5000 samples both at the cloud and theapplication for every simulation instance.

2018 Dept. of Information Technology - 14 - Lorenzo Corneo and Per Gunningberg

Page 24: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

AoI at the cloud and at the application

Figure: Age of Information at the cloud and at the application,respectively, ∆a(t) and ∆c(t) for AITE and AITC.

2018 Dept. of Information Technology - 15 - Lorenzo Corneo and Per Gunningberg

Page 25: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Validity v

0 20 40 60 80 100v [ms]

0.0

0.2

0.4

0.6

0.8

1.0C

DF

AITEAITC

Figure: Validity of the updates at the application, v .

2018 Dept. of Information Technology - 16 - Lorenzo Corneo and Per Gunningberg

Page 26: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Results

Percentage of real-time misses• AITE ≈ 34%• AITC ≈ 9%

Validity of sensor updates• vAITC > vAITE

AITC outperforms AITE in both the metrics!

2018 Dept. of Information Technology - 17 - Lorenzo Corneo and Per Gunningberg

Page 27: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Results

Percentage of real-time misses• AITE ≈ 34%• AITC ≈ 9%

Validity of sensor updates• vAITC > vAITE

AITC outperforms AITE in both the metrics!

2018 Dept. of Information Technology - 17 - Lorenzo Corneo and Per Gunningberg

Page 28: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Conclusion

We propose to use Age of Information and validity inperiodic real-time cloud assisted applications

We propose to use an edge device to schedule sensorupdates in order to fulfill application requirements

We propose and evaluate two scheduling policies at theedge device

2018 Dept. of Information Technology - 18 - Lorenzo Corneo and Per Gunningberg

Page 29: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Conclusion

We propose to use Age of Information and validity inperiodic real-time cloud assisted applications

We propose to use an edge device to schedule sensorupdates in order to fulfill application requirements

We propose and evaluate two scheduling policies at theedge device

2018 Dept. of Information Technology - 18 - Lorenzo Corneo and Per Gunningberg

Page 30: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Conclusion

We propose to use Age of Information and validity inperiodic real-time cloud assisted applications

We propose to use an edge device to schedule sensorupdates in order to fulfill application requirements

We propose and evaluate two scheduling policies at theedge device

2018 Dept. of Information Technology - 18 - Lorenzo Corneo and Per Gunningberg

Page 31: Scheduling at the Edge for Assisting Cloud Real-Time Systems · Very scalable Faraway from controlled systems Induced communication latency ... We propose two scheduling policies

Thank you!

Any questions?

2018 Dept. of Information Technology - 19 - Lorenzo Corneo and Per Gunningberg