131
Bandwidth Allocation in Large Stochastic Networks Mathieu Feuillet Soutenance de thèse 12/07/2012

Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Bandwidth Allocation in LargeStochastic Networks

Mathieu Feuillet

Soutenance de thèse

12/07/2012

Page 2: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Introduction

Page 3: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Modeling

NetworkTraffic Performance

Objectives:- Modeling- Design- Dimensioning

3

Page 4: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

What Are We Talking About?

- In a distributed storage system with failures,what is the life expectancy of a file?

- Does the Internet collapse if users are selfishand don’t use congestion control?

- Does CSMA/CA, as used in WiFi, ensureefficient use of bandwidth?

4

Page 5: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Contents

Mathematical toolsModeling

Scaling methods

Stochastic averaging

ExamplesUnreliable File System

The Law of the Jungle

Flow-Aware CSMA

5

Page 6: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Modeling

Page 7: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Modeling

NetworkTraffic Performance

Objectives:- Modeling- Design- Dimensioning

Tools:- Markov processes- Queueing models- Scaling methods

7

Page 8: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Stochastic Models

State: (X(t)) a Markov jump process in Nd:

- Number of files,

- Number of active flows in the Internet,

- Number of messages to be transmitted.

Markov assumptions:- Poisson arrivals

- Exponentially distributed sizes/durations.

8

Page 9: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Stochastic Models

State: (X(t)) a Markov jump process in Nd:

- Number of files,

- Number of active flows in the Internet,

- Number of messages to be transmitted.

Markov assumptions:- Poisson arrivals

- Exponentially distributed sizes/durations.

8

Page 10: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Stochastic Models

State: (X(t)) a Markov jump process in Nd:

- generally, non-reversible,

- when ergodic, invariant distribution not known,

- results on transient properties are rare (ford ≥ 2).

9

Page 11: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling Methods

Page 12: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling Methods

Principle: N a scaling parameterAnalyze the evolution of the sample path of

XN(ΨN(t))

ΦN

as N→∞, for some convenient (ΨN(t)) and (ΦN).

Time scale t→ ΨN(t) is used as a tool to focus onsome specific part of sample paths.

There may be more than one time scale ofinterest!

11

Page 13: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling Methods

Principle: N a scaling parameterAnalyze the evolution of the sample path of

XN(ΨN(t))

ΦN

as N→∞, for some convenient (ΨN(t)) and (ΦN).

Time scale t→ ΨN(t) is used as a tool to focus onsome specific part of sample paths.

There may be more than one time scale ofinterest!

11

Page 14: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling Methods: Goals

Give a First order description of (XN(t)):

XN(ΨN(t)) ≈ ΦN.x(t)

where,(x(t)) is a simpler stochastic process or even adeterministic dynamical system:

x(t) = F(x(t))

12

Page 15: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Classical Example: Fluid Limit

X(t)

=

X(Nt)

N

, with N = ‖X(0)‖.

Scaling parameter: initial state

Time scale: t 7→ Nt

Fluid limit reaches 0⇓

Process is stable

13

Page 16: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Classical Example: Fluid Limit

X(t)

=

X(Nt)

N

, with N = ‖X(0)‖.

Scaling parameter: initial state

Time scale: t 7→ Nt

Fluid limit reaches 0⇓

Process is stable13

Page 17: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example: Fluid Limit of M/M/1 Queue

X(t)

=

X(Nt)

N

, with N = X(0).

0 1·102

0

0.5

1

·101

X(0) = 10

t

X(t

)

14

Page 18: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example: Fluid Limit of M/M/1 Queue

X(t)

=

X(Nt)

N

, with N = X(0).

0 1·103

0

0.5

1

·102

X(0) = 102

λ = 0.8 μ = 1

t

X(t

)

14

Page 19: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example: Fluid Limit of M/M/1 Queue

X(t)

=

X(Nt)

N

, with N = X(0).

0 1·104

0

0.5

1

·103

X(0) = 103

λ = 0.8 μ = 1

t

X(t

)

14

Page 20: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example: Fluid Limit of M/M/1 Queue

X(t)

=

X(Nt)

N

, with N = X(0).

0 1·105

0

0.5

1

·104

X(0) = 104

λ = 0.8 μ = 1

t

X(t

)

14

Page 21: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example: Fluid Limit of M/M/1 Queue

X(t)

=

X(Nt)

N

, with N = X(0).

0 1·106

0

0.5

1

·105

X(0) = 105

λ = 0.8 μ = 1

t

X(t

)

14

Page 22: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

References

Fluid limits for queueing systems:[Malyshev 93][Rybko-Stolyar 92][Dai 95]

Scaling methods:[Khasminskii 56][Freidlin-Wentzell 79][Ethier-Kurtz 86][Robert 03]

15

Page 23: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerProof of the tightness of the scaled process

XN (ΨN(t))

ΦN

- Stochastic Differential Equation representationof (XN(t)) with martingales

- Standard tightness criteria

Difficulties:- Discontinuities: Skorokhod Problem Techniques- Stochastic averaging

Each example has its specific difficulties

16

Page 24: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerProof of the tightness of the scaled process

XN (ΨN(t))

ΦN

- Stochastic Differential Equation representationof (XN(t)) with martingales

- Standard tightness criteria

Difficulties:- Discontinuities: Skorokhod Problem Techniques- Stochastic averaging

Each example has its specific difficulties

16

Page 25: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerProof of the tightness of the scaled process

XN (ΨN(t))

ΦN

- Stochastic Differential Equation representationof (XN(t)) with martingales

- Standard tightness criteria

Difficulties:- Discontinuities: Skorokhod Problem Techniques- Stochastic averaging

Each example has its specific difficulties

16

Page 26: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerProof of the tightness of the scaled process

XN (ΨN(t))

ΦN

- Stochastic Differential Equation representationof (XN(t)) with martingales

- Standard tightness criteria

Difficulties:- Discontinuities: Skorokhod Problem Techniques- Stochastic averaging

Each example has its specific difficulties16

Page 27: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Stochastic Averaging

Page 28: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t)),

Fast time-scale

yN(t) = G(xN(t),yN(t))

Slow time-scale

Fast time-scale:

xN(t/N) = F(xN(t/N)).

Slow time-scale: If x(t) tends to a fixed point x?:(yN(t)) converges to (y(t)) with

y(t) = G(x?,y(t))

18

Page 29: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t)), Fast time-scaleyN(t) = G(xN(t),yN(t)) Slow time-scale

Fast time-scale:

xN(t/N) = F(xN(t/N)).

Slow time-scale: If x(t) tends to a fixed point x?:(yN(t)) converges to (y(t)) with

y(t) = G(x?,y(t))

18

Page 30: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t)), Fast time-scaleyN(t) = G(xN(t),yN(t)) Slow time-scale

Fast time-scale:

xN(t/N) = F(xN(t/N)).

Slow time-scale: If x(t) tends to a fixed point x?:(yN(t)) converges to (y(t)) with

y(t) = G(x?,y(t))

18

Page 31: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t)), Fast time-scaleyN(t) = G(xN(t),yN(t)) Slow time-scale

Fast time-scale:

xN(t/N) = F(xN(t/N)).

Slow time-scale: If x(t) tends to a fixed point x?:(yN(t)) converges to (y(t)) with

y(t) = G(x?,y(t))

18

Page 32: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t),yN(t)), Fast time-scaleyN(t) = G(xN(t),yN(t)) Slow time-scale

Fast time-scale: When N→∞, yN(t/N) ≈ z

xN(t/N) ≈ F(x(t/N), z)

Slow time-scale: If (xN(t)) tends to a fixed point x?z:

(yN(t)) converges to (y(t)) with

y(t) = G

x?y(t)

,y(t)

19

Page 33: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t),yN(t)), Fast time-scaleyN(t) = G(xN(t),yN(t)) Slow time-scale

Fast time-scale: When N→∞, yN(t/N) ≈ z

xN(t/N) ≈ F(x(t/N), z)

Slow time-scale: If (xN(t)) tends to a fixed point x?z:

(yN(t)) converges to (y(t)) with

y(t) = G

x?y(t)

,y(t)

19

Page 34: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Deterministic ExampleDeterministic sequences (xN(t)) and (yN(t)) with:

xN(t) = NF(xN(t),yN(t)), Fast time-scaleyN(t) = G(xN(t),yN(t)) Slow time-scale

Fast time-scale: When N→∞, yN(t/N) ≈ z

xN(t/N) ≈ F(x(t/N), z)

Slow time-scale: If (xN(t)) tends to a fixed point x?z:

(yN(t)) converges to (y(t)) with

y(t) = G

x?y(t)

,y(t)

19

Page 35: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Stochastic vs Deterministic

Deterministic Stochastic

Fast process ODE Markov process(x(t)) (X(t))

x = F(x(t),y) Ω(y)

Slow process ODE Markov process(y(t)) (Y(t))

EquilibriumFixed point Stationary

x?y

distributionπy

Convergence Regularity of Regularity ofy 7→ x?

yy 7→ πy

20

Page 36: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Stochastic vs Deterministic

Deterministic Stochastic

Fast process ODE Markov process(x(t)) (X(t))

x = F(x(t),y) Ω(y)

Slow process ODE Markov process(y(t)) (Y(t))

EquilibriumFixed point Stationary

x?y

distributionπy

Convergence Regularity of Regularity ofy 7→ x?

yy 7→ πy

20

Page 37: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

References

Statistical mechanics:[Bogolyubov 62]

Stochastic calculus:[Khasminskii 68],[Papanicolaou et al. 77],[Freidlin-Wenzell 79].

Loss networks:[Kurtz 92],[Hunt-Kurtz 94]

21

Page 38: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ContributionsThe Law of the Jungle:

- Stochastic averaging

- Scaling over the stationary distributions

Flow-Aware CSMA:- Suboptimality of CSMA (mono/multi-channel)- Optimality of Flow-Aware CSMA (mono/multi)- Time-scale separation

An unreliable file system:- Three time-scales- Stochastic averaging (simpler proof)

Transient properties of Engset and Ehrenfest:- Positive martingales- Asymptotics on hitting times

22

Page 39: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ContributionsThe Law of the Jungle:

- Stochastic averaging

- Scaling over the stationary distributions

Flow-Aware CSMA:- Suboptimality of CSMA (mono/multi-channel)- Optimality of Flow-Aware CSMA (mono/multi)- Time-scale separation

An unreliable file system:- Three time-scales- Stochastic averaging (simpler proof)

Transient properties of Engset and Ehrenfest:- Positive martingales- Asymptotics on hitting times

22

Page 40: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example 1:

An Unreliable File System

Page 41: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

1

1

1

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

24

Page 42: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

1

1

2

2

3

3

Back-up: λN

βN files2 copies/file μ 1

2

2

1

3

31

Each copy is lost at rate μ24

Page 43: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

1

1

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

24

Page 44: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

1

1

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

A file with 1 copy can be backed up24

Page 45: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

A file with 1 copy can be backed up24

Page 46: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

24

Page 47: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1

2

2

1

3

31

A file with 0 copies is lost24

Page 48: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

A file with 0 copies is lost24

Page 49: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

A file with 0 copies is lost24

Page 50: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

24

Page 51: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅11

1

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

24

Page 52: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅11

1

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

3

1

24

Page 53: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

∅11

1

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

3

1

24

Page 54: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Model

1

11

2

2

3

3

Back-up: λN

βN files2 copies/file

μ 1 2

2

1

3

31

What is the decay rate of the network?24

Page 55: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ModelXi(t) : number of files with i copies at time t.

(X0(t),X1(t),X2(t)): a transient Markov Process.

X0(t) +X1(t) +X2(t) = βN.

A unique absorbing state (βN,0,0).

(X0(t)) (X1(t)) (X2(t))

μx1 λN1x1>0

2μx2

2μ(βN− x0 − x1)

25

Page 56: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ModelXi(t) : number of files with i copies at time t.

(X0(t),X1(t),X2(t)): a transient Markov Process.

X0(t) +X1(t) +X2(t) = βN.

A unique absorbing state (βN,0,0).

(X0(t)) (X1(t)) (X2(t))

μx1 λN1x1>0

2μx2

2μ(βN− x0 − x1)

25

Page 57: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Different Behaviors

Three time scales:

t → t/N

t → t

t → Nt

Three regimes:

Overload: 2β > ρ = λ/μ,Critical load: 2β = ρ,Underload: 2β < ρ.

26

Page 58: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ t/N

(X0(t/N)) (X1(t/N)) (X2(t/N))

μx1

N

λ1x1>0

N(βN− x1 − x0)

27

Page 59: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ t/N

(L1(t)): an M/M/1 queue

¨

ergodic if 2β < ρ,

transient if 2β > ρ.

0 (L1(t)) ∼ Nβ

λ1x1>0

2μβ

No loss!

28

Page 60: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ t/N

(L1(t)): an M/M/1 queue

¨

ergodic if 2β < ρ,

transient if 2β > ρ.

0 (L1(t)) ∼ Nβ

λ1x1>0

2μβ

No loss!

28

Page 61: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ tOverloaded network

If 2β > ρ, (X0(t)/N,X1(t)/N,X2(t)/N) converges to adeterministic process (x0(t),x1(t),x2(t)).

λ2μ

β

t

x2(t) : 2 copiesx1(t) : 1 copyx0(t) : 0 copies

A fraction N(β− ρ/2) is lost!

29

Page 62: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ tOverloaded network

If 2β > ρ, (X0(t)/N,X1(t)/N,X2(t)/N) converges to adeterministic process (x0(t),x1(t),x2(t)).

λ2μ

β

t

x2(t) : 2 copiesx1(t) : 1 copyx0(t) : 0 copies

A fraction N(β− ρ/2) is lost!

29

Page 63: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ tUnderloaded network

If 2β < ρ, (X0(t)/N,X1(t)/N,X2(t)/N) converges to

x0(t) = 0,x1(t) = 0,x2(t) = β.

λ2μ

β

t

x2(t) : 2 copies

No significant loss!

30

Page 64: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time scale: t→ tUnderloaded network

If 2β < ρ, (X0(t)/N,X1(t)/N,X2(t)/N) converges to

x0(t) = 0,x1(t) = 0,x2(t) = β.

λ2μ

β

t

x2(t) : 2 copies

No significant loss!30

Page 65: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time Scale t→ Nt

limN→+∞

X0(Nt)

N

= Ψ(t),

where Ψ(t) is the unique solution of

Ψ(t) = μ

∫ t

0

2μ(β−Ψ(s))

λ− 2μ(β−Ψ(s))ds.

β

t0 copies

t→ Nt is the “correct” time scale to describedecay.

31

Page 66: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Time Scale t→ Nt

limN→+∞

X0(Nt)

N

= Ψ(t),

where Ψ(t) unique solution in (0, β) of

(1−Ψ(t)/β)ρ/2 eΨ(t)+t = 1.

β

t0 copies

t→ Nt is the “correct” time scale to describedecay.

31

Page 67: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Stochastic Averaging Phenomenon

∼ NΨ(t) X1,t(∞)

∼ N(β−Ψ(t))

Fast time scale: At “time” Nt,(X1(Nt+u/N),u ≥ 0): an M/M/1 with transition rates:

+1 at rate 2μ(β−Ψ(t))

−1 at rate λ.

32

Page 68: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

A Stochastic Averaging Phenomenon

∼ NΨ(t) X1,t(∞)

∼ N(β−Ψ(t))

Slow time scale: (X0(Nt)/N) “sees” only X1 at equi-librium:

Ψ(t)” = ”μ

∫ t

0E(X1,s(∞)) ds =

∫ t

0

2μ(β−Ψ(s))

λ− 2μ(β−Ψ(s))ds.

32

Page 69: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerStep 1 Radon measures: tightness of (μN) with

⟨μN,g⟩ =1

N

∫ Nt

0g

XN1 (s), s

ds

Step 2 Control of limits of (μN):

limN→∞

1

N

∫ Nt

0XN1 (s) ds = Ψ(t) =

∫ t

0⟨πs, I⟩ds

∫ t

0πs(N) ds = t

Here: Proof by stochastic dominationStep 3 Identification of πs with martingaletechniques and balance equations.

33

Page 70: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerStep 1 Radon measures: tightness of (μN) with

⟨μN,g⟩ =1

N

∫ Nt

0g

XN1 (s), s

ds

Step 2 Control of limits of (μN):

limN→∞

1

N

∫ Nt

0XN1 (s) ds = Ψ(t) =

∫ t

0⟨πs, I⟩ds

∫ t

0πs(N) ds = t

Here: Proof by stochastic dominationStep 3 Identification of πs with martingaletechniques and balance equations.

33

Page 71: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerStep 1 Radon measures: tightness of (μN) with

⟨μN,g⟩ =1

N

∫ Nt

0g

XN1 (s), s

ds

Step 2 Control of limits of (μN):

limN→∞

1

N

∫ Nt

0XN1 (s) ds = Ψ(t) =

∫ t

0⟨πs, I⟩ds

∫ t

0πs(N) ds = t

Here: Proof by stochastic domination

Step 3 Identification of πs with martingaletechniques and balance equations.

33

Page 72: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Technical CornerStep 1 Radon measures: tightness of (μN) with

⟨μN,g⟩ =1

N

∫ Nt

0g

XN1 (s), s

ds

Step 2 Control of limits of (μN):

limN→∞

1

N

∫ Nt

0XN1 (s) ds = Ψ(t) =

∫ t

0⟨πs, I⟩ds

∫ t

0πs(N) ds = t

Here: Proof by stochastic dominationStep 3 Identification of πs with martingaletechniques and balance equations.

33

Page 73: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Decay Rate of the Network

TN(δ) = inf¦

t ≥ 0 : XN0 (t) ≥ δβN©

Theorem:

limN→∞

TN(δ)

N= −

ρ

2log(1− δ)− δβ.

δ

TN

(δ)/N

34

Page 74: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conclusion

- Three different time scales

- A first example of stochastic averaging

- Asymptotics on a transitory property.

Extensions:- Number of copies: d > 2⇒ d− 1 times scales

- Decentralized back-up (mean-field)

Open problem:- Modeling a DHT: geometrical considerations

35

Page 75: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example 2:

The Law of the Jungle

Page 76: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Context

Congestion control:- Rate adjustment to limit packet loss- Retransmission of lost packets

No congestion control:- No rate adjustment- Sources send at their maximum rate- Coding to recover from packet loss

Does this bring congestion collapse?

37

Page 77: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Context

Congestion control:- Rate adjustment to limit packet loss- Retransmission of lost packets

No congestion control:- No rate adjustment- Sources send at their maximum rate- Coding to recover from packet loss

Does this bring congestion collapse?

37

Page 78: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Context

Congestion control:- Rate adjustment to limit packet loss- Retransmission of lost packets

No congestion control:- No rate adjustment- Sources send at their maximum rate- Coding to recover from packet loss

Does this bring congestion collapse?

37

Page 79: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Bandwidth Sharing Networks[Massoulié Roberts 00]

1

0

2

λ1

λ0

λ2μ1ϕ1

μ0ϕ0

μ2ϕ2

- A flow: a stream of packets

- Flows are considered as a fluid

- Users divided in classes/routes

- Poisson arrivals/Exponential sizes

- Resource allocation determined by congestionpolicy

38

Page 80: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Bandwidth Sharing Networks[Massoulié Roberts 00]

1

0

2

λ1

λ0

λ2μ1ϕ1

μ0ϕ0

μ2ϕ2

- A flow: a stream of packets

- Flows are considered as a fluid

- Users divided in classes/routes

- Poisson arrivals/Exponential sizes

- Resource allocation determined by congestionpolicy

38

Page 81: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Resource Allocation

Usually, α-fair policies are considered [MW00].

Here:- Sources send at their maximum rate (1 or a)- Tail dropping: At each link, output rates are

proportional to input rates

x1

x0

x2

ϕ1 = x1x0+x1

α = x0x0+x1

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

39

Page 82: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Resource Allocation

Usually, α-fair policies are considered [MW00].

Here:- Sources send at their maximum rate (1 or a)- Tail dropping: At each link, output rates are

proportional to input rates

x1

x0

x2

ϕ1 = x1x0+x1

α = x0x0+x1

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

39

Page 83: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Resource Allocation

Usually, α-fair policies are considered [MW00].

Here:- Sources send at their maximum rate (1 or a)- Tail dropping: At each link, output rates are

proportional to input rates

x1

x0

x2

ϕ1 = x1x0+x1

α = x0x0+x1

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

39

Page 84: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Resource Allocation

Usually, α-fair policies are considered [MW00].

Here:- Sources send at their maximum rate (1 or a)- Tail dropping: At each link, output rates are

proportional to input rates

x1

x0

x2

ϕ1 = x1x0+x1

α = x0x0+x1

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

39

Page 85: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Ergodicity Condition

1

0

2

Optimal ergodicity condition:

ρ0 + ρ1 < 1, ρ0 + ρ2 < 1

where ρi = λi/μi.

We know α-fair policies are optimal [BM02].

What about our policy?

40

Page 86: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Ergodicity Condition

1

0

2

Optimal ergodicity condition:

ρ0 + ρ1 < 1, ρ0 + ρ2 < 1

where ρi = λi/μi.

We know α-fair policies are optimal [BM02].

What about our policy?

40

Page 87: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Fluid Limits

x2

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

ϕ1 = x1x0+x1

α = x0x0+x1

x1

x0

If x2 0, class 2 uses virtually all the second link.If (z0(t), z1(t), z2(t)) is a fluid limit with z2(0) > 0,

z0(t) = λ0,

z1(t) = λ1 − μ1z1(t)

z0(t)+z1(t) ,

z2(t) = λ2 − μ2.

If ρ2 < 1, (z2(t)) reaches 0 in finite time.

41

Page 88: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Fluid Limits

x2

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

ϕ1 = x1x0+x1

α = x0x0+x1

x1

x0

If x2 0, class 2 uses virtually all the second link.If (z0(t), z1(t), z2(t)) is a fluid limit with z2(0) > 0,

z0(t) = λ0,

z1(t) = λ1 − μ1z1(t)

z0(t)+z1(t) ,

z2(t) = λ2 − μ2.

If ρ2 < 1, (z2(t)) reaches 0 in finite time.41

Page 89: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Fluid Limits

x2

ϕ0 = min

α, αx2a+α

ϕ2 = min

x2a,x2a

α+x2a

x1

x0

ϕ1 = x1x0+x1

α

Classes 0 and 1 are frozen:πα2 is the stationary distribution of class 2

Φ0(α) = Eπα2

Φ0

α,α

x2a+ α

.

42

Page 90: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Fluid LimitsWhen z2(t) = 0:

z0(t) = λ0 − μ0ϕ0

z0(t)

z0(t) + z1(t)

,

z1(t) = λ1 − μ1z1(t)

z0(t) + z1(t),

z2(t) = 0.

with

Φ0(α) = Eπα2

Φ0

α,α

x2a+ α

.

Stochastic averaging

43

Page 91: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Fluid LimitsWhen z2(t) = 0:

z0(t) = λ0 − μ0ϕ0

z0(t)

z0(t) + z1(t)

,

z1(t) = λ1 − μ1z1(t)

z0(t) + z1(t),

z2(t) = 0.

with

Φ0(α) = Eπα2

Φ0

α,α

x2a+ α

.

Stochastic averaging

43

Page 92: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Ergodicity ConditionsErgodicity conditions:

ρ1 < 1, ρ2 < 1,

ρ0 < ϕ0(1− ρ1)

Optimal conditions:

ρ1 < 1, ρ2 < 1,ρ0 < min(1− ρ1,1− ρ2)

But:ϕ0(1− ρ1) < min(1− ρ2,1− ρ1)

Not optimal!

44

Page 93: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Ergodicity ConditionsErgodicity conditions:

ρ1 < 1, ρ2 < 1,

ρ0 < ϕ0(1− ρ1)

Optimal conditions:

ρ1 < 1, ρ2 < 1,ρ0 < min(1− ρ1,1− ρ2)

But:ϕ0(1− ρ1) < min(1− ρ2,1− ρ1)

Not optimal!

44

Page 94: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Ergodicity ConditionsErgodicity conditions:

ρ1 < 1, ρ2 < 1,

ρ0 < ϕ0(1− ρ1)

Optimal conditions:

ρ1 < 1, ρ2 < 1,ρ0 < min(1− ρ1,1− ρ2)

But:ϕ0(1− ρ1) < min(1− ρ2,1− ρ1)

Not optimal!

44

Page 95: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Impact of Maximum Rate a

Class 1: ρ1

Cla

ss0

0

Optimala = 1a = 0.1a = 0.01

What happens when a→ 0 ?

45

Page 96: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Impact of Maximum Rate a

Class 1: ρ1

Cla

ss0

0

Optimala = 1a = 0.1a = 0.01

What happens when a→ 0 ?

45

Page 97: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate aWe freeze α and consider the process (XS2(t)) withQ-matrix:

q(x2,x2 + 1) = λ2,

q(x2,x2 − 1) = μ2 min

x2a,x2a

/S

α + x2a

/S

Time-scale: t 7→ St

(XS2(St)/S)⇒ (x2(t)) with

x2(t) = λ2 − μ2 min

ax2(t),x2(t)a

α + x2(t)a

Fixed point:

x2 =ρ2

amax

1,α

1− ρ2

46

Page 98: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate aWe freeze α and consider the process (XS2(t)) withQ-matrix:

q(x2,x2 + 1) = λ2,

q(x2,x2 − 1) = μ2 min

x2a

S,

x2a/S

α + x2a/S

Time-scale: t 7→ St

(XS2(St)/S)⇒ (x2(t)) with

x2(t) = λ2 − μ2 min

ax2(t),x2(t)a

α + x2(t)a

Fixed point:

x2 =ρ2

amax

1,α

1− ρ2

46

Page 99: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate aWe freeze α and consider the process (XS2(t)) withQ-matrix:

q(x2,x2 + 1) = λ2,

q(x2,x2 − 1) = μ2 min

x2a

S,

x2a/S

α + x2a/S

Time-scale: t 7→ St

(XS2(St)/S)⇒ (x2(t)) with

x2(t) = λ2 − μ2 min

ax2(t),x2(t)a

α + x2(t)a

Fixed point:

x2 =ρ2

amax

1,α

1− ρ2

46

Page 100: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate aWe freeze α and consider the process (XS2(t)) withQ-matrix:

q(x2,x2 + 1) = λ2,

q(x2,x2 − 1) = μ2 min

x2a

S,

x2a/S

α + x2a/S

Time-scale: t 7→ St

(XS2(St)/S)⇒ (x2(t)) with

x2(t) = λ2 − μ2 min

ax2(t),x2(t)a

α + x2(t)a

Fixed point:

x2 =ρ2

amax

1,α

1− ρ2

46

Page 101: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate a

(XS2

(St)/S)t→∞−−→ XS

2(∞)/S

S→∞

y

yS→∞

(x2(t)) −−→t→∞

x2(∞)

Convergence of processes⇓

Convergence of stationary distribution

lima→0

Φ0(1− ρ1) = min(1− ρ1,1− ρ2)

The policy is asymptotically optimal

47

Page 102: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate a

(XS2

(St)/S)t→∞−−→ XS

2(∞)/S

S→∞

y

yS→∞

(x2(t)) −−→t→∞

x2(∞)

Convergence of processes⇓

Convergence of stationary distribution

lima→0

Φ0(1− ρ1) = min(1− ρ1,1− ρ2)

The policy is asymptotically optimal

47

Page 103: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Scaling the Maximum Rate a

(XS2

(St)/S)t→∞−−→ XS

2(∞)/S

S→∞

y

yS→∞

(x2(t)) −−→t→∞

x2(∞)

Convergence of processes⇓

Convergence of stationary distribution

lima→0

Φ0(1− ρ1) = min(1− ρ1,1− ρ2)

The policy is asymptotically optimal47

Page 104: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conclusion- Analysis of equilibrium,

- Inversion of limits: scaling on stationarydistributions

- Impact of access rates

Extensions:- Linear networks with L links

- Second order scaling: speed of convergence.

- Upstream trees

Open problem:- General acyclic networks

48

Page 105: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Example 3:

Flow-Aware CSMA

Page 106: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ModelThe network is represented by a conflict graph

1 2 3

wireless link potential interference

For each node i:- Xi(t) ∈ N: number of flows at time t- Yi(t) = 1 if node is active at time t, 0 otherwise.

50

Page 107: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ModelThe network is represented by a conflict graph

1 2 3

wireless link

potential interference

For each node i:- Xi(t) ∈ N: number of flows at time t- Yi(t) = 1 if node is active at time t, 0 otherwise.

50

Page 108: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

ModelThe network is represented by a conflict graph

1 2 3

wireless link potential interference

For each node i:- Xi(t) ∈ N: number of flows at time t- Yi(t) = 1 if node is active at time t, 0 otherwise.

50

Page 109: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1 μ2 μ3

1 2 3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 110: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1 μ2 μ3

1 2 3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 111: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1

μ2 μ3

1

2 3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 112: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1

μ2

μ3

1

2

3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 113: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1 μ2

μ3

1 2

3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 114: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1

μ2

μ3

1

2

3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 115: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1 μ2 μ3

1 2 3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedules

In this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 116: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1 μ2 μ3

1 2 3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 117: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conflict Graph

1 2 3

λ1 λ2 λ3

μ1 μ2 μ3

1 2 3

Schedules: ∅, 1, 2, 3, 1,3.

Optimal stability region: convex hull of schedulesIn this example: ρ1 + ρ2 ≤ 1, ρ2 + ρ3 ≤ 1with ρi = λi/μi

Stability region?

51

Page 118: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Standard CSMA

∼ exp(α)

Back-off∼ exp(1)

Transmission∼ exp(α)

Back-off

Optimal?

1 2 3

ρ1 ρ2 ρ3

0 0.5 10

0.5

1

ρ1 = ρ3

ρ2

OptimalActual

52

Page 119: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Standard CSMA

∼ exp(α)

Back-off∼ exp(1)

Transmission∼ exp(α)

Back-off

Optimal?

1 2 3

ρ1 ρ2 ρ3

0 0.5 10

0.5

1

ρ1 = ρ3

ρ2

OptimalActual

52

Page 120: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Standard CSMA

∼ exp(α)

Back-off∼ exp(1)

Transmission∼ exp(α)

Back-off

Optimal?

1 2 3

ρ1 ρ2 ρ3

0 0.5 10

0.5

1

ρ1 = ρ3

ρ2

OptimalActual

52

Page 121: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Flow-Aware CSMAProposed modification of CSMA:

Exponential backoff time for each flow

∼ exp(αx1)

Back-off∼ exp(1)

Transmission∼ exp(αx1)

Back-off

The process (X(t),Y(t)) is difficult to analyze:

Idea: Separate network dynamics and flowdynamics.When N→∞, (YN(t)): classical loss network.

Stochastic averaging

53

Page 122: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Flow-Aware CSMAProposed modification of CSMA:

Exponential backoff time for each flow

∼ exp(αx1)

Back-off∼ exp(1)

Transmission∼ exp(αx1)

Back-off

The process (X(t),Y(t)) is difficult to analyze:

Idea: Separate network dynamics and flowdynamics.When N→∞, (YN(t)): classical loss network.

Stochastic averaging

53

Page 123: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Flow-Aware CSMAProposed modification of CSMA:

Exponential backoff time for each flow

∼ exp(αNx1)

Back-off∼ exp(N)

Transmission∼ exp(αNx1)

Back-off

The process (XN(t),YN(t)) is difficult to analyze:

Idea: Separate network dynamics and flowdynamics.When N→∞, (YN(t)): classical loss network.

Stochastic averaging

53

Page 124: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Flow-Aware CSMAProposed modification of CSMA:

Exponential backoff time for each flow

∼ exp(αNx1)

Back-off∼ exp(N)

Transmission∼ exp(αNx1)

Back-off

The process (XN(t),YN(t)) is difficult to analyze:

Idea: Separate network dynamics and flowdynamics.When N→∞, (YN(t)): classical loss network.

Stochastic averaging

53

Page 125: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Optimality of Flow-Aware CSMA

Theorem:Flow-aware CSMA algorithm is optimal for anynetwork.

Sketch of proof:- Asymptotically behaves as Max-Weight.

- Deduce a Lyapunov function and applyFoster’s criterion.

54

Page 126: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Conclusion

- An optimal and fully distributed channelaccess mechanism

- Limiting process: jump process

- Simplification of the problem

Extension:- Multi-channel

Open problem:- Initial problem still open

55

Page 127: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

General ConclusionThree examples:

- Capacity of an unreliable file system

- Law of the Jungle

- Flow-Aware CSMA

Mathematical tools:- Several examples of scalings

- A simpler proof for stochastic averaging

and. . .- Scalings: A set of powerful tools

- Stochastic averaging: a not so rarephenomenon

Many interesting open questions. . .

56

Page 128: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

General ConclusionThree examples:

- Capacity of an unreliable file system

- Law of the Jungle

- Flow-Aware CSMA

Mathematical tools:- Several examples of scalings

- A simpler proof for stochastic averaging

and. . .- Scalings: A set of powerful tools

- Stochastic averaging: a not so rarephenomenon

Many interesting open questions. . .

56

Page 129: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

General ConclusionThree examples:

- Capacity of an unreliable file system

- Law of the Jungle

- Flow-Aware CSMA

Mathematical tools:- Several examples of scalings

- A simpler proof for stochastic averaging

and. . .- Scalings: A set of powerful tools

- Stochastic averaging: a not so rarephenomenon

Many interesting open questions. . .

56

Page 130: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

General ConclusionThree examples:

- Capacity of an unreliable file system

- Law of the Jungle

- Flow-Aware CSMA

Mathematical tools:- Several examples of scalings

- A simpler proof for stochastic averaging

and. . .- Scalings: A set of powerful tools

- Stochastic averaging: a not so rarephenomenon

Many interesting open questions. . . 56

Page 131: Bandwidth Allocation in Large Stochastic Networksmathieu.feuillet.pro/slides/Feuillet-soutenance.pdfStochastic averaging Examples Unreliable File System The Law of the Jungle Flow-Aware

Thank you!