Distributed Operating Systems: Theoretical...

Department of Computer Science, The University of Texas at Dallas CS 6378: Advanced Operating Systems – Chapter 5: Theoretical Foundations Slide 1/44

Distributed Operating Systems:Theoretical Foundations

Neeraj Mittal

Department of Computer Science

The University of Texas at Dallas

neerajm@utdallas.edu

Inherent Limitations

❖ Two Important Characteristics

❖ Absence of Global Clock

❖ Absence of Shared Memory

Ordering of Events

Abstract Clocks

Ordering of Messages

State of a Distributed System

Monitoring a Distributed

System

Two Important Characteristics

■ Absence of Global Clock◆ there is no common notion of time

■ Absence of Shared Memory◆ no process has up-to-date knowledge about the system

Ordering of Events

Abstract Clocks

System

Two Important Characteristics

■ Absence of Global Clock◆ there is no common notion of time

■ Absence of Shared Memory◆ no process has up-to-date knowledge about the system

Ordering of Events

Abstract Clocks

System

Absence of Global Clock

■ Different processes may have different notions of time

I invented AIDS cure!

Who did it first?

Patent Officer

Earth Mars

Problem: How do we order events on different processes?

Ordering of Events

Abstract Clocks

System

I invented AIDS cure!I invented AIDS cure!

Earth Mars

Who did it first?

Patent Officer

Earth Mars

Ordering of Events

Abstract Clocks

System

Who did it first?

Patent Officer

Earth Mars

Ordering of Events

Abstract Clocks

System

Who did it first?

Patent Officer

Earth Mars

Ordering of Events

Abstract Clocks

System

Absence of Shared Memory

■ A process does not know current state of other processes

What is Harry doingat present?

Problem: How do we obtain a coherent view of the system?

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

❖ When is it possible to order

two events?❖ Happened-Before Relation

❖ Concurrent Events

Abstract Clocks

System

When is it possible to order two events?

Three cases:

1. Events executed on the same process:

■ if e and f are events on the same process and e

occurred before f , then e happened-before f

2. Communication events of the same message:■ if e is the send event of a message and f is the receive

event of the same message, then e happened-before f

3. Events related by transitivity:■ if event e happened-before event g and event g

happened-before event f , then e happened-before f

Ordering of Events

Abstract Clocks

System

Three cases:

1. Events executed on the same process:■ if e and f are events on the same process and e

Ordering of Events

Abstract Clocks

System

Three cases:

2. Communication events of the same message:

■ if e is the send event of a message and f is the receiveevent of the same message, then e happened-before f

Ordering of Events

Abstract Clocks

System

Three cases:

Ordering of Events

Abstract Clocks

System

Three cases:

3. Events related by transitivity:

■ if event e happened-before event g and event g

Ordering of Events

Abstract Clocks

System

Three cases:

Ordering of Events

Abstract Clocks

System

Happened-Before Relation

■ Happened-before relation is denoted by →

■ Illustration:

d e fP2

◆ Events on the same process:examples: a → b, a → c, d → f

◆ Events of the same message:examples: b → e, f → i

◆ Transitivity:examples: a → e, a → i, e → i

Ordering of Events

Abstract Clocks

System

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

Concurrent Events

■ Events not related by happened-before relation

■ Concurrency relation is denoted by ‖

■ Illustration:

d e fP2

◆ Examples: a ‖ d, d ‖ h, c ‖ e

■ Concurrency relation is not transitive:example: a ‖ d and d ‖ c but a ∦ c

Ordering of Events

Abstract Clocks

System

Concurrent Events

■ Events not related by happened-before relation■ Concurrency relation is denoted by ‖

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

Concurrent Events

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

Concurrent Events

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

System

Concurrent Events

■ Illustration:

d e fP2

Ordering of Events

Abstract Clocks

❖ Different Kinds of Clocks

❖ Logical Clock

❖ Implementing Logical Clock

❖ Implementing Logical Clock:

An Illustration❖ Limitation of Logical Clock

❖ Vector Clock

❖ Comparing Two Vectors

❖ Implementing Vector Clock

❖ Implementing Vector Clock:

An Illustration❖ Properties of Vector Clock

System

Different Kinds of Clocks

■ Logical Clocks◆ used to totally order all events

■ Vector Clocks◆ used to track happened-before relation

■ Matrix Clocks◆ used to track what other processes know about other

processes

■ Direct Dependency Clocks◆ used to track direct causal dependencies

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

processes

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

processes

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

processes

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Logical Clock

■ Implements the notion of virtual time

■ Can be used to totally order all events

■ Assigns timestamp to each event in a way that isconsistent with the happened-before relation:

e → f ⇒ C(e) < C(f)

C(e): timestamp for event e

C(f): timestamp for event f

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Logical Clock

e → f ⇒ C(e) < C(f)

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Logical Clock

e → f ⇒ C(e) < C(f)

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Implementing Logical Clock

■ Each process has a local scalar clock, initialized to zero◆ Ci denotes the local clock of process Pi

■ Action depends on the type of the event:

■ Protocol for process Pi:

◆ On executing an interval event:Ci := Ci + 1

◆ On sending a message m:Ci := Ci + 1piggyback Ci on m

◆ On receiving a message m:let tm be the timestamp piggybacked on m

Ci := max{Ci, tm} + 1

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Implementing Logical Clock: An Illustration

a: internal event C(a) = 1

1 2 3 4

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

b and c: internal events C(b) = 1 and C(c) = 1

1 2 3 4

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

d: send event C(d) = 2

1 2 3 4

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e: receive event C(e) = 3

1 2 3 4

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

1 2 3 4

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Limitation of Logical Clock

■ Logical clock cannot be used to determine whether twoevents are concurrent

e ‖ f does not imply C(e) = C(f)

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Limitation of Logical Clock

■ Logical clock cannot be used to determine whether twoevents are concurrent

e ‖ f does not imply C(e) = C(f)

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Vector Clock

■ Captures the happened-before relation

■ Assigns timestamp to each event such that:

e → f ⇐⇒ C(e) < C(f)

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Vector Clock

■ Captures the happened-before relation

■ Assigns timestamp to each event such that:

e → f ⇐⇒ C(e) < C(f)

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Comparing Two Vectors

■ Vectors are compared component-wise:

◆ Equality:

V = V ′ iff 〈∀i : V [i] = V ′[i]〉

◆ Less Than:

V < V ′ iff 〈∀i : V [i] ≤ V ′[i]〉 ∧ 〈∃i : V [i] < V ′[i]〉

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

◆ Equality:

V = V ′ iff 〈∀i : V [i] = V ′[i]〉

◆ Less Than:

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

◆ Equality:

V = V ′ iff 〈∀i : V [i] = V ′[i]〉

◆ Less Than:

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

◆ Equality:

V = V ′ iff 〈∀i : V [i] = V ′[i]〉

◆ Less Than:

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Implementing Vector Clock

■ Each process has a local vector clock◆ Ci denotes the local clock of process Pi

◆ On executing an interval event:Ci[i] := Ci[i] + 1

◆ On sending a message m:Ci[i] := Ci[i] + 1piggyback Ci on m

∀k Ci[k] := max{Ci[k], tm[k]}Ci[i] := Ci[i] + 1

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Implementing Vector Clock: An Illustration

a: internal event C(a) =

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

b and c: internal events C(b) =

and C(c) =

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

d: send event C(d) =

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e: receive event C(e) =

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

Properties of Vector Clock

■ How many comparisons are needed to determine whetheran event e happened-before another event f?

◆ As many as N integers may need to be compared in theworst case, where N is the number of processes

◆ Suppose e and f occurred on processes Pi and Pj

e → f

if and only if

(i = j) ∧ (C(e)[i] < C(f)[i])∨

(i 6= j) ∧ (C(e)[i] ≤ C(f)[i])

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e → f

if and only if

(i = j) ∧ (C(e)[i] < C(f)[i])∨

(i 6= j) ∧ (C(e)[i] ≤ C(f)[i])

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e → f

if and only if

(i = j) ∧ (C(e)[i] < C(f)[i])∨

(i 6= j) ∧ (C(e)[i] ≤ C(f)[i])

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e → f

if and only if

(i = j) ∧ (C(e)[i] < C(f)[i])∨

(i 6= j) ∧ (C(e)[i] ≤ C(f)[i])

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e → f

if and only if

(i = j) ∧ (C(e)[i] < C(f)[i])

(i 6= j) ∧ (C(e)[i] ≤ C(f)[i])

Ordering of Events

Abstract Clocks

❖ Logical Clock

❖ Vector Clock

System

e → f

if and only if

(i = j) ∧ (C(e)[i] < C(f)[i])∨

(i 6= j) ∧ (C(e)[i] ≤ C(f)[i])

Ordering of Events

Abstract Clocks

❖ Ordering of Messages

❖ Useful Notations

❖ Causal Delivery of Messages

❖ A Causally Ordered Delivery

Protocol❖ The BSS Protocol

❖ The BSS Protocol: An

Illustration❖ Another Causally Ordered

Delivery Protocol❖ When to Deliver a Message?

❖ The SES Protocol

❖ The SES Protocol (Continued)

❖ The SES Protocol: An

Illustration

System

■ For many applications, messages should be delivered incertain order to be interpreted meaningfully

■ Example:

m1: Have you seen the movie “Shrek”?

m2: Yes I have and I liked it

◆ m2 cannot be interpreted until m1 has been received◆ Tom receives m2 before m1: an undesriable behavior

Ordering of Events

Abstract Clocks

Illustration

System

■ For many applications, messages should be delivered incertain order to be interpreted meaningfully

■ Example:

m1: Have you seen the movie “Shrek”?

m2: Yes I have and I liked it

◆ m2 cannot be interpreted until m1 has been received◆ Tom receives m2 before m1: an undesriable behavior

Ordering of Events

Abstract Clocks

Illustration

System

Useful Notations

■ For a message m:◆ src(m): source process of m

◆ dst(m): destination process of m

◆ snd(m): send event of m

◆ rcv(m): send event of m

dst(m)

rcv(m)

snd(m)src(m)

Ordering of Events

Abstract Clocks

Illustration

System

Causal Delivery of Messages

■ A message w causally precedes a message m ifsnd(w) → snd(m)

■ An execution of a distributed system is said to be causallyordered if the following holds for every message m:

every message that causally precedes m and isdestined for the same process as m is deliveredbefore m

Mathematically, for every message w:

(snd(w) → snd(m)) ∧ (dst(w) = dst(m))

rcv(w) → rcv(m)

Ordering of Events

Abstract Clocks

Illustration

System

rcv(w) → rcv(m)

Ordering of Events

Abstract Clocks

Illustration

System

rcv(w) → rcv(m)

Ordering of Events

Abstract Clocks

Illustration

System

A Causally Ordered Delivery Protocol

■ Proposed by Birman, Schiper and Stephenson (BSS)

■ Assumption:

◆ communication is broadcast based: a process sends amessage to every other process

■ Each process maintains a vector with one entry for eachprocess:

◆ let Vi denote the vector for process Pi

◆ the jth entry of Vi refers to the number of messages thathave been broadcast by process Pj that Pi knows of

Ordering of Events

Abstract Clocks

Illustration

System

■ Assumption:

Ordering of Events

Abstract Clocks

Illustration

System

■ Assumption:

Ordering of Events

Abstract Clocks

Illustration

System

The BSS Protocol

◆ On broadcasting a message m:piggyback Vi on m

Vi[i] := Vi[i] + 1

◆ On arrival of a message m from process Pj :let Vm be the vector piggybacked on m

deliver m once Vi ≥ Vm

◆ On delivery of a message m sent by process Pj :

Vi[j] := Vi[j] + 1

Ordering of Events

Abstract Clocks

Illustration

System

The BSS Protocol

Vi[i] := Vi[i] + 1

Vi[j] := Vi[j] + 1

Ordering of Events

Abstract Clocks

Illustration

System

The BSS Protocol

Vi[i] := Vi[i] + 1

Vi[j] := Vi[j] + 1

Ordering of Events

Abstract Clocks

Illustration

System

The BSS Protocol

Vi[i] := Vi[i] + 1

Vi[j] := Vi[j] + 1

Ordering of Events

Abstract Clocks

Illustration

System

The BSS Protocol: An Illustration

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Ordering of Events

Abstract Clocks

Illustration

System

Another Causally Ordered Delivery Protocol

■ Proposed by Schiper, Eggli and Sandoz (SES)

■ Assumption:

◆ communication is point-to-point◆ processes are using vector clock algorithm

■ To determine whether a message has arrived out of causalorder:

◆ let Vm denote the vector timestamp of message m

◆ let Vi denote the vector clock of process Pi

Does there exist a message w that causallyprecedes m and destined for Pi such that Vi 6> Vw?

Ordering of Events

Abstract Clocks

Illustration

System

■ Assumption:

Ordering of Events

Abstract Clocks

Illustration

System

■ Assumption:

Ordering of Events

Abstract Clocks

Illustration

System

■ Assumption:

Ordering of Events

Abstract Clocks

Illustration

System

■ Assumption:

Ordering of Events

Abstract Clocks

Illustration

System

When to Deliver a Message?

■ A message m destined for process Pi can be delivered if:

◆ for every message w that causally precedes m anddestined for Pi:

Vi > Vw

or, equivalently

◆ let past(m, j) denote the set of all messages thatcausally precede m and are destined for process Pj :

Vi > maxw∈past(m,i)

Ordering of Events

Abstract Clocks

Illustration

System

Vi > Vw

or, equivalently

Ordering of Events

Abstract Clocks

Illustration

System

Vi > Vw

or, equivalently

Ordering of Events

Abstract Clocks

Illustration

System

Vi > Vw

or, equivalently

Ordering of Events

Abstract Clocks

Illustration

System

The SES Protocol

■ Each process maintains a list of tuples with at most onetuple for every other process

◆ let DLi denote the list for process Pi

■ The list is piggybacked on every message a process sends

◆ let DLm denote the list for message m

■ if past(m, j) = ∅, then DLm does not contain a tuplefor process Pj

■ Otherwise, the tuple for process Pj is given by:

(j, maxw∈past(m,j)

Ordering of Events

Abstract Clocks

Illustration

System

The SES Protocol

Ordering of Events

Abstract Clocks

Illustration

System

The SES Protocol

Ordering of Events

Abstract Clocks

Illustration

System

The SES Protocol

Ordering of Events

Abstract Clocks

Illustration

System

The SES Protocol (Continued)

◆ On sending a message m to process Pj :piggyback DLi on m

remove entry for Pj from DLi, if anyadd (j, Vm) to DLi

◆ On arrival of a message m from process Pj :if DLm does not contain any tuple for Pi then

deliver m

elselet (j, V ) be the tuple for Pi in DLm

deliver m once Vi > V

◆ On delivery of a message m:merge DLi and DLm

Ordering of Events

Abstract Clocks

Illustration

System

deliver m

Ordering of Events

Abstract Clocks

Illustration

System

deliver m

Ordering of Events

Abstract Clocks

Illustration

System

deliver m

Ordering of Events

Abstract Clocks

Illustration

System

The SES Protocol: An Illustration

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

Illustration

System

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

Illustration

System

)}{(3,

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

Illustration

System

)}{(3,

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

Illustration

System

), (2,

] {(3,

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

Illustration

System

), (2,

] {(3,

{} {}[

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

Illustration

System

), (2,

)}{(3,

{} {}[

Ordering of Events

Abstract Clocks

❖ State of a Distributed System

❖ Events and Local States

❖ When is a Global State

Meaningful?❖ Revisiting Happened-Before

Relation❖ A Consistent Global State

❖ Recording a Consistent

Global Snapshot❖ The CL Protocol

❖ The CL Protocol (Continued)

❖ The CL Protocol: An

Illustration❖ The CL Protocol: An

Illustration (Continued)

System

■ State of a distributed system is a collection of states of allits processes and channels:

◆ a process state is given by the values of all variables onthe process

◆ a channel state is given by the set of messages in transitin the channel

■ can be determined by examining states of the twoprocesses it connects

■ State of a process is called local state or local snapshot

◆ the textbook refers to local state as cut event

◆ cut event is not same as event

■ State of a distributed system is called global state or globalsnapshot

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Events and Local States

■ Processes change their states by executing events

■ Example:

y = 3y = 2y = 1

x = 0 x = 2 x = 3

◆ Process P1 changes its state from x = 0 to x = 2 onexecuting event a

◆ Process P2 changes its state from y = 2 to y = 3 onexecuting event d

Ordering of Events

Abstract Clocks

System

■ Example:

y = 3y = 2y = 1

x = 0 x = 2 x = 3

Ordering of Events

Abstract Clocks

System

■ Example:

y = 3y = 2y = 1

x = 0 x = 2 x = 3

Ordering of Events

Abstract Clocks

System

■ Example:

y = 3y = 2y = 1

x = 0 x = 2 x = 3

Ordering of Events

Abstract Clocks

System

When is a Global State Meaningful?

■ Example:

y = 3y = 2y = 1

x = 0 x = 2 x = 3

◆ Is it possible for x to be 0 and y to be 3 at the same time?

◆ Does {s, x} form a meaningful global state?

Ordering of Events

Abstract Clocks

System

■ Example:

y = 3y = 2y = 1

x = 0 x = 2 x = 3

Ordering of Events

Abstract Clocks

System

■ Example:

y = 3y = 2y = 1

a bs t u

dc xwv

x = 0 x = 2 x = 3

Ordering of Events

Abstract Clocks

System

Revisiting Happened-Before Relation

■ Typically, happened-before relation is defined on events

■ The relation can be extended to local states as follows:

◆ let s be a local state of process Pi

◆ let t be a local state of process Pj

◆ s → t if there exist events e and f such that:1. Pi executed e after s,

2. Pj executed f before t, and

3. e → f

Ordering of Events

Abstract Clocks

System

3. e → f

Ordering of Events

Abstract Clocks

System

3. e → f

Ordering of Events

Abstract Clocks

System

3. e → f

Ordering of Events

Abstract Clocks

System

◆ s → t if there exist events e and f such that:

1. Pi executed e after s,

3. e → f

Ordering of Events

Abstract Clocks

System

3. e → f

Ordering of Events

Abstract Clocks

System

3. e → f

Ordering of Events

Abstract Clocks

System

3. e → f

Ordering of Events

Abstract Clocks

System

A Consistent Global State

■ For a global state G, let G[i] refer to the local state ofprocess Pi in G

■ A global state G is meaningful or consistent if

∀i, j : i 6= j : G[i] ‖ G[j]

Ordering of Events

Abstract Clocks

System

∀i, j : i 6= j : (G[i] 9 G[j]) ∧ (G[j] 9 G[i])

∀i, j : i 6= j : G[i] ‖ G[j]

Ordering of Events

Abstract Clocks

System

∀i, j : i 6= j : G[i] ‖ G[j]

Ordering of Events

Abstract Clocks

System

Recording a Consistent Global Snapshot

■ Proposed by Chandy and Lamport (CL)

■ Assumptions and Features:

◆ channels satisfy first-in-first-out (FIFO) property◆ channels are not required to be bidirectional◆ communication topology may not be fully connected

■ Messages exchanged by the underlying computation(whose snapshot is being recorded) are called applicationmessages

■ Messages exchanged by the snapshot algorithm are calledcontrol messages

Ordering of Events

Abstract Clocks

System

◆ channels satisfy first-in-first-out (FIFO) property

◆ channels are not required to be bidirectional◆ communication topology may not be fully connected

Ordering of Events

Abstract Clocks

System

◆ channels satisfy first-in-first-out (FIFO) property◆ channels are not required to be bidirectional

◆ communication topology may not be fully connected

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

The CL Protocol

■ Initially: all processes are colored blue

■ Eventually: all processes become red

■ On changing color from blue to red:record local snapshotsend a marker message along all outgoing channels

■ On receiving marker message along incoming channel C:if color is blue then

change color from blue to redendifrecord state of channel C as application messages

received along C since turning red

■ Any process can initiate the snapshot protocol byspontaneously changing its color from blue to red◆ there can be multiple initiators of the snapshot protocol

Ordering of Events

Abstract Clocks

System

The CL Protocol

Ordering of Events

Abstract Clocks

System

The CL Protocol

Ordering of Events

Abstract Clocks

System

The CL Protocol

Ordering of Events

Abstract Clocks

System

The CL Protocol

■ Any process can initiate the snapshot protocol byspontaneously changing its color from blue to red

◆ there can be multiple initiators of the snapshot protocol

Ordering of Events

Abstract Clocks

System

The CL Protocol

Ordering of Events

Abstract Clocks

System

The CL Protocol (Continued)

■ Global Snapshot: local snapshots of processes just afterthey turn red

■ In-Transit Messages: blue application messages receivedby processes after they have turned red

■ Why is the global snapshot consistent?◆ Assume an application message has the same color as

its sender◆ Can a blue process receive a red application message?

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

■ Why is the global snapshot consistent?

◆ Assume an application message has the same color asits sender

◆ Can a blue process receive a red application message?

Ordering of Events

Abstract Clocks

System

its sender

◆ Can a blue process receive a red application message?

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

The CL Protocol: An Illustration

■ Three processes: P1, P2 and P3

■ Five channels: C1,2, C1,3, C2,1, C2,3 and C3,1

Ordering of Events

Abstract Clocks

System

The CL Protocol: An Illustration (Continued)

1. All processes are blue

1. P1 receives the marker message along C3,1

2. P1 records the state of C3,1 as {m2, m3}

Ordering of Events

Abstract Clocks

System

1. P1 turns red2. P1 sends a marker message along C1,2 and C1,3

Ordering of Events

Abstract Clocks

System

1. P2 receives the marker message along C1,2 and turns red2. P2 sends a marker message along C2,1 and C2,3

3. P2 records the state of C1,2 as ∅

Ordering of Events

Abstract Clocks

System

1. P3 receives the marker message along C1,3 and turns red2. P3 sends a marker message along C3,1

3. P3 records the state of C1,3 as ∅

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

2. P3 records the state of C2,3 as {m1}

Ordering of Events

Abstract Clocks

System

Ordering of Events

Abstract Clocks

System

❖ A Subclass of Distributed

Computation❖ Distributed Computation: An

Illustration❖ Termination Detection

❖ Huang’s Algorithm

(Continued)❖ Huang’s Algorithm: An

Illustration

A Subclass of Distributed Computation

■ Many distributed computations obey the followingparadigm:

◆ A process is either in active state or passive state◆ A process can send an application message only when

it is active◆ An active process can become passive at any time◆ A passive process, on receiving an application

message, becomes active

■ Intuitively:

◆ if a process is active, then it is doing some work◆ if process is passive, then it is idle◆ an active process uses an application message to send

a part of its work to another process

Ordering of Events

Abstract Clocks

System

Illustration

◆ A process is either in active state or passive state

◆ A process can send an application message only whenit is active

◆ An active process can become passive at any time◆ A passive process, on receiving an application

■ Intuitively:

Ordering of Events

Abstract Clocks

System

Illustration

it is active

◆ An active process can become passive at any time◆ A passive process, on receiving an application

■ Intuitively:

Ordering of Events

Abstract Clocks

System

Illustration

it is active◆ An active process can become passive at any time

◆ A passive process, on receiving an applicationmessage, becomes active

■ Intuitively:

Ordering of Events

Abstract Clocks

System

Illustration

■ Intuitively:

Ordering of Events

Abstract Clocks

System

Illustration

■ Intuitively:

Ordering of Events

Abstract Clocks

System

Illustration

■ Intuitively:

◆ if a process is active, then it is doing some work

◆ if process is passive, then it is idle◆ an active process uses an application message to send

Ordering of Events

Abstract Clocks

System

Illustration

■ Intuitively:

◆ if a process is active, then it is doing some work◆ if process is passive, then it is idle

◆ an active process uses an application message to senda part of its work to another process

Ordering of Events

Abstract Clocks

System

Illustration

■ Intuitively:

Ordering of Events

Abstract Clocks

System

Illustration

Distributed Computation: An Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

Termination Detection

■ To detect if the computation has finished doing all the work

◆ all processes have become passive, and◆ all channels have become empty

■ Different types of computations:

◆ diffusing: only one process is active in the beginning◆ non-diffusing: any subset of processes can be active in

the beginning■ no process knows which processes are active and

which processes are passive

Ordering of Events

Abstract Clocks

System

Illustration

◆ all processes have become passive, and

◆ all channels have become empty

Ordering of Events

Abstract Clocks

System

Illustration

Ordering of Events

Abstract Clocks

System

Illustration

Ordering of Events

Abstract Clocks

System

Illustration

◆ diffusing: only one process is active in the beginning

◆ non-diffusing: any subset of processes can be active inthe beginning■ no process knows which processes are active and

Ordering of Events

Abstract Clocks

System

Illustration

the beginning

■ no process knows which processes are active andwhich processes are passive

Ordering of Events

Abstract Clocks

System

Illustration

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Assumption: computation is diffusing

◆ the initially active process is called the coordinator■ coordinator is responsible for detecting termination

■ Initially:

◆ coordinator has a weight of 1◆ all other processes have a weight of 0

■ Invariants:

◆ total amount of weight in the system is 1◆ a non-coordinator process has a non-zero weight if and

only if it is active◆ a channel has a non-zero weight if and only if it is

non-empty■ weight of a channel is the sum of the weight of all its

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

◆ the initially active process is called the coordinator

■ coordinator is responsible for detecting termination

■ Initially:

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

◆ coordinator has a weight of 1

◆ all other processes have a weight of 0

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

◆ total amount of weight in the system is 1

◆ a non-coordinator process has a non-zero weight if andonly if it is active

◆ a channel has a non-zero weight if and only if it isnon-empty■ weight of a channel is the sum of the weight of all its

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

only if it is active

◆ a channel has a non-zero weight if and only if it isnon-empty■ weight of a channel is the sum of the weight of all its

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

non-empty

■ weight of a channel is the sum of the weight of all itsmessages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm

■ Initially:

■ Invariants:

messages

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm (Continued)

■ Actions:

◆ On sending an application message:■ send half of its weight along with the message

◆ On receiving an application message:■ add the weight of the message to the current weight

◆ On becoming passive:■ send the current weight to the coodrinator

■ Coordinator announces termination once:

◆ it has become passive and◆ it has collected all the weight

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

◆ On sending an application message:

■ send half of its weight along with the message

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

◆ On receiving an application message:

■ add the weight of the message to the current weight

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

◆ On becoming passive:

■ send the current weight to the coodrinator

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

◆ it has become passive and

◆ it has collected all the weight

Ordering of Events

Abstract Clocks

System

Illustration

■ Actions:

Ordering of Events

Abstract Clocks

System

Illustration

Huang’s Algorithm: An Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Ordering of Events

Abstract Clocks

System

Illustration

��

Distributed Operating Systems: Theoretical...

Documents

SCCENROL NO NAME OPT1 OPT2 OPT3 P1 R1 P2 …SCCENROL NO NAME OPT1 OPT2 OPT3 P1 R1 P2 R2 P3 R3 P4 R4 P5 R5 P6 R6 A1 R7 A2 R8 A3 R9 A4 R10 A5 R11 A6 R12 THRYASN AGR RESULT WORDS 001

Fibres optiques - xhinfray.free.frxhinfray.free.fr/A2/phyond/Opt3 Fibres Optiques.pdf · Progression de la fibre Une seule fibre optique peut transmettre autant d'information qu'un

Shape Optimization for Conforming Airfoilsdnc.tamu.edu/projects/flowcontrol/Morphing/public_html/papers/opt3.pdf · February 7, 2003 15:51 SHAPE OPTIMIZATION FOR CONFORMING AIRFOILS

ms.npglobal.inms.npglobal.in/tcil/opt3/pdf/print-media-coverages/2015/tci-on... · 2015 SUPPLYCHAI 2015 SUPPLYCHAI Nepal disaster challenges for The rescue operations carried out

EE 382N Guest Lecture Wish Branches

B.A I YEAR RESULT JAN - 2016 OPT1 OPT2 OPT3 ENG R1 SL R2 ... I YEAR RESULT 2016 WEB.pdf · b.a i year result jan - 2016 scc enrol no name opt1 opt2 opt3 eng r1 sl r2 opt1 r3 opt2

Distributed Systems Course Distributed transactions

users.ece.utexas.eduusers.ece.utexas.edu/~patt/14s.382N/handouts/spring2006.pdfWe are designing compilers for both a 3-wide VLIW processor and a Pentium Pro 3-wide issue machine. Assume

Distributed Database: Part 2. Distributed DBMS Distributed database requires distributed DBMS Distributed database requires distributed DBMS Functions

Business Standard - ms.npglobal.inms.npglobal.in/tcil/opt3/pdf/print-media-coverages/2014/india's... · Business Standard India\'s delivery men offer prize investment as billions

tb308 DMI TranscutaneousJaundice Opt3 v7 DeltaMed · tratamiento. El medidor de ictericia Delta Medical se puede utilizar para reducir este riesgo, mediante la detección de signos

Yale N. Patt The University of Texas at Austinusers.ece.utexas.edu/~patt/20s.382N/handouts/class...Yale N. Patt The University of Texas at Austin First presented: August 16, 2019 Abstract

HBXF / .SNXF RC Reduction Options HSPICE - Synopsys · Options.OPTION opt1 [opt2 opt3 …] opt1 opt2 … Specify an input control option. General Options ALTCC=n Enables reading

EE 382N Microarchitecture Yale Patt, instructor Eiman Ebrahimi, Khubaib, TAs

Distributed Distributed Systemscs.brown.edu/courses/csci1380/s20/lectures/L22_2020.pdf · 2020. 4. 30. · Distributed Distributed Systems L22: Distributed File Systems Theophilus

The following is excerpted from Real Options and Business …pages.stern.nyu.edu/~adamodar/pdfiles/eqnotes/opt3.pdf · · 2003-01-13Many academic writers, ... A simple home-front

Distributed Transactions 7. Transaction …Distributed Transactions 7. Transaction Management for distributed databases 28 Distributed Transactions 29 Distributed Commit 30 Distributed

Runahead Execution A Power-Efficient Alternative to Large Instruction Windows for Tolerating Long Main Memory Latencies Onur Mutlu EE 382N Guest Lecture

ms.npglobal.inms.npglobal.in/tcil/opt3/pdf/corporate-announcements/other-corpora… · India’s fastest growing express company for door to door courier and cargo. Leading player

VMM User Guide - University of Texas at Austinusers.ece.utexas.edu/~patt/14s.382N/handouts/vcs.pdf6 Implementing Tests & Scenarios Overview . . . . . . . . . . . . . . . . . . .