25
Dynamic Load Sharing and Balancing Haidong Xue

Haidong Xue. Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Embed Size (px)

Citation preview

Page 1: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Dynamic Load Sharing and

BalancingHaidong Xue

Page 2: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms

Part Two: Recent Work• Use the Mobile Agent and Include I/O• Duplex Loading Balancing Strategy• Stability Analysis Based• Extension-based Dynamic Load Balancing

Part Three: Future Work

Content

Page 3: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Part One: Knowledge in the Textbook

Motivations,ModelsConcepts, Algorithms

Page 4: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

For most distributed applications: The prior knowledge of processes is not realistic

Motivation

Page 5: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Goal:

Reduce the overall turnaround time

= communication overhead + computational constraints

Motivation

Page 6: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

(5.1c)

Models – Disjoint Process Model

Page 7: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

(5.3c)

Models – Workstation Model

Page 8: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Load Sharing Joining the shortest queue (Randy Chow, Theodore Johnson, 1997)

Load Balancing Equalizing queue sizes (Randy Chow, Theodore Johnson, 1997)

Concepts

Page 9: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Sender-initiated Algorithm Receiver-initiated Algorithm

Algorithms

Page 10: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Transfer policy: When does a node become the sender? SQ ST

Selection policy: How does the sender choose a process for transfer? The last one.

Location policy: Which node should be the target receiver? RQ PL

Sender-initiated Algorithm

Page 11: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Sender-initiated Algorithm

11

24

35

44

ST=3

52

SQ = sender’s queue sizeST = sender thresholdRQ = receiver queue sizePL = poll limit

Page 12: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Sender-initiated Algorithm

Page 13: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Receiver-initiated Algorithm

16

24

35

44

ST=3

57

Page 14: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Receiver-initiated Algorithm

11

24

35

44

ST=3

52

Page 15: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Algorithms

Page 16: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Depends on Load Stock Exchange

Algorithms - Hybrid

Page 17: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Part Two: Recent Work

•Use the Mobile Agent and Include I/O•Duplex Loading Balancing Strategy•Stability Analysis Based•Extension-based Dynamic Load Balancing

Page 18: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

In order to distribute the incoming load on participating nodes, use mobile agent (MA). A value function which is sum of all three

types of resources including CPU, Memory and I/O is considered.

(Neeraj Nehra, R.B.Patel, 2007)

Use the Mobile Agent and Include I/O

Page 19: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

When comes to OBS, an Object-based Storage System, most of these strategies are hard to comply with the new feature

DLBS can be utilized in the real OBS system to provide more effective and efficient load balance than other methods

(Tan Zhipeng et al, 2009 )

Duplex Loading Balancing Strategy

Page 20: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

the unstable behavior such as oscillatory action which caused by delay can intensely influence the performance of load balancing algorithm.

a linear dynamic load balancing model

(Qingyang Meng et al, 2008)

Stability Analysis Based

Page 21: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Connect extension theory with load Extension engineering method is initially

proposed by Prof. Cai Wen

(Zhang Xiayu et al, 2007)

Extension-based Dynamic Load Balancing

Page 22: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Part Three: Future Work

•Other theories•Collect more information

Page 23: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Incorporate other theory Collect more information of the processes Develop load balancing algorithm based on

those information

Future Work

Page 24: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Randy Chow, Theodore Johnson. Distributed Operating Systems& Algorithms. Addison Wesley, 1997

Neeraj Nehra, R.B. Patel. Towards Dynamic Load Balancing in Heterogeneous Cluster using Mobile Agent. International Conference on Computational Intelligence and Multimedia Applications 2007, 2007, 15-21

Tan Zhipeng, Feng Dan, Tu Xudong, He Fei. DLBS: Duplex Loading Balancing Strategy on Object Storage System. 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications, 2009, 45-52

Reference

Page 25: Haidong Xue.  Part One: Knowledge in Textbook Motivation, Models, Concepts, Algorithms  Part Two: Recent Work Use the Mobile Agent and Include I/O Duplex

Qingyang Meng, Jianzhong Qiao, Jun Liu, Shukuan Lin. A Dynamic Load Balancing Method Based on Stability Analysis. 2008 International Symposium on Computer Science and Computational Technology, 2008, 404-408

Zhang Xiayu, Yu Yongquan, Chen Baixing, Ye Feng, Tan Xingxing. An Extension-based Dynamic Load Balancing Model of Heterogeneous Server Cluster. 2007 IEEE International Conference on Granular Computing, 2007, 675-679

Reference Contd.