25
1 WELCOME

parallel computing

Embed Size (px)

Citation preview

Page 1: parallel computing

1

WELCOME

Page 2: parallel computing

K.NARAYANA

08Q61A0575

2

Page 3: parallel computing

Execution

EXAMPLE :-

• main()

{

• for (int i = 0; d.get_meaning(i,s) != 0; ++i)

• cout << (i+1) << ": " << s << "\n";

• return 0;

}

Page 4: parallel computing

4

Page 5: parallel computing

5

Page 6: parallel computing

For example:

Page 7: parallel computing

Traditionally software has been written for serial computation.

7

Page 8: parallel computing

8

Page 9: parallel computing
Page 10: parallel computing

Load Balancing

10

Page 11: parallel computing

11

Page 13: parallel computing

Parallel Computer Memory Architectures:

Distributed Memory

Page 14: parallel computing

There are different ways to classify parallel computers

• classified along the two independent dimensions of Instruction and Data

• SISD – Single Instruction, Single Data

• SIMD – Single Instruction, Multiple Data

• MISD – Multiple Instruction, Single Data

• MIMD – Multiple Instruction, Multiple Data

Page 19: parallel computing

ADVANTAGES

• In the simplest sense, parallel computing is

To be run using multiple CPUs

A problem is broken into discrete parts that can be solved concurrently

Each part is further broken down to a series of instructions

Instructions from each part execute simultaneously on different CPUs

Page 20: parallel computing

Synchronization

Problem decomposition

Data Dependencies

20

Parallel computing Overheads

Page 21: parallel computing

21

Page 22: parallel computing

Problem decomposition

Page 23: parallel computing

Data Dependencies

• 1: function Dep(a, b)

• 2: c := a·b

• 3: d := 3·c

• 4: end function

• 1: function NoDep(a, b)

• 2: c := a·b

• 3: d := 3·b

• 4: e := a+b

• 5: end function

Page 24: parallel computing

Conclusion

• Parallel computing is fast.

• There are many different approaches and models of parallel computing.

• Parallel computing is the future of computing.

• Solve larger problems

Page 25: parallel computing

25

THANK YOU