Introduction to Parallel Processing

Dr. Guy Tel-ZurLecture 6

Exe #3

The Course RoadmapIntroduction

Message Passing

HTCHPC

Shared Memory

Condor

The Grid (EGEE)

Cloud Computing

MPI OpenMP

Next week

Today

Agenda

• A remark about Collective commands in MPI• More MPI Demonstrations• Introduction to Condor (next week - lab)

– Users perspective– Admin. Perspective– Demo:

• How to install a Personal Condor• A test program

• Discussion about the Final presentations• Home assignment #2

http://eesgi2.ee.bgu.ac.il/

MPI

• More MPI examples– Dead lock example with collective commands.

פקודות קולקטיביות חייבות להינתן באותו הסדר לכל התהליכים בקומוניקטור

// Process A:MPI_Bcast(buf1, count, type, 0, comm);MPI_Bcast(buf2, count, type, 1, comm);break;// Process B (reverse broadcast):MPI_Bcast(buf2, count, type, 1, comm);MPI_Bcast(buf1, count, type, 0, comm);

From: “Grid Computing for Developers” book, by VLADIMIR SILVA

Makefile tutorial

• http://www.eng.hawaii.edu/Tutor/Make/

Condor

• Online manual: http://www.cs.wisc.edu/condor/manual/v7.4

• Next presentation:– 2010 Condor Week– Nick LeRoy presentation: Condor User Tutorial– URL:

http://www.cs.wisc.edu/condor/CondorWeek2010/condor_presentations.html

Installing Condor (7.4.2 – current)“Personal” Condor on Windows (Vista)

Version 7.4.2. Released on April 6, 2010

Cont’

Cont’

Cont’

Cont’

Cont’

Click on Install

Cont’

Give Administrator rights to the installer

Cont’

restart

The Condor service should be startedIf needed restart the service here

At least the five Condor daemons should be running

Condor config

Condor config_local

You will find both configuration files under the install dir c:\condor

condor_status

Good! So now we have a Personal Condor running on my laptop

Demo: cpu_burn.c

#include <math.h>#include <stdio.h>

int main() { int iMAX = 60000; int i,j; float fNORM, fMAX; float x,y; fMAX = iMAX; // convert to float fNORM = fMAX * fMAX; for (j=0;j<iMAX;j++) for (i=0;i<iMAX;i++) { y = i; // convert to float x = y*y/fNORM; } return 0;}

Submit file:universe = vanilla

executable = cpu_burn.exeError = err.$(Cluster).$(Process) Output = out.$(Cluster).$(Process) Log = log.$(Cluster).$(Process)

Queue 5

Watch the Task Manager

Check the logfile

000 (088.001.000) 04/26 10:23:10 Job submitted from host: <127.0.0.1:50486>...001 (088.001.000) 04/26 10:23:19 Job executing on host: <127.0.0.1:50487>...005 (088.001.000) 04/26 10:24:20 Job terminated.

(1) Normal termination (return value 0)Usr 0 00:00:27, Sys 0 00:00:00 - Run Remote UsageUsr 0 00:00:00, Sys 0 00:00:00 - Run Local UsageUsr 0 00:00:27, Sys 0 00:00:00 - Total Remote

UsageUsr 0 00:00:00, Sys 0 00:00:00 - Total Local Usage

0 - Run Bytes Sent By Job15686 - Run Bytes Received By Job0 - Total Bytes Sent By Job15686 - Total Bytes Received By Job

...

Condor daemons while executing cpu_burn

Same job at the vdwarf

Show demo under: /users/agnon/misc/tel-zur/condor/cpuburn

Condor and Matlab/Octave demo

The submit file

The wrapper file

Final Presentations

עבור למצגת הרצאות גמר•

כל קבוצת תלמידים מתבקשת לבחור נושא להרצאת •גמר ואז לפעול כדלקמן:

את הדברים הבאים:gtelzur@bgu.ac.ilלשלוח אלי ל- –נושא ההרצאה )כותרת(•(PP-xxמספר הקבוצה )•שמות חברי הקבוצה•

אני אשיב לקבוצה באם הנושא אושר או לא! בטרם תקבלו –אישור ממני, אין להתחיל לעבוד על ההצעה שהגשתם!

זהו להפעם, תירגול 21.8שבוע הבא,

CONDOR34 בבניין 310במעבדה

18:00-21:00נוכחות חובה