BalticGrid-II ProjectBalticGrid-II Project

MATLAB implementation and application in Grid

MATLAB implementation and application in Grid

Ilmars Slaidins, Lauris CikovskisIlmars Slaidins, Lauris CikovskisRiga Technical UniversityRiga Technical University

AHM Riga May 12-14, 2009

OutlineOutline

IntroductionIntroduction

Matlab Matlab

MathWorks licence conditionsMathWorks licence conditions

Distributed Computing Server (Distributed Computing Server (““MDCSMDCS””))

Grid applicationsGrid applications

ConclusionsConclusions

AHM Riga May 12-14, 2009

About MATLABAbout MATLAB

MATLABMATLAB (with Simulink) (with Simulink) – programming language – programming language for science and engineeringfor science and engineering

Over 1 milion users, over 3500 universities and Over 1 milion users, over 3500 universities and collegescolleges

Engineering in industry + biotech, medical, financialEngineering in industry + biotech, medical, financial

Toolboxes Toolboxes forfor different fields – different fields – Engineerieng, Bioinformatics, Economics etc.

Parallel computing supportParallel computing support Job execution on multicore/cluster systems MPI support

AHM Riga May 12-14, 2009

Licencing conditionsLicencing conditions

“Licensee” means ... an individual or an entity, to whom MathWorks grants the License, and who is responsible for complying with the contractual obligations of the License,

“Computer” means a single physical hardware system containing a maximum of four (4) Processors. Each hardware partition, or blade in a blade server, is considered to be a separate Computer, and a hardware system with more than four (4) Processors is considered to be more than one Computer.

AHM Riga May 12-14, 2009

License Grant conditionsLicense Grant conditions

Install and use the Programs Install and use the Programs solely on Computers controlled solely on Computers controlled by Licenseeby Licensee, in accordance with ... , in accordance with ... Deployment AddendumDeployment Addendum, , and and solely for Internal Operationssolely for Internal Operations;;

ForbidenForbiden - - ... to use the Programs for supporting Third Parties or otherwise transfer rights to use the Programs ... provide access ... via a web or network Application, except as expressly permitted in the Deployment Addendum

Article 3.3 MATLAB Distributed Computing ServerMATLAB Distributed Computing Server

.....

AHM Riga May 12-14, 2009

MATLAB Distributed Computing Server

MATLAB Distributed Computing Server

Licensees of the MATLAB Distributed Computing Server Program (“MDCS”) are permitted to install and make available Programs ... on one or more Computers (“Computer Cluster”) solely for use through the MDCS, provided that the Programs on the Computer Cluster are controlled by a single License

Manager on a single designated network server for each MDCS, access to any Program, whether in the MDCS or otherwise, remains

limited to those persons who are Licensed Users of such Programs and the Parallel Computing Toolbox; and

access to any Program, including the MDCS, is not made available (i) to any Third Party without the advance written consent of

MathWorks, or (ii) to any user outside the country in which the MDCS’ License

Manager server is installed, unless the Licensee has contracted for global use.

AHM Riga May 12-14, 2009

Comment from MathWorksComment from MathWorks

“The licensee having the MDCS installed is able to share his cluster to other non degree granting institutions in the same “country”; in this case Europe. That is, others can access your cluster.”

“To get access to other clusters, the other clusters must also install MDCS with third part rights. In EGEE, a middleware is used between the MDCS locations, as the MDCS are installed on separate clusters.”

AHM Riga May 12-14, 2009

Parallel Computing With MATLABParallel Computing With MATLAB

Support for third party schedulersSupport for third party schedulers

AHM Riga May 12-14, 2009

ParallelComputing Toolbox™

TOOLBOXESBLOCKSETS

Computer ClusterComputer Cluster

CPU

CPU

CPU

CPU

MATLAB Distributed Computing ServerMATLAB Distributed Computing Server

MATLABScheduler

Worker

Worker

Worker

Worker

User sideUser side

MATLAB gLite integrationMATLAB gLite integration

ParallelComputing Toolbox™

gLite user InterfaceTOOLBOXES

BLOCKSETS

GRID

API for generic schedulerAPI for generic scheduler

AHM Riga May 12-14, 2009

MDCS

MDCS

MDCS

MDCS

Our MATLAB installationOur MATLAB installation

Installed in RTUETF clusterInstalled in RTUETF cluster

32 licences of MATLAB DCS 2009a 32 licences of MATLAB DCS 2009a includes all toolboxes allows 32 parallel tasks (jobs)

IBM Blade center for Matlab clusterIBM Blade center for Matlab cluster Intel Xeon 5400 series Specially for Matlab memory intesive tasks

4GB RAM per core

AHM Riga May 12-14, 2009

How easy it is...How easy it is...

User requirementsUser requirements Balticgrid VO certificate MATLAB + Parallel computing toolbox (1 licence)

No knowledge about Grids needed No knowledge about Grids needed For simplest jobs no knowledge about parallel For simplest jobs no knowledge about parallel MMATLABATLAB language and MPI language and MPI

Direct access from MATLAB interfaceDirect access from MATLAB interface to Grid to Grid

AHM Riga May 12-14, 2009

How easy it is... (continue)How easy it is... (continue)

Just one command with Just one command with dfeval dfeval to execute your M-fileto execute your M-file

AHM Riga May 12-14, 2009

@task <parameters> glite_UI task.m

ConlusionsConlusions

MathWorks has changed the licensing conditions to MathWorks has changed the licensing conditions to comply with distributed computing demandscomply with distributed computing demands

Provided user friendly access to GridsProvided user friendly access to Grids

Oportunity to use MATLAB server and cluster just Oportunity to use MATLAB server and cluster just with individual licensewith individual license

AHM Riga May 12-14, 2009

BalticGrid-II ProjectBalticGrid-II Project

Thank you for attention!Thank you for attention!

AHM Riga May 12-14, 2009