International Workshop APAN 24, 2007International Workshop APAN 24, 2007 11

Current State of Grid Current State of Grid Computing Researches and Computing Researches and

Applications in VietnamApplications in Vietnam

Nguyen Thanh ThuyNguyen Thanh Thuy11, Nguyen Kim Khanh, Nguyen Kim Khanh11, ,

Tran Ba ThaiTran Ba Thai22

11Hanoi University of TechnologyHanoi University of Technology22Institute of Information TechnologyInstitute of Information Technology

thuynt@it-hut.edu.vnthuynt@it-hut.edu.vn

On behalf of the members of the VNGrid ProjectOn behalf of the members of the VNGrid Project

22

OutlineOutline

• Researches on grid computing in VietnamResearches on grid computing in Vietnam– Centers for High Performance ComputingCenters for High Performance Computing– Research activitiesResearch activities

• Towards a grid infrastructure for VietnamTowards a grid infrastructure for Vietnam– VNGrid projectVNGrid project– The aimsThe aims– Planed activitiesPlaned activities

• Initial results: Initial results: – a data grid for meteorologya data grid for meteorology

• ConclusionConclusion

33

Grid computing in VietnamGrid computing in Vietnam

• Initial step Initial step – since a few last yearssince a few last years– several HPC centers in several HPC centers in

Hanoi and HCM CityHanoi and HCM City• Hanoi University of Hanoi University of

TechnologyTechnology• Institute of Information Institute of Information

Technology, HCM CityTechnology, HCM City• Vietnam National Vietnam National

University, HanoiUniversity, Hanoi• Vietnamese Institute of Vietnamese Institute of

MathematicsMathematics• HCM City University of HCM City University of

TechnologyTechnology

Centers for HPC

44

MilestonesMilestones

2001 2002 2003 2004 2005 2006

First center for HPC at HUT

300 GFlops

computing center at VNU (max)

Other HPC centers are

founded

First national conference on HPC and grid computing in

HCM city

BK Grid Group

atHUT

BioGrid Group at

IOIT-HCM

TEIN2-VN Project

(Trans-Eurasia Information Network)

VNGrid Project

55

Encountered IssuesEncountered Issues

• Not yet HPC centers of Tera Flops Not yet HPC centers of Tera Flops

• Not yet a common infrastructure to Not yet a common infrastructure to connect HPC centers connect HPC centers

• Grid computing rests in academic Grid computing rests in academic researches. Not yet large scale researches. Not yet large scale applications.applications.

66

Activities doneActivities done

• Building grid portalsBuilding grid portals– BKGrid (HUT)BKGrid (HUT)– Grid iPortal (VNU-HCM)Grid iPortal (VNU-HCM)

• Experimenting with applications onExperimenting with applications on– Meteorology (HUT, VNU-Hanoi)Meteorology (HUT, VNU-Hanoi)– Bioinformatics (IOIT-HCM)Bioinformatics (IOIT-HCM)

• Participating in international gridsParticipating in international grids– Pragma (IOIT-HCM)Pragma (IOIT-HCM)– APGrid (Vietnamese Institute of Mathematics)APGrid (Vietnamese Institute of Mathematics)

77

VNGrid ProjectVNGrid Project

• Financed by Ministry of Science and Technology of Vietnam

• A two year project, to be finished in October 2009

• 5 partners in the project– HUT– IOIT in Hanoi– IOIT in HCM City– VNU in Hanoi– Vietnam Military Technical Academy (VMTA)

88

The aims of VNGrid (1)The aims of VNGrid (1)

• Building a cyber-infrastructure to Building a cyber-infrastructure to connect five partners in VN-Gridconnect five partners in VN-Grid

• Deploying advanced grid Deploying advanced grid technologies to improve the technologies to improve the performanceperformance– Resource monitoring and discoveringResource monitoring and discovering– Scheduling and brokeringScheduling and brokering

hard to reach the objective!hard to reach the objective!

99

The aims of VNGrid (2)The aims of VNGrid (2)

• Experimenting grid-based applications Experimenting grid-based applications onon– Bioinformatics,– Meteorology,– Virtual Reality,– Cryptography.

•Being connected to other grid systems in the region and over the world

1010

Planned activitiesPlanned activities

• Selecting the common technology solution for the whole VNGrid– suitable for the infrastructure in Vietnam– Via TEIN2

• Establishing necessary security policy

• Developing and deploying some grid applications

• Building a VNGrid Portal

• Connecting VNGrid to PRAGMA and some others

1111

Attended resultsAttended results

• Establishing VNGrid for Grid RD and Establishing VNGrid for Grid RD and application community in Vietnamapplication community in Vietnam

• Assembling separated HPC centers in Assembling separated HPC centers in VietnamVietnam

• Reinforcing researches on grid computing in Reinforcing researches on grid computing in VietnamVietnam

• Towards applying GC in industrial domainsTowards applying GC in industrial domains• Opening a new opportunity for collaboration Opening a new opportunity for collaboration

with partners outside Vietnam: HPC, storage with partners outside Vietnam: HPC, storage and content resources!!!and content resources!!!

1212

Apllication 1: BioinformaticsApllication 1: Bioinformatics

• Deploying grid technologies for Gene Mapping (IOIT-HCM)– Use Haplotype Pattern Mining (HPM), and

Density Based Spatial Clustering of Application with Noise (DBSCAN) to specify the locations of genetic diseases

• Performing Blast and gene prediction in Grid computing environment using iGridPortal (HCM City College of Natural Sciences)

1313

Apllication 2: Meteorological Apllication 2: Meteorological ForecastForecast

• Using agent Using agent technologies to technologies to deploy grid deploy grid servicesservices– An agent has An agent has

responsible for responsible for calling calling appropriate appropriate services services following user following user requirementsrequirements

Globus ToolkitGRAM MDS 3 Grid FTP

ClusterPBS

ClusterPBS

BKGrid Portal

SecurityService Information

ServiceWeka

Resource Broker Agent

HPC Service

Fedora Core 1

1414

Application 2: BKGrid and Application 2: BKGrid and Meteorological Forecast (cont)Meteorological Forecast (cont)

•Applying the HPC and Grid Computing for climate forecast (HUT, VNU-Hanoi)– Deploying the MM5 model

•Exploiting resources on APGrid to run a model for climate forecast (Vietnamese Institute of Vietnamese Institute of MathematicsMathematics)

1515

Intial results: data grid for Intial results: data grid for meteorology at HUTmeteorology at HUT

• Weather forecasting plays an important Weather forecasting plays an important role in the society role in the society – for agriculture, commerce, catastrophe for agriculture, commerce, catastrophe

preventing, etc. preventing, etc.

• There are different institutions in Vietnam There are different institutions in Vietnam working on the meteorology problems but working on the meteorology problems but the cooperation is not easy forthe cooperation is not easy for– sharing local observation datasharing local observation data– sharing hardware and software resources on sharing hardware and software resources on

computing weather forecast datacomputing weather forecast data

1616

A data grid portal for A data grid portal for meteorologymeteorology• Building a data grid for sharing Building a data grid for sharing

meteorological datasets is a suitable meteorological datasets is a suitable solution in Vietnam for:solution in Vietnam for:– Exploiting resources from different HPC centersExploiting resources from different HPC centers– Providing a central and easy access point to all Providing a central and easy access point to all

meteorological data via a grid portalmeteorological data via a grid portal– Offering a reliable mean for storing and sharing Offering a reliable mean for storing and sharing

meteorological data for research purposemeteorological data for research purpose– Public access to climate forecast websitePublic access to climate forecast website

1717

System architectureSystem architecture

Locally meteo-data

Global meteo-data

GrADS server

Administrator

Users

Data Grid

Http

`

``

`

`

Grid portal(gridsphere based)

`

``

`

`

`

``

`

`

MM5 Modeling System

HRM Modeling System

WRF Modeling System

User

Group

1818

Weather forecast modelingWeather forecast modeling• Model used for Model used for

weather weather forecasting: forecasting: MM5.MM5.

• It can be run on It can be run on a cluster for the a cluster for the high high performanceperformance

1919

Deployment of MM5 modelDeployment of MM5 model

• MM5 model already deployed MM5 model already deployed automatically in a cluster with 3 automatically in a cluster with 3 datasets each daydatasets each day– Downloading periodically global Downloading periodically global

meteorology data from the AVN sitemeteorology data from the AVN site– Combining with local observation data Combining with local observation data

on modelingon modeling– Configuring easily the modeling process Configuring easily the modeling process

via a configuration filevia a configuration file– Fault tolerance implemented to make Fault tolerance implemented to make

the service more reliablethe service more reliable

2020

Data grid servicesData grid services

• Data grid as a virtual container for Data grid as a virtual container for storing data and easy access laterstoring data and easy access later

• Basic services provided: Basic services provided: – Replicating data in several nodesReplicating data in several nodes– Searching data based on metadataSearching data based on metadata– Transferring data between nodesTransferring data between nodes

2121

PrototypePrototype

2222

ConclusionConclusion

• Grid Computing brings chances to Grid Computing brings chances to developing countries as Vietnam. We need:developing countries as Vietnam. We need:– Computing Resources and HPCComputing Resources and HPC– Storage Resources and Data in applications, Storage Resources and Data in applications, – QoS networking service.QoS networking service.– Grid toolsGrid tools– CollaborationCollaboration

Shortage of resources and only initial steps done, Shortage of resources and only initial steps done, more co-operations needed!more co-operations needed!

2323

ConclusionConclusion

• We would like to join grid computing We would like to join grid computing communities in communities in – APANAPAN– TEINTEIN

International Workshop APAN 24, 2007International Workshop APAN 24, 2007 2424

Thank you very much Thank you very much for your attention!for your attention!