1
The EGEE project is building a Grid infrastructure for the scientific community. Grids are networks of computers spread across many sites but able to act together to provide a range of large scale facilities, from incredible processing power and mass storage to a platform for international collaboration. EGEE-III is co-funded by the European Commission under contract number INFSO-RI-222667 www. eu - egee . o r g CENTRALIZED DEPLOYMENT OF THE FRENCH BIOINFORMATICS GRID RENABI INTERNET ELOTO C. (CNRS IBCP 1 ), MICHON A. (CNRS IBCP 1 ), ROULT A. (CNRS INRIA IRISA 2 ), COLLIN O. (CNRS INRIA IRISA 2 ), CARON C. (CNRS SBR 3 ), BLANCHET C. (CNRS IBCP 1 ) contact : GRISBIIBCP.FR (1) IBCP - UMR 5086 CNRS Université de Lyon - 7, passage du Vercors 69367 Lyon cedex 07, FRANCE (2) Equipe Symbiose - Plate-forme GenOuest IRISA-INRIA - Campus de Beaulieu 35042 Rennes cedex, FRANCE (3) Station Biologique / CNRS-UPMC - Service Informatique et Génomique - Place Georges Teissier BP 74 29682 Rosco cedex, FRANCE GRISBI GRID SITE Storage element User interface Computing element Worker nodes GRID-FR QUATTOR Quattor is an open-source software, which provides administration tools for automated installation, conguration and management of machines. The architecture of the system is client/server based. The clients are the machines to administrate. And the server runs a database containing the templates used to write XML proles. The TEMPLATES (TPL) describe hardware, gLite middleware, services, parameters of nodes and sites in a high level description langage (PAN). A set of generic templates, written by the Quattor Working Group (QWG templates), provides online conguration for every type of gLite nodes. On the server, there is one XML prole per machine with its entire description (OS, softwares, gLite middleware, services). This prole is built by the PANC compilator from the templates. And it provides the informations required by the Quattor client components, deployed on the target node, to install, congure and update this node. Benets of Quattor tools * With QWG templates, it isn't necessary to be an expert in gLite or cluster deployment to install a grid site. * Homogeneity and reproductibility of the nodes: in the templates, the common parameters between the nodes are set only once. * Quick installation and reinstallation of identical machines. GOALS OF GRISBI PARTNERS * Share their resources (computational power, storage, applications and biological data) with the French bioinformatics community through the virtual organization VO.RENABI.FR . * Deploy bioinformatics applications and data: ! gridify bioinformatics algorithms and softwares and install them on the worker nodes, ! make biological databanks available on the storage elements. * Site management: ! dissiminate the grid technology through teaching sessions, ! train one gLite and Quattor expert per platform. (1) AII = Automated Installation Infrastructure (2) KS = Kickstart prole (3) TFTP = Trivial File Transfer Protocol GRISBI MODEL OF GRID DEPLOYMENT XML proles for all the GRISBI sites are built by the Quattor server at IBCP and are distributed over the Internet via HTTPS. Secured connections between machines of the sites and Quattor server are made with the electronic certicates from the Certication Authority CNRS GRID2-FR. During the installation, two strategies are used at rst, according to the type of the machine. ! For physical nodes: the XML proles are read by the AII 1 component (part of Quattor tools) to write the kickstart proles (KS 2 ) (one per machine). A node boots using its network interface (PXE boot), downloads the network bootstrap program stored on a TFTP 3 server and executes it. This program indicates which boot kernel should be used to install the right operating system and the URL of the KS prole. The role of this KS prole is to provide the values required during the installation and to deploy the Quattor client components. ! For virtual machines: a template of a virtual machine with a basic Scientifc Linux distribution and the Quattor client components has been created. It is available for the authorized administrators of GRISBI sites. The virtual machine’s settings (number of CPU/disks, size of the RAM) must be modied depending on the type of node that will be deployed. For the second step of the installation, the processus is the same for virtual and physical nodes. A grid certicate is manually copied on the node so it can download its XML prole stored on the IBCP server. This prole is read by Quattor client components to nish the installation (gLite...) and congure the machine as a grid node (services, scripts, accounts...). Quattor components will update the machine according to the modications of XML proles made at IBCP. Benets of GRISBI model * Operations are done by one administrator. * Could move to a model with several grid administrators. RENABI ReNaBi (Réseau National des plates-formes Bioinformatiques) is the French Bioinformatics platforms network built upon the dierent bioinformatics platforms located in dierent cities and regions of France. These platforms provide many resources for the bioinformatics and life science communities. Each one producing certied tools, databases and documentation. ReNaBi supports the structuration of Bioinformatics in France through its activities. www.renabi.fr GRISBI The GRISBI Platform (Grid Support for Bioinformatics) is a joined initiative between six French Bioinformatics platforms of the ReNaBi network: PRABI Lyon, GenOuest Rennes and Rosco, CBiB Bordeaux, BIPS Strasbourg, CIB Lille, MIGALE Jouy-en-Josas, to set up a grid infrastructure devoted to serve the bioinformatics community at the national level. www.grisbio.fr The first step of the GRISBI project was to find a model of grid middleware deployment designed for the bioinformaticians operating the ReNaBi platforms and who have most of the time no experience in grid middleware installation and management. We present here the GRISBI model mainly based on Quattor tools. HTTPS GRID-FR AII server KS GRID-FR RENABI PLATFORMS RESOURCES (re)installation & conguration GRISBI MODEL OF GRID DEPLOYMENT GRISBI GRID Physical nodes XML TPL PANC server GRID-FR RENABI NETWORK (re)installation GRISBI GRID SITES update Virtual machines

Centralized deployment of the French Bioinformatics Grid - Indico

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Centralized deployment of the French Bioinformatics Grid - Indico

The EGEE project is building a Grid infrastructure for the scientific community. Grids are networks of computers spread across many sites but able to act together to provide a range of large scale facilities, from incredible processing power and mass storage to a platform for international collaboration.

EGEE-III is co-funded by the European Commission under contract number INFSO-RI-222667

w w w.eu-egee.org

CENTRALIZED DEPLOYMENT OF THE FRENCH BIOINFORMATICS GRID RENABI

INTERNET

ELOTO C. (CNRS IBCP1), MICHON A. (CNRS IBCP1), ROULT A. (CNRS INRIA IRISA2),COLLIN O. (CNRS INRIA IRISA2), CARON C. (CNRS SBR3), BLANCHET C. (CNRS IBCP1)contact : [email protected]

(1) IBCP - UMR 5086 CNRS Université de Lyon - 7, passage du Vercors 69367 Lyon cedex 07, FRANCE(2) Equipe Symbiose - Plate-forme GenOuest IRISA-INRIA - Campus de Beaulieu 35042 Rennes cedex, FRANCE (3) Station Biologique / CNRS-UPMC - Service Informatique et Génomique -Place Georges Teissier BP 74 29682 Rosco! cedex, FRANCE

GRISBI GRID SITE

Storage element

User interface Computing element

Worker nodes

GRID-FR

GRID-FR

GRID-FR

GRID-FR

QUATTORQuattor is an open-source software, which provides administration tools for automated installation, con"guration and management of machines. The architecture of the system is client/server based. The clients are the machines to administrate. And the server runs a database containing the templates used to write XML pro"les.

The TEMPLATES (TPL) describe hardware, gLite middleware, services, parameters of nodes and sites in a high level description langage (PAN). A set of generic templates, written by the Quattor Working Group (QWG templates), provides online con"guration for every type of gLite nodes.

On the server, there is one XML pro"le per machine with its entire description (OS, softwares, gLite middleware, services). This pro"le is built by the PANC compilator from the templates. And it provides the informations required by the Quattor client components, deployed on the target node, to install, con"gure and update this node.

Bene"ts of Quattor tools * With QWG templates, it isn't necessary to be an expert in gLite or cluster deployment to install a grid site.* Homogeneity and reproductibility of the nodes: in the templates, the common parameters between the nodes are set only once.* Quick installation and reinstallation of identical machines.

GOALS OF GRISBI PARTNERS

* Share their resources (computational power, storage, applications and biological data) with the French bioinformatics community through the virtual organization VO.RENABI.FR .

* Deploy bioinformatics applications and data:! gridify bioinformatics algorithms and softwares and install them on the worker nodes,! make biological databanks available on the storage elements.

* Site management:! dissiminate the grid technology through teaching sessions,! train one gLite and Quattor expert per platform.

(1) AII = Automated Installation Infrastructure (2) KS = Kickstart pro"le (3) TFTP = Trivial File Transfer Protocol

GRISBI MODEL OF GRID DEPLOYMENT

XML pro"les for all the GRISBI sites are built by the Quattor server at IBCP and are distributed over the Internet via HTTPS. Secured connections between machines of the sites and Quattor server are made with the electronic certi"cates from the Certi"cation Authority CNRS GRID2-FR.

During the installation, two strategies are used at "rst, according to the type of the machine.! For physical nodes: the XML pro"les are read by the AII1 component (part of Quattor tools) to write the kickstart pro"les (KS2) (one per machine). A node boots using its network interface (PXE boot), downloads the network bootstrap program stored on a TFTP3 server and executes it. This program indicates which boot kernel should be used to install the right operating system and the URL of the KS pro"le. The role of this KS pro"le is to provide the values required during the installation and to deploy the Quattor client components.! For virtual machines: a template of a virtual machine with a basic Scientifc Linux distribution and the Quattor client components has been created. It is available for the authorized administrators of GRISBI sites. The virtual machine’s settings (number of CPU/disks, size of the RAM) must be modi"ed depending on the type of node that will be deployed.

For the second step of the installation, the processus is the same for virtual and physical nodes. A grid certi"cate is manually copied on the node so it can download its XML pro"le stored on the IBCP server. This pro"le is read by Quattor client components to "nish the installation (gLite...) and con"gure the machine as a grid node (services, scripts, accounts...). Quattor components will update the machine according to the modi"cations of XML pro"les made at IBCP.

Bene"ts of GRISBI model* Operations are done by one administrator.* Could move to a model with several grid administrators.

RENABIReNaBi (Réseau National des plates-formes Bioinformatiques) is the French Bioinformatics platforms network built upon the di!erent bioinformatics platforms located in di!erent cities and regions of France. These platforms provide many resources for the bioinformatics and life science communities. Each one producing certi"ed tools, databases and documentation. ReNaBi supports the structuration of Bioinformatics in France through its activities. www.renabi.fr GRISBIThe GRISBI Platform (Grid Support for Bioinformatics) is a joined initiative between six French Bioinformatics platforms of the ReNaBi network: PRABI Lyon, GenOuest Rennes and Rosco!, CBiB Bordeaux, BIPS Strasbourg, CIB Lille, MIGALE Jouy-en-Josas, to set up a grid infrastructure devoted to serve the bioinformatics community at the national level. www.grisbio.fr

The first step of the GRISBI project was to find a model of grid middleware deployment designed for the bioinformaticians operating the ReNaBi platforms and who have most of the time no experience in grid middleware installation and management.We present here the GRISBI model mainly based on Quattor tools.

HTTPS

GRID-FR

AII server

KS

GRID-FR

RENABIPLATFORMSRESOURCES

(re)installation &con"guration

GRISBI MODEL OF GRID DEPLOYMENT GRISBI GRID

Physical nodes

XML TPL

PANC

serverGRID-FR

RENABI NETWORK

(re)installation

GRISBIGRIDSITES

update

GRID-FR

GRID-FR GRID-FR

Virtual machines