Embed Size (px)
DESCRIPTION
GENIUS Grid portal Hands on. Moisés Hernández Duarte UNAM FES Cuautitlán Tutorial on grid, visualization and high performance calculation Mexico City, October 23 – 26, 2007 Based on Luciano Díaz presentation, ICN-UNAM. Outline. Useful information Exercises - PowerPoint PPT Presentation
Citation preview
FP6−2004−Infrastructures−6-SSA-026409
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
Moisés Hernández DuarteUNAM FES CuautitlánTutorial on grid, visualization and high performance calculationMexico City, October 23 – 26, 2007Based on Luciano Díaz presentation, ICN-UNAM
GENIUS Grid portalHands on
Users Tutorial, Mexico City, 23 - 24 October 2007FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Outline
• Useful information• Exercises
1. GENIUS logging in and base settings
2. Launch a job described by a JDL which already exists in the UI
3. Prepare a job described by a JDL and store it on the UI
4. Submit the job described by the JDL created in the previous exercise
5. Preparing a job described by the JDL with a file to ship in the input sandbox
6. Submitting the job prepared in the previous exercise
Users Tutorial, Mexico City, 23 - 24 October 2007 3FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Useful information
• GENIUS Tutorial website: • https://glite-tutor2.ct.infn.it
• Tutorial accounts on glite-tutor:• Username: mexicocityXX where XX goes from 01 to 40• Password: GridMEXxx where xx goes from 01 to 40• When issuing the myproxy-init command:• Myproxy password: MEXICOCITY for all the accounts
Users Tutorial, Mexico City, 23 - 24 October 2007 4FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Introduction: the two-layers Authentication
• 1. Authentication with the User Interface
• 2. Authentication to the Grid.
Input password of the proxy (specified when you shall execute myproxy-init)
Input password of the user account: mexicocityXX
Users Tutorial, Mexico City, 23 - 24 October 2007 5FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 1
GENIUS logging in and base settings
Users Tutorial, Mexico City, 23 - 24 October 2007 6FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Outline of the exercise 1/2
• Login at your UI account (passwd: GridMEXxx)
• Store a proxy on a remote Myproxy Server machine with the command (using the passphrase MEXICOCITY):
• >myproxy-init --voms gilda
• Retrieve a local proxy from MyProxy server:• > myproxy-get-delegation (must use your new
MyProxy passphrase)
Users Tutorial, Mexico City, 23 - 24 October 2007 7FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Outline of the exercise 2/2
• Verify your new local proxy: • >voms-proxy-info --all
• Destroy your local proxy with the command and then inspect it
• >voms-proxy-destroy
• Go on the https://glite-tutor2.ct.infn.it with your browser, put your Myproxy passphrase.
• Come back on the terminal and execute • >voms-proxy-info --all
Users Tutorial, Mexico City, 23 - 24 October 2007 8FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
>myproxy-init --voms gilda
[mexicocity20@eela-132 mexicocity20]$ myproxy-init --voms gildaCannot find file or dir: /home/mexicocity20/.glite/vomsesYour identity: /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected] GRID pass phrase:verify OKCreating temporary proxy ................................................... DoneContacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected]] "gilda" DoneCreating proxy ........................................ DoneYour proxy is valid until Sun Sep 3 06:35:26 2006Enter MyProxy pass phrase:Verifying password - Enter MyProxy pass phrase:A proxy valid for 168 hours (7.0 days) for user mexicocity20 now exists on grid001.ct.infn.it.[mexicocity20@eela-132 mexicocity20]$
Password: MEXICOCITY
Choose a new password;This password will be referred
later as myproxy password
Users Tutorial, Mexico City, 23 - 24 October 2007 9FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Get credentials from the MyProxy server
• >myproxy-get-delegation• >voms-proxy-info -all
[mexicocity20@eela-132 mexicocity20]$ myproxy-get-delegation Enter MyProxy pass phrase:A proxy has been received for user mexicocity20 in /tmp/x509up_u519[mexicocity20@eela-132 mexicocity20]$ voms-proxy-info -allsubject : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected]/CN=proxy/CN=proxy/CN=proxyissuer : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected]/CN=proxy/CN=proxyidentity : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected]/CN=proxy/CN=proxytype : unknownstrength : 512 bitspath : /tmp/x509up_u519timeleft : 11:51:33=== VO gilda extension information ===VO : gildasubject : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected] : /C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected] : /gilda/Role=NULL/Capability=NULLtimeleft : 11:34:59[mexicocity20@eela-132 mexicocity20]$
Users Tutorial, Mexico City, 23 - 24 October 2007 10
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Destroying local voms proxy
• >voms-proxy-destroy• >voms-proxy-info -all
[mexicocity20@eela-132 mexicocity20]$ voms-proxy-destroy [mexicocity20@eela-132 mexicocity20]$ voms-proxy-info -all
Couldn't find a valid proxy.
[mexicocity20@eela-132 mexicocity20]$
Users Tutorial, Mexico City, 23 - 24 October 2007 11
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
The Genius Home Page
Users Tutorial, Mexico City, 23 - 24 October 2007 12
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
…then authenticating on GENIUS using myproxy passwd…
• GRID authentication• The password is the one set when
issued the myproxy-init command
Myproxy password set before
Users Tutorial, Mexico City, 23 - 24 October 2007 13
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 2
• Launch a job described by a JDL which already exists in the UI
• We suppose to have the JDL file and all the other required data (input sandbox files) on the UI and we
shall try to submit the job on the GRID
Users Tutorial, Mexico City, 23 - 24 October 2007 14
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Authentication with MyProxy
Users Tutorial, Mexico City, 23 - 24 October 2007 15
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
GRID Settings
Users Tutorial, Mexico City, 23 - 24 October 2007 16
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Set VO/VOMS
Users Tutorial, Mexico City, 23 - 24 October 2007 17
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Selecting jdl file
Users Tutorial, Mexico City, 23 - 24 October 2007 18
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Specify the CE Resource
Users Tutorial, Mexico City, 23 - 24 October 2007 19
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Job successfully submitted
Users Tutorial, Mexico City, 23 - 24 October 2007 20
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Job completed successfully
Users Tutorial, Mexico City, 23 - 24 October 2007 21
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving Job results 1/3
Users Tutorial, Mexico City, 23 - 24 October 2007 22
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving Job results 2/3
Users Tutorial, Mexico City, 23 - 24 October 2007 23
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving job results 3/3
Users Tutorial, Mexico City, 23 - 24 October 2007 24
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 3
• Prepare a job described by a JDL and store it on the UI
• In this exercise we are going to create a new file on the UI called helloworld.jdl describing a simple job
Users Tutorial, Mexico City, 23 - 24 October 2007 25
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
First step: create the JDL file
[ JobType = "Normal"; Executable = "/bin/echo"; Arguments = "Hello World !"; StdOutput = "std.out"; StdError = "std.err"; OutputSandbox = {"std.out","std.err"}; ]
Users Tutorial, Mexico City, 23 - 24 October 2007 26
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
The JDL is ready to be executed
Users Tutorial, Mexico City, 23 - 24 October 2007 27
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Inspecting our JDL
Users Tutorial, Mexico City, 23 - 24 October 2007 28
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 4
• Submit the job described by the JDL created in the previous exercise
• In this exercise we are going to submit the job described by the JDL file edited in the previous step
Users Tutorial, Mexico City, 23 - 24 October 2007 29
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Select JDL file 1/3
Users Tutorial, Mexico City, 23 - 24 October 2007 30
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Submitting the JDL 2/3
Users Tutorial, Mexico City, 23 - 24 October 2007 31
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving job results 3/3
Users Tutorial, Mexico City, 23 - 24 October 2007 32
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 5
• Preparing a job described by the JDL with a file to ship in the input sandbox
• In this exercise we are going prepare the JDL description for a job which executes a shell script. The .sh file will be shipped to the CE through the input sandbox
Users Tutorial, Mexico City, 23 - 24 October 2007 33
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Step 1: Create the shell script
#!/bin/sh MY_NAME="Your name" WORKER_NODE_NAME=glite-tutor.ct.infn.it echo "Hello $MY_NAME, from $WORKER_NODE_NAME" ls -a echo "This job is running on this CE: " /opt/edg/bin/edg-brokerinfo getCE
Users Tutorial, Mexico City, 23 - 24 October 2007 34
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Step2: create the JDL file
[ Executable = "startScript.sh"; StdOutput = "std.out"; StdError = "std.err"; VirtualOrganisation = "gilda"; InputSandbox = {"startScript.sh"}; OutputSandbox = {"std.out","std.err",".BrokerInfo"}; RetryCount = 7; ]
Users Tutorial, Mexico City, 23 - 24 October 2007 35
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 6
• Submitting the job prepared in the previous exercise
• In this exercise we are going submit the job which executes a shell script, prepared in the previous exercise. The .sh file will be shipped to the CE through the input sandbox
Users Tutorial, Mexico City, 23 - 24 October 2007 36
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Submitting job
Users Tutorial, Mexico City, 23 - 24 October 2007 37
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving the results
