Upload
cornelius-leonard
View
226
Download
1
Tags:
Embed Size (px)
Citation preview
© 2008 Open Grid Forum
Grid StandardsRealizing Basic Grid Use Cases Using Existing Standards and Profiles
2© 2008 Open Grid Forum
OGF IPR Policies Apply
• “I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy.”• Intellectual Property Notices Note Well: All statements related to the activities of the OGF and
addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to:
• the OGF plenary session, • any OGF working group or portion thereof, • the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, • the ADCOM, or any member thereof on behalf of the ADCOM, • any OGF mailing list, including any group list, or any other list functioning under OGF auspices, • the OGF Editor or the document authoring and review process
• Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions.
• Excerpt from Appendix B of GFD-C.1: ”Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.”
• OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.
3© 2008 Open Grid Forum
Agenda
• Why Standardize?
• Where are we now?
• Base use-cases
• Standards
• Realizing the use cases
4© 2008 Open Grid Forum
Why Standardize?
• What is the value of implementing standards?• For vendors
• meet customer demand for interoperability
• For developers• leverage the expertise of other developers• offer a choice of tools and platforms in order to speed
implementations• only need to support one integration interface
• For end-users• reduce the costs and risks of adopting grid technology• get insight into the best practices of the industry at large
5© 2008 Open Grid Forum
Why Not Standardize?
• Standards are not always appropriate
• A technology might be “too new”• you stifle innovation with standardization,
which focuses on commonality
• A technology might be very niched• defacto standards will emerge in this case
6© 2008 Open Grid Forum
Where are we now?
• We have a sufficient corpus of specifications and profiles to realize (implement) identified use cases in computing and data.
• Customer (user) value of standards is increased when they permit interoperability between packages/systems/vendors and when concepts can be transferred from one system to another.
7© 2008 Open Grid Forum
Use case driven
• High-throughput computing• Within an organization with shared file
system – HPC-BP• Multi-site/organization
• Data federation/data grids• Flat file data• Structured (relational)
8© 2008 Open Grid Forum
Classic three layer view
API’s & interfaces, e.g. NFS, CIFS
Standard portypes
Resources Layer
Grid Services Layer
Access Layer
9© 2008 Open Grid Forum
Standard APIs vs Protocols
Workload Manager Client
Workload Manager
Native API
Native Protocol Engine
proprietaryAPI
proprietaryprotocol
Native Protocol Engine
DRMAA/SAGA
Native API
proprietaryprotocol
standardAPI
OGSA-BES
WS-I compliantSOAP toolkit
standardprotocol
OGSA-BES
WS-I compliantSOAP toolkit
DRMAA/SAGA
standardprotocol
standardAPI
OGSA-BES
WS-I compliantSOAP toolkit
standardprotocol
proprietaryAPI
Native API
10© 2008 Open Grid Forum
Standards
• Security• WSI-BSP, WS-Security, WS-Trust, WS-Federation, WS-
SecurityPolicy, WS-SecureNaming, WS-Secure Communication, others
• Infrastructure• WS-Addressing, Resource Namespace Services (RNS), WS-
Naming
• Compute• JSDL, OGSA-BES, HPC-BP
• Data• RNS, OGSA-Byte-IO, gridFTP, WS-DAI
• APIs• SAGA, DRMAA, GridRPC
11© 2008 Open Grid Forum
Simple HPC use case
run myjob
BES resource0
BES resource1
BES resource2
A simple “run” command (not defined by OGSA) generates a JSDL document describing the application to be run, its resource requirements, file inputs and outputs, etc. It interacts securely with a set of predefined BES resources using the OGSA Basic Security Profile 2.0, authenticating the client to the BES resources and the BES resources to the client .
Data publisher
Windows
JSDL can specify data stagingOr use RNS/GFS file system
WSI-BSP, X.509, etc
BES/Queue
12© 2008 Open Grid Forum
Data publisher
Mapping data into the Grid
Data clients Data clients
LinuxWindowsWindows
• Links directories and files from source location to data grid directory and user-specified name
• Presents unified view of the data across platforms, locations, domains, etc.
• Data publisher controls authorization policy.
Data publisherData publisher
13© 2008 Open Grid Forum
Relational data
• Can be proxied and accessed using WS-DAI with EPRs and RNS paths
• Results of queries also have EPR’s
14© 2008 Open Grid Forum
Data federation use-case
User certificate
Grid-proxy
RNS name space with references to OGSA-ByteIO and WS-DAI resources
RNS name space with references to OGSA-ByteIO and WS-DAI resources
Legacy application
Grid aware shim
Grid name space can be mapped into local file system, e.g., /uva-genii
15© 2008 Open Grid Forum
Data federation use-case - Windows
User certificate
Grid-FS proxy
RNS name space with references to OGSA-ByteIO and WS-DAI resources
RNS name space with references to OGSA-ByteIO and WS-DAI resources
Windows FS
Windows IFS
Grid name space can be mapped into local file system, e.g., /uva-genii
16© 2008 Open Grid Forum
Interop – it takes two
• Not only must the service present the right porttype – e.g., BES
• It must also understand and use the same security infrastructure – and not choke on the XML
17© 2008 Open Grid Forum
Interop – it takes two
• One group or implementation inter-operating with itself is not interesting
• Why should two different infrastructures interoperate?• maybe there is a need for interoperability within
the infrastructure if multiple vendors solutions are deployed
• Why should grid middleware vendors bother to interoperate?
18© 2008 Open Grid Forum
Spec AdoptionProject/Spec
WS-Naming
RNS
OGSA-BESOGSA-ByteIO
WS-DAI
OGSA-BSP 2.0
JSDL
WSRF Basic
Profile
HPC Basic
ProfileSRM
Globus ? yes yes yesUnicore 6 no yes yes yesFujitsu USMT will yes yes yes yesMicrosoft CCS yes yes yesGenesis II yes yes yes yes no will yes yes yesMarty yes yes yesOMII-UK yes yes yes yesGridSAM yes yes yesCrown yes yes yesPlatform yes yes yesOGSA-DAI yes yesNAREGI No May Yes May Yes yesOsamu yesgLite
19© 2008 Open Grid Forum
Full Copyright Notice
Copyright (C) Open Grid Forum (2008). All Rights Reserved.
This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works.
The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees.