Seminar Grid Computing ‘05

Hui LiSep 19, 2005

Overview

• Brief Introduction• Presentations• Projects• Remarks

Grid Definition

• a Grid is "a set of information resources (computers, databases, networks, instruments, etc.) that are integrated to provide users with tools and applications that treat those resources as components within a 'virtual' system". Grid software solutions provide the underlying mechanisms necessary to create such systems, including authentication and authorization, resource discovery, resource management, communications, and information services, etc.

• Keywords: Virtualization, Middleware

Historically Speaking …

NetworkingARPANET

Communications and Data Sharing:Email, ftp, telnet, TCP/IP

Information Sharing:WWW, HTTP, HTML

Resource Sharing:P2P, Web Services, Grids

Why *?

• Why Grids?– Think beyond only information– Next step in networked computing

• Why now?– CPU, storage, networking– Academic, Commercial, Governmental,

Personal– $funding$

Futuristically Speaking

• Post Internet• Grid Computing, Ubiquitous

Computing, Personal Computing• $10 bn (IDG)?

Grid Checklist

• Coordinates resources that are not subject to centralized control

• Using standard, open, general-purpose protocols and interfaces

• To deliver nontrivial qualities of service (Performance)

• Security is a *serious* concern

The Evolution of Grid Software (Globus)

Pre-WSAuthenticationAuthorization

GridFTP

GridResource

Allocation Mgmt(Pre-WS GRAM)

Monitoring& Discovery

System(MDS2)

C CommonLibraries

GT2

WSAuthenticationAuthorization

ReliableFile

Transfer

OGSA-DAI[Tech Preview]

GridResource

Allocation Mgmt(WS GRAM)

Monitoring& Discovery

System(MDS4)

Java WS Core

CommunityAuthorization

ServiceGT3

ReplicaLocationService

XIO

GT3

Data Management

SecurityCommonRuntime

Execution Management

Information Services

Web Services

Components

Non-WS

Components

CredentialManagement

GT4

Python WS Core[contribution]

C WS Core

CommunitySchedulerFramework

[contribution]

DelegationService

GT4

State of the Art and Beyond:Service Oriented Architecture (SOA)

IBM

IBM

GRAM GridFTPHost EnvUser Svc

ReliableFile

Transfer

MyProxy

Uniform interfaces,security mechanisms,Web service transport,

monitoring

Host EnvUser Svc

Computers StorageSpecialized resource

UserApplication

UserApplication

UserApplication

IBM

IBM

DAIS

Database

MDS-Index

ToolTool

The Evolution of the Grid Seminar

• 2001 - first seminar, p&p structure, parallel applications

• 2003 - continuation• 2004 - p&p structure, system centric

- LUCGrid• 2005 - p&p structure, development &

research Goal: Group learning, interaction &

discussion, R & D

Presentations

• 3 or 4 presentations each class• ~30 minutes per presentation• 20-25 minutes talk, 5-10 minutes

discussion• Participation and discussion are

highly promoted, and they will be counted in grading (15%)

• “Non-trivial” questions

Topics at a Glance

Data Management

Security

Resource Management

Information Services

Architecture

Applications

Presentation Topics

• Resource Management– Superscheduling and Resource Brokering– Workload and Resource Management

Systems– State Estimation and Performance

Predictions– Fabric and Local Resource Management

Presentation Topics (Cont’d)

• Information Services– Grid Information Services and Systems– Information Retrieval, Dissemination,

and Search– Cluster Resource Monitoring– Network Measurement and Monitoring

Presentation Topics (cont’d)

• Security– Authentication and GSI– Authorization and Virtual Organizations– WS-Security– Firewall Issues

Presentation Topics (cont’d)

• Data Management– Data Transport and Access– Data Storage and Replica Management– High Performance Networking

Presentation Topics (cont’d)

• Architecture– Open Grid Services Architecture (OGSA)– Web Services and WSRF– P2P and Grid

Presentation Topics (cont’d)

• Applications– Grids and Application Scenarios– Common Runtime– Programming Environments– Grid Portals

Break

Projects

• Deployment and Maintenance• Development/Software• Research

Project 1

• Maintaining and Extending the LUCGrid (deployment)

Project 2

• Search in Grid Spaces (research)• A web-based search interface

deployed in J2EE application server (software)

Project 3

• Web Service Interfaces for Dynamic Information Publishing (software)

Project 4

• Storage Resource Broker

Project 5

• Applications– HIRLAM: A Parallel Weather Forecasting

Model – Programming GT4 Java WS core in a LAN

environment.

Project 6

• Security (NIKHEF)

Your idea matters