29
© DSRG 2001 www.cs.agh.edu.pl Cross Grid Workshop - Kraków 2001 1 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

  • View
    217

  • Download
    2

Embed Size (px)

Citation preview

Page 1: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 1

Krzysztof Zieliński, Sławomir Zieliński

University of Mining and Metallurgy

{kz, slawek}@ics.agh.edu.pl

Page 2: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 2

Our contribution to the project will include network infrastructure monitoring tools. What we are especially interested in is as follows:

• collecting information about network and it’s nodes’ load and activities

• managing the network architecture

We are not going to concentrate on application monitoring.

The software we are going to develop will support network management applications (e.g. performance metering), as well as network-aware computational ones (e.g. task scheduling).

Page 3: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 3

Servers, Networks & Node OSes

Application Services Core

ServicesDRM

• Core Services: Grid Environmental services

• Distributed Resource Management (DRM): Management of work and computing resources

• Application Services: Support those applications programmed for Grid

Applications DSRG’s contribution

Page 4: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 4

Remote data access, transfer, replication and caching

Resource accounting; capacity planning; QoS reporting

Resource monitoring and alarming; app monitoring, event automation; system management

Work scheduling; load balancing; sharing policies; resource clustering and access control; resource reservation; remote execution; fault tolerance for work

Description

Workload Management

Data Management

Performance Management

Resource Management

Function

Page 5: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 5

Event driven system

Publish – subcribe pattern implementation

Asynchronous notification

Event delivery subsystem with in-built QoS

Powerfull filtering mechanisms

Page 6: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 6

Portablity across different operating system: Linux, Solaris, Windows, etc.

Configurability

Scalability

Manageability

JMX and Jiro usage

Page 7: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 7

SNMP – de-facto standard

SNMP Gateway Agent should be constructed

Page 8: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 8

Agent

Agent

JiroStation

SNMPService

LogService

EventService

LookupService

Lookup S ervice B rowser

Lookup S ervice B rowser

SNMPDevice

Deployer

Monitor

DeployLookupSNMPService

Agent specific function

Page 9: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 9

:SNMPService :Agent :LogService :EventService :Client

write log

send event

subsrcibe event

send event

SNMPPollData

getAgentProxy

Run agent specyfic function

:External Device

Poll Data

Page 10: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 10

Page 11: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 11

Page 12: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 12

Page 13: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 13

Page 14: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 14

Jiro pieces in Common with Jini

The Jiro implementation takes advantage of Jini by using some of its interfaces and implementation code (not a requirement of the FMA).

These parts of Jiro are parts of Jini:• Leasing• Lookup Service• Transaction Service

Valid in Jiro ==> valid in Jini

Page 15: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 15

Where Jiro extends Jini (I)

Stations include:• Acceptor-Referent pattern supports:

– Remote static invocation– Remote constructors– Context mechanism for security, transactions, controllers

and logical threads

• Remote deployment of services– Get the jar files into the right locations with the right RMI-

codebase property set.

Page 16: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 16

Where Jiro extends Jini (II)

• Extended Services– Event Service

• Instead of 1-n source-listeners there is n-1-n sources-service-observers/responsibles

• New Services– Logging of messages– Scheduling of events– Persistence of services– Security (based on JAAS) of method calls– Controllers and Logical Threads

Page 17: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 17

Page 18: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 18

Client runs the Lookup Service Browser

Prerequisites:• start Jiro environment• deploy TeleCons into Jiro-station• register TeleCons in Lookup Service

System Usage

Page 19: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 19

Lookup S ervice B rowser

TeleCons Proxy

dow

nlo

ad

Jini Layer

Jiro Layer

Client Layer

Lookup Service Browser is the mean of getting TeleCons Proxy.

Provides:• easy usage of service• user friendly UIs• displays actual system’s state

Lookup Service

TeleCons Item

Base Services

TeleCons Serviceregister re

gist

er

Page 20: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 20

Client A

ServerLookup Service

Register

RMILookup Service B rowser

Browser

Lookup

Download

TeleCon.

Client B

TeleConProxy

Lookup Service B rowser

BrowserTeleCon

Proxy

TeleConProxy

Download

Lookup

MM-stream

Page 21: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 21

Client B

Client A

doctorA

*****

doctorB

*****

Page 22: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 22

Client B

Client A

Clicking Agree means that all

Conference parameters

have been negotiated.

The Multimedia TeleConsulting begins

Page 23: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 23

Page 24: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 24

How does it work?

Page 25: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 25

Communication Components

• Connectorsestablish a point-to-point connection beetwen an agent and a management application, each running in a separate JVM.

– Connector Heartbeat

allows both the agent and manager applications to detect when a connection is lost.

• Proxy MBeans• Protocol Adaptors

Translation between different protocols.

Page 26: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 26

The Notification Model• Local and Remote Listeners

Page 27: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 27

Security• Password protection

(Mostly manager applications).

• SNMP Access Control Lists (e.g. List of authorised managers’ hosts names).

• HTTP/HTTPS• Context Checking

(The context could be an arbitrary object that your code can use to determine whether or not to allow the request).

• Secure Dynamic Loading

Page 28: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 28

SNMP toolkit• Simple Network Managemet Protocol

– Integrates SNMP managemet into JMX-based architecture.

– Representing SNMP MIB (Mangement Information Base) as Mbeans.

Page 29: © DSRG 2001 Cross Grid Workshop - Kraków 20011 Krzysztof Zieliński, Sławomir Zieliński University of Mining and Metallurgy {kz, slawek}@ics.agh.edu.pl

© DSRG 2001 www.cs.agh.edu.pl

Cross Grid Workshop - Kraków 2001 29