9
Market for Computational Market for Computational Services Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West [email protected]

Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West [email protected]

Embed Size (px)

Citation preview

Page 1: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

Market for Computational Market for Computational ServicesServices

Resource Brokering, Scheduling and Accounting

John Ainsworth, e-Science North [email protected]

Page 2: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West2

Project Aims

The majority of Grid deployments are closed– The usage of resources relies on charity or exchange

A model based on a common currency is required to increase availability and utilisation

The aim of the Markets for Computational Services (MCS) project is to develop software that provides the mechanisms from which computational markets can be built– Namely brokering, negotiating, contracting, accounting and payment.

Free market dynamics will then determine what happens…

Page 3: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West3

Technologies

Originally based firmly on OGSI Transition from OGSI -> WSRF gave reason to rethink our

choice We are now using plain web services with J2EE container WS-Security with X.509 certificates is used for

authentication SSL used for secure transmission

Page 4: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West4

ArchitectureProviderIntermediaryConsumer

Job Submission

Service

UnderlyingService

ServiceDirectory

Submit

User Agent

Resource Usage Service

Advertise

RequestQuote

RequestQuote

Resource Broker

Lookup

Retrieve Usage RecordsAccountViewer

Quote Service

CheckResources

RecordUsage

Page 5: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West5

Demonstration Configuration

User Agent

RB-I

RB-R

Resource Broker I

SD-A

QS Altix

QS Origin

Quote ServiceAltix

Quote ServiceOrigin

QuoteService Re-seller

Re-seller

IndependentBroker

Job Submission

ServiceAltix

Job Submission

Service Origin

Resource Usage

Service Altix

Resource Usage

Service Altix

Altix

Origin

Altix

Origin

OriginService Provider

Altix Service Provider

RFQ

RFQ RFQ

RFQlookup

Page 6: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West6

Demonstration Configuration

User Agent

RB-I

RB-R

Resource Broker I

SD-A

QS Altix

QS Origin

Quote ServiceAltix

Quote ServiceOrigin

QuoteService Re-seller

Re-seller

IndependentBroker

Job Submission

ServiceAltix

Job Submission

Service Origin

Resource Usage

Service Altix

Resource Usage

Service Altix

Altix

Origin

Altix

Origin

OriginService Provider

Altix Service Provider

Quote

QuoteQuote

Quote

Page 7: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West7

Demonstration Configuration

User Agent

RB-I

RB-R

Resource Broker I

SD-A

QS Altix

QS Origin

Quote ServiceAltix

Quote ServiceOrigin

QuoteService Re-seller

Re-seller

IndependentBroker

Job Submission

ServiceAltix

Job Submission

Service Origin

Resource Usage

Service Altix

Resource Usage

Service Altix

Altix

Origin

Altix

Origin

OriginService Provider

Altix Service Provider

JSDL

BSUB

UR

Page 8: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North West8

Future Work

Resource Usage Server usability and functionality enhancements

Advanced reservation and demand-led pricing Work flow scheduling and negotiation Integration with LeSC banking service

Page 9: Market for Computational Services Resource Brokering, Scheduling and Accounting John Ainsworth, e-Science North West john.ainsworth@manchester.ac.uk

e-Science North Weste-Science North Westwww.esnw.ac.ukwww.esnw.ac.uk

Research Support Services Group, Manchester Computing, University of Manchesterwww.sve.man.ac.uk