39
Open Cloud eXchange (OCX) Draft Proposal and Progress GN3plus JRA1 Task 2 - Network Architectures for Cloud Services Yuri Demchenko SNE Group, University of Amsterdam 10 October 2013, GN3plus Symposium, Vienna

Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Open Cloud eXchange (OCX)

Draft Proposal and Progress

GN3plus JRA1 Task 2 - Network Architectures for Cloud Services

Yuri Demchenko

SNE Group, University of Amsterdam

10 October 2013, GN3plus Symposium, Vienna

Page 2: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Outline

• GN3+ JRA1: Network Architectures for Horizon 2020

• General use cases and scenarios for Cloud services delivery to NRENs

and universities

– Cloud and Intercloud Infrastructure and Services

• Open Cloud eXchange (OCX)

– Requirements to OCX

– OCX design principles and suggestions

• Pilot implementation by SURFnet

– GreenQloud and OneXS

• Topics for discussion

• Additional information

– Intercloud Architecture Framework (ICAF) and Intercloud Federation Framework (ICFF)

GN3Plus Symposium Open Cloud eXchange (OCX) Slide_2

Page 3: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

JRA1: Network Architectures for Horizon 2020

• Task 0: Activity Leadership

• Task 1: Future Network Architectures

• Task 2: Network Architectures for Cloud Services

• Task 3: Network Architecture for Aggregating High-

Speed Mobile Networking

GN3Plus Symposium Open Cloud eXchange (OCX) 3

Page 4: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

JRA1 Goals and Tasks

• Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses and research organisations and includes 3 parts/layers

– The user access network, which connects users to applications.

– Extreme high-speed networks, which interconnect physical servers and the movement of their virtual machines (VMs).

– Mega pipe networks, interconnecting storage tiers.

• JRA1 Task2 and Task 1 will investigate and propose the best architecture for practical NADI implementation

– To support cloud-based services, including the distribution of very large scientific data

– Pilot implementation and demonstration of few use cases

• JRA1 and JRA2 will cooperate on multiple topics – Network virtualisation and automation to deliver Performance on Demand by automating the

allocation of shared network resources among data centres on behalf of cloud operations

– JRA1’s focus on the network elements to support cloud-based services interconnection and integration, with focus on the southbound elements of the management and related control plane when interworking with the software-driven network elements

– JRA2 will research true software-driven networking for cloud-based services, with automated resource orchestration and provisioning that yield reduced network capacity requirements, predictable service performance, and simpler operations

GN3Plus Symposium Open Cloud eXchange (OCX) 4

Page 5: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Use Cases for delivering Cloud services to

campus based users

• Scientific application and scientific data – LHC/HEP, genomics, astronomy, climate, video, etc. (+long tail

science)

• Streaming high-speed high volume experimental data to labs in campus location – Direct links through campus network

• Distributed (Big) Scientific Data processing with MPP tools on distributed facilities – Data distributed between few locations next to local datacenters

• CSP and campus L0-L2 (L3) network peering – Dark fiber with termination as campus network or as CSP network

• VoIP – SURFnet approach with mobile data access – Support mobile access network (LTE) and tunnel access to campus

network

GN3Plus Symposium Open Cloud eXchange (OCX) 5

Page 6: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

General use case for infrastructure provisioning:

Workflow => Logical (Cloud) Infrastructure

GN3Plus Symposium Open Cloud eXchange (OCX) 6

Input

Data

Instrum.

Data

Data

Filtering

Special

Proc 1

Storage

Data

Special

Proc 2

Data

Archive

Visual

Present

Enterprise/Scientific workflow

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Enterprise/Project based

Intercloud Infrastructure

Cloud 1 IaaS

Cloud 2 PaaS

Enterprise/Scientific

workflow

Is mapped

to heterogeneous cloud

infrastructure containing

IaaS, PaaS components

Page 7: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Multi/inter- cloud infrastructure provisioning:

=> ICADI and OCX functions

GN3Plus Symposium Open Cloud eXchange (OCX) 7

Input

Data

Instrum.

Data

Data

Filtering

Special

Proc 1

Storage

Data

Special

Proc 2

Data

Archive

Visual

Present

Enterprise/Scientific workflow

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Enterprise/Project based

Intercloud Infrastructure

Cloud 1 IaaS

Cloud 2 PaaS

Open Cloud eXchange

(OCX) interconnects

CSP and Customer

(campus) infrastructures

OCX assumes collocation

or collapsed backbone for

connecting all OCX members

OCX as a part of GEANT infrastructure

OCX

at NREN OCX

at NREN

Intercloud infrastructure:

=> Federated Access

and Delivery

Infrastructure

Page 8: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Multilayer Cloud Services Model (CSM) http://www.ietf.org/id/draft-khasnabish-cloud-reference-framework-05.txt

GN3Plus Symposium Open Cloud eXchange (OCX) Slide_8

CSM layers (C6) User/Customer side

Functions

(C5) Intercloud Access and

Delivery Infrastructure

(C4) Cloud Services

(Infrastructure, Platform,

Applications)

(C3) Virtual Resources

Composition and

Orchestration

(C2) Virtualisation Layer

(C1) Hardware platform and

dedicated network

infrastructure

Control/

Mngnt Links

Data Links

Network

Infrastructure Storage

Resources

Compute

Resources

Hardware/Physical

Resources

Proxy (adaptors/containers) - Component Services and Resources

Virtualisation Platform VMware XEN Network

Virtualis KVM

Cloud Management Platforms

OpenStack OpenNebula Other

CMS

Cloud Management

Software

(Generic Functions)

VM VPN VM

Layer C6

User/Customer

side Functions

Layer C5

Services

Access/Delivery

Layer C4

Cloud Services

(Infrastructure,

Platforms,

Applications,

Software)

Layer C2

Virtualisation

Layer C1

Physical

Hardware

Platform and

Network

Layer C3

Virtual Resources

Composition and

Control

(Orchestration)

IaaS – Virtualisation Platform Interface

IaaS SaaS

PaaS-IaaS Interface

PaaS PaaS-IaaS IF

Cloud Services (Infrastructure, Platform, Application, Software)

1 Federated Access and

Delivery Infrastructure (FADI)

Endpoint Functions

* Service Gateway

* Portal/Desktop

Inter-cloud Functions

* Registry and Discovery

* Federation Infrastructure

Se

cu

rity

In

fra

str

uctu

re

Ma

na

gem

ent

Op

era

tio

ns S

up

port

Syste

m

User/Client Services

* Identity services (IDP)

* Visualisation

User/Customer Side Functions and Resources

Content/Data Services

* Data * Content * Sensor * Device

Administration and

Management Functions

(Client)

Data Links Contrl&Mngnt Links

Page 9: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

General use case for infrastructure provisioning:

Logical Infrastructure => Network Infrastructure (2)

GN3Plus Symposium Open Cloud eXchange (OCX) 9

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Enterprise/Project based

Intercloud Infrastructure

Cloud 1 IaaS

Cloud 2 PaaS

Provisioning network

infrastructure may

involve multiple providers

Introducing OCX

(Open Cloud eXchange)

Resource and Cloud Provider Domains

Campus A

Infrastructure Campus B

Infrastructure

Cloud Carrier or Network Provider 2

Network Provider 1

VR1 VR3 VR5

VR4 VR2 VR6

VR7

OCX at Cloud Carrier or Network

Provider (NREN) level

Page 10: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX Definition and Operational Principles

• Direct service/inter-member peering – Re-use and leverage Internet eXchange

– Open collocation services

– Scalability for growing number of members

– Controlled network parameters/QoS

• No third party (intermediary/broker) services – Transparency for cloud based services

– No involvement into peering or mutual business relations

• Trusted Third Party (TTP) – To support dynamic service agreements and/or federation establishment

– Trusted Introducer for dynamic trust establishment

• May include other special services to support smooth services delivery and integration between CSP and Customer – E.g., Local policies, service registry and discovery

GN3Plus Symposium Open Cloud eXchange (OCX) 10

Page 11: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX Topological model and Connectivity

OCX L0-L2/L3 topology

• Any-to-any

• Distributed or collapsed backbone

• Hierarchical

• Topology information exchange

L0-L2 + L3? between members

• SDN control over OCX switching

QoS parameters

• Bandwidth

• Speed, latency

• Jitter, impairment

GN3Plus Symposium Open Cloud eXchange (OCX) 11

OCX

Nodes: Providers and customers

OCX OCX Facilities

OCX OCX backbone links/connectivity

(Lo-L2)

Page 12: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX Trusted Third Party services

TTP goals and services

• Enable dynamic federations establishing

• Trusted Certificates and CA’s Repository

– Similar to TACAR (TERENA Academic CA Repository)

• Trusted Introducer Service – Trusted Introduction Protocol

• Service Registry and Discovery

• Intercloud policy clearinghouse – Repository of CSP policies

– Common policy template

• SLA repository and clearinghouse

GN3Plus Symposium Open Cloud eXchange (OCX) 12

OCX

TTP

Pre-established trust relation with OCX as TTP

Trust relations established as a part of

dynamic federation between OCX members

Page 13: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX location options: GN3, NREN (+University?)

GN3Plus Symposium Open Cloud eXchange (OCX) 13

CSP GEANT NREN University

L0

L1

DFlow

IP/L3

L2

OCX

OCX

VR3

VR5

VR4

VR6

VR7

VR3

VR5

VR4

VR6

VR7

Visuali-

sation

User User User

CE

Visuali-

sation

User User User

CE

Page 14: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX Hierarchical Topology Model

GN3Plus Symposium Open Cloud eXchange (OCX) 14

CSP GEANT NREN University

L0

L1

DFlow

IP/L3

L2

OCX

OCX

VR3

VR5

VR4

VR6

VR7

VR3

VR5

VR4

VR6

VR7

Visuali-

sation

User User User

CE

Visuali-

sation

User User User

CE

Page 15: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX Extended Backplane Topology Model

GN3Plus Symposium Open Cloud eXchange (OCX) 15

CSP GEANT NREN University

L0

L1

DFlow

IP/L3

L2

OCX

VR3

VR5

VR4

VR6

VR7

VR3

VR5

VR4

VR6

VR7

Visuali-

sation

User User User

CE

Visuali-

sation

User User User

CE

OCX

Page 16: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Pilot OCX Concept Implementation by SURFnet

• NetherLight as an Open Lightpath Exchanges (OLE) operated by SURFnet – To Bandwidth on Demand, Virtual Networking

– 100G transatlantic trials, and

– Open Cloud eXchange (OCX) pilot/prototype

• Since 2012, SURFnet and NetherLight have been performing pilots with cloud

providers that want to offer their services with lightpath characteristics to

SURFnet connected institutions

• GreenQloud (Iceland) offers service delivery over lightpaths via

NetherLight/SURFnet with advantages above the regular IP services – Guaranteed bandwidth and latency

– Protected from the external Internet

– Possibility of domain extension (VM’s appear as if inside campus network)

– Cost reduction due to offloading of traffic

• Pilot since 2012 between OneXS and Windesheim University of Applied Sciences

to deliver unified services of fixed and mobile telephony – Guaranteed bandwidth and latency

– Protected from the external Internet

– Protected from DDOS attacks

GN3Plus Symposium Open Cloud eXchange (OCX) 16

Page 17: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

General SURFnet Lightpath interconnection

• GeenQloud: cloud services

• OneXS: unified services of fixed and mobile telephony

GN3Plus Symposium Open Cloud eXchange (OCX) 17

Universities

Page 18: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

OCX Development – Next Steps (for Discussion)

• First public draft – 12 September 2013

• GN3plus inter-activities discussion and feedback – 17 May 2013 - First draft published

– June 2013 - First round of comments and update

– Sept 2013 - Second round of comments and update

– Sept - Oct 2013 - External comments and community feedback

• Design and implementation – Starting November 2013? – SDN based control and management over OCX

• Standardisation contribution – OGF, IETF, ITU-T, IEEE, NIST – IEEE Intercloud Testbed Initiative as a dissemination and

validation channel -

GN3Plus Symposium Open Cloud eXchange (OCX) 18

Page 19: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Discussion

• Network for Clouds or for future Big Data applications (cloud based)? – eScience use cases need to be analysed and new

requirements identified

– Trends in university’s and research services use

• SDN vs Software Defined Infrastructure – Big Data data-centric applications will require data

structures and processing workflow to be mapped to infrastructure

• Distributed storage, distributed processing, security, lifecycle/staging, etc.

• Lower layer infrastructure virtualisation

GN3Plus Symposium Open Cloud eXchange (OCX) 19

Page 20: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Gartner Technology Hypercycle

Source http://www.gartner.com/technology/research/methodologies/hype-cycle.jsp

GN3Plus Symposium Open Cloud eXchange (OCX) 20

Big Data

Cloud Computing

Page 21: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

GN3Plus Symposium Open Cloud eXchange (OCX) 21

5 yr for Cloud Computing

2 yr for Big Data adoption

Page 22: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Improved: 5+1 V’s of Big Data

GN3Plus Symposium Open Cloud eXchange (OCX) 22

• Trustworthiness

• Authenticity

• Origin, Reputation

• Availability

• Accountability

Veracity

• Batch

• Real/near-time

• Processes

• Streams

Velocity

• Changing data

• Changing model

• Linkage

Variability

• Correlations

• Statistical

• Events

• Hypothetical

Value

• Terabytes

• Records/Arch

• Tables, Files

• Distributed

Volume

• Structured

• Unstructured

• Multi-factor

• Probabilistic

• Linked

• Dynamic

Variety

6 Vs of

Big Data

Generic Big Data

Properties

• Volume

• Variety

• Velocity

Acquired Properties

(after entering system)

• Value

• Veracity

• Variability Commonly accepted

3V’s of Big Data

Page 23: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

From Big Data to All-Data – Paradigm Change

• Breaking paradigm changing factor – Data storage and processing

– Security

– Identification and provenance

• Traditional model – BIG Storage and BIG Computer with

FAT pipe

– Move compute to data vs Move data to compute

• New Paradigm – Continuous data production

– Continuous data processing

– DataBus as a Data container and Protocol

• Data centric infrastructure and service models

GN3Plus Symposium Open Cloud eXchange (OCX) 23

?

Big Data Big

Computer Network

Move or not

to move?

Data Bus

Visuali

sation

Presen

tation

Action

Distributed Compute

and Analytics

Infrastructure Abstraction

Distributed Big Data

Storage Data Abstraction

DataBus: (1) Data Container

(2) Metadata, State

(3) Data Transfer

Protocol

Page 24: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Big Data Ecosystem: Data, Transformation,

Infrastructure

GN3Plus Symposium Open Cloud eXchange (OCX) 24

Co

nsu

me

r

Data

Source

Data

Filter/Enrich,

Classification

Data

Delivery,

Visualisation

Data

Analytics,

Modeling,

Prediction

Data

Collection&

Registration

Storage

General

Purpose

Compute

General

Purpose

High

Performance

Computer

Clusters

Data Management

Big Data Analytic/Tools

Big Data Source/Origin (sensor, experiment, logdata, behavioral data)

Big Data Target/Customer: Actionable/Usable Data

Target users, processes, objects, behavior, etc.

Infrastructure

Management/Monitoring Security Infrastructure

Network Infrastructure

Internal

Intercloud multi-provider heterogeneous Infrastructure

Federated

Access

and

Delivery

Infrastructure

(FADI)

Storage

Specialised

Databases

Archives

(analytics DB,

In memory,

operstional)

Data categories: metadata, (un)structured, (non)identifiable Data categories: metadata, (un)structured, (non)identifiable Data categories: metadata, (un)structured, (non)identifiable

• Data management

infrastructure and tools

• Registries, search,

ontologies, schemas,

namespace

• Collaborative

Environment

• Heterogeneous multi-

provider Inter-cloud

infrastructure

• Federated Access and

Delivery Infrastructure

(FADI)

• High performance

(programmable)

network

• Security infrastructure

Page 25: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Big Data Infrastructure and Analytic Tools

GN3Plus Symposium Open Cloud eXchange (OCX) 25

Storage

General

Purpose

Compute

General

Purpose

Data Management

Big Data Source/Origin (sensor, experiment, logdata, behavioral data)

Big Data Target/Customer: Actionable/Usable Data

Target users, processes, objects, behavior, etc.

Infrastructure

Management/Monitoring Security Infrastructure

Network Infrastructure

Internal

Intercloud multi-provider heterogeneous Infrastructure

Federated

Access

and

Delivery

Infrastructure

(FADI)

Data categories: metadata, (un)structured, (non)identifiable Data categories: metadata, (un)structured, (non)identifiable Data categories: metadata, (un)structured, (non)identifiable

Big Data Analytic/Tools

Analytics:

Refinery, Linking, Fusion

Analytics :

Realtime, Interactive,

Batch, Streaming

Analytics Applications :

Link Analysis

Cluster Analysis

Entity Resolution

Complex Analysis

High

Performance

Computer

Clusters

Storage

Specialised

Databases

Archives

Page 27: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

GN3Plus Symposium Open Cloud eXchange (OCX) 27

Page 28: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Additional Information

GN3Plus Symposium Open Cloud eXchange (OCX) 28

Page 29: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Initiatives by the major CSP

• Amazon Direct Connect

• Google patent US 2012/0151057 A1 (January 2012)

Virtualised Connectivity in a Cloud Service Environment

• Microsoft Azure campus PoP (Point of Presence)

GN3Plus Symposium Open Cloud eXchange (OCX) 29

Page 30: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

New Service: Amazon Direct Connect

• AWS Direct Connect links

customer internal network to an

AWS Direct Connect location over

a standard 1 Gbps or 10 Gbps

Ethernet fiber-optic cable

– One end of the cable is connected

to customer router, the other to an

AWS Direct Connect router

– Allows creating virtual interfaces

directly to the AWS cloud (Amazon

EC2, S3) and to Amazon Virtual

Private Cloud (Amazon VPC),

bypassing Internet service

providers in your network path

• Access is limited to Amazon Web

Services in the region

5 Nov 2013, Chasopys, Kiev Cloud and Big Data 30

Page 31: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

InterCloud Architecture Framework (ICAF)

• Multi-layer Cloud Services Model (CSM) – Combines IaaS, PaaS, SaaS into multi-layer model with inter-layer interfaces

– Including interfaces definition between cloud service layers and virtualisation platform

• InterCloud Control and Management Plane (ICCMP) – Allows signaling, monitoring, dynamic configuration and synchronisation of the

distributed heterogeneous clouds

– Including management interface from applications to network infrastructure and virtualisation platform

• InterCloud Federation Framework (ICFF) – Defines set of protocols and mechanisms to ensure heterogeneous clouds

integration at service and business level

– Addresses Identity Federation, federated network access, etc.

• InterCloud Operations Framework (ICOF) – RORA model: Resource, Ownership, Role, Action

• RORA model provides basis for business processes definition, SLA and access control

– Broker and federation operation

• Intercloud Security Framework (ICSF) – Dynamic Security Infrastructure provisioning and protocols

GN3Plus Symposium Open Cloud eXchange (OCX) 31

Page 32: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Multilayer Cloud Services Model (CSM) http://www.ietf.org/id/draft-khasnabish-cloud-reference-framework-05.txt

GN3Plus Symposium Open Cloud eXchange (OCX) Slide_32

CSM layers (C6) User/Customer side

Functions

(C5) Intercloud Access and

Delivery Infrastructure

(C4) Cloud Services

(Infrastructure, Platform,

Applications)

(C3) Virtual Resources

Composition and

Orchestration

(C2) Virtualisation Layer

(C1) Hardware platform and

dedicated network

infrastructure

Control/

Mngnt Links

Data Links

Network

Infrastructure Storage

Resources

Compute

Resources

Hardware/Physical

Resources

Proxy (adaptors/containers) - Component Services and Resources

Virtualisation Platform VMware XEN Network

Virtualis KVM

Cloud Management Platforms

OpenStack OpenNebula Other

CMS

Cloud Management

Software

(Generic Functions)

VM VPN VM

Layer C6

User/Customer

side Functions

Layer C5

Services

Access/Delivery

Layer C4

Cloud Services

(Infrastructure,

Platforms,

Applications,

Software)

Layer C2

Virtualisation

Layer C1

Physical

Hardware

Platform and

Network

Layer C3

Virtual Resources

Composition and

Control

(Orchestration)

IaaS – Virtualisation Platform Interface

IaaS SaaS

PaaS-IaaS Interface

PaaS PaaS-IaaS IF

Cloud Services (Infrastructure, Platform, Application, Software)

1 Federated Access and

Delivery Infrastructure (FADI)

Endpoint Functions

* Service Gateway

* Portal/Desktop

Inter-cloud Functions

* Registry and Discovery

* Federation Infrastructure

Se

cu

rity

In

fra

str

uctu

re

Ma

na

gem

ent

Op

era

tio

ns S

up

port

Syste

m

User/Client Services

* Identity services (IDP)

* Visualisation

User/Customer Side Functions and Resources

Content/Data Services

* Data * Content * Sensor * Device

Administration and

Management Functions

(Client)

Data Links Contrl&Mngnt Links

Page 33: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

General use case for infrastructure provisioning:

Workflow => Logical (Cloud) Infrastructure

GN3Plus Symposium Open Cloud eXchange (OCX) 33

Input

Data

Instrum.

Data

Data

Filtering

Special

Proc 1

Storage

Data

Special

Proc 2

Data

Archive

Visual

Present

Enterprise/Scientific workflow

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Enterprise/Project based

Intercloud Infrastructure

Cloud 1 IaaS

Cloud 2 PaaS

Enterprise/Scientific

workflow

Is mapped

to heterogeneous cloud

infrastructure containing

IaaS, PaaS components

Page 34: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

General use case for infrastructure provisioning:

Logical Infrastructure => Network Infrastructure (1)

GN3Plus Symposium Open Cloud eXchange (OCX) 34

Campus A

Infrastructure

Cloud Carrier Network Infrastructure

VR1 VR3 VR5

VR4 VR2 VR6

VR7

Campus B

Infrastructure

Resource and Cloud Provider Domains

Cloud 1 IaaS Cloud 2 PaaS

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Enterprise/Project based

Intercloud Infrastructure

Cloud 1 IaaS

Cloud 2 PaaS

Distributed

heterogeneous cloud

infrastructure requires

separately provisioned

network infrastructure that

can be outsourced to Cloud Carrier

Page 35: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

General use case for infrastructure provisioning:

Logical Infrastructure => Network Infrastructure (2)

GN3Plus Symposium Open Cloud eXchange (OCX) 35

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Enterprise/Project based

Intercloud Infrastructure

Cloud 1 IaaS

Cloud 2 PaaS

Provisioning network

infrastructure may

involve multiple providers

Introducing OCX

(Open Cloud eXchange)

Resource and Cloud Provider Domains

Campus A

Infrastructure Campus B

Infrastructure

Cloud Carrier or Network Provider 2

Network Provider 1

VR1 VR3 VR5

VR4 VR2 VR6

VR7

OCX at Cloud Carrier or Network

Provider (NREN) level

Page 36: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Intercloud Applications Interaction (1) - ICCMP

AINA2013, 28 March 2013 InterCloud Architecture Framework 36

Layer 7 - Applications

Layer 6 – SaaS/Apps

Layer 5 - PaaS

Cloud based Platform

Layer 4 - IaaS

Cloud Infrastructure

Layer 2 - Virtualisation

Layer 1 - Physical

HW Platform/Network

Layer 3 - IaaS

User

defined

Platform

and

SW&Apps

Provider

defined

Virt&OS

Platform

Layer 4 - PaaS

User

defined

SW&Apps

Provider

defined

Infrastr.

and

Virt&OS

Platform

InterCloud Control and

Management Plane

(ICCMP)

Cloud Layers PaaS Domain IaaS Domain

Layer 3 – Composition

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

Enterprise/Project based

Intercloud Infrastructure

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

Cloud 1 IaaS

Cloud 2 PaaS

Consistent and tight

management of

the heterogeneous

cloud infrastructure requires

Intercloud Control and

Management Plane (ICCMP)

ICCMP – InterCloud Control

and management Plane

Page 37: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Intercloud Applications Interaction (2) - ICFF

AINA2013, 28 March 2013 InterCloud Architecture Framework 37

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

Enterprise/Project based

Intercloud Infrastructure

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

Cloud 1 IaaS

Cloud 2 PaaS

Layer C3-IaaS

User

SW&Apps

Provider

Virt&OS

Platform

PaaS Domain IaaS Domain

LayerC4-PaaS

User

SW&Apps

Provider

Virt&OS

Platform

Intercloud Federation

Infrastructure

Registry

GW GW

Trust

Trust

Broker

Disco-

very

Attribs

IdP

Trust

Broker

Broker Broker

Independently

managed cloud domains

may use federated

model for resources and

processes integration and

interoperation

ICFF – InterCloud

Federation Framework

Page 38: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Intercloud Federation Infrastructure and OCX

GN3Plus Symposium Open Cloud eXchange (OCX) 38

Broker

Trust Broker

(I/P/S)aaS

Provider

AAA

Gateway

IDP

Broker

Trust Broker

(I/P/S)aaS

Provider

AAA

Gateway

IDP

(I/P/S)aaS

Provider

AAA

Gateway

IDP

(I/P/S)aaS

Provider

AAA

Gateway

IDP

FedIDP

OCX

Services

Directory (RepoSLA)

Directory (RepoSLA)

Discovery OCX Interconnection

and Switching Facility

Cloud Service Broker

Cert Repo (TACAR) TTP Trusted

Introducer

Federated Cloud

Instance Customer A

(University A)

Federated Cloud

Instance Customer B

(University B)

Page 39: Open Cloud eXchange (OCX) - UAZone.org · 10/10/2013  · • Network Access and Delivery Network Infrastructure (NADI) plays important role in delivering cloud services to campuses

Intercloud Applications Integration (3) - ICOF

AINA2013, 28 March 2013 InterCloud Architecture Framework 39

VR1

VR3

VR5

VR4

VR2 VR6

VR7

Visuali-

sation

User

Group A

Campus A

User User User

CE

Visuali-

sation

User

Group B

Campus B

User User User

CE

Enterprise/Project based

Intercloud Infrastructure

CN

CN

CN

CN

CN

CN

CN

CN CN

CN

CN

Cloud IaaS Provider

Cloud PaaS Provider

Resource/

Service

Provider

Resource/

Service

Provider

Cloud 1 IaaS

Cloud 2 PaaS

Layer 7 - Applications

Layer 6 – SaaS/Apps

Layer 5 - PaaS

Cloud based Platform

Layer 4 - IaaS

Cloud Infrastructure

Layer 2 - Virtualisation

Layer 1 - Physical

HW Platform/Network

Layer 3 - IaaS

User

defined

Platform

and

SW&Apps

Provider

defined

Virt&OS

Platform

Layer 4 - PaaS

User

defined

SW&Apps

Provider

defined

Infrastr.

and

Virt&OS

Platform

Cloud Layers PaaS Domain IaaS Domain

Layer 3 – Composition

Input

Data

Instrum.

Data

Data

Filtering

Special

Proc 1

Storage

Data

Special

Proc 2

Data

Archive

Visual

Present

Layer C3-IaaS

User

SW&Apps

Provider Virt&OS

Platform

LayerC4-PaaS

User

SW&Apps

Provider Virt&OS

Platform

Intercloud Federation

Infrastructure

Registry

GW GW

Trust

Trust

Broker

Disco-very

Attribs

IdP

Trust

Broker

Broker Broker

Business Processes Management and Services

Operation Support

• SLA Management

• Business roles and Actors

• Business level Service Registry and Broker

• Mobility?

Operational and

business issues are

typically addressed

by Operations services and

a framework

ICOF – InterCloud

Operations Framework