Contrail Virtual Execution Platform
Yvon Jegou
September 25th 2013
Myriads Research TeamINRIA Rennes Bretagne-Atlantique
France
OpenNebula Conf 2013, 24-26 September in Berlin
Outline
Context: the Contrail project
Contrail Virtual Execution Platform
Service Level Agreements and derived execution environments
VEP and OpenNebula
Contrail VEP/1 contrail-project.eu
Context: Contrail ProjectOpen Computing Infrastructures for Elastic Services
Contrail project objectives
Development of an integrated approach to virtualization o�ering
services for federating IaaS clouds and PaaS services on top of
federated clouds
Challenges
Integration of resources from multiple IaaS providers
Trust, service level agreements (SLA)
Elasticity (pay-as-you-go)
Scalability
Portability, interoperability
Security
Contrail VEP/2 contrail-project.eu
VEP in the Contrail Software Stack
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
VEP: Virtual Execution Platform
VEP sits between the
infrastructure and higher-level
layers: federation and SLA
management
VEP provides a high level
interface for application
management on heterogeneous
providers
VEP integrates SLA support
Contrail VEP/3 contrail-project.eu
VEP in the Contrail Software Stack
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
VEP: Virtual Execution Platform
VEP sits between the
infrastructure and higher-level
layers: federation and SLA
management
VEP provides a high level
interface for application
management on heterogeneous
providers
VEP integrates SLA support
Contrail VEP/3 contrail-project.eu
VEP and Contrail Federation Layer
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
Each VEP is in charge of
managing applications on an
IaaS o�er on behalf of the
federation
Provides a high level uniformview of the infrastructure to thefederation
deploymentelasticity managementsnapshot
Participates to provider selection
by the federation
Monitors the application on the
infrastructure
Contrail VEP/4 contrail-project.eu
VEP and Contrail Federation Layer
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
Each VEP is in charge of
managing applications on an
IaaS o�er on behalf of the
federation
Provides a high level uniformview of the infrastructure to thefederation
deploymentelasticity managementsnapshot
Participates to provider selection
by the federation
Monitors the application on the
infrastructure
Contrail VEP/4 contrail-project.eu
VEP and Service Level Agreements
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
VEP provides support for SLA
negotiation: terms which can be
enforced, guarantees about
resource availability, ...
VEP allocates resources in-line
with agreed SLA terms
(localization, a�nity,
performance, ...)
VEP in charge of the monitoring
con�guration
Negotiated SLAs translated in
VEP using Constrained
Execution Environments
Contrail VEP/5 contrail-project.eu
VEP and Service Level Agreements
Contrail federation
SLA management
and enforcement
VEP: Virtual Execution Platform
IaaS
VEP provides support for SLA
negotiation: terms which can be
enforced, guarantees about
resource availability, ...
VEP allocates resources in-line
with agreed SLA terms
(localization, a�nity,
performance, ...)
VEP in charge of the monitoring
con�guration
Negotiated SLAs translated in
VEP using Constrained
Execution Environments
Contrail VEP/5 contrail-project.eu
VEP as an Independent Service
VEP can be exploited as an independent service
RESTful APIcan be exploited using a web browser
VEP manages applications as a whole
not just VMs
VEP application packaging: OVF format
OVF: Open Virtualization Format, a DMTF standardDistributed applications made of virtual machines (or containers),storage and networksOVF integrates
con�guration and deployment rules
means to contextualize virtual machines
VEP can exploit OVF application marketplaces
Contrail VEP/6 contrail-project.eu
VEP as an Independent Component (2)
Typical lifecycle of a VEP application
Virtual system disk image handling, external �lesApplication con�gurationExecution environment speci�cationResource need evaluationResource allocation (constraint-aware)ContextualizationDeploymentElasticity managementCheckpointing (potentially in OVF format)
Advance reservation of resources
Performance management and resource allocation constraints
VEP Constrained Execution Environments
Contrail VEP/7 contrail-project.eu
VEP as an Independent Component (2)
Typical lifecycle of a VEP application
Virtual system disk image handling, external �lesApplication con�gurationExecution environment speci�cationResource need evaluationResource allocation (constraint-aware)ContextualizationDeploymentElasticity managementCheckpointing (potentially in OVF format)
Advance reservation of resources
Performance management and resource allocation constraints
VEP Constrained Execution Environments
Contrail VEP/7 contrail-project.eu
CEE: Constrained Execution Environment
A CEE de�nes a virtual infrastructure integrating:
resource templates for computation, storage and networkingconstraints on resource allocation
localization
a�nity
protection, security
performance
OVF applications are deployed inside CEEs
OVF virtual resources mapped on CEE resource templates andallocated in accordance with associated constraints
CEE de�nition
Ready-to-use CEEs can be exported by IaaS providers
ie. A golden VM cluster with high performance interconnect
Users can de�nes their own CEEs
Contrail project: CEEs are derived from negotiated SLAs
Contrail VEP/8 contrail-project.eu
network
NFS server
mySQL server
load balancer
Apache server
net
NFS
mySQL
lbal
HTTP1
HTTP2
HTTP3
slot
slot
slot
slot
slot
slot
slot
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers
Virtual Resources OVF Descriptor
CEE handlers
VEP Application
Contrail VEP/9 contrail-project.eu
network
NFS server
mySQL server
load balancer
Apache server
net
NFS
mySQL
lbal
HTTP1
HTTP2
HTTP3
slot
slot
slot
slot
slot
slot
slot
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers
Virtual Resources
OVF Descriptor
CEE handlers
VEP Application
Contrail VEP/9 contrail-project.eu
network
NFS server
mySQL server
load balancer
Apache server
net
NFS
mySQL
lbal
HTTP1
HTTP2
HTTP3
slot
slot
slot
slot
slot
slot
slot
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers Virtual Resources OVF Descriptor
CEE handlers VEP Application
Contrail VEP/9 contrail-project.eu
network
NFS server
mySQL server
load balancer
Apache server
net
NFS
mySQL
lbal
HTTP1
HTTP2
HTTP3
slot
slot
slot
slot
slot
slot
slot
L2net
largeVolume
smallVM
largeVM
sameCluster
10 Gb
CEE Constraints Resource Handlers Virtual Resources OVF Descriptor
CEE handlers VEP Application
Contrail VEP/9 contrail-project.eu
VEP and OpenNebula
The current implementation of VEP in Contrail project targets
OpenNebula
From OVF description
disk sections ⇒ VM images
virtual systems ⇒ VM templates
product sections ⇒ contextualization
Resource allocation
VEP needs a constraint-aware resource allocatornot integrated to OpenNebuladeveloped as an external service
Monitoring
monitoring data for SLA enforcement and federation managementexternal monitoring service to export OpenNebula monitoring data
Contrail VEP/10 contrail-project.eu
Improvement Expected: VM Image Management
File references inside OVF disk sectionson the web
ie. OpenNebula marketplace
on image repositoryon IaaS image store
OVF supports disk delta
Application snapshots (in the future)
Need for close interaction with OpenNebula implementation to reduce
image management cost
Contrail VEP/11 contrail-project.eu
Contrail VEP and standards
OVF (Open Virtualization Format) from DMTF: applicationdescription
no extension to OVF
CIMI (Cloud Infrastructure Management Interface) from DMTF
VEP API based on CIMIFuture: VEP server interoperable with standard CIMI clients
In the future
OCCI (Open Cloud Computing Interface) from OGF
to support other IaaS o�ersEGI
CDMI (Cloud Data Management Interface) from SNIA
for image management
Contrail VEP/12 contrail-project.eu
Contrail VEP Software
First version May 2012
Current release (2.1): September 2013
integrating CEE supportRESTful API (DMTF CIMI style)
Full support of CIMI planned for the �nal release (2014)
VEP software: http://vep.gforge.inria.fr/index.php
Contrail VEP/13 contrail-project.eu
Conclusion
Contrail VEP provides means do deploy complex applications on
OpenNebula IaaS
Contrail VEP/14 contrail-project.eu
Consiglio Nazionale delle Ricerche Italia
Contrail)is)coordinated)by)Chris1ne)Morin,)INRIA,)France
Contrail VEP/15 contrail-project.eu
www.contrail-project.eu
Contrail is co-funded by the
EC 7th Framework Programme
Funded under: FP7 (Seventh Framework Programme)Area: Internet of Services, Software & Virtualization(ICT-2009.1.2)Project reference: 257438Total cost: 11,29 million EuroEU contribution: 8,3 million EuroExecution: From 2010-10-01 till 2013-09-30Duration: 36 months
Contract type: Collaborative project (generic)