Upload
nguyen-huy-hoang
View
219
Download
0
Embed Size (px)
Citation preview
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 1/34
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 2/34
Open Nebula .org
• MarketPlace with pregenerated Grid images• Claudia service manager
• User friendly CLI to manage VMs and create new images• Prepackaged software for common Linux distributions• Quattor recipes to easily install and configure the software in a
cluster
•
X509/Grid credentials support• VM management based on OpenNebula 2.2
StratusLab ProjectGrid aware cloud stack
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 3/34
Open Nebula .org
The version 0.4 of the software is available at http://stratuslab.eu
Version 1.0 is coming soon with utilities to upgrade previousinstalled versions.
StratusLab ProjectGrid aware cloud stack
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 4/34
Open Nebula .org
What Who
On-demand accessto any application
End-user(does not care about hw or sw)
Platform for buildingand delivering webapplications
Developer (no managing of the underlyinghw & swlayers)
Delivery of a raw computerinfrastructure
System Administrator(complete management of thecomputer infrastructure)
Cloud Computing Disciplines An Introduction to Cloud Computing
Platform as a Service
Infrastructure as aService
Physical Infrastructure
Software as a Service
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 5/34
Open Nebula .org
Infrastructure as a Service (IaaS) An Introduction to Cloud Computing
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 6/34
Open Nebula .org
Infrastructure as a Service (IaaS) An Introduction to Cloud Computing
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
A “Public Cloud behind the firewall ”
• Simplify internal operations
• Dynamic allocation of resources• Higher utilization & operational savings
• Security concerns
Private Cloud
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 7/34
Open Nebula .org
Infrastructure as a Service (IaaS) An Introduction to Cloud Computing
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
A “Public Cloud behind the firewall ”
• Simplify internal operations
• Dynamic allocation of resources• Higher utilization & operational savings
• Security concerns
Private Cloud
• Supplement the capacity of the Private Cloud
• Utility Computing dream made a reality!
Hybrid Cloud
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 8/34
Open Nebula .org
Infrastructure as a Service (IaaS) An Introduction to Cloud Computing
A “Public Cloud behind the firewall ”
• Simplify internal operations
• Dynamic allocation of resources• Higher utilization & operational savings
• Security concerns
Private Cloud• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity
Public Cloud
• Supplement the capacity of the Private Cloud
• Utility Computing dream made a reality!
Hybrid Cloud
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 9/34
Open Nebula .org
Challenges of an IaaS Cloud An Introduction to Cloud Computing
I’m using virtualization/cloud, and plan a private Cloud (BUT’s)Where do/did I put my web server VM?Monitoring & Scheduling
Can I use hypervisor X?Virtualization
ºUniform management layer that orchestrates multiple technologies
How do I provision a new VM?Image Management & Context
How do I create a new disk?
Storage
Who have access to cloud (and What)?User & Role Management
How do I set up networking for a multitier service?Network & VLANs
How can I manage the distributed infrastructure?Interfaces & APIs
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 10/34
Open Nebula .org
History of OpenNebula.org An Introduction to Cloud Computing
2005 2008 2009 2010 2011 2012
dsa group doingresearch…
TP v1.0 v1.2 v1.4 v2.0 v2.2 v2.4
4000 downloads/month
European Funding
• Develop & innovate• Support the community• Collaborate
Third party scalabilitytests: 16000 VMs
Commercial Support
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 11/34
Open Nebula .org
History of OpenNebula.org: Sample Users An Introduction to Cloud Computing
Organizations Building Clouds for Development, Testing and
Production
Projects Building an Open Cloud Ecosystem AroundOpenNebula
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 12/34
Open Nebula .org
Technical Overview of OpenNebula: Vision & Design Philosophy An Introduction to Cloud Computing
• One solution can not t all data-center, requirements andconstraints
• Open, felxible and extensible architecture that allowsmultiple components to be orchestrated
• Ready for production
• Massively scalable deployments
• Open Source – Apache License v2.0
• Provide basic components, but allow them to be easilyreplaceable
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 13/34
Open Nebula .org
Technical Overview of OpenNebula: Key Components An Introduction to Cloud Computing
VM Networking
• VLANs
• Firewall hooks• User dened
Hosts: Cluster workernoes to run VMs.
• Multiple hypervisors dened per host• Grouped in logical clusters• Custom monitoring probes andtechnologies
Storage
• NAS• SAN• Custom (bittorrent, ssh…)
Interfaces API
• CLI (local/remote)• API (java, ruby bindings)• Sunstone• Cloud (EC2, OCCI)
User Roles
Image Repository of VM
disks• ACLs (public + private)• OS and Data types (persistent)• Multiple storage backends
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 14/34
Open Nebula .org
Component OverviewComponent Overview
! Executes the OpenNebula Services!
Usually acts as a classical cluster front-end
! Provides physical resources to VMs! Must have a hypervisor installed
! Modular components to interactwith the cluster services! Types: storage, monitoring,
virtualization and network
! Repository of VM images! Multiple backends (LVM, iSCSI..)! Usually in a separate host
The same host can be can be athe front-end and a node
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 15/34
Open Nebula .org
! Image Repository: Any storage medium for the VM images(usually a high performing SAN).
! Cluster Storage! OpenNebula supports multiple back-ends (e.g. LVM for fast cloning)
!
VM Directory: The home of the VM in the cluster node! Stores checkpoints, description files and VM disks
! Actual operations over the VM directory depends on the storage medium
! Should be shared for live-migrations
! You can go on without a shared FS and use the SSH back-end! Defaults to $ONE_LOCATION/var/$VM_ID
Storage for the Priv ate CloudComponent Overview
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 16/34
Open Nebula .org
Storage for the Private CloudExample, a shared FS architecture
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 17/34
Open Nebula .org
! OpenNebula management operationsuses a ssh connections, it does notrequire a performing NIC
! Image traffic , may require themovement of heavy files (VM images,checkpoints). Dedicated storage linksmay be a good idea
! VM demands, consider the typicalrequirements of your VMs. SeveralNICs to support the VM traffic may bea good idea
! OpenNebula relies on bridgenetworking for the VMs
Networking for the Private CloudComponent Overview
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 18/34
Open Nebula .org
Configuring OpenNebula 2.2Configuration Interface
! $ONE_LOCATION/etc/im_*/im_*.conf! Defines monitoring probes
! Match-making scheduler (default)! Placement policies configured per VM
! $ONE_LOCATION/etc/oned.conf!
General configuration! Defines the drivers used in the private cloud
! $ONE_LOCATION/etc/tm_*/tm_*.conf! Defines action for generic storage operations
! $ONE_LOCATION/etc/vmm_*/vmm_*.conf! Defaults values for the hypervisor
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 19/34
Open Nebula .org
Configuring OpenNebulaThe oned.conf file
! General configuration attributes! Monitoring intervals:
! HOST_MONITORING_INTERVAL! VM_POLLING_INTERVAL
! Global Paths! VM_DIR: Path to the VM directory in the cluster nodes.! SCRIPTS_REMOTE_DIR: to store driver actions in the cluster nodes
! PORT : Port where oned will listen for xml-rpc calls! DEBUG_LEVEL! DB, configuration for the DB backend driver:
! Sqlite! MySQL
! VNC_BASE_PORT, for VNC port generation (BASE + ID)
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 20/34
Open Nebula .org
Configuring OpenNebulaThe oned.conf file
! Information Drivers , to monitor cluster nodes! name: identifies the driver! executable: absolute or relative to $ONE_LOCATION/lib/mads! arguments:
! hypervisor probe set (remotes dir)! Number of retries (-r)! Concurrency (-t number of threads)
IM_MAD = [name = "im_kvm",executable = "one_im_ssh",arguments = “-r 0 –t 15 kvm" ]
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 21/34
Open Nebula .org
Configuring OpenNebulaThe oned.conf file
! Transfer Drivers , to interface with the storage! name: identifies the driver! executable: path to driver executable! arguments: storage commands configuration file
TM_MAD = [name = "tm_nfs",executable = "one_tm",arguments = "tm_nfs/tm_nfs.conf" ]
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 22/34
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 23/34
Open Nebula .org
Configuring the Private CloudManaging hosts and clusters
! Hosts are cluster worker-nodes defined with
! Hostname of the node or IP
! Information Driver to be used to monitor the host
! Storage Driver to clone, delete, move or copy images into the host
! Virtualization Driver to boot, stop, resume VMs in the host
! Hosts are managed with the onehost utility! Create & delete hosts
! List the hosts
!
Show detailed information from a host! Enable/Disable a host
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 24/34
Open Nebula .org
Configuring the Private CloudManaging Users
!
Users are defined within OpenNebula by:! ID unique identifier for the user! Name of the user, used for authentication
! Password used for authentication
! Users are managed with the oneuser utility! Create & delete users! List the users in the cluster
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 25/34
Open Nebula .org
! A Virtual Network (vnet) in OpenNebula! Defines a separated MAC/IP address space to be used by VMs! A vnet is associated with a physical network through a bridge! Virtual Networks can be isolated (at layer 2 level)
! Virtual Network definition! Name, of the network! Type
- Fixed , a set of IP/MAC leases- Ranged, defines a network range
! Bridge , name of the physical bridge in the physical host where
the VM should connect its network interface. ! Virtual Networks are managed with the onevnet utility
Virtual NetworksOverview
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 26/34
Open Nebula .org
ImagesOverview
! An Image in OpenNebula’s repository! A virtual machine disk to be used as OS or DATA device.! Images can be persistent and/or public
! Images modifications can be saved as another image
! Image Types :! OS : contains a working operative system! CDROM : readonly data
! DATABLOCK : A storage for data. Can be created either from previousexisting data, or as an empty drive.
! Images are stored in the repository
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 27/34
Open Nebula .org
Images Automatic Disk Layout for Images
OS
Context ISO
CD-ROM
swap
Data 1
Data N…
hda
hdb
hdc
hdd
hde
hdn
• Prefix (hd,sd): set asdefault in oned.conf• Can be set per image in
its template
• Target (hda…) : can beset in the VM templatefor the DISK
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 28/34
Open Nebula .org
Virtual MachinesOverview
! A Virtual Machine in OpenNebula! A capacity in terms memory and CPU! A set of NICs attached to one or more virtual networks
! A set of disk images, to be “ transfered ” to/from the execution host.! A state file (optional) or recovery file, with the memory image of a
running VM plus some hypervisor specific information.! Virtual Machines are defined in a VM template
! Each VM has an unique ID in OpenNebula the VMID
! All the files (logs, images, state files...) are stored in$ONE_LOCATION/var/<VMID>
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 29/34
Open Nebula .org
Hybrid Cloud ComputingOverview
! External Clouds are like any other host! Placement constraints! OpenNebula distribution includes EC2 drivers
! VMs can be local or remote!
VM connectivity has to be configured, usually VPNs
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 30/34
Open Nebula .org
Public Cloud Computing with OpenNebulaOverview
! "#$ %&' $() *$+,-+) .'/)01&%)( 1#0 /2) 3+#$4
! 50&'(-&0)'/ /# 6#$0 ()/$-7! 86-)09.(#0! :/#0&;) <#4)+! 86=0.4 %#'>;$0&,#'
! :$--#0/( 855? &'4 855?: -0#/#%#+(
! "#$ %&'()*+,%+-* =&()4 #' @-)'A)=$+& %0)4)',&+(
! ?$=+.% 3+#$4 $()0( '))4 &' @-)'A)=$+& &%%#$'/
! 3+.)'/ /##+( $()( B3C +.=0&0.)(
! ?#/)',&+ .'/);0&,#' D./2 B3C /##+(EB3CFGHI -0#=+)*( 1#0 )J&*-+)K
! :2.--)4 D./2 @-)'A)=$+&! L'%+$4)( & (.*-+) :M 0)-+&%)*)'/
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 31/34
Open Nebula .org
Configuring the Public CloudDefine the Instances
! You have to define the correspondence between types (simple) and
local instantiation of VMs (hard, you should be fine by now)! Capacity allocated by this VM type (CPU, MEMORY)! Your cloud requirements, e.g. force to use a given kernel (OS) or place
public VMs in a given set of cluster nodes (REQUIREMENTS)
!
The network used by Public VMs (NIC)! VM Types are defined in econe.conf . Templates for the VM templates
are in $ONE_LOCATION/etc/ec2query_templates
! Templates for VM Types are erb files <% Ruby code here %>, youshould not need to modify that.
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 32/34
Open Nebula .org
Using the Public CloudThe econe Toolset
!
The econe-tools are a subset of the functionality provided by theonevm utility, and resembles the ec2-* cli
! EC2 ecosystem can be used (e.g. elasticfox, euca2ools…)
! Image related commands are:!
econe-upload , place an image in the Cloud repo and returns ID! econe-describe-images , lists the images! econe-register, register an image
! Instance related commands are:!
econe-run-instances , starts a VM using an image ID! econe-describe-instances , lists the VMs! econe-terminate-instances , shutdowns a VM
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 33/34
Open Nebula .org
Using the Public CloudThe econe Toolset
! User authentication is based in the OpenNebula credentials! AWSAccessKeyId is OpenNebula's username! AWSSecretAccessKey is OpenNebula's password
! Pass your credentials to the econe-tools by (in this order)! Command arguments (-K <username>, -S <pass>)
! Environment EC2_ACCESS_KEY and EC2_SECRET_KEY! Environment ONE_AUTH
! Point econe-tools to your target cloud!
Command arguments (-U <http|https>://<fqdn>:<port>) port neededif not the default for the protocol! EC2_URL environment
8/12/2019 002.Building Clouds with OpenNebula 2.2 and StratusLab - J. Fontan.pdf
http://slidepdf.com/reader/full/002building-clouds-with-opennebula-22-and-stratuslab-j-fontanpdf 34/34
Open Nebula .org
https://cloud.opennebula.org
USER: tutorialPASSWORD: lero
Hands-on SessionSunstone web interface