Implementation of Cloud Computing with Eucalyptus

EUCALYPTUSImplementation of Cloud Computing with Eucalyptus using Xen

Hypervisor

Fasih Ahmad Fakhri Mohammad ShadabBikram Singha Roy

Haldia Institute of TechnologyDepartment of Information Technology

Seminar on Final Year Project at 7th Semester, 2011

Fasih, Shadab, Bikram (HIT Haldia) Cloud Computing with Eucalyptus November, 2011 1 / 47

Outline1 Introduction to Cloud Computing2 Evolution of Cloud Computing3 Grid to Cloud4 Key Characteristics5 Layers of Architechture6 Web Services7 Deployment Models8 Virtualization Technology

Xen Hypervisor9 EUCALYPTUS10 Implementation

Installing Eucalyptus11 Challenges12 Security13 Conclusions

Xen Hypervisor9 EUCALYPTUS

10 ImplementationInstalling Eucalyptus

11 Challenges12 Security13 Conclusions

Introduction to Cloud Computing

"Cloud computing is a buzzword..."

What is Cloud?The term cloud has been used historically as a metaphor for theInternet.

What is Cloud Computing?Cloud computing describes a new supplement, consumption anddelivery model for IT services based on Internet, and it typicallyinvolves the provision of dynamically scalable and often virtualizedresources as a service over the Internet.

Evolution of Cloud Computing

Hardware EvolutionDifferent generations of computer.

Internet Software EvolutionThe Internet is named after the Internet Protocol, the standardcommunications protocol used by every computer on the Internet.

Server VirtualizationVirtualization is a method of running multiple independent virtualoperating systems on a single physical computer.

Hardware EvolutionFirst Generation ComputersSecond Generation ComputersThird Generation ComputersFourth Generation ComputersFifth Generation of Computing (after Mainframe, PersonalComputer, Client-Server Computing, and Web)

Internet Software EvolutionEstablishing a Common Protocol for the InternetEvolution of Ipv6Finding a Common Method to Communicate Using the InternetProtocolBuilding a Common Interface to the InternetThe Appearance of Cloud Formations From One Computer to aGrid of Many

Server VirtualizationParallel ProcessingVector ProcessingSymmetric Multiprocessing SystemsMassively Parallel Processing Systems

Grid Computing to Cloud Computing

Key Characteristics of Cloud Computing

On demand self ServiceRapid elasticityPay per useReliabilityScalabilityMultitenancyPerformanceSecurityMaintenance

Layers of Cloud Computing Architechture

Client: Computer hardware or software that relies on cloudcomputing for application delivery.Application: Software as a ServicePlatform: Platform as a ServiceInfrastructure: Infrastructure as a ServiceServer: Computer hardware or software products that arespecifically designed for the delivery of cloud services, includingmulti-core processors, cloud-specific operating systems andcombined offerings.

Web Services Delivered from the Cloud

XaaS/EaaSEverything as a service (EaaS, XaaS,*aaS) is a concept of being ableto call up re-usable, fine grained software components across anetwork.It is a subset of cloud computing. The most common andsuccessful example is software as a service (SaaS), but the as aservice moniker has been associated with many other functionsincluding communication, infrastructure and platforms, most of whichare core components of cloud computing.

Software-as-a-Service (SaaS)Infrastructure-as-a-Service (IaaS)Platform-as-a-Service (PaaS)Other Services:

Communication-as-a-Service (CaaS)Data-as-a-Service (DaaS)Network-as-a-Service (NaaS)

SaaS: Software as a serviceThe major service given as part of Cloud Computing services.The first service.Most Known and used.

The application itself is provided by the service provider.Example:

Enterprise: SalesForce.Com, Webex, OfficeLiveUser Mail: Gmail, HotmailUser Pics: Flickr, Picasa

IaaS: Infrastructure as a serviceService providers offers capacity for rent, basically hosted DataCenters ServersAn evolution of web site and server hosting services whichprovided servers and VPS

Examples:Amazon Web ServicesMain Services

Amazon EC2Amazon S3Amazon SQSAmazon SimpleDB

Rackspace

PaaS: Platform as a ServicePlatform enables application developers to host their services.

Examples:Googles AppEngine

Python ApplicationCampus Buzz: http://hitbuzz.co.cc

Window AzureLive Services.NET ServicesSQL ServicesSharePoint ServicesDynamic CRM Services

CloudBeesOpenStackSalesForce

Deployment Models of Cloud Computing

Public CloudThe services are delivered to the client via the Internet from a thirdparty service provider.Vendors: Amazon, Google, Microsoft, Salesforce etc.Infrastructure: Amazon, Rackspace, Gogrid, Joyent,Terramark etc.

Community CloudCommunity cloud shares infrastructure between several organizationsfrom a specific community whether managed internally or by athird-party and hosted internally or externally.

Public CloudThe services are delivered to the client via the Internet from a thirdparty service provider.Vendors: Amazon, Google, Microsoft, Salesforce etc.Infrastructure: Amazon, Rackspace, Gogrid, Joyent,Terramark etc.

Community CloudCommunity cloud shares infrastructure between several organizationsfrom a specific community whether managed internally or by athird-party and hosted internally or externally.

Private CloudThese services are managed and provided within the organization.Vendors: IBM, Vmware, HP, Oracle (Data Centers) etc.Infrastructure: Eucalyptus, 3Tera, IBM, Vmware etc.

Hybrid CloudThere is a combination of services provided from public and privateClouds.Example: ERP in Private cloud and Sales and Email on public

Virtualization Technology

Virtualization is a term that refers to the abstraction of computerresources.Types of Virtualization:

Resource Virtualization: Any part of computing resource can bevirtualized. e.g. Virtual MemoryPlatform Virtualization: The whole system is virtualized. e.g.Server Virtualization

Scope of VirtualizationServer ConsolidationHigh Availibility Disaster RecoveryInfrastruction OptimizationInfrastructure AutomationClient VirtualizationIntelligent InfrastructionSecured ComputingApplications

Types of Platform VirtualizationParavirtualization, requiring porting of guest systemsHardware-assisted virtualization, allowing for unmodified guests

Virtualization is based on insertion of ahypervisor on top of hardware.Virtual machine (VM), a softwareimplementation of a machine (computer) thatexecutes programs like a real machine.Virtual machine manager (VMM), ishardware virtualization techniques that allowmultiple operating systems, termed guests,to run concurrently on a host computer.

Xen Hypervisor

XenA virtual machine monitor providing services that allow multiplecomputer operating systems to execute on the same computerhardware concurrently.

The first guest operating system, called in Xen terminology domain 0(dom0) The system administrator can log into dom0 in order tomanage any additional guest operating systems, called user domains(domU) in Xen terminology.Xen’s support for virtual machine live migration from one host toanother allows workload balancing and the avoidance of downtime.

Xen Hypervisor

Eucalyptus Open source Cloud computing System

EUCALYPTUS:Elastic Utility Computing Architecture Linking YourPrograms to Useful SystemsAn open-source software framework that implements what iscommonly referred to as Infrastructure as a Service (IaaS)The architecture of the EUCALYPTUS system

FeaturesCurrent release is version 2.0.2:

Interface compatibility with EC2 (both Web service and Queryinterfaces)Support for Xen and KVM hypervisorStand-alone RPMs for non-Rocks RPM based systemsSecure internal communication using SOAP with WS-securityElastic Block Store (EBS) compatible storage serviceBasic "Cloud Administrator" tools for system management anduser accountingThe ability to configure multiple clusters, each with private internalnetwork addresses, into a single Cloud.

Eucalyptus ComponentsCloud Controller: Includes the front-end servicesWalrus Storage System: S3 functionalityCluster Controller: Provides support for virtual network overlayStorage Controller: EBS functionalityNode Controller: Interacts with XEN to manage individual VMs.

Implementation of Cloud with EUCALYPTUS 2.0

Cloud DesignA single-cluster deployment of Eucalyptus Open Source release 2.0 ona two-machine system running Fedora12/CentOS 5.6.

Hardware RequirementsNeed a minimum of two machines minimum to host Eucalyptuscomponents.

Network RequirementsMust have a DHCP server installed (but not running).Must have range of available public IP addresses. These will beassigned to VM instances.Must have large range of available private IP addresses. Thesewill be used by a virtual subnet.They cannot overlap or containany part of a physical network IP address space.

Software RequirementsFedora12/CentOS 5.6 install CD 1 (of 8).Eucalyptus 2.0

Machine Hosted Components Min. Disk Space Min. MemoryFrontend CLC, Walrus, CC, SC Min. 100GB 4-8GB

Node NC Min. 100GB 4GB

Installing Eucalyptus (2.0) on Fedora 12

Download and Install RPMsEucalyptus binary installation is broken up into several packages: onefor each of the components (CLC, Walrus, CC, etc.), as well as acouple of common packages.There are two options for downloading and installing the packages:

Yum optionTarball option

Install RPMs on the front endrpm -Uvh eucalyptus-2.0.2.i386.rpmrpm -Uvh eucalyptus-common-java-2.0.2.i386.rpmrpm -Uvh eucalyptus-cloud-2.0.2.i386.rpmrpm -Uvh eucalyptus-sc-2.0.2.i386.rpmrpm -Uvh eucalyptus-walrus-2.0.2.i386.rpmrpm -Uvh eucalyptus-cc-2.0.2.i386.rpmrpm -Uvh eucalyptus-gl-2.0.2.i386.rpmFasih, Shadab, Bikram (HIT Haldia) Cloud Computing with Eucalyptus November, 2011 38 / 47

Install RPMs on the nodesrpm -Uvh eucalyptus-2.0.2.i386.rpmrpm -Uvh eucalyptus-gl-2.0.2.i386.rpmrpm -Uvh eucalyptus-nc-2.0.2.i386.rpmPost-Install StepsOn the node, /etc/libvirt/libvirtd.conf file needs to be modified:unix-sock-group = "kvm"unix-sock-ro-perms = "0777"unix-sock-rw-perms = "0770"auth-unix-ro = "none"auth-unix-rw = "none"

Installing Eucalyptus (2.0) on Fedora 12 Contd..

Once you made the modification, stop and start the libvirt, and makesure the sockets belong to the correct group:/etc/init.d/libvirtd stop/etc/init.d/libvirtd startchown root:kvm /var/run/libvirt/libvirt-sockchown root:kvm /var/run/libvirt/libvirt-sock-roNow, the node should be ready to run.Run EucalyptusNow start up Eucalyptus services.On the front-end: /etc/init.d/eucalyptus-cloud start/etc/init.d/eucalyptus-cc startOn the node:/etc/init.d/eucalyptus-nc start

Installing Eucalyptus (2.0) on Fedora 12 Contd..

Once you made the modification, stop and start the libvirt, and makesure the sockets belong to the correct group:/etc/init.d/libvirtd stop/etc/init.d/libvirtd startchown root:kvm /var/run/libvirt/libvirt-sockchown root:kvm /var/run/libvirt/libvirt-sock-roNow, the node should be ready to run.Run EucalyptusNow start up Eucalyptus services.On the front-end: /etc/init.d/eucalyptus-cloud start/etc/init.d/eucalyptus-cc startOn the node:/etc/init.d/eucalyptus-nc start

Challenges

ExtensibilitySimple architecture and open internal APIs

Client-side interfaceAmazonâs EC2 interface and functionality (familiar and testable)

NetworkingVirtual private network per cloudMust function as an overlay => cannot supplant local networking

SecurityMust be compatible with local security policies

Packaging, installation, maintenancesystem administration staff is an important constituency for uptake

Security

All Eucalyptus components use WS-security forauthentication

Encryption of inter-component communication is not enabled bydefaultConfiguration option

Ssh key generation and installation ala EC2 is implementedCloud controller generates the public/private key pairs and installsthem

User sign-up is web basedUser specifies a password and submits sign-up requestCert is generated but withheld until admin. approves requestUser gains access to cert. through password-protected web pageSimilar to EC2 model without the credit cards

Conclusions

Eucalyptus was designed from the ground up to be easy to installand as non-intrusive as possible (can be installed on a laptop forexperimentation)Highly modularExternal interface is based on highly popular API of Amazon(industry standard interface)Unique among the open-source offerings in providing a virtualnetwork overlay

Conclusions

Thank You

Implementation of Cloud Computing with Eucalyptus

Technology

Eucalyptus: An Open-source Infrastructure for Cloud Computing

Implementation of MapReduce parallel computing framework

Cloud computing-insights-from-110-implementation-projects

Avoiding Cloud Computing Planning & Implementation Failure

High Performance Computing Implementation on AWS

Eucalyptus: an open-source cloud computing infrastructurerich/publications/euca-phys-09.pdf · Eucalyptus: an open-source cloud computing infrastructure Daniel Nurmi, Rich Wolski,

Software Rejuvenation in Eucalyptus Cloud Computing

Open Source Private Cloud Computing -Eucalyptus

Implementation of a Validated Statistical Computing Environment

ODFM implementation with Elemental Computing Arrays

CLOUD COMPUTING IMPLEMENTATION ORGANIZATIONAL

The Eucalyptus Open-source Cloud-computing System

Cloud Computing Resource Management through a Grid … · forme open-source Eucalyptus. Mots-clés : Cloud Computing, DIET-Solve, Eucalyptus, gestion des ressources. Cloud Computing

Eucalyptus: An Open-source Infrastructure for Cloud Computing– Eucalyptus imposes no statistically detectable overhead – AWS small appears to throttle network bandwidth and (maybe)

Queensland Government Cloud Computing Implementation Model · Queensland Government Cloud Computing ... Queensland Government Cloud Computing Implementation ... Cloud brokers will

Eucalyptus · Cloud computing -V. Anandh Cloud computing is the delivery of computing as a service rather than a product, whereby shared resources, software and information are provided

Cloud Computing Privé type Iaas - UVTpf-mh.uvt.rnu.tn/1073/1/Cloud-Computing.pdf · Mots clés : Virtualisation, Cloud Computing, Cloud privé, IaaS, Open Source, Eucalyptus, AWS

Ubiquitous Computing Design Implementation and Usability

Cloud computing Workflow Workflow lifecycle Workflow design Workflow tools : xcp, eucalyptus, open nebula

ABS Cloud Computing Implementation Guide 2