Amazon EC2 / Eucalyptus

Daniel Hallmann I 7 July 2011

Amazone EC2 / Eucalyptus I Mayflower GmbH I 7 July 2011 I 2

I Daniel Hallmann Dipl.-Inf. (FH)

I Developer

I Since 3 ½ years working for Mayflower

I Working fields: Development in PHP, JS and MySQL

Referent

Amazon EC2 / Eucalyptus I Mayflower GmbH I 7 July 2011 I 3

“Cloud computing is like sex in high school: Everyone is talking about it, not many are actually doing it, and none are doing it well.”2:25 PM Jun 9th from TweetDeck

jack_danielJack Daniel

“Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing.”http://en.wikipedia.org/wiki/Cloud_Computing

“Cloud computing is a general term for anything that involves delivering hosted services over the Internet..”http://searchcloudcomputing.techtarget.com/definition/cloud-computing

Amazon EC2 / Eucalyptus Mayflower GmbH I 7 July 2011 I 5

PaaS

Vorführender

Präsentationsnotizen

Platform as Service Runtime Environment Development Environment Pitfalls Vendor lock in Security Advantages Easily scalable Only include programmatically logic without self administration Google App Engine, Force.com (Salesforce.com) und Windows Azure

Runtime/DevelopmentEnvironment

Application 1 Application 2

Vorführender

Pitfalls Vendor lock in Security Advantages Easily scalable

SaaS

Runtime-Environment

Application 1 Application 2

Application 3Application 4

Vorführender

Pitfalls Vendor lock in Security Advantages Easily scalable Examples zoho.com (chat, docs, mail) google.com (docs, mail, translate)

IaaS

Vorführender

Infrastructure as a Service Computer infrastructure typically a platform virtualization environment

Server 1 Server 2 Server 3

Storage 1 Storage 2

Webservice

Db-Layer

Application 1 Application 1 Application 1

Vorführender

Pitfalls Vendor lock in Security Integrity of the service provider Advantages Easily scalable Don’t worry about hardware

CLOUDS

PUBLIC

Vorführender

Customer and Provider are not under the same organisatorical unit Pitfalls Vendor lock in Security Costs Advantages Easily scalable (Tech perf, storage perf) Reliable 99,9% High End machines

Public Cloud

Customer Provider

Vorführender

Customer and Provider are under the same organisatorical unit

Private Cloud

Customer Provider

Vorführender

Pitfalls Partial Vendor lock in Partial Security More Costs Additional administration Advantages Lower security risks

Hybrid

Vorführender

Hybrid solution Mixing of public and private cloud

Public CloudPrivate Cloud

Customer Provider

Vorführender

Pitfalls Partial Vendor lock in Partial Security More Costs Connections to public cloud Additional overhead Advantages Handle performance picks Do not need expensive hardware Increase flexibility

AMAZON.COM

Vorführender

Christmas Presents for children Replication of storage and available servers

WHY?

HIGH PRESSURE

Vorführender

Heavy Load Load picks Spread storage for replication Provide functionality through web services

25. August 2006

First announcement

DEVELOPMENT

Vorführender

mostly developed by a team in Cape Town, South Africa lead Chris Pinkham Pinkham provided the initial architecture

26. October

2008

Vorführender

Add different instances e.g. High-CPU instances New features Static IP adresses, Available Zones, Elastic Block Storages

Full production

level

Vorführender

Dropped beta status

Public Cloud

Customer Provider

Server 1

App 1

Server 2

App 1

Server 4

App 1

Server 3

App 1

Server 5

App 1

Server 6

App 1

Server 7

App 1

Server 8

App 1

Vorführender

// Elastic feature Quickly scale and reduce time to boot new instances Run your image as many or few you desire Load custom applications // Flexible feature Select a configuration of memory, CPU storage Manage network access permissions Variety of operating systems

Public Cloud

Customer Provider

Server 1

App 1

Vorführender

// Additional services Simple Storage Service, Amazon Relational Database Service

FEATURES

elastic block storage

multiple locationscloud watch

auto scaling

elastic load balancing vm import

Vorführender

Elastic block storage (offers persistent storage) Multiple locations (provide instances to multiple locations and protect applications from failures) Elastic IP Addresses (IP address can be mapped to any instance of your account) Virtual Private Cloud (connect existing infrastructures with the AWS resources) Cloud Watch (monitor your cloud resources) Auto Scaling (scale up or down your cloud instances according to conditions you define) Elastic Load Balancing (distributes incoming application traffic across cloud instances) High performance computing (cloud can be programmatically launched into cluster) Vm import (easy import your existing virtual machines)

Reliable

Vorführender

99.95% availability SLA

R H E LW i n d o w s S e r v e rO r a c l e E n t e r p r i s e L i n u xO p e n S o l a r i sA m a z o n L i n u x A M IU b u n t u

ApacheSoftware

EC2

Vorführender

1. Login (https://console.aws.amazon.com) 2. Boot instance 3. Show description 4. Show monitoring 5. Show Tags 6. Show volumes (ebs elastic block storage) 7. Show Sidebar - on demand instances (pay for hours with no long term commitments) - reserved instances (low one-time payment) - spot instances (bid on unused Amazon EC2 capacity)) 8. Login instance (ssh -i ~/.ec2/dhkey.pem ec2-user@ec2-46-51-154-180.eu-west-1.compute.amazonaws.com) Notes: RDS (Ralational Database Service); SNS (Simple Notification Service); IAM (Identity and Access Management)

Eucalyptus

PRIVATE

Vorführender

Open source Modular(components have well designed interfaces) Flexible(can be installed on minimal setup, thousand of cores and TB of storage) Compatible (implemented EC2, S3 standard) Hybrid cloud(combine private and public cloud Eucalyptus compatibility with EC2 API)

University Project in the MAYEM labs of UC Santa Barbara

Department of GRID, HPC and massive scalable systems

EUCALYPTUS Elastic Utility Computing Architecture for Linking Your Programs To Useful Systems

Vorführender

CentOS, Fedora VMware, Xen, KVM, vSphere, ESX, ESXi

FULL API compatibility

with EC2

Vorführender

http://docs.amazonwebservices.com/AWSEC2/2009-04-04/DeveloperGuide/ e.g. commands to control cloud components ec2-run-instances ami-2bb65342 euca-run-instances emi-8A1119CC

Vorführender

Demo Login: https://ecc.eucalyptus.com:8443 euca-describe-instances euca-describe-keypairs euca-run-instances --kernel eki-D61714AE --ramdisk eri-1798159C -k mykey emi-8A1119CC ssh -i ~/.euca/mykey.private root@173.205.188.131 euca-terminate-instances euca-describe-volumes euca-describe-availability-zones euca-create-volume --size 1 --zone open euca-attach-volume -i i-<instance> -d /dev/sdb vol-<id> sudo fdisk /dev/sdb mkfs –t ext2 /dev/sdb mkdir /media/storage mount -t ext2 /dev/sdb /media/storage/ df –h /media/storage

Amazon EC2 Eucalyptus

Public Cloud Private Cloud / Hybrid Cloud

Commercial Open Source

Support Community

Scaling architecture Scaling architecture

Elastic storage Elastic storage

Multiple Hypervisors Multiple Hypervisors

Multiple OS Multiple OS

Monitoring Monitoring

Vorführender

Block Storage (Eucalyptus) iSCSI, SAN, NAS Hypervisors (Eucalyptus) VMware, Xen, KVM, vSphere, ESX, ESXi OS (Eucalyptus, Amazon) RHEL, SLES, Ubuntu, Debian, Fedora Community (Eucalyptus) World wide user community

Amazon EC2

Eucalyptus

FeaturesFeatures

Security

Vorführender

Features Elasticity, Storage, OS, Applications

Links

I aws.amazon.com/ec2/

I open.eucalyptus.com/

Vorführender

Links

I Index: http://1.2.3.10/bmi/open.eucalyptus.com/themes/eucalyptus/img/eucalyptus_logo_awh.pngI Index: http://1.2.3.9/bmi/d36cz9buwru1tt.cloudfront.net/logo_aws.gifI Pressure: http://www.flickr.com/photos/sharynmorrow/144297839/I Cloud: http://www.flickr.com/photos/kky/704056791/I Private: http://www.flickr.com/photos/loop_oh/5631953241/I Public: http://www.flickr.com/photos/utekoehler/4732012177I Hybrid: http://www.flickr.com/photos/chl/102448403I Development: http://www.flickr.com/photos/monjurulhoque/315359640I Reliable: http://www.flickr.com/photos/joelanman/367425390/I C64: http://data.motor-talk.de/data/galleries/509516/14975/c64-startbildschirm.jpgI Gollum: http://www.arteyfotografia.com.ar/5263/fotos/125592/I Ubuntu-Girls: http://www.flickr.com/photos/buggolo/446184392/I Ubuntu-Logo: http://www.voipnovatos.es/media/1/20050825-ubuntu.gifI RedHat-Girl: http://www.flickr.com/photos/hpnadig/4427294088/I RedHat-Logo: http://1.2.3.10/bmi/www.redhat.com/g/chrome/logo_rh_home.pngI Suse-Kameleon: http://www.flickr.com/photos/m4tik/1857974/I Suse-Logo: http://www.flickr.com/photos/techweet/5398030424/I Debian-Cake: http://www.flickr.com/photos/oskay/299949769/I Debian-Logo: http://www.debian.org/Pics/openlogo-50.pngI Microsoft: http://www.microsoft.com/germany/business/cloudservices/includes/images/msft_cloudservices_logo.gifI Racspace: http://www.rackspace.com/images/sprites/global_header.pngI Google: http://www.google.de/images/logos/ps_logo2.pngI Yahoo: http://irudiak.argazkiak.org/43977f0fcf55b56038924249a87aaa81_c.jpgI Apple: http://images.apple.com/icloud/images/overview_title.png

Table of Images

http://1.2.3.10/bmi/open.eucalyptus.com/themes/eucalyptus/img/eucalyptus_logo_awh.png�

http://1.2.3.9/bmi/d36cz9buwru1tt.cloudfront.net/logo_aws.gif�

http://www.flickr.com/photos/sharynmorrow/144297839/�

http://www.flickr.com/photos/kky/704056791/�

http://www.flickr.com/photos/loop_oh/5631953241/�

http://www.flickr.com/photos/utekoehler/4732012177�

http://www.flickr.com/photos/chl/102448403�

http://www.flickr.com/photos/monjurulhoque/315359640�

http://www.flickr.com/photos/joelanman/367425390/�

http://data.motor-talk.de/data/galleries/509516/14975/c64-startbildschirm.jpg�

http://www.arteyfotografia.com.ar/5263/fotos/125592/�