Hybrid Cloud Enablement Technologies

http://www.coord.org

Woohyun Kim

The creator of open source “Coord”

(http://www.coord.org)

2012-04-05

Hybrid Cloud Enablement Technologies


The Advent of Hybrid Cloud


The Cloud is DEAD

• Amazon Outage Ironically Raises the Public Cloud Doubts

• On April 21st, 2011, Amazon made the

worst outage in the cloud’s history

• A networking glitch made its storage volumes

automatically create back-ups of themselves,

filling up storage capacity and causing

connectivity issues, lasts two days

• The affected sites could not help waiting

for just Amazon’s repairs

• Q&A site Quora posted “Sorry – it sucks for us

too. We’d point fingers, …”

• News aggregator Reddit posted “We are still

waiting on Amazon to get to our volumes”

• Location service Foursquare, and SCVNGR

posted “The sky is falling! Amazon’s cloud

seems to be down (raining?)”


The Cloud is just a Tool

• How SmugMug Survived the Amazon Cloud Failure

• All of services in Amazon were spread across multiple AZs

• They just launched another identical ELB(Elastic Load Balancer), point it at the

non-affected zones, and updated their DNS

• Note that ELB was affected by the EBS outage

• Like RDS, ELBs would be also constructed on EC2 instances with EBS volumes ??!

• The services were designed for failure

• Fortunately, they didn’t use EBS, which was the main problem for

Amazon crashes

• Since EBS didn’t guarantee predictable performance, they didn’t use RDS running

on it.

• As a result, the exact types of data that would have potentially been disabled by

the EBS meltdown don’t actually live at Amazon at all

• Note that it all still lives in their own datacenters, where they can provide

predictable performance


A Better Alternative is Hybrid Cloud

• Zynga Makes Dramatic Shift From Public Cloud

• Zynga has moved most of its users away from Amazon and onto its

private cloud, called zCloud, to maximize the reliability and performance

of its social games network

• Zynga started out hosting games on its own servers in a collocation facility but

moved to Amazon when it couldn’t keep pace with demand

• A turning point was the 2009 launch of “Farmville,” which shot form zero to 10

million users in six weeks

• But from early 2011, Zynga launched all its new games in their own cloud only

when demand became predictable

• zCloud was built on top of CloudStack and RightScale

• Nearly 80 percent of Zynga’s daily active users were hosted on its own

infrastructure at the end of 2011, while 80 percent were hosted in Amazon at

the start of 2011

• Zynga now sees Amazon as a way to deal with unexpected surges in

demand rather than as its primary platform


Public Players are headed for Hybrid Cloud

• “The hybrid cloud is a little bit like sex

in high school” – Michael Crandell

• Everybody is talking about it, but not

everybody is doing it – except us

• “RightScale is a little bit like a parasite in Amazon”

Michael Crandell, RightScale




Auto-Scaling in Hybrid Cloud

Public Cloud

ServerArray

CPU

Scale Up Scale Down LB

App

Master

LB

App App

Slave

… App App App …

Contact DB:

• Using DNS / IP

• Executing a script

Security:

• Access Control

• Encryption

Public Internet

Private Cloud

Register with LB’s:

• Using SSH

• Using RightNet

• Central repo


Disaster Recovery in Hybrid Cloud

Public Cloud

ServerArray

CPU Scale Up Scale Down

LB

App

Master

LB

App App

Slave

… App App App …

Private Cloud

Public Internet

Slave

snap snap

snap snap

snap snap

snap snap

snap snap

snap snap

• Global storage

• Live replication + rsync

• NoSQL

S3/Cloudfiles


Networking in Hybrid Cloud


• Why Application Virtualization?

• Extreme Simplicity – copy and run

• VM doesn’t solve the app/OS problem

• VM images tie OS and apps together forever and must be

managed as a whole

• Separate app and OS images to reduce permutations

• Adapting VM images for migration among differing

infrastructures is difficult

• App & OS patches done once – gold “images”

• Simple copy for archive, release, DR, replication

Application Virtualization in Hybrid Cloud


I/O Virtualization in Hybrid Cloud


• Image Storage

• Racemi

• rPath rBuilder

• Glance

• RightScale ServerTemplate & MCI(Multiple Cloud Image)

• Cloud Bridge

• Rackspace RackConnect

• Vyatta-based SSL-VPN

• RightScale Point-To-Point

• Storage

• NexentaStor – NexentaVDI at Citrix Synergey 2011

• GlusterFS, Sheepdog

• Abiquo Tiered Storage(SATA, SAS, SSD)

• High perf, replicated (tier 1)

• High perf (tier 2)

• Standard (tier 3)

• Low cost (tier 4)



Thank You

Documents

Hybrid Cloud Enablement Technologies