49
RabbitMQ at Skills Ma-er Cloud Exchange Cloud Messaging Use Cases April 2010 Alexis Richardson VMware Inc. copyright (c) VMware Inc. Friday, 23 April 2010

Use cases for cloud messaging

Embed Size (px)

DESCRIPTION

RabbitMQ is a complete and highly reliable enterprise messaging system based on the emerging AMQP standard. It is licensed under the open source Mozilla Public License and has a platform-neutral distribution, plus platform-specific packages and bundles for easy installation. In this talk, Alexis talks on use cases for cloud messaging.What is messaging and why it is useful for cloud computing? This talk will answer these questions by way of illustrating use cases from RabbitMQ customers.

Citation preview

Page 1: Use cases for cloud messaging

RabbitMQatSkillsMa-erCloudExchange

CloudMessagingUseCases

April2010AlexisRichardsonVMwareInc.

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 2: Use cases for cloud messaging

RabbitMQisamessagingserverthatjustworks

Thank you!

Im in yr serverz,queueing yr messagezPhoto credit: http://flickr.com/photos/53366513@N00/67046506/

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 3: Use cases for cloud messaging

Wees7mate300‐500ormoreinproduc7on,>20Kindev

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 4: Use cases for cloud messaging

RabbitMQintegratedwithmorethan100developerplaForms

RabbitdistributedbymostLinuxtypeplaForms

WeofferpackagesformanyotherOSplaForms

RabbitMQ.NETandMicrosoOIVApartnership

UsingRabbitMQiseasy

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 5: Use cases for cloud messaging

545

RabbitdistributedbymostLinuxtypeplaForms

WeofferpackagesformanyotherOSplaForms

RabbitMQ.NETandMicrosoOIVApartnership

Cloudmessagingisthefuture

RabbitMQintegratedwithmorethan100developerplaForms

UsingRabbitMQiseasy

Friday, 23 April 2010

Page 6: Use cases for cloud messaging

Cloudhasre‐energisedIT

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 7: Use cases for cloud messaging

CloudmaIersbecauseweoperateatreal7meonaglobalscale

Mobile, video, presence, live streams - anywhere, anytime

How to deliver this without lock-in to any one platform or location?

Massive amounts of data everywhere and changing all the time

Security, privacy, consistency of customer experience eg latency, relevance

Cloud Messaging matters!

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 8: Use cases for cloud messaging

http://railsdog.com/blog/2009/12/generating-pdfs-on-ec2-with-ruby/copyright (c) VMware Inc.

Friday, 23 April 2010

Page 9: Use cases for cloud messaging

9http://railsdog.com/blog/2009/12/generating-pdfs-on-ec2-with-ruby/

Friday, 23 April 2010

Page 10: Use cases for cloud messaging

Cloud+QueuesmakesiteasytomanageanARMYofworkerbots

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 11: Use cases for cloud messaging

WealsocareaboutSCALE...

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 12: Use cases for cloud messaging

WealsocareaboutSCALE...whenwecannotpredictdemand

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 13: Use cases for cloud messaging

Cloudapplica7onsarecomponentbasedandneedintra‐appmessagingtoscale

See more here: http://aws.typepad.com/aws/2008/12/running-everything-on-aws-soocialcom.htmlcopyright (c) VMware Inc.

Friday, 23 April 2010

Page 14: Use cases for cloud messaging

Inter‐cloudapplica7onsuseinter‐applica7onmessagingtorouteanddeliverdata

!

WestEuropedatacentre

NEEuropedatacentre

SouthernEuropedatacentre

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 15: Use cases for cloud messaging

Inter‐cloud“securenetworkoverlay”‐usesRabbitMQunderthecovers

See http://www.cohesiveft.com/vpncubed/copyright (c) VMware Inc.

Friday, 23 April 2010

Page 16: Use cases for cloud messaging

DMAC

PUBSUBatmassivescale:“TwiIerforDataintheCloud”

Service.DomainName

Region Virtual IP

Cloud IPs

See: http://www.oceanobservatories.org/spaces/display/CIDev/HomeFriday, 23 April 2010

Page 17: Use cases for cloud messaging

Pubsub?wZ?

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 18: Use cases for cloud messaging

At scale, coping with changing data can be a problem

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 19: Use cases for cloud messaging

19

Socialapplica7onsstoredata

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 20: Use cases for cloud messaging

20

And thereʼs terabytes of it

Socialapplica7onsstoredata

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 21: Use cases for cloud messaging

21

And thereʼs terabytes of it

And itʼs in the cloud

Socialapplica7onsstoredata

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 22: Use cases for cloud messaging

Tell me when THIS changes

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 23: Use cases for cloud messaging

PubsubwinsbecausePollingSucks...“Arewethereyet?”,“Arewethereyet?”,..

Pubsubhubbub provides web pubsub

Pubsub Hubs are Cloud Messaging Technology

Check out RabbitHub on github for more info/code

Check out the Google teamʼs video at

http://www.youtube.com/watch?v=B5kHx0rGkec

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 24: Use cases for cloud messaging

Monitoringdonewrong

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 25: Use cases for cloud messaging

Monitoringdoneright

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 26: Use cases for cloud messaging

Monitoringdoneright

See: Ben Hyde’s post at http://enthusiasm.cozy.org/archives/2009/02/listening-to-the-system

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 27: Use cases for cloud messaging

Monitoringdoneright

27copyright (c) VMware Inc.

Friday, 23 April 2010

Page 28: Use cases for cloud messaging

Monitoringdoneright

28Lots more event processing goodness here: http://blog.cloudeventprocessing.com/

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 29: Use cases for cloud messaging

29

PubsubgetsyouMonitoring‐andifyouaddQueuesyougetLogging

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 30: Use cases for cloud messaging

Recordinginforma7onisoffundamentalhumanvalue

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 31: Use cases for cloud messaging

Sowhatismessaging?

Messages

Pubsub

Queues

Log Storage

messagingis‘datainmoSon’anditisreallyimportantand‘themovetocloudcompuSng’willputmessagingeverywhere

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 32: Use cases for cloud messaging

ThereareLOTSofcloudmessagingtechnologies!

Messages

Pubsub

Queues

Log StorageAMQP, NoSQL, SQL

Routing, transforming, alertingeg SNS, ESBs and Esper CEP

Buffering, caching, filteringeg SQS, Redis

Email, Chat, Comet, BOSH, ..SMS, Twitter, ..

Trading, Cash transferSMTP, HTTP, XMPP, AMQP

AMQP, HTTP PSHB, XMPP

AMQP, (XMPP)

Archiving + searcheg Riak, Cassandra

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 33: Use cases for cloud messaging

...andRabbitMQ’sgoalistomakeallofthisreallysimple

Messages

Pubsub

Queues

Log StorageAMQP, NoSQL, SQL

Routing, transforming, alertingeg SNS, ESBs and Esper CEP

Buffering, caching, filteringeg SQS, Redis

Email, Chat, Comet, BOSH, ..SMS, Twitter, ..

Trading, Cash transferSMTP, HTTP, XMPP, AMQP

AMQP, HTTP PSHB, XMPP

AMQP, (XMPP)

Archiving + searcheg Riak, Cassandra

Thank you!

Im in yr serverz,queueing yr messagezPhoto credit: http://flickr.com/photos/53366513@N00/67046506/

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 34: Use cases for cloud messaging

RabbitMQ

TowardsaPLATFORMforCloudMessaging

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 35: Use cases for cloud messaging

IfcloudrequiresaCloudOS,thenismessagingtheCloudBus?

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 36: Use cases for cloud messaging

ForInfra,yes.Manyclouds,egNASANebula,haveaRabbitMQcloudbus:

Usecases:Inter‐VMchaIerAndlotsofManagement:RequestcapacityStart100VMs.Shutthemdown.“Iamoverloaded”“Findme‐whoamI?”“Moveme”“Backmeup”Scalebackcapacity

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 37: Use cases for cloud messaging

That’sgreatbutwealsoneedaPLATFORMifwearetodeployandrunapps

SaaS cloud applications

PaaSeg RabbitMQ on Heroku

IaaSeg Rabbit at NASA

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 38: Use cases for cloud messaging

PlaZormasaserviceexample:Heroku!

SaaS cloud applications

PaaSeg RabbitMQ on Heroku

IaaSeg Rabbit at NASA

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 39: Use cases for cloud messaging

Conceptually:aplaZormrepresentsfreedomfromcomplexity

App AppApp

Scalablecloudbus‐runasmanyasyoulike(Rabbitisopensourceandcanrunonanycloudasits‘centralnervoussystem’)

IaaS infra is hidden

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 40: Use cases for cloud messaging

Pubsubismadesimple‐likeappstwee7ngateachother!

App AppApp

“hey” “hey”“hey”

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 41: Use cases for cloud messaging

Queuesareeasytoo

App AppApp

“hey”

“hey”

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 42: Use cases for cloud messaging

Queuesareeasytoo

App AppAppApp

“hey”

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 43: Use cases for cloud messaging

Bybeing100%open‐wecanalsodointercloudjustassimply!

Intra-App Intra-Cloud Inter-Cloud

Rabbit Cloud Service

Rabbit Cloud Service

Rabbit Cross-cloud Services

Rabbit inside the Cloud VM

RabbitMQ as infra: “Cloud Bus”

Federated RabbitMQIaaS

PaaS

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 44: Use cases for cloud messaging

44

Tobridgeprivateandpublicclouds,opensourceandopenstandardsarebest

SAY NO TO

CLOUD

LOCK IN

(CC) Giara @flickr.com copyright (c) VMware Inc.

Friday, 23 April 2010

Page 45: Use cases for cloud messaging

Summary‐cloudsbreakthelinkbetweenapplica7onandloca7on

Can’t predict where apps and VMs are running

Can’t predict scale

Design for DATA IN MOTION

In motion VMs need PUBSUB and ROUTING like with cell phones

VMs suspended or offline need QUEUES

Messaging lets you ‘dial up’ VMs and broadcast changes safely

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 46: Use cases for cloud messaging

Solu7on‐RabbitMQistheopencloudmessagingplaZorm

Fantastic community support for messaging intra app

Language neutral open protocols for messaging inter app

Federation - bridge private and public ‘intercloud’

Cloud Bus for IaaS

Messaging PaaS

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 47: Use cases for cloud messaging

Solu7on‐RabbitMQasanopencloudmessagingplaZorm

We’ll manage messaging for you

Scalable, easy to use

Completely portable - no lock in

Pre-provisoned - zero install, pay as you go, self-service

Latency is low: Application logic and data are CO-LOCATED

WIN

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 48: Use cases for cloud messaging

RichWolski,CTOandFounder,Eucalyptus

“pre-ymucheverythingyouownisgoingtobetryingtosendyoudata”

StefanNorberg,ChiefArchitect,Unibet

“Ifyouremovetheneedtoinvestininfrastructure,theneedtotrainpeopleontheoperaSonalaspectsandthengetexcellentscalabilityandlowlatencyguaranteedbycontract,I’dbuyitinasecond.WhowillprovidemewiththeRealTimeWebasaservice?”

copyright (c) VMware Inc.

Friday, 23 April 2010

Page 49: Use cases for cloud messaging

Thank‐you

Email:[email protected]

Getstarted:h-p://www.rabbitmq.com/how.html

copyright (c) VMware Inc.

Friday, 23 April 2010