Patterns For Cloud Computing David Gristwood Application Architect Microsoft @ScroffTheBad

Patterns For Cloud Computing

David GristwoodApplication ArchitectMicrosoft

http://blogs.msdn.com/david_gristwood/@ScroffTheBad

Session Objectives

Provide you with 5 patterns for cloud-based applications

Show implementations ofthese patterns

Patterns for Cloud Computing

#1 - Using the Cloud for Scale

Web TierBrowserRequest

B/L Tier Database

Response

“Wow! What a great site!”

Web Tier B/L Tier Database

Browser

“Server Busy”

Web Tier B/L Tier Database

Browser

“Timeout”

Browser

Web Tier

B/L Tier Database

Browser

Web Tier

How would you do this today on premises?

Database

Browser

Web Tier B/L Tier

B/L Tier

Database

Browser

B/L Tier

Web Tier

Browser

B/L Tier

Database

p1 p2 p3

Web Tier

Not without consequences...

Browser

B/L Tier

Database

p1 p2 p3

Web Tier

“That took a lot of time, effort and money!”

Browser B/L Tier

B/L Tier

Database

p1 p2 p3

Web Tier

“Not so great now…”

“Hmmm... Most of this stuff is sitting idle...”

“That took a lot of time, effort and money!”

Jan Apr Jul Oct

Datacenter peak load

Idle time

How can cloud computing help?

Web RoleBrowserRequest

Worker Role

Azure Storag

eResponse

“Wow! What a great site!”

Web RoleWorker

AzureStorag

Browser

“Server Busy”

Browser

Web Role

Worker Role

AzureStorag

Browser

Web Role

You don’t see this bit

Web Role

AzureStorag

Browser

Web Role

Worker Role

OK, so changing config is easy...

…but what else do I need to know?

Web Role

Browser

Web Role

AzureStorag

Worker Role

Web Role

Browser

Web Role

AzureStorag

Worker Role

Tight coupling between web and worker role is an anti-

pattern

Web RoleWorker

1. Place on queue 3. Pickup from queue

4. Process

2. Respond to UI

Web RoleWorker

4. Process

5. Add result to table

6. Query table on refresh

Demo #1: Prime Solver

How many web and worker roles do you need?

Web Role

Worker Role

AzureStorag

Browser

Web Role

Worker Role

WMI_Win32_PerfFormattedData_ASPNET_ASPNETApplications/RequestsPerSecond

Management APIor Email

How many web and worker roles do you need?

Web Role

Monitor queuelength against

user’s expectations

Web Role

Worker Role

Web Role

Monitor queuelength against

user’s expectations

Web Role

Worker Role

Takeaways

Understand how to communicate between roles and nodesStrategy on when to scale up/down roles in production

A core tenet of cloud computing is the ability to scale up & down

Patterns for Moving to the Cloud

#2 - Using the Cloud for Multi-Tenancy

#2 - Using the Cloud for Multi Tenancy

Web TierBrowser B/L Tier Database

Customer #2

Customer #1

Customer #3

Gets expensive pretty quickly

Browser

Customer #1

Customer #2

Customer #3

What you really want is this:

Schema Customizations

UI Customizations

3 options for data in multi tenant environment

Browser

Customer #1

Customer #2

Customer #3

Option 1: Everyone Uses the Same Database/Schema

Fixed Schema

Pros: Simplest approach, easy to maintain/upgrade.Cons: No customizations. Restoring of tenant data.

Web TierBrowser B/L Tier

Database

Browser

Customer #1

Customer #2

Customer #3

Option 2: Give Each Customer Their Own Database/Schema

Customer #1

Database

Customer #2

Customer #3

Pros: Flexible. Tenant restore is easier. High Isolation.Cons: Can be costly. Difficult to upgrade db schemas.

Browser

Customer #1

Customer #2

Customer #3

Option 3: Fixed Database/Schema, with customizations

Fixed Schemawith

Customizations

Pros: Customers can add their own custom fieldsCons: Non standard way of customizing the schema. Tenant restore is difficult.

TenantID

Tenant

TenantNamenvarchar

EmployeeId

Employee

FirstName nvarchar

LastName nvarchar

CustomizationID

Customization

Value nvarchar

TypeID

Name nvarchar

CLRType nvarchar

TenantID

Tenant

TenantNamenvarchar

EmployeeId

Employee

FirstName nvarchar

LastName nvarchar

CustomizationID

Customization

Value nvarchar

TypeID

Name nvarchar

CLRType nvarchar

Fixed SchemaApplies to All

Tenants

CustomizableTenant by

Tenant Basis

TenantID

Tenant

TenantNameUK Branch

EmployeeId

Employee

FirstName Gordon

LastName Brown

CustomizationID

Customization

Value SW1A 2AA

TypeID

Name PostalCode

CLRType string

TenantID

Tenant

TenantNameUS Branch

EmployeeId

Employee

FirstName Barack

LastName Obama

CustomizationID

Customization

Value 20500

TypeID

Name ZipCode

CLRType string

UI Customizations

Browser

Customer #1

Customer #2

Customer #3

URL Handing using MVC routing

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk

http://hr.fabrikam.com

http://employeedata.cloudapp.net

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk -> CNAME (employeedata.cloudapp.net)

http://hr.fabrikam.com -> CNAME (employeedata.cloudapp.net)

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk -> CNAME (employeedata.cloudapp.net)

http://hr.fabrikam.com -> CNAME (employeedata.cloudapp.net)

Use custom route to controller mapping

Demo #2: Multi Tenant Schema and UI

Takeaways

Design considerations must include both data and UI

Many other considerations, such as identity

Always consider Multi Tenancy first, even if only one customer

#3 - Using the Cloud for

Compute

#3 - Using the Cloud for Compute

MasterClient

Worker

MasterClient

Result

Worker

Result

Popularized by the term “MapReduce”*

* 2004 OSDI paper by Jeff Dean and Sanjay Ghemawat (Google)

MasterClient

Worker

“Map”

M<k,v>

M<k.v>

M<“the quick brown”.”e”>M<“fox jumps over”.”e”>M<“the lazy dog”.”e”>

How many ”e”’s in“The quick brown fox jumps over the

lazy dog”?

MasterClient

Result

Worker

“Reduce”

L<k,v>

L<”e”,”1”>L<”e”,”1”>L<”e”,”1”>

3 x ”e”s found

And it’s definitely popular...

Google20pb of data analyzed every day using

MapReduce

Yahoo!10k+ cores, 4pb of data using MapReduce

Facebook2500+ cores, 1pb of data using MapReduce

And there are several frameworks…

C++, C#, Erlang, Java, Python, Ruby, F#, R, …

Apache HadoopOpen Source Java “Inspired by MapReduce”

(Core, HDFS, many more)

Amazon Elastic MapReduceHadoop implementation on EC2

MasterClient

Worker

DataClient ApplicationJob/Task Scheduler

Remote Service

Sockets

How about implementing this on Windows Azure?

Web RoleClient

Worker

Client ApplicationJob/Task Scheduler

Remote Service

Demo #3: Windows Azure Demo “Inspired by MapReduce”

Takeaways

Learn about existing frameworks, especially Apache HadoopRead up on Dryad (DryadLINQ) for future direction

MapReduce very visible, although can be difficult to initially grasp

Storage

#4 - Using the Cloud for Storage

File ServerClientRPC/NFSFile

DB ServerClient RDBMS

TDS (Tabular Data Stream)Data

Web Server

Browser Database

HTTP POSTData

Server Data

Affinity between your data and physical hardware that serves it

I love you!

I love you too!

Server Data

I love you!

I love you too!

Symptoms:Which RAID number was that again?

Tedious to backup exponentially growing dataDamn! I’m at 95% capacity - got to move to a

bigger disk

How does the cloud help?

Breaks the affinity between your data and hardware

Blobs, Tables, Relational

Client Azure Blob Storage

REST API

PutBlob PUT http://account.blob.core.windows./net/containername/blobname

Blob Container

http://account.blob.core.windows.net/containername/blobname

REST API

GetBlob GET http://account.blob.core.windows./net/containername/blobnameRange: bytes=329300 - 730000

Blob Container

REST API

PutBlock(blobname, blockid, data)PutBlockList(blobname, blockid1, …, blockidN)

Blob Container

Worker Role

AzureTable

Storage

Each Table:

PartitionKey (e.g. DocumentName) to ensure scalabilityRowKey (e.g. version number) as application key[fields] for data as name / value pairs

http://account.table.core.windows.net

REST: GET http://account.table.core.windows.net/Customer?$filter=%20PartitionKey%20eq%20value LINQ:var customers = from o in context.CreateQuery<customer>(“Customer”) where o.PartitionKey == value select o;

SQL AzureClient RDBMS

TDSData

For easy migration, this is what I would like to do...

SQL AzureBrowser RDBMS

Web RoleHTTP

Worker Role

Migration:

Browser RDBMS

Web TierHTTP

Bus. Logic

“The Data Center”

SQL Server

SQL AzureBrowser RDBMS

Web RoleHTTP

Worker Role

“The Cloud”

Demo #4: SQL Azure

Takeaways

Understand the pricing model for storage on-premises vs. cloudSQL Azure as a factor for migration/move from on premises

Storage in the cloud may look the same, but breaks the affinity issue

Communications

#5 - Using the Cloud for Communications

Client Server

Company 1 Company 2Telco provided WAN

FTPClient

FTPServer

Client Server

FTPClient

FTPServer

Internet

Client Server

Browser

Internet

ExtranetSite

What does the cloud provide?

Client

Azure Queue

http://app.queue.core.windows.net/

Client

Company 1

Company 2

Client

Azure Queue

Client

Company 1

Company 2 xSecurity?Shared keys?

Client

Azure Queue

Client

Company 1

Company 2

Web Role

Client

Azure Queue

Client

Company 1

Company 2

Web Role

Firewall

Proxy?

Client

Azure Queue

Client

Company 1

Company 2

Web Role

Firewall

65.55.33.204

192.168.14.100

Client

Azure Queue

Client

Company 1

Company 2

Web Role

Firewall

65.55.33.204

192.168.14.100OK, so I’ll do a

HTTP poll every minute

Client

Azure Queue

Client

Company 1

Company 2

Web Role

Firewall

65.55.33.204

192.168.14.100…and how about other

protocols other than HTTP?

How does the Azure AppFabric Service Bus help?

Client

AppFabricService Bus

sb://.../myqueue

Client

Company 1

Company 2

Client

Outbound bi-directional socketKept alive in background

AppFabric Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

Client

Outbound bi-directional socketKept alive in background

AppFabricService Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

FirewallOutbound one-way socket

Message routedaccordingly

Takeaways

Firewalls/NATs can add additional trouble (especially non-HTTP)Learn how AppFabric Service Bus traverses in these scenarios

Be careful consuming REST based queues using shared secret

Putting the patterns together…

Putting the Patterns Together

Let’s build an application in

PHP that scales to many nodes…

Windows Azure

Java Servlet

Google AppEngine

ASP.NET

Amazon EC2

Windows AzureUse the principles of multi tenancy to

create a version of the application across multiple

vendors

(10 nodes)

(5 nodes using ELB)

Java Servlet

Google AppEngine

ASP.NET

Amazon EC2

Client

Windows Azure

Compute results with a

MapReduce-like way of

distributing work across all of

these applications

SQL Azure

Database

Java Servlet

Google AppEngine

ASP.NET

Amazon EC2

Client

Windows AzureStore the

results in a SQL Azure database

SQL Azure

Database

.NET Service Bus

Java Servlet

Google AppEngine

ASP.NET

Amazon EC2

Client

Windows Azure

Coordinate communication

through the AppFabric

Service Bus

SQL Azure

Database

AppFabric Service Bus

Java Servlet

Google AppEngine

ASP.NET

Amazon EC2

Client

Windows Azure

40 jobs of250,000numbers

Compute

Store resultsin SQL AzureHow many

prime numbers

between 1 & 10,000,000?

Demo #5: Prime Solver v2.0

Next Steps

Head up to www.Azure.com . . . . .

Next Steps

© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED

OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Patterns For Cloud Computing David Gristwood Application Architect Microsoft @ScroffTheBad

Documents

Leveraging Design Patterns in ABL Applications Phillip Magnay Technical Architect

C8: Enterprise Integration Patterns in Sonic ™ ESB Stefano Picozzi Solutions Architect

Software Factories : Assembling Applications with Patterns, Models, Frameworks and Tools Steve Cook Architect Visual Studio

Design Patterns Applied Andrea Saltarello Software Architect – Software Architect – Managed Designs S.r.l.Managed Designs S.r.l.

Name:David Hill Title:Principal Architect Company:Microsoft Patterns & Practices Session Code:ARC303

Schema Design Patterns for a Peta-Scale WorldSchema Design Patterns for a Peta-Scale World Aaron Kimball Chief Architect, WibiData . About me . Big Data Applications Customer Mobile

Cross Platform Design Patterns - Meetupfiles.meetup.com/5083302/Cross Platform Design Patterns... · 2012-12-14 · Cross Platform Design Patterns Roy Cornelissen IT Architect, Info

Using Promise Patterns with JavaScript, jQuery, and the SharePoint 2013 App Model Doug Hemminger SharePoint Solutions Architect, Protiviti

Patterns: Model-Driven Development using IBM Rational ... · ibm.com/redbooks Patterns: Model-Driven Development Using IBM Rational Software Architect Peter Swithinbank Mandy Chessell

API Security & Federation Patterns - Francois Lascelles, Chief Architect, Layer 7 @ QCon SF

Cf.OBJECTIVE (ANZ) Design Patterns and Form Processing Jaime Metcher Software Architect, Centre for Innovation in Professional Learning, University of

Design Patterns and ColdFusion - corfield.org · Sr Architect, Macromedia IT Sr Consultant, various web co. Architect / Developer: ColdFusion since 2001 Java since 1997 (Groovy since

@ScroffTheBad http:// bit.ly/davidgri David.Gristwood@microsoft.com The A-Z of the Windows Azure Platform David Gristwood Application Architect, Microsoft

Cloud Design Patterns - HAVIT Knowledge Base · 4/8/2018 · Cloud Design Patterns Robert Haken software & cloud architect, HAVIT, s.r.o. haken@havit.cz, @RobertHaken, + .eu Microsoft

Patterns and Practices for Model-Based Testing...Patterns and Practices for Model-Based Testing MBT = More Better Testing Keith Stobie, Test Architect Protocol Engineering Team, Microsoft

Functional Programming—a php[architect] Guide · Functional Programming in PHP 69 Patterns In functional programming there are repeating patterns just as in any other programming

Server Development Overview Paul Appleby & David Gristwood Application Architects Developer & Platform Group Microsoft Limited

Integration Patterns Overview Christopher Baldwin Architect Microsoft EMEA cbaldwin@microsoft.com

1 © Copyright 2012 EMC Corporation. All rights reserved. MapReduce Design Patterns Donald Miner Greenplum Hadoop Solutions Architect @octopusorange

Understanding Developing with Microsoft SharePoint Services David Gristwood, Paul Appleby, Mike Taulty. Developer Platform Group Microsoft Ltd