AWS Summit Berlin 2013 - Building web scale applications with AWS

Ryan Shuttleworth, Technical Evangelist

Building Web-Scale Applications with AWS

What’s a web scale application?

Three principles to build upon

Layering the cake:Data

Application

Total Jobs Group – their story

What are we going to cover?

What do web scale apps have in

common?

Actual demand

Predicted demand

Customerdissatisfaction

Demand

Elastic capacity No need to guess capacity requirements and over-provisionElastic Capacity

Elastic capacity

Demand

Elastic capacity No need to guess capacity requirements and over-provisionElastic Capacity

Built on a global footprint

9 Regions

25 Availability Zones

Continuous Expansion

Built across regional availability zones

Relational Database ServiceDatabase-as-a-Service

No need to install or manage database instances

Scalable and fault tolerant configurations

DynamoDBProvisioned throughput NoSQL database

Fast, predictable performance

Fully distributed, fault tolerant architecture

Use RDS for databases

Use DynamoDB for high performance key-

value DB

Architected using services

Amazon SQS

Processing

task/processing

trigger

Processing results

Amazon SQSReliable, highly scalable, queue service

for storing messages as they travel

between instances

Task A

Task B

(Auto-scaling)

Task C

Simple WorkflowReliably coordinate processing steps

across applications

Integrate AWS and non-AWS resources

Manage distributed state in complex

systems

Push inter-process workflows into the cloud with SWF

Reliable message queuing without

additional software

Cloud SearchElastic search engine based upon

Amazon A9 search engine

Fully managed service with

sophisticated feature set

Scales automatically

DocumentServer

Results

SearchServer

Don’t install search software, use CloudSearch

Process large volumes of data cost effectively

with EMR

Elastic MapReduceElastic Hadoop cluster

Integrates with S3 & DynamoDB

Leverage Hive & Pig analytics scripts

Integrates with instance types such as

Three principles to build upon…

Elasticity

State Data

Security

Elasticity

State Data

Security

Elasticity

State Data

Inherent2

Security

Elasticity

State Data

Inherent

Groups

FailureSecurity

Elasticity

State Data

Inherent

Groups

FailureSecurity

Elasticity

State Data

Inherent

Expected

Groups

FailureSecurity

Elasticity

State Data

Inherent

Expected

Automation

TestingGroups

Failure

Elasticity

State Data

Expected

Automation

Testing

SecurityInherent

Groups

Layering the cake

Web scale data

Object storage

You put it in S3AWS stores with 99.999999999% durability

Highly scalable web access to objects

Multiple redundant copies in a region

What is S3?

Highly scalable data storage

Access via APIsA web store,

not a file system

Highly available & durable

Economical

Case S

Web scale data

Object storage

Web scale data

Object storageRelational data

Master/Slave Horizontal ScalingReasonably simple to implement

Leverage PIOPs for raw performance

Easy to change instances sizes

Has an upper limit

hash ring

Sharded Horizontal ScalingMore complex at the application layer

No practical limit on scalabilityOperation complexity/sophistication

Shard by function or key spaceRDBMS or NoSQL

Web scale data

Horizontal Scaling - Fully Managed

DynamoDBProvisioned throughput NoSQL database

Fast, predictable performance

Fully distributed, fault tolerant architecture

Considerations for non-uniform data

DynamoDBProvisioned read/write performance per table

Predictable high performance scaled via console or

Dial it up

Low provisioned throughput

TablePartition

Region

Illustrative diagram only

Region

TablePartition

Increased provisioned throughput

DataRegion

Illustrative diagram only

TablePartition

High provisioned throughput

Application

Loose coupling sets you free!

The looser they're coupled, the bigger they scale

Independent components

Design everything as a black box

Decouple interactions

Load-balance clusters

Application

Amazon SQS

Processing

task/processing trigger

Processing results

Amazon SQSReliable, highly scalable, queue service for storing

messages as they travel between instances

Application

Controller A Controller B Controller C

Tight Coupling

Application

Controller A Controller B Controller C

Tight Coupling

Loose Coupling

Application

Auto ScalingAutomatic resizing of compute clusters based on demand

Trigger auto-scaling policy

Feature Details

Control Define minimum and maximum instance pool sizes and when scaling and cool down occurs.

Integrated to Amazon

CloudWatch

Use metrics gathered by CloudWatch to drive scaling.

Instance types Run Auto Scaling for On-Demand and Spot Instances. Compatible with VPC.

Application

Where does state

reside?

Application

Where does state

reside?

Browser cookies

Framework session handler

Session database

Memory session

manager

Application

State store should be:

Performant

Scalable

Reliable

Application

Where should state reside?

Application

Not here

Application

Not here

Session state service

State must reside OUTSIDE the scope of the elements you wish to scale

Application

Where should state reside?PerformantScalableReliable

Application

Load Balancing

Feature Details

Available Load balance across instances in multiple Availability Zones

Health checks Automatically checks health of instances and takes them in or out of service

Session stickiness Route requests to the same instance

Secure sockets layer Supports SSL offload from web and application servers with flexible cipher support

Monitoring Publishes metrics to CloudWatch

Elastic Load BalancingCreate highly scalable applications

Distribute load across EC2 instances

in multiple availability zones

Application

Load Balancing

Distribution

Route53

Region A

Route53

Region B

Request

Route53Global DNS service

Application

Load Balancing

Distribution

Route53

Region A

Route53

Region B

16ms 92ms

Request

Application

Load Balancing

Distribution

Route53

Region A

Route53

Region B

16ms 92ms

Request

Application

Load Balancing

Distribution

Route53

Region A

Route53

Region B

16ms 92ms

RequestRegion A DNS entry

Application

Load Balancing

Distribution

London

Served from S3/images/*

Served from EC2*.php

Single CNAMEwww.mysite.com

CloudFrontWorld-wide content distribution

network

Application

Load Balancing

Distribution

No CDN CDN for

Static

Content

CDN for

Static &

Dynamic

Content

CloudFrontWorld-wide content distribution

network

Application

Load Balancing

Distribution

Management

Application

Load Balancing

Distribution

Management

10 instancesmanageable

Application

Load Balancing

Distribution

Management

100 instancesat a push

Application

Load Balancing

Distribution

Management

1,000 instancesnot a chance

Application

Load Balancing

Distribution

Management

Automation & management

Web scale enabler

OpsWorks Elastic Beanstalk

CloudFormation EC2

Application

Load Balancing

Distribution

Management

OpsWorks Elastic Beanstalk

CloudFormation EC2control

convenience

Application

Load Balancing

Distribution

Management

Summary

Use these techniques (and many others) as appropriate

Awareness of the options is the first step to good design

Scaling is the ability to move the bottlenecks around to the least expensive part of the architecture

AWS makes this easier – so your application is not a victim of its own success

Summary

Thank you

AWS Summit Berlin 2013 - Building web scale applications with AWS

Technology

BERLIN - Amazon Web Servicesaws-de-media.s3.amazonaws.com/images/AWS Summit Berlin 2015... · Simple Security for Startups Mark Bate, AWS Solutions Architect . Agenda • Our Security

AWS Summit Berlin 2013 - Introducing AWS Opsworks

BERLIN 2015 - Amazon Web Servicesaws-de-media.s3.amazonaws.com/images/AWS Summit Berlin 2015... · Solution: • Stack membership - serfdom. • Gossip based cluster membership. •

Berlin 2015 - Amazon Web Servicesaws-de-media.s3.amazonaws.com/images/AWS Summit... · Berlin 2015. Scaling on AWS From 1 to 10 Million Users Matthias Jung, Solutions Architect AWS

Transforming the Customer Experience AWS Summit …aws-de-media.s3.amazonaws.com/images/Enterprise Summit... · Transforming the Customer Experience AWS Summit 2015 Reinhard Rabenstein

Agility: A Case Study - aws-de …aws-de-media.s3.amazonaws.com/images/AWS Summit Berlin 2015... · Agility: A Case Study ... ThoughtWorks Philipp Garbe - AutoScout24 . AUTO 24

AWS & Intel: A Partnership Dedicated to Cloud …aws-de-media.s3.amazonaws.com/images/AWS Summit Berlin...to cloud directly • Old VMs abandoned or become “zombies” • Security

d1.awsstatic.comTIBCO Jaspersoft + able a u. aws SUMMIT . aws aws SUMMIT . arce10 LIONSGATE LOCKHEED M bp TATA MOTORS Ctx,l-td- ... XEON inside- aws SUMMIT . intel XEON inside- aws

AWS Summit Berlin 2013 - Amazon Redshift

Berlin - Amazon Web Servicesaws-de-media.s3.amazonaws.com/images/AWS Summit Berlin 2015... · Berlin . Best Practices for ... (Amazon VPC) • The principle of least privilege

AWS Summit Berlin 2013 - Realtech - How to Determine the Economic Value of SAP in the Cloud

Berlin - Amazon Web Servicesaws-de-media.s3.amazonaws.com/images/AWS Summit Berlin 2015... · • Appropriate VF driver ... Intel® 82599 Virtual Function driver . Enhanced Networking

AWS Summit Berlin 2013 - Keynote - 6wunderkinder

AWS Summit Berlin 2012 Talk on Web Data Commons

AWS Summit Berlin · 2019-11-12 · AWS Global Summits are free events designed to bring together the cloud computing community to connect, collaborate, and learn about AWS. Over

Cloud Analytics and Business Intelligence on AWSaws-de-media.s3.amazonaws.com/images/AWS Summit Berlin 2015... · Cloud Analytics and Business Intelligence on AWS. Infrastructure

AWS Summit Berlin 2013 - Tadaa - HD Camera and Photo Community

AWS Summit Nordics - Enterprise Apps on AWS

AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

AWS Summit Berlin 2013 - Your first week with EC2