(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Preview:

DESCRIPTION

Join Peter De Santis, Vice President of Amazon Compute Services, and Matt Garman, Vice President of Amazon EC2 as they share a ''behind the scenes'' look at the evolution of compute at AWS. You hear about the drivers behind the innovations we've introduced, and learn how we've scaled our compute services to meet dramatic usage growth.

Citation preview

2011 2012 2013 2014

99% YoY increase in EC2 instance usage

(Q3 2014 vs. Q3 2013, not including Amazon use)

do more with less

operational excellence at scale

Do more with less

C4

T2

R3

I2

G2

We use Amazon EC2 to serve hundreds of millions of

Pinterest users. Our C1 to C3 migration of over 1200

app servers took no more than three days while

reducing the EC2 instance footprint by 75%,

and adding 30% more compute capacity.

Such a project could easily take up to 3 months and

some serious project management in a traditional

data center environment.

Raj Patel, Head of Cloud Engineering at Pinterest

Simulated 22 advanced

head designs, 3 materials

= 1 million possible designs

Used c3 instances with

Intel IvyBridge cores

Ran in 8 hours vs. 30 days

on internal cluster!

Total cost:

$5,593.94

New Drive Head

Design

Workloads

Submit jobs, orchestrate

HPC clusters over VPN

Encrypt, route data to

AWS, return results

HPC Cluster

70k Cores

Of Spot

Instances

Transforming Disk Drive DesignDesigning devices that store the world’s data

Low Utilization

High Utilization

Apache

MySQL

Tomcat

nginx

PostgreSQL

Rails

MongoDBdjango

OpenVPNnodejs

WordPress

Asterisk

IIS

LighttpdPHP

Varnish

Selenium

Subversion

Flask

LAMPhaproxy

R

Git

Jenkins

OpenERP

“Is there no minimum guaranteed level of CPU performance?”

“I could get all of a core or be totally starved?”

“It would be great to get solid lower bound on physical CPU

allocation even if it was indeed low, so we know what to expect.”

General Purpose (SSD) Volumes

SSD-backed • 3 IOPS per GB of baseline performance

• Burst up to 3000 IOPS for 30 minutes

Target use cases • Boot volumes

• Small to medium database

Only 0.3% of volumes run out of burst credits

Performance (per volume)

GP2 PIOPS GP2 PIOPS

Max Size 1 TB 1 TB 16 TB 16 TB

Max IOPS 3,000 4,000 10,000 20,000

Max Throughput 128 MBps 128 MBps 160 MBps 320 MBps

PREVIOUSLYW/ LARGER &

FASTER VOLUMES

Glympse is a fast, free, and simple way to share your location in

real time with the people you trust.

I LOVE the T2 instances. I'm

shocked and surprised at how well

they perform. We saw a 74% cost

savings in moving to them..

Craig Link

Cloud Architect, Glympse

Instance vCPU Mem

(GiB)

Monthly price

(3-yr heavy RI )

Ideal use case

m3.medium 1 3.75 $20.16 Always available, balanced

c3.large 2 3.75 $29.95 Always available, compute

t2.medium 2 4 $17.87 Bursty workloads

T2

Amazon

CloudWatch

Operational Excellence at Scale

2011 2012 2013 2014

99% YoY increase in EC2 instance usage

(Q3 2014 vs. Q3 2013, not including Amazon use)

90

91

92

93

94

95

96

97

98

99

100

%Success Rate

Please give us your feedback on this session.

Complete session evaluations and earn re:Invent swag.

http://bit.ly/awsevals