37

(SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Embed Size (px)

DESCRIPTION

Join Peter De Santis, Vice President of Amazon Compute Services, and Matt Garman, Vice President of Amazon EC2 as they share a ''behind the scenes'' look at the evolution of compute at AWS. You hear about the drivers behind the innovations we've introduced, and learn how we've scaled our compute services to meet dramatic usage growth.

Citation preview

Page 1: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 2: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

2011 2012 2013 2014

99% YoY increase in EC2 instance usage

(Q3 2014 vs. Q3 2013, not including Amazon use)

Page 3: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

do more with less

operational excellence at scale

Page 4: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Do more with less

Page 5: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

C4

T2

R3

I2

G2

Page 6: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 7: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 8: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 9: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 10: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 11: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 12: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 13: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

We use Amazon EC2 to serve hundreds of millions of

Pinterest users. Our C1 to C3 migration of over 1200

app servers took no more than three days while

reducing the EC2 instance footprint by 75%,

and adding 30% more compute capacity.

Such a project could easily take up to 3 months and

some serious project management in a traditional

data center environment.

Raj Patel, Head of Cloud Engineering at Pinterest

Page 14: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Simulated 22 advanced

head designs, 3 materials

= 1 million possible designs

Used c3 instances with

Intel IvyBridge cores

Ran in 8 hours vs. 30 days

on internal cluster!

Total cost:

$5,593.94

New Drive Head

Design

Workloads

Submit jobs, orchestrate

HPC clusters over VPN

Encrypt, route data to

AWS, return results

HPC Cluster

70k Cores

Of Spot

Instances

Transforming Disk Drive DesignDesigning devices that store the world’s data

Page 15: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Page 16: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Low Utilization

High Utilization

Page 17: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Apache

MySQL

Tomcat

nginx

PostgreSQL

Rails

MongoDBdjango

OpenVPNnodejs

WordPress

Asterisk

IIS

LighttpdPHP

Varnish

Selenium

Subversion

Flask

LAMPhaproxy

R

Git

Jenkins

OpenERP

Page 18: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

“Is there no minimum guaranteed level of CPU performance?”

“I could get all of a core or be totally starved?”

“It would be great to get solid lower bound on physical CPU

allocation even if it was indeed low, so we know what to expect.”

Page 19: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 20: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 21: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

General Purpose (SSD) Volumes

SSD-backed • 3 IOPS per GB of baseline performance

• Burst up to 3000 IOPS for 30 minutes

Target use cases • Boot volumes

• Small to medium database

Only 0.3% of volumes run out of burst credits

Page 22: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Performance (per volume)

GP2 PIOPS GP2 PIOPS

Max Size 1 TB 1 TB 16 TB 16 TB

Max IOPS 3,000 4,000 10,000 20,000

Max Throughput 128 MBps 128 MBps 160 MBps 320 MBps

PREVIOUSLYW/ LARGER &

FASTER VOLUMES

Page 23: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Glympse is a fast, free, and simple way to share your location in

real time with the people you trust.

I LOVE the T2 instances. I'm

shocked and surprised at how well

they perform. We saw a 74% cost

savings in moving to them..

Craig Link

Cloud Architect, Glympse

Page 24: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Instance vCPU Mem

(GiB)

Monthly price

(3-yr heavy RI )

Ideal use case

m3.medium 1 3.75 $20.16 Always available, balanced

c3.large 2 3.75 $29.95 Always available, compute

t2.medium 2 4 $17.87 Bursty workloads

Page 25: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

T2

Amazon

CloudWatch

Page 26: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 27: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 28: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 29: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Operational Excellence at Scale

Page 30: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

2011 2012 2013 2014

99% YoY increase in EC2 instance usage

(Q3 2014 vs. Q3 2013, not including Amazon use)

Page 31: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 32: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 33: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 34: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

90

91

92

93

94

95

96

97

98

99

100

%Success Rate

Page 35: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 36: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014
Page 37: (SPOT211) State of the Union: Amazon Compute Services | AWS re:Invent 2014

Please give us your feedback on this session.

Complete session evaluations and earn re:Invent swag.

http://bit.ly/awsevals