Devopsconf 2015 sebamontini

Preview:

Citation preview

Exprimir cada centavo

@sebamontini

Operations Manager @ Nubity

Amateur golfer, whisky enthusiast and cloud evangelist

Current GenerationT2 - General PurposeM4/M3 - General Purpose (Haswell+AVX2/Ivy Bridge)C4/C3 - Compute Optimized (Haswell+AVX2/Ivy Bridge)High performance ApplicationsR3 - Memory Optimized (Ivy Bridge)Distributed Database & Cache, Hungry-hungry JavaG2 - GPU Optimized (Sandy Bridge + CUDA)3D video streaming, machine learning, video encoding, little coinsI2 - High I/O (Ivy Bridge)Cassandra, MongoDB, HadoopD2 - Dense-Storage (Haswell)Map Reduce, MPP, Warehouse

Instance Types

Instance Sizes

Small InstancesNo EBS optimizationLow Network PerformanceSmall local instance storage

Medium InstancesEBS optimization (varies)Moderate Network PerformanceModerate local instance storage

Large InstancesEBS optimization (varies)10gb Network ConnectionSSD local instance storage

T2 Instances Family The T2 family of instance types could be a good option

for development and test workloads, especially continuous integration (CI) and automated testing. T2 instance types are also a fit for single-server workloads where the server sits idle much of the time.

Instance type Initial CPU credit*CPU credits earned

per hourBase performance (CPU utilization)

Maximum earned CPU credit balance Cores RAM (GB) Cost/Hour Cost/Month

t2.micro 30 6 10% 144 1 1 0.013 9.36

t2.small 30 12 20% 288 1 2 0.026 18.72

t2.medium 60 24 40%** 576 2 4 0.052 37.44

t2.large 60 36 60%** 864 2 8 0.104 74.88

Reserved Instances

Spot Instances

Instance Type On Demand Spot

m3.medium $0.067 $0.0081 12.09%

m3.large $0.133 $0.0201 15.11%

m3.xlarge $0.266 $0.0387 14.55%

m3.2xlarge $0.532 $0.0708 13.31%

m4.large $0.126 $0.0137 10.87%

m4.xlarge $0.252 $0.0267 10.60%

m4.2xlarge $0.504 $0.0521 10.34%

m4.4xlarge $1.008 $0.1043 10.35%

m4.10xlarge $2.520 $0.3285 13.04%

Spot Bid Advisor

Spot InstancesNew Resource-Oriented Bidding

EC2 will use this information to build the fleet using the most economical combination of available instance types, looking for instances that have the lowest Spot price per unit.

2 x r3.8xlarge4 x r3.4xlarge8 x r3.2xlarge16 x r3.xlarge32 x r3.large

Or something more complex and heterogeneous, such as:1 x r3.8xlarge and 2 x r3.4xlarge2 x r3.4xlarge and 8 x r3.xlarge8 x r3.xlarge and 16 x r3.large

S3 & Glacier

Glacier Pricing Model:

• 1Tb = $ 7.17

• 1Tb retrival in 1 month = $ 9.73

• 1Tb retrival in 1 day = $ 306.99

• 1Tb retrival in 4hs = $ 1840

PitfallsUndersizing your servers- Build T1 servers that will spawn alarms constantly- Jenkins build time up to the roof- Rebuilding servers

Oversizing your servers- Wasted CPU/Memory processing & storage laying around- RDS storage that will eat you alive- Rebuilding servers

API hits- R53 TTL & Health check nightmares- Extreme monitoring gone wrong- Read. The. Fine. Print.

Pitfalls

Know your infrastructure“Hey! That team migration was amazing! Can’t we just do the same and move our entire storage to AWS?”

Understand your applications“So, I’m thinking about moving Project X to AWS. It shouldbe super simple!! It’s just a couple of APIs!”

Make your team know & understand that most migrations are an architectural challenge“Can it be done by next sprint?”

Forecasting

http://calculator.s3.amazonaws.com/index.html

is it worth it?

Preguntas?

Gracias!

Sebastian Montinismontini@nubity.com@sebamontini

Recommended