Optimizing AWS S3 storage costs and usage

Preview:

Citation preview

@cloudability

@cloudability

Optimizing AWS Storage Costs and UsageMonitor and optimize S3 usage for cost

July 20, 2016

๏ @cloudability

Introduction

Today’s Topics

Mike McCullough Technical Account Manager

TODAY’S SPEAKER

1. Wait, how does Cloud Storage work again?

2. Understanding Object Storage types

3. Optimizing for cost efficiency

4. Q&A

@cloudability

Our SolutionsHow It Works

1 2 3

4 5

Spend Monitoring Spending visibility via custom dashboards, budget alerts, and daily email digests.

Cost Allocation Segment your cloud costs with detailed reports by tag, service, usage type, etc..

Usage Optimization Spot under-utilized resources w/ instance level usage metrics.

RI Portfolio Optimization Get recommendations to buy, modify and sell the right RIs. Then see their impact on your spending.

Company-Wide Governance Organizational group views/filtering/rollups, multi-user access.

0

45

90

135

180D

ev/T

est

POC

App

#1

App

#3

App

#2

Exec team starts really caring

Load

test

A Story of Growth

๏ @cloudability

Cloud Storage BasicsWhat is AWS Simple Storage Service?

๏ Secure, durable, scalable, Cloud object storage

๏ S3 Standard, S3 Standard - IA, Glacier

๏ Misalignment in data location by storage term length can be very costly

๏ @cloudability

Cloud Object Storage Basics

AWS S3 Standard

๏ Know the Tier requests ๏ Tier 1: PUT, COPY, POST, LIST ๏ Tier 2: GET ๏ Tier 3: Glacier Archive and Restore

๏ Tag your buckets

๏ Implement data lifecycle management policies

๏ @cloudability

S3 Bucket Level ReportsCloudability Resource Analytics

๏ @cloudability

S3 Bucket Level ReportsCloudability Resource Analytics

๏ @cloudability

Stage I: Cost visibility for all (emails, alerts, dashboards)

Stage II: Allocating costs to departments (tags, linked accounts)

Stage III: Using only what you need (underutilized, unneeded)

Stage IV: Lowering Cost Per Hour (new families, Reserved Instances)

Stage V: Tying spending to the bottom line (unit cost)

The Five Stages of Cloud EfficiencyCloudability

๏ @cloudability

IA Storage BasicsAWS S3 Standard - Infrequent Access

๏ Less frequently accessed data

๏ Exists at object level and can sit side by side with Standard in an S3 Bucket

๏ Min billable object size (128k)

๏ Min storage time (30 days)

๏ @cloudability

IA Storage BasicsAWS S3 Standard - Infrequent Access

๏ Less frequently accessed data

๏ Exists at object level and can sit side by side with Standard in an S3 Bucket

๏ Min billable object size (128k)

๏ Min storage time (30 days)

๏ @cloudability

S3 Bucket Level WidgetsCloudability Resource Analytics

๏ @cloudability

Glacier BasicsAWS Glacier

๏ Very infrequently accessed data and long-term backups

๏ Secure, durable, low-cost*

๏ Redundant storage and systematic integrity checks

๏ Min storage time before restore (90 days)

๏ Max data retrieval (5% of total monthly Glacier storage)

๏ @cloudability

Cloud Storage BasicsWhat is AWS Simple Storage Service?

๏ Secure, durable, scalable, Cloud object storage

๏ S3 Standard, S3 Standard - IA, Glacier

๏ Misalignment in data location by storage term length can be very costly

๏ @cloudability

Going Further

- Turn off instances that are not being used- Autoscale resources down when load decreases- Turn off dev/test/stage resources at night - Rightsize the instance size/type to the load- Migrate from old instance families to new ones (e.g., m1 to m3)

- Optimize Reserved Instances - Employ a ‘stopinator’ or Janitor Monkey- Use Spot Instances for asynchronous workloads

Many ways to increase efficiency…

@cloudability

Thank you!Try Cloudability free

Learn more

Want a demo?

cloudability.com

blog.cloudability.com

demo@cloudability.com

@cloudability

Thanks! mike@cloudability.com

Recommended