31
Doron Rogov Head of Operations [email protected] FinOps: Financial Operations

FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Embed Size (px)

Citation preview

Page 1: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Doron RogovHead of Operations [email protected]

FinOps: Financial Operations

Page 2: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

CloudZone, Matrix’s cloud unit, is a leading AWS solution provider. With over 7 years of experience over AWS, CloudZone provides its customers with a complete service package that includes consulting, professional services and managed services.

As an Premier Consulting Partner, Worldwide Channel Reseller and Managed Service Provider of Amazon Web Services, we ensure that our customers adopt the most advanced technologies and best practices.

Page 3: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

BIG F^$&ING ###

Page 4: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Dedicated Tenancy:Dedicated Instances are Amazon EC2

instances that run in a VPC on hardware that's dedicated to a single customer

*$2 per hour (Per Region Fee)

Page 5: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Detailed Monitoring for EC2 Detailed Monitoring for EC2 instances with higher resolution and metric aggregation

*$3.50 per instance

Page 6: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

CloudWatch Custom MetricsSubmit Custom Metrics generated by

operating systems or your own applications*$0.50 per metric

Page 7: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Case StudyPhase 1Highly Available PHP App (x100s) and MongoDB (x10s)

Page 8: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Case StudyPhase 2Highly Available PHP App and Fully Managed DynamoDB

Page 9: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Case StudyPhase 3Serverless App using Lambda, API Gateway and DynamoDB

Page 10: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Design for Cost Reduction

Finding and Eliminating Waste

Leveraging the Cloud to Reduce Costs

Implementing governance policies

and rules

FinOps is a 4 step continuous cost optimization service:

What is FinOps?

Page 11: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Design for Cost Reduction

Finding and Eliminating Waste

Leveraging the Cloud to Reduce Costs

Implementing governance policies

and rules

FinOps is a 4 step continuous cost optimization service:

What is FinOps?

Page 12: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Finding and Eliminating Waste

• Underutilized or unused resources (EC2, EBS, RDS, etc.)

• EBS Snapshots retenation

• Archiving Amazon S3 Data to Amazon Glacier

• Reserved Instance purchase (EC2, RDS, Redshift)

Page 13: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Design for Cost Reduction

Finding and Eliminating Waste

Leveraging the Cloud to Reduce Costs

Implementing governance policies

and rules

FinOps is a 4 step continuous cost optimization service:

What is FinOps?

Page 14: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Leveraging the Cloud to Reduce Costs

• Dev/test environments can be shut down at project termination.

• Shutdown specific services after business hours, during holidays.

• Disaster Recovery environments can remain inactive until you need them.

• Tag resources that can be turned off or deleted after a specified time period.

Page 15: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Parameters for Tagging

10 custom tags per resource.Max key length: 127 Unicode characters.Max value length: 255 Unicode characters.

➢ Non-ASCII characters return as Unicode escapes (example: \u65e5\u672c).

Prefix aws: is reserved.Few resources cannot be tagged; different resources require using different commands.

Page 16: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Tag’s Key Examples

Business Unit Cost Center Owner

Shutdown Time Environment Support Contact

Dept./GroupApplication/ProductEndpoint

Page 17: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Tagging CLI Commands

Resource view: use --filter argument to the relevant AWS CLI command:➢ Provides access to all values regarding resource.aws ec2 describe-instances --filter "Name=tag:Role,Values=DEV"

Use --query to get list of specific values, such as instance ID:aws ec2 describe-instances --filter "Name=tag:Role,Values=DEV" --query 'Reservations[*].Instances[*].InstanceId'

Page 18: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Design for Cost Reduction

Finding and Eliminating Waste

Leveraging the Cloud to Reduce Costs

Implementing governance policies

and rules

FinOps is a 4 step continuous cost optimization service:

What is FinOps?

Page 19: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv
Page 20: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Design for Cost Reduction• “Right-size” & “Right-family” instances.

• Purchasing Reserved Instances (RI) for groups of long-running instances.

• Leverage spot instances to get the best price.

• Use AWS obstructed services to leverage a “Pay as you go” model to reduce cost(Lambda, DynamoDB, SQS, etc.).

• Design for server-less architecture.

Page 21: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

FinOps is a 4 step continuous cost optimization service:

Design for Cost Reduction

Finding and Eliminating Waste

Leveraging the Cloud to Reduce Costs

Implementing governance policies

and rules

What is FinOps?

Page 22: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Implementing governance policies and rules

• Track and manage changes like: launching new resources, tracking and terminating unused or underutilized assets, sudden cost spikes, security risks and adherence to business guidelines.

• Automate workflow for policy actions like: stop or terminate instances, delete volumes, etc.

• Automate the process of purchasing and modifying reserved instances across one of more accounts.

• Avoid costly surprises in your cloud. Proactively manage your cloud with policy notifications and “Pulse” subscriptions for timely cost, usage, performance, and budget considerations.

Page 23: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

AWS Config AWS CloudTrail

Page 24: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Top 5-ish tools (That you can start using right now!)

Page 25: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Trusted Adviser

CloudWatch

Cost Explorer

CLI Budgets

Cost Allocation

Price List API

Identity Access Management

Page 26: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Netflix Ice

Ice communicates with AWS Programmatic Billing Access and maintains knowledge of the following key AWS entity categories:

• Accounts • Regions • Services (e.g. EC2, S3, EBS) • Usage types (e.g. EC2 - m3.xlarge) • Cost and Usage Categories (On-Demand,

Reserved, etc.)

https://github.com/Netflix/ice

Page 27: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

EverythingMe ncdu-s3

NCDU stands for NCurse Disk Usage which is Linux program that displays Disk usage statistics in a Ncurse menu, which makes things easier where you don’t know exactly where to start – Giving you a good overview and letting you know where is the bottom of disk space issues. No imagine these abilities over S3 buckets!

https://github.com/EverythingMe/

Page 28: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

• Power Scale - Take control of your AWS Auto Scaling.

• Power Cycle - No more wasted AWS EC2 usage.

• Alerts - Put an end to AWS billing surprises • Teams - Sophisticated permissions for

multiple users • Integration with Slack and HipChat

www.gorillastack.com

Page 29: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

https://github.com/GorillaStack/auto-tag

This is an open-source tagging solution for AWS. Deploy auto tag to lambda and set up CloudTrail and have each of your resources tagged with the resource who created it. It was written by GorillaStack.

Lambda Auto-Tag by

Page 30: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

www.cloudhealthtech.com

With the CloudHealth’s platform, customers can control their data through knowledge. CloudHealth can quantify, understand, optimize and automate its cloud resources, giving customers visibility across their entire cloud ecosystem to effectively optimize resources and define governance policies for ongoing management. CloudHealth allows customers to scale their cloud without scaling their IT workforce.

Page 31: FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel Aviv

Doron RogovHead of Operations [email protected]

Thank you!

BTW - We’re hiring! (DevOps | Cloud Engineers | Jugglers)