30
Scale on AWS (Part 1/4) Doron Rogov Head of Operations [email protected] @DorikRo

Satrtup Bootcamp - Scale on AWS

Embed Size (px)

Citation preview

Page 1: Satrtup Bootcamp - Scale on AWS

Scale on AWS(Part 1/4)

Doron Rogov Head of Operations [email protected] @DorikRo

Page 2: Satrtup Bootcamp - Scale on AWS

Agenda

• Amazon Web Services Overview

• 1st Stage: User = 1

• 2nd Stage: User > 1

• 3rd Stage: User > K

• Then what? (Stage)

Page 3: Satrtup Bootcamp - Scale on AWS

CloudZone, Matrix’s cloud unit, is a leading AWS solution provider in the region. With over 7 years of experience with AWS, CloudZone provides its customers with a complete service package that includes consulting, professional services and managed services.

As a Premier Consulting Partner, a Worldwide Channel Reseller and a Managed Service Provider of AWS, we ensure that our customers adopt the most advanced technologies and best practices.

Page 4: Satrtup Bootcamp - Scale on AWS

CloudZone Pay As You Grow

Account Managers Solution Architects Tools Professional Services

We Are Here to Help Startups

Page 5: Satrtup Bootcamp - Scale on AWS

Broadest and Deepest Functionality

Page 6: Satrtup Bootcamp - Scale on AWS

AWS’s Rapid Pace of Innovation

2011

82

159

2012

280

2013

516

2014

AWS has launched a total of 522 new features and/or services during in 2015*, a total of ~1,600 new features and/or services since inception in 2006.

* As of 8 Oct 15

Page 7: Satrtup Bootcamp - Scale on AWS

AWS IoTAWS Mobile HubAWS Device Farm

AWS CodeDeploy Amazon EFSAWS CodeCommit Amazon InspectorAWS CodePipeline Amazon WorkMailAmazon EC2 Container Service

Amazon Kinesis Analytics

Amazon Lambda Amazon Kinesis Firehose

Amazon Config AWS Import/Export Snowball

AWS Storage Gateway

Amazon CloudWatch Logs

Amazon QuickSight

Amazon Dynamo DB

Amazon Elastic Transcoder

Amazon RDS for Aurora

Amazon Elasticsearch ServiceAWS Elastic Load

BalancingAmazon SES Amazon

CloudSearchAWS OpsWorks AWS KMS AWS WAF

Amazon CloudWatch

AWS Elastic Beanstalk

Amazon SWF Amazon CloudHSM

Amazon Cognito Amazon API Gateway

Amazon FPS AWS Import/Export AWS CloudFormation

Amazon Glacier

Amazon AppStream

Amazon WorkDocs Amazon EC2 Container

AWS EMR Amazon SNS Amazon ElastiCache

Trusted Advisor Amazon CloudTrail

AWS Service Catalog

AWS Database migration Service

Amazon VPC AWS Identity & Access Management

AWS Direct Connect

Amazon Redshift

Amazon WorkSpaces

AWS Directory Service

Amazon Machine Learning

Amazon RDS Amazon Route 53 GovCloud AWS Data Pipeline

Amazon Kinesis

Amazon Mobile Analytics

Amazon RDS for MariaDB

2009 2010 2011 2012 2013 2014 2015

AWS’s History of Innovation

* As of 8 Oct 15

AWS has been continually expanding its services to support virtually any cloud workload, and it now has more than 60 services that range from compute, storage, networking, database, analytics, application services, deployment, management and mobile.

Page 8: Satrtup Bootcamp - Scale on AWS

AWS Regions

12 Regions

32 Availability Zones

Page 9: Satrtup Bootcamp - Scale on AWS

AWS Edge Locations

53 Edge Locations

Page 10: Satrtup Bootcamp - Scale on AWS

Which Region you should use?

Latency

Proximity to customers

Data governance and legal requirements

Services available within the Region

Costs (vary by Region)

Page 11: Satrtup Bootcamp - Scale on AWS

1st Stage: User = 1 AKA: “I just need it to work for me” stage

Page 12: Satrtup Bootcamp - Scale on AWS

• Route end users to Internet applications• Answers DNS queries with low latency by using a global network of DNS

servers• Latency based routing to closest AWS endpoint (e.g. EC2 instances, Elastic

IPs or ELBs)• Application Health Checks• Deep integration with other AWS services (ELB,

EC2 NAT/EIP, etc.)• DNS failover

Route 53Scalable DNS

Page 13: Satrtup Bootcamp - Scale on AWS

• Resizable compute capacity in more then 30 instance types• Reduces the time required to obtain and boot new server instances to minutes

or seconds• Scale capacity as your computing requirements change• Pay only for capacity that you actually use• Choose Linux or Windows• Deploy across Regions and Availability Zones for reliability• Support for virtual network interfaces that can be attached to EC2 instances in

your VPC

EC2Virtual servers in the cloud

Elastic Compute CloudCompute

Page 14: Satrtup Bootcamp - Scale on AWS

• Building blocks of EC2 instances• An AMI is like a template of a computer's root volume.• Can be public or private and shared with other accounts • Create hardened or gold “Images” of your EC2 infrastructure• Copy AMIs between regions

Amazon Machine ImageEC2Virtual servers in the cloud

Compute

Page 15: Satrtup Bootcamp - Scale on AWS

• Use for persistent storage from 1GB – 1TB• Can use to create RAID configuration for a server• Off-instance block storage that persists independently• Storage volumes for use with Amazon EC2 instances – create, attach, backup,

restore and delete• Can be attached to a running Amazon EC2 instance and exposed as a block

device for raw or formatted (file system) access• Snapshots are durably saved to S3• Ideal use cases:

• OS Boot device / root file system; secondary volumes/file systems

• Typical basis for database storage

• Raw block devices for RAID, some databases

• Available in magnetic, general purpose SSD, and provisioned IOPS

Elastic Block Storage (EBS)Compute

EC2Virtual servers in the cloud

Page 16: Satrtup Bootcamp - Scale on AWS

2nd Stage: Users > 1 AKA: “I hope my users don’t mind some downtime” stage

Page 17: Satrtup Bootcamp - Scale on AWS

T2 Instance TypesReplacement for some T1, M1 instances.Designed for occasional bursts of activity (e.g., Web servers, ERP, modeling and simulation jobs).Can handle large variety of general purpose workloads.➢ “CPU credits” given for idle time.➢ Only 2.5% of all T2 instances run out of burst credit.Requires HVM images.

Page 18: Satrtup Bootcamp - Scale on AWS

T2 Baseline Performance

Instance Size

Processor Arch.

vCPUs Memory CPU Credits per hour

Baseline Performance

Instance Storage

t2.micro 32 bit or 64 bit

1 1.0 GiB 6 10% of a core EBS only

t2.small 32 bit or 64 bit

1 2.0 GiB 12 20% of a core EBS only

t2.medium 32 bit or 64 bit

2 4.0 GiB 24 40% of a core*

EBS only

* t2.medium baseline performance can be 40% of 1 core, 20% each of 2 cores, or anywhere in between as demanded by the workload

Each T2 size is given a number of “credits” to run at baseline performance.

Page 19: Satrtup Bootcamp - Scale on AWS

Understanding T2 CPU Credit Accumulation

CPU Credit: One minutes’ worth of a full CPU coreCredits accrue during idle time, used during heavy usage spikeCredits accrue continuously

Page 20: Satrtup Bootcamp - Scale on AWS

Right-Sizing Your Instances

How do I know if I chose the right instance size?

Check CloudWatch statistics for instance – CPU utilization, IOPS, othersFor T2, check how often credit balance approaches zero

Page 21: Satrtup Bootcamp - Scale on AWS

3rd Stage: Users > KAKA: “S%&t is getting real!” stage

Page 22: Satrtup Bootcamp - Scale on AWS

• Supports the routing and load balancing of HTTP, HTTPS and generic TCP traffic to EC2 instances

• Supports SSL termination and Proxy protocol• Supports health checks to ensure detect and remove failing instances• Dynamically grows and shrinks required resources based on traffic• Seamlessly integrates with Auto-scaling to add and remove instances based

on scaling activities• Single CNAME provides stable entry point for DNS configuration• Supports internal load balancing within a VPC

Elastic Load Balancing Compute

EC2Virtual servers in the cloud

Page 23: Satrtup Bootcamp - Scale on AWS

• Client Defined Business Rules• Scale your Amazon EC2 capacity automatically once you define the conditions

(may be 1000’s of servers)• Can scale up just a little…doesn’t need to be massive number of servers (may

be simply 2 servers)• Well suited for applications that experience variability in usage• Set minimum and maximum scaling policies• Alternate Use is for Fault Tolerance

Auto ScalingCompute

EC2Virtual servers in the cloud

Page 24: Satrtup Bootcamp - Scale on AWS

Database• Fully-managed, tuned MySQL, PostgreSQL, Oracle 11g, MS SQL ot Aurora• Cost-efficient and resizable capacity• Manages time-consuming database admin tasks• Code, applications, and tools you already use today work seamlessly • Automatically patches the database software and backs up your database• Flexible Licensing: BYOL or License Include• Multi-AZ deployment option for MySQL, PostgreSQL and Oracle• Cross-Region Read Replica support for MySQL

Relational Database Service RDSManaged Relational Database Service

Page 25: Satrtup Bootcamp - Scale on AWS

Then what? (Stage)

Page 26: Satrtup Bootcamp - Scale on AWS
Page 27: Satrtup Bootcamp - Scale on AWS
Page 28: Satrtup Bootcamp - Scale on AWS
Page 29: Satrtup Bootcamp - Scale on AWS

AWS Startups on: medium.com/aws-activate-startup-blog• Scaling on AWS (Part 2): > 10K Users

• Scaling on AWS (Part 3): >500K Users

• Scaling on AWS (Part 4) : > One Million Users

@AWSstartups

Page 30: Satrtup Bootcamp - Scale on AWS

Doron RogovHead of [email protected]@DorikRo

Thank you!BTW - We’re hiring!

(DevOps | Cloud Engineers | Jugglers)