Upload
idan-tohami
View
111
Download
2
Embed Size (px)
Citation preview
Scale on AWS(Part 1/4)
Doron Rogov Head of Operations [email protected] @DorikRo
Agenda
• Amazon Web Services Overview
• 1st Stage: User = 1
• 2nd Stage: User > 1
• 3rd Stage: User > K
• Then what? (Stage)
CloudZone, Matrix’s cloud unit, is a leading AWS solution provider in the region. With over 7 years of experience with AWS, CloudZone provides its customers with a complete service package that includes consulting, professional services and managed services.
As a Premier Consulting Partner, a Worldwide Channel Reseller and a Managed Service Provider of AWS, we ensure that our customers adopt the most advanced technologies and best practices.
CloudZone Pay As You Grow
Account Managers Solution Architects Tools Professional Services
We Are Here to Help Startups
Broadest and Deepest Functionality
AWS’s Rapid Pace of Innovation
2011
82
159
2012
280
2013
516
2014
AWS has launched a total of 522 new features and/or services during in 2015*, a total of ~1,600 new features and/or services since inception in 2006.
* As of 8 Oct 15
AWS IoTAWS Mobile HubAWS Device Farm
AWS CodeDeploy Amazon EFSAWS CodeCommit Amazon InspectorAWS CodePipeline Amazon WorkMailAmazon EC2 Container Service
Amazon Kinesis Analytics
Amazon Lambda Amazon Kinesis Firehose
Amazon Config AWS Import/Export Snowball
AWS Storage Gateway
Amazon CloudWatch Logs
Amazon QuickSight
Amazon Dynamo DB
Amazon Elastic Transcoder
Amazon RDS for Aurora
Amazon Elasticsearch ServiceAWS Elastic Load
BalancingAmazon SES Amazon
CloudSearchAWS OpsWorks AWS KMS AWS WAF
Amazon CloudWatch
AWS Elastic Beanstalk
Amazon SWF Amazon CloudHSM
Amazon Cognito Amazon API Gateway
Amazon FPS AWS Import/Export AWS CloudFormation
Amazon Glacier
Amazon AppStream
Amazon WorkDocs Amazon EC2 Container
AWS EMR Amazon SNS Amazon ElastiCache
Trusted Advisor Amazon CloudTrail
AWS Service Catalog
AWS Database migration Service
Amazon VPC AWS Identity & Access Management
AWS Direct Connect
Amazon Redshift
Amazon WorkSpaces
AWS Directory Service
Amazon Machine Learning
Amazon RDS Amazon Route 53 GovCloud AWS Data Pipeline
Amazon Kinesis
Amazon Mobile Analytics
Amazon RDS for MariaDB
2009 2010 2011 2012 2013 2014 2015
AWS’s History of Innovation
* As of 8 Oct 15
AWS has been continually expanding its services to support virtually any cloud workload, and it now has more than 60 services that range from compute, storage, networking, database, analytics, application services, deployment, management and mobile.
AWS Regions
12 Regions
32 Availability Zones
AWS Edge Locations
53 Edge Locations
Which Region you should use?
Latency
Proximity to customers
Data governance and legal requirements
Services available within the Region
Costs (vary by Region)
1st Stage: User = 1 AKA: “I just need it to work for me” stage
• Route end users to Internet applications• Answers DNS queries with low latency by using a global network of DNS
servers• Latency based routing to closest AWS endpoint (e.g. EC2 instances, Elastic
IPs or ELBs)• Application Health Checks• Deep integration with other AWS services (ELB,
EC2 NAT/EIP, etc.)• DNS failover
Route 53Scalable DNS
• Resizable compute capacity in more then 30 instance types• Reduces the time required to obtain and boot new server instances to minutes
or seconds• Scale capacity as your computing requirements change• Pay only for capacity that you actually use• Choose Linux or Windows• Deploy across Regions and Availability Zones for reliability• Support for virtual network interfaces that can be attached to EC2 instances in
your VPC
EC2Virtual servers in the cloud
Elastic Compute CloudCompute
• Building blocks of EC2 instances• An AMI is like a template of a computer's root volume.• Can be public or private and shared with other accounts • Create hardened or gold “Images” of your EC2 infrastructure• Copy AMIs between regions
Amazon Machine ImageEC2Virtual servers in the cloud
Compute
• Use for persistent storage from 1GB – 1TB• Can use to create RAID configuration for a server• Off-instance block storage that persists independently• Storage volumes for use with Amazon EC2 instances – create, attach, backup,
restore and delete• Can be attached to a running Amazon EC2 instance and exposed as a block
device for raw or formatted (file system) access• Snapshots are durably saved to S3• Ideal use cases:
• OS Boot device / root file system; secondary volumes/file systems
• Typical basis for database storage
• Raw block devices for RAID, some databases
• Available in magnetic, general purpose SSD, and provisioned IOPS
Elastic Block Storage (EBS)Compute
EC2Virtual servers in the cloud
2nd Stage: Users > 1 AKA: “I hope my users don’t mind some downtime” stage
T2 Instance TypesReplacement for some T1, M1 instances.Designed for occasional bursts of activity (e.g., Web servers, ERP, modeling and simulation jobs).Can handle large variety of general purpose workloads.➢ “CPU credits” given for idle time.➢ Only 2.5% of all T2 instances run out of burst credit.Requires HVM images.
T2 Baseline Performance
Instance Size
Processor Arch.
vCPUs Memory CPU Credits per hour
Baseline Performance
Instance Storage
t2.micro 32 bit or 64 bit
1 1.0 GiB 6 10% of a core EBS only
t2.small 32 bit or 64 bit
1 2.0 GiB 12 20% of a core EBS only
t2.medium 32 bit or 64 bit
2 4.0 GiB 24 40% of a core*
EBS only
* t2.medium baseline performance can be 40% of 1 core, 20% each of 2 cores, or anywhere in between as demanded by the workload
Each T2 size is given a number of “credits” to run at baseline performance.
Understanding T2 CPU Credit Accumulation
CPU Credit: One minutes’ worth of a full CPU coreCredits accrue during idle time, used during heavy usage spikeCredits accrue continuously
Right-Sizing Your Instances
How do I know if I chose the right instance size?
Check CloudWatch statistics for instance – CPU utilization, IOPS, othersFor T2, check how often credit balance approaches zero
3rd Stage: Users > KAKA: “S%&t is getting real!” stage
• Supports the routing and load balancing of HTTP, HTTPS and generic TCP traffic to EC2 instances
• Supports SSL termination and Proxy protocol• Supports health checks to ensure detect and remove failing instances• Dynamically grows and shrinks required resources based on traffic• Seamlessly integrates with Auto-scaling to add and remove instances based
on scaling activities• Single CNAME provides stable entry point for DNS configuration• Supports internal load balancing within a VPC
Elastic Load Balancing Compute
EC2Virtual servers in the cloud
• Client Defined Business Rules• Scale your Amazon EC2 capacity automatically once you define the conditions
(may be 1000’s of servers)• Can scale up just a little…doesn’t need to be massive number of servers (may
be simply 2 servers)• Well suited for applications that experience variability in usage• Set minimum and maximum scaling policies• Alternate Use is for Fault Tolerance
Auto ScalingCompute
EC2Virtual servers in the cloud
Database• Fully-managed, tuned MySQL, PostgreSQL, Oracle 11g, MS SQL ot Aurora• Cost-efficient and resizable capacity• Manages time-consuming database admin tasks• Code, applications, and tools you already use today work seamlessly • Automatically patches the database software and backs up your database• Flexible Licensing: BYOL or License Include• Multi-AZ deployment option for MySQL, PostgreSQL and Oracle• Cross-Region Read Replica support for MySQL
Relational Database Service RDSManaged Relational Database Service
Then what? (Stage)
AWS Startups on: medium.com/aws-activate-startup-blog• Scaling on AWS (Part 2): > 10K Users
• Scaling on AWS (Part 3): >500K Users
• Scaling on AWS (Part 4) : > One Million Users
@AWSstartups
Doron RogovHead of [email protected]@DorikRo
Thank you!BTW - We’re hiring!
(DevOps | Cloud Engineers | Jugglers)