Embed Size (px)
Citation preview
The Pace of Innovation at AWS
Ian MassinghamTechnology Evangelist, AWS
@IanMmmm
What sets AWS apart from other providers?
Breadth and Depth of Services
Infrastructure
Foundation Services
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Infrastructure
Foundation Services
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services
Databases
Relational
NoSQL
Columnar
Caching
Infrastructure
Foundation Services
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
Infrastructure
Foundation Services
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Infrastructure
Foundation Services
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Deployment & Management
Containers
Dev/ops
Templates
Infrastructure
Foundation Services
Regions Availability Zones Edge POPs
Compute Storage Networking & Content Delivery
Security & Access
Platform Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Deployment & Management
Containers
Dev/ops
Templates
Mobile & Devices
Identity
Sync
Analytics
Notifications
Amazon WorkSpaces
Delivering on the promise of desktop virtualization
Most successful preview, ever
Infrastructure & admin tools
End user desktop and mobile apps
Fully managed, secure document storage and sharing service for the Enterprise
Amazon WorkDocs
Secure
Easy sharing Simple documentfeedback
Access from any device
Integrate yourcorporate directory Low cost
Is secure email and calendaring made easyAmazon WorkMail
Managed email and calendaring solution
Always available, anytime, anywhere.
Integrates with Amazon WorkDocs
Infrastructure
Foundation Services
Regions Availability Zones CDN Points of Presence
Storage(Object, Block and Archive)
NetworkingSecurity & Access Control
Platform Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real-time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Deployment & Management
Containers
Dev/ops Tools
Resource Templates
Mobile & Devices
Identity
Sync
Mobile Analytics
Notifications
Applications Virtual Desktops Collaboration and Sharing
Data Workflows
Usage Tracking
Monitoring and Logs
Compute(VMs, Auto-scaling and Load Balancing)
What sets AWS apart from other providers?
Breadth and Depth of Services
What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
The AWS Price Reduction Philosophy47 Price Reductions Since 2006
Infrastructure innovation
EcosystemGlobal Footprint
New FeaturesNew Services
AWS Trusted AdvisorFour reports available to all
What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Small, autonomous teamsRoadmap ownership
Decoupled launch schedules
Small, “Two Pizza” Teams
Get Core Functionality in the Hands of Customers, QuicklyOperational stabilityHigh scale
Limited initial feature set
Iterate Based on Customer Feedback
AmazonRedshift
AmazonGlacier
AmazonWorkspaces
EPICCOLLABORATION
+
=
Rapid pace of Innovation
2008 2009 2010 2011 2012 2013 2014
280
159
826148
24
516
What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Innovation at every level of the stack
Every day, AWS adds enough new server capacity to support all of Amazon’s global infrastructure when it was
a $7B annual revenue enterprise
Get Networks Out of the WayRelative cost of networking increasing quickly
• Server & storage prices falling fast• Network costs trending to dominate
Networking frozen in time• Vertically integrated ecosystem• Indefensible profit margins
AWS solution:• Custom net H/W & protocol stack• Private long haul links
57%
8%
18%
13%
4%Servers
Networking Equipment
Power Distribution & Cooling
Power
Other Infrastructure
Monthly Costs
3yr server & 10 yr infrastructure amortization
AWS Global Regions Locations
US-WEST (Oregon)
GOV CLOUD
US-WEST (N. California)US-EAST (Virginia)
EU (Dublin)
EU (Frankfurt)
SOUTH AMERICA (Sao Paulo)
CHINA (Beijing)
ASIA PAC (Sydney)
ASIA PAC (Singapore)
ASIA PAC (Tokyo)
Regions
PoP
Redundant paths to transit centersTransit centers connect to:• Private links to other AWS regions• Private links to AWS Direct Connect customers• Internet through peering & paid transit
Redundant paths to transit centersTransit centers connect to:• Private links to other AWS regions• Private links to AWS Direct Connect customers• Internet through peering & paid transit
82, 864 fiber strands in regionAZs <2ms apart & usually <1ms25Tbps peak inter-AZs traffic
Why Does AWS Offer AZs?Asynchronous replication between distant data centers• Committing to an SSD order 1 to 2ms• But, LA to New York is 74ms round trip• You can’t wait 74ms to commit a transactionOn failure, difficult & high skill decision:• Fail-over & lose transactions, or• Or don’t fail-over & lose availability• Difficult choice• Use AZs for no-admin failover• Sync works when <2ms• Can be combined with regional replication for
very high availability
74ms
1 of 28 availability zones world-wide
All regions have 2 or more AZs
Each AZ is 1 or more DC- No data center is in two AZs
- Some AZs have as many as 6 DCs
DCs in AZ less than ¼ ms apart
Data centers & Availability zones
Single DC typically over 50,000 servers & often over 80,000
• Larger DCs undesirable (blast radius)
• Diminishing returns on scale
Up to 102Tbps provisioned in to a single DC
AWS custom network equipment:• Multi-ODM sourced• Amazon custom network protocol
stack
Remove the “virtualization tax”
NIC supports Supports Single Root I/O VirtualizationMuch lower latency & less latency jitter
Logarithmic Scale
tp0 tp50 tp99 tp99.9 tp00
>2x average latency
reduction
>10x latency variability
improvement
Previous generation
Current generation
OEM servers• Very general designs able to run wide variety of workloads• Vast, expensive, world-wide distribution network (30% of cost)
AWS custom servers & storage• Specialized servers optimized for a specific workload• Move hot software kernels to hardware implementations• Custom Intel processors beyond commercially available clock rates• DCs, servers, networking, storage designed to integrated specs
Example Storage Rack864 disks, 2,350lb
Power InfrastructureSome DCs with custom power sub-stations
• Lower power cost & build more quickly
• Negotiated power purchasing agreements
Custom switchgear firmware3 100% carbon neutral regions:
• US West (Oregon)• AWS GovCloud (US)• EU (Frankfurt)
