View
1.392
Download
0
Category
Preview:
Citation preview
Microservices Architecturefor Digital Platforms using Serverless AWS
http://www.meetup.com/AWSnewyork/events/226419743
Eugene Istrati, Technology Partnereugene@mitocgroup.comwww.mitocgroup.com
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Eugene Istrati, Partner @ Mitoc Group
Microservices Architecturefor Digital Platforms with AWS Lambda,
Amazon CloudFront, and Amazon DynamoDB
eugene@mitocgroup.com
October 2015
ARC201
Digital Platforms Challenges
Note: Credits and thanks are listed at the end of the presentation
…
…
…
Average cost of downtime• $500K - $1M / hour (IDC, Dec 2014)• $140K - $540K / hour (Garner, July 2014)• $474K / hour (Ponemon Inst., Dec 2013)
Most commonly reported consequences
• Damage to reputation (38%)• Increase in customer churn (37%)• Damage to credit rating (28%)• Increase to insurance premiums (26%)
Digital Platforms Challenges
Outage
Degradation
No impact
0% 10% 20% 30% 40% 50% 60% 70%
27%
60%
13%
Impact of DoS/DDoS Attack
Note: Credits and thanks are listed at the end of the presentation
Digital Enterprise End-to-end Platform
About
Eugene Istrati
• eugene@mitocgroup.com
• Partner @ Mitoc Group Inc
• 15+ years in IT; 7+ years on AWS
• AWS Certified Solutions Architect (re-certified at re:Invent 2015)
• Companies: Hearst, Amazon, GrubHub, Tenaris (Europe)
Mitoc Group Inc
• www.mitocgroup.com
• Web Development Studio
• AWS Technology Partner
• Focusing on enterprise applications and platforms
• Working with customers from media and entertainment industry
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Demo: todo.deep.mg
• Inspired from open source• www.todomvc.com
• Go to the GitHub repository• github.com/MitocGroup/deep
-microservices-todo-app
• Follow the steps from Getting Started to build and deploy
• todo.deep.com
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
• Flexible choice of technology
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
• Flexible choice of technology• Requires devs with rich skill set
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
• Flexible choice of technology• Requires devs with rich skill set
• Cost-effective
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
• Flexible choice of technology• Requires devs with rich skill set
• Cost-effective• Over-provisioning and over-paying
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
• Flexible choice of technology• Requires devs with rich skill set
• Cost-effective• Over-provisioning and over-paying
AWS re:Invent 2014
Note: Credits and thanks are listed at the end of the presentation
AWS Summit NY 2015
Note: Credits and thanks are listed at the end of the presentation
Web Apps Hosting … Reinvented
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
S3 bucket
CloudFrontdistributio
n
Web Tier
CognitoIdentity DB Tier
SQS DynamoDB
LambdaCloudFrontlogs
API Gateway
www.example.comstatic.example.com
App Tier
AWS Region RDS Aurora
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
What does “serverless” mean?
Not involving a server; composed only of clients.http://www.wordsense.eu/serverless
Serverless doesn’t mean servers are no longer involved. It simply means that developers no longer have to think "that much" about them. Computing resources get used as services without having to manage around physical
capacities or limits.https://www.quora.com/What-is-Serverless-Computing
Serverless vs. Reference
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
S3 bucket
CloudFrontdistributio
n
Web Tier
CognitoIdentity DB Tier
SQS DynamoDB
LambdaCloudFrontlogs
API Gateway
www.example.comstatic.example.com
App Tier
AWS Region RDS Aurora
vs
Serverless Architecture – Web Tier
S3 bucket
CloudFrontdistribution
Web Tier
CognitoIdentity
CloudFrontlogs
www.example.comstatic.example.com
Availability Zone A Availability Zone B
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
Serverless Architecture – Web Tier
S3 bucket
CloudFrontdistribution
Web Tier
CognitoIdentity
CloudFrontlogs
www.example.comstatic.example.com
• Static Assets• Same as in reference architecture• css, js, docs, images, videos + html
• Dynamic Functionality• Use JS framework (e.g. Angular)• SEO-friendly (Custom Error
Response + HTML5 History API)
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
Serverless Architecture – Web Tier
S3 bucket
CloudFrontdistribution
Web Tier
CognitoIdentity
CloudFrontlogs
www.example.comstatic.example.com
• Static Assets• Same as in reference architecture• css, js, docs, images, videos + html
• Dynamic Functionality• Use JS framework (e.g. Angular)• SEO-friendly (Custom Error
Response + HTML5 History API)
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
Serverless Architecture – Web Tier
S3 bucket
CloudFrontdistribution
Web Tier
CognitoIdentity
CloudFrontlogs
www.example.comstatic.example.com
• Static Assets• Same as in reference architecture• css, js, docs, images, videos + html
• Dynamic Functionality• Use JS framework (e.g. Angular)• SEO-friendly (Custom Error
Response + HTML5 History API)
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
Serverless Architecture – App Tier
CognitoIdentity
SQS
Lambda
API Gateway
App Tier
Availability Zone A Availability Zone B
Auto Scaling Group
appservers
appservers
CognitoIdentity
SQS
Lambda
API Gateway
App Tier • Accelerated Backend• Write node.js functions and load
into Lambda• Power up Lambda with RESTful
endpoints on API Gateway• Cache, throttle, meter, version, etc.
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
Serverless Architecture – App Tier
• Accelerated Backend• Write node.js functions and load
into Lambda• Power up Lambda with RESTful
endpoints on API Gateway• Cache, throttle, meter, version, etc.
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
Serverless Architecture – App Tier
CognitoIdentity
SQS
Lambda
API Gateway
App Tier
Availability Zone A Availability Zone B
Serverless Architecture – DB TierDB Tier
SQS DynamoDB
RDS Aurora
DB Tier
SQS DynamoDB
RDS Aurora
Serverless Architecture – DB Tier• First choice – DynamoDB + SQS
• Schema-free• Scale only reads and writes
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
• Next choice – RDS Aurora• Relational• MySQL-like approach, but 5x better
Serverless Architecture – DB Tier• First choice – DynamoDB + SQS
• Schema-free• Scale only reads and writes
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
• Next choice – RDS Aurora• Relational• MySQL-like approach, but 5x better
DB Tier
SQS DynamoDB
RDS Aurora
Serverless Architecture – DB Tier• First choice – DynamoDB + SQS
• Schema-free• Scale only reads and writes
• Completely Serverless• Pre-scaled• Low-cost• Low-maintenance
• Next choice – RDS Aurora• Relational• MySQL-like approach, but 5x better
DB Tier
SQS DynamoDB
RDS Aurora
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Demo: Setup Serverless AWS1. Security - Create IAM roles2. Front-end - Create S3 bucket - Enable static website hosting - Add bucket policy - Create CloudFront distribution3. Back-end - Create Lambda function - Upload code into Lambda - Create API Gateway endpoint4. Database - Create DynamoDB table5. Code - Load code into S3 bucket - View via CloudFront (S3 as backup)
S3 bucket
CloudFrontdistribution
Web Tier
CognitoIdentity DB Tier
SQS DynamoDB
LambdaCloudFrontlogs
API Gateway
www.example.comstatic.example.com
App Tier
AWS RegionRDS Aurora
Lessons Learned
• Serverless approach is challengingly awesome
• Frontend is restricted to JS (and JS Frameworks)• Backend is restricted to Python, Java or JS (for now)• SOA and APIs are required by design
Lessons Learned
• Serverless approach is challengingly awesome
• Frontend is restricted to JS (and JS Frameworks)• Backend is restricted to Python, Java or JS (for now)• SOA and APIs are required by design
• Services must be as small as possible
• AWS Lambda constrains• Browser limitations (on mobile devices)
Lessons Learned
• Serverless approach is challengingly awesome
• Frontend is restricted to JS (and JS Frameworks)• Backend is restricted to Python, Java or JS (for now)• SOA and APIs are required by design
• Services must be as small as possible => microservices
• AWS Lambda constrains• Browser limitations (on mobile devices)
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Google Trends: Microservices
What does “microservices” mean?
In computing, microservices is a software architecture style in which complex applications are composed of small, independent processes communicating with each other using language-agnostic APIs. These services are small, highly
decoupled and focus on doing a small task, facilitating a modular approach to system-
building.https://en.wikipedia.org/wiki/Microservices
Microservices Architecture
Keynote GOTO Conference: Microservices by Martin Fowler - https://www.youtube.com/watch?v=wgdBVIX9ifA
State of the Art in Microservices by Adrian Cockcroft - https://www.youtube.com/watch?v=nMTaS07i3jk
Sam Newman atThoughtWorksLondon 2015:Deploying and OperatingMicroservices - https://www.youtube.com/watch?v=OTSlg7_y3bA
Speeding Up Digital Platforms on AWS
Deploy in weeksLive for years
Deploy in minutesLive for weeks
Deploy in secondsLive for minutes/hours
Deploy in millisecondsLive for seconds
On-Premises Amazon EC2 Amazon ECS AWS Lambda
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Powered by AWS Lambda
AWS Lambda in Action
• AWS Lambda scaled with no effort for us
• 70M+ invocations / day• 10K+ concurrent invocations / second
Web Apps Hosting / Reference Architecture
Availability Zone A Availability Zone B
Auto Scaling Group
Auto Scaling Group
www.example.com
static.example.com
webservers
webservers
appservers
appservers
• Scales in minutes• Huge challenge for breaking
news, viral content, or attacks
• Reduced operational complexity• Requires DevOps with experience
• Flexible choice of technology• Requires devs with rich skill set
• Cost-effective• Over-provisioning and over-paying
AWS Lambda in Action
• AWS Lambda scaled with no effort for us
• 70M+ invocations / day• 10K+ concurrent invocations / second
• AWS Lambda made it really easy for us
• Comes pre-scaled and charges in 100ms blocks• No under- or over-provisioning (by design)• Developers love it (especially frontend JS folks)• DevOps still in play mode (learning to build ops code)
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Tips and Tricks
• AWS Lambda is continuously evolving
• Set up alarms for all 4 Lambda metrics in Amazon CloudWatch• Avoid S3 throttling by integrating S3 => SNS => Lambda• Beware of potential infinite loops
Tips and Tricks
• AWS Lambda is continuously evolving
• Set up alarms for all 4 Lambda metrics in Amazon CloudWatch• Avoid S3 throttling by integrating S3 => SNS => Lambda• Beware of potential infinite loops
• Microservices are game changers
• The shorter TTL, the more secure it becomes• First, build a service or a feature• Next, break it down into microservices
Tips and Tricks – From Monolithic Approach
applicationsdevelopers
Build Test Release
development cycle
Tips and Tricks – To Microservices Approach
applicationsdevelopers
Build Test Release
development cycle
Build Test Release
Build Test Release
Build Test Release
Build Test Release
Build Test Release
Build Test Release
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Demo: todo.deep.mg
• Inspired from open source• www.todomvc.com
• Go to the GitHub repository• github.com/MitocGroup/deep
-microservices-todo-app
• Follow the steps from Getting Started to build and deploy
• todo.deep.mg
DEEP Frameworkhttps://github.com/MitocGroup/deep-framework
“DEEP Framework is a serverless web framework, core component of the Platform-as-a-Service that abstracts web apps and web services from specific cloud providers. This
framework enables developers build cloud-native applications or platforms using microservices architecture in a completely
serverless approach”
Agenda• Web Apps Hosting on AWS
• Reference Architecture• Serverless Architecture• Demo: Setup Serverless AWS
• Microservices Architecture• Powered by AWS Lambda• Tips and Tricks• Demo: todo.deep.mg
• Q&A + Next Steps
Q&A + Next Steps
github.com/MitocGroup medium.com/@MitocGroupbeta@deep.mgwww.deep.mg
Thanks:
http://www.meetup.com/AWSnewyork/events/226419743
Jag Singh from AWS NYC Meetup
Hosting Team from AWS Loft
Credits and Thanks• Slide 3: Digital Platforms Challenges
• http://www.buzzfeed.com/daozers/what-its-like-to-work-on-buzzfeeds-tech-team-during-record-t#.axR6WG9Yr• http://www.dailydot.com/crime/new-york-magazine-ddos-bill-cosby-cover/• http://www.cio.in/topstory/flipkart%E2%80%99s-cto-explains-the-xiaome-launch-outage
• Slide 4: Digital Platforms Challenges• http://www.slideshare.net/Radware/radware-cmg2014-tammyevertsslowtimevsdowntime• http://www.statuscast.com/application-downtime-according-to-idc-gartner-and-others• https://press.kaspersky.com/files/2014/11/B2B-International-2014-Survey-DDoS-Summary-Report.pdf
• Slide 19: AWS re:Invent 2014• https://venturebeat.com/wp-content/uploads/2014/11/aws-reinvent-lambda.png
• Slide 20: AWS Summit NY 2015• https://d0.awsstatic.com/events/aws-hosted-events/2015/AWS-Global-Summit-Series/new-york/press-room/introducing-amazon-api-
gateway.jpg
• Slide 46: Microservices Architecture• https://www.youtube.com/watch?v=nMTaS07i3jk - State of the Art in Microservices by Adrian Cockcroft• https://www.youtube.com/watch?v=wgdBVIX9ifA - Microservices by Martin Fowler• https://www.youtube.com/watch?v=OTSlg7_y3bA - Deploying and Operating Microservices by Sam Newman
Recommended