51
AWS re:Invent 2016 re:Cap

AWS re:Invent 2016 Day 2 Keynote re:Cap

Embed Size (px)

Citation preview

AWS re:Invent 2016 re:Cap

What Are The Best Practices Of Transformational Development?

Security Performance efficiency

Cost optimization

Reliability

Well-Architected Framework

Operational excellence

NEW

Introducing

The Well-Architected Framework CourseWith Broader And Deeper Content

A Year In Amazon CloudFormation

20 additional services 20 services updated YAML support Role-based stack creation

Change sets Cross-stack references Failure recovery Resource schemas

Prepare

AWS OpsWorks For Chef AutomateFully managed Chef server

NEW

Prepare

Generally Available Today

Amazon EC2 Systems ManagerCollection of AWS tools for package installation, patching,

resource configuration, and task automation

Prepare

NEW

Generally Available Today

AWS CodeBuild

NEW

Operate

Generally Available Today

Build service for compiling source code

and running unit tests

!"#

AWS X-Ray

NEW

Operate

Analyze and debug distributed applications

in production

Preview Available Today

fanout-00002

AWS X-RayNEW

hello-1.mbfzqxzcpe.us-east-..

hello-2.mbfzqxzcpe.us-east-..

fanout-00005fanout-00003

throttle DynamoDB

index DynamoDB

fanout-00004

400 traces/min avg - 0.30 ms

600 traces / min avg - 0.19 ms

1000 traces /min avg - 0.13 ms

400 traces / min avg - 0.30 ms

1000 traces / min avg - 0.28 ms

400 traces / min avg - 0.30 ms

850 traces / min avg - 0.16 ms

850 traces / min avg - 0.17 ms

Client

Client

800 traces / min avg - 0.19 ms

fanout-00001

560 traces / min avg - 0.19 ms

fanout-00006

AWS X-RayNEW

AWS X-RayNEW

AWS Personal Health Dashboard

NEW

Respond

Personalized view of AWS service health

Generally Available Today

Web applications running on AWS are already protected

by Shield Standard - no action is required

Protection from volumetric and state exhaustion attacks

NEW

Respond

Generally Available Today

AWS Shield For Everyone

For additional protection against very

large and sophisticated attacks

AWS Shield Advanced

Respond

NEW

Generally Available Today

Respond

Advanced notifications via CloudWatch

Cost protection on ELB, CloudFront, Route 53

24/7 DDoS response team and support

WAF included at no additional cost

AWS Shield Advanced

NEW

Targeting

Targeted push notifications for mobile apps

Amazon Pinpoint

Generally Available Today

Understand user behavior

Define who to engage

Deliver notifications

Track campaign results

Amazon Pinpoint

S3 Storage Management

S3 Data Events in CloudTrail S3 Object Tagging S3 Analytics - Storage Class Analysis S3 CloudWatch Metrics S3 Inventory

Innovations In S3NEW

Integrated with:

Fully-managed data catalog and ETL service

S3, RDS, Redshift & any JDBC-compliant data store

AWS GlueNEW

Build Your Data Catalog

Generate And Edit Transformations

Schedule And Run Your Jobs

2. Source Data

S3 Upload

Kinesis Firehose

DynamoDB Streams

Snowball Snowball Edge

Snowmobile

3. Lifecycle management and cold storage

5. Data governance, security, privacy

8. Preparing for Analytics

9. Orchestration and job scheduling

Analytics

Database Migration Service

1. Ingestion

Datastore target

4. Metadata capture

10. Capturing data change

Athena

EMR

Elasticsearch

Redshift

AI

Machine Learning

Quicksight

RDS

DynamoDB

EFS

S3 EBS

6. Self-service discovery, search, access

Glacier

7. Managing data quality

EMR

Glue

The Modern Data Architecture On AWS

Install batch software

Manage job interdependencies

Manage job queues

Schedule jobs

Provision server cluster

Scale server cluster

Challenges Of Large-Scale Batch Processing

AWS BatchFully-managed batch processing at any scale

NEW

Preview Available Today

Dynamic provisioning and scaling

Priority-based queues and scheduling

Cost optimization through EC2 Spot fleet

Fully managed

AWS Batch

Containers

A Spectrum Of Compute

High availability

Infrastructure management

Security Task scheduling

Pipeline integration

Container management

Service discovery

Resource access

The Challenges Of Container Based Operations

Amazon ECS

Managed platform for:

Cluster Management Container Orchestration Deep AWS Integration

ELBContainer Auto Scaling

CloudTrailVPCIAM CloudWatch Metrics

Instance Auto Scaling

CloudWatch Logs

CloudWatch Events

X-Ray

Deep Integration With AWS Platform

You can now determine scheduling policies based on:

AMI ID Availability zone

Instance type

Distinct instances

Custom

Task Placement Engine (Coming Soon)

Real-time notifications of current state

Container instance events

Task events

Event Stream

They need the ability to:

Create custom schedulers Integrate 3rd party schedulers Develop and test locally

Developers Want More Control

Introducing NEW

A collection of open source projects for:Container management and orchestration

Today we are releasing:

cluster-state-service daemon-scheduler

BloxNEW

Open Source

blox.github.io

Serverless

AWS Lambda

A Spectrum Of Compute

Languages Integrations

Node.js (JavaScript) Java (Java 8 compatible) Python

Amazon API Gateway AWS CodeCommit AWS CloudFormation

AWS Config

Amazon Simple Notification Service

Amazon Simple Email Service

State Of AWS Lambda

Amazon CloudWatch

Amazon Kinesis Streams

Amazon DynamoDB

Amazon RDS

Amazon Aurora

Amazon CognitoAmazon S3

VPC Support

Node 4.3

Simple Proxy

API Gateway Binary Support

Environment Variables

Serverless Application Model

NEW

New Serverless Features In 2016

NEW

C# In AWS Lambda

AWS Lambda@Edge

NEW

Preview Available Today

Run AWS Lambda functions at CloudFront locations

“I want to sequence functions”

“I want to run functions in parallel”

“I want to select functions based on data”

“I want to retry functions”

“I want to try/catch/finally”

“I have code that runs for hours”

Turning Functions Into Applications

Method Call Function Chaining Database QueuesDifferent Ways To Coordinate Functions

NEW

AWS Step Functions

Generally Available Today

Coordinate the components of distributed

applications using visual workflows

AWS Step Functions

Branching Steps

Select image converter

RAW to JPEG RAW to PNGRAW to TIFF

Load in Database

Start

End

Unsupported image type

Upload RAW file

Delete RAW file

Start

End

Process photo

Resize image

Start

End

Extract metadata

Facial recognition

Load in Database

Parallel StepsSequential Steps

AWS Step Functions

Virtual Machines Containers Serverless

First-Class Primitives With Deep AWS Integration

Transformations

AWS OpsWorks For Chef Automate

Amazon EC2 Systems Manager

AWS CodeBuild

AWS X-Ray

AWS Personal Health Dashboard

AWS Shield

</></>

Amazon Pinpoint

AWS Glue

AWS Batch

C# In AWS Lambda

AWS Lambda@Edge

AWS Step Functions

Elastic GPUs For EC2

Amazon Lightsail

F1 Instances

Amazon Athena

Amazon AI

Amazon Rekognition

Amazon Polly

Amazon Lex

PostgreSQL For Aurora

AWS Greengrass

AWS Snowball Edge

AWS Snowmobile

Day 1 Day 2

Thank You