39
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SAC 305 How AWS Automates Internal Compliance at Massive Scale using AWS Services Chad Woolf, Director, Risk & Compliance Sara Duffer, Director, Security Assurance Automation 11/30/2016

AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Embed Size (px)

Citation preview

Page 1: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

SAC 305

How AWS Automates Internal Compliance

at Massive Scale using AWS Services

Chad Woolf, Director, Risk & Compliance

Sara Duffer, Director, Security Assurance Automation

11/30/2016

Page 2: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

What to Expect from the Session

Four examples of how we deal with massive scale in compliance

1. Automated Control Mapping

2. Access Management

3. Change management

4. Vulnerability management

For each example:

• AWS Services that we utilize for operationalizing compliance

• Lessons learned

Amazon CloudWatch AWS CloudTrail AWS Lambda Amazon API Gateway Amazon Redshift

Page 3: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Scale, Complexity,

Security

Page 4: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

AWS: Huge Scale

Page 5: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

AWS Security: A Very High Bar

Page 6: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

AWS: Complex System?

Page 7: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Gall’s Law:

A complex system that works is invariably

found to have evolved from a simple

system that worked.

A complex system designed from scratch

never works and cannot be patched to

make it work. You have to start over with a

working simple system.

Page 8: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Advice:

1. Start over, and start simple.

2. Implement Agile methodology. And do it forever.

Page 9: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

+ Complex Systems

+ Highest Security Bar

= Impossible Task

(in a manual world)

Huge scale

Page 10: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Customized, Customer-centric Approach

40+

services

7,710 Audit

Artifacts

2,670

Controls

3,030 Audit

Requirements

Page 11: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Advice:

3. Objectively look at your requirements,

and build to that.

Page 12: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Advice:

4. Hire Compliance Automation Engineers

Investments in Automation

Pay for Themselves

Page 13: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Using AWS to Automate Compliance

We'll walk you through 4 examples today

1. Automated Control Mapping

2. Access Management

3. Change management

4. Vulnerability management

+ Lessons learned

Page 14: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 1: Automated Control

Mapping

Page 15: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 1: Automated Control Mapping

• Problem: Control mapping – everyone does it and it takes a

really long time

• Our response: We developed intelligent correlation mapping

automation

• How we use it: For use with questionnaires, control mappings,

general search

• Benefit: Authoritative source of control mapping and

implementation.

Page 16: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Amazon API

Gateway

Amazon

Elasticsearch

Service

AWS Lambda

Example 1: Under the hood

Internal

Website

Questions,

responses,

& control

statements

6 2 3 4

1

Page 17: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 1: Under the hood

Page 18: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 1: Under the hood

Page 19: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 1: Lessons Learned

• Mapping is a heavy lift

• Granularity and specificity matter

• Higher return than expected

Page 20: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 2: Access Management

Page 21: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 2: Access Monitoring of Critical Systems

• Problem: monitoring access to a large number of hosts

• Our response: remediation controls that evaluates who AND

what

• How we use it: monitor, validate, remediate access controls

at AWS scale quickly

• Benefit: ensure principle of least privilege access

Page 22: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Near real time validation

Baseline rule review

Example 2: Access Management layered controls

Critical Assets

Rules based permission

management

Step 1: Principle of Least Privilege

Page 23: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 2: Step 1 Under the hood

HR

Permission

store

On-prem

hostsAmazon

Redshift

S3

AWS

Data

Pipeline

Job

Management

service

EC2 Worker

fleet

AWS

Lamdba

Group owners

Notifications

Amazon

Kinesis

Firehose

On-prem

hostsAmazon

SQS

“On prem like” environmentA

1

2

3

4

5

ETL SolutionB

6

78

9

Continuous Monitoring & Notification SolutionC

10

11 12 13

Page 24: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 2: Step 2 Under the hood

Amazon S3 Log

Repository Apache Spark

cluster

(Amazon EMR)

ETL using

Lambda

S3 bucket to

store extracted

SSH logins

Amazon Redshift

Step 2: Principle of Least Privilege

1 2 3 4 5

Page 25: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 2: Lessons Learned

• Revoke access of users who

haven’t used their access to critical

AWS resources/systems

• AWS CloudTrail + Credential

Usage Report + Service Access

Report

• Logins to your EC2 fleet vs. SSH

keys access list

Page 26: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 3: Change Management

Page 27: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 3: Change Management

• Problem: controlled automated deployment and validation of

daily deployments

• Our response: automated auditable deployment and validation

environment

• How we use it: auditor validation of our preventative and

detective change management controls

• Benefit: all changes to environment and controlled and

documented

Page 28: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 3: Under the hood

1 2 3 4 5

Page 29: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 3: Under the hood

QA & Code Review

1 2 3 4 5 6

Page 30: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 3: Under the hood

Flagged Deployment

ID: 47365690

Deployer: johndoe@

Deployment Time: 09:56:23 11/15/2016

Flag reason: Approval was not documented in the change ticket

Page 31: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 3: Lessons Learned

• AWS CodeCommit – authoritative source code

repository

• AWS CodeDeploy – controlled deployments to

instances

• AWS CodePipeline – continuous delivery of software

releases

AWS CodePipelineAWS CodeCommit AWS CodeDeploy

Page 32: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 4: Vulnerability

Management

Page 33: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 4: Vulnerability Management

• Problem: analyzing large data set of fleet information and

identifying ‘actionable’ patching data for our large fleet of

hosts

• Our response: utilize active and passive assessments to

accurately capture and identify opportunities for updates

• How we use it: utilizing 3rd-party scanners and on host

agents to reduce false positives and increase accurate

‘actionable actions’ for remediation

• Benefit: Our hosts are patched, preventing security issues

Page 34: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 4: Under the hood

Amazon

RDSAmazon

Elasticsearch

Service

Distributed

sensorsAmazon

EC2Dashboard

Page 35: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Example 4: Lessons Learned

• Active Scans are costly in time and resources

• False positives are hard to deal with

• Datatype definitions matter

Amazon

Inspector

Amazon

RDS

Amazon

Redshift AWS

Lambda

Amazon

Elasticsearch Service

Amazon

QuickSight

ASSESS STORE PROCESS VISUALIZE

Page 36: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Recap

• Our lesson learned: we had to automate to survive. We did this

using AWS services – to address Cloud + on-prem compliance

monitoring.

• You have the same opportunity for these examples and others.

• AWS can be used to automate Cloud and on-prem environments.

Page 37: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Thank you!

Page 38: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Related Sessions

• ARC312 - Compliance Architecture: How Capital One Automates the Guard Rails for 6,000 Developers

- Thursday, 11am, Venetian, Level 2, Venetian H

• SAC311 - Evolving an Enterprise-Level Compliance Framework with Amazon CloudWatch Events and AWS Lambda

- Friday, 9am, Venetian, Level 4, Lando 4205

• SAC315 - Scaling Security Operations and Automating Governance: Which AWS Services Should I Use?

- Friday, 11am, Venetian, Level 3, Lido 3005

• SAC316 - Security Automation: Spend Less Time Securing Your Applications

- Thursday, 4pm, Venetian, Level 2, Venetian A

Page 39: AWS re:Invent 2016: How AWS Automates Internal Compliance at Massive Scale using AWS Services (SAC305)

Remember to complete

your evaluations!