93
Media Applications on AWS Danilo Poccia AWS Solutions Architect

Media Applications on AWS

Embed Size (px)

DESCRIPTION

Media Applications Lifecycle on AWS - from 2013 AWS Summit in Milan, Italy.

Citation preview

Page 1: Media Applications on AWS

Media Applications on AWS

Danilo Poccia – AWS Solutions Architect

Page 2: Media Applications on AWS

What?

Page 3: Media Applications on AWS

Case Studyfrom 50,000 users

to 17 millionin 9 months

now ~70 million users

Page 4: Media Applications on AWS

Case Study

Longer term, we believe that companies such as ours will

divest themselves of all infrastructure in favor of

third parties.

Page 5: Media Applications on AWS

Case Study

By using Amazon Web Services, Coursera can handle half a

petabyte of traffic each month and scale to deliver courses over

3 million students in one year.

Page 6: Media Applications on AWS

Who?

Agency Enterprise

ContentProvider

Broadcaster

WebAgency

“New Media” Marketing

LiveContent

TraditionalBroadcaster

“Online” Marketing

Online Broadcaster

AdvertisingAgency

On DemandContent

Page 7: Media Applications on AWS

How?

Page 8: Media Applications on AWS

Build

Page 9: Media Applications on AWS

Build

EU West(Ireland)

Choose your Region

US East (Northern Virginia)

US West (Oregon)

US West(Northern California)

São Paulo

Asia Pacific (Tokyo)

Asia Pacific

(Singapore)

Asia Pacific

(Sydney)

Page 10: Media Applications on AWS

2 x Availability Zones (AZ)

Auto Scaling + ELB

RDS Multi-AZ

Page 11: Media Applications on AWS

RDBMS / NoSQL

Page 12: Media Applications on AWS

Case Study

“Amazon DynamoDB … could support over 500,000

writes per second.”

Page 13: Media Applications on AWS

DynamoDB…Now all we had to do was move there – in 5 days.

Page 14: Media Applications on AWS
Page 15: Media Applications on AWS

Java

Python

PHP

.NET

Ruby

Node.js

Page 16: Media Applications on AWS

AWS Toolkit for Visual Studio

AWS Toolkit for Eclipse

Page 17: Media Applications on AWS
Page 18: Media Applications on AWS
Page 19: Media Applications on AWS
Page 20: Media Applications on AWS
Page 21: Media Applications on AWS
Page 22: Media Applications on AWS
Page 23: Media Applications on AWS
Page 24: Media Applications on AWS

Build

Page 25: Media Applications on AWS

Build

Store

Page 26: Media Applications on AWS

your content

Page 27: Media Applications on AWS

99.999999999% durabilitysecurity & access control

1B to 5TB objectsAs many as you like

your content

Page 28: Media Applications on AWS

your content99.999999999% durabilitysecurity & access control

1B to 5TB objectsAs many as you like

Page 29: Media Applications on AWS
Page 30: Media Applications on AWS
Page 31: Media Applications on AWS

Case Study

Spotify needed a storage solution that could scale

very quickly without incurring long lead times for

upgrades…

Amazon S3 gives us confidence in our ability to expand storage quickly while also providing high

data durability.

Page 32: Media Applications on AWS

Build

Store

Page 33: Media Applications on AWS

Build

Store

Load

Page 34: Media Applications on AWS
Page 35: Media Applications on AWS
Page 36: Media Applications on AWS
Page 37: Media Applications on AWS
Page 38: Media Applications on AWS

Build

Store

Load

Page 39: Media Applications on AWS

Build

Store

Load

Transform

Page 40: Media Applications on AWS

OriginalVideo / Audio

File(s)

TranscodedVideo / Audio

File(s)

Input Buckets are where you store the files that you want to

transcode

Output Buckets are where you want the

transcoded files to go

Transcoding Pipelines are queues that manage your

Transcoding Jobs

Transcoding Presets contain audio, video and

other parameters that specify the output format

details

Video files are stored as S3

objects

Transcoding Jobs do the work of transcoding and contain a filename and a Transcoding Preset(s)

Page 41: Media Applications on AWS
Page 42: Media Applications on AWS
Page 43: Media Applications on AWS

Build

TransformStore

Load

Page 44: Media Applications on AWS

Build

Transform

Archive

Store

Load

Page 45: Media Applications on AWS

Secure and DurableStorage

for Data Archivingand Backup

Page 46: Media Applications on AWS

An organization like ours thinks in centuries

when it comes to content retention

We are excited to move our archives to Amazon Glacier

Page 47: Media Applications on AWS

Archive With S3 Lifecycle Management

S3(Online)

Move toGlacier

(Archive)

Expiration(Delete)

1. Store my object on S3

2. After 30 days, move it to Glacier

3. I need it again, restore it for 3 days

4. Then it is back to Glacier

5. (Optional) Delete it after 365 days

Page 48: Media Applications on AWS

Build

Transform

Archive

Store

Load

Page 49: Media Applications on AWS

Build

Transform

Archive

Store

Load

Page 50: Media Applications on AWS

Build

Transform

Archive

Notify

Store

Load

Page 51: Media Applications on AWS
Page 52: Media Applications on AWS
Page 53: Media Applications on AWS

Notify SNS Enpoints

SNS

SQS

Email

Mobile Push Notification

SMS

HTTP(S)

Page 54: Media Applications on AWS

Build

Transform

Archive

Notify

Store

Load

Page 55: Media Applications on AWS

Build

Transform

DeliverArchive

Notify

Store

Load

Page 56: Media Applications on AWS

Deliver

Dallas (2)

St. Louis

Miami

JacksonvilleLos Angeles (2)

Palo Alto

Seattle

Ashburn (3)

NewarkNew York (3)

Dublin

London (2)Amsterdam (2) Stockholm

Frankfurt(2)Paris (2)

Singapore(2)

Hong Kong (2)

Tokyo (2)

São Paulo

South Bend

San Jose OsakaMilan

Sydney

Hayward

Madrid

Seoul

Chennai

Mumbai

Leverage Edge Locations

Page 57: Media Applications on AWS

Deliver From Different Origins

CloudFront

S3

EC2

Custom

Route 53 LBR

Page 58: Media Applications on AWS
Page 59: Media Applications on AWS
Page 60: Media Applications on AWS
Page 61: Media Applications on AWS

Case Study

Page 62: Media Applications on AWS

Case Study

…using Amazon CloudFront is so simple and reliable that the team

doesn’t have to think about it.It all just works, freeing us to focus

on building cool applications.

PBS reaches 120 million people through television

and over 29 million people online each

month.

Page 63: Media Applications on AWS

Deliver Live HTTP Streaming Tutorials

CloudFront

Adobe Media Server

IIS Media Services

Wowza Media Server

Page 64: Media Applications on AWS

Case Study

Since launching Wowza Pro on Amazon EC2 … hundreds of

users have signed up and our revenue for Wowza Pro has increased by more than 400

percent in just 6 months.

Page 65: Media Applications on AWS

Build

Transform

DeliverArchive

Notify

Store

Load

Page 66: Media Applications on AWS

Build

Transform

Deliver

Search

Archive

Notify

Store

Load

Page 67: Media Applications on AWS

+

Page 68: Media Applications on AWS
Page 69: Media Applications on AWS

Relevance & Ranking

Page 70: Media Applications on AWS

Faceting

Page 71: Media Applications on AWS

Range Searching

Page 72: Media Applications on AWS

FieldSearching

Page 73: Media Applications on AWS

(Meta)Data

Indexing

Search Requests

Page 74: Media Applications on AWS
Page 75: Media Applications on AWS
Page 76: Media Applications on AWS
Page 77: Media Applications on AWS
Page 78: Media Applications on AWS
Page 79: Media Applications on AWS
Page 80: Media Applications on AWS

Build

Transform

Deliver

Search

Archive

Notify

Store

Load

Page 81: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Store

Load

Page 82: Media Applications on AWS

Understand Analyze Your Data

ElasticBeanstalk Log

S3

CloudFrontAccess Log

Custom Log

ElasticMapReduce

Redshift

Page 83: Media Applications on AWS

Understand Know Your Users

Who is it about?What happened?When did it take place?Where did it take place?Why did it happen?

The 5 W’s

Page 84: Media Applications on AWS
Page 85: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Store

Load

Page 86: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Improve

Store

Load

Page 87: Media Applications on AWS

Improve Test Your Content

Kaizen*(改善 )

ContentA / B

Testing

Continuous Integration

MeasureFeedback

Continuous Improvement

Continuous Deployment * Japanese for "improvement"

or "change for the best”

Know Your Users

Page 88: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Improve

Store

Load

Page 89: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Improve

Store

Load

Page 90: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Improve

Store

Load

Page 91: Media Applications on AWS

Build

Transform

Deliver

Search

Understand

Archive

Notify

Improve

Store

Load

Page 92: Media Applications on AWS

Build

Store

Load

Transform

Deliver

Search

Understand

Archive

Notify

Improve

Page 93: Media Applications on AWS

http://commons.wikimedia.org/wiki/File:Lego_bricks.jpg