Web Scale Computing

Mike Culver

Amazon Web Services

Agenda

Web Scale Computing Overview

Code

The Obligatory Timeline Slide

COBOL, Edsel

1959 19691982

1996

Amazon.com

20042006

Darkness Web as a Platform

Web Services, Resources Eliminated

Web Awareness

InternetARPANET

Dot-Com Bubble Web 2.0 Web ScaleComputing

20011997

Being Relevant Counts

It’s All About Ideas

Ideas Cost Money

a + bc

a + bc

But How Much Money?

Our favorite numbers: 0.10, 0.15, and 0.20

x

10

Amazon Web Services Are...

A set of APIs and business models which give developers access to Amazon technology and content

Data As a ServiceAmazon E-Commerce Service

Amazon Historical Pricing

Infrastructure As a ServiceAmazon Simple Queue Service

Amazon Simple Storage Service

Amazon Elastic Compute Cloud

Search As a ServiceAlexa Web Information Service

Alexa Top Sites

Alexa Site Thumbnail

Alexa Web Search Platform

People As a ServiceAmazon Mechanical Turk

Amazon Web Scale Infrastructure:We Do the Muck

Leverage Amazon’s Core Expertise

Scales to the Enterprise

Priced for People

Reliable

Simple to Use

Highly Available

Using Industry Standards

HTTP, XML, REST, SOAP, XSLT

With World-Class Developer Support

What do these companies have in common?

Amazon E-Commerce Service

Amazon E-Commerce Service

Exposes Amazon's product data plus a shopping cart

In 4th major release

Millions of products

Rich data schema

Product images

Reviews

Wishlists

Commissions via Amazon Associates program

Amazon.com With Your Look

Amazon ECS Cost

$0.00

Amazon Simple Storage Service

Amazon S3 is… Simple

Data Storage in Amazon Data Center

Web Service interface

No set-up fee, No monthly minimum

Storage: $0.15 per GB/Month

Data Transfer: $0.20/GB to transfer data

Private and public storage

Each object up to 5GB in size

Many ISV Implementations

S3 Explorer filicio.us Jungle Disk

S3 Firefox Organizer MyOwnDB

Amazon Elastic Compute Cloud

Amazon EC2 Is…

A Web service that provides resizable compute capacity in the cloud.

Designed to make Web-scale computing easier for developers.

A simple Web service interface that provides complete control of your computing resources

Amazon EC2 Benefits You Because It

Reduces the time required to obtain and boot new server instances to minutes

Quickly scales capacity, both up and down, as your computing requirements change

Changes the economics of computing:

Pay only for capacity that you actually use

a + bc becomes just bc

Amazon EC2 Changes Computing Economics

No start-up, monthly, or fixed costs

$0.10 per CPU hour

$0.20 per GB transferred across Net

No cost to transfer data between Amazon S3 and Amazon EC2

Amazon EC2 Profile

1.7 Ghz x86 processor

1.7 GB of RAM

160 GB disk

250 Mb/second network

Web-Scale for Mobile

Services Used•Amazon S3•Amazon EC2

Estimated Savings$650,000

Gumiyo.com

Amazon Mechanical Turk

Amazon Mechanical Turk Is…

A web service that exposes an on-demand global workforce ready to complete small tasks in exchange for micro-payments

Frictionless. Outsourcing per-se is irrelevant.

A web services API

Identify Road Markings

Are These the Same MP3 Players?

30

How It Works

www.mturk.com

Workers

Artificial, Artificially

Intelligent Software

Requester(Developer)

Human Intelligence Tasks (HITs)

Completed HITs

Worker Qualifications

32

Man Versus Machine

33

But Not Really

Podcast transcription service provider

Transcribes audio into high-quality text

Amazon Mechanical Turk: Workers transcribe podcasts and index text within search engine

Amazon Simple Storage: Stores the podcasts and related files

Amazon Simple Queue

Amazon Simple Queue Is

A reliable, highly scalable hosted distributed queue for storing messages as they travel between computers.

Amazon's web-scale messaging infrastructure as a web service

Platform-agnostic, allowing any computer on the Internet to add or read messages without any installed software or special firewall configurations

Amazon SQS Highlights

Reliable

Runs within Amazon's high-availability data centers.

Messages are stored redundantly across multiple servers and data centers.

Simple: Only Six Methods

Scalable

Secure: Strong access controls

Amazon SQS Pricing

Pay only for what you use

No minimum fee

No start-up cost

$0.10 per 1,000 messages sent ($0.0001 per message sent)

$0.20 per GB of data transferred

Alexa Web Services

Four Alexa Web Services:One Vast Web Database

Alexa Web Information Service: Web search engine, traffic information for web sites, a web site directory, and more.

Alexa Top Sites: Programmatic access top sites data is available for the web as a whole, or for individual countries

Four Alexa Web Services:One Vast Web Database

Alexa Site Thumbnail:Programmatic access to thumbnail images for the home pages of web sites.

Alexa Web Search Platform:Directly analyze Alexa's Web archive to create and publish new search services

Amazon Historical Pricing

Amazon Historical Pricing

Highlights

Access to 3 years of actual sales history from books, music, videos, and DVDs sold on Amazon.com

Returns the average, minimum, maximum, and median price for items

Up to ten items per request

Pricing:$249/mo. for up to 60,000 requests/mo.

Learn More About AWS

Explore http://aws.amazon.com

Read Our Blog at http://aws.typepad.com

Amazon’s hiring www.amazon.com/jobs

Code!!!