56
APRESENTATIONBY @timangladE FROMYOURFRIENDSAT @cloudant Big Data Small Problems

Big Data | Small Problems

Tags:

Embed Size (px)

DESCRIPTION

Given at OSCON 2011. Version with notes available here: http://dl.dropbox.com/u/348446/big-data-small-problems_with-notes.pdf

Citation preview

Page 1: Big Data | Small Problems

A!PRESENTATION!BY @timangladEFROM!YOUR!FRIENDS!AT @cloudant

BigData

SmallProblems

Page 2: Big Data | Small Problems

NOSQL TApesNOSQL SUmmer.org

.com

Page 3: Big Data | Small Problems

Big EFFING DEALBig Data

Page 4: Big Data | Small Problems

Do we need to goover this again?Look out! HE’s got GRAPHS!

Page 5: Big Data | Small Problems

1

10

100

1,000

10,000

100,000

1,000,000

1981 1985 1990 1994 1998 2003 2007

Consumer Cost per GB

Sources: Ivan Smith+ IDC, 2008

Page 6: Big Data | Small Problems

0

12,500

25,000

37,500

50,000

1986 1994 2002 2010

WorldWIDE STORAGE CAPACITY / CAPITA

Source: The World’s Technological Capacity to Store, Communicate, and Compute Information, Hilbert, et al. Science 1 April 2011: 60-65.

Page 7: Big Data | Small Problems

Just Data SIZE?

if I’m asking, you probably know the answer!

Page 8: Big Data | Small Problems

The Big DataTrifecta

1. Gigabytes 2. IOPS 3. DOLLARS

Page 9: Big Data | Small Problems

Why NOW?

Page 10: Big Data | Small Problems

Just technology?

Page 11: Big Data | Small Problems

What Ails US…

Page 12: Big Data | Small Problems

AILMENT #1Digital Disconnect

Page 13: Big Data | Small Problems

AILMENT #2DimensionalOVERLOAD

Page 14: Big Data | Small Problems

AILMENT #3Infobesity

Page 15: Big Data | Small Problems

Text

Page 16: Big Data | Small Problems

AILMENT #4DeterminismDISORDER

Page 17: Big Data | Small Problems

AILMENT #5YEARNINGFOR MEANING

Page 18: Big Data | Small Problems

AILMENT #6REVOLUTIONDELUSION

Page 19: Big Data | Small Problems
Page 20: Big Data | Small Problems
Page 21: Big Data | Small Problems
Page 22: Big Data | Small Problems

AILMENT #7BUBBLYBUZZWORDBUG

Page 23: Big Data | Small Problems

AILMENT #8BLACK BOX

Page 24: Big Data | Small Problems

AILMENT #9CARGO CULTS

Page 25: Big Data | Small Problems

AILMENT #10SCALE-OIL SALESMEN

Page 26: Big Data | Small Problems

How do IBig DATA?

Page 27: Big Data | Small Problems

RULE #1PAPER / Practice

Page 28: Big Data | Small Problems

RULE #2Only UseNOSQL (or Newsql)if you have to.

Page 29: Big Data | Small Problems

RULE #3Distribution modelDATA MODELDISK STRUCTURE

Page 30: Big Data | Small Problems

RULE #4CATCHY PHRASESARE RED HERRINGS

Page 31: Big Data | Small Problems

RULE #5WHO DO YOU TRUST?

Page 32: Big Data | Small Problems

A Word aboutRELATIONAL SYSTEMS

Page 33: Big Data | Small Problems

A Word aboutSWITCHING

Page 34: Big Data | Small Problems

NOSQL / NewSQL

Page 35: Big Data | Small Problems

Did we reallyNEED A SEQUEL?

Page 36: Big Data | Small Problems

Did we reallyNEED A REMAKE?

Page 37: Big Data | Small Problems

NEWSQL

Page 38: Big Data | Small Problems

VoltdbClustrixGenieDBXEROUNDDrizzleAzureAMAZON RDS

Page 39: Big Data | Small Problems

I CAN HAZPARTITIONTOLERANCE?

Page 40: Big Data | Small Problems

IT-FriendlyCompliance-Friendly

NewSQLis about BEING…

Page 41: Big Data | Small Problems

NOSQL

Page 42: Big Data | Small Problems

Mongodb Couchdb RIAK Cassandra NEO4J(BigCOUCH) Redis? Hadoop?

Page 43: Big Data | Small Problems

3 NOSQL TRENDS

Page 44: Big Data | Small Problems

TREND #180% vs. 20%

Page 45: Big Data | Small Problems

80% Databases

Page 46: Big Data | Small Problems

20% Databases

Page 47: Big Data | Small Problems

ALSO Hadoop REDIS

Page 48: Big Data | Small Problems

TREND #2Storage Separation

Page 49: Big Data | Small Problems

You GOTYOUR CASSANDRAIN MY HADOOP

Page 50: Big Data | Small Problems

You GOTYOUR ACUNUIN MY CASSANDRA

Page 51: Big Data | Small Problems

You GOTYOUR LEVELDBIN MY RIAK

Page 52: Big Data | Small Problems

TREND #3Ease of ACCESS

Page 53: Big Data | Small Problems

Riak SeARCH PIPE SECONDARY IND.CLOUDANT SEARCHCASSANDRA CQL

Page 54: Big Data | Small Problems

Dev-FriendlyOPS-Friendly

NOSQLis about…

Page 55: Big Data | Small Problems

.com

Page 56: Big Data | Small Problems

Thank You

@[email protected]