To SQL or No(t)SQL - PHPNW12

PHPNW 2012 Jeroen van Dijk

To SQL

OR

No T SQL?( )

Sunday, October 7, 12

JEROEN VAN DIJK

∂Nerd chief @ ENRISE

∂PHPBenelux board member∂Zend Certified Engineer∂Web technology freak∂Open source addict

[email protected] @NEOREY


∂ You engineers are our top chefs!

THE ENRISE RESTAURANT

∂ We want to prepare the best dishes∂ With the best ingredients∂ To create a magical client experience!



WHAT IS

ACID?Sunday, October 7, 12


EVER HEARD OF

THEOREM?CAP


KNOW

ABC?∂ Courtesy of Tim Anglade


Always

∂ Courtesy of Tim Anglade


AlwaysBe



AlwaysBeCaching



AlwaysBeCaching



JOIN THE HYPE?

WANT!==HAVE


HAVE TO USE NOSQL?

SCALABILITY&

PERFORMANCE


HAVE TO USE NOSQL?

SCALABILITY&

PERFORMANCE


RECAP RDBMS GREATNESS

∂ Standard Query Language∂ ACID: Atomicity, Consistency, Isolation, Durability∂ Supported by everyone and everything∂ Tuning options∂ Battle tested!∂ Open source?!

NOT ENOUGH?


MAKING LOADS OF MONEY?


BUY A BIGGER BOX

18


∂ Vertical scalability

NOT SO GREAT RDBMS FEATURES




∂ Horizontal scalability



∂ Horizontal scalability

∂ Schema changes!



SINCE 2004

DATA++++++


WHO NEEDS

ACID!?Sunday, October 7, 12

CAP THEOREM

PC

A

CONSISTENCY PARTITION TOLERANCE

AVAILABILITY


CAP THEOREM

P

CA AP

CP

C

AAVAILABILITY

PICKTWO

CONSISTENCY PARTITION TOLERANCE


CAP THEOREM

P

CA AP

CP

C

A

PARTITION TOLERANCE

PICKTWO

CONSISTENCY

MySQL (InnoDB, not MyISAM)

PostgreSQL SQL Server

Dynamo Voldemort

Cassandra

SimpleDB

CouchDB

Riak

BigTable

Hypertable Hbase

MongoDB Terrastore

Couchbase Memcache Redis

AVAILABILITY

Oracle RAC Neo4J


RELATIONAL DATABASES

ID FIRST LAST1 Jeroen van Dijk

2 Paul Borgermans

3 Thijs Feryn

4 Mike van Dam

5 Jeremy Coates

6 Jenny Wong

USERS

ID NAME1 PHPNorthWest

2 PHPBenelux

COMMUNITIES

ID COM_ID USER_ID PRIMARYT

NICK1 2 1 1 neorey

2 2 2 1 paulb

3 2 3 1 thijs

4 1 4 0 dragonbe

5 2 4 1 dragonbe

6 1 5 1 coates

7 1 6 1 miss_jwo

MEMBERS


NOSQL TYPES4


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

4 NOSQL MODELS


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

4 NOSQL TYPES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

4 NOSQL TYPES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

4 NOSQL TYPES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

∂ 122 known NoSQL databases

4 NOSQL TYPES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

∂ Focus from Redis, Riak, Neo4J, MongoDB

4 NOSQL TYPES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

KEY - VALUE

∂ Schema-less design∂ Just strings of data∂ Hard to query∂ Mostly in memory


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

KEY - VALUE

USER_1

“Jeroen van Dijk”

USER_2

{ id: 3, first: “Thijs”, last: “Feryn”}


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

REDIS

∂ Blazing fast key-value implementation∂ Master - slave replication∂ Lots of methods to query data∂ Notable options∂ Data types : Strings, hashes, lists, sets∂ Data expiration∂ Pub/Sub for messaging

∂ Reconsider when using Memcached


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

∂ BigTable or Dynamo style∂ Consistent hashing∂ Vector clocks∂ Hinted hand off


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

DATABASE

USERS (COLUMN)

USER_5

USER_6

FIRST LAST GROUP

Jeremy Coates PHPNW

NAME NICK

Jenny Wong @miss_jwo


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

∂ Data stored in a ring


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

A

B

C

D

∂ Consistent hashing with 4 nodes


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

∂ Partitioning as done by Riak


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

∂ First node joins the cluster, claims all partitions


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

A

B

C

∂ Reading / writing is done to 3 nodes

N = 3


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

A

B

C

N = 3W = 2

R = 2

∂ Reading / writing succeeds with 2 valid responses


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

A

B

C

D

N = 3W = 2

R = 2[ Ov1 ]

[ Ov1,v2 ]

∂ Node C down, while new write action

[ Ov1,v2 ]


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

COLUMN

A

B

C

D

[ Ov1,v2 ]

N = 3

∂ Node D hands the new version off

N = 3W = 2

R = 2

[ Ov1,v2 ]

[ Ov1,v2 ]


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

RIAK

∂ Dynamo implementation∂ MapReduce query style∂ Multiple storage backends∂ Notable options

§ Link walking (like Graph solutions)§ Solr-like search interface§ Secondary indexes


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

∂ Relations more important than entities∂ From RDBMS perspective: SELF JOINS

GRAPH


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

∂ Facebook style

GRAPH


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

∂ Betweenness centrality


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

∂ Degree centrality


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

∂ Closeness centrality


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

∂ Twitter style


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

∂ TomTom style

2

1

1

33

92

31

2

2


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

2

1

1

33

92

31

2

2

∂ TomTom style


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

GRAPH

2

1

1

33

92

31

2

2

∂ TomTom style


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

NEO4J

∂ ACID compliant∂ Enterprise product for HA ($$$)∂ Custom query language∂ Notable options

§ Self contained web admin


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

DOCUMENT

∂ Largest resemblance with RDBMS∂ Familiar query language

§ $select->where(‘id’, $this->getId());

∂ Software architect more important


USER_2

{ first: “Paul”, last: “Borgermans”}

USER_4

{ first: “Michelangelo”, last: “van Dam”, communities: [ “PHPNW”: { id: 1, name: “PHPNW” }, “PHPBNL”: { id: 2, name: “PHPBenelux” } ]}

KEY-VALUE

COLUMN

GRAPH

DOCUMENT

MONGODB


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

MONGODB

∂ MySQL of its generation?!∂ Replicas structure∂ MapReduce∂ Notable options

§ Geo indexes

SMALLEST LEARNING CURVE!


KEY-VALUE

COLUMN

GRAPH

DOCUMENT

∂ Rapid changing data which fits in memory∂ Analytics, logging, real-time data collection

USE CASES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT


∂ Very good availability & fault tolerance ∂ Applications where seconds of downtime hurt

USE CASES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT



∂ For rich interconnected data∂ Social relational data, geo & maps data

USE CASES


KEY-VALUE

COLUMN

GRAPH

DOCUMENT



∂ For rich interconnected data∂ Social relational data, geo & maps data

∂ MySQL like usage with indexes∂ Any type of data you’d fit in MySQL

USE CASES


NOSQL IS HERE TO STAY

THEREPLACEMENTS


NOSQL IS HERE TO STAY

THEREPLACEMENTS


ONE USEFUL INGREDIENT


MORE GREAT TASTES


∂ KLIK VOOR FOOTER

70


∂ KLIK VOOR FOOTER

71

Polyglot persistence?


∂ THANK YOU! FEEDBACK? JOIND.IN/6976


∂ MORE DETAILS? SCAN THIS CODE.Sunday, October 7, 12

Technology

To SQL or No(t)SQL - PHPNW12