Cassandra 1.0The Future Of Big DataMatthew F. Dennis // @mdennis7th Advanced Computing ConferenceSeoul, South KoreaFebruary 15th, 2012

Cassandra Job Trends (indeed.com)

Cassandra Job Trends (indeed.com)

“Big Data” Job Trends (indeed.com)

Big Data

Why People Choose Cassandra

True Multi­DC Support

Linearly scalable

Larger­than­memory datasets

Best­in­class performance (not just for writes!)

Fully durable

Integrated caching

Tuneable consistency

No single point of failure (SPOF)

Common Cassandra Use Cases

Time Series 

Sensor Data

Messaging

Ad Tracking

Financial Market Data

User Activity Streams

Fraud Detection / Risk Analysis

Anything Requiring:linear scale + high performance + global availability

“With Cassandra, we get better business agility, and we don’t have to plan capacity in advance, we don’t need to ask permission of other people to build things for us, and we don’t worry about running out of space or power.”   

Adrian Cockcroft, Cloud Architect

Netflix’s problems

Could not build datacenters fast enoughMade decision to go to cloud (AWS)Cassandra on AWS is a key infrastructure component of its globally distributed streaming product.Applications include Netflix’s subscriber system, AB testing, and viewing history service (including pause/resume).

Netflix on Cassandra

FastCheapScalableFlexibleNo SPOF

Scale Horizontallyhttp://www.datastax.com/1-million-writes

Number Of Nodes

Clie

nt

Wri

tes

Per

Seco

nd

“Without Cassandra, our engineers would’ve had to create something that could scale to our needs, that would’ve prevented us from focusing on building product and solving problems for Backupify’s users, which are far more important tasks.”

Matt Conway, VP Engineering

Backupify’s problem

Cloud­based utility that enables businesses and consumers to backup, search and restore the content of popular online applications such as Google Apps, Gmail, Facebook, Twitter, and Blogger

Backupify on Cassandra

Ease of scale enabled engineers to focus on building great applicationsDataStax OpsCenter made it easy to monitor the health and performance of their clusterReliable, redundant, scalable and cheap data  storage helped eliminate down­timeAbility to offer both backup and storage, but   also analysis of data in the future

“You can seamlessly add new nodes and expand your total capacity without deteriorating the performance of the data store. Cassandra has allowed us to scale very effectively.”

Harry Robertson, Tech Lead

Ooyala’s problem

Ooyala provides a suite of technologies and services that support content owners in managing, analyzing and monetizing the digital video they publish online

Ooyala on Cassandra

Classic “Big Data” problem did not require re­architectingEnabled Application agility – developers spend time building cool apps, not figuring out how to scaleEnabled more powerful and granular analytics for their customers

Financial

Social Media

Advertising

Entertainment

Energy

E­Tail

Health Care

Infrastructure

Government

Some More Cassandra Users http://www.datastax.com/cassandrausers

Big Data

The evolution of Analytics

Analytics + Realtime

The evolution of Analytics

Analytics Realtime

replication

The evolution of Analytics

ETL

RealtimeAnalytics

DataStax Enterprise re-unifies realtime and analytics

realtime and analytics

Portfolio Demo dataflow

Portfolios

Historical Prices

Intermediate Results

Largest loss

Portfolios

Live Prices for today

Largest loss

Operations

“Vanilla” HadoopMany pieces to setup, monitor, backup, and maintain(NameNode, SecondaryNameNode, DataNode, JobTracker, TaskTracker, Zookeeper, Region Server, ...)Single points of failure

DataStax EnterpriseSingle simplified systemSelf­organizes based on workloadPeer to peerJobTracker failoverNo additional Cassandra config

Monitoring Cassandra (OpsCenter)

Q?Matthew F. Dennis // @mdennishttp://slideshare.net/mattdennis