Data Grids and Data Caching

Thursday, November 3, 11


Data Grids and Data Caching

Galder ZamarreñoSenior Software Engineer

Red Hat, Inc

3rd October 2011, Soft Shake


Galder Zamarreño

• R&D Engineer, Red Hat Inc.• Infinispan developer• 5+ years exp. with distributed data systems• Twitter: @galderz• Blog: zamarreno.com


Agenda

• What is Infinispan?• Infinispan as in-memory cache• Infinispan as in-memory data grid• Data-as-a-Service with Infinispan• Who uses Infinispan?


Introducing


What is Infinispan?

An in-memory, highly available, elastic, and open source (LGPL) data grid platform


Infinispan can be used as...


Local in-memory cache

Boost performance caching data which is hard to calculate or expensive to retrieve


ConcurrentHashMap ?

Infinispan provides greater concurrency with MVCC, has built-in eviction...etc


Local cache example


A local cache might not be enough...


Clustered caches

Scale up your application and maintain cache consistency


Consistency in a clustered cache...


Invalidation


Invalidation


Invalidation


Cache-oriented operations...


putForExternalRead()put() putForExternalRead()

Use for updating state Use to cache state read from external source

Regular lock acquisition timeout Fail-fast

Could throw an exception Fails quietly

Could cause existing transaction to fail

Will never affect existing transactions


Accessing Infinispan caches


Embedded Access


Infinispan is not just a cache!


In-memory data grid

It’s a Fast, Available, Distributed, Elastic data store, not just a cache!


Invalidation won’t work for data grids!


Data distribution


Replication


Distribution• With number of copies = 2


How is data distributed??


Consistent Hashing


Solving unequal distribution


Virtual Nodes


Accessing Infinispan data grid


Remote Access

• Via protocols :

• REST

• Hot Rod


Hot Rod clients


Infinispan as cloud data store


Traditional 3-tier App


Typical IaaS App


Traditional PaaS App


Where’s your data stored??


Clouds are ephemeral!!


State


Virtualizing Data

Some public services exist (i.e. Amazon RDS), but not all cloud deployments are public!


Build your own Data-as-a-Service!


Characteristics of DaaS

Elastic, scalable and highly available!


DaaS with Infinispan


ArchitectureM

anage and Monitor


Who uses Infinispan?


As a cache...

Hibernate 2nd level cache, Torquebox Rails cache...


As a temporary store...

Http session cache & EJB SFSB cache, in JBoss AS7


As data grid...

Real-time trading app of a well known stock exchange


What’s next?


Towards EDG

Solidifying Infinispan towards integration with Red Hat’s Enterprise Data Grid


Plus more data grid...

Enhancing Hot Rod protocol, Hibernate Object/Grid Mapper ...etc


Summary

Infinispan as fast powerful local cache that can be clustered!


Summary

But also a F.A.D.E. data grid, accessible in embedded or remote fashion


Summary

Build your own Infinispan based Data-as-a-Service in your private cloud!


Questions

infinispan.org - @infinispan

speakerrate.com/galder

More on data grids at 5pm!


Technology

Data Grids and Data Caching