Upload
oracle-isv-migration-center
View
196
Download
6
Embed Size (px)
DESCRIPTION
The Oracle NoSQL Database is a horizontally scaled, Key-Value database for Web Services and Cloud, designed specifically to provide highly reliable, scalable and available data storage across a configurable set of systems that function as storage nodes. Oracle NoSQL Database provides a powerful and flexible transaction model that greatly simplifies the process of developing a NoSQL-based application. It scales horizontally with high availability and transparent load balancing even when dynamically adding new capacity. With Big Data becoming the biggest thing in IT since the internet itself, developers everywhere are focused on applications to accelerate businesses. [Read More @https://blogs.oracle.com/imc/entry/oracle_nosql]
Citation preview
Stay Connected
BLOGS.ORACLE.COM/IMC
TWITTER.COM/ORACLEIMC
YOUTUBE.COM/ORACLEIMCTEAM
FACEBOOK.COM/ORACLEIMC
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Presented by
Oracle NoSQL Database
Andrey Rivkin Technical Consultant FORS Distribution October 16, 2014
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Agenda
A bit of history and what is NoSQL
Data Model
Architecture
Consistency
When to use
Community Edition vs Enterprise Edition
What’s new in release 3.0
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Reasons for creating NoSQL technology
The appearance in the early 2000s:
• Google - web search engine
• Facebook – social network
• Amazon - online retailer
Common features of these systems:
• Constantly changing structure
• Unpredictable data growth
• A huge number of users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
What is NoSQL?
NoSQL = Not only SQL.
Do not have a structured scheme - Frequently the data is stored in the scheme of key-value - The structure of the database schema is created by the application
Allow almost infinite horizontal scale - The data is stored in the copies on different servers - Node failure does not result in data loss - Reading is done from the master or a copies
Working with data through a simple operations (no SQL)
- CREATE - RETRIEVE
- UPDATE - DELETE
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL Database Horizontally Scaled, Key-Value Database for Web Services and Cloud
• Simple Data model Based on Key-value scheme with two parts key – major +
minor
Simple operations read/insert/update/delete
• Scalability Optimized data access
Smart division and distribution of data
• High Availability & No-Single Point of Failure single-master, multi-replica database replication
automated fail-over election
• Transparent Load Balancing Read from master or/and replicas
Network topology and latency-aware
Storage Nodes Data Center A
Storage Nodes Data Center B
Application
NoSQL DB Driver
Application
NoSQL DB Driver
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Key – Value pair
Oracle NoSQL Database hashes keys to provide good distribution over a collection of computers that provide storage for the database.
A key is the concatenation of a Major Key Path and a Minor Key Path, both of which are specified by the application.
A minor component does not affect the distribution and can be empty.
Key
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Key – Value pair
Oracle NoSQL Database stores value as byte array.
Mapping of the byte arrays to data structures is done by application.
There are no restrictions on the size or structure of the value field.
Value
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Logical representation of Oracle NoSQL Database
Key Value
Key 1 Value 1
Key 2 Value 2
Key 3 Value 3
Key 4 Value 4
Key 5 Value 5
Key 6 Value 6
Index
Key 1 – Value 1
Key 5 – Value 5
Key 4 – Value 4
Key 2 – Value 2
Key 3 – Value 3
Key 6 – Value 6
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Physical representation of Oracle NoSQL Database
Key 1 – Value 1
Key 5 – Value 5
Key 4 – Value 4
Key 2 – Value 2
Key 3 – Value 3
Key 6 – Value 6
server rack 1 server rack 2
Key 1 – Value 1 Key 1 – Value 1
Key 4 – Value 4 Key 4 – Value 4
Key 2 – Value 2 Key 2 – Value 2
Key 5 – Value 5 Key 5 – Value 5
Key 3 – Value 3 Key 3 – Value 3
Key 6 – Value 6 Key 6 – Value 6
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Physical representation of Oracle NoSQL Database server rack 1 server rack 2
Key 1 – Value 1 Key 1 – Value 1
Key 4 – Value 4 Key 4 – Value 4
Key 2 – Value 2 Key 2 – Value 2
Key 5 – Value 5 Key 5 – Value 5
Key 3 – Value 3 Key 3 – Value 3
Key 6 – Value 6 Key 6 – Value 6
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
server rack 1 server rack 2
Key 1 – Value 1 Key 1 – Value 1
Key 4 – Value 4 Key 4 – Value 4
Key 2 – Value 2 Key 2 – Value 2
Key 5 – Value 5 Key 5 – Value 5
Key 3 – Value 3 Key 3 – Value 3
Key 6 – Value 6 Key 6 – Value 6
Storage architecture
Shard 1 (Replication Group 1)
Shard 2 (Replication Group 2)
Shard 3 (Replication Group 3)
Master
Master
Master
Slave
Slave
Slave
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Storage architecture
Key 1 – Value 1
Key 4 – Value 4
Oracle NoSQL Database
Storage Node
Key 1 – Value 1 Key 1 – Value 1
Key 4 – Value 4 Key 4 – Value 4
Key 2 – Value 2 Key 2 – Value 2
Key 5 – Value 5 Key 5 – Value 5
Key 3 – Value 3 Key 3 – Value 3
Key 6 – Value 6 Key 6 – Value 6
Master
Master
Master
Slave
Slave
Slave
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
How Does it work?
Client
Replication Group
Master
Replica Replica Key – Value pairs
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Client
How Do We Read?
get( )
hash( )
LUT( )
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Consistency of data
BASE
Basically Available Soft state Eventual consistency
ACID
Atomicity Atomicity requires that each transaction is "all or nothing": if one part of the transaction fails, the entire transaction fails, and the database state is left unchanged.
Consistency The consistency property ensures that any transaction will bring the database from one valid state to another.
Isolation The isolation property ensures that the concurrent execution of transactions results in a system state that would be obtained if transactions were executed serially, i.e. one after the other.
Durability Durability means that once a transaction has been committed, it will remain so, even in the event of power loss, crashes, or errors.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Consistency of data
Oracle NoSQL Database – ACID or BASE system? Can be configured for the whole system and for a particular operation!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
In which case you should use Oracle NoSQL Database?
Terabytes or petabytes of data
The application should not have a single point of failure
The use of multiple low-cost servers
Short response time of simple queries
Unstructured or semi-structured data model
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Potential systems for Oracle NoSQL Database LDAP like systems Why? It’s fast! User personalization Why? No clear data model and constant addition of new features! Collection of different types of data from the sensors Why? A lot of concurrent sessions! Logging of Internet traffic (CDR GPRS, web logs) Why? Huge amount of data! File storage (like Dropbox, Google disk) Why? Cheap store of large amounts of unstructured data!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL Database Community VS Enterprise Edition
Oracle NoSQL Database Community Edition. Open Source. GPLv2 or AGPL license.
Oracle NoSQL Database Enterprise Edition. Closed Source. Standard Oracle License. List price: $10K/CPU.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL Database benefits Community Edition
1. Java and C APIs
2. Store billions of records and multi-terabytes of data
3. No-Single Point of failure
4. Designed to scale out to thousands of nodes
5. Streaming Large Object Support
6. Easy online administration
7. Online rolling upgrade
8. Efficient Multi-Zone support
9. Integrated with Apache Hadoop
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL Database Enterprise Edition includes all features available in Community Edition, plus these additional features: Simple Network Management Protocol (SNMP) adapter for monitoring Oracle Database Integration via External Tables: Access data through SQL queries Integration with Oracle Event Processing (OEP) engine using NoSQL database cartridge:
Access data through CQL queries Integration with Oracle Coherence to permit Oracle NoSQL Database to be used as a
cache for Oracle Coherence applications and to allow applications to directly access cached data from Oracle NoSQL Database.
A Java-based interface to store and query semantic data through support for the Resource Description Framework (RDF), SPARQL query language, and a subset of the Web Ontology Language (OWL) are now supported.
Enterprise Grade Support (24x7) for Enterprise Edition (EE).
Oracle NoSQL Database benefits Enterprise Edition
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Table data model support – Simplifies data modeling & leverages existing “table” expertise
Secondary indexing – Allow indexing on any component of the record
– Huge performance benefit due to parallel, indexed data access
Data centers – Metro-area zones for disaster recovery and business continuity
– Secondary zones for read-only workloads
Security – Authentication and network-level encryption
Oracle NoSQL DB Release 3.0
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Lower barrier to adoption, shorter time to market
Simplified application modeling – Uses familiar table concepts
– Introduces strongly typed fields
– Easy to/from JSON with full type support and AVRO serialization
– Allows secondary indexing of non-key data
Sets foundation for SQL query access from Oracle DB
Previous Key/Value and JSON schema APIs still supported
Oracle NoSQL DB Release 3.0 Table model benefits
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL DB Release 3.0 Secondary Index support
Broader low latency use case support – Primary and Secondary Indexes
– Indexes automatically maintained
– Provides sorted results
Low resource cost with high performance – Low cardinality matching, guaranteed consistent
– Shard-local indexing, low latency record access
– B-trees locally ordered, scanned in parallel, merged result set
– Improved index cache eviction
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL DB Release 3.0 Secondary Index
Get() API specifies index Equality or range searches Low order multi-value indexes
– Composite index on values
– Parallel Index ScanA
– Ordered results
– Indexable single element arrays
Equality search on lname + fname
Equality search on lname and range on fname
Range or Equality search on lname by itself
Can’t search on just fname
Index on (lname, fname)
UserId fname lname email Table
Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL DB Release 3.0 Zones
Metro-Local Quorum – Low latency writes, HA
2nd’ary Read-Only Zones – Analytic workloads
– Report generation
– Asynchronous replication
New Read Consistency: No Master
Topology Aware Client Driver
Provides business continuity and distributed workload management
DC1 DC2 DC3
Metropolitan Zones
Reports
Batch Analytics
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL DB Release 3.0 Security Overview
Protected Access to Data – Enforcement is configurable
Authentication – OS independent, password based user access
– Internal cluster components self authenticate (HA password distribution)
– Oracle Wallet integrated
– Admin utility to generate self-signed certificates
Wire level data encryption – All client-server, server-server channels SSL encrypted
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
• Free test of Oracle NoSQL database is available here:
http://www.oracle.com/technetwork/database/database-technologies/nosqldb/overview/index.html
• Try Oracle Big Data Lite Virtual Machine:
http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite-2104726.html
32
Try it yourself!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Q&A
33
Andrey Rivkin FORS Distribution Big Data Specialist [email protected] ISV Migration Center blog: http://blogs.oracle.com/imc ISV Migration Center email: [email protected]
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
• Oracle.com Partner Hub oracle.com/partners/goto/hub-ecemea
• Migration Center Team Blog blogs.oracle.com/imc
feeds.feedburner.com/oracleIMC
• Partner Webcast Recordings youtube.com/OracleIMCteam
• Partner Webcast Presentations slideshare.net:/Oracle_IMC_team
Oracle Partner Hub ISV Migration Center • twitter.com/OracleIMC
• plus.google.com/+OracleIMC
• facebook.com/OracleIMC
• linkedin.com/groups/Oracle-Partner-Hub-Migration-Center-4535240