Upload
rohit-jain
View
130
Download
0
Tags:
Embed Size (px)
DESCRIPTION
3 - Trafodion Technology Look
Citation preview
HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Trafodion Transactional SQL-on-HBaseTrafodion Technology Look
www.trafodion.org
HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2
Trafodion – Software architecture (3 layers)
JDBC ODBC
User and ISV Operational Applications
Driver
Client
SQL
Storage Engine
*ESP
CMP Master
ESPDTM
WMS
Compiler and Optimizer Workload Management
SQL ParallelismDistributed Transaction
Management
. . . .
FutureDatabase Connectivity
HBase
Relational Schema
Trafodion Tables
HDFS
Data Store Integratio
nHBase
Native HBase Tables KVS,
Columnar via HBase API +
coprocessors
Hive
Direct HDFS access to Hive tables using
HCatalog
*Executor Server Process
HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3
Optimized for varying operational workloads• Optimized performance and efficiency
– OLT optimization for directed keyed access
– ESPs for parallel SQL operations– Multi-layered ESP for complex plans– Data Flow pipeline parallel architecture– Reusable Masters and ESPs for efficiency
• Cached SQL plans eliminates recompilation
• Sophisticated Optimizer– Leverages Equal Height Histograms– Pushes down
• Filters e.g. row selection (start-stop key)
• Coprocessors e.g. aggregates
• Multi-Dimensional Access (MDAM)
– Secondary index access
• Service persistence (via Zookeeper) and automatic query resubmission
Node 1 Node 2 Node n
Client Application
HDFS
HBase HBase HBaseFILTERS
HDFS HDFS HDFS HDFS
Ethernet
COPROCESSORS
Master
ESP ESP ESP ESP ESP
ESP ESP ESP ESP ESP
Master
Type 2 and Type 4 ODBC/JDBC driver
HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4
Trafodion – Differences with HBase
Trafodion + HBase
Data abstraction
Relational schema
Physical Layout Single column family with space-saving column encoding
Column values Explicitly defined and enforced data types
ACID Guarantee
Transactions across multiple SQL statements, tables, and rows
Language API SQL (Trafodian invokes native HBase API)
Row Key Index Composite (multi-column) row key
Secondary Indexes
Arbitrary secondary key columns
Salting Allows specification of salt key-prefix for load balancing
HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5
Comprehensive DDL, DML, TCL, and utility support • ANSI Core SQL 99 complaint + other SQL 99 and SQL 2003 support with
Trafodion extensions• Full featured DDL - CREATE/DROP/ALTER statements for tables, views,
indexes, constraints– Comprehensive data type support - numeric, character, varchar, date, time, interval– Unicode encoding including UTF8, UCS2, and ISO8859-1for user data; UTF8 for
metadata
• Full featured DML – SELECT, INSERT, UPDATE, DELETE, UPSERT and MERGE statements– JOIN (INNER, LEFT/RIGHT/FULL OUTER), UNION, WHERE, GROUP BY, HAVING, ORDER
BY, SAMPLING, etc.– Correlated and nested sub-queries– Cursor support (non-holdable)– Extensive SQL function support - aggregate, date/time, character, mathematical,
OLAP, sequence, etc.
• Utilities – Update Statistics, Explain, Control Query Shape, Command Line Interface
• Transaction Control – BEGIN WORK, COMMIT WORK, ROLLBACK WORK, SET TRANSACTION
• Work-in-progress: Stability, Performance, Triggers, Referential Integrity, C++ UDFs, Java Stored Procedures, Bulk Loader, node/system failure Transaction Recovery, Grant/Revoke, …
HP © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6
See for yourself…Come discover and develop on
Trafodion
www.trafodion.org