Upload
others
View
6
Download
0
Embed Size (px)
Citation preview
Information Management
Agenda
� Primjer razvoja Data Warehouse okoline u Zavarovalnici Maribor
� Kako može IBM pomoči kod ubrzanja Data Warehouse-a
© 2011 IBM Corporation
Information Management
Zavarovalnica Maribor
• The second universal insurance company in Slovenia measured by Written Premium (WP).
• Market share 2011: about 13%.
• Number of employed:• More than 900 internal workers, approximately 200 of which are
© 2011 IBM Corporation
• More than 900 internal workers, approximately 200 of which are
sellers on the active list.• Contractual sellers: approx. 500
Information Management
The BI system of ZM - development
• Years 2005 – 2007:
• Upgrade of the data warehouse– launching a three tier infrastructure and introducing atomary data on important business transactions (events).
• Enlargement of the data warehouse by 100.• Purchased a new data server in the price range of 30.000 EUR (price
per CPU speed and storage units also fall dramaticly).
© 2011 IBM Corporation
per CPU speed and storage units also fall dramaticly).• Bought an application server for the BI tool – launching a thin client.• Increasing the number of common users to 250.• Purchased a CPU license for the BI tool.• The very beginning of the real time operational decision support:
• Finding out client’s profitability.
• Demands managing.• Towards the end of 2007 BI declared as a key business process of
ZM.
Information Management
Expected responsiveness of DWH system
• “Imediate” responsivness:
• Daily or even shorter frequencies for data loading;
• Real time BI.
© 2011 IBM Corporation
• Real time BI.
• Sophisticated iterative analysis: marketing analysis, product or customer profitability analysis etc.
• Quick ad-hoc reporting for various purposes.
Information Management
Main issues regarding the further development of the DWH
• More and more administration: database servers, application servers, BI
tools, BI applications...
• Higher and higher ownership costs (HW; SW, licences...).
• Continuously increased complexity of the ELT process.
© 2011 IBM Corporation
• Smaller and smaller time window for transfer of more and more data for the
ETL process.
• More and more end users.
• Continously increased complexity of the reports and analysis - killer
queries which can only be run in the evening hours , “freeze” the server,
even on DWH.
Information Management
The IBM Netezza Appliance: Revolutionizing Analytics
� Purpose-built analytics engine
� Integrated database, server & storage
� Standard interfaces
� Low total cost of ownership
© 2011 IBM Corporation
� Speed: 10-100x faster than traditional systems
� Simplicity: Minimal administration
� Scalability: Peta-scale user data capacity
� Smart: High-performance advanced analytics
Information Management
Bold Claims, but...We Prove Them!
�We prove we are simpler
�We prove we deliver performance
�We prove we work within your environment
© 2011 IBM Corporation
�We prove we integrate with your 3rd party tools
�We prove we are “easy to do business with”
�We prove we have the lowest TCO
�We prove Business Value
Appliance Simplicity
© 2012 IBM Corporation
����
Information Management
Managing The Netezza Appliance
No storage administration
No database tuning
No software installation
© 2011 IBM Corporation
No database tuning
Less DBA drudgery, More applications
Information Management
Data Integration
The Netezza Appliance – Loading
Ab Initio
Business Objects/SAP
Composite Software
Expressor Software
SQ
L
OD
BC
JD
BC
O
LE
-DB
© 2011 IBM Corporation
Data InGoldenGate Software (Oracle)
Informatica
IBM Information Server
Sunopsis (Oracle)
WisdomForce
SQ
L
OD
BC
JD
BC
O
LE
Information Management
The Netezza Appliance – Querying
Reporting & Analysis
Cognos (IBM)
Actuate
Business Objects/SAP
Information Builders
Kalido
SQ
L
OD
BC
JD
BC
O
LE
-DB
© 2011 IBM Corporation
KXEN
MicroStrategy
Oracle OBIEE
QlikTech
Quest Software
SAS
SPSS (IBM)
Unica (IBM)
SQ
L
OD
BC
JD
BC
O
LE
Data Out
Appliance Architecture
© 2012 IBM Corporation
����
Information Management
Server
IBM Netezza True Appliance Architecture
DATA
Client
SOLARIS
LINUX
HP-UX
AIX
WINDOWS
TRU64
StorageDatabase
© 2011 IBM Corporation
CACHE
SQL
DATA
Source Systems
High Performance
Loader
3rd PartyApps
DBA CLI
ETL Server
SQL Data
CACHECACHEI/O I/O
Information Management
IBM Netezza True Appliance Architecture
Client
SOLARIS
LINUX
HP-UX
AIX
WINDOWS
TRU64
ODBC 3.XJDBC Type 4
SQL-92
StorageServerDatabase
© 2011 IBM Corporation
Source Systems
High Performance
Loader
3rd PartyApps
DBA CLI
ETL Server
SQL-92SQL-99 Analytics
Database, Server, Storage - in one CACHECACHECACHE I/O I/O
Information Management
IBM Netezza True Appliance Architecture
Optimized Hardware+Software
Purpose-built for high performance analytics;
Streaming Data
Hardware-based query acceleration for blistering
© 2011 IBM Corporation16
performance analytics; requires no tuning
acceleration for blistering fast results
True MPP
All processors fully utilized for maximum speed and efficiency
Deep Analytics
Complex analytics executed in-database for deeper insights
Information Management
IBM Netezza True Appliance Massively Parallel Processing
1
2
ODBC 3.XJDBC Type 4
OLE-DBSQL/92
Execution Engine
SQL Compiler
Query
Client
SOLARIS
LINUX
HP-UX
AIX
WINDOWS
TRU64
S-Blade
S-Blade
Processor &
streaming DB logic
S-Blade
Processor &
streaming DB logic
© 2011 IBM Corporation
Massively Parallel Intelligent Storage
3
960
�
�
�
Network FabricSMP Host
DBOSFront End
High-Speed Loader/Unloader
EngineQuery Plan
Optimize
Admin
Source Systems
High Performance
Loader
3rd PartyApps
DBA CLI
ETL Server
High-PerformanceDatabase EngineStreaming joins,
aggregations, sorts
S-Blade
Processor &
streaming DB logic
S-Blade
Processor &
streaming DB logic
Information Management
S-Blade
S-Blade
Processor &
streaming DB logic
S-Blade
Processor &
streaming DB logic
1
2SQL
Compiler
Query
SQL
Snippets
1 2 3
Client
SOLARIS
LINUX
HP-UX
AIX
WINDOWS
TRU64
IBM Netezza True Appliance Massively Parallel Processing™
Execution Engine
2 3
2 3
© 2011 IBM Corporation
High-PerformanceDatabase EngineStreaming joins,
aggregations, sorts
S-Blade
Processor &
streaming DB logic
S-Blade
Processor &
streaming DB logic
Massively Parallel Intelligent Storage
3
960
�
�
�
Network FabricSMP Host
DBOSFront End
High-Speed Loader/Unloader
Query Plan
Optimize
AdminSQL
Source Systems
High Performance
Loader
3rd PartyApps
DBA CLI
ETL Server
Engine2 3
2 3
Information Management
S-Blade
S-Blade
Processor &
streaming DB logic
S-Blade
Processor &
streaming DB logic
IBM Netezza True Appliance Massively Parallel Processing™
1
2SQL
Compiler
Query
2 3
2 3
Consolidate
Client
SOLARIS
LINUX
HP-UX
AIX
WINDOWS
TRU64
Execution Engine
© 2011 IBM Corporation
High-PerformanceDatabase EngineStreaming joins,
aggregations, sorts
S-Blade
Processor &
streaming DB logic
S-Blade
Processor &
streaming DB logic
Massively Parallel Intelligent Storage
3
960
�
�
�
Network FabricSMP Host
DBOSFront End
High-Speed Loader/Unloader
Query Plan
Optimize
Admin
2 3
2 3Source Systems
High Performance
Loader
3rd PartyApps
DBA CLI
ETL Server
Engine
Information Management
Our Secret Sauce
FPGA Core CPU Core
select DISTRICT,
PRODUCTGRP,
sum(NRX)
from MTHLY_RX_TERR_DATA
where MONTH = '20091201'
and MARKET = 509123
and SPECIALTY = 'GASTRO'
© 2011 IBM Corporation
Uncompress Project Restrict,Visibility
Complex ∑Joins, Aggs, etc.
Slice of table
MTHLY_RX_TERR_DATA
(compressed)where MONTH = '20091201'
and MARKET = 509123
and SPECIALTY = 'GASTRO'
sum(NRX)select DISTRICT,
PRODUCTGRP,
sum(NRX)
����
Information Management
Appliance family for data life-cycle management
© 2011 IBM Corporation21
Skimmer TwinFin Cruiser
Dev & Test System Data WarehouseHigh Performance Analytics
Queryable ArchivingBack-up / DR
1 TB to 10 TB 1 TB to 1.5 PB 100 TB to 10 PB
Information Management
�We prove we are simpler
�We prove we deliver performance
�We prove we work within your environment
Bold Claims, but...We Prove Them!
Tes t D r i v e
TwinFin
© 2011 IBM Corporation
�We prove we integrate with your 3rd party tools
�We prove we are “easy to do business with”
�We prove we have the lowest TCO
�We prove business value
TwinFinYour Data. Your Site. Our Risk.
http://www.netezza.com/testdrive/
Information Management
• Considered by the management as one of the best IT-investments in the last 10 years.
• The trend of IT-investments in BI remained and is at the moment considered as more profitable than investment in ERP.
• In ZM BI-investment are at the moment number one or at least as important as ERP in operational IT-infrastructure!
The “Netezza-effect” on positioning the BI/DWH in ZM
© 2011 IBM Corporation
important as ERP in operational IT-infrastructure!
• The same BI-team is capable of manage even larger BI-infrastructure.
• Vast simplification of many complex queries and batch jobs.
• Development of new BI-solutions.