Datawarehouse på system z
Peter SchouboeBrand Sales Specialist, IBM
© 2010 IBM Corporation
IBM SoftwaredagData Warehousing on System z
Peter Schouboe – Information management on system z,
Nordic, 28.09.2010
© 2010 IBM Corporation
Information Management
Agenda Overview
� Dynamic Warehousing and Business Intelligence: The Challenges
� Infosphere Warehouse on System z
� IBM Smart Analytics System 9600 –Overview
© 2010 IBM Corporation
Information Management
The Journey to Smart Business Decisions
Business Operations
Transform the Business
Data Warehouse
Business Intelligence
Organize it!
Store it!
Standardize it!
Transform it!
Analyze it!
Expose it!
Leverage it!
Create it!
HR ExternalERP
BillingCRM …
Manage your Data and simplify the delivery, access & management of expanding data infrastructures
Provide access to the data to ensure smart business decisions
Optimize it!
© 2010 IBM Corporation
Information Management
Business Analytics ….Demands are shifting!
The Voice of the Business
• Need to ensure smart business decisions
With…• Support for
more users• More/faster
access to business data
• Less tools• More
functionality• Ability to work
the way we work
• How• What• When • Where
The Voice of IT
• Need to simplify the delivery, access & management of our expanding data infrastructure
While….
• Reducing costs
• Reducing complexity
• Reducing the time to value
• Meeting SLA objectives
• Performance
• Availability/Reliability
• Ensuring security
Data Integration& Data Quality
Tools
Platforms & Databases
Security Providers& Firewalls
Application & Web Servers
Dashboards
Reporting
Analysis
Real-time Monitoring
© 2010 IBM Corporation
Information Management
Today’s Traditional Business Analytics Infrastructure…Making it Difficult to Meet Shifting Demands
Executive Management
IT Administrators,
Report Authors &
BI Administrators
Division ‘A’ - Marketing & R&D Users
BA Solution
Division ‘B’ - Marketing & R&D Users
BA Solution
IT Administrators,
Report Authors & BI Administrators
Operations
Users
BA Solution
IT Administrators,
Report Authors &
BI Administrators
Sales Users
BA Solution
IT Administrators,
Report Authors &
BI Administrators
Finance Users
BA Solution
IT Administrators,
Report Authors &
BI Administrators
© 2010 IBM Corporation
Information Management
But what if YOU had Another Option?Data Warehousing & Business Analytics on System z
IT Administrators,
Report Authors &
BI Administrators
Enterprise DW and BI Deployment
IBM System z
Business
Analytics on
System z
Division ‘B’ -Marketing & R&D
Users
Division ‘A’ -Marketing & R&D
Users
Executive
Management
Operations
Users
Sales Users
Finance Users
Manufacturing
Users
HR Users
© 2010 IBM Corporation
Information Management
WarehouseWarehouse
Present Information
Acquire Data
ETLETL
Data QualityData Quality
ELTELT
ReplicationReplication
EAIEAI
EIIEII Common Meta Data
Common Meta Data
InfoSphere WarehouseThe Integrated Stack for System z
WarehouseInformation
CubingCubing
Operational Source Systems
Structured/ Unstructured Data
Operational Applications
TransformInformation
Excel
Smart Analytics System 9600
Smart Analytics Optimizer
Information Management Software
© 2010 IBM Corporation
Four Simple Steps to your new DB2 for z/OS Warehouse!
108
1. Model your data for OLAP access using the InfoSphere Warehouse Design Studio
2. Populate your star schema using InfoSphere Warehouse SQW Scripts
3. Build one or more Cube structures using the InfoSphere Warehouse Design Studio
4. Access data through Excel or Cognos MDX queries
InfoSphere WarehouseDesign Studio
Cognos
Excel
System z Environment Improved with InfoSphere Warehouse
z/OS Linux on System z
OLTP DB2 DWH DB2
SQW
MDX Queries
Cubing Services
1
2
3
4
Information Management Software
© 2010 IBM Corporation
InfoSphere Warehouse on System z
Source Systems
DB2 for z/OS
DB2 for z/OS IMS VSAM RDBMS
Data Warehouse Server
Cubing Services Engine
SQW Runtime
WebSphere App Server
Linux on System Z Partition / IFL
Design Studio
Admin Console
Windows / Linux
Application Server
Cognos 8 BI for System zExcel
Client Layer•Design and admin client•BI / Reporting tools
and apps
MQT Advisor
MQT Cube MetadataControl
DB
JDBC/DB2 Connect
JDBC/DB2 Connect
MDX
IE/Firefox
Eclipse
SQL
Information Management Software
© 2010 IBM Corporation
InfoSphere Warehouse on System z
• Tooling
• Design Studio – development IDE
• Develop physical data model
• Develop data movement flows
• Develop OLAP Model
• Prepare for deployment
• Administration Console – manage
the runtime environment
• Deploy data movement applications
• Schedule, Execute, Monitor flows
• Define and manage cube servers
• Manage OLAP Metadata
• Assign cubes to cube servers
110
Information Management Software
© 2010 IBM Corporation
Cubing Services (OLAP)
Cubing Services is a Multidimensional Analysis Server that enables OLAP applications access to Terabyte data volumes via industry standard OLAP connectivity
Benefits
• Uses industry standards OLAP Interfaces for access by a wide variety of tools for presentation and reporting
• Empowers users with ad hoc access to business information.
• What is the profitability for Product A across the Branches X,Y,Z?
• Speed of thought access to OLAP data managed in a DB2 Data Warehouse. Thus for your DB2 Warehouse OLAP data there is:
• OLAP and SQL shared access to the same information
• Single point of Management
• Single point of Maintenance
• Single point of Performance Tuning
• Enables Access to up to 1 TB of base OLAP Data
IBM DB2 Warehouse
Information Management Software
© 2010 IBM Corporation
Cubing Services - OLAP Analytics and Open Access
Cubing Services
SQL
MDX
MDX/XMLA
MDX/ODBO
DB2 Warehouse
CognosReporting ToolExcel
z/OS
Linux on System z
Information Management Software
© 2010 IBM Corporation
InfoSphere Warehouse on System z
• Adds core data warehouse and analytics capability to DB2 for z/OS
• Advanced physical database modeling
and design
• in-database data movement and
manipulation capabilities of SQL
Warehouse Tool (SQW)
• Optimize multidimensional reporting and
analysis of data with Cubing Service
• Additional capabilities available as part of a broad System z Solution
• Cognos 8 BI
• InfoSphere Data Architect
• Information Server
• MDM Server
• Industry Data Models
113
InfoSphereWarehouse
InformationServer
IBM IndustryModels
InfoSphereData Architect
MDM Server
Cognos 8 BI
Information Management Software
© 2010 IBM Corporation
WarehouseWarehouse
Present Information
Acquire Data
ETLETL
Data QualityData Quality
ELTELT
ReplicationReplication
EAIEAI
EIIEII Common Meta Data
Common Meta Data
InfoSphere WarehouseThe Integrated Stack for System z
WarehouseInformation
CubingCubing
Operational Source Systems
Structured/ Unstructured Data
Operational Applications
TransformInformation
Excel
Smart Analytics System 9600
Smart Analytics Optimizer
© 2010 IBM Corporation
Information Management
115
IBM Smart Analytics System 9600Unprecedented Value in Deploying New Business Analytics
How is it different?� Secure, Available Business Analytics
– Rapidly delivers analytic information to decision makers at the time of decision.
– New environment for the availability, reliability and scalability necessary to stay aligned with the operational systems
� Simplified administration
– Appliance-like delivery
– Faster deployment at lower cost.
– Leverages customers existing disaster recovery, and backup processes
� Proven Operational Characteristics
– Extends the qualities of service of System z.
– Reduces risk through extending System z manageability and security across the entire system.
� High Value Operational BI
– Cost effective way to drive daily operational decisions
What is it? The IBM Smart Analytics System 9600 is an integrated solution of hardware, software and services that enables customers to rapidly deploy cost effective game changing analytics across their business.
Delivering business results in days, not months
© 2010 IBM Corporation
Information Management
116
IBM analytics solutions enable decision-makers at all levels to optimize business performance and achieve break-away results
– Analytic-ready out of the box
– Pre-built for faster deployment
– Optimized and integrated with OLTP capabilities
– Flexible to add users, BI modules or additional
capacity seamlessly
– Lower total cost
Mobile OfficeWeb
Open, enterprise-class platform to deliver complete, consistent and timely information across diverse user communities with
cost-effective scale.
Dashboards Scorecarding Reporting Analysis
Answering the question “How are we doing?”
Answering the question “Why?”
Delivering a Complete Range of Business Analytics Capabilities
© 2010 IBM Corporation
Information Management
117
IBM Smart Analytics System Offerings Deliver Analytics Value Across PlatformsFaster Time to Value, Faster Business Results
Meeting clients where
their information is…
7600Based Power System
9600Based on System z
5600Based System x
117
Consistent value,
Right fitted to your needs
© 2010 IBM Corporation
Information Management
118
IBM Smart Analytics System – 9600 foundation
BI tooling in z-Linux LPAR:
•InfoSphere Warehouse:• Cubing Services –
• In memory cubes• OLAP type processing
• Design Studio –• simplifies database definition • GUI frontend for table/index structure
• ELT –• in database transformation of data
• Cognos 8.4 BI: • Query and Reporting • Go!Mobile – access to information
• Delivered to handheld devices• Go!Office – Easy refresh of info within
m/Soft files
IBM Services:
•Hardware:• Setup System, storage• Install hardware on floor• Customer defined IODF
•Lab Services: Installs 2 LPARS –• DB2 for z/OS
• Correct PTF Levels• WLM policies for period aging• DB2 customizations for BI
• z/VM LPAR• InfoSphere Warehouse• Cognos 8 BI
• CUSTOMER: • Clone z/OS image – provide
Linux SUSE
© 2010 IBM Corporation
Information Management
119
Hardware: A single centralized BI environment
z/OS foundation LPAR for enterprise BI:• DB2 for z/OS – highly available, secure, query prioritization, concurrent utilities/queries
• z/OS: Highly secure, Efficient, Trusted, Responsive
Building an end-to-end BI environment on System z
End-user functionality
BI tooling in z-Linux LPAR:• InfoSphere Warehouse
• Cognos
• Optional:• DataQuant/QMF• IBI WebFocus, SAS• Business Objects
8700 Storage:Smart Control Unit• Simplified Management• Easy Tier Management• OPTIONAL:
• Solid State Disk
• SATA slower drives
Optional software:Federated Server
• Sybase, Oracle
Classic Federation• IMS, VSAM,
© 2010 IBM Corporation
Information Management
120120
Software Stack
� z/OS …..
� z/VM V6 3390 System DDR 6.01.00 English (US)
� RSCS Feature 6.01.00 English (US)
� RACF Security Server for VM 6.01.00 English (US)
� Performance Toolkit for VM 6.01.00 English (US)
� Dir Maint Facility Feature 6.01.00 English (US)
� =====================================================
� DB2 9 for z/OS
� DB2 Utilities Suite V9
� InfoSphere Warehouse
� Cognos 8 BI
IBM Smart Analytics System 9600
© 2010 IBM Corporation
Information Management
121
Optional Value Priced Add-ons� Tivoli OMEGAMON for DB2 Performance Expert
� Tivoli Directory Server
� InfoSphere Master Data Management Server
� InfoSphere Information Server
� InfoSphere Replication Server
� Q-Rep, CDC and Event Publisher eligible
� InfoSphere Federation Server plus Classic Federation on System z
� SPSS
� Tivoli ITCAM, ITUAM
� Cognos Now! For Linux on System z
� Cognos Blueprints for Healthcare, Banking and others…
� BI User on-boarding application (as proposed for Smart Analytics Cloud)
Powerful Data Warehouse and BI Software� DB2 9 for z/OS Value Unit Edition (primary) - Option for MLC� DB2 Utilities Suite V9� DB2 Connect� InfoSphere Warehouse on System z V9.5.2� IBM Cognos 8.4 BI for Linux on System z
IBM Cognos® 8 BI reporting, IBM Cognos® 8 BI analysis, IBM Cognos® 8 BI dashboard, Cognos 8 Go! Mobile, Cognos 8 Go! Search, Cognos 8 Go! Office
� z/OS Operating System Stack V1.11� z/VM 6.1
121
IBM Smart Analytics System 9600 SoftwareDeeply Optimized by IBM Experts for Flexible Growth…
© 2010 IBM Corporation
Information Management
122
4TB8TB
12TB24TB
25TB60TB
50TB120TB
100TB240TB
AmtUser Data*
Amt Usable Disk*
PART A- DB2 BASE
IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements
Data Capacity Sizing
*Usable = Disk for compressed table data, indexes, work files, MQTs etc.
*User Data = Raw, uncompressed, user data
© 2010 IBM Corporation
Information Management
123
250-2500
502500-5000
1005000-10000
Max Concurrent UsersNamed Users
PART B- Cognos Workload
BI Capacity Sizing
IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements
© 2010 IBM Corporation
Information Management
124
IBM Smart Analytics SystemHigh Performance and scalable platform
Database
� Shared data parallel database
� Industry leader in mixed workloads
� Integrated multi-level security
� 27 years of maturity and development
� Hardware data compression
Server
� Industry standard for availability
� Leadership in virtualization and consolidation
� Up to 60 LPARs each with 64-bit central memory addressability
� Advanced encryption
I/O subsystem
� New drive options, including SSD
� DB2 Online Reorg function for migrating DB2 table spaces to appropriate drive tier
© 2010 IBM Corporation
Information Management
125
IBM System z…the platform for the future
"you cannot think seriously about your longer-term IT architecture without thinking equally seriously about
what today's mainframe environment has to offer“
CIO Magazine: Mainframe computing is
set for a rebirth – September 29, 2009