View
674
Download
1
Category
Tags:
Preview:
DESCRIPTION
automation Data verification tool for BI and DWH. for more info contact: liorkat@tact.co.il
Citation preview
Your Data Quality Solution By
4/6/2011 1
&
Quality Gates – A Brief Overview
BI Data quality
Demo
Meeting Agenda
4/6/2011 2
Vision.bi Quality Gates - overview
Vision.bi Quality Gates ™ is a centralized solution for data quality.
The solutions helps organizations to constantly and efficiently improve
the quality of information and trust in organizational information systems
by defining various types of quality gates.
Quality gates can be used for integration and BI projects (QA) or for
monitoring data quality in production (On going…)
4/6/2011 3
Vision.bi – Quality Gates
4/6/2011 4
Load Metadata Design Your Model Create DWH Create ETL QA
SCD
RI
OLAP\Front
Roles
Quality Gates
Vision.bi Create
On Going
Source Changes
Undated sources
Bugs in the sources
Referential Integrity
Regression tests
QA
Columns\Table Mapping
Data Loaded
Calculations
Cubes
Reports *
Quality Gates
Centralize management
Auto execution
History
Various sources
Methodology
QA in BI Environment
4/6/2011 6
Centered Management
Cartelize Solution
Unique QA dashboard
Intuitive drill to the tests result
Manage QA organization tree
4/6/2011 7
QA best practices
Unique test types for BI and integration
User friendly definition
Various test types
Best practices
Check sum - Compare between source
Compare tables – Detailed compare
Execution flow – Tests parallelism and
dependencies
Referential integrity – Complete dimension
missing value
Free SQL – Custom tests
4/6/2011 8
Test goal
Identify changes in data trend
Identify missing sources
#1 – Data consistency
How
Compare amount between current period to previous
Compare to average
Test type: Check Sum
When
End of the ETL cycle
Before cube process
4/6/2011 9
Test goal
Verify updated data availability
Inform users for updated data
#2 – Data Availability
How
Query for rows on the last period
If missing inform the IT team else inform the user
Test type: Custom test
When
End of the ETL cycle
Every hour
4/6/2011 10
Test goal
Check and complete dimension missing keys with default values
Insure data integrity for join between fact tables and dimensions
#3 – RI Completeness
How
Find distinct values from fact where not exists in the dimension
Test type: Referential integrity
When
After loading fact tables
4/6/2011 11
Test goal
Verify cube data Vs. Data warehouse
#4 – Cube correctness
How
Compare last period in cube Vs Dwh\sources queries
Test type: Check Sum
When
End of the ETL cycle
4/6/2011 12
Test goal
Tests dependencies
Execute in parallel
Drill to the row level
#5 – Execution Flow
How
Add your tests to the execution flow test and define the dependencies
Test type: Execution flow and all other objects
When
End of the ETL cycle
4/6/2011 13
Compare values – changes over time
Tests history & versions
Advanced mail alerts
Environments (Test -> Production)
…
And more…
BI clients (Partial List)
14
Eden Springs Ltd is the IL market leader in the Water Cooler Industry and forms part of Eden Springs Europe, which has a presence in 13 other European countries.
Harel Group is the third largest insurance group in Israel. It is the second largest in general insurance; the market leader in health insurance, and from the perspective of premium volume, it is the third largest in life insurance.
013 NetVision is the leading company in the Israeli communication sector with a market share of 36% in International Telephony services. In addition, the company offers its customers a domestic calls service (VOIP).
NICE Systems (NASDAQ: NICE), is the worldwide leader of intent-based solutions that capture and analyze interactions and transactions, realize intent, and extract and leverage insights to deliver impact in real time.
A global company (NYSE: DOX) with revenue of $3.0 billion in fiscal 2010, Amdocs is the market leader in customer experience systems innovation with over 19,000 employees delivering the most advanced business support systems (BSS), operational support systems (OSS) and service delivery to innovative service providers in more than 60 countries around the world.
Start using Vision.bi Quality gates and get
Business alerts
Data integrity
Inform on data inconsistency
Cube validation
Summary
4/6/2011 15
4/7/2011 16
&
Thank You! For demo please contact Ram Yonish M - ryonish@tact.co.il P – 052-2424314
Yifat Vector M - yifatva@matrix.co.il P – 052-8651729
Recommended