Visionbi Quality Gates

Preview:

DESCRIPTION

automation Data verification tool for BI and DWH. for more info contact: liorkat@tact.co.il

Citation preview

Your Data Quality Solution By

4/6/2011 1

&

Quality Gates – A Brief Overview

BI Data quality

Demo

Meeting Agenda

4/6/2011 2

Vision.bi Quality Gates - overview

Vision.bi Quality Gates ™ is a centralized solution for data quality.

The solutions helps organizations to constantly and efficiently improve

the quality of information and trust in organizational information systems

by defining various types of quality gates.

Quality gates can be used for integration and BI projects (QA) or for

monitoring data quality in production (On going…)

4/6/2011 3

Vision.bi – Quality Gates

4/6/2011 4

Load Metadata Design Your Model Create DWH Create ETL QA

SCD

RI

OLAP\Front

Roles

Quality Gates

Vision.bi Create

On Going

Source Changes

Undated sources

Bugs in the sources

Referential Integrity

Regression tests

QA

Columns\Table Mapping

Data Loaded

Calculations

Cubes

Reports *

Quality Gates

Centralize management

Auto execution

History

Various sources

Methodology

QA in BI Environment

4/6/2011 6

Centered Management

Cartelize Solution

Unique QA dashboard

Intuitive drill to the tests result

Manage QA organization tree

4/6/2011 7

QA best practices

Unique test types for BI and integration

User friendly definition

Various test types

Best practices

Check sum - Compare between source

Compare tables – Detailed compare

Execution flow – Tests parallelism and

dependencies

Referential integrity – Complete dimension

missing value

Free SQL – Custom tests

4/6/2011 8

Test goal

Identify changes in data trend

Identify missing sources

#1 – Data consistency

How

Compare amount between current period to previous

Compare to average

Test type: Check Sum

When

End of the ETL cycle

Before cube process

4/6/2011 9

Test goal

Verify updated data availability

Inform users for updated data

#2 – Data Availability

How

Query for rows on the last period

If missing inform the IT team else inform the user

Test type: Custom test

When

End of the ETL cycle

Every hour

4/6/2011 10

Test goal

Check and complete dimension missing keys with default values

Insure data integrity for join between fact tables and dimensions

#3 – RI Completeness

How

Find distinct values from fact where not exists in the dimension

Test type: Referential integrity

When

After loading fact tables

4/6/2011 11

Test goal

Verify cube data Vs. Data warehouse

#4 – Cube correctness

How

Compare last period in cube Vs Dwh\sources queries

Test type: Check Sum

When

End of the ETL cycle

4/6/2011 12

Test goal

Tests dependencies

Execute in parallel

Drill to the row level

#5 – Execution Flow

How

Add your tests to the execution flow test and define the dependencies

Test type: Execution flow and all other objects

When

End of the ETL cycle

4/6/2011 13

Compare values – changes over time

Tests history & versions

Advanced mail alerts

Environments (Test -> Production)

And more…

BI clients (Partial List)

14

Eden Springs Ltd is the IL market leader in the Water Cooler Industry and forms part of Eden Springs Europe, which has a presence in 13 other European countries.

Harel Group is the third largest insurance group in Israel. It is the second largest in general insurance; the market leader in health insurance, and from the perspective of premium volume, it is the third largest in life insurance.

013 NetVision is the leading company in the Israeli communication sector with a market share of 36% in International Telephony services. In addition, the company offers its customers a domestic calls service (VOIP).

NICE Systems (NASDAQ: NICE), is the worldwide leader of intent-based solutions that capture and analyze interactions and transactions, realize intent, and extract and leverage insights to deliver impact in real time.

A global company (NYSE: DOX) with revenue of $3.0 billion in fiscal 2010, Amdocs is the market leader in customer experience systems innovation with over 19,000 employees delivering the most advanced business support systems (BSS), operational support systems (OSS) and service delivery to innovative service providers in more than 60 countries around the world.

Start using Vision.bi Quality gates and get

Business alerts

Data integrity

Inform on data inconsistency

Cube validation

Summary

4/6/2011 15

4/7/2011 16

&

Thank You! For demo please contact Ram Yonish M - ryonish@tact.co.il P – 052-2424314

Yifat Vector M - yifatva@matrix.co.il P – 052-8651729

Recommended