14
datagaps The data testing company Dynamic Data Model Overview

ETL Validator: Creating Data Model

Embed Size (px)

Citation preview

Page 1: ETL Validator: Creating Data Model

<Insert Picture Here>

datagapsThe data testing company

Dynamic Data Model Overview

Page 2: ETL Validator: Creating Data Model

Typical Data Warehousing Life Cycle

Plan Design Develop Test Operate

Initiate End

End User

Interviews

Data Profile

Specification

Data

Sources

Sample

Reports &

Concurrency

ETL

Mappings

Schema

Mappings

Warehouse

Data

Dictionary

Technical

Architecture

Facts &

Dimensions

Data Testing

ETL Process

Reports &

Analytics

Performance

& Scalability

Defects

Manage

Growth

Continuous

Integration

EnhancementsReports

Leverage the data model across all phases of the DW Life Cycle

Page 3: ETL Validator: Creating Data Model

Objective

• As a QA Engineer, I should be able to build/leverage an

existing data model for the following:

• Query Construction

• Testing Referential Integrity

• Identifying noise in the data warehouse

Page 4: ETL Validator: Creating Data Model

This Deck

• The following slides explain how a data entity model

can be designed in ETL Validator so that the

aforementioned use cases can be reused over time

Page 5: ETL Validator: Creating Data Model

Upon Login, system displays the

Home Page

Page 6: ETL Validator: Creating Data Model

Select an existing connection in the

DB Explorer, right click and click on

the “Add Data Model”

Page 7: ETL Validator: Creating Data Model

ETL Validator a listing of all the tables

in the selected connection/schema •Click on

Create

Page 8: ETL Validator: Creating Data Model

Search for tables of interest and select

them by clicking on the checkboxes.

Then click on OK.. This will enable you

to specify the join conditions bet

Page 9: ETL Validator: Creating Data Model

Select a table and click on “Add”

button on the right side.

Page 10: ETL Validator: Creating Data Model

You can pick another table (Table

2) from the pick list

1 2

3

4

Pick a table from the left side

You can select the attributes for the

join conditions and operators

Click on Add Condition

CHANNEL_ID

CHANNEL_ID

Page 11: ETL Validator: Creating Data Model

The recently added condition

should show up here

Page 12: ETL Validator: Creating Data Model

I specified a number of join conditions. Where

are these used?

Page 13: ETL Validator: Creating Data Model

Usage

• Query Builder

• The queries can be constrained by the filter

conditions

• Referential Integrity Test Plan

• This test plan can automatically identify the records

which do not have valid parents

Page 14: ETL Validator: Creating Data Model

More Resources

•http://www.datagaps.com

•http://youtube.com/datagaps

•http://www.twitter.com/datagaps