WTX Overview

8/3/2019 WTX Overview

1/45

WebSphere Transformation Extender(Mercator)

Rajesh MamidiVenkata BrundavanamDate: 11/27/2006


2/45

2

Agenda

Agenda

EAI

What is WTX (Mercator)

WTX Design Studio Type Designer

Database Interface Designer

Map Designer

Integration Flow Designer

Command Server

Event Server


3/45

3

SMTP

FlatFiles

ODBCDatabase

VANsEDIFACTX12

FTP

ERP

Legacy

Enterprise Integration

CRM


4/45

4



5/45

5

Enterprise Application Integration

Enterprise Application Integration is the process of coordinating theoperations of various applications across an enterprise.

EAI solutions offer the following features:

Reduced development and maintenance cost.

Enhanced performance and reliability

Extension of legacy system lifecycle



6/45

6

WebSphere TXis a unique data integration technology

for use in Application to Applicationand Business to Business enablement.

A powerful data transformation engine that natively across the enterprise operatingenvironments that has the ability to speak directly to native interfaces and APIs without

the need for coding or re-tooling.

What is WebSphere Transformation Extender (Mercator)?


7/45

7

The Benefits of Websphere Transformation Extender

Automated processes for integration of data with transactional and operationalsystems

Automated decisions on routing basedon content of messages, eliminatingcostly and time- consuming hand coding

High interoperability within a Service-Oriented Architecture to leverageexisting and future IT enhancements

Compliance with industry andgovernment standards and regulationsgoverning data transfer and integration(EDI, ACORD, AL3, HIPAA, SWIFT)

Legacy-to-AnythingIntegration

Enhanced visibility enablessingle view of key data within

front- and back-officeapplications/systems

EDI-to-AnythingIntegration

Enhanced data connectivitysimplifies the complex andspeeds B2B implementations

Transformation &Routing

Enhanced synchronizationprovides real-time validation

and transformation


8/45

8

Web Services Enablement

Expose legacy applications containing key dataelements

Use a common methodology for interactionacross apps, data, processes

Leverage mainframe power with Web-basedtechnologies

Automated, complex data transformation androuting across many points of integration

Integrated tools and environment for completeenterprise data integration

Enterprise-wide interoperability supported by anSOA

MAPApplication

Database

File

Application

Database

File

SOAEdition

WebService

WebService

TypeTree

IBM WebSphere DataStage TX Map

Enterprise Data Integration Requirements IBM Websphere DataStage TX Value


9/45

9

What is Mercator?


10/45

10

TYPE DESIGNERMAP DESIGNER

COMMAND SERVER

EVENT SERVER

INTEGRATION FLOW DESIGNER

DATABASE INTERFACE DESIGNER

WebSphere TX (Mercator) Components


11/45

11

Design Studio

Platform-specific transformation engines for production environmentAdapters to integrate with specific types of data sources and targets

DatabasesMessaging systemsPackaged applicationsBusiness integration utilities

ClientDevelopment System

ServerProduction System

Integration Flow Designer to model andmanage transformation workflows

Type Designer to define and import dataobjects

Database Interface Designer togenerate data definitions from metadataimported from database

Map Designer to define datatransformation and routing rules

Transformation engines to develop, testand run transformations in developmentenvironment

WebSphere TX (Mercator) Components


12/45

12

Modeling the Transformation Process

Flow Events

Timing

Analyze and Define the Data

Interfaces Resources

Apply Integration Rules to Models

Deploy and Manage Processes

Properties

Structure Validation rules

Structure Formats Semantics

Communication Storage Services

Type Designer

Database Interface

Designer

Map Designer

Integration FlowDesigner


13/45

13

TYPE DESIGNER

Type Designer


14/45

14

What is Type Tree?

A type tree is a data dictionary that defines how types areclassified.

A type tree describes:

Syntax

Structure

Semantics

Type Designer


15/45

15

Specify, define and manage Type Trees.

Maintain Type Trees

Properties of data Structure

Data Validation Rules

Different Character Sets

Type Designer


16/45

16

File

RecordRecord

Record

ComplexSimple

ComplexComplexComplexSimpleSimpleSimple D

a t a

I t e m s

(Input and Output)

Step 1

Step 2

Step 3

Type Designer


17/45

17

Type Designer

For modeling data objectsStructure/containment of data

Syntax propertiesSemantic validation rules

Graphically design in aType TreeImport or use industry datadefinitions


18/45


19/45

19

Building In Additional Validation

Additional validation can be added to check if data, once isolated,matches specific data value or set of values

Use restriction lists to limititem to particular valueor set of values

Use restriction lists to limititem to particular valueor set of values

Use component rules tospecify condition(s) that must

be met for a particularcomponent to be valid

Use component rules tospecify condition(s) that must

be met for a particularcomponent to be valid


20/45

20

DATABASE INRERFACE DESIGNER

Database Designer


21/45

21

Database Interface Designer

Specify databases to use for data source or target

Define query statements

Generate type trees for tables/views, queries, and storedprocedures by importing metadata from RDBMS

Identify additional tree definition, mapping andexecution requirements


22/45

22

Imports metadata about

Queries

Tables

Stored procedures

Database connectivity is supported under the control of Relational Database Management Systems (RDBMS).

Database Designer


23/45

23

Generating Type Trees from Databases

Type TreeQuery

Database

Type TreeStored Procedure

Database

Type TreeTable/View

Database

2-23


24/45

24

Database Designer


25/45

25

MAP DESIGNER

Map Designer


26/45

26

Map Designer

Create maps to:Validate data from data sourcesIdentify data targetsSpecify data transformation logic (rules)


27/45

27

The Map Designer is used to:

Create maps to specify the logic necessary to transform theinput data to the desired output data.

Identify the source and data objects of the input data.

Identify the target and data objects of the output data. Specify and build the output data according to the map rules.

Provide information about data validation by generating trace files.

View the run results of the map execution.

Map Designer


28/45

28

FromWindowFrom

Window

NavigatorNavigator ToWindow

ToWindow

Rule barRule barMap nameMap name

Map source file nameMap source file name

Rule columnRule column

CardsCards

Map Designer


29/45

29

How DataStage TX Engine Works

1. Validates input data against typetree starting with Input card #1

2. Applies map rules starting withOutput card #1

Input card #1

Input card #2

Output card #1

Output card #2


30/45

30

Map Designer


31/45

31

Around 100 Functions Most can be used both

in Component Rules aswell as Mapping Rules

Component Rules evaluate to True or FalseMapping Rules evaluate to some value

Functions - Rules


32/45

32

INTEGRATION FLOW DESIGNER



33/45

33

The integration flow designer (IFD) is a component of theMercator design studio that provides a graphical interface

to combine collection of maps and run them as a singleunit

There are three stages of Using the IFD :

Defining Systems

Verifying Component Relationships

Preparing Systems to Run



34/45

34

Define systems that graphically and logicallyorganize transformation workflows into logicalcollections based on requirements

Generate system control information from

system definitions for real-time processing

Define systems that graphically and logicallyorganize transformation workflows into logicalcollections based on requirements

Generate system control information from

system definitions for real-time processing



35/45

35

What is a System?

A system is:A set of logically related maps

Assigned to a server on which it will runRun by WTX transformation servers

A system can include:Components that

reference mapsComponents that referenceother systems


36/45

36

TRANSFORMATION ENGINES

Event & Command Server


37/45

37

WebSphere DataStage TX Transformation Engines

Command ServerCan be run on variety of

platforms and operatingsystemsPlatform-specificRuns one map at a time

Event Server/LauncherCan be run on variety

of platforms and operatingsystemsPlatform-specificManages execution of systems of maps based ontriggers

Message eventsTime eventsFile state changes

Database triggers


38/45

38

Command Server is used to execute maps

Command Server


39/45

39

Command Server

Command Server Output


40/45

40

The Event Server automates the execution of maps.

The Event Server runs systems of maps that are created andgenerated using the Integration Flow Designer (IFD).

These systems of maps that are generated specifically to runin the Event Server are called Event Server system filessometimes referred to as Event Server control files.

Event Server


41/45


42/45

42

Event Server


43/45

43

WebSphere DataStage TX Administrative Tools

Event Server Administration allows configuration of secure accessrights to monitor and control Event Servers and the DataStage TXsystems they are running

Management Console allows user to view and control the status of transformation workflows running with the Event Server

Event Server Monitor gives detailed information about maps runningwith Event Server

Snapshot Viewer enables analysis of snapshots of Event Serveractivity

Resource Registry defines resource name aliases for data sources andtargets


44/45

44

Event Server Monitor

Red line indicatesmap failure

Red line indicatesmap failure

Yellow line indicatesmap warning

Yellow line indicatesmap warning

Vertical gridtime intervalVertical gridtime interval

Green line indicatesmap success

Green line indicatesmap success

Server nameServer name

Name of watchName of watch


45/45

45

Merci

Grazie

Gracias

Obrigado

Danke

Japanese

French

Russian

German

Italian

Spanish

Brazilian Portuguese

Arabic

Traditional Chinese

Simplified Chinese

Thai

Thank You

Documents

WTX Overview