Click here to load reader
Upload
victoria-powell
View
233
Download
5
Tags:
Embed Size (px)
Citation preview
C5: Introduction to DataXtend® Semantic Integrator (DX SI)
Dean ElliottClient Solutions Manager
© 2008 Progress Software Corporation2
Agenda
Data challenges in integration solutions
DX SI enables the data layer in integration
DX SI Lifecycle
DX SI Demonstration
© 2008 Progress Software Corporation3
Traditional approaches to data integration
Message Oriented Middleware
Inventory TT
ProvisioningBillingCMR1 CRM2
CallCenter
DataW/house
TT
ProvisioningBilling
Inventory
CRM1 CRM2
CallCenter
‘Integration Spaghetti’
DataW/house
© 2008 Progress Software Corporation4
Business Challenges resulting from traditional approaches to data integration
Message Oriented Middleware
Inventory TT
ProvisioningBillingCMR1 CRM2
CallCenter
DataW/house
TT
ProvisioningBilling
Inventory
CRM1 CRM2
CallCenter
‘Integration Spaghetti’
DataW/house
Business Challenges
Agility
Managing Change
Increasing complexity
Increasing maintenance costs
© 2008 Progress Software Corporation5
A new approach to data integration
ProvisioningBilling
Inventory
CRM1
TT
CRM2
CallCenter
DataW/house
‘Integration Spaghetti’ Messaged OrientedMiddleware
Inventory TT
ProvisioningBillingCRM1 CRM2
CallCenter
DataW/house
ESB and Semantic Data Integration
Provision-ingBilling
Inventory
CRM1
TT
CRM2
CallCenter
Common Data Model
A common data model enablestransformation of all interfaces to
a single semantic meaning.
© 2008 Progress Software Corporation6
Can’t We All Just Get Along?
No central management
Costly to modify
Not easily adapted to change
The Problem
Database 2
Database 1
Application 3
Application 2
Database 3
Translation
Translation
Application 1
TranslationTranslation
Translation
Translation
Translation
Translation
Translation
Tran
slatio
n
Tran
slat
ion
Translation
Translation
Translation
Translation
Translation
Tra
nsla
tion
Tra
nsla
tion
Translation
Tran
slatio
n
Tran
slatio
n
Translation Translation
TranslationTranslation
Translation
© 2008 Progress Software Corporation7
Model Driven Integration
Database 2
Database 1
Application 3
Application 2
Application 1
Database 3
Common Model
The Solution
DistributedTransformation
Engine
Centralized management
Rapid development and deployment
Lower TCO
© 2008 Progress Software Corporation8
Data has different meanings in different systems (semantics)• “age” means something different to an insurance
company issuing a premium than to a government agency issuing a driver’s permit
Many data transformations between systems are complex • XSLT is not enough
In SOA, everybody needs to know how to talk to everybody else!
Why DataXtend Semantic Integrator?
© 2008 Progress Software Corporation9
DataXtend Semantic Integrator
Common model architecturefor semantic mediation• Visual mapping of large,
complex integrations
Robust project life cycle support• Round-trip testing and impact analysis
Flexible, distributed deployment options• Web services, ESB, app server, or Java
container
Address the accidental architecture of data
Customer Care
Products
Customers
Provisioning
Services
TM Forum SID
Invoicing
© 2008 Progress Software Corporation10
Challenges of Common Model Integration
A good Common Model should be• Comprehensive
• Abstract
• Extensible
But… a comprehensive, abstract model is• Large
• Complex for simple things
• Hard to maintain
DataXtend SI addresses these issues
© 2008 Progress Software Corporation11
Industry Standard Common Data Models
P&C Insurance (ACORD P&C) Health Care Payers and Providers (HL7) Financial Derivatives (FpML) Telecommunication (TMF SID) Horizontal (OAGIS) Retail (ARTS) Mortgage Banking (MISMO) Utilities (IEC 61968) Life Insurance (ACORD Life) Financial Services Messages (ISO20022) B2B Supply Chain (RosettaNet, GS1/EAN)
© 2008 Progress Software Corporation12
Agenda
Data challenges in integration solutions
DXSI enables the data layer in integration
DXSI in the Systems Development Lifecycle
Summary
© 2008 Progress Software Corporation13
Progress® DataXtend SI
ENTERPRISE SERVICE BUS
NMS Inventory OMS Billing CRM
System Integration Layer- Infrastructure Abstraction
Common Data Model
CustomerProduct
ResourcePartner
Common
Market
ServiceData Interoperability Layer
- Semantic Abstraction
Business Process Layer- Process Abstraction
BPM BAM
- Enables the data layer in Integration
BPM Layer
ESB/EAI Layer
Progress DataXtend SI
Utilizes a
Common Model Semantic
Brokering Model based
Mappings Visual Round-
Trip Testing 360º End-to-End
Impact Analysis Governance
Change and
Lifecycle
Management
© 2008 Progress Software Corporation14
Visual tool for designing integration
Stateless for scalability
Runs in any Java container
Connects to any bus
DataXtend SI Product Capabilities
Runs in Eclipse
DISTRIBUTEDRUNTIME
CENTRALIZEDDESIGN
GenerateDeploy
TESTING
© 2008 Progress Software Corporation15
Agenda
Data challenges in integration solutions
DXSI enables the data layer in integration
DXSI in the Systems Development Lifecycle
Summary
© 2008 Progress Software Corporation16
RuntimeAutomate
rules execution
Audit and Validateevery exchange
Lifecycle ManagementManage rules, aggregations
and maps over time
Design Time Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Change integrations of adaptive infrastructure with build-in change management facilities
The DataXtend SI Lifecycle
© 2008 Progress Software Corporation17
DataXtend Exchange Model
Import directly from a database
(default validation rules to enforce constraints)
Import directly from XML
Import directly from a WSDL
Import directly from a UML
1080 Classes5000 Classes1000 Classes1020 Classes
Your OwnModel!
Semantic Mappings:Validate DataMatch incompatible dataFlag Data ErrorsConditionally Map
© 2008 Progress Software Corporation18
DataXtend Common Model Navigator
ComponentViewDetail about the component in tabular form: attributes, types, classes, collections and relationships
Graph ViewShows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships
Tree ViewAllows you to navigate through the containment hierarchy of the component.
© 2008 Progress Software Corporation19
Computed AttributesSimplify Common Models for Ease of Use
Contact
Mobile
Type = Home
Type = Work
Type = Mobile
TelephoneCustomer
Centralized design
Virtual attributes simplify models
without deviating from the standard
© 2008 Progress Software Corporation20
DataXtend Mapping and Rule Designer
All assets are visually mapped to and from the common model
Even complex expressions are
designed without coding
© 2008 Progress Software Corporation21
DataXtend Tester
© 2008 Progress Software Corporation22
Deployment Options: Distributed Execution
The DXSI Runtime is stateless and each executes independently
There is no central hub to limit performance or single point of failure
Multiple deployment
options can be used simultaneously
Source Application
DXSI Runtime Influences Message Content, Not Transport Architecture
App Server
DXSI Data Services
Target System
Target System
DXSI
Adaptor
DXSI Assembly
© 2008 Progress Software Corporation23
DXSI Exchange Model Packaging
DXSI services can be wrapped with a variety of code generators to provide easily deployed, high performance packages for many platforms including:• Sonic ESB Itineraries• Websphere SCA / SDO • WebLogic 8 and 9 XMLBeans• WAR, EAR, EJB etc.
Packagers are designed to leverage the infrastructure and tools of the chosen platform
© 2008 Progress Software Corporation24
DataXtend Deployment1: Creating the DX SI service interfaces
Interface wrappers Simplify access to DX SI service interface Build-in to DX SI
IBM SDOs Sonic™ ESB BEA Beehive JMS Java™ Beans EJB Sessions
Create one or more wrappers for every data service
DX SI
Java Runtime
No wrappers. DX SI Java interface is used
Can run standalone orpackaged
build
build
© 2008 Progress Software Corporation25
DataXtend Deployment2: Packaging
Application and Service packagers
Fully deployable solution generated Build-in packagers to DX SI
Web service, EJB, EAR Supported platforms: JBOSS, IBM, BEA, Oracle®
DX SI
Java Runtime
1. Define wrappers
2. Build
3rd Party IDE
Examples: Sonic Workbench IBM WID BEA Workshop
Application Server BPM Server ESB
3. Package & Deploy
3. Package
© 2008 Progress Software Corporation26
RuntimeAutomate
rules execution
Audit and Validateevery exchange
Lifecycle ManagementManage rules, aggregations
and maps over time
Design Time Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Change integrations of adaptive infrastructure with build-in change management facilities
The DataXtend SI Lifecycle
© 2008 Progress Software Corporation27
DataXtend SI Runtime
DataXtend SI Engine runtime process:1. Input data is mapped to the Common Model
2.Common Model is enriched with extra data if required
3.Data is mapped from Common Model to Data Source (writing)
4.Results are mapped back to the Common Model and Data Services
Rules engine automates validation of the data at all stages
Runtime report is available detailing all issues
© 2008 Progress Software Corporation28
ESB Solution without DataXtend SI
Goal:• To provide an aggregated
view of a customer’s accounts
Issues• Solution assumes all data
is equivalent i.e. canonical and on the same version, for message and data
• No controls to map data types
– E,g. TVAccounts – maps Mr as ‘0’
– Wireless maps Mr as ‘A’
– To solve requires multiple transformation svcs
• Possibly 10 XForm and Enrichment steps
© 2008 Progress Software Corporation29
DataXtend SI and ESB
ESB and DX SI• Intermediate services replaced by DX SI• DX SI handles Data and Message layout impedance
– Using XML based invocation framework similar to WS
• 11 Intermediate services to 1
© 2008 Progress Software Corporation30
RuntimeAutomate
rules execution
Audit and Validateevery exchange
Lifecycle ManagementManage rules, aggregations
and maps over time
Design Time Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Change integrations of adaptive infrastructure with build-in change management facilities
The DataXtend SI Lifecycle
© 2008 Progress Software Corporation31
DataXtend SI Lifecycle Management Features
Impact Analysis view and report: Identify interdependencies in a project. An Impact Analysis report provides a snapshot of
an element's current state for future reference.
Comparison of exchange model elements: Provides an interface for comparing elements in the
same project or in different projects.
Synchronize model changes: Allows you to selectively accept changes from one
exchange model into another.
© 2008 Progress Software Corporation32
Select the DataXtend Impact Analysis tab with an entity selected
The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor
You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity
DataXtend SI Impact Analysis
© 2008 Progress Software Corporation33
Use the Compare Editor to compare: • Entities in the same or in different projects• Two files in the same projectThis example shows how to compare two files in the same project.
DataXtend SI Compare Editor
Changes are highlighted in the Compare Editor
© 2008 Progress Software Corporation34
You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).
You can also use project synchronization to create a new project based on another, exported one.
Synchronizing Model Changes
© 2008 Progress Software Corporation35
Agenda
Data challenges in integration solutions
DXSI enables the data layer in integration
DXSI Lifecycle
Summary
© 2008 Progress Software Corporation36
SummaryDX SI Differentiator vs. Traditional Mappers
Comparison with traditional point-to-point message mapping tools
© 2008 Progress Software Corporation37
What if…?
What if… you could accurately turn around change impact assessments in hours rather than days?
What if… you could radically increase systems agility and responsiveness to business requests through a loosely coupled architecture?
What if… you could significantly reduce maintenance costs (through re-use, consistency, reduction in custom code, end-to-end visibility of data, and leverage of open inter-operable standards)
© 2008 Progress Software Corporation38
In Summary
DataXtend SI reduces costs to create and maintain data transformation
DataXtend SI utilizes and enables a common model approach
DataXtend SI deploy as a service
© 2008 Progress Software Corporation39
For More Information, go to…
PSDN• DataXtend SI Product Center
• Documentation
Progress.com• DataXtend SI Home Page
• DataXtend SID Model Browser
© 2008 Progress Software Corporation40
Relevant PTW Sessions
C4: Common Applications of Sonic ESB
C8: Enterprise Integration Patterns in Sonic ESB
C9: SOA Management with Actional for Sonic live at work
© 2008 Progress Software Corporation41
Questions?
© 2008 Progress Software Corporation42
Thank You
© 2008 Progress Software Corporation43