Feeding Mash-ups with TDI 7 May 2007

© 2007 IBM Corporation

Reduce Complexity, Harness Diversity

Feeding Mash-ups with TDI7 May 2007

Eddie HartmanJohan VarnoTDI Development Team

© 2007 IBM CorporationPage 2


Tivoli Directory Integrator

Highlights

Using TDI as a general purpose mash-up & syndication integration server that provides RSS and Atom feeds based on data from multiple back-ends with custom transformation.




Agenda

Overview Situation Challenge Proposed approach

TDI fundamentals

Live demonstration




Overview

Situation RSS/Atom is a flexible data distribution/request mechanism. Furthermore, its

simplicity has fuelled the advent of mash-ups. Orchestrating the mash-ups and consuming RSS/Atom feeds is well underway

all across IBM.

Challenge Getting data into feeds or available as Web Services, although not complex in

itself, is not as simple in a scalable manner. This is largely due to the huge permutation of data sources and API’s where available information needs to be enriched, transformed and augmented before being driven into an RSS or Atom feed.

Proposal TDI provides a general-purpose integration service for hosting feeds. The

content of these feeds is provided by back-end ‘service AssemblyLines’ that use TDI Connectors to access data sources, manipulate retrieved data and create the RSS/Atom payload.

–these service AssemblyLines can also be published as Web Services.




Pooling, threads & tombstones

JavaScript Engine

TDI architecture

Files

LDAP

JDBC

Web Services

HTTP, TCPGLA, RAC

AssemblyLine

Execution run-time environment

Logging & tracing

Event service

Delta detection

Functions & libraries

Java VM

TDI server

XML, CSV

Windows, Linux, AIX, iSeries, zOS, Sun, HP

ACT event processing

SNMP, JMX

CCMDB, CEI

Persistence service: SystemStore SystemQueue

Commandline interface

Web administration and monitoring

Action Manager: Automatic monitor, control, and alternate action

Integrated development environment

SAP, Siebel Peoplesoft

JMS / MQ

LDIF, DMSL

POP, IMAP

Script, Java

Domino

API




AssemblyLine pipelineAutomated behaviors and flow logic reduce the work needed to build secure, enterprise-ready integration solutions. These internal workflows can easily be modified and extended.

In addition, each AssemblyLine is a custom dataflow pipeline that is built quickly and visually using the TDI editor GUI.




TDI: Mashup & syndication integration serverTDI

HTTP (Web Service)

service connector

Service AssemblyLines

Incoming RSS or Atom (or Web Service)request

Any number of ”service AssemblyLines” can provide services that may be accessed through the multi-threaded ”Service controller”. Each Service AL leverages the connectors and capabilitites of TDI to create advanced feeds and services that provide transformation, augmentation, enrichment of the data from any number of connected sources.

JDBC connector

AssemblyLine ”service Controller”

connector

Custom logic, such as registration and provisioning of services

RDBMS

LDAP connector

JMS connector

”any” connector OMP




Demonstration OverviewTDI

HTTP

Incoming RSS or Atom request

The service AssemblyLine to use is specified as a parameter in the RSS URL (http://myrssfeed/rss?AL=People) making the solution easily extendable.

For Atom, you replace ”/rss” with ”/atom” and conversion is handled automatically.

'Feed Server' AL

connector

Dispatcher fordelegating work toservice AssemblyLines

'People' AL

JDBC connector

LDAP connector

Data filtering logic

Build and reply with RSS feed XML based on returned data.

'Changes' AL

Domino Changeconnector

Data filtering logic

Reads from a database table, joining more attributes from an LDAP server and

filtering out invalid data

Picks up changes to Person documents in Domino that occurred since the last time this

info was requested.

’Mail’ AL

LDAP connector

Data filtering logicReturns LDAP entries

found using the specified mail filter




Demo




REST ”mashup” server with TDITDI

HTTP connector HTTP connector

AssemblyLine ”REST server”

Incoming REST callhttp://<server>/events?keywords=music&location=Austin&date=Future

TDI returns Keyhole Markup Language for use in

Provided location (”Austin”), event type (”music”) and date (”future”) in a URL, this REST server will return suitable events from EVDB, augmented with content from Google, formatted in KML format for viewing with Google Earth.

Google connector

For each EVDB event returned

Create KML and add to return payload

Get events from EVDB

Get content on each event from Google




What is TDI?

TDI is an integration framework Graphical Development Environment to build and test solutions Run-time Server for deployment Web-based Administration and Monitoring Console for management (AMC) Java API & Commandline utility for automation and embedding

Represents a unique rapid integration development methodology

Provides unparalleled control over data flow and transformation

Remote (over IP) development and test from your laptop

Supported on most major platforms, including iSeries and z/OS.




Evolution of Infrastructure

TDI Approach Build & extend integration incrementally Phase in (and out) systems in controlled stages Enable & leverage standards

Solution Framework & Trench Tool Accelerating POCs/POTs Deploying software -

data migration, validation, washing and conversion Extending the reach of installed systems Augmenting monitoring (e.g. log scraping, polling APIs/sockets, ...)

Creating new data services




TDI bundled with IBM products (partial list)

Lotus Domino 8 & Lotus Connections

WebSphere RFID Information Center

Tivoli Identity Manager (Enterprise & Express)

CCMDB & TADDM

Tivoli Access Manager (TAMeb)

Tivoli Directory Server

Federated Identity Manager




Community Resources

Community websites Examples, video tutorials, reusable assets, documentation

http://www.tdi-users.org

(IBM internal) https://w3.webahead.ibm.com/w3ki/display/TDI Mailing list (news, updates, events)

Newsgroups TDI Newsgroup

news://news.software.ibm.com/ibm.software.network.directory-integrator IBM internal newsgroup

news://ibmforums.ibm.com/s.directory

!! Participate and Share !!




End

Documents

Feeding Mash-ups with TDI 7 May 2007