SOA and System i - IBM · SOA and System i Modernize and introduce flexibility into your applications IBM Systems and Technology Group Technical Day Paris, November 6th 2008. IBM

IBM Europe System and Technology Group Lab ServicesEuropean Business Solution Center, La Gaude

© 2008 IBM Corporation

Jérôme TARTE - Senior IT Architect IBM Europe STG Lab ServicesEuropean Business Solution Center, La Gaude

SOA and System iModernize and introduce flexibility into your applications

IBM Systems and Technology Group Technical DayParis, November 6th 2008


© 2008 IBM CorporationIBM STG Technical Day November 6th 2008-Jérôme Tarte | EBSC INNOVATION@work

innovation

solutions

partnership

System i

System p

System x

System z

System Storage

Infrastructure Solutions

e1350

IT Optimization

Data Center Services

Worldwide STG Lab Services Delivery Teams: a global team

Rochester, MNPOWER Systems,Business Systems,


Rochester, MNPOWER Systems,Business Systems,


Beaverton, OR

Kirkland, WA

System x

Beaverton, OR

Kirkland, WA

System x

West, Central, East

Scorpion, Solutions

West, Central, East

Scorpion, Solutions

Poughkeepsie, NY

System zData Center Services

Poughkeepsie, NY

System zData Center Services

Tucson, AZSystem Storage

Tucson, AZSystem Storage

Austin, TXPOWER Systems

Austin, TXPOWER Systems

RTP, NCSystem x

System Cluster 1350

System Storage

RTP, NCSystem x

System Cluster 1350

System Storage

LaGaude, FranceSystems

LaGaude, FranceSystems

Mainz, Germany

System Storage

Mainz, Germany

System Storage

Bangalore, India

POWER SystemsSystem z

System Storage

Bangalore, India

POWER SystemsSystem z

System Storage

Beijing, China

POWER SystemsSystem xSystem z

System Storage

Beijing, China

POWER SystemsSystem xSystem z

System Storage

Taiwan, TaipeiSingapore

Business SystemsPOWER Systems

System xSystem z

System Storage

Taiwan, TaipeiSingapore

Business SystemsPOWER Systems

System xSystem z

System Storage

Our mission : Accelerate acceptance of STG products and

solutions by providing support for emerging and mature technologies

Our 400 consultants reside in these centers as well as other cities around the world



The Reality

Complex application dependencies Job, Transaction, File, Database

Program, package, EJB, Web service

Application, Site, EnterpriseDependencies increasingly cross technologies and environments in composite applications

i5/OS, DistributedApplication assets stored

in many formats and in different locations

SomeBank application dependency graph217 applications, 1,700 unique

application-application pairs

Complexity increases the cost, risk, and fear of making application changes

Composite applications add new dimensions of complexity and risk

SomeBank application dependency graph217 applications, 1,700 unique

application-application pairs

This is the one we want

to change



… a service?

A repeatable business task – e.g., check customer credit;

open new account

What is …..?

… service orientation?

A way of integrating your business as linked

servicesand the outcomes that

they bring

… service oriented architecture (SOA)?

An IT architectural style that supports service orientation

… a composite application?

A set of related & integrated services that

support a business process built on an SOA



Aligning business with IT

Business processes

IT processes

Business design IT design

Reusing existing assets is key

Existing IT Assets

Business Need Necessary Functions & Services Composite Application(s)

1. Decompose the business need into its necessary functions and services

2. Reuse existing IT assets by exposing them to the SOA as services

3. Create new business logic as necessary and integrate with newly exposed “existing IT”services

1 3

2



The Value of System i in an SOA

Reuse current, proven business processes & the applications thatenable them“Usual i benefits” including …

Qualities of Service, Manageability, Performance, SecurityIntegrates apps on i5 and other platforms

Equally accessible to developers – the implementing technology not an issue

those writing business process flows don’t need to be mainframe specialists

new application development decisions become a matter of “best fit for purpose”– required SLA, cost to develop, administer, run, etc.

Faster & cheaper to reuse than rewrite



App

s &

In

fo A

sset

s

Business Innovation & Optimization Services

Dev

elop

men

tSe

rvic

es Interaction Services Process Services Information Services

Partner Services Business App Services Access Services

ESB

IT S

ervi

ceM

anag

emen

t

Infrastructure Services

Provide for better decision-making with real-time business information

Enables collaboration between people,

processes & information

Orchestrate and automate business

processes

Manages diverse data and content in a

unified manner

Integrated environment

for design and creation of solution

assets

Manage and secure services,

applications &

resourcesConnect with trading

partners

Build on a robust, scaleable, and secure services environment

Enable inter-connectivity between services

Facilitate interactions with existing information and application assets

Optimizes throughput, availability and performance

The IBM SOA Reference Architecture



SOA Roadmap on System i5

Step 1Isolate Application

Function

Step 1Isolate Application

Function

Step 2Expose Elements of Business Processes

as Services

Step 2Expose Elements of Business Processes

as Services

Step 3Connecting

Applications & Services

Step 3Connecting

Applications & Services

Step 4Integrating and

Managing Services

Step 4Integrating and

Managing Services

MVC Modernization No Time to Modernize, Use HATS and WDHT

generate web servicesXML Toolkit for iSeries to consume web services

ESB

Services OrchestrationBusiness Monitoring



Service Enabling System i Applications and Data - I

No modification to existing applications and data

Service enabling i5/OS interactive applicationsHost Access Transformation Service (WDHT)

– SynchronousData Queues / WMQ Queues (Toolbox for Java)

– Asynchronous

Web service enabling DB2 UDB for i5/OS resourcesJDBC Drivers (Toolbox for Java)

– SQL– Stored Procedures

DADx Service Data Objects (SDO)



Service Enabling Interactive Applications

Host Access Transformation Services (HATS)Requirements

Applications driven using macro

Single request / response modelLimitations

Not suitable for complex transactions– Multiple request / response model

May not be a highly scalable solution



Web Service

Using Data Queue/MQ Queue to Create a Service Provider

Example of using a Data/WMQ Queue to create web service1. Web Service Client Sends SOAP request to Web Service, Web Service calls Java Bean2. Java Bean writes a message to a “Request” Queue3. RPG Application picks up a message from the “Request” Queue4. RPG Application processes the message put an entry on the “Response” queue5. Java Bean picks up the message from “Response” queue and results are returned through a web service

RPG /COBOL Java Application

Web ServiceClient

3 2 1

54

RequestData/MQ Queue

ResponseData/MQ Queue

Internet /

Intranet



Web Service

Using SQL to Create a Service Provider

Example of using SQL to create a web service1. Web Service Client Sends SOAP request to Web Service, Web Service calls

Java Bean2. Java Bean invokes SQL statement which uses JDBC Driver to retrieve

information from database3. Database returns a result set (Output data)4. Web Service returns the SOAP message with output data

Java Bean

Web ServiceClient

3

21

4

DB2 SQL Statement Internet /

Intranet



Service Enabling System i Applications and Data - II

Creating Modular Applications

Create Service ProviderWeb Service Wizard

Creating Java WrapperIBM Toolbox for Java

– Program Call Bean Wizard– Web Interaction Wizard– System i application java integration toolkit



Modernization of Applications and Data

RPG IV, ILE COBOL or ILE CL

Print

User Interface DB

LogicRPG III, COBOL/400 or CL/400

DB constraints

DB triggers

Stored ProceduresGraphical

InterfaceBrowser Interface

ILE Srvpgm

Java BeanJava Bean1. Move to modern compilers2. Modularize the code using

ILE3. Replace components as

business dictates



Modular Applications

Good Module

A routine that does one “logical function and does it wellClearly stated and well-named

Should be like a “black box”You know what goes in and what comes outWhat happens inside?

Only the programmer of that module need know or careIt is usually reusable

Generic functionData input and output is clearly “parameterized”

Modules may (and usually do) use other modulesLayered structure

Is independent from its callerDefines and uses its own data

May share data with related modulesChanges to functions or data do not impact callers



Integrated Web Services Gateway

Provide the best SOA ‘Web Services’runtime possible

Provide option that doesn’t require new skills / tools to ILE programmers

Address issues with Rational development tools for i5/OS developers

–Workstation memory requirements–Install / configuration –Learning new wizards / concepts

Address issues with WAS runtime–Install, update and startup issues–Administration skills required

D custData DS D custNo 5p 0D custName 32aD street 32aD city 24aD state 2aD zip 5p 0D zipPlus 4p 0D salesRep 4aD printData1 DS QualifiedD custName 40aD custNo 5s 0 D division 2aD salesRep 4aC Eval printData1.custNo = custNoC Eval printData1.custName = custnameC Eval printData1.salesrep = salesRepC Eval-Corr printData1 = custData

Web Service Consumer

Web

Web Services Server

D custData DS D custNo 5p 0D custName 32aD street 32aD city 24aD state 2aD zip 5p 0D zipPlus 4p 0D salesRep 4aD printData1 DS QualifiedD custName 40aD custNo 5s 0 D division 2aD salesRep 4aC Eval printData1.custNo = custNoC Eval printData1.custName = custnameC Eval printData1.salesrep = salesRepC Eval-Corr printData1 = custData

Web Service Consumer

Web

Web Services Server



Web Service

Using PCML or Program Call to Create a Service Provider

Example of using a PCML or Program call to create web service1. Web Service Client Sends SOAP request to Web Service, Web Service calls Program Call Bean (Java

Bean)2. Java Bean invokes RPG/COBOL module using program call or program call using PCML3. RPG Application executes and gives output back to Java Bean4. Web Service returns the SOAP message with output parameters

RPG /COBOL

SRVPGM

Program CallBean

(Java Bean)

Web ServiceClient

3

21

4

Internet / Intranet



System i application java integration toolkit

Integrate System i program (PCML) into UML model

Provide PCML Java integration pattern

Generate Java code

Extends IBM Rational Software Architect v7.0Stereotype

Pattern

Java transformation

UML->PCML and PCML->UML transformation

Accelerate design and development of J2EE system i application

PCMLPCMLPCML

PCMLPCMLJava

Uml model Uml Java model

export

import

Apply pattern

Java transformation

create



Services Clients

Web service invocation steps1.Create a SOAP message: service location, procedure name, input parameters (or simply XML document)

2.Send the SOAP message

3.Process the response SOAP message: output parameters

Web service client does not use a SOAP server, just APIs to construct a SOAP message



Services Client: System i ApplicationsExample of using a Data/WMQ Queue for a Web Services call

1. An RPG program writes a message to a “Request” Queue

2. Java Web Service Proxy picks up a message from the “Request” Queue

3. Java Web Service Proxy performs a Web service call

4. After results are returned, Java Web Service Proxy writes a message to a “Response”Queue

5. RPG program gets Web service call results from the “Response” Queue

RPG /COBOL

Java Web ServiceProxy Web Service

1 2 3

45

RequestData/MQ Queue

ResponseData/MQ Queue

Generated by toolingwith some manual coding

Internet /

Intranet



i5/OS

System i Native Web Service requester

Web Services C/C++ ClientOpen Source, Apache.org AXIS

Ported to OS/400 ILE

WSDL -> C++ or C Stub Generator

Direct invocation from ILERuns in the ILE Job

RPG C Stub C/C++ Proxy

JOB


JOB


JOB

Web ServicesSOAP/HTTP

XML Toolkit generated



Common Connectivity: Enterprise Service BusAn Enterprise Service Bus (ESB) is a flexible connectivity infrastructure for integrating applications and services.

An ESB powers your SOA by reducing the number, size, and complexity of interfaces.

Shape = ProtocolColor = Data type

An ESB performs the following between requestor and service

• CONVERTING transport protocols between requestor and service

• HANDLING business events from disparate sources

• TRANSFORMING message formats between requestor and service

• ROUTING messages between services



The ESB allows you to focus on your core business rather than your IT

TravelReservation

Process

FlightAvailability

Service

Enterprise Service Bus

NEW CheckTravelerService

Book HotelService

HotelAvailability

ServiceBook CarService

NEW FlightAvailability

Service

OLD FlightAvailability

Service

Book FlightService

Check CreditService

Change services with minimal impact to existing services

Add new services faster



ESB Mediation Component

Provide the Implementation of mediation “logic”

“flows” that operate on messages/events as they are processed by the systemOperate on both One-Way and Request-Response interactions

Pre-Supplied primitives allow flows to be visually composed

XSLT TransformationMessage LoggerMessage FilterFailStopDatabase LookupCustom (Java) ComponentCEI Emitter (Post GA)

MediationPrimitive

MediationPrimitive

MediationPrimitive

Request Flow

Response Flow



Business Process Management : Two Styles of Service Choreography

Business ProcessesTraditional Business Processes

Full support for WS-BPEL

Import from WebSphere Business ModelerWS-BPEL compliant business process engineSimplified Process Editor

Optional simplification of termsGeneric Business Process

Service Implementation Details hiddenTransactions / Compensation

Business State MachinesEvent-driven Business Processes

Full support for State Machine programming model– States, Events, Transitions, Actions, Guards, …– State Machine Authoring / Debugging / Logging

State MachineImplementation

Based on UML 2.0 State Machine Models

Event driven business processes

Creates WS-BPEL under the covers



Business Rules

Rule Group

Decision Table

Rule SetExternalize Business Logic from an application (business process)

Easy change of logic that may change

Dynamically Update Rules in Runtime on the fly through Web Interface

– NLS enabled free text representation for rules

Most-requested Business Rule FunctionalityDecision TablesRule Sets (If/Then Rules)Rule TemplatesAction Rules

Ease of UseRule Group: detailed implementation encapsulated in a component with a well defined interface



Monitoring Business Processes

Real Time Visibility into Business Performance

View performance and modify dashboards in real timeScorecard view of Key Performance IndicatorsTrack cost, time and resourcesIdentify bottlenecks, balance workloads, reduce latencies

Ability to intervene in deployed processesSet situational triggers and notificationsDynamically respond to these alerts

Supporting continuous process improvementMonitor in-flight business processesMake process modifications based upon

real-time data sent back to the Modeler for simulations



The SOA Lifecycle

Gather requirementsModel & SimulateDesign

DiscoverConstruct & TestCompose

Manage applications & servicesManage identity & complianceMonitor business metrics

Financial transparencyBusiness/IT alignmentProcess control

IntegratePeopleProcessInformation



SOA Foundation – Complete Lifecycle

New! IBM SOA Foundation: http://www.ibm.com/soaWebSphere Integration Developer

Easy-to-use integration to simplify and speed the assembly of composite applications

http://www.ibm.com/software/integration/wid/

WebSphere Process Server

Flexible deployment of business processes,

making plug-and-play of components a reality

http://www.ibm.com/software/integration/wps/

WebSphere Business Modeler

Simple to use process modeling for the business analyst to help maximize process and business

resource re-use

http://www.ibm.com/software/integration/wbimodeler/

WebSphere ESBConnectivity infrastructure for integrating applications and services to power your

SOAhttp://www.ibm.com/software/integration/wsesb/

WebSphere Business Monitor

Real-time visibility into process performance enabling process intervention and continuous improvement

http://www.ibm.com/software/integration/wbimonitor/

WebSphere Development Studio Client (WDSc)

http://www.ibm.com/software/awdtools/wdt400/



How to Build a SOA solution using IBM development toolsRational RequisitePro

Create, Simulate & Analyze As-Is

Business Model

WebSphere Business Modeler

Create FinancialReports & ROI

Estimates

Create Observation Model with KPIs & export to Monitor

Create, Simulate, Analyze and Optimize To-Be Business Model

BusinessAnalyst

Integration Developer

WebSphere Integration DeveloperChoreograph

services using BPEL, WSDL,

etc.

Configure Human Task Manager

(including Ad-Hoc) & Client

Assemble Solution(BPEL, Human Task Manager, Business

Rules, etc)

Understand Risk, Project

Costs, and ROI

Identify and Manage

Projects and Resources

CIO

ProjectManager

Rational PortfolioManager

DataArchitect

ModelRelationalDatabaseSchemas

Rational DataArchitect

RDB Mapping

Trace Requirements & Create System

Use Case Realizations

Model & Implement Services, & expose as

Web Services

Test Create & Manage

SystemRequirements

Architect

RationalSoftwareArchitect Java

Developer

Develop Portlets(App UI

and Monitor)

PortalDeveloper

Tester

Rational Functional & Performance Tester

IBM Rational Team Unifying Platform

BPELWSDL

UML

DBA

Deploy/Run

Monitor BusinessOperations

Analyst

RuntimeWebSphere Process ServerWebSphere Portal WebSphere Business Monitor

WSDLEAR

WSDLEAR

Observation ModelRun-time Statistics

RationalApplicationDeveloperWebSphereDevelopment Studio for iSeries client



Networks and network storage

Unassigned on demandresources

Hypervisor™

i5/OS™

Serviceprocessor

ProcessorsMemory

Linuxpartitions

HardwareManagement

Console Virtual Network

AIX 5L V5.2

Expansion slots

AIX 5L V5.3 partitions

Virtual processors Virtual adapters

VirtualI/O

server

Linuxkernels

AIX 5Lkernels SLIC

Virtualnetwork

& storage

Local devices & storage

Workload management and provisioning

IBM POWER Systems Virtualization Architecture



Customer samples



Bank (Belgium)

IBM content: software and service

Solution design: WebSphere Message Broker calling HATS Web Service

STG LS deliverables: expose 5250 application as Web Service via HATS macro, deploy Web Service on WebSphere Application Server running on i5/0S

WebSphereMessage Broker

Q # 1 Q # 2

3rd partyflat file

3rd partyflat file

file #1file #2

file #n

xSeries iSeries

DB2/400

5250*PGMIBM

HTTPServer

fori5

WebSphere Application Server

Plugin

HATSWeb

Service

HATSsupportclasses

HATSruntime

Customer req.: integration of 3rd parties flat files into DB2/400 using existing 5250 business logic



Bank (Greece)Customer needs :

Enable interaction between existing applications–iSeries ILE applications (RPG and Cobol)–.Net applications

Solution:Use of Enterprise Service Bus

Expose component applications as web services

Enable web services calls from ILE programSTG Lab Services deliverables :

SOA Architecture design

Demonstration development

Skills transfer

iSeries

RPG

WebSphere ASJava Bean

Cobol

Web ServiceInterface

Web ServiceInterface

Java Bean

DB2

iSeries


JOB

Cobol C Stub C/C++ Proxy

JOB


JOB SOAP/HTTP

xSeries

.Net Web Service

.Net Web Service

.Netprogram.Net

program



Transport (France)

WebSphere Application Server

MicrosoftApplication (VB, .NET)

Java toolbox

DB2/400

System i program

User desktopI5/OS partition

Web ServiceWrapper

Web Service Proxy client

Connection pool

SOAP/HTTP

Federate integration

Need of Application Server node

Optimization of performance by use of Connection pooling Local database

Use of open communication protocol (SOAP/HTTP)

Loose coupling between server and client



Transport (France), slide 2

Configuration : 1,6 CPU power 6, 32 G memoryRuns with 410, 820, 1230 et 1640 concurrent users (avg 25 req/sec, 49 req/sec, 72 req/sec, 95 req/sec)Run length : 15 min ramp up +1 hours for measure

ImpactsLimited impacts on response timeLinear growth of CPU consumption with

workload

CPU consumption evolution

0

10

20

30

40

50

60

70

80

410 820 1230 1640

concurent users

% C

PU

For each service, column 1: 410 users, column 2 : 820 users, column 3 : 1230 users, column 4 : 1640 users



SOA on System i5: Modernize your most valuable assets!Extend and enrich core ILE and WebSphere applications

Running on any platform,

including i5/OS and

Linux, AIX on LPAR

WebSphere and DB2

are enabled for SOA

today!

A great number of System i5

applications

WebSphere SOA platform

products

Unlocks the value of…

Creates opportunities for new business processes

with …

For advanced services..user interactionprocess managementinformation integrationenterprise service bus

For asset reuse..time to valuelower risklower cost

.. and service integritysecurityavailabilityrecoverability



Thank You

MerciGrazie

GraciasObrigado

Danke

Japanese

French

Russian

GermanItalian

Spanish

Portuguese

Arabic

Traditional Chinese

Simplified Chinese

Hindi

Tamil

Thai

Korean

HvalaSerbian

Documents

SOA and System i - IBM · SOA and System i Modernize and introduce flexibility into your applications IBM Systems and Technology Group Technical Day Paris, November 6th 2008. IBM