Ims04 ims modernization and integration - IMS UG May 2014 Sydney & Melbourne

© 2014 IBM Corporation1

IMS04: IMS Modernization & Integration Strategy and Solutions

Shyh-Mei F. Ho IBM Distinguished Engineer

[email protected] IMS Integration SOA Chief Architect

SVL, San Jose, CA. USA


Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which

IBM operates.

Acknowledgements and Disclaimers

© Copyright IBM Corporation 2013. All rights reserved.

– U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM

Corp.

IBM, the IBM logo, ibm.com, IMS, DB2, CICS and WebSphere MQ are trademarks or registered trademarks of International Business Machines

Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this

information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this

information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is

available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

Other company, product, or service names may be trademarks or service marks of others.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for

informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While

efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of

any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any

other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM

or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have

achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to,

nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.


IMS Enterprise Integration Solutions

z/OS

TCP/IP

WAS

IMS TM & DB

Resource

Adapters

Universal JDBC

& DLI

drivers

Vendor &

RYO

Solutions

WebSphere

DataPower

SOAP

Gateway

IIB & IBPM

IMS TM

Resource

Adapter

IMSTM

IMS

IMS DB

� IMS Connect is the high speed TCP/IP gateway for IMS: >15,000 transactions/sec

IMS Connect

API

IMS

CONNECT

DB2


IMS Database: Emerging Technology and Standards

� IMS provides Java and SQL/JDBC access to IMS database since 2000

� All IMS data are captured as standard metadata– IMS Catalog (V12)– Allow desktop tools to consume and understand IMS data

� IMS Open Database provides distributed access to IMS data via standard interfaces

� IBM WebSphere can access IMS data via IMS DB Resource Adapter – WAS to access IMS data– DataPower V6 to access IMS data (2Q2013)

� Integration with IBM Watson Explorer (4Q2013)

� Integration with InfoSphere– Classic Federation– Discovery – Guardium– BigInsights (1Q2014)– MDA (Machine Data Analytics)

� Cognos V10.2 is fully integrated with IMS to do business reporting against both operational and data warehousing environments (2Q2013)

� SAP & .NET (4Q2013) directly access IMS database

� IMS goes Mobile!

Zillow.com

Competitive Mashup

iGoogle

New

New

New

New

Plan

New

© 2014 IBM Corporation

IMS and Cognos BI for enhanced Reporting& Opertional BI

� Provide real-time access to IMS data for report generating

� No longer need to be skilled in IMS to write reports

� Create and manage business-related metadata into visual presentations

� Ease decision making faster, sooner and react more quickly

� Compare performance across dimensions to spot trends and anomalies over time

5

Cognos

BI

Data

Store

IMS

IMS

Universal JDBCData

ModelPublished

Reports

Report

Authoring Cognos

Framework

Manager

Consumer

Author

JDBC


6

Accelerators

Information Integration & Governance

Data

Warehouse

Stream

Computing

Hadoop System

DiscoveryApplication

Development

Systems

Management

BIG DATA PLATFORM

Watson Explorer

Find, navigate, visualize all data

Accelerators

Speed time to value with analytic and application

accelerators

InfoSphere BigInsights

Bringing Hadoop to the enterprise

InfoSphere Data Warehouse

Delivers deep insight with advanced database

analytics & operational analytics

Information Integration and Governance

Governs data quality and manages the information

lifecycle

InfoSphere Streams

Analytics for data in-motion exploration

IBM BIG DATA PLATFORMLogical platform with many physical deployment options

© 2014 IBM Corporation7 7

� Much of the world’s operational data resides on z/OS

� Unstructured data sources are growing fast

� There is a need to merge this data with trusted OLTP data from System z data

sources

� IMS provides the connectors and the DB capability to allow BigInsights v2.1.2.0 to

easily and efficiently access the IMS data source

� BigInsights v2.1.2.0 was available on 3/13/2014

Enhancing IMS analytics on System z with Big Data

New


HDFS

BigInsights Platform

JDBC

Analysis

Discovery

IMS and Big Data Overview

8


�Watson Explorer is the visualization & discovery

capability for IBM’s comprehensive big data

platform

�Watson Explorer is a key component of all the big

data use cases with greatest impact in Big Data

Exploration & Enhanced 360 View of the

Customer

9

IBM Watson Explorer


Watson Explorer : visualization & discovery across all your datasources : “Integration at the glass”

Create unified view of ALL information for real-time

monitoring

Identify areas of information risk & ensure data compliance

Analyze customer information & data to unlock true customer

value

Increase productivity & leverage past work increasing speed to

market

Improve customer service & reducecall times

Watson

ExplorerProviding unified, real-time access and fusion of big data unlocks greater insight and

ROI

Securely connect to and leverage data stored in DB2 for z/OS & IMS

Help prioritize your System z big data integration and analytics projects

10


Requirements: Machine Data Analytics (MDA) Accelerator

IBM Big Data Platform

Systems Management

Application Development

Visualization & Discovery

Accelerators


HadoopSystem

Stream Computing

Data Warehouse

Custom Applications Shrink Wrap Solutions

Health Care Networking Insurance Telco “x2020” “Unity”

IBM Big Data Platform

HadoopSystem

Stream Computing

Data Warehouse


MDA Accelerator

Telco HealthcareRetailFinancial services

Parsers and Extractors

(applications, services, servers

and devices )

Federated Discovery, Pattern Discovery,

Search, Visualization Tools for root cause

analysis

Generic

Domain

Specific

Tools Client Specific Customizations, Visualization tools (“zInsights”)

IT use cases:

• Server, performance, troubleshooting

Business use cases:

• Click stream and transaction analysis

• Optimize production, advance planning

IMS intends to provide

Make IMS transactional log data available to the suite of BigInsights tools.


IMS Transaction: Emerging Technology and Standards

� Provide Java container in IMS regions since 2000

� IMS has evolved from its initial server function with the ability to consume external resources as well as provider access to external applications– IMS as an Integration Focal Point in enterprise environments– Support both Web services and non-Web services protocols

� Integration with IBM products in supporting XML, Java, JEE, Web Services, SOAP, RESTful, JSON, etc.– WebSphere: WAS, WDP, WTX

• DataPower V6 to support IMS Callout– PureSystems– IIB (IBM Integration Bus), BPM IPS (IBM Process Server)

• IMS Callout– IODM V8.5 (IBM Operational Decision Manager)– WebSphere MQ

� IMS SOAP Gateway: Direct SOAP endpoint for IMS transactions

� Integration with solution packages and databases – JEE compliant application servers– .NET– BizTalk– SAP– and Oracle, etc.

� Integration with Big Data

� IMS goes Mobile!

Zillow.com

Competitive Mashup

iGoogle

Plan

New

New


SOAP

Gateway

WebSphere

DataPower

IBM

Integration

Bus

Enterprise Service

Bus

Web ServicesWeb Services

• Direct IMS

SOAP

endpoint for

Web

Services

• Inbound and

Outbound

to/from IMS

• Ubiquitous

gateway for Web

& REST services

• Fast web

services and XML

transformation

• Inbound to IMS

• Outbound

from IMS

(DataPower V6.0)

IBM Business

Process

Manager

WebSphere

Transformation

Extender

BPMBPM

• Transform

complex data

types

• Inbound to

IMS

Complex Data Transformation

Complex Data Transformation

• Business

process

automation

and

choreography

• Inbound to IMS

• Interoperability

among

heterogeneous

services and

data

environments

• Inbound to IMS

Network Gateway

WebSphere

Application

Server

or Java EE

Server

Java EEJava EE

• Full SOA and

Java EE

Services

• Inbound and

Outbound

to/from IMS

IBM

Operational

Decision

Manager

Business RulesBusiness Rules

• zRule

Execution

Server (stand-

alone)

supports IMS

• Rule Execution

Server in zWAS

supports IMS

IBM Worklight

MobileMobile

• Open mobile

platform

• Integration with

other servers

(WAS,

DataPower, IMS

SOAP Gateway,

IIB, IBPM, and

etc.)

WebSphere DataPower: IBM Strategic Security and Integration Gateway for Cloud, Mobile, and Internet connectivity

6.0

IMS TM Connectivity and Integration

Many IBM application servers already provide built-in support for IMS transaction access today

IBM Integration Bus (IIB) formally known as WebSphere Message Broker: IBM Strategic Enterprise Service Bus


WebSphere ServersWAS, WTX, IIB, IBPM

Connectivity with IMS Connect & MQSeries(Inbound Requests)

IMS

Connect

O

T

M

A

IMS DB &

XML DB

IMSIMS SOAP

Gateway

WebSphere

DataPower

(WDP)

Connect API

(Java, C)

MQMQ Client

RYO Client

Web Service

Consumer

IMS TM

Resource

Adapter

DB2

Appl

JCA

JMS or MQ API

SOAP over IP

IIB &

WDP

MQ Trigger Monitor

IMS TM Resource Adapter:

WAS – WebSphere Application Server

WTX – WebSphere Transformation Extender

IIB – IBM Integration Bus

IBPM – IBM Process Process Management

WDP – WebSphere DataPower

WOLA – WebSphere z/OS Optimized Local Adapter

IMS MQ Bridge

WOLA


Fast and cost-effective development, integration and management of rich, cross-platform mobile

applications

Client Challenge

Key Capabilities

Using standards-based technologies and tools and delivering an enterprise-grade services layer that meets the needs of mobile employees and customers

Mobile optimized middleware

• Open approach to 3rd-party integration

• Mix native and HTML

• Strong authentication framework

• Encrypted offline availability

• Enterprise back-end connectivity

• Unified push notifications

• Data collection for analytics

• Direct updates and remote disablement

• Packaged runtime skins

• zLinux support

Delivering for multiple mobile platformsIBM Worklight


WebSphere DataPower: Mainframe integration

Offload processing for reduced MIPSServices Enablement for

IMS, DB2, CICS

IBM WebSphere DataPower Appliances are the industry-leading

Security & Integration gateway that helps provide security, control, integration

and optimized access to a full range of Mobile, Web, API, SOA, B2B and Cloud

workloads

is the first level of security for access control, threat protection, and data validation

WebSphere DataPower deployed in the DMZ

Identity & Access

ManagementThreat

ProtectionData Security


Recent DataPower deliverables for System z

1. IMS Callout – Allows applications running in IMS to make service calls to external web service providers using the existing IMS ICAL interface [DP v6.0]

2. IMS DB – Provides a new information-as-a-service interface for service consumers to access IMS databases using standard SQL (requires DataPower’s Database Connectivity feature) [DP v6.0]

3. DB2 WLM – Provides support for real-time load distribution of SQL calls from DataPower to Sysplex-aware DB2 instances running on z/OS [DP v6.0]

4. XI50z firmware upgrade� Provide support for DataPower firmware level v5.0 [1Q13]� Provide support for DataPower firmware level v6.0 [1Q14]

IMS

CICS

DB2

1

2

3

4

Business Integration


DataPower Models for IMS solutions

XI52, XI50B, XB62, XG45 IMS DB support

XI52, XI50B, XI50z, XB62IMS TM provider support

XI52, XI50B, XI50z , XB62IMS TM synchronous callout support

DataPower Models supporting 6.0+ release

• DataPower XI50z V6.0 firmware for zBX Model 003 when attached to zEC12 and zBC12 servers

•More capabilities planned for future DataPower releases

New

New


IMS

IMS Connect

WebSphere

DataPower (DP)REST

client

JSON

OTMA

IMS App

Mobile Integration with IMS

Worklight

Server

IIB, IBPM , etc.

zConnect

Worklight

Server

DP, WAS

DMZ


Customer demo: DataPower as “RESTful Service Facade”

� Mobile connectivity for both inbound and outbound requests with

IMS transactions


Mobile Integration with IMS Transactions Use Cases

� To view total accounts’ balance

� To do fund transfer between accounts

IMS

IMS Connect

WebSphere

DataPower (DP)

REST

client1

JSON

OTMA

IMS App

REST

client2


Connectivity with IMS Connect & MQSeries(Outbound Requests)

IMS

Connect

O

T

M

A

IMS DB &

XML DB

IMS

IMS App

IMS TM

Resource

Adapter

WebSphere e.g. WAS

WebSphere

DataPower

MQMQ Server

RYO Server

Web Service

Provider

Event

Processing

WBE, WBM

RYO Server - .Net, BizTalk, Oracle SP, SAP, PayPal

services, and any application server, etc.

DB2

IMS MQ Bridge

IMS Connect

API (Java)

IIB &

WDP

IMS SOAP

Gateway

WOLA

MQ Trigger Monitor


IMS Synchronous Callout Flows

IMS Callout

ApplicationTpipe X

External

application

1

1 : External application issues a Resume Tpipe request

2: IMS application issues ICAL to send out a callout request to the external application

3: External application receives the callout request from IMS application, then acknowledges (ACK) it

4: External application issues SEND-ONLY (w/ACK) to send a response back to IMS application.

5: Optionally, IMS acknowledges (ACK) the receipt of the response

2 ICAL

3

4SEND-ONLY

5

ACK

ACK

IMS

IMS

Connect

ACK


IMS Synchronous Callout via IMS Connect

IMS SOAP

Gateway

IMS Connect

OTMA

Descriptor

WebSphere Application Server

IMS TM

Resource

Adapter

IMS

EJB/MDB

Web Services

Provider

IMS Application

Synch Callout (ICAL)

User Written

Application

WebSphere

DataPower

New


Requirements: IMS Transactions and Large Attachments Requirements


IMS Transactions & Large Attachments Business Value

� Target Market

– Enterprise customers with IMS TM and DB2 zOS who desire to drive IMS transactions with “immutable” large data, e.g. picture files, clinical records, documents, and biometric signatures, etc..

� Challenge Addressed

– Today IMS cannot satisfy this requirement, because transactional messages have to be segmented to be processed.

� Solution Statement

– Large attachments will be stored in DB2 z/OS; only the handlers, i.e. RowID(s), will be passed through IMS transactional pipelines

� Business Value

– To make IMS relevant in today and future IT environment, it is valuable to extend existing IMS TM capabilities to handle unmodifiable large transactional message data.


Large Attachments: Customer Requirements

� RFE 31993– More and more clinical artifacts, e.g. XRays, MRIs, and genetic info, etc. are being

digitized. Today customers use a manual type of process to coordinate files for claims. It is desirable to have transactional integrity support for claim processing on z/OS with IMS transactions. These image files, stored as attachments in a repository, are immutable; and attachments would be used to make business decisions by medical professionals.

� RFE 31973– A large Banking System in African desires to drive IMS transactions with "finger prints"

for security reasons. They also have the need to deliver PDF and JPEG to external servers via IMS transactions. (This customer believes that DB2 as a repository to support large attachments for IMS transactions will provide a robust and scalable solution.)

� Large Credit Card Co. in USA– This client wants to explore Large Attachments capabilities with IMS transactions for

"documents" and "payments & billing processing". They have voted the Large Attachments RFE 31993

� Large Banking system in NA– Wants to pass documents for their loans business with IMS Large Attachments.

� Large Banking system – Huge IMS message data, i.e. 10 MB, is needed to synch up customer data between

IMS and Oracle Exadata


IMS Transactions and Large Attachments: Requirements

IMS

Connect

O

T

M

A

IMS

Application

WebSphere (e.g. WAS, DataPower),

IMS SOAP Gateway,RYO Application,

Etc.

z/OS

TCP/IP XCF


Requirements: Network Security Credential Propagation


System z

z/OS

IBM

Directory

Server

LDAP

RACF

WebSphereApplication Server

DB 2

CICS

MQ

IMS

Distributed Network Security Credential Propagation

Today’s distributed model:

End-user signs on to a distributed application, e.g. WAS, with distributed User ID

• Distributed applications often use a common RACF user-ID (e.g. IMSadmin) when invoking IMS, CICS, DB2 to process the request.

• This distributed User ID (e.g. [email protected]) not passed to IMS, etc. and on to RACF, making end-user accountability

difficult to determine.

• Do you have a requirement of propagating original Network Identity for both inbound and outbound requests?

30


IMS Explorers


IMSISPF

IMS Explorer for Administration (Web

Browser)

AdministratorsDevelopers

IMS Explorer for Development

(Eclipse)

IMS User Interfaces

Mobile


IMS Explorer for Development � Change IMS Database and Program Definitions sources

� Integrate with Eclipse to give relational view of IMS data via Data Source

Explorer

� Provide graphical editor to create SQL statements to use with IMS data

� Graphically access IMS data using SQL

� View your mainframe datasets

� Submit JCL and inspect output in JES

� Fully integrated with Data Studio

� Intended directions:

– Support IMS transactions

– Integrate with CICS Explorer

Automatic

Generation


IMS Explorer for Administration

� Provide IMS system programmers and DBAs a state-of-the-art user interface to manage, configure, and deploy IMS

systems

� Full operational single point of control for all IMS address spaces

� Full GUI support for IMS resources

� Immediately react to and resolve issues in the system

� Cloud-style IMS system management

� Integrated with IMS Tools Administration Console

� Requirements:

– Enable RESTful API for Mobile administration

– Integration with zOSMF for dynamic configuration updates

© 2014 IBM Corporation

IBM Tools Administration Console

� Provides a single, holistic easy-to-use web-based interface

• Consolidates information from various tools giving a more complete picture of IMS systems and databases

• Leverages the latest web technologies for a richer user experience

• Access from anywhere via the Internet using standard web browsers, with positioning to extend to mobile

• Integrates a context sensitive help system as a learning aid for new IMS DBAs and System Programmers

• Dramatically changes the appearance and impression of our mainframe tools

• Continue to extend integration to allIMS ToolsSincluding Vendor Tools and DB2

Database Health

and Autonomics

Graphical Visualization

of data not possible in ISPF

IBM OneUI Theme

Integrated Help


Admin Console vision

� Provide IMS system programmers and DBAs a state-of-the-art user interface to

manage, configure, and deploy IMS systems

� Full operational control over all IMS address spaces

� Full command of IMS resources

– Programs, transactions, databases, etc

� Immediately react to and resolve issues in the system

� Cloud-style IMS system management

– IMS region profiling, application profiling, application deployment


IMS resource relationships


Transaction insight


Operate directly on databases


Thank You