IMS, Fit For the Future May 2011 - · PDF fileIMS, Fit For the Future May 2011 Helene Lyon ... Cognos IMS TOOLS ... IBM Mashup Center / WebSphere sMash Web 2.0

© 2011 IBM Corporation

IMS, Fit For the FutureMay 2011

Helene Lyon

[email protected]

DE, European IMS Architecture Team Technical Executiv e

© 2011 IBM Corporation2

Announcement … European IMS Symposium

� European IMS Symposium – 14 to 17 November 2011– http://www.ibm.com/training/conf/ims


IMS Position in IBM Smarter Planet

“Data is exploding and it’s in silos”

IMS & Information Integration

IMS & Operational BI

“Our resources are limited”IMS & Autonomics

“New business and process demands”

IMS & Business Process Mgmt

“My infrastructure is inflexible and costly”

IMS & Parallel Sysplex

DB2

Optim

WAS

BRMSRational

z/OSParallel SysplexSecurity Server

WLMLowest TCO

Datapower

System z Data Compres.

IMS DB

Cognos

IMS TOOLS

De-duplication

InfoSphere Classic Federation & Publication &Replication

VSAM

DM Tools

IMS TM CICS

Business Event & Business Monitor

Tivoli

Mashup

Master Data management

NEW INTELLIGENCE

GREEN & BEYOND

SMART WORK

SMARTER COMPUTING


IMS Position within the Smarter Computing DomainsMany different workloads which can benefit from the power of IMS!

Message Driven

Web Facing� Business on the Web� Java front ends

� ERP, CRM, Financials, etc.� Custom or Packaged applications

� Business on a global scale� Huge transaction rates and high

database activity

� Periodic business cycles� Limited batch windows

Data Processing

Transaction Processing

Batch Processing

� Event driven business models� High message processing rates

TM – Numerous call in & callout capabilitiesDB – JDBC access to hierarchical data from

every platforms (distributed or z/OS)Web 2.0 support or how to quickly transform

IMS assets into RESTful Services

DB – Smarter data management DB – Smarter data governanceDB – Smarter operational BI

Leading On-line Transaction & DatabaseManagement System

TM - Easy integration with BRMS, Events, MDM

Efficient Batch management thanks to z/OS capabilities

Highly parallel processing

TM – Generation of Business EventsTM – Inbound and outbound integration with

WMQ

And More …


Agenda

� IMS Applications – Rejuvenate, Leverage and Grow– SOA Integration– WOLA IMS Support– Enhancing application development environment– Using Business Rules Management Services– Accessing Master Data – Integration with Business Event Services

� IMS Database – Build their Future – Smart Data Access– Smart Data Governance– Smart Data Integration– Smart Operational Business Intelligence


DB2

What assets in IMS can be leveraged?

� IMS Transaction– No presentation layer– Access to Resource Managers (RM)

•IMS DB, DB2, MQ– Very simple design

•Get Input Message•RM calls•ISRT Output Message

� IMS Database– Hierarchical design– JDBC access– XML datastore

� IMS MFS – Description of input and output

messages and device map– Not used in client/server implementations

B

D

P

IMS ConnectWMQ

Appl. . . . Appl.

IMS Transaction

Manager

IMS Message Queues

IMS Data Comm.

Open Transaction Manager AccessAPPC/IMS

Common Interface (XCF)

APPC/MVS

VTAM(LU0 LU1 LU2 LU6.1 LU6.2) TCP/IP for zOS

z/OS

Telnet

B B

IMS Database Manager

D

MFS P

DB2 SP

ODBAWMQ

ODBM


Positioning IMS Assets in SOA Architecture

Business TierPresentation Tier Enterprise Tier

DB

Core Business Services

User and Interaction Domain Core and Information Domain

Channel Interaction Services

Enterprise Service Bus

Integration/Process Domain

Des

ktop

Cha

nnel

s

Data Services

Business Services

Business Processes

Integration Services

JDB

CW

eb

Ser

vice

sJC

AJM

S

External Systems Applications

External Business Partners

External Services Providers

External Systems

D

B


WebSphere MQ

WebSphere Application Server

WebSphere Message Broker

Increased capabilities / automation

A new version of our proven product that delivers an advanced Enterprise Service Bus. Provides universal connectivity and data transformation. Built on WebSphere MQ.

Business Process

ESB

Provides reliable integration messaging to connect applications and Web services across more than 80 supported platform configurations.

WebSphere Process ServerFor customers who want a higher level solution to design, automate and manage composite applications and operational business processes. Built on WebSphere ESB.

WebSphere ESBA new product that delivers an Enterprise Service Bus. Provides Web Services connectivity and data transformation. Built on WebSphere Application Server.

IMSCICS

Application/Transaction Servers

A complete solution from existing systems to the full SOA Lifecycle

Service integration

Process integration

The WebSphere “Universal Transformer”

DB2

Service enablement

Datapower


SOA with IMS Applications

� When designing an SOA, much of the business logic t o be deployed as services is already implemented in exis ting IT application systems

– And much of this runs on the mainframe - Bottom-Up approach

� New services may also be written– It might be appropriate to write this as an EJB or Web Service

• For example, using IMS JDBC to directly access the IMS Databases– But in many cases the best solution will be to create new IMS transactions – Top-Down

approach

� When the existing transaction does not exactly matc h the business requirement, the most efficient solution is to modify the existing t ransaction

– Modify or add COBOL or PL/I logic– Add JAVA classes to existing COBOL or PL/I programs– Take benefit of a Business Rules management system

• Business Rules mining using Rational Asset Analyzer– Take benefit of Business Event management system

• Generate events from IMS application– Study all Call in/Callout capabilities– Be creative ☺

� Rational Developer for System z (RDz) provides the best platform for IMS application program development, maintenance and renovation

“ A study of 35 SOA projects across 11 industries worldwide revealed improved flexibility (100%), decreased costs (97%), reduced risk (71%), and increased revenue (51%).”

IBM Institute for Business Value http://www-935.ibm.com/services/us/gbs/bus/html/soa-industry-series-tl.html


SOA Connectivity with IMS TM - Inbound to IMS

IMS Connect

OTMA

IMS DB &XML DB

IMS

WebSphere ServersWAS, WPS, WESB,

WTX and WMB

IMS SOAP Gateway

WebSphereDataPower

Connect API

MQMQ Client

RYO Client

Web Service

Consumer

IMS TM Resource Adapter

WAS – WebSphere Application ServerWOLA - WebSphere z/OS Optimized Local AdaptersWPS – WebSphere Process ServerWESB – WebSphere Enterprise Service BusWTX – WebSphere Transformation ExtenderWMB – WebSphere Message Broker

IBM MashupCenter /

WebSpheresMash

Web 2.0 Client

DB2

WOLA

D

B

JCA

JMS or MQ API

SOAP over IP

WMB & DataPower

MQ IMS Bridge

MQ Trigger Monitor


SOA Connectivity with IMS TM - Outbound from IMS

� Asynchronous support with– IMS API (ISRT ALTPCB)– MQ API– APPC API– TCP/IP calls with IMS Connect

� Synchronous (not in 2PC scope) support with– IMS API - New ICAL with IMS 10 – MQ API– APPC/IMS (also in 2PC scope)– SQL calls to DB2 stored procedures

B

IMSAppls.

B

IMSAppls.

B

Output Gateway

?

B

IMSAppls.

B

Output Gateway

?


IMS Connect

OTMA

IMS DB &XML DB

IMS

DB2

WOLA

D

B

SOA Connectivity with IMS TM - Outbound from IMS

� Asynchronous and synchronous capabilities

IMS TM Resource Adapter

WAS

IMS SOAP Gateway

MQMQ Server

RYO Server

Web ServiceProvider

Event ProcessingWBE, WBM

WAS – WebSphere Application ServerWOLA - WebSphere z/OS Optimized Local AdaptersWBE – WebSphere Business EventsWBM – WebSphere Business MonitorWMB – WebSphere Message BrokerRYO Server - .Net, BizTalk, Oracle SP, SAP, PayPal services, and any application server, etc.

WMB


IMS SOA Solutions & Development Tools

� WebSphere using IMS Resource Adapter– WebSphere Application Server (WAS) – Rational Application Developer (RAD)– WebSphere ESB (WESB) – WebSphere Integration Developer (WID)– WebSphere Message Broker (WMB) – WebSphere Message Broker Toolkit (WMBT)– WebSphere Process Server (WPS) - WebSphere Integration Developer (WID)– WebSphere Transformation Extender (WTX) – WTX Design Studio– WebSphere Application Server Community Edition (WASCE)

� WebSphere DataPower – WTX Design Studio– DataPower offers many built-in functions, e.g. WS-security, WS-management,

firewalling, XML performance, etc

� IMS SOAP Gateway – Rational Developer for System z (RDz)– Direct SOAP connectivity for IMS (not an Application Server)


IMS Transactions SOA Integration - Solution Summary

Consider as option to service enable IMS applications when WMB is already used as enterprise ESB.

IMS Connect node available in addition to MQ supportIMS Connect (enhanced with IMS Connect Extension Tool)WMB server

WebSphereMessage Broker

Use as ESB gateway for security functions, message transformation and routing

Synchronous and AsynchronousInbound CM1 with sync-level=NoneNo CM0 support32 KB limit (single segment)No support for IMS conversational transaction

IMS Connect (enhanced with IMS Connect Extension Tool)DP Appliance

DataPower

Exploit JMS and WMQ for basic messaging and flowing Web services.

Asynchronous, with almost-synchronous capabilitiesInbound and outboundCM0 and CM1 supportAssured delivery

MQ IMS BridgeWAS Server

JMS

Most appropriate solution when service requester is JEE component and when high QoS required (2PC, connection pooling, identity propagation etc.)

Synchronous with Asynchronous output retrieve options Inbound and outbound (with IMS 10)CM0 and CM1 supportNO maximum message size: IMS Connect supports multi segment message (32K limit for one single segment)

IMS Connect (enhanced with IMS Connect Extension Tool)WAS Server

JCA

Still has some limitation today; work with IMS lab if you have specific customer requests

Synchronous access over HTTPInbound and outbound (with IMS 10)CM1 with sync-level=NoneNo CM0 supportNo support for IMS conversational transaction

IMS Connect (enhanced with IMS Connect Extension Tool)&IMS SOAP Gateway

SOAP

RecommendationCapabilitiesMiddlewareStandard architecture


WebSphere Optimized Local Adapters – What is it?

� Providing a highly scalable transactional solution

� New cross-memory communication structure for WAS V7 , extension of a WAS “Local Comm” used inside of WAS .– Introduced in May of 2009 in WAS 7.0.0.4, and enhanced in WAS 7.0.0.12 …

This extension is implemented with a new set of mod ules that provide an API for programs in external a ddress spaces to access servers using this Daemon shared space mecha nism

CR SR

AppServer

CR SR

DMGRDaemon

Shared Space

WOLACICSAssembler/Cobol/PLI/C or C++

z/OS BatchAssembler/Cobol/PLI/C or C++

UNIX Systems ServicesAssembler/Cobol/PLI/C or C++

Airline Control SystemAssembler/Cobol/PLI/C or C++

WOLA

WOLA

WOLA

This is bi-directional

Cross memory “Local Comm”

CR SR

AppServer

IMSAssembler/Cobol/PLI/C or C++

WOLA

New in 7.0.0.12!

LPAR


WOLA - Interface with Batch, CICS, IMS

Enterprise Java Bean(Or Servlet)

Enterprise Java Bean

WOLA Execute()ExecuteHome()

WOLA JCA Adapter

WOLA

CICS Program

CICS Program

WOLA BBO$/BBO#

WOLA Modules/APIs

Batch Program

WOLA Modules/APIs

WebSphere Environment

CICS EnvironmentBatch Environment

EJBs that initiate a call to WOLA do so through a supplied JCA adapter.

Several WOLA-specific methods used to invoke services over WOLA

EJBs that will be the target of inbound calls need to implement the WOLA-supplied Execute() and ExecuteHome() classes.

Calls into CICS come across WOLA-supplied BBO$/BBO# task and transaction. Target CICS program unchanged if able to be invoked over COMMAREA or Channel/Container

A CICS program that wishes to initiate an outbound connection must write to the WOLA APIs

A Batch program that wishes to initiate an outbound connection

must write to the WOLA APIs

You make modules/classes available: STEPLIB, DFHRPL, DFSESL, ola.rar and ola_apis.jarBatch CICS WAS Development ToolIMS

BMP/MPP/ IFP

WOLA IMS

ESAF

IMS Dependent regionsWOLAOTMA

A WAS application can call an existing unchanged IMS transaction using OLA over OTMA


WOLA – IMS Support - Basics

� WOLA OTMA support– A WAS application can call an existing unchanged IMS transaction using OLA over

OTMA

� IMS WOLA APIs support– Allow IMS applications in the following IMS dependent regions to use the WOLA APIs for

bi-directional calling between WAS / IMS when co-located on the same z/OS system• Message Processing Programs (MPPs)• IMS Fast path Programs (IFPs)• Batch Message Programs (BMPs)• Batch DL/I apps

– Based on External Subsystem Attach Facility (ESAF) use• ‘WOLA’ subsystem – with all required exits (new BBOAI- modules)• WOLA APIs are enhanced to detect when under IMS and pass requests to WOLA Normal Call

ESAF exit – then on to WAS.• Positions for global transactions support


Relative Advantage Favors …

WOLA ICON

Part of the WebSphere Application Server z/OS Produ ctWOLA II shipped with WAS z/OS 7.0.0.12, IMS Connect is a separate FMID that ships with IMS

Able to be used for local or remote access to IMSWOLA is a local technology only, IMS supports both a local mode as well as TCP-based remote access

Propagation/assertion of User Identity from IMS in to WASWOLA can propagate the thread-level ID over a call into the WAS EJB container and assert it

Bi-directional and able to call existing unchanged IMS transactions

Multi-segment messages WOLA over IMS OTMA does not yet support multi-segme nt messages. This is coming soon.

WOLA is a complementary technology with IMS Connect. Both will have their place within an enterprise architecture.

Global Transactions WAS to IMS WOLA does not yet support this.

Global Transactions IMS to WASNeither IMS ICAL callout or WOLA support this yet.

WOLA – IMS Support & IMS Connect (ICON)


Enhancing z/OS Application Development ExperienceWith Rational Developer for System z (RDz)

� Eclipse-based application development tool for mode rnizing and developing System z applications– COBOL, PL/I, C, C++, HL Assembler, Java– Supports IMS, CICS, Batch, USS, etc.– Interactive access to z/OS system– Access PDS and run JCL from your workstation

� Premier IBM Integrated Development Environment for development and test of IMS applications – RDz V7.6 adds drag-and-drop code snippet function for IMS DLI calls– Or RDz V8.0.1

� Also supports IMS SOA enablement– Enables CICS and IMS applications for Web

Services and SOA– Built-in wizard for SOAP Gateway and Web 2.0– Generate XML COBOL/PLI converters for XML

transformation– Generate WSDL, correlator files for Web

Services access

** Unwarranted two complimentary copies of RDz 7.6. x for IMS 10 or 11 users


Enhancing z/OS Application Development Experience on x86 workstationWith Rational Developer for System z Unit Test (RDz)

� Rational Developer for System z Unit Test feature c an greatly enhance the way organizations develop, maintain and test mainframe applications

– Based on the IBM z Personal Development Tool (zPDT) – Small-scale, personal test environment for developers that can run z/OS and z/OS middleware from

IBM, but on an Intel or Intel-compatible (x86) personal computer (PC)

� Features / Business Value– Develop and test z/OS applications on a desktop machine – Lower testing costs over traditional mainframe environments– Facilitates quick changes to test configurations during development

20


� Standardware COPE mainframe virtualization solution for IMS integrates with RDz to enable additional productivity and cost savings for z/OS development projects

– The Standardware COPE solution allows IMS development teams to virtualize their IMS test environments for potential savings in test resources, process time and set-up systems skills without associated application program changes.

– The COPE JCL integration with IBM Rational Developer for System z used in conjunction RDz remote interactive testing, debugging and deployment capabilities can help achieve business objectives by making the IMS test deployment less CPU costly and more transparent for the developer

� More information about COPE can be found in the IMS Newsletter: – http://www-

931.ibm.com/bin/newsletter/tool/landingPage.cgi?lpId=2337&open&cm_mmc=6231-_-n-_-vrm_newsletter-_-11069_137321&cmibm_em=dm:0:18016073

� Or at the Standardware site:– http://www.standardware.com/index.php/site/products/

Virtualization of IMS Application Development Environment on z/OS


Collaborative Application Development including IMS applications

� The nature of applications has changed– loosely coupled components– teams need to collaborate– use multiple platforms that are fit-for-purpose

� Coordination required– requirements management– work item management– iteration planning (what should go into what level/release)– multi-platform build processing

Integrated application

development tools enable developer

productivity


Repository

Jazz Server

Application Server

Jazz Team Server

Clients

Collaboration

Tomcat, WAS

Sametime or Jabber, Google Talk

DB2, or Derby,Oracle,

SQL Server

AgentAgent

AgentAgent

AgentAgent

AIX

Solaris

z/OS

IBM i

HPUX

WindowsLinux

Linux for System z

Build Agents

Collaborative Application Development including IMS applications …

� Rational Team Concert - Single Collaborative Develop ment environment for all types of teams

– Development in any language– Development for any platform– Traditional or Agile Planning

Extensions for z/OS�Native z/OS build support �Integration with RDz�Integrated SCM solution for z/OS and distributed assets


Bringing Agility to IMS transactions

� Value of a Business Rules Management System– Manages the business rules allowing them to be visible and easily maintained by business analysts– Provides a knowledge base that is accessible for application understanding and ongoing

management– Enables decision services for SOA and other modernization strategies– Reduces risk through reuse of proven, existing logic in a modernized architecture while rationalizing

software assets that are misaligned with corporate priorities.

VALIDATION & MANAGEMENTIBM WebSphere ILOG BRMS

IDENTIFICATIONIBM Rational Asset Analyzer

REMEDIATIONIBM Rational Developer for System z

— What decisions— Using which rules— Where in the source

— Adjust the source to match the rule— Extract the rule to a callable element— Extract the rule to a rule server

— Align rules with business goals— Manage business rules life cycle— Test and validate rules


Application Developer, Architect

Business Analyst, Business Manager

CICS, IMS, Batch Applications

Decision ValidationServices

Rule Studio(Eclipse)

Rule TeamServer (RTS Web)

RTS Rule Repository

ILOG Rules for COBOL

ILOG Jrules Rule Execution Server z/OS

Development

Rule Management

ILOG BRMS Management and Development

WebSphere ILOG Business Rules for z/OS

Bringing Agility to IMS transactions with ILOG BRMS Solutions on z/OS


Accessing “Operational Master Data” in a z/OS environment

� InfoSphere MDM Server– High performance, high scalability foundation

to access master data•Server and/or Data can be distributed or z/OS

– Enabled as an SOA Library with 800 pre-packaged business services

� When data is in DB2 for z/OS, a COBOL Adapter enables COBOL programs to access Master Data Management Server services

– Both the MDM Server Central Transaction server (for Update request) and MDM Server “Query” Connect (for Read-only requests)

– Based on MQ communication

� More on MDM Server “Query” Connect – z/OS MDM Server component to service high

volume read only transactions (around 1000 tps)

– Mirror typical use scenarios where a large portion of transactions is search or inquiry (read-only)

– Java SE application (like a long-running batch job for z/OS) – WAS not prereq

Mainframe z/OS

MDMDatabase

Distributed AIX

JDBC

MDMQuery

Connect

ApplicationServer

MQ Server

Client Apple.g. Cobol

Client Appl

Client Apple.g. Web UI

JDBC/SQLJ

JMS

RMI

JMS

JMS

MDMApplication

JMS


Batch Framework COBOL

AdapterJMS/MDBAdapter

JMS Notification

Query Connect(zSeries)

Event Manager

SQL

DataWarehouse

KnowledgeMaster Data

ServicesMaster Data

Database

IBM InfoSphere Master Data Management Server

Interfaces and message formats

Web Services XML Interface Java Object

MDM Server - Integration Options

• Technical Connectivity to many other application

• Adaptable Message format• Non proprietary technologies


Sending « Business Events » from IMS Applications

� What is … a Business Event?– Any electronic signal (message) indicating a

change in the state of the business has occurred

� Event message is created by the IMS application

– Based on data included in IOPCB– Based on database content– Based on application logic

� Event message is sent based on IMS Calloutsolutions

– Using IMS API•Enhanced with IMS SOAP Gateway Business Event Support

– Using MQ API– Synchronous or asynchronous

Event Processing

Business Users

A PIN is changed

A call to the help desk

A New Location is Detected

A sale is made

“Events… pass silently back and forth… as unrelated pieces of communication. They are a source of great power, for when they are correlated, they yield a wealth of information.”Dr. David Luckham, Professor Emeritus, Stanford University


WebSphere Business Events

Con

nect

ors

ESB

Code/API

Adapter

WebSphere Business Events – Connectivity Options

� Embedded Connectors– Database– Email– File System– FTP– JMS– Web Services– (and more)

� Enterprise Service Bus

� Custom Code using API

� 3rd Party Application/Adapter


Integrating IMS applications / data in Web 2.0 applications

� Think of Web 2.0 as a concrete implementation of SO A philosophy, and more :)– And reuse existing IMS assets in new combinations

� Using IBM enterprise mashup solutions – IBM Mashup Center — a comprehensive mashup platform, supporting line of business

assembly of simple, flexible, and dynamic web applications - with the management, security, and governance capabilities IT requires.

• Create Atom feeds from both IMS transactions and IMS databases• Use tooling support from Rational Developer for System z and IMS Enterprise Suite DLIModel

utility – IBM WebSphere sMash — provides an agile, dynamic scripting environment and an

integrated runtime component for building and running REST-style services on top of IMS Connect API using the 3 languages (Groovy, Java and PHP)

� Offer for IMS Customers – IBM Mashup Center V2 to IMS 10 & IMS 11

customers for free – Use limited to IMS and two SQL data servers

in support of IMS solution

http://www-01.ibm.com/software/data/ims/mashup.html

IMS

DB


Agenda




IMS DB in Perspective

InfoSphere IMS Replication Replication to IMS

IMS 11 Open databaseFast integration in Web 2.0 applications

Decomposed or IntactXML Support

COGNOSOperational Business Intelligence

InfoSphere Classic Data Event PublisherPublication of DB Changes

InfoSphere Classic Replication Server & Classic CDCReplication to Relational

InfoSphere Classic FederationData Federation

Information Integration & Data Synchronization

OPTIM FamilyCreation of Test databases

OPTIM FamilyData Masking

IMS Tools – Guardium Tools (planned)Audit for every access

IMS Tools – Guardium ToolsCompression and Encryption

Enterprise Data Governance

IMS ToolsReorganization for better performance

IMS ToolsBackup and Recovery Advanced Solutions

Pointer validation & repairHealth Check

DFSMS familyAdvanced Space Management Capabilities

Data Management

IMS 11 Open DatabaseOpen Access and Data Integration

IMS JavaJava SQL support (JDBC)

COBOL, PLI, C, … JAVAMulti-language AD support

Application Development

1/2 the MIPS and 1/2 the DASD of relationalPerformance without CPU extra cost

IMS Data SharingHigh Availability

HALDB & DEDBHigh Capacity

Native Quality of Services


z/OS Database Manager Positioning

� Hierarchical – Operational Data– Utmost performance– Real time mission critical work – Bill of materials applications– Complex data structures with many levels

� XML – B2B– Document exchange and storage

� Relational – Warehousing– Complex queries– Decision support – Tabular data – accounting data

33

CUSTOMER

BILL

COMMAND

ARTICLEPRODUCT

CUSTOMERCUSTOMER

BILLBILL COMMANDCOMMAND

PRODUCTPRODUCT

ARTICLE


Enhancing IMS DB Openness and Integration

� Access to IMS DB with traditional IMS API– Using “DL/1 Calls” from traditional application, support for many languages– In CICS or IMS transactions, in IMS standalone batch or BMP

� Access to IMS DB with relational API– Using JDBC SQL calls for Java programs on z/OS or distributed

• Implemented by IMS Java component of IMS• Distributed access enhanced with IMS 11 Open Database – Full DRDA Support• Based on a relational view provided by IMS Enterprise Suite DLIModel Utility

� Using IMS DB to store XML data– Like IMS DB, XML data is hierarchical

• It is simple to map IMS data into XML documents.• All IMS databases are Virtual XML Databases


IMS Open Database Overview

IMS DB

z/OS LPAR

SCI

PC

DRDA RYO Client

CSL RYO Client

SCI

CICS

Stand-alone* Java DL/1

Stand-alone* JDBC

JavaEEJDBC

Application Types

IMS Connect

D

R

D

A

Note: In addition, you can use the CCI programming style in a

JEE environment to access IMS databases using either

simple SQL calls (non-JDBC) or simple DL/1 calls

* In this context, “stand-alone” means “standalone Java SE”

ODBM IMSODBA

TCP/IP

JavaEEJDBC

Stand-alone* JDBC

Stand-alone* Java DL/1

e.g.

WAS

e.g.

IMS TM

SCI


Information Governance Creates Order out of Information Chaos

� Information Governance is the exercise of decision rights to optimize, secure and leverage data as an enterprise asset.

– Safeguards information – Ensure highest quality– Manage it throughout lifecycle

� Governing the creation, management and usage of ent erprise data is not an option any longer.

� It is– Expected by your customers– Demanded by the executives– Enforced by regulators/auditors


Data Governance

Manage Data Lifecycle

•Data Retention•Data Retirement

Secure•Prevent Access• Restrict Access• Monitor Access

Protect & Privacy•Mask Data•Encrypt Data

Audit•Audit Privileges•Audit Users•Audit Access

DB2/RACF Security

Tivoli zSecure Audit

Audit Mgt. Expert (AME) for IMS

Guardium and AME for DB2

Tivoli zSecure

InfoSphere Guardium Data

Encryption for DB2 and IMS Databases

Optim Test DMOptim Data

Masking Option

Optim Data Growth Solution

IBM is the only solution provider with an end to en d comprehensive solution

Reduce risk fromSecurity breaches

Protect sensitive customer and employee data

Comply with internal and external auditing requirements

Archive inactive dataand reduce amount of dataexposed and requiring protections.

Enterprise Data Governance for System z


Current

Production

Historical

Selective Retrieval

Retrieved

Universal Selective Access to Application Data

Managing Data Growth in Production – OPTIM Data Growth

Archives

Reporting

Data

Historical

DataReference

Data

Selective Archive

Optim

� Segregate historical data to secure archive

� Align performance to service level targets

� Reclaim underutilized capacity

� On z/OS: Support for DB2, IMS DB, VSAM– IMS DB and VSAM support provided by Distributed Data growth based on Classic Federation on

z/OS and InfoSphere Federation Server– Native support on z/OS planned

© 2011 IBM Corporation39 39

Managing Test Data in Non-Production – OPTIM Test Data Management

� Create right-sized test environments, providing sup port across multiple applications, databases and operating systems

� Deploy new functionality quicker and with improved quality & customer satisfaction

� Compare results during successive test runs to pinp oint defects and errors

� On z/OS: Support for DB2, IMS DB, VSAM

100 GB

Development

100 GB

Test 100 GB100 GB

Training

100 GB100 GB

QA

Production or

Production Clone Subset

1 TB

http://www-01.ibm.com/software/data/data-management/optim/core/test-data-management-solution-zos

© 2011 IBM Corporation40 40

Data Masking and Protection - OPTIM Data Masking Option

� Reduce risk of exposure during data theft– Fines and lawsuits– Avoid the negative publicity– Customer loss– Loss of intellectual property

Personal identifiable information (PII) is maskedwith realistic but fictional data for testing & development purposes.

http://www-01.ibm.com/software/data/data-management/optim/core/data-privacy-solution-zos/

� De-identify for privacy protection

� Deploy multiple masking algorithms

� Provide consistency across environments and iterations

� No value to hackers

� Enable off-shore testing

� On z/OS: Support for DB2, IMS DB, VSAM–Compare “before” and “after” images of test data for DB2


ISPF

Workstation

Repository Services

Data Access Services

Archiving Services

Subsetting Services

Data Privacy Services

Open Data Management

Security

Server

Storage Independent ArchiveStorage Independent Archive

IndexIndexDataData

Metadata

Artifacts

Storage Independent ArchiveExtract & Archive Files

IndexIndexDataData

Metadata

Artifacts

DataData

Metadata

Artifacts

ODBC/JDBC

DB2Optim

Directory

IMS

IMS Native Access

Orders Products

DB2

DB2 Access

Employee Payroll

VSAM / SEQ Files

Native Access

Customers Payments

OPTIM Test Data Management and Data Privacy


Secure & Protect High Value Databases - Guardium Real-Time Database Monitoring

� Non-invasive architecture

� Heterogeneous, cross-DBMS solution

� Does not rely on native DBMS logs

� Minimal performance impact (2-3%)

� No DBMS or application changes

� Activity logs cannot be erased by attackers or rogue DBAs

� Automated compliance reporting, sign-offs & escalations (SOX, PCI, NIST, etc.)

� Granular, real-time policies & auditing

� Locate and assess vulnerabilities in db security

DB2 & DB2/z

http://www-01.ibm.com/software/data/guardium/


extract, transform, load

BusinessApplication

Message Queue

ETL

Multiple Data Delivery Methods for Enterprise Needs

Bulk Data Delivery

Region 1 Product

Performance

Region 2 Product

Performance

Analytical & Reporting Tools

Web Applications

Product Performance

Real-time Inventory Level

federation

Virtual Data Delivery

Database

Incremental Data Delivery

PrimaryDatabase

BackupDatabase

change data capture

change data capturechange data capture

change data capture


Leverage Critical “Classic” z/OS Data Resources in Today’s EnvironmentFederation – Publication - Replication

� Leverage your z/OS data resources

� Optimize bandwidth utilization

� Enable real-time data warehousing

� Reduce dependence on batch window

z/OS

DB2z/OS

IMS

QSAMVSAMPDS

CADatacom

CAIDMS

SAGADABAS

Application or

ETL Tool

ExtractClassic Fed

Load / UpdateData Warehouseor

Other Relational container

Classic EP,Classic Rep

Publish Changes


Federation - Access your IMS data as well as many other z/OS data sources

� Read-from & write-to mainframe data sources– Using standard ODBC, JDBC or Call-Level-

Interface SQL– Without database/file unique API skills

� Metadata-driven means– No mainframe programming required – Leverages COBOL & PL/I copybooks, DBD

source, etc.

� Deliver mainframe data to– Self-service portals … e.g. accurate account

details– e-commerce solutions … e.g. up-to-the-

second inventory– Reporting and analytical tools such as

Cognos– Data transformation and cleansing tools such

as DataStage and QualityStage for data warehousing, ODS, MDM, etc.

z/OS

MetadataCatalog

Classic Server

ClassicData Connectors

ClassicDataArchitect

Distributed

platform

Tool Application

Classic Client

COBOL or PL/Icopybooks IMS,

IDMS, Datacom,

and Adabas databasesVSAM & seq. files

JDBC / ODBC / CLI drivers


Publication - Capture and Publish IMS DB Changes

� Near real-time changed-data capture & push to:

– ETL tool for incremental updating of a data warehouse

– Application integration to drive downstream processes

– Portals & other Web-based interfaces to stream live data

� Capture data “events”– Monitor source specific logs, journals, etc – Capture changes as they happen– Fully recoverable

� Format data for optimized utilization– XML for broad consumption– Delimited values to reduce message size– “Raw” format to optimize performance with

DataStage

� Deliver data for consumption– WebSphere MQ for global delivery– File-based interface to optimize performance

with DataStage

Changes

z/OS

metadatacatalog

WebSphere MQ

IDMSJournaling

ClassicData Architect

Adabaslogging

IMSlogging

MVSlog

VSAM

CICS Auto-

journal

Change Capture Agents

Classic ServerCorrelation &

Distribution/Publication

"raw"data


Replication – From IMS DB to Relational

� High speed unidirectional replication for:– Creating relational copies of nonrelational data – Assisting in DB modernization – Enabling high-availability VSAM environments

MQQueues

Replication Server TARGET

TGT3

TGT1

Q ApplyBrowser

Apply Agent

Apply Agent

Apply Agent

TGT2

METADATA

Changes

z/OS

metadatacatalog

IDMSJournaling

ClassicData

Architect

Adabaslogging

IMSlogging

MVSlog

VSAM

CICS Auto-

journal

Change Capture Agents

Classic ServerCorrelation &

Distribution/Publication

Classic Replication Server SOURCE

© 2011 IBM Corporation4848 January, 2011

InfoSphere Classic CDC – Announced May 2011

� Enable IMS Databases on z/OS as InfoSphere CDC Sourc es – Classic CDC provides the IMS SOURCE capabilities– TARGETing done by CDC on z/OS OR LUW

� Unidirectional movement of IMS data to– Local or remote RDBMS– Message queues– Flat files– Transformation engines, e.g. InfoSphere DataStage

� Classic CDC IMS “Capture” supports – DB/TM, DBCTL, Batch DL/I – Capture x’99’ log records

� Basic replication monitoring in the initial release via the Management Console

� Multiple modes of incremental delivery – Continuous mirroring

• Apply data changes at the target as it is generated at the source– Scheduled end (periodic mirroring)

• Apply net changes on a scheduled basis– Refresh

• Apply a snapshot version of source system


SOURCE

InfoSphere Classic CDC

Target (CDC Apply)• Receives captured changes • Queries database metadata tables• Applies changes with transactional semantics

ManagementConsole

Classic DataArchitect

MetaData

ClassicCaptureEngine

Replication Replication ChangeChange

DetectionDetectionLRSLRS

Source Databases

Source Database

Logs

TARGET

Target Engine

Comm Layer

Admin APIMetaData

Admin Agent

TCP/IP Apply Agent

Refresh

cdcmonito

ring

config

uratio

n

Access Server


InfoSphere IMS Replication – Announced May 2011

� Unidirectional Replication of IMS data– Release 1:

- Conflicts will be detected- Manual resolution will be required- External initial load of target DB- Basic replication monitoring

� Administration via Classic Data Architect & z/OS co nsole commands

� IMS “Capture” supports – DB/TM, DBCTL, Batch DL/I – Capture x’99’ log records– Increase in log volume due to change data capture records

� IMS “Apply” supports– Serialization based on resources updated by unit of recovery – New IMS Replication Restart Database required


SOURCE SERVER

Classic DataArchitect

ReplicationMetadata

CaptureServices

Source IMS Databases

TARGET SERVER

TCP/IP

IMSLogs

IMS

DBRC API

RECON

ACBLIB

IMSApplyServices

Target IMS Databases

ReplicationMetadata

ACBLIB

BookmarkDB

Admin. Services Admin. Services

InfoSphere IMS Replication – Announced May 2011 …


IBM Data Warehouse and BI System z Solution

� From traditional data warehousing to dynamic wareho using and operational BI– Getting the best of both worlds: z/OS and zLinux

Information Server

for System z

DB2 for z/OS

Data Warehouse

Cognos 8 BIfor

System z

Serving Up Consolidated Enterprise BI

Complete ETLSolution

The Enterprise Data Warehouse

InfoSphere Warehouse Cubing

Services

InfoSphere Warehouse

SQW

Source Systems :DB2

IMS DBVSAM

IBM Smart AnalyticsOptimizer

OLTPdata


Adding IMS database queries to a Business Analytics solution

� Extending your Reporting and BI capabilities to IMS provides

– Real-time access to IMS data for report generating

– Advantages of creating and managing business-related metadata and translating it into visual presentations

– Knowledge to help decision makers know sooner, understand faster, and react quicker than the competition

– Ability to compare performance across dimensions to spot trends and anomalies over time

Windows, Linux, Unix, and zLinux z/OS

Cognos

IMS Univers

al Databa

se Driver

TCPIP

TCPIP

IMS Connect

SCI

ODBM

SCI

ODBA

CTL IMS DB

PC

IMS

TCPIP


Agenda

Final Thoughts




The Message

� IMS continues to be a premier server with architect ed standard interfaces– New products and tools from a variety of vendors provide access to IMS transactions

and data

� Our goal is to leverage IMS as an integral part of the enterprise in the evolving business world through

– Addition of support for complementary standards surrounding IMS connectivity, data representation, and application development

� And to allow you to realize the promise of building a Service Oriented Architecture– Simplify the business environment– Respond to market changes quicker and at less cost


� A NEW Team of “IMS Architecture”Specialists in Europe

– Technical Team Lead: Helene Lyon– Operate across Europe and Africa

� Team Mission– Confirm and secure existing IMS workload

and seek opportunities to derive new benefit and workload on existing systems.

� Job role– Develop database and transaction

management solutions that fully integrate and collaborate with existing IT systems in order to perform a business function, with a focus on the “right fit” positioning of the IMS DB and TM capabilities within those systems.

– Establish and maintain strong technical relationships with client architect team with a focus on improving the satisfaction and technical health

– Position the business value of System z & z/OS

Ask for Help from the NEW European IMS Architecture Team (IAT)


twitter.com/IBM_IMS

Twitter, Facebook, YouTube, LinkedIn, SlideShare, Tumblr and their respective logos may be trademarks or registered trademarks of Twitter Inc., Facebook Inc., Google Inc., LinkedIn Corp., SlideShare Inc. & Tumblr Inc., respectively.

imsmadesimple.tumblr.com

ibm.com/developerworks/mydeveloperworks/blogs/IMS

ibm.com/developerworks/mydeveloperworks/blogs/imscn/?lang=zh

t.sina.com/imschina

www.youtube.com/user/ReThinkIMS

www.slideshare.net/ibmims

www.ims-ug.org

facebook.com/IMSFans

imslistserv.bmc.com

ibm.com/vrm/newsletter/11069

linkedin.com/groups?mostPopular=&gid=1949922

Documents

IMS, Fit For the Future May 2011 - · PDF fileIMS, Fit For the Future May 2011 Helene Lyon ... Cognos IMS TOOLS ... IBM Mashup Center / WebSphere sMash Web 2.0