How I successfully designed,

Implemented and Monitored

IBM INFOSPHERE EVENT PUBLISHER

: My Experience 04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 1

2

Requirement

04/13/2023DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc

Asked by e-commerce client to write input feed for Netezza data warehouseData feed should land at staging server • Delimited format as Column delimiter | (pipe)• Character delimiter ‘`’ (acute) Decided to

use Event Publisher After Looking at source, Target and OS

What is Event Publishing ?• It is a subset of Q Replication• Its target is not a table • It has not got Q Apply • Q Capture puts the messages Into MQ websphere Queues• The data messages are written in either XML or CSV

format• It can publish subset of columns and rows• Application program reads destructively/non-

destructively the message Queues

Event Publication Process

04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 3

SourceTab1, Tab2

DB2 Log

Q Capture

Meta DATA

SOURCE

Replication CenterReplication Monitor

Replication Dashboard

ASNCLP Commands

ADMINISTRATION

MQ MESSAGE BROKER

USER Application

TARGET

WBI Event Broker

DB2 MQ Listener

User Stored Procedure

User Application

04/13/2023DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc

4

EVENT PUBLISHING SETUP FOR NETEZZA

pdbin006@aixdb313p

Instance "pdbin006" uses "64" bits and DB2 code release

"SQL09072" with level identifier "08030107".

Informational tokens are "DB2 v9.7.0.2", "s100514",

and Fix Pack "2".Product is installed at "/udb/

pdbin006/IBM/db2/V9.7".

MQSERVERQMGR NAME : SQLP0232

RESTART QUEUE: ASN.RESTARTQ

ADMINQ : ASN.ADMINQSENDQ : NETEZZA.PUB.QL01PUBLISHING QUEUE MAP :

XCHREPP_EVP_TO_XCHTEZZA_EVP01

DBNAME : REPPSCHEMA : EVP01

CAPTURE LOG :/install/db2/caplog

Submitted By :Renu Sharma 05/03/2011

MQ CLIENT Name: WebSphere MQ

Version: 6.0.2.10CMVC level: p600-210-100825

BuildType: IKAP - (Production)

04/13/2023DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 5

Setting up Event Publisher Components

Installing InfoSphere Data Event Publisher using ./ISEPSETUP Register license key of InfoSphere Data Event Publisher db2licm –a isep.licGet QMGR and MQ Objects created by MQ Administrator

QMGR NAME : SQLP0232RESTART QUEUE: ASN.RESTARTQADMINQ : ASN.ADMINQSENDQ : NETEZZA.PUB.QL01

Setup following MQ environment Variables on AIX OS:export ASNUSEMQCLIENT=TRUEexport MQCHLLIB=/var/mqmexport MQCHLTAB=AMQCLCHL.TAB

Create Control Tables

ASNCLP SESSION SET TO Q REPLICATION;SET SERVER CAPTURE TO REPP DB REPP ID evpbusr1 password "password";SET QMANAGER "SQLP0232" FOR CAPTURE SCHEMA;SET CAPTURE SCHEMA SOURCE EVP01;SET OUTPUT CAPTURE SCRIPT "epcontrol.sql";SET RUN SCRIPT LATER;CREATE CONTROL TABLES FOR CAPTURE SERVER USINGRESTARTQ "ASN.RESTARTQ" ADMINQ "ASN.ADMINQ"SLEEP INTERVAL 1000;QUIT;

asnclp –f asnevpcntrl.qrpdb2 –tvf epcontrol.sql

04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 6

Create Publishing Q MAPSET LOG "pqmap.err";SET SERVER CAPTURE TO DB REPP ;SET CAPTURE SCHEMA SOURCE EVP01;SET OUTPUT CAPTURE SCRIPT "pqmap01.sql";SET QMANAGER "SQLP0232" FOR CAPTURE SCHEMA; SET RUN SCRIPT LATER;CREATE PUBQMAP XCHREPP_EVP_TO_XCHTEEZA_EVP01 USINGSENDQ "NETEZZA.PUB.QL01" MESSAGE FORMAT DELIMITEDMESSAGE CONTENT TYPE TMAX MESSAGE SIZE 128;asnclp –f epqmap.qrpdb2 –tvf pqmap01.sqlTo setup LOAD feed format: db2 "update evp01.IBMQREP_SENDQUEUES set COLUMN_DELIMITER = '|'"db2 "update evp01.IBMQREP_SENDQUEUES set DECIMAL_POINT = ‘.'“db2 "update evp01.IBMQREP_SENDQUEUES set STRING_DELIMITER = ‘`’"

04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 7

Create PublicationASNCLP SESSION SET TO Q REPLICATION;SET LOG "pub.err";SET SERVER CAPTURE TO DB REPP ID DB2ADMIN password “XXX”;SET CAPTURE SCHEMA SOURCE EP1; SET OUTPUT CAPTURE SCRIPT "pub.sql";SET RUN SCRIPT LATER;CREATE PUB USING PUBQMAP XCHREPP_EVP_TO_XCHTEZZA_EVP01(PUBNAME "DEPARTMENT0001" DB2ADMIN.DEPARTMENT ALL CHANGED ROWS Y SUPPRESS DELETES Y);QUIT;asnclp –f asnpublication.qrpdb2 –tvf pub.sqlasnqcap capture_server=REPP capture_schema=EVP01 capture_path=/install/db2/caplog startmode=coldView the messages using :asnqmfmt NETEZZA.PUB.QL0 SQLP0232Data was written at staging server using a JAVA CODE

04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 8

9

Some monitoring SQL’s To Know

04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc

Querying the Status of Q Captureasnqccmd capture_server = SQLP0232 status show detailsStarting and Stopping the Publication :INSERT INTO EVP01.ibmqrep_signal (signal_type,signal_subtype, signal_input_in, signal_state ) VALUES ( 'CMD','CAPSTART', 'DEPARTMENT0001','P');INSERT INTO EVP01.ibmqrep_signal (signal_type,signal_subtype, signal_input_in, signal_state ) VALUES ( 'CMD','CAPSTOP', 'DEPARTMENT0001', 'P');Status of sendq:SELECT sendq,state FROM EVP01.ibmqrep_sendqueues;Status of restartq:SELECT SUBSTR(qmgr,1,10) AS qmgr, SUBSTR(restartq,1,20) AS restartq FROM EVP01.ibmqrep_capparms ; Status of Q subscription:SELECT SUBSTR(subname,1,10) AS subname,state AS s, state_time FROM EVP01.ibmqrep_subs;

04/13/2023 DB2's GOT TALENT FINALS #2 BY Renu Sharma ACE DBA CONSULTING Inc 10

Links and resources Please Vote For me

InfoSphere Replication Server and InfoSphere Data Event Publisher Version 9.7 product documentation in PDF formathttp://www-01.ibm.com/support/docview.wss?uid=swg27016356

My contact and blog info : Renu SharmaACE DBA Consulting Incwww.db2dbas.comrenusharma@db2dbas.com, renusharma@aol.com732-342-7630, 732-995-9963,732-374-3601Facebook :https://www.facebook.com/home.php#!/pages/ACE-DBA-Consulting/138802816289257Twitter : @db2_dbasLinkedin : http://www.linkedin.com/home?trk=hb_tab_home_top