InterConnect 2016: What's new in IBM MQ

© Copyright IBM Corporation 2016

HHM-3592 Hybrid Messaging: How New MQ Features Enhance Capabilities On-premise and in the CloudDavid Ware

Andrew Schofield

Pete Siddall


Please Note:

2

• IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s solediscretion.

• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.

• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

• Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.


Speed & Agility

Integration & Scale

Core Enterprise

Digital Ecosystem

Dig

ital

te

ams

Ente

rprise IT

team

s

4

Speed and agility to drive innovation and growth• Explore, adopt, adapt• Rapid, Iterative prototypes

Reliability, security and scalability for Business Critical systems• Always on, always available• Security, control and governance

Digital Transformation = Many Modes of IT


Digital IT Enterprise IT

Message Hub(Based on Apache Kakfa)

MQ Light API

MQ Light API5

Enterprise Messaging & Integration

Hybrid Messaging

MQ ExplorerMQ ClientMQ Light API

Kafka API REST API IBM MQ Appliance

Bluemix Public

Bluemix Dedicated(Announced, GA March)

Bluemix Local(Coming soon)

IBM MQ

Cloud

On-Prem

Cloud

On-Prem

IBM Message

Connect


IBM MQ V8


Platforms & Standards

Security ScalabilitySystem z exploitation

64-bit for all platforms

Userid authentication via OS & LDAP

Multiplexed client performance

64-bit buffer pools in MQ for z/OS means less paging, more performance

Multiple Cluster Transmit Queue on all platforms

User-based authorisation for Unix

Queue manager vertical scaling

Performance and capacity

Support for JMS 2.0

AMS for IBM i & z/OS

Publish/Subscribe improvements

Performance enhancements for IBM Information Replicator (QRep)

Improved support for .Netand WCF

DNS Hostnames in CHLAUTH records

Routed publish/subscribe

Exploit zEDCcompression accelerator

SHA-2 for z, i & NSS

Multiple certificates per queue manager

SMF and shared queue enhancements

IBM MQ V8 delivering best in class enterprise messaging

7




64-bit for all platforms








Support for JMS 2.0












• Availability:

– May 2014 (eGA Distributed)

– June 2014 (z/OS and

pGA Distributed)

• FixPack 4 on Distributed

platforms now available

8




New platforms with 64-bit for all








Support for JMS 2.0












• Aligned MQ across its distributed

platforms, and z/OS

• 64-bit server support for all queue

manager platforms

• New MQ platform, Power Linux

little-endian

Statement of Direction for MQ V8 on

HP NonStop

9












Support for JMS 2.0












• Long-awaited update from the JMS 1.1 standard

• New Messaging Features

– Delivery Delay

– Asynchronous Send

– Subscriptions can be shared across a messaging provider

• API improvements

10





Useridauthentication via OS & LDAP







Support for JMS 2.0












• Is the application who they say they

are?

• The ability to require a connecting

application to provide a userid and

password

• Authentication against OS or LDAP

user repositories

QMgr

Application

Application

?

?

LDAP

11Sessions 3433 and 3429 for security












Support for JMS 2.0












• Enhanced vertical scaling for

distributed queue managers

– Less targeted at internal benchmarks,

favouring more realistic scenarios

12Session 3450 for optimising applications












Support for JMS 2.0












• 64-bit address space available for

buffer pools

– Each buffer pool can be much larger

• Number of buffer pools can match

page sets

2 GB BAR

Queue Manager Address Space

Max 1.6GB

Max 16EB

CODE

DATA

BufferPool

BufferPool

BufferPool

BufferPool

BufferPool

BufferPool

BufferPool

BufferPool

DATA

13Session 3470 for latest z/OS features


…and since MQ V8


Incremental features

• MQ V8 is on its fourth fixpack

• These have contained more than just fixes…

15


Distributed Fixpack 2

• Built on the new LDAP features in MQ V8 to support authority records for

LDAP users and groups

– No need to define OS users/groups for applications

– Supported for Unix, Linux and IBM i

• Activity trace data extended to include microsecond call durations

16Session 3452 for more on Activity Trace



• Support for authentication via PAM on Unix platforms

– Configure authentication to go via PAM modules

– Gives more flexibility in mechanisms for verification and account validation

• Protection against SSL security vulnerabilities

– This was the time of Heartbleed, POODLE, BEAST, FREAK, Bar Mitzvah, LogJam, …

– Before V8.0.0.3, 44 different CipherSpecs to choose from

– With V8.0.0.3, subset of just 17 CipherSpecs

• Extended start events

– Allows system monitoring applications to see when a multi-instance queue manager

has failed over and where it is now running

Includes z/OS

17



• Capped message expiry

– Administratively impose minimum expiries

– Applies to queues and topics

• Redistributable clients

– Simple tar/zip image for Windows and Linux

– Permitted to embed clients with applications

• Security change configuration events

– Coverage for all security changes

– Includes new event formatting sample

• Obfuscation of database passwords

– Queue manager configuration for connecting to resource managers

Includes z/OS

18


Enhanced Java SE support for MQ JMS on z/OS

• CICS Transaction Server

– MQ JMS applications in a CICS OSGi JVM server

– CICS TS V5.2+/V5.3

– IBM MQ V7.1+/V8+

• IMS

– MQ JMS applications in IMS

IMS V13 (MPR, BMP, IFP, JMP, JBP regions)

– MQ V8+

Statement of Direction to provide MQ

JMS in CICS Liberty

19Session 3481 for z/OS connectivity


Additional Active Logs on z/OS

• Maximum active log capacity increased 10x

• Improve resilience to issues affecting log archiving

• Now up to 310 x 4GB active logs.

• MQV8+

21Session 3470 for latest z/OS features


The IBM MQ Appliance


• The scalability, security and reliability of IBM MQ V8

• The convenience, fast time-to-value and low total cost of

ownership of an appliance

• Built in high availability and disaster recovery capabilities

• Ideal for use as a messaging hub running queue managers

accessed by clients, or to extend MQ connectivity to a remote

location

• Familiar feel for existing MQ users – application interfaces,

administration, networking/clustering, security….

The IBM MQ Appliance

Sessions 3456, 3458, 3465 for the appliance 24


MQ Appliance high availability and disaster recovery

• Fully built-in HA and DR capabilities

– No external components required

– Per queue manager active/passive

topologies

• High availability

– Short distance configurations

– All recoverable data replicated immediately

– Failures automatically detected and queue

managers restarted

• Disaster recovery (firmware update 4)

– Long distance configurations

– Manual queue manager takeover

Synchronous replication

Automatic takeoverAsynchronous replication

manual takeover

Sessions 3456, 3458, 3465 for the appliance

Statement of Direction to

support combined HA

and DR deployments

25


MQ Appliance console

• Browser-based UI for

administering the appliance

– Administration

• Configuration of the appliance

and the MQ resources

– Monitoring

• Exposes machine level

metrics

• And MQ operations

Sessions 3456, 3458, 3465 for the appliance

Statement of Direction to provide the

console across multiple MQ platforms

in the future

26


New MQ environments


IBM PureApplication

28

• PureApplication provides a fully integrated IaaS for

automated provisioning of machines and software

deployments

– Available as a hardware system, software or a Softlayer service

– Repeatable and reliable MQ deployments for consistency

• MQ vSys.Next Support in IBM PureApplication V2.0

from MQ V8.0.0.3 onwards

– Concept similar to hypervisor but software components separated from O/S

– Drag and drop MQ onto Core O/S image to compose VM configuration

• Management and maintenance of MQ via PureApp console

• Pattern support for highly available queue managers

• Power/AIX support added to Linux x86 support with MQ 8.0.0.4

Off-prem in Dedicated

SoftLayer datacenters

worldwide

On-prem Bring Your Own

Hardware

On-prem Appliance


MQ in Docker

• MQ 8.0.0.4 supported to run inside a Docker image.

Details: https://ibm.biz/mqdocker

• Brings the benefits of Docker to MQ

– Lightweight containers for running MQ

– Predictable and standardized units for deploying MQ

– Process, resource and dependency isolation

• IBM sample Docker files for customizing and building

your own Docker images

– Best practice guidance

– Runs an MQ queue manager inside a container,

isolated from the rest of your system

29

https://ibm.biz/mqdocker


Supporting MQ deployed to the cloud

• Enterprise applications are expanding beyond the

datacentre and asynchronous Enterprise Messaging is

the easiest and most efficient way to bridge between the

applications in globally distributed cloud datacentres.

– MQ offerings available on popular public cloud platforms

• E.g. Azure, EC2, Softlayer

• Monthly or hourly license options for MQ are available

• Or BYOL

– Or build your own VM or container and deploy

30


Using MQ as a service

• Not an environment, more a lifestyle choice!

• Addresses the increasing demands on agility and scale of

messaging infrastructures

• As a service goes hand in hand with self service

• Many clients have built MQ as a service today

– Orchestration and automation of MQ resources

• E.g. IBM Urbancode Deploy, Chef, Puppet, etc.

– Running on bare metal or in a cloud

• Redpaper now available http://ibm.biz/mqaas_red

Sessions 2931, 3613 for as a service 32

http://ibm.biz/mqaas_red


MQ ecosystem – what’s new

33

Running MQ in Docker is now supported

for production usehttps://github.com/ibm-messaging/mq-docker

Sample cookbook for installing and

configuring MQ using Chefhttps://github.com/ibm-messaging/mq-chef

https://github.com/ibm-messaging/mq-docker

https://github.com/ibm-messaging/mq-chef


MQ ecosystem – what should we do next?

Architect

DevelopDeploy

Operate

34


MQ Light


MQ Light : Software and Cloud

Messaging that application developers

will love to use, helping them make

responsive applications that scale

easily

A very simple messaging API

Multiple ways to access MQ Light

– An MQ Light software download for developers

– A managed Bluemix service

• Message Hub (MQ Light support coming soon)

– Directly connected to MQ V8

Sessions 3540 and 3544 for MQ Light 36


Connecting MQ Light applications to MQ

• MQ Light applications connect directly into

MQ queue managers

• A new MQ channel type of “AMQP”

– Supported from MQ 8.0.0.4

– Similar in style to an MQTT channel

– Supports the subset of the AMQP 1.0 Oasis

specification required for MQ Light applications

• MQ Light applications interoperable with all

other MQ applications

– All share the same topic space

C

JMS

MQTT.NET

COBOL

QMgr

QMgr

QMgr

37Sessions 3540 and 3544 for MQ Light


Message Hub


Hybrid Cloud MessagingDigital IT Enterprise IT

Cloud

On-

Prem

Cloud

On-

Prem

MQ Light Software(Local stand-alone Server)

App AccessPartner

Traditional Data Centre

Enterprise MessagingMQ

Light

API

HSecure

Gateway

Message

Hub

MQ Light API REST Kafka Client

Cloud

Data

Services

Apache

Spark

Watson

BluemixAs-a-service

on-prem

management

of MQ

PureApp

Cloud

PureApp SW

PureApp HW

Dev-ops

CI/CD

Monthly

Session 3499 for Message Hub 39


What does Message Hub enable?

40

Hub for asynchronously

connecting services inside

Bluemix or beyond

Applications connected to

events happening in other

Bluemix services, or from

beyond the cloud

Insights from the data you already have

Data needs to be streamed from anywhere to one or

many analytics engines

1 2

3

Microservices allow

applications to evolve rapidly

Open protocols support

polyglot runtimes,

application controlled

behavior and reactive

scale

MQ

plus other

on-prem data sources

4


Why Apache Kafka?

41

Fast: Responds to your needs

Scalable: Scales according to demands

Durable: Prevents data loss

Distributed: Fault-tolerant

Used by companies

including:

LinkedIn

Yahoo

Twitter

Netflix

Spotify

Pinterest

Paypal

Tumblr


Going forward with MQ


Version X, MQ long term service

X.0.0.1 X.0.0.2 X.0.0.3 X.0.0.4 X.0.0.5 X.0.0.6 ……

Stable and Rapid Delivery

Version X+1, MQ long term service

43


Version X, MQ long term service

X.0.0.1 X.0.0.2 X.0.0.3 X.0.0.4 X.0.0.5 X.0.0.6 ……

Stable and Rapid Delivery

Version X+1, MQ long term service

Statement of Direction

X.0.1

X.0.2

X.0.3

X.0.n

(X+1).0.1

(X+1).0.2

(X+1).0.3

Fixes only. No mid-service function.

Same 5+3 service lifetime

LTS releases every couple of years

Fixes, plus new function

New delivery every few months

Fixes on latest mod only

44


IBM MQ early access programs

Interested in hearing about the future direction of MQ?

Want to influence the shape of features while they’re still on the drawing board?

Want access to early drivers?

Join any of the IBM MQ early programs

IBM MQ v.Next early program

IBM MQ Appliance early program

IBM MQ on HP Non Stop Server early program

Talk to your IBM contact, alternatively email [email protected] for further details

45


Where do I get more information?

IBM Messaging developerWorks

developer.ibm.com/messaging

IBM Messaging Youtube

https://www.youtube.com/IBMmessagingMedia

LinkedIn

Ibm.biz/ibmmessaging

Twitter

@IBMMessaging

IBM MQ Facebook

Facebook.com/IBM-MQ-8304628654/


Monday

10:30-11:30 3592 New MQ features

3452 Managing applications

12:00-13:00 2835 MQ on z/OS and Distributed

15:00-16:00 3470 Latest MQ z/OS features

2833 Where is my message?

3544 MQ Light in an MQ infrastructure

16:30-17:30 3573 Hybrid cloud messaging

2941 MQ Advanced

Tuesday

08:30-09:30 3540 The MQ Light API

12:00-13:00 3456 The IBM MQ Appliance

13:15-14:15 3499 Introducing Message Hub

3458 MQ Appliance administration

14:30-15:30 6432 MQ updates and futures (InnerCircle)

2849 Messaging feedback roundtable

16:00-17:00 3544 MQ Light in an MQ infrastructure

3513 MQ hands on lab

Wednesday

08:30-09:30 3602 Managing your MQ environment

12:00-13:00 3613 Designing MQ self service

6408 Hybrid messaging roadmap (InnerCircle)

13:15-14:00 3416 HA and DR with MQ

3433 Why secure your messaging?

15:45-16:30 3429 Securing MQ

2847 Meet the messaging experts

16:00-17:00 3508 MQ Light hands on lab

16:45-17:30 2275 Migrating to the IBM MQ Appliance

Thursday

08:30-09:15 3420 MQ Clustering

2931 Business agility with self service MQ

09:30-10:15 3479 MQ z/OS clusters and shared queue

3450 Optimising MQ applications

2849 Messaging feedback roundtable

10:30-11:15 3465 MQ Appliance high availability

3481 MQ z/OS messaging connectivity

11:30-12:15 3474 Active-active messaging

3537 Monitoring and managing MQ

3425 MQ publish/subscribe

Find us at the EXPO:

Hybrid Integration peds 65-68

Check out the Hybrid Messaging sub topic under the

Hybrid Integration topic for further customer and business

partner sessions

Hybrid Messaging from the IBM experts at InterConnect 2016

Sunday

14:30-15:30 6408 Hybrid messaging roadmap (InnerCircle)


Notices and Disclaimers

48

Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written

permission from IBM.

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.

Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of

the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS

DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE

ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS

OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.

Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.

Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how

those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating

environments may vary.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in

all countries in which IBM operates or does business.

Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All

materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any

individual participant or their specific situation.

It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification

and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to

comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance

with any law


Notices and Disclaimers Con’t.

49

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources.

IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to

non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of

any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES,

EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or

other intellectual property right.

IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™,

FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on

Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®,

PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling

Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of

International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other

companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.

http://www.ibm.com/legal/copytrade.shtml


Thank YouYour Feedback is Important!

Access the InterConnect 2016 Conference Attendee Portal to

complete your session surveys from your smartphone,

laptop or conference kiosk.