1143 Cloud options for IBM Integration Bus (IBM IMPACT 2014)

© 2014 IBM Corporation

1143: Cloud Options for IBM Integration BusMatthew Golby-Kirk, IBM UK

Please NoteIBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

IBM Integration Bus This Week – Selected Sessions

Monday• 2.30-3.30 Palazzo H – Integration Featured Session• 4.00-5.00 Palazzo H – What's New in IIB• 5.15-6.15 Palazzo H – Introduction to IIB

Tuesday• 10.30-11.30 Palazzo H – Cloud Integration Options• 10.30-11.30 San Polo 3502 – Meet The Experts• 1.00-2.00 Palazzo H – WESB Conversion• 1.00-2.00 Marcello 4403 – IIB Retail Integration Pack• 1.00-3.15 Murano 3303 – IIB V9 Lab• 2.15-3.15 Palazzo H – Designing for Performance• 3.45-4.45 Palazzo H – Mobile Integration• 5.00-6.00 Palazzo H – DFDL Introduction• 5.00-6.00 Marcello 4402 – Manufacturing in IIB

3

IBM Integration Bus This Week – Selected Sessions

Wednesday• 10.30-11.30 Palazzo H – .NET Integration• 1.00-2.00 Palazzo H – Effective Application Development• 1.00-2.00 Marcello 4403 – IIB Healthcare Integration Pack• 1.00-2.00 San Polo 3503 – Meet The Experts (Repeat)• 2.15-3.15 Palazzo H – Effective Administration• 3.45-4.45 Palazzo H – Applications, Libraries, APIs• 3.45-6.00 Murano 3303 – IIB Open Beta Lab• 5.00-6.00 Palazzo H – Transformation Options in IIB

Thursday• 9.00-10.00 Palazzo H – Predictive Analytics• 10.30-11.30 Palazzo H – BPM Integration• 1.00-2.00 Palazzo H – Modelling Industry Formats• 2.15-3.15 Palazzo H – What's New in IIB (Repeat)

4

© 2014 IBM Corporation5

Cloud and “bas a Service”

! Service Computing Model - “Pay only for what you use”– Computing resources as a utility like:

• Electricity• Office Space

– Purchase specific services with a well-defined contract– Services can be consumed internally or externally

• On-premise• Off-premise• Hybrid

! Application Programming Interfaces or “APIs” - Automation– HTTP and JSON(XML) based protocol for common “business” service tasks

• Business tasks relate to service: infrastructure, platform, software• Enables automation – 'Elastically scalable'


The Value of Cloud

• Deploy systems faster, easier & on demand• Support SLAs for lines of business• Reduce and rationalize IT infrastructure• Reduce cost of operation • Applies to large numbers of systems

• easier to schedule planned updates• fewer unplanned disruptions

• Scale elastically to cope with demand• (Enable chargeback for users)• Ease of deployment and maintenance

• Pay like a utility for IT, reduce our fixed costs and benefit from economy of scale

• Provide on-demand self-service, commoditized IT and give us more choices

• Expect to specify SLA• Rapid on-boarding of developers and rapid

cycle by provisioning standard development and test environments

Line of BusinessCentral IT

• These concerns are the “forever” concerns of Infrastructure teams and LOB

• Increased focus on developers. Killer App, Mobile etc

• Most infrastructure groups have significant backlog of work

• Tension between “do in a hurry” and “do properly” is not desirable


SaaS

IaaS

PaaSInfrastructure as a Service

“Hardware & Environments”

Software as a Service“Applications”

Platform as a Service“Operating System”

IaaS

PaaS

SaaS

The Layers of Cloud


SaaS

IaaS





IaaS

PaaS

SaaS

The Layers of Cloud


! Basic Layer – (Parallels to “Hardware”)– Compute– Memory– Storage– Network Resources

Infrastructure as a Service (IaaS)

! Charged by (Virtual) Machine Capacity

! IaaS APIs:– Create Server, Delete Server– Add Memory, remove memory– Create Environment

! Examples:– Virtualization Providers:

• Softlayer• Amazon EC2• VMWare• OpenStack• Azure• PureSystems

– Automation Tools: • Chef• Puppet• uDeploy• PowerShell DSC

! Many organizations already have experience with these technologies

! Flexibility – Automate creation of a machine that can run any application


SaaS

IaaS





IaaS

PaaS

SaaS

The Layers of Cloud


Platform as a Service (PaaS)! Application Centric View – (Parallels to 'Operating System')

– Applications• J2EE• Spring• Rails• Play

– Services• MongoDB• Postgre SQL• Elastic MQ

! PaaS APIs:– Deploy Application, Destroy Application– Scale Application– List Databases, Bind Application To Database

! Examples:– CloudFoundry– IBM Blue Mix– Heroku– Open Shift

! Developers are trying these platforms today, adoption growing

! Changed by licensed capacity or usage


SaaS

IaaS





IaaS

PaaS

SaaS

The Layers of Cloud


Software as a Service (SaaS)

! Provides access to hosted applications or services

! SaaS APIs:– Dependent on what the solution offers– Examples:

• Query Product• Order Product

! Examples:– SalesForce– Google Apps– Office 365

! Particular applications are very popular

! Trades off hosting flexibility for ease of use

! Usage based charging– Per Hour, Day, Week, Month– Per Transaction


SaaS

IaaS





IaaS

PaaS

SaaS

The Layers of Cloud

These are Independent Concepts

They can be used together, but don't have to be


On-Premise, Off-premise and Hybrid Clouds

! IaaS, PaaS and SaaS can each be on-premise, off-premise or hybrid– Data Sensitity is the key concern

! Motivations– Adding workload: start private, add public capacity– Reducing workload: start private, move to public– Moving workload: start public, move to private

! Economics – Less expensive to use a public cloud

• For low utilization, rental is cheaper• For spontaneous capacity. rental is cheaper• Private Cloud incurs hosting costs

– Match risk to cost as business grows

• Hybrid CloudHybrid Cloud• Private • Cloud

Private Cloud

• Public• Cloud

PublicCloud

On premises/Internal to Company Off premises/Third Party

• Private • Cloud

Private Cloud

• Private • Cloud

Private Cloud

PublicCloud

PublicCloud

PublicCloud

PublicCloud

PublicCloud

PublicCloud

InternetEdge of EnterpriseIntranet


IaaS: Making it easier to provision IBM Integration Bus

There are many diverse choices a user can make in technology:

“I want to reduce the cost of managing my integration infrastructure by having a flexible, dynamic and automated provisioning system which fits with MY choice of infrastructure technology”

IBM Workload Deployer

Most of these technologies are used in Cloud Computing.

IaaS


! Flexible, Automated, Provisioning of Infrastrcuture– Exploits Chef technology, Opscode project (http://docs.opscode.com/)– Allows provisioning on wide variety of Operating Systems

• Initial focus on Linux/UNIX based systems, including Ubuntu 64bit– Chef is general purpose automation tool, particularly popular for configuring VMs– Can compose VM from multiple products by running each product cookbook

! Cookbook is key Chef concept– A cookbook is a library of chef recipes– A recipe script defines set of install, config & setup actions– Limited set of parms exposed in default recipe

• e.g. Server only, full package– Users can create own recipes with variations as required

! Typical Process– Download product binary, save on local HTTP or FTP server– Add Chef recipe to chef server or file system (point at server)– Scripts run on new OS image/node to create Integration Bus per definition

! Chef Solo & Chef Server Deployment Options– Chef Solo for simplified set up

• User pushes cookbooks to target OS image– Chef Server for multiple systems

• e.g. schedule provisioning, auto-provisioning

Making it Easier to Provision Integration BusIaaS


Providing a Chef Cookbook for IBM Integration Bus

A chef cookbook is a library of chef recipes

A chef recipe

A cookbook is created by building a simple directory structure

IIB Cookbook

IaaS

default recipe if none is given by user.

Name of cookbook

Sets machine up to look like the Hypervisor Edition.

is a script to do a well defined set of:

! Install, Config and Setup actions.

Based on


What the user has to do...

Download the install images for IBM Integration Bus.

Setup HTTP or FTP server with install images.

Add IBM Integration Bus chef cookbook to chef server

(or add to file system if using chef solo).

Set attributes to point to FTP/HTTP server.

Run chef scripts on new node.

Download the Chef Cookbook for IBM Integration Bus.

Full system set up:"Runtime, Toolkit, MQ, Explorer."Operating system tuned."User account created."Broker created and started.


Using Chef solo

!Chef-solo allows a simplified setup with no need for a server.

!Workstation can push cookbooks and other files directly to image.

!They are then run using the chef-solo version of the chef client.

IaaS


Using Chef client and serverIaaS


Development unit test environments defined in chef ...

Chef attributes currently in recipe Full spec for developer setup

! Uses the publically available single package developer edition.

! Runs on 64bit Ubuntu, 64bit RHEL.

! Chose between two recipes:– default – installs everything including setting up a default configuration– runtime – installs everything except the toolkit

! Everything else controlled through cookbook attributes that can be defined in json/yaml.

Attributes impliedbut not exposed

IaaS


Test, QA and Prod systems environments defined in chef ...

! Exactly the same install package as developer edition.

! Works on both: Ubuntu 64 bit and RHEL 64 bit.

! Exactly the same cookbook and the same two recipes: – default – installs everything– runtime – installs everything except the toolkit

! Controlled through attributes and databag items:– Operations mode can be chosen:

• Advanced, standard, express ...– Allow multiple IIB nodes.– Format identical to IIB REST IIB json.– Configure node, server and queue manager details.

Chef databag item: “dev_1” Iaas

Contents based on REST API JSON


Databag features.

Chef databag: Full “dev_env_1”

Structure is identical to the JSON from a get request to the IIB REST API.

Chef databag: Subset “dev_env_1”

Properties used by recipe

Other properties ignored

! Very powerful mechanism where a REST call can be made to an IIB node and the response use to create a new broker with the same properties.

! Allows backing up and restoring a broker onto a new vanilla machine.

! Only basic properties to start with but can be expanded to include everything:– Polices and configurable services– Deployed bar files

IaaS


Machine A

Setting up a complex system on a single machine...

PROD_NODE_2

Server_1Server_2

Server_4Server_3PROD_NODE_1

Server_1Server_2

Server_4Server_3

PROD_NODE_3

Server_1Server_2

Server_4Server_3

Chef Role


Mac

hine

CM

achi

ne B

Mac

hine

A

Setting up a complex system on multiple machines...

PROD_NODE_2

Server_1Server_2

Server_4Server_3

PROD_NODE_3

Server_1Server_2

Server_4Server_3

PROD_NODE_1

Server_1Server_2

Server_4Server_3


Open Source

! Cookbook hosted publicly on GitHub

! Opscode Community Site (http://community.opscode.com/cookbooks/ibm_integration_bus)

! Licensed under the Eclipse Public License

! Natural Extension points– Additional properties

• Integration Node• Integration Server

– Policy– Deployed BARs

! Contributions are welcome!

Available from: https://github.com/ot4i-cookbooks/ibm_integration_bus


Testing chef recipes – Test kitchen

! No, I am not making the names up.

! Integration test harness for Chef Cookbooks– Open source available on Github– Configured via a .kitchen.yml file– Use to add tests to ibm_integration_bus Cookbook

! What it doesb– Uses Vagrant to create & access a VM– Installs Chef Client– Uploads relevant files– Runs recipes using Chef Solo

! Enables smoother contribution process– Speedy verification process– Faster “time to known quality”

https://github.com/test-kitchen/test-kitchen


SoftLayer Compute InstanceSoftLayer Compute Instance

IIB on Softlayer using Chef

Product install imagesProduct install images

SoftLayer Compute Instance Node

MQ, IIB, b

SoftLayer Compute Instance Node

MQ, IIB, b

SoftLayer Management

Provision Compute Instance

Provisioning script bootstrap

Two approaches:"Provisions SL server then use knife bootstrap to add the node/install client"Provisions SL server with provisioning script that installs the client and adds the node

IaaS

Questions?

We Value Your Feedback

Don’t forget to submit your Impact session and speaker feedback! Your feedback is very important to us – we use it to continually improve the conference.Use the Conference Mobile App or the online Agenda Builder to quickly submit your survey

• Navigate to “Surveys” to see a view of surveys for sessions you’ve attended

31

Thank You

Legal Disclaimer

• © IBM Corporation 2014. All Rights Reserved.• The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained

in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

• References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

• Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

• All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

• Lotus® Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation. IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

• Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.• Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.

Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

• UNIX is a registered trademark of The Open Group in the United States and other countries.• Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of

others.

Technology

1143 Cloud options for IBM Integration Bus (IBM IMPACT 2014)