AAI-1445 Managing Dynamic Workloads with WebSphere ND and in the Cloud

© 2015 IBM Corporation

Session 1445A Managing Dynamic Workloads with WebSphere ND and in the Cloud

Ian RobinsonDE, WebSphere Chief [email protected]

Christopher VignolaWebSphere System Management [email protected]

Agenda

• Dynamic workloads - what and why

• WebSphere – how it supports them

• Why this matters

2

Dynamic Workloads

3

Dynamic Workloads

• Natural consequence of competitive forces

• Cloud as industry response

• Software managed platforms

4

Why this matters to you

• Servers commonly 50% over-provisioned

• Represents huge cost in under-utilized capacity

• Bad habits die hard – even in Cloud

• WebSphere Application Server can help

5

WAS Supports Dynamic Workloads

• Traditional Workloads

• New Workloads

• Traditional Management

• Scalable Management

• Off-premise Cloud

6

Traditional Workloads

Traditional Workloads

• ND Full Profile

• Cell configuration

• Make dynamic through Intelligent Management functions

• Dynamic clusters

• Dynamic routing

Dynamic Clusters

• Application demand-driven capacity

• Policy-driven

• Optional elasticity mode

9

Dynamic Routing

• Web routing tier

• Automatic discovery of dynamic capacity

• On Demand Router

• Java Proxy

• IHS w/WAS Plugin (dynamic mode)

• Datapower

10

Dynamic Cluster/Routing - Topologies (Cell)

11

nodeAgent

AppServersAppServers

AppServers

application

resources

management infrastructure

(IM Connector)

machine boundary

nodeAgent AppServersAppServers

AppServers

Full P

rofile

Workload

Router

ODR, IHS or

DataPower

dmgr

workload

workload

JMX Client

HTTP ServerOn Demand Router

WAS Full ProfileServer X

AppsApps

WAS Full ProfileServer Y

AppsApps

Messaging Cluster

WAS ND Application Cluster

WAS Full ProfileCluster Member

AppsApps


AppsApps

Intelligent Management Agents

High Availability Manager

Node Agent Node Agent

Browser Client

DeploymentManager

Admin App

…

CatalogServer

WXS Caching Tier

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

WebSphere

plugin

Intel Mgmt for Web Servers1

1

2

WAS NDAdministrative Cell

Routing information

2 WebSphere eXtreme Scale

3 Dynamic Clustering3

host 2host 1

Topological View

©

2014

IBM

12

New WorkloadsTraditional Management

WAS ND Cells – 2 Options

• Cross-deploy apps to from Liberty to Full Profile

• One-way programming model fidelity

• 100% operational consistency

• Manage Liberty profiles as integral part of ND Cell

• Built on Intelligent Management Middleware Server support

– Available v8.5.5.1

• Basic console/scripting access to Liberty

– config access (i.e. server.xml)

– lifecycle (start/stop/status)

– log access (messages.log, etc)

• Optional dynamic clusters for Liberty

• This is “Liberty Assisted Lifecycle” support

©

2014

IBM

14

WAS ND Liberty Assisted Lifecycle

• Liberty in the

ND cell gives

operations

similar to WAS

full profile.

• Perfect way to integrate

operational practice

across both profiles types.

dmgr

nodes

ND Cell

DBHTTP

proxy

node

agent

app

server

app

server

node

agent

app

server

app

server

liberty

liberty

We like reusing

our existing

operational

infrastructure

I like the lightweight

development

experience

©

2014

IBM

15

JMX Client

HTTP ServerOn Demand Router


AppsApps


AppsApps

Messaging Cluster



AppsApps


AppsApps




Browser Client

DeploymentManager

Admin App

…

CatalogServer

WXS Caching Tier

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

WebSphere

plugin


1

2


Routing information


4

Dynamic ClusteringCell-based Liberty Dynamic Clustering

Assisted lifecycle dynamic cluster4host 2host 1

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps

Liberty ProfileServer 1

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


Apps Apps

Topological View

©

2014

IBM

16

3

3

But alternatively…

dmgr

nodes

ND Cell

DBHTTP

proxy

node

agent

app

server

app

server

node

agent

app

server

app

server

liberty

liberty

This is good

but…

I like the lightweight

development

experience

Actually, we’d like a

lightweight and

massively scalable

cluster…

Collectives

Principles of Liberty Collective

• Standards-based admin API

• Built on JMX (MBeans).

• Works with common tools (Jconsole, Jython, etc).

• Loosely-coupled

• Exploits Liberty composable server model.

• App servers can easily and quickly be moved in and out of collective.

• Large-scale testing of 10,000 server collective

• Distributed Cache Model

• Admin server (controller) is config/state cache.

• Doubles as bi-directional JMX proxy.

• Distributed Configuration

• App Server owns its own config.

• App Servers cache sparse config and state in controller.

• Scalable, Resilient Admin Domain

• Highly Available admin server (replica model)

• Agentless©

2014

IBM

19

WAS ND Liberty Collective

• Massive scalability

• Easy/Flexible configuration

• Scalable/HA ops/monitoring

liberty liberty liberty

cluster

members

liberty

controllers


HTTP

Proxy

Liberty

Admin Center

Like this…

©

2014

IBM

20

server.xml

<featureManager>

<feature>collectiveController-1.0</feature>

</featureManager>

server.xml

<featureManager>

<feature>collectiveMember-1.0</feature>

[ <feature>clusterMember-1.0</feature> ]

</featureManager>

Liberty Controller

WLP

Liberty Collective

WLP WLP

WLP WLP

Liberty Collective

1. wlp/bin/server create {controller}

2. wlp/bin/collective create {controller} ...3. wlp/bin/server start {controller}

1. wlp/bin/server create {member}

2. wlp/bin/collective join {member} …rep

ea

t

Liberty Collective: Lightweight Management At Scale

WLP=WebSphere Liberty Profile

© 2014 IBM Corporation 21

server.xml

<featureManager>

<feature>collectiveMember-1.0</feature>

<feature>clusterMember-1.0</feature>

</featureManager>

<clusterMember name=“MyAppCluster1”/>

Liberty Controller

WLP

Liberty Clusters

WLP

WLP WLP

Liberty Collective

WLP

Name the

cluster:

Add cluster

feature:

Liberty Collective: Lightweight Management At Scale


© 2014 IBM Corporation 22

Liberty Controller

WLP

Liberty Clusters

WLP

WLP WLP

Liberty Collective

WebSphere Developer Tools

File

Tra

nsfe

r

MB

ean

explode

archive

Liberty Server

Package

Example: Centralized Member Creation


Admin Center

or scripting

©

2014

IBM

23

JMX Client

HTTP Server


AppsApps


AppsApps

Messaging Cluster



AppsApps


AppsApps




Browser Client

DeploymentManager

Admin App

…

CatalogServer

WXS Caching Tier

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

WebSphere

plugin


1

2


Routing information


3 Lightweight Server Collectivehost 3

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


Apps

host 2host 1

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


Apps Apps

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0


AppsApps

Management and Monitoring (JMX)

Liberty Collective

Feat

ure Man

ager

HTT

P Tran

sport

Appli

cation

Man

ager

servl

et-3.0

jsp-

2.2

apps

ecurity-

1.0

restc

onnector-

1.0

jpa-

2.0

Liberty Collective Controller

3

Liberty Administrative Center

4

Topological View

©

2014

IBM

24

4

Dynamic Collectives

From Static to Dynamic Load Balancing -Intelligent Management

• Integrated from WebSphere Virtual Enterprise in WAS ND 8.5.0

cell-based admin

• Available for Liberty Collectives as of 4Q 2014.

• Demand-driven, policy-controlled, auto-scaling of system

resources to increase/decrease Liberty-hosted application

capacity.

• Dynamic Routing with enhanced WebServer plugin for WAS

(“Intelligent Management for Web Servers”).

©

2014

IBM

26

AutoScaling and Dynamic Routing

• Policy bound to app clusters

• Automatic start/stop of JVMs to scale up/down capacity.

• Dynamic routing


cluster

members

liberty

controllers


IHS

<scalingPolicy name=”policy1” min=”3”>

<metric name=”heap” max=”80”/>

<bind clusters=”cluster1”/>

</scalingPolicy>

Administratively

defined policy dynamic

start/stop

©

2014

IBM

27

JMX Client

HTTP Server


AppsApps


AppsApps

Messaging Cluster



AppsApps


AppsApps




Browser Client

DeploymentManager

Admin App

…

CatalogServer

WXS Caching Tier

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

Grid Container

WebSphere

plugin


1


Routing information

2 Lightweight Server Collective

3 Liberty AutoScaling

4 Liberty DynamicRouting

host 3

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


Apps

host 2host 1

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


Apps

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0

Apps


Apps

F

ea

t

ur

e

Ma

n

ag

e

r

H

TT

P

T

r

a

ns

p

or

t

A

pp

l

ic

a

t

io

n

M

a

na

g

e

r

s

er

v

le

t

-

3.

0

j

sp

-

2.

2

a

pp

s

ec

u

r

it

y

-1

.

0

r

es

t

co

n

n

ec

t

or

-

1.

0

j

pa

-

2.

0


AppsApps

Management and Monitoring (JMX)

Liberty Collective

Feat

ure Man

ager

HTT

P Tran

sport

Appli

cation

Man

ager

servl

et-3.0

jsp-

2.2

apps

ecurity-

1.0

restc

onnector-

1.0

jpa-

2.0

Liberty Collective Controller

2

ScalingPolicies

3

Routing information

4

scalingMember-1.0

smartRouting-1.0

scalingController-1.0

Topological View

©

2014

IBM

28

IBM Public Dynamic Clouds

IBM Bluemix

• Off premise application cloud.

• Choice of application types: Java, Node, .py, …

• WAS Apps: Born in the cloud vs migration.

• Over-provisioning may still happen.

30

Portable Auto-scaling

• Auto-scaling Java (Liberty) apps + scaling policy portable

between

• Liberty Collective

• IBM Bluemix

31

On-premise Off-premise

Scaling

Policy

Auto-scaling on Bluemix

• Deploy (push) app to Bluemix

• Bind auto-scaling add-on from catalog to your app

• Choose default or custom policy

32

IBM Softlayer

• Off premise infrastructure cloud.

• Bring your own application/container.

• Strong fidelity with WAS deployments.

• Over-provisioning may still happen.

33

Auto-Scaling on Softlayer

• Virtual HW only

• Designed for Softlayer Load Balancers

• Define auto scale group/region

• Define policy

34

Wrap Up

Conclusion

• Internet of things driving up dynamic workloads.

• Over-provisioning is a reality and cost problem.

• Auto-scalable applications is a key mitigation.

• WebSphere supports dynamic workloads with auto-scaling

choices: ND, Bluemix, Softlayer

• Important strategy for you to manage cost.

36

Other Sessions

• AAI-2822 - Liberty Elastic Clusters and Centralized

Administration Using Scripting and Admin Center Lab

• AAI-3218 - Production Deployment Best Practices for the IBM

WebSphere Liberty Profile

• AAI-3281 - Smarter Production with WebSphere Application

Server ND Intelligent Management

• AAI-2694 – Deploying Applications to the WebSphere Liberty

Profile in IBM Bluemix PaaS

37

https://www-950.ibm.com/events/tools/interconnect/2015ems/screens/activity/activityView.xhtml?faces-redirect=true&id=2822



















Selected References

• Top 9 rules for cloud applicationshttp://www.ibm.com/developerworks/websphere/techjournal/1404_brown/1404_brown.html

• Introducing the Liberty Collectivehttp://www.ibm.com/developerworks/websphere/techjournal/1309_vignola/1309_vignola.html

• Scaling Applications in IBM Bluemixhttp://www.ibm.com/developerworks/cloud/library/cl-bluemix-autoscale/

• Introduction to Softlayer Auto Scalehttp://knowledgelayer.softlayer.com/learning/introduction-softlayer-auto-scale

38

http://www.ibm.com/developerworks/websphere/techjournal/1404_brown/1404_brown.html

http://www.ibm.com/developerworks/websphere/techjournal/1404_brown/1404_brown.html

http://www.ibm.com/developerworks/websphere/techjournal/1309_vignola/1309_vignola.html

http://www.ibm.com/developerworks/websphere/techjournal/1309_vignola/1309_vignola.html

http://www.ibm.com/developerworks/cloud/library/cl-bluemix-autoscale/





http://knowledgelayer.softlayer.com/learning/introduction-softlayer-auto-scale







Notices and Disclaimers

Copyright © 2015 by International Business Machines Corporation (IBM). No part of this document may be reproduced or

transmitted in any form without written permission from IBM.

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with

IBM.

Information in these presentations (including information relating to products that have not yet been announced by IBM) has been

reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM

shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY,

EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF

THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT

OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the

agreements under which they are provided.

Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without

notice.

Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are

presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual

performance, cost, savings or other results in other operating environments may vary.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such products,

programs or services available in all countries in which IBM operates or does business.

Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not

necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither

intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.

It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal

counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s

business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or

represent or warrant that its services or products will ensure that the customer is in compliance with any law.

Notices and Disclaimers (con’t)

Information concerning non-IBM products was obtained from the suppliers of those products, their published

announcements or other publicly available sources. IBM has not tested those products in connection with this

publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM

products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to

interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED,

INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A

PARTICULAR PURPOSE.

The provision of the information contained herein is not intended to, and does not, grant any right or license under any

IBM patents, copyrights, trademarks or other intellectual property right.

• IBM, the IBM logo, ibm.com, Bluemix, Blueworks Live, CICS, Clearcase, DOORS®, Enterprise Document

Management System™, Global Business Services ®, Global Technology Services ®, Information on Demand,

ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™,

PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®,

pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, SoDA, SPSS, StoredIQ, Tivoli®, Trusteer®,

urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of

International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and

service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on

the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.

http://www.ibm.com/legal/copytrade.shtml

Thank YouYour Feedback is

Important!

Access the InterConnect 2015

Conference CONNECT Attendee

Portal to complete your session

surveys from your smartphone,

laptop or conference kiosk.

Session 1145A