Market Leading Continuous Testing and Service ... · PDF file1| Stuart Feasey IBM Hybrid Cloud...

1 |

Stuart FeaseyIBM Hybrid Cloud - Test and Virtualization Specialist

Market Leading Continuous Testing and Service Virtualization Capability for WebSphere

2 |

Whatdoesanenterpriseenvironmentmeantoyou?

3 |

Today’sRealityforTesters

28%ofTestersarenottesting50% (ormore) ofthetime!

40%ofTestersarenottestingatleast1dayper

week!

4 |

MiddlewareChanges

4 InternalSoftwareUpgrades

§ Standardsbodyupdates

4 NewInitiatives

§ Regulatorychanges

4 VendorChanges

§ Stackupgrades/EOLdates

§ Fromonevendortoanother

4 Consolidation

§ CorporateM&A

5 |

Today’sRealityforTesters

TesterswanttospendMORE time

TesterswanttospendLESS time

6 |

TheRoleofTestingintheContextofDevOps

Top15challengesidentifiedafteranalysisofaround20IBMDevOpsworkshopreports:

• FlexibleenvironmentprovisioningrequiredbyDevOpsteams(67%)• ThereisalackofcollaborationbetweenBus,DevandOps(58%)• Thereisnocoordinationofthedeliveryenvironmentelements(e.g.aDevOpsCoE)(58%)• GovernancewhenapplyingDevOps(50%)• Deploymentsarelargelymanual(anderrorprone)(50%)• TherearenoorlimitedDevOps-specificmetricsinplace(50%)• Insufficientandinconsistenttestautomation(42%)• Testdatamanagement(42%)• Testingisnotperformedearlyusingcapabilitiessuchasservicevirtualisation (33%)• Thereisnointegratedtoolsarchitectureinplace(42%)• NoDevOpsvocabularyisinplace(33%)• NoDevOpsvisionorstrategyhasbeendefined(33%)• Missingorinconsistentmechanismsforgettingfeedback(33%)• ApplyingDevOpsinaregulatedenvironment(33%)

7 |

Presentation layer

Integrations, data and business logic

Traditional UI testing:

Automated Integration Testing and Service Virtualization:

The majority of risk in modern systems is seldom tested as it is unseen.

8 |

Shiftingleft;Testingsmarter

UNIT SERVICE UI

Automated Integration Testing

Service Virtualization

Traditional UI Tools

Development Testing Staging Production

9 |

10 |

Gartner - Magic Quadrant for Software Test AutomationPublished: 15 November 2016

IBM STRENGTHS•IBM's test automation tools can give many enterprises a jump-start in their continuous testing efforts. They are strongest as an integrated solution, delivering a combination of products and services.•IBM provides automated testing support for many technologies and applications, including legacy systems, client/server applications, packaged applications, and Web and mobile applications. It offers integration across the development and delivery life cycle.•IBM is well-positioned for cloud-based testing and advanced cognitive analysis to aid in adaptive testing and decision making.IBM CAUTIONS•IBM's portfolio is comprehensive and can be perceived as too complex, especially in the early stages of investing in test automation or for simpler testing needs.•While IBM provides a powerful portfolio, it is not optimized for nontechnical users and may require additional services to set up and implement.•IBM supports packaged application testing, but relies on partners for business process analysis and validation.

HTTP(S)Web Services / RESTJSON / SwaggerXML (XSD, WSDL)SOAP

JDBC

WASMQ

z/OS SI BUS

IIB

RR

HTTP(S)WebSphere MQJMS (multiple)RESTS/MIMEJava RMI (virtualization)JVM (virtualiazation)SAP IDOC, BAPI, RFC, XI 3.0Software AG’s IB & ISTCP/(S), IP, UDPCICS TGCICS IPICCICS DPLIMS ConnectTIBCO Rendezvous, Smart Sockets & EMSActive MQEmail (SMTP, IMAP)FilesFTP/S

Websphere Application ServerIBM Integration Bus (WSMB)Websphere MQWebsphere SI BusWebsphere RRUDDIWeb Services / RESTWSDL / WADL / SwaggerSystem z (CICS and IMS)Software AG IS, BrokerOracle FusionTIBCO ActiveMatrixDatabasesLog FilesCentraSiteSCA Domain

XML (XSD, WSDL, WADL)SOAPJSON / SwaggerCOBOL CopybookPL/1ASC X12UN/EDIFACTDFDLISO8583ISO20022Fixed WidthJava ObjectsAS2Software AG Broker Docs.Net ObjectsBytesSWIFTCHIPSFedWireFIXTIBCO ActiveEnterpriseCustom

13 |

IBMDevOpsSolutionforContinuousTesting

Presentationlayer

Middleware,Data, Services

Systems of Recordcomponents

Functional Tester

Web UI Tester

Rational Test Workbench

Integration Tester

Rational Performance Test Server

Performance TesterRational Test

Virtualization Server

RPTonCloud

RPTVTPacks

14 |

MiddlewareTestingChallenges

4 Whatisitthatneedstesting

§ Unknownsystemcomponents

§ Wherearethesystemendpoints

§ Variationfromdocuments

4 Whatmessagesarebeingexchanged

§ Goodsourceofdata

§ Mirrorrealliferatherthanhistory

4 Identifyingchanges

§ Helptargettesting

§ Optimizecreationofnewtestassets

15 |

ContinuousTesting

Execute test assets in headless mode§ Regression test new code quickly§ Continuous test cycles§ Build / Deploy / Test / Virtialize / Report�

Integrate into new or existing process§ Urban Code Plugin§ ANT task integration with Jenkins, CruiseControl, Bamboo, etc§ Command line execution§ Native integrations RTC, RQM, HP QC etc

Integration Tester reports served through a web browser (via Control Panel)

15

16 |

TopologyDiscovery

Clients

Web Services

Database

Mainframe

HTTP Proxy

JDBC Driver

CICS TG Exit

17 |

Synchronization

18 |

Buildingasystemmodelfromrecordedevents

Queue.A.Reply

Queue.A

Application servers

Clients Queue.B.Reply

Queue.B

Queue.C.Reply

Queue.C

19 |

WebSphere

4 RationalIntegrationTestercansynchronizewith:

§ IBMIntegrationBus

§ WebSphereApplicationServer

§ WebSphereRegistryandRepository

4 Discover:

§ HTTPEndpoints,MQconnections,JMSproviders,WSDLs,Databases,CICSandIMSconnections

4 Import

§ DFDLschemas

§ WSDL,WADL,XSD,Swagger

§ Copybooks,ProtocolBufferDefinitions

§ FromAPIConnect,Z/os ConnectEnterpriseEdition

20 |

SiftandpassthroughwithMQ

MQQueueManager

Queue

RealTestSystem

MQExit

Clientthatinitiatestransaction(orRIT)

MQExitisinstalledontheMQQueueManager.Directsinboundandoutboundtrafficforexecutionpurposes.

Stub

MQExitInterceptsmessagebeforeithitstheinboundqueue.

Ifstubisdown,thenMQExitdirectsmessagetoLivesystem.

Passthroughroute.

21 |

TypicalScenariosEncountered

22 |

BUSINESSWORKS

SAPPI

CICS

DATABASE

APP SERVER

SWIFT/MQ

HL7/TCP

X12/SOAP

JSON/REST

MostOrchestrationEngineshavetheirownproprietaryruntime(unlikeJ2E)whichmeansmigrationbetweenvendorsisariskpropositionasdevelopmentisrequired.Testenvironmentsareexpensiveanditisextremelydifficulttofault-findinanenvironmentwithmanymovingparts

Scenario1:AMigrationChallenge

23 |

IntegrationTestingandServiceVirtualizationcansignificantlyde-riskthemigrationandreducethetimerequired.

Development/testteamscanbuildagainstvirtualservicesandtestearlyandtestcontinuouslyusingmessagescapturedfromtherealsystems.Exception/edgecasetestingismucheasiertodo.

RITunderstandsawiderangeoftechnologiesandmessagingprotocols(includingDFDL)makingitwell-alignedtoIIBusers

Scenario1:FromTIBCOtoIIB

IBMINTEGRATIONBUS

SAPPI

CICS

DATABASE

APP SERVER

SWIFT/MQ

HL7/TCP

X12/SOAP

JSON/REST

24 |

Step1– Recordrealmessages(usingRITAgents)

Step2– Createtestsandvirtualservices

Step3– Enhancetestsandvirtualservicestoincludeedge/errorcases

Step4– Migrationteamusetests/servicestobuildIIBsolutionandgainconfidence

Step5– Swapvirtualservicesforrealtestenvironmentsoneatatimeandre-runtests

Step6– Endtoendtest(confidentoflessriskofexpensiveerrorsatthisstage)

Scenario1:Details

IBMINTEGRATIONBUS

SAPPI

CICS

DATABASE

APP SERVER

SWIFT/MQ

HL7/TCP

X12/SOAP

JSON/REST

25 |

Scenario2:IncreasingBuild/DeliveryVelocity

4 FinancialServicesCompany

§ AModernEnterprise

4 Complexity

§ Business

§ Technology

§ Organization

4 Getnextversionofweb/mobileofferingstomarketASAP

4 Maintainqualitywhilstprogressingtowardscontinuousdelivery

26 |

Scenario2:MeetthatChallengewithDevops Capabilities

4 Understandtheissuesandfindopportunitiestoimprove

4 Automate andsimplify toenablecontinuousintegration

§ Openinterfacestotesttools

• ANTscripting

• Comand line

• RESTinterface

• UrbanCode plugins

4 LeadingtoasmoothpathtoContinuousTestingandultimatelyContinuousDelivery

27 |

Scenario2a:CICSRegionunavailable

4 AppdevelopmentandtestteamuseUItestinginRationalTestWorkbench

4 AccessesrecorddataandservicesthroughCICSviaTransactionGateway

4 Resourceconstraints- won’tbeavailablefor2weeks

4 DevelopmentteamuseServiceVirtualizationtosimplify

§ PrototypetheservicewithRationalTestVirtualizationServer

CICSTransactionGateway

TestAutomation

VirtualService

New

28 |

Scenario2b:DependentProgramNotAvailable

4 Exposedfunctionalityinvokesprogramcross-LPARoverDPL

4 DevelopandunittestinisolationusingRationalDevelopmentandTestEnvironmentforSystemz

4 UseRationalTestWorkbench toautomatefunctional/regressiontests

4 BeforelinkedprogramavailableuseServiceVirtualizationtosandboxonmainframe

RationalDevelopment&Test(RD&T)

VirtualService

29 |

Adoption

30 |

Thejourney– continuousintegration

Successivepracticesbuildoneachother,witheachpracticeaddinggreaterandgreaterbusinessvalueandhavinggreaterscopeoverthesoftwaredevelopmentprocess.

• Instant feedback to developers on quality issues• Supports Agile development• Unit test automation & more• Pre-cursor to Continuous Delivery and DevOps

31 |

Multiple technologySome Open Source

Provide Virtual

Services

TESTER

Continuous deployment to

test environments

OPS

API TestingPerformance Testing

UI Automation

TESTER

Design & Build

DEVELOPER

Shippingcodefasterwithouttestingmeansthatbadcodecanbeshippedfaster.TestingisanintegralpartofDevOps.

Usingservicevirtualizationincreasestheabilitytotestearly,whiletestautomationprovidesrapidfeedbackonthequalityofthesoftwarebeingshipped.

WithoutContinuousTesting,thereisnoDevOps

32 |

Resources

ContinuousTestingondeveloperWorks athttps://developer.ibm.com/testing/ContinuousTesting:AnIBMpointofview:http://www.ibm.com/developerworks/library/d-continuous-testing-shift-left-trs/index.htmlDevOpsROI:https://developer.ibm.com/urbancode/docs/devops-managers-organization-leaders-making-roi-case-executives/TheForresterWaveModernApplicationFunctionalTestAutomationTools,Q42016:https://reprints.forrester.com/#/assets/2/581/'RES123866'/reportsGartnerMagicQuadrantforSoftwareTestAutomation:https://www.gartner.com/doc/reprints?id=1-3NWQQJB&ct=161214&st=sgGartnerMagicQuadrantforApplicationReleaseAutomation:https://www.gartner.com/doc/reprints?id=1-3FNG0BR&ct=160822&st=sg

33 |

ThankYou