Application Tuning for CA Datacom Environments Part I

World®’16

ApplicationTuningforCADatacomenvironments– PartIKevinShuma,VPProductManagementCATechnologies

MFX67EA

MAINFRAMEANDWORKLOADAUTOMATION

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Abstract

ThisisatwopartsessionthatdescribesthevarioustechniquesusedtotuneaCADatacomapplicationforthebestpossibleperformance.Includedwillbediscussionsonavailablemonitoringtools.

ThissessionisprimarilyfocusedontheapplicationdeveloperwhoiswritingapplicationsfortheCADatacom®/DBdatabase.

KevinShuma

CATechnologiesVP,ProductManagement


Agenda

THEAPPLICATIONESTATE

THEAPPLICATIONARCHITECTURE

WHYWOULDINEEDTODOTUNING?

APPLICATIONTUNINGWITHOUTCHANGINGTHEAPPLICATION

APPLICATIONTUNINGWITHOUTCHANGINGTHEAPPLICATION

SUMMARY(FORPARTI)

1

2

3

4

5

6


Theapplicationestate

§ ITdepartmentsvaryinsizeandscope

§ Applicationactivitydiffersineachsite

§ Applicationplatformsvary

§ Programmerskillsvary

§ Soifeverythingisvarying,whatisconsistent?

UnderstandingthetypicalCADatacomapplicationdevelopmentenvironment


The“RealWorld”– Today’sMainframeITrequirement

§ ReducingtheTCOofthemainframe– Doingmorewithless– Everynew"businessbenefit"application/changemustbecostjustified

§ Utilizeexistingstaffandresourcedtoachievethisgoal

Theconsistenttheme


The“RealWorld”– Today’senvironment

§ MajorEuropeanretailer– Datacom/Ideal/MetaCOBOL+runsalmostallmissioncriticalsystems– 0.6ofaDatacomDBA(average3daysperweek)– 6mainframedevelopers– Cappedat24MSU’s(downfrom37MSUsin2years)

§ Financialinstitution– Datacom/Idealrunsalmostallmissioncriticalapplications– 0.25ofaTechnicalConsultant(average5dayspermonth)– 3mainframedevelopers– Cappedat100MIPS

MuchsmallerITdepartment– typicallywithverysmallDBAstaffs


Wherecanwegetthebiggestbangforthebuck

§ “Fromaproductperspective,addinganenhancementthatimprovestheefficiency/productivityofapplicationandprogrammercanhavealargepositiveimpactonthebusiness.– Improvementstoapplicationperformanceresultsin

§ Improvedproductivityofend-users/operationsstaff§ DevOps – Theclue’sinthename!§ Businessgrowth.Employment.§ ReducedTotalCostofOwnership(orperceived“overhead”)ofthemainframe”

Excerptfromawell-knownCADatacomconsultantandDBA


Improvingtheefficiency/productivityofapplications

§ ApplicationTuningincludes– Identifyingandeliminatingredundant/inefficientprocessing– Eliminatingunnecessaryoutages/resourceconflicts– Makingfulluseofhardware/infrastructurechanges– Implementingenhancementsthatimprovebusinessproductivity


Theapplicationarchitecture


Theapplicationarchitecture

§ RAAT– Recordatatime– Typically“verychatty”withthedatabase

§ Manysmallrequestsandresponses– BatchdoeshaveGSETx commandsforlargerrequests/responses

§ SAAT– Setatatime– Typically“lesschatty”withthedatabase

§ Smallernumberofrequestswithlargerdatabaseprocessingrequirements– UsedbyIdeal,DQRYandSQLunderthecovers

UnderstandingthetypicalCADatacomapplicationenvironment- APIs


Theapplicationarchitecture(cont’d)

§ SQL– StandardQueryLanguage– Typically“lesschatty”withthedatabase

§ Smallernumberofrequestswithlargerdatabaseprocessingrequirements§ Requestcanincludevariousdatarefinementprocessing

– Unique,Groupby,Union,etc.§ UsesSAATatthedatarowretrievalmethod

§ AllthreeAPIsrequireaURT

UnderstandingthetypicalCADatacomapplicationenvironment- APIs


Theapplicationarchitecture(cont’d)Batchaddressspace

zOSLPAR

• Start-upparameters• Executingcode• Sharedmemory(buffers)• Dataspacesattachedasneeded

DatabasesubsystemandPCCallsinstalledduringCAS9(CACommonServices)initiation

CXX

LXX

FXX

PXX

RXX

DD0002

DDD0015

SQL0016

TTM0017

CBS0006

HEUR1006

DST1000

STA1018

SNP1019

DEL1020

PRM0004

ACCT0005

HR0001

OE0010

DQ0003

URT

UserProgramCallDBNTRYCallDBSQLE

UserDBIDs

BatchURT• Needstobeloadedinthe

addressspace(typicallinkedwithprogram)

• ProvidestheinterfacetotheMUFaddressspace

• ForRAAT/SAATselectstablestobeaccessed

• CanholdadditionalbufferareaforspecialGSETx commands

Interface

BatchAddressSpaceMUFAddressSpace


Theapplicationarchitecture(cont’d)CICSaddressspace

zOSLPAR


CXX

LXX

FXX

PXX

RXX

DD0002

DDD0015

SQL0016

TTM0017

CBS0006

HEUR1006

DST1000

STA1018

SNP1019

DEL1020

PRM0004

ACCT0005

HR0001

OE0010

DQ0003


UserDBIDs

CICSServices• LoadsmultithreadedinterfacetoMUF• LoadsapoolofURTsforallCICStransactions

• ForRAAT/SAATselectstablestobeaccessed• DefaultURT020providedforSQLaccess

• ProvidesasetofCICStransactionstomanagetheinterfaceandURTs

URT URT

InterfaceDatabasesubsystemandPCCallsinstalledduringCAS9(CACommonServices)initiation


URT URT URT URTInterface

CICSAddressSpace BatchAddressSpaceMUFAddressSpace


Theapplicationarchitecture(cont’d)Serveraddressspace

zOSLPAR


CXX

LXX

FXX

PXX

RXX

DD0002

DDD0015

SQL0016

TTM0017

CBS0006

HEUR1006

DST1000

STA1018

SNP1019

DEL1020

PRM0004

ACCT0005

HR0001

OE0010

DQ0003


UserDBIDs

Server• LoadsmultithreadedinterfacetoMUF• LoadsURTstubforbasicsupport• Providesasetofcommandstomanagethe

interface• ProvidesinteractiveSQLprocessorfor

clientODBC/JDBCrequests

URT URT

InterfaceDatabasesubsystemandPCCallsinstalledduringCAS9(CACommonServices)initiation


URT URT URT URTInterface

CICSAddressSpace BatchAddressSpaceMUFAddressSpace

Interface

URT

InteractiveSQLprocessor

ODBC/JDBCServerclient


WhywouldIneedtodotuning?


WhywouldIneedtodoapplicationtuning?

§ Backwhentheywerewritten– WewerebalancingCPUvsIOvslimitedrealstorage– DASDwasexpensive– Howmuchrealstoragedidyourmainframehave

§ Howmuchdoesithavenow?– Howmuchdatadidyourapplicationprocess

§ Howmuchdoesithavenow?

§ Bottomline– Theapplicationsmaynothavechangedbuttheenvironmentsurelyhas

Myapplicationshavenotchanged


Recent“gamechanger”

§ ForzOSsiteswithzIIPprocessors– 90%+MUFCPUcanbeoffloadedtozIIP

§ UserapplicationCPUcannotrunonzIIP– PerIBMlicensetousezIIP

§ MakeuseofopportunitiestoswapfromapplicationCPU(expensive)toMUFCPU(inexpensiveonzIIP)

IBMzSystemsIntegratedInformationProcessor(zIIP)


ApplicationTuningwithoutchangingtheapplication


ApplicationTuningwithoutchangingtheapplication

§ Manyapplicationissuescanbemitigatedbyadjustingthedatabaseenvironment

§ Noteveryissuecanberesolvedthisway– InpartII,wewilldiscussapplicationspecificcorrections

§ Thissessionwilladdresswaystoimproveapplicationprocessingwithoutchangingtheapplicationcode

WhatIspentalargepartofmyDBAcareerdoing


Aslongasthegeometryoftherowdoesnotchange,theapplicationswillnotneedtobechanged§ ReplacingphysicalIOwithmemoryprocessing(DBAtuning)

– IncreasethenumberofIXX,DXXandDATAbuffers– ConsiderusingMRDFCOVERED

§ Dependingonprocessingapreloadmayhelp– Changethedatablocksizeto1/3trackor1/2track

§ Requiresanadjustmentofdatabufferpools– DATANO,DATANO2orspecialDATApools

§ Requiresanoutage(fornow,comingsoonTM24)– IfzIIPavailable

§ ImplementcompressionusingTA24


Aslongasthegeometryoftherowdoesnotchange,theapplicationswillnotneedtobechanged(cont’d)§ AddkeystoimproveCBS/SQLefficiency

– Willaddoverheadonrowaddsanddeletes– WillonlytakeaffectwithoutapplicationchangeforSAATorSQL– LocateCBSorSQLrequeststhatarebuildingtempindexes

MUFEOJ,AUTOINFO,AUTOCOLLECT,

ALL_INFO_REPORTAccountingTables

MUFlevelCBSindexstatisticsfortotals Useaccountingtocapturespecificjobs,transactions


Aslongasthegeometryoftherowdoesnotchange,theapplicationswillnotneedtobechanged(cont’d)§ Removeunusedkeys(overheadoneveryadd/delete)

– WillonlytakeaffectwithoutapplicationchangeforSAATorSQL– Locatekeysthatarenotused

§ DSTDIR_KEY(onlyshowsstatssinceMUFstartup)

SELECTDBID,TABLE_NAME,KEY_NAME,KEY_ID,NATIVE,MASTER,NIL,DIRECT,KEY_LENGTH,CBS_IGNORE,USES_RAAT,USES_SAAT,USES_SQL

FROMSYSADM.DIR_KEYWHEREDBID>19ANDDBID<1000;


DBUTLTYtuning

§ ManybatchapplicationjobstreamsincludeDBUTLTYjobs– ThefasterDBUTLTYrunsthefasterthejobstreamcompletes

§ DBUTLTYfunctionslikeDEFRAGandOLREORGcansignificantlyimproveperformanceofapplications

Utilityprocessingcanaffectapplicationperformance


DBUTLTYtuning(cont’d)

§ REGION=0MonJCLEXECinz/OS

§ Largepartition(50M)inz/VSE

§ MasterlistIXX/DXX/Databuffers(especiallyinz/VSE)

§ Half-trackblockingforDataAreas

§ Arealevelcontrols– Eliminatenegativedependencies– Sometimesappropriate,sometimesnot




§ BLKSIZE=nnnnn forBACKUP/EXTRACT(z/VSEornon-SMS)

§ LOAD/RETIXparameters– KBYTES=9999– OPTIMIZE=YES– OPTION1=‘(I)’andreviewsortmessages– SORT=#indexentries (SORT=1forz/VSE)– SORTDFT(newin14.0– greatifusedwisely)




§ ReplacemostRETIXwithDEFRAG– DEFRAGisonlineactivityandisoftenfaster– UseFIRSTKEY/LASTKEYonEXTRACTwhereappropriate

§ INITIXXOLDEP=NO

§ DBIN1PR/SYSIN1STtoapplydefault/overrides– NewDEFAULT/FORCEoptionsplannedfor15.1

§ DBUTLTYtuningsavedseveralelapsedhoursfrommanyjobs– Simplechanges1hr+savedfromoverallbatchcriticalpath




§ Stopperformingunnecessaryreorgs– Trulyrandomprocessingwillnotbenefitfromreorg– NewDATANEreportshowsNativeSequenceEfficiency– Historydatabaseshowssequentialactivity

§ ReorgOptions– TraditionalBACKUPSEQ=NATIVE+LOAD

§ Considerarea-levelcontrolsifonlyaminorityofareasneedreorg§ Ifreorganising wholedatabase,usedatabase-levelBACKUP+INITIXX+database-levelLOAD




§ ParallelREORG– stillanoutagerequired,butquicker– Backuponlyoptionforquickerbackups

§ OLREORG– REFGROUP=nn– REFGROUP=0

§ CurrentlyplannedforV15.1– TM24

§ Considerpartitioningwhereappropriatetominimizereorgeffort



Changingthephysicaldatabasestructure

§ Splitupdataareasthathave2ormoreheavilyusedtables

§ Splituplargedatabasesthathavemultipletables– URToptionforDBIDremapping– Improvesbackup/load/reorg/recoveryprocessing– MultipleDBIDs=Multiple(smaller)indexes

§ Reducedlevelsofindex§ MoreopportunitiestouseMRDFcovering

Requiresanoutagetoimplement


Changingthephysicaldatabasestructure(cont’d)

§ Splituplargetablesusingtablepartitioning– Existingapplicationsrununchangedatlogical(parent)level– Betterbackup/load/reorg/recoveryoptionswithmultipleareas– MorepossibilitiesforMRDFcovering

§ Busierpartitionscanbecovered– Newoptionsforapplicationprocessingatpartition(child)level

Requiresanoutagetoimplement

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.31 @CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.31

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI


RecommendedSessionsSESSION# TITLE DATE/TIME

MFX92S StrategyandVisionforCADatacomandCAIdeal 11/16/2016at12:45pm

MFX93S What’snewinCADatacom 11/16/2016at1:45pm

MFX94S ReducingTCOwithDatacomCompression(Presspack) 11/16/2016at3:00pm

MFX95SA ModernizingtheCADatacomdata – SQLAccessPartI 11/16/2016at3:45pm

MFX95SB ModernizingtheCADatacomdata – SQLAccessPartII 11/16/2016at4:30pm

MFX96S CADatacom/ADInstallation/UpgradeandMaintenance 11/17/2016at12:45pm

MFX97S CADatacom/ADReportUtilization,andinformationgatherforSupport 11/17/2016at1:45pm

MFX98SUsingSysview tomonitorandmeasureyourCADatacomenvironment– ADandDB

11/17/2016at3:00pm

MFX99S BirdsofaFeather/StumptheTechie! 11/17/2016at3:45pm


Questions?


Thankyou.

Stayconnectedatcommunities.ca.com


©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation

Technology

Application Tuning for CA Datacom Environments Part I