Advanced DBA – High Availability for Data

World®’16

AdvancedDBA– HighAvailabilityforDataKevinShumaVP,ProductManagementCATechnologies

MAINFRAMEANDWORKLOADAUTOMATION

MFX65E

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Abstract

ThissessiondescribestheavailableoptionsforsitesthatneedtokeeptheirCADatacomdatauseraccessibleforextendedperiodsoftime.Thisincludefunctionalitytoreorganize,compressandmovedatawithoutinterruptinguseraccess.

ThissessionwillprimarilycoverthenewfeaturesavailableintheCADatacom®/DButilityprocessingthatallowsuserstocontinuetoaccessdatatableswhiletheDBAisperformingneededdatabasemanagementactivities.

KevinShuma

CATechnologiesVP,ProductManagement


Agenda

WHATISHIGH-AVAILABILITYFORDATA?

FUNCTIONALITYAVAILABLETOKEEPDATAAVAILABLE

CURRENTLYPLANNEDFUNCTIONALITY

SUMMARY

1

2

3

4


Whatishigh-availability?

“Highavailabilityisacharacteristicofasystem,whichaimstoensureanagreedlevelofoperationalperformance,usuallyuptime,forahigherthannormalperiod.”

“Ifausercannotaccessthesystem,itis- fromtheuserspointofview– unavailable.Generally,thetermdowntimeisusedtorefertoperiodswhenasystemisunavailable.”

AccordingtoWikipedia

24x7


Whatishigh-availabilityfordata?

§ Theabilityforuserstoaccesstheirdata(tables)anytimetheDatacomenvironment(MUF)isup– Donotinterruptuserdataaccessfor

§ Datasetexpansions§ Datareorganizations§ Indexreorganizations(defragmentation)§ Indexchanges(addingordeletingkeydefinitions)§ Changingcompressionalgorithms§ DASDrestructuringanddatarowrestructuring§ JustabouteverythingaDBA“does”tomanagethesystem

FromaCADatacomperspective


Functionalityavailabletokeepdataavailable


Datasetexpansions

§ CADatacomsupportsmultiplewaystoexpanddataandindexareaswithoutanoutage– Dynamicextend(dictionaryattributes)

§ Canbeupdatedtoexistingdatabasedefinitions§ ProvidestheMUFtheabilitytotriggerarequestforanewextentwhenthecurrentextent(s)arefull

– Ondemandextend§ ConsolecommandthattriggersaMUFtorequestanewextent

– CanbeplacedinaDBUTLTYbatchjob

§ Doesnotrequiredynamicextendtobeturnedon

Weneedourdataandindexareastoexpand(fornewentries)withoutanoutage


Datasetexpansions- OnlineAreaMoveprocess

§ DeliveredinV14.01

§ Usedforcaseswhereoriginaldataset(indexorarea)nolongermeetsthecurrentneed

§ Extentstoosmall– maximumnumberofdynamicextendsbeingreached§ Notenoughvolumesallocated– canonlyextendonallocatedvolumes§ Needtomovetoanewer,larger,fasterDASDdevice§ Sitesdoesnotwantdatasetswithmultipleextentstoremainforlongerperiods

§ Otherneeds



Datasetexpansions- OnlineAreaMoveprocess(cont’d)

§ DefineandPREINIT(DBUTLTY)new“.new”targetdataset– Createwiththe“new”requirementsforextentsandvolumes– Sameblocksizeassource

§ WhenreadyissueaconsolecommandtodoONLINE_AREA_MOVE– Opens“.new”datasettoMUF– EstablishesanIOdirectortomanagewhichdatasethascurrentblock– Beginscopyblockforblockfromolddatasetto.new– WhendoneusesanI/Ogatetopausethesystem

§ Scratchorrenamecurrenttooldandrename“.new”tocurrent



Datasetreorganizations

§ Determineifareorganizationisneeded– Datarowreuseallowsspaceindatasetstobereused

§ Defaultre-useisrandom(DSOP=1)§ Newdatarowsbeingaddedmaybeplacedoutof(nativekey)sequence§ Withcompressionormulti-tableareassomefragmentationoffreespaceinthedatablocksmayoccur

– Withgoodbufferingand/orMRDFalotofthedis-organizationishidden

– Manyreorganizationsaredonewithoutrealneed§ Don’timproveperformanceoraffectfragmentation

Weneedourdataputbackintonativesequence(forbatchperformance)


Datasetreorganizations(cont’d)

§ Usingthehistorydatabase(DBID1007)todetermineif– Thereissignificantsequential(nativekey)processing




§ Usingthehistorydatabase(DBID1007)todetermineif– Thereissignificantreductioninsequentialefficiency


Re-orgdoesnotimproveefficiency

Re-orgimprovesefficiency



§ UsingtheDBUTLTYDATANEreporttodetermineifthedataisoutofsequence




§ UsingtheDBUTLTYDATASPreporttodetermineifthedatablockshavealotoffragmentedspace




§ OfflineReorg(causesanoutage)– DBULTYBACKUP(SEQ=Native),INIT,LOAD– DBUTLTYREORG(parallelreorg)– AREAcontrolscanbeusedtodojustoneareaofadatabase

§ OnlineReorg– TriggeredbyDBUTLTY,butrunsinMUF(availableforzIIP)– Allowsuserstocontinuetoaccessdata– Movesrowswithintheexistingdataarea– Someindexspacewillbeused(MovedRecordIndex)– Fullyrecoverable/restart-able

Choosingtherightmethod



§ OnlineReorg(cont’d)– DBUTLTYOLREORGREFGROUP=nn(greaterthanzero)

§ Reorganizesbymovingrowsfromoneblocktoanother§ Makessequence“better”

– DBUTLTYOLREORGREFGROUP=0(RequiresDSOP4or5)§ Reorganizesbymovingrowsinordertoemptyblocks§ Requiresapercentageofempty(notin-use)blocks§ Allnewblocksarefullyloaded§ Typicallyresultsinsmallerwellorganizeddatatable



Indexreorganizations(defragmentation)

§ OfflineRETIX(causesanoutage)– DBULTYINITandRETIXoftheindex– AREAcontrolscanbeusedtodojustoneareofadatabase

§ OnlineDEFRAG– TriggeredbyDBUTLTY,butrunsinMUF(availableforzIIP)– Allowsuserstocontinuetoaccessdata– Defragments/combinesDXX(low-level)ofindex– Reducesin-useblocks,improvesperformance– Fullyrecoverable/restart-able– Doesnotreduce“levels”



Indexreorganizations(defragmentation)(cont’d)

§ OnlineDEFRAG(cont’d)– Lowcost,runsinMUF– Compressesindexes(reducesin-useblocks)– Improvedperformanceofbuffers

Useitfreely


Indexchanges(addingordeletingkeydefinitions)

§ PriortoV15– OnlyonlineabilityisthroughSQLALTERtable

§ Causessignificantdatarow“lock”iflargenumberofrows§ Notrecommendedforproduction

§ DeliveredinV15– Onlinefunctionality

§ Abilitytoremoveakey§ Abilitytoaddakey

Addorremovingindexesfromexistingtableswhileprocessing


Indexchanges(cont’d)

§ Removingakey– Logicallydeleteakey(index)foratable

§ Internalindexstillmaintainedwhenrowsaddedordeleted§ Canbere-instatedifusersdetectthatthekeywasneeded

– Physicallydeleteakey(index)foratable§ Locksinlogicaldelete§ Removesindexentriesfromtheindexarea(IXXorInn)

– Spaceavailableforotherindexestouse

Removingindexesfromanexistingtablewhileprocessing



§ Addinganewkey(index)foratable– AddskeytoDirectoryCXX– Keyenabledtomaintenancecommands– Internaltaskstartedtoreadallrows,addnewindex

§ Whencompletekeyismadeavailable– Canbeaddedintoindex–

§ IXXarea§ ExistingInn area(multi-datasetindex)§ BrandnewInn area(multi-datasetindex)

Addingindexestoanexistingtablewhileprocessing



§ Swapwhereakey(index)resides– Addaparallelkeytoonebeingusedin

IXXorInn– Swapusageforuserapplicationsfrom

oldtonew– Deleteoldkeyandreclaimspace– LesslevelsreducesI/O– AllowsCOVEREDtobemuchmore

effective§ CoverthespecifickeyIDsthataremost

‘timecritical’

Movingindexeswithinanexistingtablewhileprocessing

Multi-datasetindex

IXX

I01

I01

IXX


Changingtablecompression

§ Datarowcompressioncanbeusedto– Reducedatarowfootprint(saveDASD)– Improvebuffer,memoryandzIIPutilization– Makedataless“readable”byexternalviewers

§ TSO,DITTO,SORT,etc.

§ OnlineCompress(TA24)– AllowstheDBAtoadd/remove/changecompression

specificationswithoutinterruptinguserdataaccess– FullsessionatCAW2016discussingthisnewcapability

AllowingtheDBAtochangecompressionwithoutadataaccessoutage


OtherchangesinV15

§ MUFRESTARTinparallel,muchfaster

§ DynamicanddirectedextendVIRTUALbasearea– IncludestheCBSindex– IncludestheTTMindex

§ ExtendthelogareaLXX

§ ExtendtheDirectoryCXX

§ UniqueRowIdentifier(URI)reuse

RemovingMUFoutagesthataffectuserdataaccess


Currentlyplannedfunctionality


UnderConsideration

§ ONLINE_AREA_RELEASE– Freeunused/neverusedspaceatbackofdataset

§ Dataareaonly– Inasecondcanreleasespacebacktosystem

§ PastMaximumusedblocks§ PastHighUsedBlock§ GoodforareasthatwereoversizedatINIT

Itemsthatareinthecurrentbacklogofnewfunctionality


UnderConsideration(cont’d)

§ ONLINEBlockSizeAlter(Pre-initializeanewdataarea– PartONLINE_AREA_MOVE,PartOLREORG

§ Pre-initializeanewdataarea– “Right-sized”extents

§ Differentblocksize§ Datadictionarydriven§ Movesrowsbynativekeytonewarea

– AnyADDITduringalsogoestocurrentblocksonotinorder

§ Whendoneoldareascratched,newarearenamed



UnderConsideration(cont’d)

§ ONLINE_TABLE_MOVE– PartONLINE_AREA_MOVEandpartOLREORG

§ Pre-initializeanewdataarea– “Right-sized”extents

§ Imagineoldarea1000cylindersbutcurrently1recordonlasttrack

– Newareacanbe2tracksandwillrunveryfast

§ Movesrowsbynativekeytonewarea– AnyADDITduringalsogoestocurrentblocksonotinorder

§ Whendoneoldareascratched,newarearenamed



SummaryAFewWordstoReview

ExperiencesOnesitehasusedthesenewfunctionstokeeptheiruserdataavailable24x7forover4years.

KeyTopicsIntoday’sworld,user’sdatamustbeaccessible24x7

FindingsCADatacomcontinuestodelivernewfunctionalitythatallowstheDBAtoperformneededactivitieswithoutinterruptinguseraccess.

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.30 @CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.30

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI


RecommendedSessionsSESSION# TITLE DATE/TIME

MFX92S StrategyandVisionforCADatacomandCAIdeal 11/16/2016at12:45pm

MFX93S What’snewinCADatacom 11/16/2016at1:45pm

MFX94S ReducingTCOwithDatacomCompression(Presspack) 11/16/2016at3:00pm

MFX95SA ModernizingtheCADatacomdata – SQLAccessPartI 11/16/2016at3:45pm

MFX95SB ModernizingtheCADatacomdata – SQLAccessPartII 11/16/2016at4:30pm

MFX96S CADatacom/ADInstallation/UpgradeandMaintenance 11/17/2016at12:45pm

MFX97S CADatacom/ADReportUtilization,andinformationgatherforSupport 11/17/2016at1:45pm

MFX98SUsingSysview tomonitorandmeasureyourCADatacomenvironment– ADandDB

11/17/2016at3:00pm

MFX99S BirdsofaFeather/StumptheTechie! 11/17/2016at3:45pm


Questions?


Thankyou.

Stayconnectedatcommunities.ca.com


©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation

Technology

Advanced DBA – High Availability for Data