Ims02 automics and modernization - IMS UG May 2014 Sydney & Melbourne

IBM IMS Tools…the tools you can count on

© 2010 IBM Corporation

Janet LeBlancIMS Tools Strategist

[email protected]

2 © 2014 IBM Corporation


What is your pain?

� Aging DBAs and System Programmers– Need to use resources more efficiently

– Need to train new young staff

� Need software you can count on to support all the new modernizing features of IMS

IMS Tools


� Need software that continues to be enhanced with the features you need for your business

� Need software that will be there for you now and in the future

Modernization: Breaking New GroundAdministration Console Goals

5 © 2014 IBM Corporation5

� Provide a holistic view of your IMS databases from a single, easy-to-use web UI

– Dynamic, interactive graphs and charts provide you with a visual representation of your databases– Integration with the IMS Autonomics Director provides a list of policy exceptions and recommended

resolutions for all monitored databases– All IMS Tools reports stored in the IMS Tools Knowledge Base can be searched, retrieved, and

viewed effortlessly

� Prepare for the next generation of IMS DBAs– Uses the latest web technologies for a rich user experience– Access from anywhere via the Internet using the most popular web browsers– Includes a robust help system that serves as a learning aid for new IMS DBAs.

Our Vision – Putting information to work for you

Gather database statistics at regular intervals

User-defined policies and thresholds

PoliciesPolicies SensorsSensors


Rich, web-based user interface

Recommending and taking corrective actions

ModernizationModernizationAutomationAutomation

• Provides complete tool set• Online / Offline• Reorganization and restructure• Pointer check and space analysis

• High performance/function Image Copy• Library consistency verification

• Delivers Performance• Optimization of resource and CPU

IMS Fast Path Solution Pack

� Autonomics

� IMS Administration


• Optimization of resource and CPU usages

• Reduced elapsed time

• Delivers New IMS Version support• NEW FP Secondary Index support

• Advanced DB Monitoring Solution• Simplification through automation

� Autonomics Director

• Modernization through graphical interface

� Admin. Console

� IMS Administration Console

� HP FP Utilities

� FP Advanced Utilities

� FP Online Utilities

� IMS DB Repair Facility

� IMS HP Image Copy

� IMS Library Integrity Utilities

• Provides complete tool set• Conditional Reorganization

• Online, Read-Only and Offline Additional User Exit and Application API

• Pointer check and space analysis• High performance/function Image Copy

• Library consistency verification

• Specialized HALDB Support

• Delivers Performance

IMS Database Solution Pack

� Autonomics

� IBM Administration


• Delivers Performance• Optimization of resource and CPU usages





� Admin. Console

� IBM Administration Console

� IMS Online Reorg Facility

� DB Reorg Expert

� Unload

� Load

� Prefix Resolution / Update

� Index Builder

� HP Image Copy

� HP Pointer Checker



Database space monitoringIts common purpose is to prevent these situations

• Free space shortage

o Caused by running-out of data set extents or free space on volumes and resulting in service outage

• Inefficient use of database space

o Caused by free space fragmentation, which can eventually


o Caused by free space fragmentation, which can eventually result in free space shortage

• Performance degradation

o Caused by free space fragmentation, long synonym chains, a large percentage of overflow segments, etc. and sometimes can result in “batch job overrun”

Database space monitoringWhat activities are needed?

• Collect space statistics data

o % of max data set size, …

• Analyze the data

o Is a threshold reached? …

• Notice exceptional states

Analyze

Notice Decide

Prepare


o Fragmentation, space shortage, …

• Decide actions

o Free-space reorg, DBD/randomizer change, (re-)partitioning…

• Prepare for action(s)

o Schedule a free space reorg, plan tuning for actions, …

• Take action(s)

o Do the structure change, (re-)partitioning, …

Collect Act

Challenges in the current IT environmentEspecially in IMS database space management

• Decrease in

o Skilled IMS DBAs

o Maintenance window time

• Increase in

o Number of databasesAnalyze

Notice Decide

PrepareAnalyze

Notice Decide

Prepare

Notice DecideNotice Decide

Notice Decide


o Number of databases

o Data volume

• Increasing business pressures

o “Do more with less.”

• Flat or less IT cost

• Less people

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

We recommend simplification and automationfor the efficiency of the process

• Simplify each step

o Data collection

o Data analysis

o Exception notification

o Action determinationAnalyze

Notice Decide

PrepareAnalyze

Notice Decide

Prepare

Notice DecideNotice Decide

Notice Decide


o Action determination

o Action preparation

o Action taking

• Automate repetitive tasks

o Starting from data collection through action decision

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

Collect

Analyze

Act

Prepare

IBM IMS Tools… can simplify and automate the process

• IMS Database Solution Pack database sensor feature can simplify the ‘Collect’ step

• Autonomics Director (IBM Tools Base) and Policy Services can simplify and automate the ‘Analyze’, ‘Notice’, and ‘Decide’ steps


IBM Tools Base

+


‘Notice’, and ‘Decide’ steps

• Administration Console (IBM Tools Base) can simplify access to space monitoring information needed for the ‘Prepare’ step

• IMS Database Solution Pack also provides reorganization tools that can make execution of space maintenance ‘Actions’ simpler and accelerate the performance

Collect

Analyze

Notice Decide

Act

Prepare

You can do more with less people and time… by using the IBM IMS Tools Solution

• Space statistics can be collected as byproducts of your Pointer Checker and/or Image Copy jobs

• Data analysis, exception notification, and action recommendation can be made automatically based on


IBM Tools Base

+


made automatically based on exception detection/notification policies

• Space statistics, detected exceptions, and recommended actions can be accessed through a comprehensive graphical web interface

• Space maintenance actions can be simplified and accelerated

Collect

Analyze

Notice Decide

Act

Prepare

Automating monitoring process


Autonomics Director and Policy ServicesInfrastructure for automation

• Autonomics Director server

o Periodically evaluates space statistics data collected by IMS DB Solution Pack utilities, and detect and notifies exceptions if any

• AD server configuration:

Automation Infrastructure

Policy ServicesPolicy Evaluation &

Exception Notification

AutonomicsDirector

Server


• AD server configuration:

o Database monitor list

o Data evaluation schedule

o Data collection schedule

o Exception detection rules

o Exception notification targets and policies

IMS ToolsKnowledge Base

Server

Repositories

IMS DB Solution Packutilities can collect andstores space statistics



Data CollectionDatabase Sensor capability in utilities

• You can collect database space status as “sensor data”

• Sensor data can be collected during

o Pointer Checker run

Image Copy run

Collect

Analyze

Notice Decide

Act

Prepare


o Image Copy run

• Sensor data are stored In ITKB Sensor Data Repository

• Stand-alone DB Sensor can collect sensor data of one or more online full-function databases and OLR-cursor-inactive HALDB partitions

IMS Database Solution PackHigh Performance Pointer Checker

High Performance Image CopyStand-alone Database Sensor

IBM Tools BaseIMS Tools Knowledge Base (ITKB)Policy Services Sensor Data Store

Data AnalysisYou don’t need to look at / parse a large number of reports

• AD invokes “policy evaluation”

o New sensor data are notified to Autonomics Director

o Then, AD invokes data analysis process based on the evaluation schedule and the policy pre-configured for each database that is

Collect

Analyze

Notice Decide

Act

Prepare


configured for each database that is registered in the Monitor List

• Policy evaluation

o A process of applying threshold-detection rules and exception-notification policy to the collected sensor data

• Each rule detects an exceptional state of a database or a partition

IBM Tools BaseAutonomics Director (AD)

Policy Services Policy EvaluationIMS Tools Knowledge Base (ITKB)

o Policy can be selected or defined for each database type, for an individual database, or for a group of databases.

Exception NotificationYou’ll be notified of exceptions

• Action Recommendation

o A policy associates exceptions with an action recommendation (e.g., REORG)

• Notification List

o A policy can have a list of Collect

Analyze

Notice Decide

Act

Prepare


o A policy can have a list of destinations of exception notification

• Exception Notification

o The action recommendation is sent to the destinations listed in the Notification List in the form of WTO, an e-mail, a short message, or a TSO message

IBM Tools BaseAutonomics Director (AD)

Policy Services Exception NotificationIMS Tools Knowledge Base (ITKB)

o An exception consists of:

•An exception name

•A severity

•A short message

Simplifying accessto monitoring information


Action DeterminationTypical questions that need to be answered

• Which databases need attention now?

• Why they need attention?

• What actions are recommended?

• How those databases have gotten to the current state?

Collect

Analyze

Notice Decide

Act

Prepare


to the current state?

• How are free spaces and DASD volumes used?

o What did HP Pointer Checker report?

• What the average database record length and is the current block/CI size optimal for it?

o What did HP Unload report?

• Summary of latest status

• Trend of space status changes

• Database utilities reportsfor “drill-down” research

Information needed

Administration ConsoleProvides a holistic view of data and informationIBM OneUI Theme History of

utility reportsDetected exceptions and action recommendation

• Admin. Console also provides a table of the number of exceptions and highest severities for each user-defined


Search and group

databases

Online help for space

monitoring

Charts of various space statistics data

items

each user-defined group of databases and partitions.

• A typical use case scenario and various screen shots are available on Information Center.

DBD Visualization – “DBD Map Viewer”New in IMS Database Solution Pack, Version 2.1

• An Admin. Console add-on

o Can be installed by using IBM Installation Manager

• It provides six views for a DBD:


o DBD map

o DBD source

o DBD XML

o Segment properties

o Data sets

o Outline

DBD Visualization – “DBD Map Viewer”

DBD Map ViewDBD Map View

DBD Source ViewDBD Source View

Data Sets ViewData Sets View


DBD XML ViewDBD XML View

Segment Properties ViewSegment Properties View Outline ViewOutline View

Simplifying space management tasks


Space management actionsThree main action types

• Free space reorganization

o Offline reorganization

o Online reorganization

• Definition change reorganization

o Space allocation change Collect

Analyze

Notice Decide

Act

Prepare


o Space allocation change

o DBD/randomizer change

o Partitioning/re-partitioning

• Tuning for definition changes

o Planned to prepare for an immediate or futuredefinition/structure change

Collect Act

Collect

Analyze

Notice Decide

Act

Prepare

Offline free space reorganization solutionHigh Performance reorganization utilities

• IMS Database Solution Pack provides following utilities

o IMS High Performance Unload

o IMS High Performance Load

o IMS Index Builder

//REORG EXEC PGM=HPSGMAIN,PARM='DBD=dbdname,DBRC=Y'

//STEPLIB DD DISP=SHR,DSN=IMSTOOLS.LOADLIB

// DD DISP=SHR,DSN=IMS.SDFSRESL

//IMS DD DISP=SHR,DSN=IMS.DBDLIB

//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB

//HPSIN DD *

(REORG)

DBSHARE=YES

IMSCMD=YES,TOSI

TOSIXCFGRP=REORG

SPACEALLOC=YES

INDEXBLD=YES

IC=YES

NAMESWAP=YES

DISPOLDDS=NEWSHADOW


o IMS High Performance Prefix Resolution

o Smart Reorg utility

• An integrated reorganization utility that runs utility functions above and post-reorganization Image Copy and Pointer Checker in a single job step

DISPOLDDS=NEWSHADOW

STARTDB=YES

(UNLOAD)

...

(RELOAD)

...

(INDEXBLD)

...

/*

//ICEIN DD *

GLOBAL VIC=Y,

VICDSN=&DDN..UC1,

ICHLQ=TESTDS,

DSN=&ICHLQ..&DDN..IC1,

UNIT=SYSALLDA,

SPACE=(CYL,10,10)

/*

An example JCL statements for Smart Reorg (for a database that has no logical relationship)

Online free space reorganization solutionIMS Online Reorganization Facility (ORF) for z/OS

• IMS Database Solution Pack ORF provides online reorg. solution for full-function databases and HALDBs

COPY UNLOAD APPLYTKO

RELOADIMAGECOPYProcessing Phase

Update and

re-register

logs

ORFORF


Time

UPDATE UPDATEDatabase Status

UPDATE UPDATE

Read-Only or Offline

UPDATEDatabase Status

DB Update Capture Log Database Update Capture

UPDATE

Unload, Reload, Index Build,

Image Copy, Pointer Check

in a single job stepNSProcessing Phase

Legend (for both ORF and Smart Reorg)

DB Data Set

before Reorg

Shadow

Data Set

Reorganized

DB Data Set

Post-Reorg

Image Copy

Smart ReorgSmart Reorg

Name Swap (NS)

Preparing for definition changeIMS DB Solution Pack supports tuning activity

• Types of definition change

o Space allocation change

o DBD/randomizer change

o Partitioning/re-partitioning

• You need to collect information to Collect

Analyze

Notice Decide

Act

Prepare


• You need to collect information to determine the optimal sizes or parameters for these changes

• IMS Database Solution Pack provides tools to support this activity

• The Solution Pack also provides a tuning guide, which explains how to use various utility reports and Administration Console Sensor charts

Solution Pack helps preparation for• Space allocation change• DBD/randomizer change

• Partitioning/re-partitioning

IMS Database Solution PackHigh Performance Pointer Checker

IMS High Performance UnloadIMS HALDB Toolkit

Tuning by partitioning/re-partitioningIMS HALDB Toolkit helps you

• The Toolkit provides HALDB maintenance, modeling, and analysis functions, including

o Splitting a partition

o Consolidating partitions

o Adding an empty partition to

PART31PART21 PART41PART11

DBDS4DBDS3DBDS2DBDS1

001-099 100-199 200-299 300-399

001-099 100-199 200-299 300-X’FFFFFF’

Key Ranges:

RECONPartition

Defiinition

DBD1 DBD2 DBD3 DBD4

DBDH1 DBDH2 DBDH3 DBDH4

Key Ranges:

Convert user-partitioned full-function

databases to single-partition HALDBs.

Merge a set of single-


o Adding an empty partition to the end of a database

o Merging HALDBs

• The Toolkit can help reduce the time and minimize the skills that are required to perform HALDB maintenance tasks


001-099 100-199 200-299 300-X’FFFFFF’

DBDHRECONPartition

Definition

Key Ranges:


001-099 100-199 200-259 300-X’FFFFF’

DBDHRECONPartition

Definition

Key Ranges:

Merge a set of single-partition HALDBs to a

single HALDB with multiple partitions.

Maintain partitions

(partition split, etc.)

PART31

260-299

Gather database

statistics at regular

intervals

User-defined policies and thresholds

PoliciesPolicies SensorsSensors

ModernizationModernizationAutomationAutomation


� New in Autonomics: – Active Autonomics

– New User GROUP management– Group Reorganization Management

Rich, web-based user interface

Recommending and taking corrective

actions

Active Autonomics

Submission of Reorganization JobstreamsManages job distribution across sysplex Controls for parallelism

DB Maintenance WindowsUser controlled DB maintenance windows

Automatic ReorganizationDetermined by Sensor and Policy Evaluation Supported by IMS DB Reorg Expert


Plan restart capability

Determines what ran successfullyOnly reruns/runs what failed or is yet to

run

User NotificationsEmail, Text Job plan and results viewable via AD

Tracks jobstream thru completion

Manages job distribution across sysplex Controls for parallelism

User Defined Groups

� Easy to create– Select from any DBs/partitions/areas in system DBDLIBs– Select from any DBRC or other user group– Name masking support: PAY*

� Contains– List of DB’s in group– Consolidated group attributes and options for various tools and

functions


functions– Reorganization, Back-up and Recovery, etc.

� Automatic membership checking/warning for logical relationships

� Useful for – Adding DBs to the monitor list– Viewing recommendation list– Scheduling on demand

� Basis for Group Managed Reorganization

Structure of GMR jobs – 4-step multiple jobs

1. Pre-GMR job

– Cleans up work data sets of the previous run

– Takes image copies of all databases

– Runs IMS Pre-Reorg utility and Reorg ExpertPre-Reorg utility to identify databases to process

2. One or more Reorg and/or DB Scan jobs

– Runs Reorg Expert if Reorg was recommended

– Runs IPR DB Scan if DB Scan was recommended

• Does nothing if even DB Scan is not needed

Pre-GMR

Reorg or Reorg or Reorg or…

Step 1

Step 2


• Does nothing if even DB Scan is not needed

3. Post-Reorg job

– Runs Reorg Expert Post-Reorg utility to do

• Prefix resolution and prefix update

• Cleans up all work data sets

4. Post-GMR job

– Success case:

• Takes image copies of all databases

– Failure case:

• Does not take an post-reorg image copybecause the reorg should be aborted

Reorg orDB Scan

Reorg orDB Scan

Reorg orDB Scan

…

Post-Reorg

Post-GMR

Step 3

Step 4

• Provides complete tool set• Online / Offline• Reorganization and restructure• Pointer check and space analysis

• High performance/function Image Copy• Library consistency verification

• Delivers Performance• Optimization of resource and CPU

IMS Fast Path Solution Pack

� Autonomics

� IMS Administration


• Optimization of resource and CPU usages


• Delivers New IMS Version support• NEW FP Secondary Index support




� Admin. Console

� IMS Administration Console

� HP FP Utilities

� FP Advanced Utilities

� FP Online Utilities


� IMS HP Image Copy


• DEDB space management activity is composed of the following tasks:

o Monitoring space utilization

o Tuning areas and randomizer

o Reorganizing free space or restructuring areas

DEDB space management


Background and challenge of space monitoring

• DEDB space utilization must be monitoring on a regular basis for the following reasons:

o To avoid application failures that might be caused by out-of-space conditions

o To determine whether reorganization is required

o To determine the optimal timing for database expansion


o To determine the optimal timing for database expansion

• To maintain hundreds and thousands of DEDB areas, DBA needs deep IMS skill and experiences for database space analysis , and it takes a lot of time to check a large number of reports that IMS tools generates

Space monitoring solution

• DEDB area analysis and pointer validation

o Collect raw space statistics (called sensor data)

o Report detailed space usage statistics

o Ensure that your database pointers are error free

o Help you detect and correct database errors quickly

o Provide both online and offline utilities


o

• IMS Tools Knowledge Base

o The reports that are generated by the FPA functions, FPO tools, and IMS HPIC can be stored in a repository

o You can search historical copies of those reports by database name, date and time, or other search criteria

o Threshold criteria for detecting database exceptions and recommendations can also be defined and stored in a repository

• Autonomics Director and Administration Console

o Simplify DEDB space monitoring tasks

Activating DB Sensor function in FPSP Utilities

• DB Sensor function is supported in following utilitieso FP Advance Tool (ANALYZE, UNLOAD, RELOAD, CHANGE, and REORG)

o FP Online Tool (ANALYZE (Online PC), REORG (Online Expert Reorg))

o HP Image Copy

• DB Sensor is activated just by adding three control statement optionso SENSOR=YES (required)

o ITKBSRVR=your_itkb_xcf_group_name (required)

o ADXCFGRP=autonomic_director_xcf_group_name (optional)


o ADXCFGRP=autonomic_director_xcf_group_name (optional)

//FPA EXEC PGM=HFPMAIN0

//STEPLIB DD DISP=SHR,DSN=HPFP.SHFPLMD0

// DD DISP=SHR,DSN=ITB.SHKTLOAD

// DD DISP=SHR,DSN=IMSVS.SDFSRESL

// DD DISP=SHR,DSN=IMSVS.PGMLIB

//IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB

//IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB

//HFPSRPT DD SYSOUT=*

//HFPSYSIN DD *

GLOBAL

DBRC=YES,

ITKBSRVR=FPQSRV01,

ADXCFGRP=IAVADM00

ANALYZE

DBD=DEDBJN22,IAREA=(DB22AR0,DB22AR1),

PTRCHKLVL=FULL,SDEPCHKLVL=FULL,

SENSOR=YES

REPORT

/*

For details and more JCL samples, see “DEDB monitoring and

tuning guide” in the User’s Guide.

//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//STEPLIB DD DISP=SHR,DSN=HPFP.SHFPLMD0

// DD DISP=SHR,DSN=ITB.SHKTLOAD

// DD DISP=SHR,DSN=IMSVS.SDFSRESL

// DD DISP=SHR,DSN=IMSVS.PGMLIB

//FPXIN DD *//FPXIN DD *//FPXIN DD *//FPXIN DD *GLOBAL

DBRC=YES,

ITKBSRVR=FPQSRV01,

ADXCFGRP=IAVADM00

ANALYZE AREA=(DB22AR0,DB22AR1),

FULLSTEP=YES,

TYPRUN=RPT,

SENSOR=YES

/*/*/*/*

A JCL Example for FPA ANALYZEA JCL Example for FPA ANALYZE A JCL Example for OPCA JCL Example for OPC

Online free space monitoring acceleration

• Support light-weight monitoring besides full monitoring

o OPC with TYPRUN=FS now can store both the sensor data and reports on free space statistics in a single job step

IMS

OPC

Free spacereport

area

A subsetof sensor

data

Light-weight monitoring of free spaces (new)

• TYPRUN=FS• SENSOR=YES

• FULLSTEP=YES

No SORT


space statistics in a single job step

• Elapsed time of OPC with FULLSTEP=YES is significantly reduced by

o Processing multiple areas concurrently

o Eliminating I/Os for intermediate data sets

report

Full monitoring of space utilization

IMS

OPC

Full analysisreport

area

Full setof sensor

data

• TYPRUN=RPT• SENSOR=YES

• FULLSTEP=YES

SORTsSORTsSORTs

* Note: Consumption of IMS online DB buffer resource is same as that for

TYPRUN=RPT.

Stand-alone DB Sensor

• Process one DEDB in a job step

• Be used to collect and store sensor data for multiple areas

• Process both offline and online areas

• Report sensor data values in a report

• Does NOT produce Area Analysis Reports

IMS HPFP UTILITIES IMS HPFP UTILITIES IMS HPFP UTILITIES IMS HPFP UTILITIES ---- DB SENSORDB SENSORDB SENSORDB SENSOR

5655565556555655----WWWW11114444 VVVV1111RRRR3333

DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

========================================================================================================================================================================================AREA DEFINITIONAREA DEFINITIONAREA DEFINITIONAREA DEFINITION

========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478

========================================================================================================================================================================================FREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICS

Sensor Data Statistics ReportSensor Data Statistics Report


// DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD

//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD //IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPSYSIN DD *//HFPSYSIN DD *//HFPSYSIN DD *//HFPSYSIN DD *

GLOBAL DBRC=YES, GLOBAL DBRC=YES, GLOBAL DBRC=YES, GLOBAL DBRC=YES, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01

DATABASE DATABASE DATABASE DATABASE DBD=DEDBJN23, DBD=DEDBJN23, DBD=DEDBJN23, DBD=DEDBJN23, IAREA=*ALL IAREA=*ALL IAREA=*ALL IAREA=*ALL

/*/*/*/*

A JCL Example for Stand-alone DB SensorA JCL Example for Stand-alone DB Sensor

• FPA, FPO, and HPIC with SENSOR=YES can also produce this report.

FREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICS========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%

========================================================================================================================================================================================OVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICS

========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%

............

Automated exception detection for sensor data

• Autonomics Director provides:

o Automatic and on-demand analysis of the state of your databases against user-defined threshold criteria

o Generation of user-recommended actions for subject databases and database groups

• Exception detection rules are


• Exception detection rules are almost same as those supported by thresholds for DEDB Pointer Checker and FPA ANALYZE function and OPC

o Free space availability

o Overflow status

o Randomizing Synonyms

o DB Record Length (Avg. & Max)

o Physical I/O

Administration Console work flow for DEDB area space monitoring

Check the itemized diagnosis result for the resource.

Check the summary of latest DEDB area space diagnosis done by Autonomics Director.

11

22

33

Summary Table for a DEDBSummary Table for a DEDB

Exceptions WidgetExceptions Widget

Help WidgetHelp Widget


Look at FP Solution Pack utility reports to see detailed analysis of the space usage of the subject area.

Read the help for each of the detected exceptions.

33

44

Help WidgetHelp Widget

Reports WidgetReports Widget

Main dashboardfor a DEDB areaMain dashboardfor a DEDB area

Sensor WidgetSensor WidgetLook at the trend of specific sensor data values

55

Background of database tuning

• When an exceptional state of an area is detected by space monitoring

o Tuning these areas to obtain the optimal database definition parameters, then reorganize or restructure them based on the tuning results, might resolve the exception

• Tuning a database often involves significant and time-consuming database administration tasks


consuming database administration tasks

o DBDLIB and ACBLIB need to be generated for each iterative if DBD structure change is required

o Unloading and reloading the area to determine if the changes are effective is time-consuming

Database tuning solution

• Adjust the DBD parameters or/and the randomizing routine to suit the current characteristics of the database records in the area

• Goal of tuning is to achieve the following results:

o Shorter synonym chains with fewer unused RAPso Higher percentage of segments in RAA BASE


o Higher percentage of segments in RAA BASEo Fewer physical I/Os to access a root segment and a complete

database record

• The following database specifications can be changed and evaluated:

o Randomizing moduleo UOW parameter valueso ROOT parameter valueso Number of database areaso CI sizes

FPA TUNE function

• Simulate changes of the DBD parameters and the randomizing routine without loading the segments to allow user to select the physical database attributes that satisfy the performance and space utilization requirements

o Provide JCL ease of use

o Allow user to specify new DBD parameters and new randomizing routine with keywords, instead of new ACBLIB


o

routine with keywords, instead of new ACBLIB

o Tune multiple areas in parallel

o Provide a set of complete reports to verify effects of changes

Database tuning simplification

• Database tuning function facilitates multiple iterations of the database tuning process, thereby allowing you to select physical database attributes that meet your requirements

o Even if the tuning attribute is determined once (without iteration), the steps are reduced significantly

o It is unnecessary to build DBDLIB and ACBLIB for each iteration


FPSP V1.2 FPSP V1.3

DBAs generate DBDLIB for the new DBD definition if DBD structure change is required.

Not necessary

DBAs generate ACBLIB for the new DBD definition if DBD structure change is required.

Not necessary

DBAs run FPB DEDB Tuning Aid (DEDBTA) using the above new ACBLIB and/or the new randomizer and threshold in 6 job steps.

DBAs run FPA Tune function with no AREA scan mode specifying the candidate of the new DBD definition and threshold to the keywords and/or the new randomizer in 1 job step.

DBAs need to compare some reports of before/after the tuning to confirm the effectiveness of the tuning.

DBAs can confirm the effectiveness of the tuning based on the threshold values in the area tuning summary report.

o Complete reports are provided to verify effects of changes

Command set of FPA TUNE function

• TUNE command

o Specify general information for tuning, such as DBD name, area name, dataset mask, and so on

• SIMULATE subcommand

o Provide resources for tuning, such as new randomizing routine name, and so on

//HFP//HFP//HFP//HFPTUNETUNETUNETUNE EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0

//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=HPFHPFHPFHPF.SHFPLMD0.SHFPLMD0.SHFPLMD0.SHFPLMD0

// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL

//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB

//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=HFPHFPHFPHFP.DB30AR0.ADS1 .DB30AR0.ADS1 .DB30AR0.ADS1 .DB30AR0.ADS1

//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*

//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*

//HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD *

GLOBAL GLOBAL GLOBAL GLOBAL

SCAN=NO, SCAN=NO, SCAN=NO, SCAN=NO,

DBRC=NO DBRC=NO DBRC=NO DBRC=NO

TUNETUNETUNETUNE

DBD=DEDBJN30, DBD=DEDBJN30, DBD=DEDBJN30, DBD=DEDBJN30,

IAREA=DB30AR0IAREA=DB30AR0IAREA=DB30AR0IAREA=DB30AR0,,,,

AREASCAN=YESAREASCAN=YESAREASCAN=YESAREASCAN=YES

SIMULATE SIMULATE SIMULATE SIMULATE

OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0


so on

• AREADEF subcommand

o Define the new area parameters for tuning, such as CISIZE, UOW, ROOT, and so on

OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0

AREADEF AREADEF AREADEF AREADEF

OAREA=DB30AR0, OAREA=DB30AR0, OAREA=DB30AR0, OAREA=DB30AR0,

UOW=(28,8) UOW=(28,8) UOW=(28,8) UOW=(28,8)

THRESHOLD THRESHOLD THRESHOLD THRESHOLD

DOVFFS_PCT=30, DOVFFS_PCT=30, DOVFFS_PCT=30, DOVFFS_PCT=30,

IOVFFS_PCT=50 IOVFFS_PCT=50 IOVFFS_PCT=50 IOVFFS_PCT=50

/* /* /* /*

areaTAR file

FPA TUNE

iteration

area

FPA TUNE

FPA TUNE

iteration

AREASCAN=YES &No TAR files specified

AREASCAN=NO &TAR files specified

AREASCAN=YES &TAR files specified

tuning reports

tuning reports

Sample JCL for mode 2

Mode 1: Create TAR files at first, then iterate tuning process using the existing TAR files

Mode 2: Iterate tuning process using the intermediate TAR files that are deleted at the end of each iteration

OPC/OER TAR files generation

• Generate the TAR files, which can be used as the input data for FPA TUNE function

o Enable DEDB areas to be tuned without taking the areas offline

o Specify TARECGEN=YES for

//OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA

//STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0

// DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL

// DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB

//SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY

//SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=*

//FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=*

//FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=*

//DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY

//FPXIN DD * //FPXIN DD * //FPXIN DD * //FPXIN DD *

ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1

MFILE=FPXMFILE MFILE=FPXMFILE MFILE=FPXMFILE MFILE=FPXMFILE

RFILE=FPXRPTS RFILE=FPXRPTS RFILE=FPXRPTS RFILE=FPXRPTS

TYPRUN=RPT TYPRUN=RPT TYPRUN=RPT TYPRUN=RPT

FULLSTEP=YES FULLSTEP=YES FULLSTEP=YES FULLSTEP=YES

TARECGEN=YES TARECGEN=YES TARECGEN=YES TARECGEN=YES

TARDSNMASK=‘TARDSNMASK=‘TARDSNMASK=‘TARDSNMASK=‘HFPHFPHFPHFP.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'

/*/*/*/*


• ANALYZE statement of OPC

• or PTRCHK statement of OER

o Specify TAR file and AREASCAN=NO for

• TUNE command of FPA

//HFP//HFP//HFP//HFPTUNETUNETUNETUNE EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0

//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS133330.SHFPLMD00.SHFPLMD00.SHFPLMD00.SHFPLMD0

// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL

//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB

////////TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=HFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TAR

//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*

//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*

//HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD *

GLOBAL DBRC=NO, GLOBAL DBRC=NO, GLOBAL DBRC=NO, GLOBAL DBRC=NO,

SCAN=NO SCAN=NO SCAN=NO SCAN=NO

TUNETUNETUNETUNE

IAREA=DBIAREA=DBIAREA=DBIAREA=DB23AR123AR123AR123AR1, , , ,

DBD=DEDBJNDBD=DEDBJNDBD=DEDBJNDBD=DEDBJN23,23,23,23,

AREASCAN=NOAREASCAN=NOAREASCAN=NOAREASCAN=NO

SIMULATE SIMULATE SIMULATE SIMULATE

OAREA=DBOAREA=DBOAREA=DBOAREA=DB23AR123AR123AR123AR1, , , ,

AREADEFAREADEFAREADEFAREADEF

OAREA=DBOAREA=DBOAREA=DBOAREA=DB23232323AR1, AR1, AR1, AR1,

CISIZE=4096 CISIZE=4096 CISIZE=4096 CISIZE=4096

/* /* /* /*

IMS

OPC

areaTAR file

FPA TUNE

iteration

AREASCAN=NO &TAR files specified

tuning reports

Area Tuning Summary ReportIMS HPFP UTILITIES - FPA TUNE "Area Tuning Summary Report" PAGE: 15655-W14 V1R3 2013-09-13 16:22:48DBD NAME: DEDBJN30SIMULATION MODE: RESTRUCTURE (AREADEF subcommands are specified)CURRENT RESOURCES:- ACBLIB DDNAME: IMSACB- RANDMIZER : DBFHDC44SIMULATED RESOURCES:- ACBLIB DSNAME: IMS.ACBLIB- RANDMIZER : DBFHDC44Threshold Exceptions:Exceptions from current areas-------------------------------------------------------------------------------------------------------------------The percentage of free space in DOVF fell below a threshold in area DB30AR0.The percentage of free space in IOVF fell below a threshold in area DB30AR0.-------------------------------------------------------------------------------------------------------------------Exceptions from simulated areasList the threshold exceptions that are detected in the current areas

and the simulated areas


Exceptions from simulated areas-------------------------------------------------------------------------------------------------------------------*** No exception was detected ***-------------------------------------------------------------------------------------------------------------------Area Statistics:*: Shows the point of threshold exception.AREA NAME: DB30AR0------------------------------------------------------------------------------------------------Keyword Threshold Value Current Value Simulated Value Difference------------------------ ---------------- ---------------- ---------------- ------------------DOVFFS_PCT 30% 26%* 57% +31IOVFFS_PCT 50% 47%* 98% +51Database Definition and Database Record Distribution:Upper row for each area shows the definition and number of database records of current areasLower row for each area shows the definition and number of database records of simulated areas* shows the difference TOTAL CI'S SDEP STARTAREA AREA CI-SIZE UOW= ROOT= --------------------------------------- ------------------ NUMBER OFNAME NO. BASE DOVF IOVF TOTAL BLOCK# RBA(HEX) DB RECORDS-------- ----- ------- ------------- ------------- --------- --------- --------- --------- --------- -------- -----------DB30AR0 1 2,048 (24,4) (6500,500) 120,000 24,000 11,900 155,900 - - 109,900DB30AR0 1 2,048 (28,8)* (6500,500) 120,000 48,000 13,883 181,883 - - 109,900-------- ----- ------- ------------- ------------- --------- --------- --------- --------- --------- -------- -----------

List the threshold value for each factor that is evaluated (supplied

through the THRESHOLD subcommand keywords)

List the database definitions and the number of database records

in the current areas and the simulated areas

Other reports generated by FPA TUNE function

• Provide two sets of the comprehensive analysis reports to evaluate the effects of tuning

o The reports beginning with TUNED in the title contain information that obtained from the simulated areas

o The reports without beginning with TUNED in the title information that obtained from the current areas


o The following reports are generated:

• (TUNED) DEDB Area Analysis report

• (TUNED) Process Summary of Analysis report

• (TUNED) Segment Length Distribution report

• (TUNED) UOW report

• (TUNED) UOW Exception report

• (TUNED) Largest Database Records report

• (TUNED) Consolidated Largest Database Records report

More information in area analysis report

• Solution

o Add new report header lines that indicate:

• Input data set name• Input data set type (and the timestamp for image copy)

o Add SDEP information in the following reports:

• SDEP LB/LE information in Freespace Analysis report• Number of occurrences in Segment Placement Analysis report


• Number of occurrences in Segment Placement Analysis report

o Optionally add segment prefix length information in the DB Record Profile Analysis report

o Optionally add Segment Length Distribution report

• Customer benefit

o Sure identification of the source of statistics data

o Comprehensive reporting of SDEP space usage information

o Better estimation of space use by each segment type

o Quick identification of segment length

Make space management simpler and easier


Background and challenge of space management

• When an exceptional state of an area is detected by space monitoring, reorganize free space or extend the size of areas based on the tuning results

o If the database record profile and the number of database records in the area are relatively unchanged, reorganizing free space might resolve the exception

o If the available free space fall below the thresholds, extending


o If the available free space fall below the thresholds, extending the size of the DEDB areas might resolve the exception

• In operating environments that cannot be stopped, unload/reload cannot be used to increase free space in areas, and ineffective reorganization causes unnecessary impact upon online performance

Space management solution

• DEDB area expansion

o Dynamically extend the IOVF portion and the SDEP portion of DEDB area without take it offline

o Support volume management in SMS environment

• DEDB area reorganization


o Extend the capability of High-Speed DEDB Direct Reorganization utility (DBFUHDR0)

o Evaluate UOWs in DEDB areas, rank the UOWs, and reorganize only highly ranked UOWs to reduce the volume of database update logs

o Collect statistics and generate area analysis reports of the reorganized area

o Take image copies of the reorganized area

Online area expansion

• Increase IOVF and/or SDEP parts size while allowing online access to the area that is being extended

o Use DEDB create utility (DBFUMRI0)

o Process a single area in one step

• Two expansion types


IMS

OAE

avail

IOVF

avail

IOVF

ADS1ADS1 ADSADS１１１１１１１１

copy back

Rename(TOSI)

Original expansion

IMS

OAE

unavail

avail

IOVF

ADS2ADS2

avail

unavail

Shadow expansion

IOVF

ADS1ADS1

IOVF

ADS1ADS1

IOVF

ADS2ADS2

IOVF

ADS2ADS2

Simpler parameter specification

• The extended size for SDEP portion can be specified with a specific number or by a percentage of CIs within the total number of CIs defined in the SDEP portion

o SDEP_CI=xx or xx%

• The extended size for IOVF portion can be specified with a specific number or by a percentage of UOWs within the


specific number or by a percentage of UOWs within the total number of UOWs defined in the IOVF portion

o IOVF_UOW=xx or xx%

• These specifications allow OAE to be executed multiple times without JCL modification

Volume management support

• Provide a keyword VOLCNT to allow user to specify the maximum number of volumes for the extended area data set

o OAE uses volume where space is available

o The VOLCNT keyword is supported only for SMS environment


• Make OAE execution a success although some volumes are out of space

Online free space reorganization

• Save online system resource and eliminates unnecessary reorganizations by identifying only those databases that need to be reorganized based on user-defined criteria

ROOT DDEPROOT


DDEP

DDEP

DDEP

DDEP

ROOT

ROOT

ROOT

DDEP DDEPROOT

ROOTROOT

Base Base

DOVF

DDEPROOT

DDEP

DDEP

UOW IOVF

DDEP DDEP

IOVFUOW

IMS

OER

DOVF

Free space reorganization acceleration

• Minimize the impact on other critical applications accessing the area, and maximize the effect of reorganization

o Reorganize only the subset of the most fragmented UOWs

o Provide a keyword REORGLIM to allow user to specify an allowable maximum number of UOWs to be reorganized


• Internally invoke OPC after reorganization to produce reports to verify the effects of reorganization, to take image copy of the reorganized areas

Big picture of Fast Path Solution Pack and Tools Base

Analyze & DB Sensor functions

IMS FP Solution Pack V1.3 IMS FP Solution Pack V1.3

TSO

Reorganize functions

• Reorganize free space

Tune functions• Tune database

• Extend database

11

22

44

Extend function

Restructure functions55

• Change database attributes

• Analyze and collect sensor data


IMS ToolsKnowledge

BaseRepository

Server

Repository

Autonomics Director Server

Autonomics

Director

(+ Policy Services)

IBM Tools Base V1.4 IBM Tools Base V1.4

z/OS Env.

• Policy-based DEDB Area Diagnosis

• Store sensor data

(and reports)• Notify sensor data

Distributed Access

Infrastructure

Administration

Console Open Env.

• Notify

exceptions

22

33

So what is next?

� We introduced AUTONOMICS– Automation of sensor capture – Passive Autonomics

– Active Autonomics

� Introduced IBM Administration Console– Web Browser view of your world

– Web Browser management of autonomics

� Retaining ISPF


� Retaining ISPF– Management of autonomics

– View on exceptions

– Management and view of Group Reorganizations

� What about MOBILE?

So …. You say that you still want ISPF

So …. You say that you don’t see the value of a web browser connection….it is pretty but not likely to be used


So …. You say that you definitely never use mobile

BUT – is that true?

Let’s examine the evidence

1. Do you have a smart phone?2. What applications do you have on your phone?

1. GPS2. Banking app3. Airline notifications4. Fitness application5. Cheapest Gas app6. Track Gas spend/mileage7. Budgeting App8. Grocery List App


8. Grocery List App9. Email10. E-reader application11. Calendar12. Address Book13. Reminders14. Games15. Weather Reports16. Web Browser

3. Is it more this year than last year – 5 yrs ago what did you have?

4. What about your younger staff?

Summary

� IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs

� We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers around autonomic computing

� IBM is dedicated to the continued success and


� IBM is dedicated to the continued success and support of IMS and the mainframe. We’re invested for the long term, right beside you.

IMS Tools

Technology

Ims02 automics and modernization - IMS UG May 2014 Sydney & Melbourne