IBM Software© 2014 IBM Corporation

IBM DB2 Recovery ExpertJune 11, 2015

Baltimore/Washington DB2 Users Group

IBM Software

Topics

Backup and Recovery Challenges

FlashCopy Review

DB2 Recovery Expert Overview

Examples of Feature and Function

Benefits of System Level Backup (SLB)

Recovery Expert and Disaster Recovery

Summary

2

IBM Software

Backup and Recovery Challenges

Backup and Recovery is complicated

► Managing and verifying recovery assets is essential, yet difficult

Need to balance high availability with “time to copy”

Customers often don’t revisit new Backup & Recovery technologies/options

High cost in resources (CPU and I/O)

Perform complex tasks with smaller number of skilled professionals

Swift recovery required

► Recovery normally not practiced

3

IBM Software

What causes “unplanned” outages?

4

20%

40%

40%

Hardware Outage

Operator Errors

Application Errors

IBM Software

Database Downtime Affects Your Business

5

Time consuming, rarely used, manual backup/recovery procedures don’t scale as data volumes grow

Inability to backup all data because of shrinking maintenance windows and growing data volumes

Difficult to get complete database backup impacting availability

Modernization: No longer have the luxury of doing backup and recoveries the traditional way

Average cost of database downtime $1.5M USD/year

Revenue at risk

Customer satisfaction declines

Missed service level agreements

Brand damage and loss of goodwill

Customer’s desire immediate gratification !!

*Source Aberdeen Group, 2010

IBM Software

Once you have an event…

6

Up to 70% of recovery time is “think time”!

► Not processing time

0% 50% 100%

120 20 30 30

Ele

me

nts

Total Recovery Time

Diagnose

Investigate

Analyze

Recover

Source : McGladrey and Pullen

. . . . . ..

IBM Software

FLASHCOPY REVIEW

7

IBM Software

FlashCopy Overview

FlashCopy (FC) is an optional licensed feature of IBM storage subsystems

Creates instant copy of a volume or a dataset at specific time

Advantages

► Can copy huge volumes of data very quickly (seconds to a few minutes)

► Minimal disruption for the running applications

► Copy process is offloaded to storage subsystem - lower CPU and I/O

► Faster Backups – fit backup window

Many options available including

► Volume and Dataset level FC

► Copy and NoCopy FC

► Incremental FC

► Space Efficient FC

► Consistency Group FC

► Remote Pair FC

8

IBM Software

Source and Target Volumes

9

Source

Establish FC

Target

Track Bit Map

Source

Background Copy

Target

Track Bit Map

FlashCopy Establish command issued

1) Source and Target volume relationship established

2) Track bit map created

3) Source volumes available immediately for updates

4) In background copy, tracks are copied from Source to Target

5) Track bit map is updated

IBM Software

FlashCopy Background Copy

FlashCopy target can be immediately used for recovery

► If background copy not complete – Fast Reverse Restore

► If background copy complete – FlashCopy used

Offload process can happen any time after backup

► If background copy complete, no I/Os will be directed to production

► If background copy is not complete, could be small performance impact

on production I/O

Performance Implications

► Background copy at lower priority – Minimizes production impact

► Recommendation: Wait for background copy BEFORE offloading to tape

10

IBM Software

FlashCopy for a Consistency Group

11

Source Target

S1 T1

FlashCopy Establish

1) S1 is Frozen, no more writes

2) S2 is Frozen, no more writes

3) S3 is Frozen, no more writes

T1 – T3 have Consistent FlashCopy

Source Target

S2 T2

Source Target

S3 T3

THAW after Establish Phase

1) Source updates proceed on S1, S2, S3

IBM Software

FlashCopy Consistency Groups

12

Source

Target

T1

(Loadlibs)

Source

Target

T2

(DB2 Log)

Source

Target

T3

(DB2 DB)

Source

Target

T4

(IMS Log)

Source

Target

T5

(IMS DB)

S1

(Loadlibs)

S2

(DB2 Log)

S3

(DB2 DB)

S4

(IMS Log)

S5

(IMS DB)

Time

Suspe

nd I

/O

Re

sum

e

Maximum time I/O frozen

IBM Software

The Benefits of Storage Aware Database Tools

Fast backups and restores

Enables fast copy for DBAs

Integrates DBMS and

Storage Functions

Reduces host CPU and I/O

resource utilization

13

Mainframe Database Systems

Storage Aware

Database Tools

Source

Database Backup,

Clone,

DR

IBM Software

IBM DB2 Backup and Recovery Tools - Our Goals Create recovery assets with minimal impact to database availability

► Little or NO database unavailable time

► Limit resource usage: Save CPU, I/O, and storage

Recover as quickly and efficiently as possible

► Efficient complete recovery strategy

► Limit the amount of data needed to recover

Recover to any point in time

► RBA, LRSN, Timestamp, current

Validate recovery

► Ensure TSs and indices are recovered correctly

Most important, remove most of the “think time” in database recovery

14

IBM Software

IBM DB2 RECOVERY EXPERT FOR Z/OS

15

IBM Software

Recovery Expert is a Backup and Recovery Solution Provides fast and low cost method of backup and recovery

Wide range of backup and recovery solutions - including recovering from a dropped object to a major disaster(local mass recovery) -- and everything in between

A System Level Backup is a backup of the entire DB2 environment at a point in time.

Much more than a backup & recovery product, DBA rich functionalities

Intelligent Recovery Manager

Insurance Policy

16

IBM Software

Recovery Expert is an Insurance Policy

Protects your critical DB2 for z/OS objects and data

► Extensive validity checking

► Consistent guaranteed backups

● Finds related objects

● Validates all objects are included for recovery

– During system configuration analysis

– At backup set up and execution time

– During health check process

● Ensures the quickest, most efficient recovery

● Restartable & Consistent image of DB2

– DR Plan B & Complement for mirroring

● Can be used as part of process to be restored to a non-

production environment.

17

IBM Software

Recovery Expert is an intelligent backup and recovery manager

► Reduces the complication of recovery!

● Analyzes your recovery resources

● Easy to choose recovery points

● Create detailed recovery plans

● Provides cost-based recovery estimates in real-time

● Detects and recovers related objects

● Detects objects not updated since last recovery point and will not be recovered

● Utilizes new technologies and recovery strategies

● Generates the optimized JCL

● Provides reporting for review and control

► Minimizes the exposure & risk!

● Pro-actively create recovery plans to validate the ability to recover

● Health check functionality validates the ability to recover to selected points in time

18

IBM Software

Where is SLB recorded?

Meta Data Repository

► Store information on SLBs created

► Track database characteristics and status

● Volume, table spaces, indexes, etc.

► Tape offload tracking

► Sent to remote site for restart and recovery automation

19

Source Volumes

IBM Software

Backup Resource Utilization Test Results

20

0

50

100

150

200

250

300

350

400

Elasped Time in Minutes EXCPs in Millions CPU in Minutes

Traditional ICStrategy

Flash Copy ImageCopy

Recovery ExpertSLB

IBM Software

Image Copy Creation

• Image copies created from a system level backup

► Eliminate batch window requirements

► Image copies can be created and registered in DB2 SYSCOPY

► Eliminates I/O contention to maintain production performance

► All image copies created at the same point in time

► Reduces recovery time

21

IBM Software

Recovery Expert is Easy to Use!

Only backup and recovery product in market that offers choice of either ISPF or Web Browser UI

► Same look-and-feel and function across either interface

► Menu-driven, self-guided solution

Simple navigation through backup and recovery tasks

► One screen, one job - replaces thousands of image copies

Choose your object(s), select a recovery point, generate and execute the job

22

IBM Software

DB2 System Backup Profiles - Panels

23

IBM Software

IBM FlashCopy

EMC Snap

Backup Profile Screen

24

IBM Software

Offload…

25

IBM Software

One job…

26

DB2 Recovery Expert

SLB control statements

IBM Software

One Job…Offload Step

Offloads Control

Statements

27

IBM Software

Establish/Thaw Benchmark

Source

Establish/Thaw FC

Target

Track Bit Map

Specifications1) 13 TB of data2) 461 volumes3) DS83004) 2817-M80 z1965) 4,075.28 TX/second6) Backup Elapsed = 0.37 secs

IMS Recovery Expert for z/OSBackup Summary Report

Utility Executed:......... BackupProfile Name:............. ROCKET1.BKUP1IMS Subsystem:............ IMSPIMS Version:.............. 12.1Backup Type:.............. Flash CopyBackup Contains:.......... Database, Log Data (Mixed)Partial Backup:........... NoNbr of Volumes:........... 0461Backup Date:.............. 02/01/2012Backup Time:.............. 2012-02-01-17.03.20.671934Consistency Method:....... Flash Consistency GroupSupports Database Restore: NoI/O Suspend Time:......... 2012-02-01-17.03.20.671932I/O Resume Time:.......... 2012-02-01-17.03.21.042397Backup Elapsed:........... 00.37 Seconds

28

IBM Software29

Replaces thousands of image copies…

= SLB

Elapsed Time Savings

IBM Software30•30

Recovery Advisor

IBM Software

Recovery Expert Meta Data Repository

Backup and Recovery Assets Needed:

● System Level Backup/Image Copy

● Archive Logs

● Up-to-date Recovery Expert Meta Data Repository

DB2 for z/OS

Schema Level

Repository (SLR) Job

Info gathered about:

• Log/BSDS

• DB2 data

• and more…

Chg’dVers

Timestamp OrigVers

RE MetaData Repository

Chg’dVers

Timestamp OrigVers

…… …

31

IBM Software32

DB2 RE Web-Based Interface

IBM Software33

User Interface – Web UI

Recovery Advisor wizard allows you to build recovery for any object data and/or DDL

Result will be recovery plans with cost associated to each

Log Analysis wizard allows you to find and store QUIET times based for a set of objects and store this in an RE repository for later use

System Restore wizard allows you to build restore JCL using any SLB supported by RE.This includes DFSMSdss

The Log Based Recovery Advisor will assist you through the steps of generating DDL and recovering dropped objects at a DB2 location using DB2 log files

The Specifications wizard allows you to build profiles of OBJECTs.You can use these similar to the BACKUP PROFILEs in ISPF

IBM Software34

DB2 Recovery Expert Examples

IBM Software35

Recovery Advisor

IBM Software

Include Objects

Filtering Functionality

36

IBM Software

DB2 Object Profiles - Panels

IBM Software

DB2 Object Profiles - Panels

IBM Software

IBM Software40

Select the version of the

object to reverse

IBM Software

IBM Software42

Quiet Time Scan Period Quiet times meeting

criteria

IBM Software43

IBM Software44

IBM Software45

IBM Software

DB2 Recovery Options - Panels

IBM Software

IBM Software

DB2 V10 RECOVER

with Backout

Relative Cost

IBM Software

DB2 v10 Online Schema Recovery

DB2 v10 provides more Online Schema options

► Defer Alter for various object types with no recovery possible

With Recovery Expert

● Ability to reverse conversion

● Recover up to QUIESCE point prior to REORG materializing

49

IBM Software

DB2 Recovery Expert for z/OS V3.1

Storage Integrated DB2 Recovery Example

Managed DB2 Application Recovery

DB2Spaces

BSDS

Image Copies

DB2 System Backup

DB2 RE Intelligent Recovery Manager

Tra

dit

ion

alIC

Fa

stre

p IC

SQL Recovery

Re

do

SQ

L

Un

do

SQ

L

Index Rebuild

DB

2

Uti

lity

Check Utility

Ind

ex

Da

ta

Post Recovery

Image Copy

Tra

dit

ional

Fa

stre

p IC

Restore FromSLB

IBM

Fla

shco

py

EM

C S

NA

P

DF

SM

Sd

ss

Fast-replicationData Set Restore

DB2 Recovery Expert Invoked Recovery Processes

RecoverUtility

DB2 Catalog

DB2 Log

DB2 RERepository

DroppedObject

Recovery

DD

L +

DC

L

Da

ta R

eco

ver

Lo

g A

pp

ly

50

IBM Software

Powerful features of Recovery Expert

51

IBM Software

Benefits of Recovery Expert

System Level Backup

52

IBM Software

Assist with System Level Backup

53

IBM Software54

Assist with System Level Backup

IBM Software

Health Checking

Online Health Check

recovering to current.

Health Check can

execute online or

batch..

IBM Software

DB2 RE SLB – Health Check report

Displaying objects can

be recovered with an

additional image copy.

Displaying objects can

NOT be recovered. No image copies taken after

load replace log no.

IBM Software

DB2 RECOVERY EXPERTDISASTER RECOVERY

IBM Software

Disaster Recovery

58

IBM Software

Disaster Recovery – DR Prep

59

IBM Software

Customer’s Disaster Recovery Process

Storage Processor APIs

IBM DB2/IMS

Recovery

Expert

DB2

Tape

Processing

Source

Database

Volumes

System

Level

Backup

SLB

Primary Production Site Secondary Production Site

Vtape Replication

Primary Disaster

Restart Site(remote tape-based

disaster restart)

Tape

Processing

SLB

SLB and

Archive Log Tapes

Offload

Frequency - Nightly

DR -Prep

Executes on local Mainframe, copies archive logs and necessary

recovery assets.

Frequency – 15 mins.

RPO – 15 – 30 mins.

Execute 4 jobs created by

DR-Prep process for complete DBMS Recovery,

resulting in reduced RTO.DB2

IBM DB2/IMS

Recovery

Expert

SLB

Frequency - Nightly

recovery

assets

60

IBM Software

Disaster Recovery

Volume Copies

Image copies

Mirroring

Recovery Expert

brings it all together! 61

IBM Software

Integration with other Tools

IBM DB2 Cloning Tool

► Clone from a System Level Backup (SLB)

● Use an SLB created via IBM DB2 Recovery Expert as input

● Duplicate your production environment quickly and easily

IBM DB2 Automation Tool

► DB2 Automation Tool can drive the process of creating numerous image

copies from an SLB

► Can reuse IBM DB2 Automation Tool object profiles

62

IBM Software

CPU Savings

63

Elapsed Time Savings

-400

100

600

1100

1600

Today Year 1 Year 2 Year 3 Year 4 Year 5

Traditional IC

Fast Rep IC

Admin Cost Savings

Time to Recover

70% Think Time

63

IBM Software64

Backup and Recovery Summary

Complexity of backup and recovery

Backup practices are sometimes not cohesive

Recovery requires lots of time, effort and resources to plan/create/maintain

Unexpected stressful situations with executive scrutiny

Why Recovery Expert

Manages backup strategies – provides visibility

Reduces application service down time with faster and guaranteed recovery

Easily back out unwanted schema changes or errors

• Improves availability and application time to market • Industry-leading capability in DB2 10/11

Best storage-aware database product in industry• Multi-vendor support• Operational simplicity and efficiency• Ensures assets exist prior to backup/recovery• Integration with IBM DB2/IMS Cloning Tool for z/OS for additional value

IBM Software

Questions

65