Click to add text IBM Software February 2009 | Advanced Technical Support © 2009 IBM Corporation Confidentiality/date line: 13pt Arial Regular, white Maximum

IBM Software

February 2009 | Advanced Technical Support © 2009 IBM Corporation

Tivoli Storage Manager Version 6Technical Overview

IBM Advanced Technical SupportDave Daun [email protected]

| Tivoli software

TSM V6 Technical Overview | February 2009 l © 2009 IBM Corporation 2

Agenda

New Install Process

New TSM Database – Port to DB2

Data Deduplication

Real-Time Monitoring and Reporting

Individual Mailbox Restore for Microsoft Exchange

N-Series SnapDiff Integration and Snap Mirror to Tape Integration

VMware Consolidated Backup Improvements

Microsoft Windows Active Directory Individual Object Restore

AdminCenter Improvements

| Tivoli software


Agenda

Disaster Recovery Manager for Active Data Pool Objects

GPFS for LANfree

Improved Restore Performance

Improvements to EXPIRE INVENTORY

Other New Features

| Tivoli software


Overview

Some perspective on the TSM V6 announcement

• Announced on February 10, 2009

• Electronic download available on March 27, 2009, Media on April 24, 2009

• Significant in terms of scope and function

• Beta program started in April 2008 and has included over 200 participants

What’s coming in in the Lunch & Learn Series

• Preparing for the Next Release of TSM (January 22)

• TSM V6 Performance Assessment

• TSM V6 Database Upgrade Process

• TSM V6 Integrated Reporting Feature

• TSM V6 Data Deduplication Feature

• TSM V6 Administration Center Update

| Tivoli software


TSM Installation

| Tivoli software


TSM V6 Installation

New installation tool – Deployment Engine

• No longer use the native install tools (smit, Windows Installer, etc.)

Installs all components easily

Used by the TSM server, client and reporting tool

| Tivoli software


TSM V6 Installation

| Tivoli software


TSM V6 Installation

| Tivoli software


TSM V6 Installation

| Tivoli software


TSM Database

| Tivoli software


TSM V6 Database – Port to DB2

Major restructuring of the TSM database – complete port to IBM DB2

Why do this ??

• Current DB is reaching its limits in terms of size, performance, and function

• Position for long term growth

• Position for future additional function (online audit and reorg)

• Free up development resources

Performance goal is to provide “equivalent performance”

• Compared to Version 5.5

• “Port” to a new database has some side effects

!! Not the solution to every problem !!

| Tivoli software



Completely New TSM Database

• External to TSM – you can see it there and you can interact directly with the DB2 database manager – DON’T ALTER ANYTHING

• Design goal is make DB2 as transparent as possible – there is no expectation that TSM administrations will need to be DB2 administrators

One-to-One relationship between TSM and database

• Must use the DB2 that is installed with TSM – cannot use an existing DB2 instance

• No merge of multiple TSM instances into one database

• Can run multiple TSM / database instances on same OS image

| Tivoli software



Upgrade utility is provided as a separate install package

• Use the utility to upgrade a V5.4 or V5.5 server to TSM V6

• Upgrade can run in-place or to a separate install of TSM V6

• Upgrade can run using an intermediate media (sequential) or direct network connection

• Utility can coexist with TSM V5

Upgrade process:

1. Upgrade existing TSM database to V5.5.2 level

2. Extract from existing V5 database

3. Insert into new TSM V6 database

Source server is down during extract process

• If TSM V5.5.2, existing TSM server can restart

• If prior to V5.5.2, the TSM database needs to be restored

| Tivoli software


TSM V6 Database – Port to DB2 Upgrade with Media Process

1. dsmupgrd extractdb 2. dsmserv loadformat

3. dsmserv insertdb

Source TSM V5 Server Target TSM V6 Server

Sequential Media

Extractdb/dsmserv insertdb done in separate steps.

DB2

| Tivoli software


TSM V6 Database – Port to DB2 Upgrade with Network Process

2b. dsmupgrd extractdb

1. dsmserv loadformat

2. 2a. dsmserv insertdb

Source TSM V5 Server Target TSM V6 Server

Network Connection

Extractdb/dsmserv and insertdb done at same time.

DB2

| Tivoli software


Data Deduplication

| Tivoli software


TSM Data Deduplication

Only supported with stgpools using devclass=file

• Including ADPs

Server-side

• No required change to clients or legacy data in storage pools

• Duplicates across clients can be identified

• V6.1 client will change to identify meta data vs content

− Not required, but this will improve the de-dup process on the server

Out-of-band process

• Background process

• No impact on backup window

IBM Advanced Technical Support | Tivoli Storage Manager

TSM with Large Disk Pools | SHARE Mar 2009 | © 2009 IBM Corporation19

TSM Data De-DuplicationConcept

1. Chunk the object

Divide object into logical segments called chunks

2. Identify duplicate chunks

Hash each chunk to produce unique identifier

Compare each chunk identifier with index to determine whether chunk is already stored

3. Eliminate redundant chunks

Update index to reference matching chunks

Deallocate space for redundant chunks

Object Chunks Chunk identifiers

Index Chunk identifiers

5

91

17

25

Index

5

91

17

25



TSM Data Deduplication Overview

Client 1 A

ServerB

C

Deduplicated disk storage pool stores

unique chunks to reduce disk

utilization

Node File

Client 1 A

Client 2 B

Client 3 C

TSM DatabaseA

B

C

Tape copy pool stores A, B, and C individually to

avoid performance degradation

during restoreFiles A, B and C have common data

A

B

C

Client 2

Client 3

Deduplication

Allows more objects to be stored on disk for fast accessAllows more objects to be stored on disk for fast access

| Tivoli software


TSM Deduplication New Externals

DEFINE / UPDATE STGPOOL stgpoolname

DEDUPlicate=No | Yes

IDENTIFYPRocess=nn (default number of background processes)

IDentify DUPlicates stgpoolname

DUration=mm (minutes to run process)

NUMPRocess=nn (override stgpool setting)



TSM Deduplication Considerations

Consider deduplication if• Data recovery would improve by storing more data objects on limited

amount of disk• Data will remain on disk for extended period of time• Much redundancy in data stored by TSM (e.g., for common operating-

system or project files)• TSM server CPU and disk I/O resources are available for intensive

processing to identify duplicate chunks

Deduplication might not be indicated for• Mission-critical data, whose recovery could be delayed by accessing

chunks that are not stored contiguously• TSM servers that do not have sufficient resources• Data that will soon be migrated to tape

| Tivoli software


Real-Time Monitoring and Reporting

| Tivoli software


TSM Real-Time Monitoring and Reporting

A new stand-alone monitoring and reporting server based on IBM/Tivoli Monitoring (ITM) and Tivoli Common Reporting (TCR)

Monitoring/Reporting server installs on Windows, AIX, and Linux86

Monitoring agent installs directly on some server platforms or runs on the monitoring server

Uses Deployment Engine to install all components easily

• DB2

• IBM/Tivoli Monitoring/Tivoli Enterprise Portal/Tivoli Data Warehouse

• Tivoli Common Reporting and TSM ISC/Admin Center

• TSM/TEP Workspaces and TSM/TCR report definitions

During installation, the administrator will select userid's and passwords for each of the ITM/TEP/TDW/TCR components.

No need to license DB2, ITM or TCR separately

| Tivoli software


TSM Real-Time Monitoring and Reporting TSM Tivoli Common Reporting

Integrated, common-reporting engine that integrates to IBM Tivoli Monitoring (ITM) and Tivoli Data Warehouse (TDW)

Uses an agent to communicate with the TSM server and extract data from the TSM database and return this data to the ITM server to be stored in the TDW database

ITM will act as a monitoring application while the Tivoli Common Reporting (TCR) portion of ITM will report on the retrieved data

TCR uses the Eclipse/BIRT (open-source) engine to report on the data using customized and standardized reporting templates provided by TCR and customized by TSM developers.

| Tivoli software


TSM Real-Time Monitoring and Reporting Platform Support

Platform Server OS Support Notes:

AIX Those supported by TSM 5.4 - 6.1 The ITM agent will be installable on this OS

HP Those supported by TSM 5.4 - 6.1 The agent will NOT be installable on this OS but will be able to monitor TSM remotely from the ITM server

i/p Series Linux

Those supported by TSM 5.4 - 6.1 The agent will NOT be installable on this OS but will be able to monitor TSM remotely from the ITM server

x Series Linux

Those supported by TSM 5.4 - 6.1 The ITM agent will be installable on this OS

z Series Linux

Those supported by TSM 5.4 - 6.1 The agent will NOT be installable on this OS but will be able to monitor TSM remotely from the ITM server

z/OS Those supported by TSM 5.4 – 5.5 The agent will NOT be installable on this OS but will be able to monitor TSM remotely from the ITM server

Solaris Those supported by TSM 5.4 - 6.1 The agent will NOT be installable on this OS but will be able to monitor TSM remotely from the ITM server

Windows Those supported by TSM 5.4 - 6.1 The ITM agent will be installable on this OS

| Tivoli software



| Tivoli software



| Tivoli software


TSM Real-Time Monitoring and Reporting Using the Event Monitor

ITM workspaces are presented on the Tivoli Enterprise Portal foundation. A number of workspaces will be delivered with the TSM reporting solution. These workspaces will be easily selected from a list of workspaces in the TEP console. Once selected, each workspace will communicate with the TSM agent to retrieve and present data to the user from the selected TSM server.

• The user opens the TEP console on their computer desktop

• A userid and password will be entered into the TEP console for access to the predefined workspaces

• The main TEP screen displayed will present the user with a set of attribute groups and workspaces that they can select to display the appropriate information

| Tivoli software



| Tivoli software



| Tivoli software


TSM Real-Time Monitoring and Reporting Using the Reporting Feature

To start TCR, the user will point their browser to a URL in the same as the user points to the Admin Center URL. ISC will request a userid and password to access the TCR product.

The user will be presented, after login, a list of reports available to them in the ISC navigation tree. They will select each report which will then be displayed to them in the ISC console at which time they may choose to save the report in a number of different formats or print the report.

| Tivoli software



| Tivoli software



| Tivoli software


Individual Mailbox Restore for MS Exchange

| Tivoli software



Perform individual mailbox and item-level recovery operations in Microsoft Exchange Server 2003 or Microsoft Exchange Server 2007 environments using Data Protection for Exchange backups

GUI or Command-line interface

• TDP EXCC RESTOREMailbox mailbox_name(s)

| Tivoli software



Supports mainstream platforms

• Exchange Server 2003 and Exchange Server 2007

• Windows Server 2003, Windows Server 2008

• 32-bit x86 and 64-bit x64

Uses strictly Microsoft recommended techniques and interfaces

• Recovery Storage Groups

• Messaging API (MAPI)

Single user interface for:

• Storage group, database, mailbox or message restore

• Legacy or VSS restores

• Full, differential, incremental, and copy restores

Supports existing backup procedures – no changes required

• Does not require separate, costly “brick” backups

• Mailboxes can be restored from backups made with previous versions of TSM for Mail

| Tivoli software



| Tivoli software



| Tivoli software


N-Series and NetApp SnapDiff and SM2T

| Tivoli software


N-Series and NetApp SnapDiff

As NAS filers get bigger and bigger, there is a requirement to perform incremental backups of the NAS filesystems

NetApp uses a closed operating system so a TSM client cannot be created or installed

This feature takes advantage of NetApp’s Snapshot Difference API to enumerate the differences between two snapshots

TSM then performs a backup of only the changed files

Not a replacement for a normal incremental backup – some circumstances can result in missed files

Only available with AIX (nfs mount) and Windows (CIFS mount) TSM clients

| Tivoli software



dsmc incremental –snapdiff H:1

Create snapshot2 Get changes3

Populatedatabase

4

Get files5

Backup to TSM6

N-Series or NetApp

TSM Windows or AIX Client

TSM Server

| Tivoli software



|--DIFFSNAPSHOT = | CREATE --|>>-------------------------------------------->< |--DIFFSNAPSHOT = | CREATE --| | LATEST --|

New Client Option

| Tivoli software


N-Series and NetApp Snap Mirror to Tape (SM2T)

NDMP backups of very large NAS devices can be slow

SM2T is a block level movement of a filesystem

• Similar to BA Client BACKUP IMAGE command

Data written to tape is a block by block copy of the file system

• Disk geometry taken into account

• Restoration of traditional volume to unlike geometry can be very slow

SM2T operations are only supported for Netapp and IBM nSeries file servers

Implementation provided by extending NDMP functions

| Tivoli software



The following specific functions will be provided:

1.Backup a Netapp file system to media using the Netapp NDMP SnapMirror to Tape function.

TSM admin command: BACKUP NODE Both Direct to tape and TSM Native stgpool using filer-to-server

2.Retrieve a SnapMirror copy of a Netapp file system TSM admin command: RESTORE NODE

3.Display information about SnapMirror copies. TSM admin command: QUERY NASBACKUP

4.TSM back-end data movement for SnapMirror copies Same support as currently provided for NDMP backup images. BACKUP STGPOOL, MOVE DATA

| Tivoli software



Admin Command Line only

• No BA Client interface, neither Web GUI nor command line

• No support through Admin Center

No NDMP differential backup of SnapMirror images

No NDMP Directory level backup using SnapMirror to tape

• TSM will not permit an SM2T backup operation on a server virtual filespace mapping

No Generation of a Table of Contents for SM2T images

• No NDMP file level restore from SM2T images

| Tivoli software



Command

• BACKUP NODE nodename fsname type=snapmirror

− Must be MODE=FULL− Must be TOC=NO

• RESTORE NODE nodename fsname [destination_fsname] type=snapmirror

• QUERY NASBACKUP nodename fsname

| Tivoli software


VMware Consolidated Backup

| Tivoli software



VCB, introduced in VMware Virtual Infrastructure 3, allows the backup of multiple virtual machines to be off-loaded to a dedicated physical host (Backup Proxy).

Off-loading the backup from virtual machines and the ESX service console, allows backups to be completed LAN-free.

VCB significantly reduces the load on ESX Servers which allow it to run more virtual machines

Primary BackupTSM/VCB

| Tivoli software



Full VM for Disaster Recovery provides support to move entire VMDK files (disk to disk across a SAN) via a backup proxy, to TSM storage

• Provides a backup method similar to a TSM Linux x86 client backing up entire virtual machines directly from the ESX server service console

• Similar to a TSM image backup but comprise the entire virtual machine in a set of files that represent the physical disks of the virtual machine and other control information.

| Tivoli software



| Tivoli software


VMware Consolidated BackupSyntax

>>-dsmc BACKUP VM--------------------+-----><'-VMBACKUPTYPE=File | Fullvm-' '- VMLIST-' '-VMCHost-' '-VMCUSER-' '-VMCPW-' '-VMBACKDIR-‘'-VMFULLNODELETE=NO | YES-'

| Tivoli software


Windows Active Directory

| Tivoli software


Windows Active Directory

Before TSM V6

• AD restores require the DC be booted into Active Directory Restore mode

• AD can only be restored with all bootable components (the entire system state)

New with TSM V6

• No need to reboot the Domain Controller during restore process

• Restore only Active Directory objects needed by administrator

• Provide an easy to use graphical interface

• Tombstone re-animation support

• Active Directory objects can be restore from the TSM server

| Tivoli software


New Client Commands (cont.)

Restore ADOBJect Source_path_spec

Specifies the Active Directory object or container to restore

When a container is specified, all contents will also be restored

Specification

• Full distinguished name of an object or a container

• Just the name attribute ('cn' or 'ou')

• Wildcards can be used

• Wildcards are not supported in distinguished name specification

| Tivoli software


Display Organizational Unit

| Tivoli software


Administration Center

| Tivoli software


Administration Center

Reduce footprint / improve performance

• ISC AE 7.1 or higher

• Presentation Services (PS) 5.6

• Improve performance of the Admin API

When launching new portlets, stop browser from jumping

Improve the performance of Notebooks and Multi-Table Portlets

Add Hover Help to describe the default action of the hyperlinks in a table

Improved Messages - Hyperlinks to server help for a given server message

Support for new and enhanced server function

Add “Managing Server” name to the Enterprise Management table of servers

Policy Domain Updates

Client Node Navigation

Maintenance Plan Enhancements

Create New Server wizard

Export/Import ISC connections files

| Tivoli software


Initial Admin Center Panel

Link to “Common Reporting”

Link to new panel “Manage Servers”

Link to New Panel “Nodes and Backupsets”

| Tivoli software


New “All Nodes” panel

| Tivoli software


Active Data Pools

| Tivoli software


DRM Support for Active Data Pools

Active Data Pools can now be used for both faster restore and for disaster recovery – could replace an existing Offsite pool with an Active Data Pool

DRM enhanced to include handling of ADP volumes as offsite volumes

• Supports both tape and server-to-server volumes

A new DRM SET command added to provide the ability to specify ADP names to be managed by DRM

• Default is ADPs are NOT DRM managed

Disaster recovery (DR) media management capability updated so that ADP volumes can be cycled offsite/onsite per underlying server policies and processes

• Including off-site reclamation processing

Query commands updated so that DR ADP media can be tracked and managed appropriately

The PREPARE command updated to provide the ability to include ADP volumes in the scripts, macros and documentation included in the recovery plan file

| Tivoli software


DRM Support for Active Data PoolsExternals

SET DRMACTIVEDATASTGPOOL

• Default is APDs are NOT managed with DRM

MOVE DRMEDIA

• Now moves ADP volumes when ADP stgpool is managed

QUERY DRMEDIA

• Now lists managed ADP volumes

PREPARE Command processing

• Creates Prepare plan file additions to support ADP

• Updated “planexpl” script recognizes new stanzas

| Tivoli software


DRM Support for Active Data Pools Plan File Enhancements

New prepare plan stanzas:

• ACTIVEDATASTGPOOL.VOLUMES.AVAILABLE

• ACTIVEDATASTGPOOL.VOLUMES.DESTROYED

Updated Stanzas

• RECOVERY.SCRIPT.DISASTER.RECOVERY.MODE

• RECOVERY.VOLUMES.REQUIRED

| Tivoli software


GPFS

| Tivoli software


LANFree to Disk with GPFS

Nothing specific within TSM to support GPFS

• Or any shared file system

Use GPFS to support a sequential access, FILE type Storage Pool

Simply a testing and validation process to ensure GPFS provides required function for TSM LANFree:

• Integrity – appropriate locking, etc

• Recoverability from errors

Requirements

• GPFS V3.2 or above

• Testing configurations− LINUX (Intel and AMD) - SLES 10− AIX 5.3

| Tivoli software


Restore Performance

| Tivoli software


Improve Performance for No Query Restore (NQR)

Provide an NQR algorithm which incurs a minimal cost compared to classic restore

Maintain NQR's single mount per tape volume

• Ensure that objects on tape volumes are processed in “restore-order”

Treat FILE storage pools like DISK as much as possible

Maintain compatibility with storage agents from Version 5.5 for LANFREE restores

Maintain compatibility with clients from 5.5 and 6.1

| Tivoli software


Improved NQR - Implementation

Exploit DB2 capabilities

• New tables and views to better index objects for restore

Eliminate 2 phase approach

• All necessary information gathered in a single pass

Individual objects tracked, eliminating potential restoration of duplicates

Continue using parallel restore operation

No new externals

| Tivoli software


Expire Inventory

| Tivoli software


Inventory Expiration

Inventory Expiration has been reworked to take advantage of the new DB2 database, to be more efficient and to give administrators more control

>>-EXPIre Inventory-

.-Node--=--*------------------. >--+-----------------------------+------------------------------> '-Node--=---node1,node2,...---' >--+-------------------------------------+----------------------> '-DOmain--=----domainName-------------'

.-REsource--=--4--------. >--+-----------------------+------------------------------------> '-REsource--=--value--+-'

.-Type--=--ALl---------. >--+----------------------+-------------------------------------> '-Type--=--+-ALl-----+-' |-ARchive-| |-Backup--| '-Other---'

| Tivoli software


Other Improvements

| Tivoli software


Other Improvements

TSM for ACS: Incremental FlashCopy with SVC

Client GUI (Java replacing Windows Native GUI)

Client Restore Statistics

TSM for ACS (Oracle): Snapshot

TSM HSM for Windows Automated Threshold Migration

TSM HSM for Windows 64-bit Support for Windows 2008 Server

Documents

Click to add text IBM Software February 2009 | Advanced Technical Support © 2009 IBM Corporation Confidentiality/date line: 13pt Arial Regular, white Maximum