A Close-up Look at Potential Future Enhancements in Tivoli ...tsm- Close-up Look at... · 2 Potential…

  • Published on
    30-Aug-2018

  • View
    212

  • Download
    0

Transcript

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation

    A Close-up Look at Potential Future Enhancements in Tivoli Storage Manager

    Dave CannonTivoli Storage Manager ArchitectOxford University TSM SymposiumSeptember 2005

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation2 Potential Future Enhancements in Tivoli Storage Manager

    Disclaimer

    This presentation describes potential future enhancements to IBM Tivoli Storage Manager

    Information in this presentation does not constitute a commitment to deliver the described enhancements or to do so in a particular timeframe

    IBM reserves the right to change product plans, features, and delivery schedules according to business needs and requirements

    This presentation uses the following designations regarding availability of potential product enhancements Planned: GA is currently planned for 2005, but subject to change Candidate: Will be a candidate for possible delivery in 2006 - 2007

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation3 Potential Future Enhancements in Tivoli Storage Manager

    Agenda

    Management of data in server storage

    Optimizing restore of client data

    Backup set enhancements

    TSM database

    Snapshot exploitation

    IBM TotalStorage N series (Network Appliance) integration

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation4 Potential Future Enhancements in Tivoli Storage Manager

    Simultaneous Migration and Storage Pool Backup

    Can reduce client backup window as compared to simultaneous write to primary and copy storage pools during backup operation

    Combines windows for migration and storage pool backup

    Periodic storage pool backup required to ensure all data copied

    Copy pool 2

    Copy pool 1

    Client

    2. Storage pool backup

    2. Storage pool backup

    Server

    2. Migration1. Backup

    Data flow

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation5 Potential Future Enhancements in Tivoli Storage Manager

    LAN-free Simultaneous Write to Copy Pools

    LAN-free, simultaneous write to primary pool and copy pool(s)

    Reduces LAN traffic as compared with LAN-based simultaneous write

    Duplicates data while reducing time for storage pool backup

    Periodic storage pool backup required to ensure all data copied

    Copy pool 2

    Primary pool

    Client/Storage Agent

    Server

    Copy pool 1

    LAN

    SAN

    Control

    Data flow

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation6 Potential Future Enhancements in Tivoli Storage Manager

    Management of Redundant FilesCommon files (operating system, application) are not duplicated in the TSM storage hierarchy for each node

    Also known as single instance store

    Client can transparently restore unique and common files

    Benefits Reduced bandwidth and/or time required for backup Reduced space requirements in storage pools Especially attractive for disk-only TSM configurations

    Client 1 filesystem

    File XClient 2 filesystem

    Client 3 filesystem

    File X

    TSM Server

    File X

    File X

    Only one instance of File X is stored on server, but each

    node shows backup of this file

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation7 Potential Future Enhancements in Tivoli Storage Manager

    Management of Redundant Files: Model NodeEach node can optionally be assigned to a model node with same operating system and preferably common application/project files (e.g., one model node per project)If file has already been stored by model node, same file is not resent by other nodes but unique database entry is created for each instanceAlthough multiple nodes share a common file, each node Can have unique attributes (policy, insertion date, security) for the common file Can query file information for its own objects, whether stored uniquely or in common

    Efficient checking for previously stored common files because only the assigned model node is checkedData for model node can be stored on disk or collocated tape for faster restores (avoids need for mounting many tapes)

    Node Name

    MODEL_NODE

    SMITH

    JONES

    JOHNSON

    Cataloged Files for Node

    Solid boxes indicate files stored in storage hierarchy by this node

    Striped boxes indicate files which require database entries only (file is stored by model node)

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation8 Potential Future Enhancements in Tivoli Storage Manager

    MOVE NODEDATA for Off-site Volumes

    DB

    2. Copy files from on-site location to new

    copy pool volumes

    3. Update database to reference new location of files

    TSM server location1. Use database to identify files for

    designated nodes on off-site volumesOff-site volumes

    Offsite location

    4. Transporttapes off-site

    5. Transporttapes on-site

    Allows consolidation of data on off-site volumes for selected nodes

    Supports specification of following options for data to be moved On-site data only Off-site data only All data Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation9 Potential Future Enhancements in Tivoli Storage Manager

    Agenda

    Management of data in server storage

    Optimizing restore of client data

    Backup set enhancements

    TSM database

    Snapshot exploitation

    IBM TotalStorage N series (Network Appliance) integration

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation10 Potential Future Enhancements in Tivoli Storage Manager

    Collocation of Active Data

    Active-only storage pool allows collocation of active backup versions for fast restore Active backup versions still reside on client machine (have not been modified or deleted) Active-only pools will be sequential-access only (typically sequential-access disk)

    Possible benefits- Optimized access to active versions - Reduced size of disk pools if only active versions are stored- Reduced data movement in preparation for restore of active data

    Challenge is to collocate active data while also preserving performance benefits of file aggregation and correspondence to data in copy storage pools

    Active data in disk pool for fast restore

    Active and inactive data for point-in-time restore

    Storage Hierarchy

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation11 Potential Future Enhancements in Tivoli Storage Manager

    Collocation of Active Data: Example

    Client

    Active-only pool

    A0 B0 C0 D0

    A0 B0 C0 D0

    A0 B0 C0 D0

    1. Client backs up A0, B0, C0, D0 to active-only pool. Then these files are migrated to next pool.

    Server

    Active/inactive pool

    Migration

    B1A0 B0 C0 D0 E1

    Client

    Active-only pool

    Server

    Active/inactive pool

    Migration

    B1 E1

    B1A0 B0 C0 D0 E1

    B1A0 B0 C0 D0 E1

    2. Client backs up B1, E1, which deactivates B0. Then B1, E1 are migrated to next pool.

    B1A0 B0 C0 D0 E1

    Client

    Active-only pool

    Server

    Active/inactive pool B1A0 B0 C0 D0 E1

    B1A0 C0 D0 E1

    3. Reclamation removes inactive B0 from active-only pool.

    B1A0 B0 C0 D0 E1

    Client

    Active-only pool

    Server

    Active/inactive pool B1A0 B0 C0 D0 E1

    B1A0 C0 D0 E1

    4. Client restores active files A0, C0, D0, B1, and E1 from active-only pool.

    A0 C0 D0 B1 E1

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation12 Potential Future Enhancements in Tivoli Storage Manager

    Transfer from Active/Inactive to Active-Only Pool

    Copy DataCopies active versions from active/inactive primary pool to active-only primary poolTransfer is performed incrementallyCan be restricted by node and file spaceAllows population of active-only pool with previously stored data

    Restore to Active-Only PoolRestores active files From copy pool containing both active

    and inactive data To active-only primary pool

    Allows recovery of active-only primary pool from active/inactive copy pool

    Active data in disk pool for fast restore

    Active and inactive data for point-in-time restore

    Copy data

    Storage Hierarchy

    Active/inactive copy pool

    Restore

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation13 Potential Future Enhancements in Tivoli Storage Manager

    Reclamation of active-only copy pool recovers space occupied by inactive and deleted files

    Active-Only Copy Storage Pools

    Reduced storage requirement for copy poolSimplified tape management because fewer tapesImproved recovery performance for active data

    Incremental backup from active-only primary pool to active-only copy pool

    Active data in disk pool for fast restore

    Active and inactive data for point-in-time restore

    Storage Hierarchy

    Active-only copy pool

    Restore

    Backup

    Reclamation

    Inactive filesExpired files

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation14 Potential Future Enhancements in Tivoli Storage Manager

    Restore of Individual Files from File System Image

    Server

    1. Client creates image and collects file metadata

    2. Image and metadata sent to server

    3. Server stores image and table of contents (TOC) in

    storage hierarchyMetadata

    Image

    Image

    DBTOC

    ClientBackup

    Server1. Client specifies images

    to examine

    3. Client queries file information and user

    selects files to restore

    2. Server loads TOC(s) into TSM database

    Image

    DBTOC

    Client

    4. Selected files restored

    Restore

    TOC

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation15 Potential Future Enhancements in Tivoli Storage Manager

    Agenda

    Management of data in server storage

    Optimizing restore of client data

    Backup set enhancements

    TSM database

    Snapshot exploitation

    IBM TotalStorage N series (Network Appliance) integration

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation16 Potential Future Enhancements in Tivoli Storage Manager

    Generation of Backup Sets to Point in Time

    Allows generation of backup set to specified point in time Files must not already be expired or deleted from the server Default is date/time of backup set generation

    Benefits Increases operational flexibility because backup sets need not be generated

    before next client backup Allows retroactive generation of synthetic full backup if unanticipated needs

    arise

    TSM Server

    GENERATE BACKUPSET nodename PITDATE=mm/dd/yyyy PITTIME=hh:mm:ss

    Storage Hierarchy

    Backup Set

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation17 Potential Future Enhancements in Tivoli Storage Manager

    File Selection During Backup Set RestoreServer1. Client specifies

    backup sets

    3. Client queries file information and user

    selects files to restore

    Client Server

    2. Server locates backup set TOCs and loads into database

    DB

    TOC TOC

    Backup Set

    4. Server restores data to client

    4. Server restores data to client

    Server storage pool has table of contents (TOC) with backup set contents

    On demand, server loads TOC into TSM database

    Client queries TOC and displays directory tree structure and files

    User expands directories and selects files for restore

    Simplifies task of restoring selected directories/files from a backup setCandidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation18 Potential Future Enhancements in Tivoli Storage Manager

    Generation of Backup Sets for List of Nodes

    Allows generation of multiple backup sets with a single command A distinct backup set is generated for each node Backup sets generated with a single command are written sequentially to the

    same media

    Improves media utilization

    Physical security may be important for backup set restore at the client (without the TSM server)

    GENERATE BACKUPSET bob,fred,sue

    Distinct backup sets fornodes BOB, FRED, and SUE

    TSM ServerStorage

    Hierarchy

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation19 Potential Future Enhancements in Tivoli Storage Manager

    Differential Backup SetsSupports full and differential backups sets Full includes all files matching the backup set specification Differential includes all matching files that were backed up from the client since

    the last full backup set was generated

    Restore requires base and differential backup sets

    Benefits Reduces media requirement Faster generation of backup sets

    Full Backup Set

    Time

    Differential 2Differential 1

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation20 Potential Future Enhancements in Tivoli Storage Manager

    Backup Set Support for Application Data

    Expand backup set support to include Data Protection products

    Allows Data Protection client to restore from backup set via the TSM server

    Candidate applications include Microsoft Exchange Microsoft SQL Server Lotus Domino

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation21 Potential Future Enhancements in Tivoli Storage Manager

    Possible Uses for Enhanced Backup Sets

    Offsite vaulting of self-describing data

    Traditional tape rotation (e.g., grandfather/father/son) for SMB or departmental environments

    Long-term retention of point-in-time data Individual files in backup set do not require entries in TSM database because

    entire backup set is tracked as a single entity Separate policies for retention of backup set and individual files stored by TSM May be useful in environments with stringent regulatory requirements for data

    retention

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation22 Potential Future Enhancements in Tivoli Storage Manager

    Agenda

    Management of data in server storage

    Optimizing restore of client data

    Backup set enhancements

    TSM database

    Snapshot exploitation

    IBM TotalStorage N series (Network Appliance) integration

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation23 Potential Future Enhancements in Tivoli Storage Manager

    DB2 Database Engine for TSM

    Conversion of existing TSM database

    ConversionProprietary Database

    DB2 Database

    TSM Server

    Before conversion

    After conversion

    TSM server unavailable during conversion

    Installation of new TSM server

    DB2 Database

    TSM Server

    DB2 included in install package

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation24 Potential Future Enhancements in Tivoli Storage Manager

    Why a Proprietary TSM Database Today?

    Portability to diverse server platforms- Proprietary TSM database portable to any server platform

    - In early days of ADSM, DB2 had only limited platform support

    TSM database optimized for storage-management operations- Database schema

    - Customized, multilevel locking

    - ARIES technology reduces overhead for logging and recovery

    Bit vectors stored in database for tracking block allocation in random-access storage

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation25 Potential Future Enhancements in Tivoli Storage Manager

    Potential Benefits of DB2 as Database Engine

    Scalability Database Recovery log

    Database maintenance Online database reorganization Referential-integrity checking to eliminate or minimize need for database audit

    Monitoring - Complete SQL function including UNION, INTERSECT, and correlated sub-

    queries not available with proprietary database- Ability to optimize SQL query performance by defining secondary indices

    Potential ability to support alternate configurations- Distributed databases- Enhanced LAN-free and library sharing

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation26 Potential Future Enhancements in Tivoli Storage Manager

    Design Goals for DB2 DatabaseNo extra expense for database product license

    TSM administration should not become more complex Preserve existing administrative interfaces to the extent possible Provide virtualized tables equ...