A Close-up Look at Potential Future Enhancements in Tivoli ...tsm- Close-up Look at... · 2 Potential…

Embed Size (px)

Text of A Close-up Look at Potential Future Enhancements in Tivoli ...tsm- Close-up Look at... · 2...

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation

    A Close-up Look at Potential Future Enhancements in Tivoli Storage Manager

    Dave CannonTivoli Storage Manager ArchitectOxford University TSM SymposiumSeptember 2005

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation2 Potential Future Enhancements in Tivoli Storage Manager

    Disclaimer

    This presentation describes potential future enhancements to IBM Tivoli Storage Manager

    Information in this presentation does not constitute a commitment to deliver the described enhancements or to do so in a particular timeframe

    IBM reserves the right to change product plans, features, and delivery schedules according to business needs and requirements

    This presentation uses the following designations regarding availability of potential product enhancements Planned: GA is currently planned for 2005, but subject to change Candidate: Will be a candidate for possible delivery in 2006 - 2007

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation3 Potential Future Enhancements in Tivoli Storage Manager

    Agenda

    Management of data in server storage

    Optimizing restore of client data

    Backup set enhancements

    TSM database

    Snapshot exploitation

    IBM TotalStorage N series (Network Appliance) integration

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation4 Potential Future Enhancements in Tivoli Storage Manager

    Simultaneous Migration and Storage Pool Backup

    Can reduce client backup window as compared to simultaneous write to primary and copy storage pools during backup operation

    Combines windows for migration and storage pool backup

    Periodic storage pool backup required to ensure all data copied

    Copy pool 2

    Copy pool 1

    Client

    2. Storage pool backup

    2. Storage pool backup

    Server

    2. Migration1. Backup

    Data flow

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation5 Potential Future Enhancements in Tivoli Storage Manager

    LAN-free Simultaneous Write to Copy Pools

    LAN-free, simultaneous write to primary pool and copy pool(s)

    Reduces LAN traffic as compared with LAN-based simultaneous write

    Duplicates data while reducing time for storage pool backup

    Periodic storage pool backup required to ensure all data copied

    Copy pool 2

    Primary pool

    Client/Storage Agent

    Server

    Copy pool 1

    LAN

    SAN

    Control

    Data flow

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation6 Potential Future Enhancements in Tivoli Storage Manager

    Management of Redundant FilesCommon files (operating system, application) are not duplicated in the TSM storage hierarchy for each node

    Also known as single instance store

    Client can transparently restore unique and common files

    Benefits Reduced bandwidth and/or time required for backup Reduced space requirements in storage pools Especially attractive for disk-only TSM configurations

    Client 1 filesystem

    File XClient 2 filesystem

    Client 3 filesystem

    File X

    TSM Server

    File X

    File X

    Only one instance of File X is stored on server, but each

    node shows backup of this file

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation7 Potential Future Enhancements in Tivoli Storage Manager

    Management of Redundant Files: Model NodeEach node can optionally be assigned to a model node with same operating system and preferably common application/project files (e.g., one model node per project)If file has already been stored by model node, same file is not resent by other nodes but unique database entry is created for each instanceAlthough multiple nodes share a common file, each node Can have unique attributes (policy, insertion date, security) for the common file Can query file information for its own objects, whether stored uniquely or in common

    Efficient checking for previously stored common files because only the assigned model node is checkedData for model node can be stored on disk or collocated tape for faster restores (avoids need for mounting many tapes)

    Node Name

    MODEL_NODE

    SMITH

    JONES

    JOHNSON

    Cataloged Files for Node

    Solid boxes indicate files stored in storage hierarchy by this node

    Striped boxes indicate files which require database entries only (file is stored by model node)

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation8 Potential Future Enhancements in Tivoli Storage Manager

    MOVE NODEDATA for Off-site Volumes

    DB

    2. Copy files from on-site location to new

    copy pool volumes

    3. Update database to reference new location of files

    TSM server location1. Use database to identify files for

    designated nodes on off-site volumesOff-site volumes

    Offsite location

    4. Transporttapes off-site

    5. Transporttapes on-site

    Allows consolidation of data on off-site volumes for selected nodes

    Supports specification of following options for data to be moved On-site data only Off-site data only All data Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation9 Potential Future Enhancements in Tivoli Storage Manager

    Agenda

    Management of data in server storage

    Optimizing restore of client data

    Backup set enhancements

    TSM database

    Snapshot exploitation

    IBM TotalStorage N series (Network Appliance) integration

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation10 Potential Future Enhancements in Tivoli Storage Manager

    Collocation of Active Data

    Active-only storage pool allows collocation of active backup versions for fast restore Active backup versions still reside on client machine (have not been modified or deleted) Active-only pools will be sequential-access only (typically sequential-access disk)

    Possible benefits- Optimized access to active versions - Reduced size of disk pools if only active versions are stored- Reduced data movement in preparation for restore of active data

    Challenge is to collocate active data while also preserving performance benefits of file aggregation and correspondence to data in copy storage pools

    Active data in disk pool for fast restore

    Active and inactive data for point-in-time restore

    Storage Hierarchy

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation11 Potential Future Enhancements in Tivoli Storage Manager

    Collocation of Active Data: Example

    Client

    Active-only pool

    A0 B0 C0 D0

    A0 B0 C0 D0

    A0 B0 C0 D0

    1. Client backs up A0, B0, C0, D0 to active-only pool. Then these files are migrated to next pool.

    Server

    Active/inactive pool

    Migration

    B1A0 B0 C0 D0 E1

    Client

    Active-only pool

    Server

    Active/inactive pool

    Migration

    B1 E1

    B1A0 B0 C0 D0 E1

    B1A0 B0 C0 D0 E1

    2. Client backs up B1, E1, which deactivates B0. Then B1, E1 are migrated to next pool.

    B1A0 B0 C0 D0 E1

    Client

    Active-only pool

    Server

    Active/inactive pool B1A0 B0 C0 D0 E1

    B1A0 C0 D0 E1

    3. Reclamation removes inactive B0 from active-only pool.

    B1A0 B0 C0 D0 E1

    Client

    Active-only pool

    Server

    Active/inactive pool B1A0 B0 C0 D0 E1

    B1A0 C0 D0 E1

    4. Client restores active files A0, C0, D0, B1, and E1 from active-only pool.

    A0 C0 D0 B1 E1

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation12 Potential Future Enhancements in Tivoli Storage Manager

    Transfer from Active/Inactive to Active-Only Pool

    Copy DataCopies active versions from active/inactive primary pool to active-only primary poolTransfer is performed incrementallyCan be restricted by node and file spaceAllows population of active-only pool with previously stored data

    Restore to Active-Only PoolRestores active files From copy pool containing both active

    and inactive data To active-only primary pool

    Allows recovery of active-only primary pool from active/inactive copy pool

    Active data in disk pool for fast restore

    Active and inactive data for point-in-time restore

    Copy data

    Storage Hierarchy

    Active/inactive copy pool

    Restore

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation13 Potential Future Enhancements in Tivoli Storage Manager

    Reclamation of active-only copy pool recovers space occupied by inactive and deleted files

    Active-Only Copy Storage Pools

    Reduced storage requirement for copy poolSimplified tape management because fewer tapesImproved recovery performance for active data

    Incremental backup from active-only primary pool to active-only copy pool

    Active data in disk pool for fast restore

    Active and inactive data for point-in-time restore

    Storage Hierarchy

    Active-only copy pool

    Restore

    Backup

    Reclamation

    Inactive filesExpired files

    Candidate

  • Tivoli Storage, IBM Software Group

    2005 IBM Corporation14 Potential Future Enhancements in Tivoli Storage Manager

    Restore of Individual Files from File System Image

    Server

    1. Client creates image and collects file metadata

    2. Image and metadata sent to server

    3. Server stores image and table of contents (TOC) in

    storage hierarchyMetadata

    Image

    Image

    DBTOC

    ClientBackup

    Server1. Client specifies images

    to examine

    3. Client queries file informat