Legato NetWorker technical update ‚P078‘

Presentation Title

1Copyright © 2004 HP corporate presentation. All rights reserved.

© 2004 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice

Legato NetWorkertechnical update‚P078‘

Reinhold DannerCustomer Support Consultant, HP

IT-Symposium 2005 www.decus.de 2

Agenda• NetWorker overview• NetWorker release history• NetWorker V7.1 new features• NetWorker V7.2 new features− improved firewall support− configuration wizards−Windows user GUI face lifting−Direct File Access with Advanced File Type Devices−Data Service Agent / NDMP−Storage Node Support for NDMP clients

Presentation Title



Networkeroverview


Legato NetWorker overview

Server

Storage Node

Client

data zone

• comprehensive multi-platform data protection and application support

•server•storage node•client

•three-tier any-to-anyarchitecture

Presentation Title



NetWorker features• central management through GUI or scriptable

commands• browse and retention policies (based on

savesets)• policy based scheduling• flexible grouping of clients• full, incremental, level 1-9, skip & consolidated

levels• directives – backup all, but....• pre- and post- processing


NetWorker features (cont)• user initiated and directed recovers• automatic and manual initiated cloning• multi-tier staging• archiving• ad-hoc user backups• NDMP & OpenTape Dynamic Drive Sharing• Multiplexing, cloning and staging of NDMP streams

Presentation Title



NetWorker features (cont)• comprehensive application support− SAP R/3 on Oracle− Oracle− Microsoft Exchange Server− Microsoft SQL Server− Sybase− DB2− Informix− Lotus Notes

− and many more• please see Software Compatibility Guide


NetWorker architecture

nsrindexd nsrmmdbd

clientindex

Resource files /nsr/res/nsrdb

Log files /nsr/logs

nsrexecd

nsrexecd

nsrmmd

nsrd

/nsr/index /nsr/mm

nsrexecd

nsrexecd

nsrmmd

Storage Node

Client

Networker Server

Media DB

Windows: DRIVE:\<install path>\Legato\

Presentation Title



NetWorker data flow

• parallelism− multiple data streams from

client

multiplexing– multiple data streams

written to one or multiple tape drives

NetWorker ServerOPEN TAPE FORMAT


saveset cloning

Tape

Optical

File

Tape

Optical

File

• Duplicate saveset for offsite vaulting• Backup operation reads filesystem once• Recover can use original or clone• Automatic scheduled or user initiated on demand

backup pool clone pool

Presentation Title



saveset staging

client file system

file1. Backup

file

2.Cloning optical

tape3. ‘Grooming‘

space isrecovered

• initial backup to high speed disk devices• when stage area reach preset threshold, NW

automatically stage data to removable media• Interim recovery operations occurs at disk speed• staging can be initiated manually by means of

nsrstage


staging: volume consolidation

• free almost unused volumes• evacuate savesets to a different type of media• command line: nsrstage−openVMS : nsrrepack

Presentation Title



storage node

storage node

Scalability and AvailabilityNetWorker server •backup device location flexibility

•availability – reduce network traffic

•failover – dynamic allocation of devices


library / drive sharing & cluster support

Presentation Title



static library sharing

• Library is shared among one NetWorker Serverand /or multiple Storage Nodes

• a physical tape drive is used by one SN only

Tape Tape drivedrive controlcontrol, , DataData flowflow

RoboticsRoboticsControlControl

NetWorkerServerHP-UX

StorageNode

Windows 2003

NetWorker Data Zone

B A


dynamic device sharing (DDS)

• device allocation is controlled by NW server• physical tape drives get a designated hardware id• each logical device is linked to the physical drive by

means of the hardware id

robotic control

NW Server ‘A’Linux

Storage Node ‘B’Windows 2003

NWserver ‚A‘ devices/dev/nst0/dev/nst1

LAN

hwid: drive-I

hwid: drive-IIStorage Node ‚B‘ devicesrd=B:\\.\Tape0rd=B:\\.\Tape1

Presentation Title



Networker Cluster support

• almost all popular cluster environments are supported− HP-UX MC/ServiceGuard− Tru64 UNIX TruCluster− Microsoft Cluster Server− and more

NSR

LAN

BA

virtual Networker Server


Networkerreleases

Presentation Title



release history

NW 7.0major releaseship date: 03.03

NetWorker 7.1.1maintenanceship date: 01.04

NetWorker 7.1.2maintenanceship date: 06.04

NetWorker 7.2major releaseship date: 12.04

NW 7.1.3maintenanceship date: 01.05

2003 2004 2005

NW 7.1major releaseship date: 09.03

OpenVMS NOC V6.0.1d maintenanceship date: 06.04

OpenVMS NOC V6.0.1d ECO5

maintenanceship date: 03.05

OpenVMS NOC V6.0.1c maintenanceship date: 12.03 Networker 6.1.*

End-Of-Support 30.01.05

6.x : extended support available till Dec 31th 2005


NetWorker for OpenVMS client (NOC)• latest release : V6.0.1d ECO5− ODS-5 support since V6.0.1d

• Storage Node support− library and drive sharing

• openVMS supports a maximum blocksize of 64kB -1 Byte• DDS: choose 32 kB in heterogeneous configurations

− disk to disk backup

• Oracle DBMS and RDB support

Presentation Title



Networker V7.1new features


V7.1 new features• certified to work with 256 virtual devices using

dynamic device sharing (DDS)− test configuration: 16x Storage Nodes sharing a library

with 16 physical tape drives

• jbedit allows to add/remove devices or storage nodes that share a drive without deleting the existing configuration

Presentation Title



V7.1 new features (cont)• Firewall enhancement−NW server processes only start TCP listeners in the

service port range−NW software requires the connection ports (source

TCP ports) to be used− if a firewall rule is defined as a TCP rule, the firewall

automatically creates a bi-directional connectivity between connection ports (TCP source ports) and service ports (TCP listener ports)

• NSR_KEEPALIVE_WAIT− nsrexecd will send ‚keep alive messages‘ to nsrexec to

keep messages active once a connection to the NW server has been established through a firewall


V7.1 new features and changes• mminfo reports and queries− ssretent field replaces ssexp(iration)

• NW Storage Node release 7.1 is not compatible with a NW server release earlier than 6.0−NW server V7.1 support NW storage node 6.x

• Hierarchical Storage Management− is no longer supported in V7.1− replaced by DiskXtender software

Presentation Title



Networker V7.2new features


V7.2 New features• Expanding the NetWorker Data Zone−Device limit doubled to 512 from 256

• Easier and quicker problem resolving• Error message improvements

• Better Linux file system protection− backup/recover Access Control Lists (ACL) and

Extended Attributes (EA) of Linux file systems• ACL and EA information saved as metadata separate from

other file system data

Presentation Title



improved firewall support


V7.2 improved firewall support• NetWorker nodes communicate via structured messages

using XDR (called XDR messages protocol )− works similar to RPC except it is peer to peer instead of

client/server− supports routing messages from one connection to another− supports multiple different protocol types including rsh, RPC, XDR

messages, and raw stdio from a child process. This allows multiple different connections using different protocols in the same select loop.

− The XDR messages version of the session channel allows two peers to send synchronous messages to each other without creating a possible deadlock situation.

− service ports remain the same based on this formula

number_of_service_ports = 2C + 3S + 2TT = total number of defined devices

C = 2x nsrexcecdS = nsrd, *indexd + *mmdbd

Presentation Title



V7.2 improved firewall support (cont)

• untranslated strings are exchanged between the NW server (nsrexec) and save

XDR message protocol

nsrexec

Networker Server

nsrexecd

Networker Client

save

stdio


Configuration Wizards

Presentation Title



• Simplified file system and device configuration

• Easier set up for backup jobs and clients

• UNIX / Linux− start wizard with #

nwwiz

V7.2 Configuration wizards


Client configuration wizard

Presentation Title



Device configuration wizard


Windows GUI facelifting

Presentation Title



pre V7.2 Windows user GUI• files were

sorted by name only


V7.2 Windows user GUI • New tree control for

improved Windows look and feel

• Comprehensive right mouse click context menu selection

• Improved icons with tool tips

• Sort columns according to user preference

• Enhanced browse capability for recovers and improved backup status screensv

Presentation Title



V7.2 Windows user GUI (cont)• smaller icons− show tool tips


V7.2 Windows user GUI (cont)• backup options are shown in new column

Attributes− encryption− compress− password

Presentation Title



V7.2 Windows user GUI (cont)• browse a

new destination directory


V7.2 Windows user GUI (cont)• you may now

connect to a new server

Presentation Title



V7.2 Windows user GUI (cont)• you may

copy the recover output and paste it to an editor for further processing


Direct File Access with Advanced File Type Devices

Presentation Title



Direct File Access with Advanced File Type Devices−Direct File Access (DFA) is a new mechanism, which

right now is only implemented for recover processes from save sets which have been stored on a UNIX Advanced File Type Device (AFTD).

− Instead of using NetWorker traditional mechanisms, the save set can be read directly using the file system’s capabilities.

−Benefits:• In general the transfer rate will be faster because overhead

caused by the existing NetWorker data transport mechanism will be avoided.

• However, this improvement can be marginal• DFA will reduce the recover time significantly when multiple are

recovered simultaneously


data movement via the existing method

/adv_file/_AF_readonly

Sub-directory

/adv_file

Filesystem

nsrd

nsrmmdWrite

operations

Read operations

NetWorker Client

1. The client requests the recovery

2. nsrmmd reads the save set file and passes the data to the recover

program.

nsrmmd

AFTD

Presentation Title



data movement via Direct File Access

/adv_file/_AF_readonly

Sub-directory

/adv_file

Filesystem

nsrd

nsrmmdWrite

operations

Read operations

NetWorker Client

1. The client requests the recovery

2. nsrmmd requests the save set file and passes

the symlink of the file name to the recover

program.

3. The recover program opens the file through the share and reads it directly

from the file system.

AFTD

nsrmmd


Data Service Agent

Presentation Title



Data Service Agent (DSA)• The Data Service Agent (DSA) is a new method

for the Networker server to communicate with a client which has no NetWorker software installed. This especially applies to NDMP Networkerclients.

• In general, it provides an “any-to-any“ capability:−Any NetWorker client may deliver data to any

NetWorker device −A DSA save set is treated like any other save set - the

configuration will be easier−The NDMP version does not matter−There is no NDMP device driver software needed


Local NDMP Backups

TCP/IP

NetWorker ClientsNetWorker Server

.....

SCSI/FC

NAS Filer

Backup data

Index data

NDMP Device

Presentation Title



Third Party Copy NDMP Backups

TCP/IP


.....

NAS Filer

Backup data

Index data

SCSI/FC

NAS Filer

NDMP Device


NDMP Backups without DSA (SnapImage Drivers)

TCP/IP


.....

SCSI/FC

NAS Filer

Index data

Storage Node

NDMP Device

Backup data

Presentation Title



NDMP Backups with DSA

TCP/IP


.....

SCSI/FC

NAS Filer

Index data

Storage Node

Backup data

Non-NDMPDevice


Storage Node Support for NDMP clients

Presentation Title



Storage Node support for NDMP clients• NDMP savesets may now be directed to any

Storage Node within the Data Zone• Normal and NDMP save sets may be mixed on a

single piece of media• Almost all saveset related commands apply• To activate DSA, you only need to add the option-M for the nsrndmp_save backup command.

• DSA savesets are marked with additional flags in the MDB


No multiplexing with NDMP devices

TCP/IP


.....

NAS Filer

Backup data

Index data

NAS Filer

Storage Node

NDMP Device

Stream 1Stream 2Stream 3


Stream 1 Stream 2 Stream 4Stream 3 Stream 5 Stream 6Tape layout

Presentation Title



Multiplexing with none NDMP devices

TCP/IP


.....

NAS Filer

Backup data

Index data

NAS Filer

Storage Node

Non-NDMP Device



Tape layout


Identifying NDMP/DSA save sets# mminfo -avvolume client size ssid fl lvl namev.1 server 62 KB 4042190034 cr full bootstrapv.1 server 2 KB 4058967249 cr 9 index:netappv.1 netapp 98 MB 4075744447 cbNs full /vol/vol0/cr_unixv.1 server 58 KB 4092521505 cr full bootstrapv.1 server 117 KB 4109298720 cr full index:netappv.1 netapp 197 MB 4126075891 cbNs full /vol/vol0/cr_unix#

In any NetWorker Admin GUI or within NMC you will not see anything.

Presentation Title




Presentation Title



NDMP index processing improvements


NDMP index processing improvements• The improvement for the NDMP index processing

is just a new method how to ‘translate’ and sort the NAS filer’s index data.

• The new NetWorker 7.2 algorithm moves the NDMP file index information processing from a−CPU centric method using lots of RAM to a −Disk centric method using a temporary database

Presentation Title



NDMP index processing improvements• NetWorker 7.2 incrementally inserts NDMP file index

information into a new, temporary WISS based B-Treeindex database. The helper nsrndmp_2fh tries to finish sorting the entries along with the backup.nsrdmpix simply reads the temporary WISS database and commits the file index information for each NDMP client.

2:05 h36 Hours30 Million

1:20 h12 Hours20 Million40 minutes2 Hours10 Million

NW 7.2NW 7.1.2client file index entries


Presentation Title



Documents

Legato NetWorker technical update ‚P078‘