Bringing Mainframe Data to the Cloud!Bringing Mainframe Data to the Cloud! CLOUDVTB Overview • CLOUDVTB is a new solution that allows you to convert your z/OS tape data sets to a

Breaking New Ground Protecting Your Physical/Virtual Tape Data Sets, Providing You with Cost Savings, Flexibility and Hardware Independence.

PRESENTED BY:

John Killeen [email protected] INNOVATION Data Processing

August 7, 2017 Session #21355

Bringing Mainframe Data to the Cloud!

CLOUDVTB Overview

•  CLOUDVTB is a new solution that allows you to convert your z/OS tape data sets to a disk file format and upload them to a Private or Public Cloud.

•  Cloud storage can dramatically reduce your z/OS tape storage costs. •  Files can be downloaded from the Public or Private Cloud to z/OS tape

on demand.

2

CLOUDVTB Overview

3

CLOUDVTB Overview

Mainframe tape has evolved significantly over the last 50 years, providing users with high reliability and almost instant access to data. But now, more than 95% of the data that needs to be retained to meet business or government requirements is rarely accessed. This data should be moved to a storage tier that is less costly but still readily accessible to minimize annual increases in your tape storage budget. CLOUDVTB will allow you to move your tape data to the Private or Public Cloud, allowing you to:

•  significantly reduce your mainframe storage costs •  improve your disaster recovery preparedness •  allow your tape data to be tape hardware-independent.

4

CLOUDVTB Overview

The currently supported environments: •  Tape devices: all physical or virtual z/OS tape devices •  Tape management: IBM’s DFSMSrmm, CA-1 •  Private Cloud: a Network File Server (NFS) can be almost any type, such as

UNIX, Linux, AIX, Solaris, or Windows •  Public Cloud provider: Amazon Web Services

(Other Cloud providers will be supported in the future.)

Transparency: No changes are required to existing tape jobs.

5

BENEFITS OF USING CLOUDVTB

6

Benefits of using CLOUDVTB

Cost Savings and Better Recoverability Many data centers have thousands of tapes on older media that need to be kept for long periods of time to meet regulatory requirements. They are faced with three choices: •  Copy to newer and higher-capacity tapes •  Copy to a Virtual Tape System (VTS), increasing the cost to retain data on both

the VTS and on a replicated system •  Keep the old hardware indefinitely to restore these files when required

7


Cost Savings and Better Recoverability Solution: CLOUDVTB will copy these files to a Private and/or Public Cloud, reducing your tape storage cost. •  Since CLOUDVTB creates the tape copy in generic format, you have the

flexibility to restore it to the currently installed tape drives, and can eliminate the older hardware and the cost associated with managing it.

8


Enhanced Recovery If the primary copy of a tape is corrupted because of hardware failure, human error, or malicious intent, you may be left without valid data. Solution: CLOUDVTB gives you the ability to have a completely separate copy of your data locally and/or offsite.

9


Data Availability and Increased Data Protection Data sets created by CLOUDVTB can be maintained in multiple locations with a Cloud provider to maximize recoverability and to meet users’ Service Level Agreements (SLAs). If the primary copy of a replicated VTS tape is corrupted, the replicated copy will also be unusable. Cloud copies created by CLOUDVTB can be retrieved to enhance your data protection and availability. With the increasing threat of cyber ransom, data centers are adding an additional level of security to their disaster recovery plans. To prevent malicious data destruction from internal or external causes, the Cloud data can be made available to a different group under different security protocols from the data that is directly accessible on the mainframe.

10


Data Protection – Best Practice Rule 3-2-1 The “3-2-1” rule says that you should have 3 copies of your data (the original + 2 copies), stored on 2 different storage media, with 1 copy located offsite. CLOUDVTB allows you to make a copy on a Private Cloud and in the Public Cloud. The Public Cloud copy can be your offsite disaster recovery copy. You can also replicate the Private Cloud copy.

User Experience – “We uploaded 29 tape files to the Private Cloud. They varied in size from 68 KB to 9.1 GB, totaling 158 GB. Replicating them to an identical Private Cloud server took 35 minutes when using a 1 GB Ethernet connection, and 9 minutes when using a 10 GB connection.”

11


Dramatically Lowering Long-Term Tape Storage Costs Mainframe VTS provides excellent high performance tape storage where data can be accessed in seconds. Maintaining the data on a VTS is less costly than on mainframe DASD, but in many cases after about 4 weeks the tape data is rarely or never accessed, but needs to be kept for corporate and legal reasons for many years.

12


Dramatically Lowering Long-Term Tape Storage Costs We surveyed a number of large mainframe users and we found the average cost to store tape data is about $3,000 per TB. This includes the VTS being replicated, the floor space, and power cost. They also projected their long-term retention will grow by about 10 percent a year. So for a data center that has 100 TB of long-term data, the initial cost would be $300,000 with it increasing about $30,000 a year. Compare that to the cost of moving the data to the Private Cloud, where the storage cost is less than $200 per TB. This would result in a 90 percent savings in your mainframe tape storage cost.

13


Dramatically Lowering Long-Term Tape Storage Costs

An Example Comparing Mainframe Tape Storage Cost For 100 TB On Different Storage Platforms

14

You can reduce your storage cost significantly with Amazon Glacier, but recovery time could be many hours or days.

MaintenanceVTS

PrivateCloud

AmazonStandardStorage

AmazonStandard-Infrequent

AccessStorage AmazonGlacier

Storage $300,000 $20,000 $23,000 $12,500 $4,000

PrivateCloud $20,000

CLOUDVTB SPECIAL FEATURES

15

In CLOUDVTB, you define an “Upload Rule” that can specify many combinations of criteria for including and excluding tape data sets:

…or any combination of these criteria. CLOUDVTB does not require you to specify a list of specific data sets or tape volumes to be uploaded. If you specify other criteria (such as creation date & program), CLOUDVTB will determine which data sets match those criteria.

Tapevolumeserialormaskorrange ExpiraJondate CreaJngjob

ormaskCreaJngprogram

ormask CreaJondateDay/weeks/years

(orrange)sincecreaJon

Datasetnameormask

Permanent,catalog-controlled,

and/orcycle-controlled

Datasetsizeorrange

Numberofdayssincelastreferenced

RangeofspecificexpiraJondates

Days/weeks/years(orrange)

unJlexpiraJon

CLOUDVTB Special Features - Filtering

16

CLOUDVTB Special Features - Retention

CLOUDVTB provides flexible criteria in setting retention periods for data sets in the Cloud. Retention can be: •  A number of days or years from the tape data set’s expiration date

(0 days è same Cloud retention as z/OS tape retention). •  A number of days or years from the tape data set’s creation date. •  A number of days or years from the tape data set’s upload date. •  Until a specific expiration date (separate from the tape data set’s

expiration date). •  Permanent. •  Based on a maximum number of versions of the same tape data set name.

17

CLOUDVTB Special Features – IBM zEDC Feature

zEDC is a hardware feature offered by IBM that allows efficient compression of data sets. Many of the historical tapes you have were created before zEDC was available. CLOUDVTB can take advantage of zEDC and reduce the time and number of bytes of a transfer by up to 70%. For example, in a copy of a z/OS tape file containing 22.4 GB using zEDC, the amount of data transferred to the Private Cloud was about 9.6 GB, a space savings of 57%. Use of zEDC has very little effect on CPU resources. IBM says the effect is less than 0.1 CPU sec/GB.

18

CLOUDVTB Special Features – Compare Utility and DR Procedure

CLOUDVTB includes a utility called CLDCOMPR which you can use to verify that the contents of a data set that has been downloaded from the Cloud match the contents of the original tape data set. CLOUDVTB includes instructions for moving the CLOUDVTB Data Base and product libraries to a DR site, where you can download Cloud data sets onto any type of tape device (physical tape or VTS).

19

CLOUDVTB Special Features – Move Tape Data to a New Data Center

A 4-step process can be used to move tape data to another data center: 1.  Install CLOUDVTB at both sites 2.  Copy the data to the Private Cloud 3.  Send or Replicate the Private Cloud

to the target site 4.  Files remain on the Private Cloud,

or are restored if needed

20

Applications Moving Off the Mainframe

As applications move off the mainframe, many companies are still required to keep records for 7 years or more to meet customer and government requirements. Sites now have the ability to move all of their tape data from a VTS and/or physical tape to the Private and/or Public Cloud using CLOUDVTB. Customers can have their Private Cloud server reside at a DR site that has a mainframe. If any of the files are needed, they can upload the CLOUDVTB libraries and Data Base, and then restore the files at the DR site. Since CLOUDVTB creates the files on the Private Cloud in a generic format, you will be able to recover these files to whatever mainframe tape technology is installed at the DR site at the time a recovery is required. CLOUDVTB offers you a solution to meet your legal requirements at a fraction of the cost compared to maintaining the data on a mainframe VTS.

21

MOVING TAPE DATA SETS TO THE CLOUD

22

FINAL TOTALS -- DDSNAME-------------7983 TDAPRSIZ--------3906.649G VALUE SUMMARY OF TDCRDATE--- TOTAL NUMBER OF VALUES-------1 TDCRDATE--2016.299 ( 7983) VALUE SUMMARY OF TDCRPGM --- TOTAL NUMBER OF VALUES------66 TDCRPGM--- ( 7) ADRDSSU ( 177) AMSE ( 20) ARCCTL ( 46) CKAPFRPT ( 11) CKAP01V ( 13) CMNBKRST ( 6) DB2PM ( 3) DFSRRC00 ( 1) DMT02035 ( 1) DMT02075 ( 1) DMT02100 ( 4) DMT02290 ( 2) DMT02300 ( 1) DMT02360 ( 1) DMT02410 ( 2) DMT03200 ( 36) DMT03270 ( 4) DMT03275 ( 2) DMT03280 ( 10) DMT03281 ( 6) DMT03282 ( 6) DMT03290 ( 20) DMT03300 ( 6) DMT03360 ( 4) DMT03600 ( 2) DMT03605 ( 2) DMT03610 ( 2) DMT03615 ( 2) DMT03620 ( 2) DMT03625 ( 2) DMT03630 ( 2) DMT03635 ( 2) DMT90650 ( 6) DSNUTILB ( 6317) DSNYASCP ( 138) DWWLC ( 8) FDRABR ( 351) FILEAID ( 1) GETHIST ( 1) GOVSMQSM ( 28) ICEGENER ( 41) ICETOOL ( 13) IDCAMS ( 9) IEBGENER ( 1) IFASMFDP ( 17) IFCEREP1 ( 1) IKJEFT1B ( 79) JHSARCRE ( 1) JHSARMIG ( 116)

FDRABR CUSTOM REPORTS - FDREPORT VER 5.4/83P DATE - DATA SET NAME …VOLSER VSQ DEQN LRECL RECFM BKSZ APPROXSZ CRPGM CRDATE EXPDAT RETENTVALU ------------- …------ --- --- ------ ----- ---- --------- ------- -------- -------- ---------- HSM.HMIGTAPE.DATASET… L44392 1 1 16384 F 16384 12779848K ARCCTL 2016.299 1999.365 CYCL/99999 AT.MKV.#030.DMT02100… L44393 1 1 1400 FB 32200 320648K SORT 2016.299 2016.300

Moving Tape Data Sets to the Cloud

First, you need to determine how much tape data is created daily. CLOUDVTB will create reports that will show the tapes created today, yesterday, etc.

23

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . #tapefiles 3.9TB

#programsthatcreatedtapedatasets

When you analyze the data below, you see: •  Of the 3.9 TB created, 2.3 TB will expire in 7 or less days (59% of the data).

In most cases, no need to move this data to the cloud. •  19% of the data (744 GB) has a retention of one or more years.

Moving Tape Data Sets to the Cloud

24

You can start by uploading those files that have a retention of more than 1 year, that were created at least 180 days ago, but also not referenced in the last 180 days. These are good candidates for expiring the z/OS copy to free up space on your mainframe VTS storage.

Sample NFS Configuration

25

At Innovation, we use 2 NAS devices with 120 TB of storage on each with an NFS server configured as RAID 5. Total cost was $14,000. Storage cost is $155 per TB, compared to thousands of dollars per TB for mainframe VTS storage. In a test, we uploaded 242 GB of data to NAS 1, then replicated the data to NAS 2. That took less than 12 minutes.

CLOUDVTBSetupAtInnova:onDataProcessing

Cisco6509EMasterSwitchComputerRoomz/13s

z/OSLinuxonzz/VM

1GFiber

1GOSA

1GCopperEthernet

1GCopperEthernetNASServer1

120TBTotalRAID5

90TBUsable

NASServer2120TBTotal

RAID590TBUsable

PortEth3

192.168.xxx.aaa/24

PortEth3

192.168.xxx.bbb/24

PortEth1

192.168.yyy.aaa/24

PortEth1

192.168.yyy.bbb/24

10GBFiber 10GBFiber

User Experience

Problem: I needed to recover data from one of our backups, but found that the onsite backup of that tape had expired. The second copy of these backup tapes are stored at a secure offsite tape vaulting service. However, we needed to restore the data after the normal working hours of the tape vaulting service, so we would either have to wait until the next day or pay a premium to get it. Solution: CLOUDVTB can keep duplicate copies of backup tapes with the same or extended retention dates that can be accessed 24x7. Therefore, you save time and money that is being spent at 3rd party DR sites.

26

USING THE CLOUDVTB ISPF PANELS

27

Getting Started: CLOUDVTB Configuration

28

SelectOp:on8toconfigureCLOUDVTB


29

VSAMKSDSfile.Mustspecifyaclasstype

orvolume.

Specifyclassortapeunittouseonrestores

RequiredifanABRcustomer


30

z/OSmountpointforNFSServer

Op:onalsubdirectoryforthisdatabase

Useanytexttodescribethedatabase

Defining an Upload Rule

•  Option 1 displays a series of ISPF panels that let you define the selection/exclusion criteria to be used by a new Upload Rule. You also specify how long data sets uploaded using this rule should be retained in the Public or Private cloud.

31


•  For this example, we will define an Upload Rule to select all tape data sets with permanent retention, that were created more than 1 year ago.

32


•  Enter a name and description for the rule.

•  Then, traverse options 1-4 to specify all your selection criteria.

•  When complete, click on or enter Next to specify information on what to do with the uploaded files.

33


•  Option 1 panel criteria are not needed for this example.

34


•  Option 2 panel – select files created more than 1 year ago.

35


•  Option 3 panel – select permanent-retention files.

36


•  Option 4 panel criteria are not needed for this example.

37


• By default, retention of data sets in the Cloud is the same as the retention of the corresponding z/OS tape data sets.

• When done, enter or click Save.

38

Running an Upload Rule

•  Main Menu Option 4 displays a list of Upload Rules.

39


•  Select or click on the Upload Rule you want to run.

40


•  The Cloud retention specified in the Upload Rule is displayed, and can be overridden for this upload job.

41


•  Review the SYSPRINT and COPYRPT output of your batch job to see the upload results.

42

Downloading Data Sets

Option 7 displays a series of panels with options to: •  Download Cloud

data sets •  Delete Cloud

data sets •  Change retention of

Cloud data sets

43


•  You can filter the list of uploaded data sets to be displayed, or show all of the data sets recorded in the data base. Then click/enter Next to proceed.

44


•  Use option “I” to get more information about a data set.

45


46


•  Use option “S” to select a data set for download. You can select multiple data sets in a single download job. Then click/enter Next to continue.

47


•  By default, the downloaded tape file(s) will have the same z/OS retention as the original (uploaded) file(s), but you can override that here.

•  Click/enter Sub to submit the download job.

48


•  Review the SYSPRINT and COPYRPT output of your batch job to see the download results, including the output VOLSER.

49


•  Going back to the data set information panel, the data set is now shown as having been downloaded.

50

CLOUDVTB Reports

Option 6 displays a menu with options to: •  View Simulation outputs •  Generate reports listing

data sets that have been uploaded to the Cloud

•  View Upload reports On the Reports Menu, select Option 2 to generate the Upload Report.

51

CLOUDVTB Reports

•  You can filter which data sets are listed, or display a list of all uploaded data sets. Enter/click Next to continue to the next panel where you submit the report job.

52

CLOUDVTB Reports

•  After the report job completes, select Option 3 to view a list of generated reports.

53

CLOUDVTB Reports

•  Select the desired report. The list is sorted newest to oldest.

54

CLOUDVTB Reports

55

Data Set Uploaded to Amazon

56

QUESTIONS?

57

Providing a Long Line of Solutions…

58

INNOVATION Data Processing, a leading international provider of enterprise data protection, business continuance and storage resource management solutions satisfying customer business information security concerns since 1972. Combining high performance design along with non-disruptive virtualization, easy-to-use & extremely reliable backup, recovery, data replication & privileged information protection, INNOVATION solutions seek to eliminate business downtime while addressing data security concerns. By actively partnering with leading storage vendors, to ensure technological currency, INNOVATION is the choice of thousands of enterprise customers around the world for their business resiliency needs. You can rely on our software solutions to be easy-to-use, efficient, reliable and are supported by a commitment to first class technical support. LEARN MORE: •  CLOUDVTB Web Page – www.fdr.com/CLOUDVTB •  CLOUDVTB Technical Presentation – www.fdr.com/CLOUDVTBtechsess •  CLOUDVTB User Manual – www.fdr.com/CLOUDVTBmanual

http://www.fdr.com/CLOUDVTB

http://www.fdr.com/CLOUDVTBtechsess

http://www.fdr.com/CLOUDVTBmanual

Trademarks and statements

CLOUDVTB, FDR, ABR, IAM, FDRSOS, SOSINSTANT, FDR/UPSTREAM and UPSTREAM/SOS are service marks, trademarks or registered trademarks of Innovation Data Processing Corporation. EMC, DLm, SYMMETRIX, VMAX, DMX and TimeFinder are trademarks or registered trademarks of the EMC Corporation. IBM, z/OS, zEDC, ProtecTIER, zDDB, FlashCopy, z Systems and FICON are trademarks or registered trademarks of International Business Machines Corporation. All other service marks, trademarks or registered trademarks are the property of their respective owners.

17038 - 17079 © Copyright 2017 INNOVATION Data Processing. All rights reserved.

mailto:[email protected]

mailto:[email protected]

http://www.fdr.com

Documents

Bringing Mainframe Data to the Cloud!Bringing Mainframe Data to the Cloud! CLOUDVTB Overview • CLOUDVTB is a new solution that allows you to convert your z/OS tape data sets to a