IT Matters

Data Storage 2014

University of Adelaide 2

Topics

• Current Storage Infrastructure• Backup and Restore• Handy Information and Techniques• Storage Future

University of Adelaide 3

Current Storage Infrastructure

• Mainly consists of NetApp Storage (www.netapp.com)– FAS 6240’s

• Home/Shared Folders (U:\ and S:\)• Staff Email (Exchange Mailboxes)• TRIM Records Management• MyMedia Streaming Data• Majority Server Storage• Uptime is vital!

– FAS 3250’s• Databases (Peoplesoft/Access Adelaide/MyUni)• Uptime is vital!

– FAS 2240’s• Lower Cost Storage

University of Adelaide 4

Current Storage Infrastructure

• FAS 6240

University of Adelaide 5

Current Storage Infrastructure

• FAS 3250

University of Adelaide 6

Current Storage Infrastructure

• FAS 2240

University of Adelaide 7

Current Storage Infrastructure

• How much data?– Total Capacity: 1000TB+ usable.– Data Transfer Rates: 880MB/s.– Usage Numbers:

• 20TB of Email (Staff) – 128,368,337 emails.• 49TB of Home Folders – 84,763,414 files and folders.• 26TB of Shared – 39,266,782 files and folders.

University of Adelaide 8

Current Storage Infrastructure

• Enterprise Support – 24/7 – Substantial Cost– Proactive Maintenance

• Guaranteed Compatibility– The storage system is guaranteed to integrate

effectively with other components of our IT infrastructure.

University of Adelaide 9

Current Storage Infrastructure

• Data Efficiencies (Cost Benefits!)– Deduplication

Duplication Enabled

U:\ Drive Storage

University of Adelaide 10

Current Storage Infrastructure

• Data Efficiencies (Cost Benefits!)– Thin Provisioning

Storage AdminUsers

Wow, so much storage! :D

Only going to buy enoughstorage to store actualdata! This should do:

Saved Data

Money Saved!

Saved Data

CRAP!

University of Adelaide 11

Current Storage Infrastructure

• Data Efficiencies (Cost Benefits!)– Thin Provisioning– Capacity on Demand (COD)

Storage AdminUsers

Wow, so much storage! :D

Only going to buy enoughstorage to store actualdata! This should do:

Saved DataSaved Data

CrisisAverted!

Lets save all the data!

Data increasing.. Stress rising! Better enableCOD.

University of Adelaide 12

Current Storage Infrastructure

• Data Protection– Has a whole topic coming next!

• High Reliability– Hardware Redundancy (two of everything)

• Plus many more..– Performance– Manageability (Provisioning/Monitoring/Reporting)

University of Adelaide 13

Backup and Restore

What is a Backup?

A second copy of data!

Main purpose:Recover data from large scale corruption, equipment failure or disaster scenarios...

University of Adelaide 14

Backup and Restore

Disasters won’t happen to us? Think again!

University of Adelaide 15

Backup and Restore

Any other uses?!

Alternate usage:Recover individual emails or files from particular points of time in the past. Alternate usage, but most common.

University of Adelaide 16

Backup and Restore - Tape

• Backup-To-Tape:– Long term retention.– Slow to restore data.

University of Adelaide 17

Backup and Restore - Tape

• Backup-To-Tape:– Long term retention.– Slow to restore data.

U:\ Drive

S:\ Drive

Email Tape Library

GeographicallyRemote

Data Centre 1 Data Centre 2

Aged 8 weeks

University of Adelaide 18

Backup and Restore – “Local” Disk• Backup-To-Disk:

– Reduced disk cost and smart software making this possible.– Fast to access!– We utilise backup-to-disk in a couple ways, Local and Remote backups.

“Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.

Storage without Snapshots

Time (Days)

1010101 1010101011110

101010111110011

10101001010100100

101010101001010100110011

10101

“Bugger”

University of Adelaide 19

Backup and Restore – “Local” Disk• Backup-To-Disk:

– Reduced disk cost and smart software making this possible.– Fast to access!– We utilise backup-to-disk in a couple ways, Local and Remote backups.

“Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.

Storage with Snapshots

Time (Days)

1010101 1010101011110

101010111110011

10101001010100100

101010101001010100110011

10101

Snapshot 1 Snapshot 2 Snapshot 3 Snapshot 4 Snapshot 5

Snapshots protect the data!

“Bugger”“Snapshots!”

University of Adelaide 20

Backup and Restore – “Remote” Disk#1 “Remote” Disk Backups: Quick Disaster Recovery!Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre.

U:\ Drive

Primary DataCentre

S:\ Drive

Active Connections

FAS 6240

U:\ Drive

Secondary DataCentre

S:\ Drive

FAS 6240

Changes made toData are copied to

Secondary Data Centre(Twice a day)

Active Connections

Data is a maximum of 24 hours out of date.

University of Adelaide 21

Backup and Restore – “Remote” Disk#2 “Remote” Disk Backups: Making File and Email Restores easy!Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre.

U:\ Drive

Primary DataCentre

Active Connections

FAS 6240

U:\ Drive

Secondary DataCentre

FAS 2240

Email

Email

Changes made to data, copied to Secondary Data Centre (Once a day)

Manual Connections

Efficient Backup Software

Email Admin

University of Adelaide 22

Backup and Restore

• Important:– Missing Data? Call Service Desk as soon as possible.– Never delete required data, assuming it’ll just get restored from

backup.– Local Computer Hard Disc, not backed up!

University of Adelaide 23

Handy Information and Techniques• Secure Data Transfers and Remote File Access

– AARnet CloudStor (https://cloudstor.aarnet.edu.au/sender/)• Secure data transfer to anyone with an email address.

– University Virtual Private Network (https://vpn.adelaide.edu.au/)• Secure data access to R:\, S:\ and U:\ drives for all UofA affiliated users.

University of Adelaide 24

Handy Information and Techniques• Big Datasets

– AARnet CloudStor+ (https://cloudstor.aarnet.edu.au/plus)

– eResearchSA (http://www.ersa.edu.au/data)

• Data Collaboration– AARnet CloudStor+– Shared Data Drive (S:\)– Low Cost Storage (R:\)

• More information on research data management:

http://libguides.adelaide.edu.au/researchdata

University of Adelaide 25

Handy Information and TechniquesWhat about Cloud Storage?

• Would the Cloud provider tell you if they were hacked and your data was stolen?

• Is your data being backed up?

• Is your data being shared with advertising companies?

• What happens if the Cloud provider goes bankrupt or is taken over?

• Are employees of the Cloud provider allowed to view and share your data?

University of Adelaide 26

Handy Information and TechniquesWhat about Cloud Storage?

Some privacy policies:

“When you upload or otherwise submit content to our Services, you give Google (and those we work with) a worldwide license to use, host, store, reproduce, modify, create derivative works … communicate, publish, publicly perform, publicly display and distribute such content.” – Google, April 2014

“In the event of a reorganization, merger, or sale we may transfer any and all personal information we collect to the relevant third party.” – Apple, March 2014

“If we are involved in a reorganization, merger, acquisition or sale of our assets, your information may be transferred as part of that deal. We will notify you (for example, via a message to the email address associated with your account) of any such deal and outline your choices in that event.” – DropBox, March 2014

More information about keeping data secure:http://www.adelaide.edu.au/technology/secureit/data/

University of Adelaide 27

Storage Future

• What’s on the horizon.

– Bigger S:\ drive allocations

– Smarter Archiving

– Cloud Integration for Data Storage• Ability to access your files any device, any time, any way.• Ease of collaboration.

– Research Data Reforms (via eResearch Strategy)• Associate Director Research IT Strategy (David Munro)

– Identify-Classify-Protect! (Data Classification Campaign - Secure IT)

Questions?IT Matters – 2014 Storage

IT Matters

THANKS FOR LISTENING!