Upload
pamela-miles
View
224
Download
2
Tags:
Embed Size (px)
Citation preview
Storage Overview And Architecture
Arvind Shrivastava
Enterprise Network Storage Architecture
Unbounded Unbounded performance and performance and
capacitycapacity
Unprecedented Unprecedented flexibilityflexibility
Simplified managementSimplified management
The lowest The lowest total cost of ownershiptotal cost of ownership
++
++
==
Core Core TechnologyTechnology
Network Network Attached Attached StorageStorage
Direct Direct AttachedAttached
ServicesServices
Storage Storage Area Area
NetworkNetwork
SoftwareSoftware
Direct Attached Storage(DAS)
Low Cost Solution
Simple to Configure
De-Centralized Storage
No Storage Consolidation
No High Availability
Low Performance
Network Attached Storage(NAS)
Heterogeneous Environment
Centralized Storage
Low Performance
Limited scalability
Network Congestion during backups & Restore
Ethernet Limitations
Storage Area Network
Heterogeneous environment
Centralized Storage Management
High Degree of Fault Tolerance
Best and superior performance
Storage Consolidation
Fast and efficient backups and restores
Dynamic Scalability
Expensive solution for small setups
SAN V/s NAS
Fibre Channel IP
Reliable Unreliable
Extremely low CPU Overhead Extremely High
Large Blocks of Data Large Nos. of small Blocks
LAN-free back-up Lan Back-up
Applications managing own Data specs
Applications driven by universal access to files
Mid-Range Storage Features
• Excellent ease of use
• Virtualization
• Dynamic virtual disk expansion
• Business Copy functions
• Continuous Access functions
• High availability features
• High, middle*, and low models and configurations
• Multiple operating system support
• Single pathing support for all operating systems
• Coexistence with heterogeneous configurations
Buisness copy Overview
Continuous Access-Overview
Flex Copy Concept
Features• Allows use of low end storage
for low-cost point-in-time copies of production data
• Point-in-time copy to and restore from Low end storage
• CLI or GUI ConfigurationBenefits
• Reduced TCO in mixed product/non-production
• Offloads production data from secondary operations
• Allows for distributed remote data and hi performance two-stage backup/archive configurations
Cost-effective, external point-in-time copies
Low end storage
P
C1
Enterprise storage
Product Positioning
Additional Features EVA4000/6000/8000
Additional features unique to the second generation EVA
• New controllers with improved performance, higher capacity
support, larger cache, more FC ports
• Up to 200TB of presented capacity (versus 35TB for the first
generation EVA)
• Support for 1024 LUNs (first generation EVA was 512)
• Support for active-active failover using multipath software
for all operating systems
• Increased support for boot from SAN (AIX, Solaris)
• Direct Connect support for Windows
• Additional CA functionality
• Support for native HBAs and HBA drivers
• Additional snapshot and snapclone functionality
Useful Links
Information sources :-– HP Enterprise Virtual Array• http://h18006.www1.hp.com/storage/arraysystems.html– HP Command View EVA• http://h18006.www1.hp.com/products/storage/software/cmdvieweva/index.htm– Whitepapers• http://h18006.www1.hp.com/storage/arraywhitepapers.html
Storage backup Overview And Architecture
Arvind Shrivastava
BACKUP SOFTWARE
What is it?
• Software that provides automated data protection for businesses with 24x7 availability needs.
What does it do?
• Data Protection: copies data onto a storage device, so that in case of a need (loss, corruption, disaster), data can be easily recovered and made accessible.
• Media management: easily manages the library catalogues to keep track of all media and copies of data for fast recovery.
Most important features:
• Automated backups that scale from small workgroups to multi-site, heterogeneous SAN & NAS environments with thousands of servers.
• Fully-integrated Zero-Downtime backup with Instant-Recovery.
Architecture Components
manager of managers
distributed GUI
operations console
cell manager
cell manager
cellclients
cellclients
Client-Server Modules
media agent(MA)
disk agent(DA)
cell console(CC)cell manager
(CM)
Inter-process Communication (IPC)
session manager
cell manager
tcp/ip
tcp/ip
tcp/ip
disk agent
media agent
disk agent
media agent
tcp/ip
tcp/ip
scheduler
cell console
network backup/restore
local backup/restore
shared memory
session manager
How to choose between tape drives and tape libraries servers
Tape drives Autoloaders Tape Libraries• Servers are configured individually and backup device is connected directly to the server
• Disk capacity to be backed up is less than 200 GB
• Cost conscious customer
• Single/Multiple servers
• Unattended backup
• LAN based Backup
• Disk capacity to be backed up is 200 GB to 1 TB
• Consolidation is required
• Multiple servers are configured together
• Unattended backup
• LAN or SAN based backup
• Disk capacity to be backed up is more than 1 TB
• Consolidation and centralized management is required
• Storage external to servers in JBOD or disk arrays
25GB
100GB
50GB
6 10025 50 200Speed GB/hour (compressed)
12
Cap
acit
y (
com
pre
ssed
)
Relative Performance
Ultrium 215
Ultrium 230
DAT 40
Ultrium 460
SDLT 320
DAT 24
400GB
200GB
DLT VS80
Workstations
Office Servers
Departmental/local network
Corporate/
networked backup
DAT 72
Complied by Ranganath Sadasiva
Tape Device
Native Compressed Native Compressed Native Compressed
DAT 12/ 24 1.2 2.4 12 24 4.32 8.64
DAT 20/ 40 2.4 4.8 20 40 8.64 17.28
DAT 72 3 6 32 72 10.8 21.6
DLTvs80 3 6 40 80 10.8 21.6
DLTvs160 8 16 80 160 28.8 57.6
DLT 80 (obs) 6 12 40 80 21.6 43.2
SDLT 110/ 220(obs) 11 22 110 220 39.6 79.2
Ultrium 215 7.5 15 100 200 27 54
Ultrium 230 15 30 100 200 54 108
SDLT 160/ 320 16 32 160 320 57.6 115.2
SDLT 600 36 72 300 600 129.6 259.2
Ultrium 448 24 48 400 800 86.4 172.8
Ultrium 460 30 60 200 400 108 216
Ultrium 960 80 160 400 800 288 576
Date Transfer Speed MB/ Sec Data Capacity in GB
Back up capacity GB / hour-
max
Tape drives – Speeds and feeds - Comparison
Features
Features Required in any Backup software• Advanced backup to disk
• Oracle/SAP Integrations
• Zero Downtime Backup
• Split mirror
• Snapshot
• Snapclone
• Filesystem / application backup on inactive MC/SG node
Overview – Advanced backup to disk
Why backup to disk?Benefits
• Fast random access allowing:– Fast single file restore– Space efficient backup
• Instant recovery– e.g. switching for recovery instead of restoring
data from tape• Faster restore of backup chains• No tape streaming problems• Ideal for RAID 5• Easy to detect disk failures• More protected, e.g. it’s not easy to steal a disk
Advantages of ZDB
The advantages of using Data Protector Oracle ZDB integration are the following:• ZDB reduces the performance degradation of the application system.• The tablespaces are in backup mode (online backup) or the database is shut down (offline backup) only during the short period required to create a replica (split the mirror disks or create snapshots).• The time to create a replica is significantly reduced. Following its creation, tape backup can be created on the copied data, at leisure , using a separate backup system.•The Data Protector Oracle ZDB integration offers online and offline backup of your Oracle Server System (application system).
BACKUP CONCEPT-SPLIT MIRROR BACKUP
ZDB Setup
P
P – primary LDEV
M – mirror copy (MU0-2)
• True online backup for integrated applications
• Split mirrors may used for instant recovery or resynced
• No performance impact on applications during backup
• Mirror synchronization before or after backup
• Automatic mirror rotation
• API based integration
Backup host
Application host
MM
XP
M0 21
Backup Software and Storage Integration Concept
Client 1 Client 2
Questions?
New HP Storage Products
Arvind Shrivastava
RISS
Introducing…
HP StorageWorks Reference Information Storage System
What is RISS is and who wants it?
The HP StorageWorks Reference Information Storage System (RISS)
A cornerstone of HP ILM (Information Lifecycle Management )
A fully integrated and uniquely scalable system for access to reference information that…
…reduces Total cost of Ownership, mitigates risk and turns data into information
HP StorageWorks Reference Information Storage System
• Manage Costs
– Remove static data from application servers/storage
– Shorten backup windows– Eradicate duplicate data objects
• Mitigate Risks – Automated retention of messages &
attachments– Data is digitally signed, time
stamped & protected– Assist customers to meet their
compliance requirements
• Exploit Data Assets
– Power indexing!– Grid computing for fast
search/retrieval
AB C
AB CA
B C
AB
C
As the number of information objects grows…• cost of management increases
• accessibility to the information decreases
Scale is the Problem
TCO $
# of content objects managed
AccessTime
TCO
Performance
HP StorageWorks RISSarchitectural benefits
‘back end'
‘front end'
Modular, redundant, self healing gridcomputing and storage (smart cells)
Application-independent indexing, search and retrieval of information
Objects in the RISS cannot be modified or deleted until end of retention period
Content is digitally signed and time stampedfor regulatory compliance
User Application
Application Integration
RISS
Open protocol API
Clients
smart cell
Application integrationwith e-mail and MS Office
Client applications get added archive functionality(architecture transparent to them)
smart cell
hp StorageWorksFile System Extender (FSE)
A General Overview
Arvind Shrivastava
What is FSE?
• HP StorageWorks File System Extender (FSE) is new-generation data management software that is part of the HP Information Lifecycle Management portfolio.
• Enables automatic and transparent data movement between production (primary) storage media and secondary storage media, using simple user-defined rules.
Changing digital storage demands
Time
Sto
red
data
Reference
Operational
Majority is reference
information
FSE attacks the costs of reference data
FSE Basics
• Based on Client/Server architecture.
• Infinite File System
• FSE software supports LTO drive technologies for – LTO Ultrium 1 and LTO Ultrium 2 media.
• WORM Support.
• Automatic error detection
• FSE automatically detects drive and media hardware errors.
• NFS & CIFS support
Managing storage spaces
FSE storage spaces
MSA/EVA & FSE
h p S torageWorksM SL 6030
production storage SCSI
disk
MSA1500/EVA
secondary storage
SATA/FATA disk
secondary storage
MSL tape library
1. Inactive files moved from SCSI to SATA disk
2. Optional second copy to tape
3. Automatic & transparent recall of migrated files
4. File recall from second copy if first unavailable
Contents
What is the EFS WAN Accelerator?
HP EFS WAN AcceleratorHow Does it Work?
Removes All Redundant TCP Traffic on WANs• Files, Emails, Backup, Web Traffic, FTP, Applications
• Stores All TCP Traffic On Disk
• Never Send The Same Data Twice
• Reduces WAN Traffic By Up To 98%
Optimizes Application Protocol Behavior • Removes Most Round Trips for Chatty Apps Like Windows
• Highly Effective for the Most Common Applications
Optimizes the Behavior of TCP• Reduces “Chattiness” in TCP
• Implements Latest TCP Optimizations
Up to 100 Times Faster Throughput
HP EFS WAN AcceleratorThree-part Solution
The Problem HP’s Solution What it Does
1. Not Enough Bandwidth
Scalable Data Referencing (SDR)
Remove repeated bytes from the WAN for all TCP traffic
2. TCP Chattiness and Inefficiency
Virtual Window Expansion (VWE)
Optimizes performance of TCP
High speed TCP optimizations
Enables much higher throughput on “LFNs”
3. Application Chattiness and Inefficiency
Transaction Prediction (CIFS, MAPI)
Optimizes the performance of specific applications
HP EFS WAN Accelerator Management Features Overview
EFS WAN Accelerator Manager• Provides central management of up to 500 appliances
• Provides fleet management– Monitors health, throughput & acceleration done– Performs SW updates to groups of nodes
• Separate product packaged as an appliance
HP Proliant Management• HP Systems Insight Manager
• Full Integrated Lights-out (iLO) support
HP Storage Essentials Suite
Storage Software DivisionHewlett-Packard
Unified Management of Server and Storage Infrastructure
Storage Island
Efficiency
Consolidate infrastructure mgmt tools
Centralize and automate routine tasks
Improve deployment costs
Lower training costs
Deploy resources faster and more reliably
Enable IT agility
Single point of integration between business process and IT infrastructure
Specify SLA’s across entire infrastructure
Consistent security model for entire infrastructure
Quick access to business operation metrics (e.g., audit and usage reports)
Increase availability
Quicker time to problem resolution
Manage systems remotely from any location
Server Island
Introducing HP Storage Essentials
Chargeback
Oracle Views
Customize Reports
ExchangeViews
File System Views
Provisioning
• Capacity • Performance• Topology Maps
SybaseViews
Centralized Reporting
• Policy Mgr• GUI & CLUI
3rd Party/HP Developed
Main console for open, heterogeneous SAN management
Enterprise Edition
Provisioning Mgr
Chargeback Mgr
Oracle Viewer
Main console for open, heterogeneous SAN management
Heterogeneous host to array path provisioning wizard
Asset based chargeback management. Assign tiers
Oracle database availability and performance views
Exchange database availability and performance viewsExchange
ViewerSybase database availability and performance views
File System Viewer
Global Reporter
Report Designer
Sybase Viewer
File system scanning – reclaim wasted space
Rollup reporting of multiple Storage Essentials Server instances
Develop custom reports for storage infrastructure
HP Storage Essentials – Enterprise Edition
Capabilities:
Application-to-LUN auto-discovery
Topology visualization
Dependency, path, & connection management
Capacity management
Real-time performance monitoring
Advisors & Automators
Enabling Features:
Role-based security
Event management
Historical & predictive trends
Reporting engine
Policy engine
OpenRAD and CLIs
Main console for open, heterogeneous SAN management
Deployment on Windows 2003
Topology
Capacity
HP Storage Essentials – Oracle Viewer
Capabilities:
Discovers database instances, hosts, databases & tablespaces
SAN dependency & path management
“Closed loop” capacity management
Real-time performance monitoring
Role-based security
Policies, events, reports
Extends Storage Essentials capabilities "inside" Oracle databases to ensure availability and performance of database applications
Where is the Pain ?
Under-utilized assets
• Storage infrastructure
• IT staff
Cost of heterogeneous management is expensive and inefficient
Application down time issues angers the customer
• Troubleshooting is time consuming
• Help desks are flooded
Server consolidation/data center moves drives the budget
On-going justification of the budget
• What happened to all the storage?
• Why do we need more now? When again?
Key Qualification QuestionsIdentifying the Pain Points
How do you manage increasing storage capacity with flat or shrinking IT headcount?
Do you have a SAN? Can you tell what the impact of a lost SAN element will be on your applications and users?
How do you keep your staff trained on a wide range of device-specific element managers and tactical SRM tools that, right now, only add complexity?
Do you want to replace the whiteboards and spreadsheets you’re currently using for SAN management with something that is more scalable and reliable?
How do you avoid vendor lock-in and heavy, proprietary agents that come with other solutions?
Can you provision storage in real time to support new applications and projects?
How do you comply with SAN change control and internal audits?
Questions ?