Upload
jacknaren
View
225
Download
0
Embed Size (px)
Citation preview
7/24/2019 VSP Tech 01_065966
1/58
2010 Hitachi Data Systems. All rights reserved.
Hitachi VirtualStorage PlatformTechnical Overview
September 2010
Your Name Here.Your Title Here.
7/24/2019 VSP Tech 01_065966
2/58
2
AGENDA
Data center transformation
Whats new, whats different
3D scaling architecture
Hitachi Virtual Storage Platform physical description
Feature drilldown
Summary
7/24/2019 VSP Tech 01_065966
3/58
3
Data Center Transformation
Transition to Virtual
Environment
Reduce capital andoperational expenditures
Increase flexibility to be moreresponsive to the business
Improve service levels
Silos of independent physical devices
Closed, inflexible monolithic environment
SustainableCostly, legacy systems
Cloud-ready
Manage physical devices independently Automated
Virtualized
From Managing Infrastructure Technology
Physical,Legacy Environment
To Providing Infrastructure Services
7/24/2019 VSP Tech 01_065966
4/58
4
Industry Leading Results
Only 3D scaling
3D
48% Less
Power
Automated
Dynamic
Tiering
Twice the
Connectivity
IndustrysHighest
Performance
15x Larger
Volume Size
VMware VAAI
Integration
Most External
Virtualized
Capacity
40% Higher
Density
NewSeptember2010
7/24/2019 VSP Tech 01_065966
5/58
5
3D Scaling Architecture vs. Others
Separate application data and control
data
+
Volume components and specialized
offload ASICs
+
Write mirrored global memory;
Variable bandwidth+
Switching interconnects with
messaging latency (nanoseconds)
+
High density packaging; Selectable
increments of specialized controller,cache, host and disk I/O blades
+
Full array virtualization features;
Compatible with external storage
Full volume and sub-volume tiering
Optimized
Enterprise wide consolidationMission critical volatile workload
Common application data and control path
+
Off the shelf components and processors
+
Mirrored global distributed memory; Fixed
bandwidth+
Switching interconnects with messaging
latency (microseconds)
+
Midrange packaging; Dual controller
increments with fixed cache, host and diskI/O ports
+
Partial array virtualization features
compatibility; Full volume tiering
Commodity
Application with linear growth ofcapacity and performance
7/24/2019 VSP Tech 01_065966
6/58
6
Evolution of an Architecture
Lightning 99002000 - 2003
Continuous enhancement in bandwidth, connectivity and scalability
Efficient global cache management
New 3D scaling architecture
Lightning 9900V2002 - 2005
TagmaStore
Universal Storage Platform2004 - 2007
Hitachi Univ
ersal Storage
Platform V/VM 2007 - 2011
7/24/2019 VSP Tech 01_065966
7/587
2 to 4 Virtual Storage Director blades 8 to 16 cores 2 to12 FED blades with 16 to 96 ports 2 to 8 cache adapters with 32 to 512! cache " to 4 !ED blades with " to 32 S#S li$%s
8 Virtual Storage Director blades 32 cores 24 FED blades with 192 ports 16 cache adapters with 1&"24! cache 16 !ED blades with 64 S#S li$%s
VSP Architectural View Configuration
7/24/2019 VSP Tech 01_065966
8/588
3D Scaling Architecture
5thgeneration networkcrossbar switch
New control memoryarchitecture
2.4x OLTP performance
Greater connectivity andchoice
79% increase inbandwidth
Scale up, scale out, scaledeep growth path
2x single image globalcache
Backward compatibleBasic Operating System V(BOS V) operating system
Virtua
lStor
ageDirec
tor Fro
ntEndDirector
BackEndDirector Ca
cheAd
ater
7/24/2019 VSP Tech 01_065966
9/589
Control Memory Architecture LatencyHierarchy
28 ! 'o$trol
(e(or)
*S+ V
VS+
'o$trol
(e(or)'o$trol
(e(or)'o$trol
(e(or)4 ! 'o$trol(e(or)
'e$trali,edDistributed
Latency reduction driven by new architecture
8-
7/24/2019 VSP Tech 01_065966
10/5810
ac r ua orage a ormSingle Image Global Cache with Dynamic CacheAssignment
E!!icient cache management e"ecuted by each #irtual storage director
$lobal cache is a#ailable to any #irtual storage director
%o storage and !orward messaging o#erhead
7/24/2019 VSP Tech 01_065966
11/5811
3D Scaling Scale !"
Increase performance,capacity and connectivitytightly coupled through aglobal cache to meet
increasing server demands.
3D
Solution Capabilities
Host servers can access all the resources that are
dynamically added to the base configuration.
All the resources can act as one system for
maximum performance and capacity.
Managed as one common pool of resources for
more efficient utilization of resources
Dynamically scale for performance, capacity,
connectivity without disruption
Business Value
Industrys highest OLTP performance for open and
mainframe environments.
Grow from a small data center footprint 19 rack
Front to rear airflow for most efficient floor planning
Highest density storage using 2.5 drives
&ost transarent migration !rom'to multi#endor
storage at () ercent less e!!ort and cost
7/24/2019 VSP Tech 01_065966
12/5812
Solution Capabilities
Build out the storage system by combining
multiple units into a single logical system
Dynamically scales out to support the needs
of different servers by prioritizing the
common storage resources
Ensure safe multitenancy and quality of
service through partitioning of cache and port
address space.
Business Value
Tailor for increasing workloads without
compromise Consolidate resources for virtual server
environments
Highest data center density and lowest power
consumption for the capacity stored
Increase aggregate
performance, capacity,throughput, and connectivity
by dynamic allocation of
storage resources to satisfy
multiple distributed host
server requirements.
3D
3D Scaling Scale #ut
7/24/2019 VSP Tech 01_065966
13/5813
Solution Capabilities
External storage joins the storage pool with all
the functionality of the storage system
Offloads less demanding data to lower cost
external storage
Simplifies management of external storage with
common management, data protection, and
search
Allows use of existing or legacy assets over
200 storage systems and up to 255PB
Business Value
Increase value and useful life of existing assets Reduce OPEX costs through a common
management framework
Reduce CAPEX using lower cost tiers of
external storage
Storage virtualization can
provide a third dimension ofscaling for consolidating
externally attached storage
systems with virtual servers.
3D
3D Scaling Scale Dee"
7/24/2019 VSP Tech 01_065966
14/58
14
Hitachi Virtual Storage Platform Rack Structure
The maximum number of racks is 6:
2 control chassis and 16 drive chassis
* All channel configuration,* *#)+
Rack-00
Rack-01
Rack-02
Rack-10
Rack-11
Rack-12
Controller 0
Controller 1
3,610mm
2,006mm
1,100mm
1 control
chassis
2 control
chassis
HDD (2.5) 0 - 1,024 0 - 2,048
HDD (3.5) 0 - 640 0 - 1,280
Ports 16 - 96* 16 - 192*
Cache Up to 512GB** Up to 1,024GB**
7/24/2019 VSP Tech 01_065966
15/58
15
42U 19 inch rack
Reduces width 20% from UniversalStorage Platform V
14U control chassis cabled from the rear
Fan thermal control has 3 levels to reducenoise
14U
13U
13U
42U Rack (19inch)
Control Chassis2,006mm
610mm
1,100mm
Hitachi Virtual Storage Platform Rack Structure
Rear
14U
Front
7/24/2019 VSP Tech 01_065966
16/58
16
Increased overall airflow while requiring less powerful fans
Front to back flow results in more even and consistent airflow
Configuration provides more effective use of hot/cold rows
Airflow Efficiencies: Enabling Hot/Cold Rows
HotAisle
HotAisleCold
Aisle
Raised Floor
Return Air Plenum
7/24/2019 VSP Tech 01_065966
17/58
17
Most Flexible Building Block
Scale u" "roce$$ing "ower and cache bandwidth
Highly granular scalability
Virtual StorageDirectors " ,
VirtualStor
age
Director
DataCach
eAdater
Data Cache
Adater " (
Front view
7/24/2019 VSP Tech 01_065966
18/58
18
Main processors and operational
control data memory
Stores and manages internal
operational metadata and state
Array groups, LDEVs, external LDEVs,
runtime tables, mapping data for
various software products
Overall state of the system stored,
referenced and executed
Distributed to the appropriate I/O
offload processors
Virtual Storage Director
7/24/2019 VSP Tech 01_065966
19/58
19
Single Image Global Cache With Dynamic Cache Assignment
Data 'ache S)ste( .lobal 'ache/
Caches user data blocks from drives via theBED during a read
Caches data from the FED as part of a datawrite operation
All write data is mirrored in cache
Only one copy of cached data when performingread operations
Up to 128GB of data cache and a total of512GB in a single control chassis
2 chassis can contain 1TB of cache memory
Non-volatile data protection
Back up cached user data
Also used to protect meta data
Allows for three copies: one operationaland two backup copies (mirrors)
Backed up to an onboard flash drive
7/24/2019 VSP Tech 01_065966
20/58
20
Most Flexible Building Block
Interconnected directors deliver tailoredscalability
Independently grow
$rid Switch ,
Back End
Director +
Front End
Director ,
Front End Director ,
Back End Director +
BackEndDir
ector
FrontEnd
Director
GridSwitch
Scale !" Connectivity% Ca"acity% &andwidth
Back view
7/24/2019 VSP Tech 01_065966
21/58
21
Back End Director and Front End Director Pairs
Operational control data is distributed to L2 memory Data accelerator processors
Transfer data to and from cache
Execute host command requests
Dual core, special purpose I/O processors built into a unique data accelerator ASIC
Designed to accelerate I/O and operational performance
Offload latency sensitive processing tasks directly onto the BEDs and FEDs
7/24/2019 VSP Tech 01_065966
22/58
22
Virtual Storage Director Advantage$
Scaling Throughput
VSD cores for host I/O Mixed core
Total : 400%Host I/O : 350%
100% 100% 100%
50%
50%
VSD
Front end director Back end director
100%
20%
75%
5%
85%
15%
80%
20%
Total : 400%Host I/O : 350%
Heavywork
load
VSP
Total : 140%Host I/O : 120%
VSD cores for host I/O Core for async processing
40% 40% 40%20%
VSDUSP V
Total : 140%Host I/O : 120%
Front end director Back end director
40% 30%
5%5%
30%
5%
20%
5%
Host I/O processing
Copy processing
Lowworkload
No change in operating rate of MP used for host I/O and for PP Throughput is not changed by separation of cores
Perform both host I/Oprocessing and copyprocessing (Asyncprocessing) in each core
Perform copyprocessing (Asyncprocessing) in adedicated core
S! " niversal Storage !lat#orm $S! " $irt%al Storage !lat#orm
7/24/2019 VSP Tech 01_065966
23/58
23
Virtual Storage Director Advantage$
VSP
VSD cores for host I/O Core for async processing
40% 40% 40%20%
VSD
Average response:SmallResponse is stablebecause host I/Oprocessing and copyprocessing are notmixed.
USP V
Target MP Initiator MP
40% 30%
5%5%
30%
5%
20%
5%
Averageresponse: SmallNote that whenlarge copyprocessingtakes placeduring host I/Oprocessing, I/Owith largeresponse ismixed.
Scaling Throughput
Host I/O processingCopy processing
Lowworkload
Average response:
MediumI/O response ofmixed coresbecomes large, butno impact of mixedcores because allMPshave heavy load
60%
VSD cores for host I/O Mixed core
55% 65%
20%
VSD
20%
Heavy
workload
When the average operatingrate exceeds a threshold(ex:50%), inflow of host I/Oprocessing starts in core usedfor async processing.
50%
7/24/2019 VSP Tech 01_065966
24/58
24
Virtual Storage Director Advantage$
!ecause 0irtual storage director .VSD/ is i$depe$de$t o FED a$d !ED port& $o i(pact o$ oS duri$g (icrocode e-cha$ge
FED FED BED BED
VSD air
..
rocessing
&/S0 1/
rocessing
2icrocode
e"change
&/S0 1/
rocessing
Data #cceleratorData #ccelerator
&
(pact o$ (icrocode e-cha$ge
FED FED BED BED
VSD air
..rocessing
&/S0 1/
rocessing
&/S0 1/
rocessing
&/S0 1/rocessing
Data #cceleratorData #ccelerator
.er!orm micro-code e"change er 3 core During micro-code e"change o! core
dedicated to .. rocessing4 other core
takes o#er the rocessing
Because 2. is indeendent o! .ort4 no
imact on other ort during micro-code
e"change
FED FED BED BED
VSD air
..rocessing
2icrocodee"change
&/S0 1/
rocessing
&/S0 1/rocessing
Data #cceleratorData #ccelerator
'
FED FED BED BED
VSD air
2icrocodee"change
&/S0 1/
rocessing
&/S0 1/
rocessing
Data #cceleratorData #ccelerator
..rocessing(
FED FED BED BED
VSD air
..
rocessing
&/S0 1/
rocessing
&/S0 1/
rocessing
Data #cceleratorData #ccelerator
2icrocode
e"change )
.er!orm micro-code e"change er 2.
Since 2. is indeendent o! .ort4 2..5 continues
rocessing 1/ during micro-code e"change6
++processi$g
icrocodee-cha$ge
icrocodee-cha$ge
++processi$g
++
processi$g
icrocode
e-cha$ge
++
processi$gicrocode
e-cha$ge
During micro-code e"change o! core dedicated to
.. rocessing4 other core becomes a core
dedicated to .. rocessing and takes o#er the
rocessing
7/24/2019 VSP Tech 01_065966
25/58
25
Hard Disk Drive Support
2.5 drive cost crosses over 3.5
SAS interface becomes dominant
Fibre channel will decline on performance drives
Flash drives for performance alternative
Worldwide performance Optimized HDD for Enterprise ApplicationsAverage price per Gigabyte Form Factor, 2009 - 2014
Worldwide HDD Shipment for Enterprise ApplicationsBy Interface, 2009 - 2014
Comparison:UniversalStoragePlatformVFibreChannel
7/24/2019 VSP Tech 01_065966
26/58
26
Comparison: Universal Storage Platform V Fibre ChannelLoops vs. Virtual Storage Platform SAS
Controller 1
4 SASLinks
Controller 0
4 SASLinks
4 SASLinks
4 SASLinks
Expander
Expander
Enclosures
15Disks SAS
HDDSlot 0
SASHDDSlot 1
SASHDDSlot 2
SASHDDSlot 3
SASHDDSlot 4
SASHDDSlot 13
SASHDDSlot 14
Universal Storage Platform V with 64 FibreChannel (FC) loops 4 FC loops percontroller
4 FC loops per back end director
Half duplex arbitrated loops
32 FC loops pair at 4 Gb/s
Virtual Storage Platform with 64 SAS links 8 SAS paths per back end director blade
32 full duplex links per control chassis
64 SAS links at 6 Gb/s
Chassis are connected point-to-point
SAS and SATA can be intermixed
7/24/2019 VSP Tech 01_065966
27/58
27
Most Flexible Building Block
768 in dri#es " ,) " +
or
+68 in dri#es " 9, " +
Increases capacity per square foot
Decreases power and OPEX
13 U
Late$t Di$' and (la$h Drive )echnology
7/24/2019 VSP Tech 01_065966
28/58
28
Princi"al Characteri$tic$
(1) At v02 (2) All channel configuration (3) Orderable in clustered pair
VSP minimumVSP
maximumUSP V
VSP vs.
USP V
Number of Drives 0 1280/ 2048 1152 +77%
Virtual Capacity - 255PB 247PB +3%
FED Ports(8G)
FC, FICON, FCoE(1)16 (FC) 192 (FC)(2)
192 (FICON)(2)
96 (FCoE)
FC4 224 / FC8
112(2)
FICON4 112
+70% (FC8)
BED Links(6G) 0 64 64 (FC-AL 4G) +50%
Cache Size 32 GB 1TB(1) 512GB 2x
Cache Protection Flash (+ battery) Flash (+ battery) Batteries
Virtual Storage Director(3) 2 8 Not Available
Chassis Internal
Bandwidth (Data and
Control GB/s)
- 128/64 68/39 +79%
Power Consumption
(Fully Configured)
- 30 KW (one phase) 33.2 KW (three
phase)
-48% (W/TB
600GB HDD)
7/24/2019 VSP Tech 01_065966
29/58
29
Performance com"ari$on &ac'end Mi*+,-.-/0'& 12#PS
+reli(i$ar) results
i- .6"4" 7eadrite ratio/
3*
45.*
7/24/2019 VSP Tech 01_065966
30/58
30
Performance com"ari$on &ac'end 0'&12#PS
+reli(i$ar) results
7eads rites
657*458*
3* .5,*
7/24/2019 VSP Tech 01_065966
31/58
32
3D Management
Manage Up, Manage Out andManage Deep
Hitachi Command Suite v7
3DM tM U
7/24/2019 VSP Tech 01_065966
32/58
33
3D Management: Manage Up
Solution Capabilities Automate data placement for higherperformance and lower costs
Ability to manage up to 5M logical objectsand 255PB of virtualized capacity
Manage large storage resource
management deployments with agentlesstechnologies
Scale up virtual server deployments byeliminating shared resource contention
Business Value
Significant CAPEX and OPEX savings bymoving data to lower cost tiers
Increase storage utilization up to 50%
Easily align business application needs tothe right cost infrastructure
HighActivity Set
9ormal:or'ing Set
;uietDataSet
Storage )ier$ Data Heat2nde*
!ni
7/24/2019 VSP Tech 01_065966
33/58
34
3D Management: Manage Out
Solution Capabilities
Unified management for block, file, and
content across all Hitachi storage
Common management of virtualized
heterogeneous storage assets
Endto-end visibility and correlation of
applications, virtual machines, virtual servers,
and logical storage devicesfor traditional andVMware environments
Roadmap to comprehensive IT management
system starting with orchestration layer
Business Value
Properly monitor and plan resource needs forvirtual server farms
Consolidate multivendor storage management
Integrated, open solution with orchestrated
management lowers complexity and costs
Single management
framework with the breadth
to manage storage, servers
and the IT infrastructure
3DM tM D
7/24/2019 VSP Tech 01_065966
34/58
35
3D Management: Manage Deep
:etwor%
Solution Capabilities Consistent implementation of
management operations toreduce human errors
Persistent logical grouping forefficient management practices
Service level managementincorporating both capacity and
performance Common GUI, usability, datarepositories and task workflows
Business Value Simplify operations with up to
50% fewer managementoperation steps
Reduce manual provisioningand reporting processes
Reduce IT deployment timesand risks significantly and gainbusiness agility
Deep integration within Hitachi Command
Suite for the highest level of operationalefficiency to manage the complexities oftodays data centers
Improved Scalability and Performance:
7/24/2019 VSP Tech 01_065966
35/58
36
Improved management performance with parallel refreshes ofmanaged subsystems
Test results show parallel refreshes improves refresh speeds by 6 times HDS lab tests with 12 subsystems refreshed in parallel versus sequential
p S tyEnhanced Management Performance
6ti(
es1aste
r
) 8)) 3))) 38)) +))) :Sec;
Se;ue$tial
7eresh
+arallel
7eresh
Hit hiC dSit C St M t
7/24/2019 VSP Tech 01_065966
36/58
37
Hitachi Command Suite: Core Storage Management
Business View of Storage infrastructure
Policy manager for Tiered Storage Policy Manager for Replication
Performance Problem Management Services
Storage Configuration Services
Heterogeneous Resource Services
Heterogeneous Reporting Services
Backup Reporting Services
&itachi Virtual Ser#er
7/24/2019 VSP Tech 01_065966
37/58
38
Hitachi Dynamic Provisioning
Virtualize devices into a pool of capacity
and allocate by pages
Dynamically provision new servers in
seconds
Eliminate allocated but unused waste by
allocating only the pages that are used
Extend Dynamic Provisioning to external
virtualized storage
Convert fat volumes into thin volumes by
moving then into the pool
Optimize storage performance by
spreading the I/O across more arms
Single LDEV Windows LVM HDP Pool
716% more transactions
0
Transactions (IOPS)
20
40
60
80
100
ResponseTime(ms)
0 1,000 2,000 3,000 4,000 5,000 6,000 7,000
120
LDEVLDEVLDEVLDEVLDEVLDEVLDEVLDEV
HDP Pool
LDEVs
HDP Volume(Virtual LUN)
Today:AutomatedDataMobility
7/24/2019 VSP Tech 01_065966
38/58
39
Today: Automated Data Mobility
)ier -
)ier 6
)ier 4
2nfra$tructure=
bloc' level
#b>ect=