Upload
srikanth-muthyala
View
18
Download
0
Embed Size (px)
DESCRIPTION
Hitachi
Citation preview
6/2/2008
1
2008 Hitachi Data Systems
Hitachi Data Systems Enterprise Storage Boot CampHitachi Universal Storage Platform, Hitachi Universal Storage Platform V, Hitachi Universal Storage Platform VM, and Hitachi Network Storage Controller Hardware and Architecture
6/2/2008
2
2
Module Objectives
Upon completion of this module, the learner should be able to: Describe the Network Storage Controller hardware architectural concepts and
fundamentals Describe the Universal Storage Platform VM hardware architectural
concepts and fundamentals Describe the Universal Storage Platform hardware architectural concepts and
fundamentals Describe the Universal Storage Platform V hardware architectural concepts
and fundamentals
6/2/2008
3
6/2/2008
3
3
Func
tiona
lity
Dem
ande
d
WMS100AMS200
AMS500 AMS1000
Hitachi Storage Families
All product families are managed from one integrated software suite
All models are designed for tiered storageAdvanced Midrange
Storage Systems
Intelligent Virtual Storage Controllers
Network Storage Controller
Model NSC55
Size of Organization Served
Small Business or Department
Large BusinessMid-size Business or Department
Universal Storage Platform V
Universal Storage Platform Universal
Storage Platform VM
In the diagram above, and on subsequent pages,
WMS100 = Hitachi Workgroup Modular Storage system Model WMS100
AMS200 = Hitachi Adaptable Modular Storage system Model AMS200
AMS500 = Hitachi Adaptable Modular Storage system Model AMS500
AMS1000 = Hitachi Adaptable Modular Storage system Model AMS1000
6/2/2008
4
4
Alternate System Names
Unofficial product names occasionally appear in documentation.
StorEdge 9970, 9980
StorageTek 9985V
StorageTek 9985
StorageTek 9990
StorageTek 9990V
Sun
R450
R600-RK
R500-RK
R500
R600
Hitachi RSD
Universal Storage Platform VM
Universal Storage Platform V
Lightning 9900 V Series
Network Storage Controller
Universal Storage Platform
Hitachi Data Systems
RSD is a unit of Hitachi Ltd., RSD stands for Raid Storage Division.RAID500-RK (rack) instead of RAID500-FC (flexible cabinet)
Lightning 9900 V Series stands for Hitachi Lightning 9900 V Series enterprise storage system
6/2/2008
5
5
Key Components Logical Layout
Hi-Star Crossbar Switch Architecture
CHANNEL ADAPTER - CHA
DISK ADAPTER - DKA
CACHE SWITCH - CSW
CACHE SHAREDMEMORY
Host Host
PARITY GROUPS
Ent
erpr
ise
Sto
rage
6/2/2008
6
6
Architecture Key Components
Channel Adapter (CHA) Disk Adapter (DKA) Shared Memory Cache Memory Cache Switch Service Processor (SVP)
Channel Adapter CHA or Front End Director-FED - Provides ports that control data transfer between the host and the cache memory.
Disk Adapter DKA or Back End Director-BED. Provides ports that control data transfer between the disk drive and cache memory.
Shared Memory (SM) - This is the memory that stores configuration data, plus information and status for controlling cache memory, disk drives and the logical devices.
Cache Memory (CM) - This is the memory that stores user data in order to perform I/O processing asynchronously with the reading and writing to a disk drive.
Cache Switch (CSW) - Provides multiple switched data paths between the CHA/DKA and Cache memory
Service Processor (SVP) - Exclusive PC for performing all hardware and software maintenance functions on the
Network Storage Controller.
6/2/2008
7
7
Key Components Physical Layout
Hi-Star Architecture
CHANNEL ADAPTER - CHA
DISK ADAPTER - DKA
CACHE SWITCH - CSW
CACHE SHAREDMEMORY
Host Host
PARITY GROUPS
Uni
vers
al S
tora
ge P
latfo
rm
6/2/2008
8
8
Key Components Physical Layout
Hi-Star Architecture
CHANNEL ADAPTER - CHA
DISK ADAPTER - DKA
CACHE SWITCH - CSW
CACHE SHAREDMEMORY
Host Host
PARITY GROUPS
Net
wor
k S
tora
ge C
ontro
ller
Mix Adapter
Base Adapter
6/2/2008
9
9
Architecture Storage
Storage Overview
00:0000:0100:02
1. Physical Devices - PDEV
3. Virtual Device(s) - VDEV
5. Logical Devices - LDEV
2. PDEV grouped together with RAID type.RAID 1+, RAID 5, RAID 6
4. EMULATION specifies smaller logical unit sizes
6. Assign addresses in CU:LDEV format
Parity Groups are created from the physical disks.
A RAID Level and emulation is applied to the group.
The emulation creates equal sized stripes called LDEVs (Logical Devices).
LDEVs are mapped into a Control Unit matrix (CU#:LDEV#).
6/2/2008
10
10
Network Storage Controller
Network Storage Controller
For entry-enterprise storage customers or the high-end of modular storage customers with either open or mainframe servers who seek to exploit the reliability, availability and unique software capabilities of the Universal Storage Platform at a lower capacity and price point with a smaller form factor.For disaster recovery programs where it can be deployed as a more cost-effective data mover between primary and secondary sites (will support both Hitachi TrueCopy Heterogeneous Remote Replication Software and Universal Replicator)For customers seeking to aggregate or consolidate and simplify the management of a heterogeneous storage poolFor customers who wish to deploy a storage solution across multiple differentiated tiers of heterogeneous storage with common management, replication, and data movement software
6/2/2008
11
11
Cabinet Layout
15U
1U
12U
12U
SVP
Logic/Power Supply Box
Initial disk chassis is required
Optional disk chassisDKC-F515-B2R
Primary Rack
12U
12U
Two more optional B2R disk chassis
Secondary Rack
Hardware Structure Primary/secondary racks
are identical components
The Global Rack provides 42U of useable space. Any portion not covered by a bezel will be covered by a flat filler plate. Additional bezels may be ordered as a line item.Note: If a Hitachi Thunder 9500 V Series modular storage system is mounted in place of the optional disk chassis, its standard bezel will be installed instead of the flat filler panel.The primary rack is composed of the DKC Box, SVP and up to two disk chassis, which can hold a total of 120 disk drives. The DKC can control a maximum of 240 HDDs when connected with four disk chassis. Disk ControllerThe DKC consists of the DKC Box in which the MIX-PCB (channel adapters & disk adapters), BASE-PCB (cache memories, shared memories, and CSW) are installed, and power supplies and battery boxes that supply power to the components above. Most of the main components have been designed with a duplex or redundant configuration, to achieve non-stop operation against failures at a single point. In addition, components can be replaced and added, and the microcode can be upgraded while the subsystem is in operation. The control unit is equipped with an SVP, which is used to service the subsystem, monitor its running condition, and analyze faults. Connecting the SVP with a service center enables remote maintenance of the subsystem.
The secondary rack is composed of two disk chassis, which can hold 60 disk drives.The disk chassis consists of the four HDU boxes in each, of which 15 disk drives can be installed, cooling fans, and power supplies that supply power to the components above. It can have up to 60 disk drives installed.This disk unit is configured from duplex power supply system and cooling fans with redundancy introduced. In addition, the disk drives achieve non-stop operation against failure of one piece of components by employing the RAID1, RAID5, or RAID6 levels. Components can be replaced and added while the subsystem is in operation.
6/2/2008
12
12
Disk Chassis
Disk Chassis Overview Includes a total of 60 slots for HDDs Four HDDs (data) plus one HDD (spare) must be included in initial
configuration
12U
12U
Initial disk chassis is required
DKC-F515-B2R
Optional disk chassisDKC-F515-B2R
The Disk chassis is comprised of two assemblies
Each assembly consists of two rows of 15 slots for HDDs
The disk chassis does not include any HDDs. The HDDs must be ordered as a separate line item
Parity groups of four HDDs are installed vertically in one disk chassis for RAID 1 or RAID5 (one disk in each of the four rows)
Parity groups of eight HDDs are installed vertically in two adjacent columns for RAID6 (two disks in each of the four rows)
Disk ChassisThe disk chassis consists of two physical HDD boxes which contains two HDU Boxes in each, of which 15 disk drives can be installed, cooling fans, and power supplies that supply power to the components above. It can have up to 60 disk drives installed.This disk unit is configured from a duplex power supply system and cooling fans with redundancy introduced. In addition, the disk drives achieve non-stop operation against failure of one piece of components by employing the RAID1, RAID5 or RAID6 level. Components can be replaced and added while the subsystem is in operation.
6/2/2008
13
13
Hardware Specifications
Hardware SpecificationsConnectivity Fibre CHA, FICON, ESCON, NAS, ISCSI
Min/Max ports16/48 Fibre Channel, 16 FICON,
16 ESCON, 8 NAS, 8 ISCSIMinimum HDD 4 Data + 1 SpareMaximum HDD 240 HDDDrive Types 73GB, 146GB, 300GB
Maximum External Capacity 16PBMinimum Cache 4GBMaximum Cache 64GB
Min/Max Control Memory 1GB/6GBMax No. LUNs 16384
Max Virtual Host Ports 1024 per physical portMax Private Virtual Storage Machines 8
Max Internal Capacity 72TB
6/2/2008
14
14
RAID Levels Supported
RAID1 (2D+2D), RAID5 (3D+1P), RAID5 (7D+1P) and RAID6 (6D+2P)
RAID1 (4D+4D) (two concatenation RAID1 (2D+2D) RAID / Emulation types supported by the 300GB HDD
(code 50-05-xx): RAID1 (2D+2D), RAID5 (7D+1P, 3D+1P), and RAID6 (6D+2P) Open Systems: OPEN-V, OPEN 3, 8, 9, E and L Mainframe: 3380-3, 3390-9, -L, and -2L are supported
6/2/2008
15
15
Architecture
MIX (DKA/CHA)
MIX (DKA/CHA)
CSW CSW
CACHE CACHE
SM SM
Channel Interface
FCAL(2Gbps/port)
Cache Path(8.5GB/s)
SM Path (3.6GB/s)
Max. 60HDD
DKU
Battery Box Battery
Box
DKC Power Supply
Max. 240 HDD/subsystem
Disk Path (max.8path)
AC-DC Power Supply
Input Power AC-DC
Power Supply
AC-DC Power Supply
Power Supply
PDB-Box PDB-Box
Input Power
PDB-Box PDB-Box AC-DC Power Supply
CHA CHA
The Network Storage Controller is divided into the Power Supply section, DKC section, and DKU section.The Power Supply section consists of AC-DC power supplies and battery boxes (only for DKC).The DKC section consists of channel adapters (CHAs), disk adapters (DKAs), cache memories (CACHEs), shared memories (SMs).The DKU section consists of FSWs and HDDs.
6/2/2008
16
16
Architecture
M IX (C H A & D K A )(B as ic )
C H A(A dd .1 )
C lus te r1 C lus te r2
2pa th
2pa th
C ache D IM M
M IX (C H A & D K A ) (B as ic )
C H A (A dd .1 )
C S W (B A S E P C B ) C S W (B A C E P C B )
C ache (B A S E P C B )
C ache M em ory (m ax16G B )
C ache (B A S E P C B )
C ache M em ory (m ax16G B )
M ax.8 .5G B /s
Cluster1 Cluster2
2Path
SM DIMM
CHA(Add.1)
MIX(CHA&DKA)(Basic)
SM(BASE)
CHA(Add.1)
MIX(CHA&DKA)(Basic)
SM(BASE)
Universal Star Network The data path bandwidth maximum
is 8.5GB/s (C-HSN) The control path bandwidth
maximum is 3.6GB/s (S-HSN)
6/2/2008
17
17
Disk Controller Unit (DKC)
The Logic Box has six slot locations
Rear Side
Power supply sphere boundary
Cluster 2
CHA&DKA
CHA1
BASE
SMDIMM
A
Logic PL
PCB Location
BASE(Basic)
MIX (Basic)
CHA (Add.1)
B C D E F
CMDIMM
BASE
SMDIMM
CMDIMM
CHA1
CHA&DKA
BASE(Basic)
MIX (Basic)
CHA (Add.1)
Cluster 1
The Network Storage Controller has a structure in which the Base, Mix, and CHA PCBs are arranged on the rear side of the storage system. The domain power supply is divided into left and right halves forming the center of the L/G PL boundary. The left half (front view) is the cluster 1 and the right half, the cluster 2.Numbers of PCBs that can be installed are as follows: MIX PCB: 2 Standard CHA PCB: 2 Optional BASE PCB: 2 StandardThe shared memory modules and cache memory modules are mounted on the BASE PCB. The Base PCB also houses the CSW hardware.
6/2/2008
18
18
Universal Storage Platform VM
Universal Storage Platform VM
Universal Storage Platform VM is targeted at the small enterprise. It sits between the Network Storage Controller Model NSC55 and the Universal Storage Platform V. It can be replicated to and from a Network Storage Controller Model NSC55 and can be replicated to a Universal Storage Platform V.
All of the Hitachi Data Systems Adaptable Modular Storage and Workgroup Modular Storage systems in additional to the legacy product lines, can be virtualized behind the Universal Storage Platform VM for maximum ROI and reduced storage management.
6/2/2008
19
19
Overview
Smaller businesses can exploit enterprise-class software and intelligent storage controller architecture with their existing modular storage
Virtualization Services that simplifies: Non-disruptive Data Migration Data Replication
Local Long Distance
Thin Provisioning of internal and virtualized external storage that:
Reduces storage management Reduces capital expenditures and
monthly electrical and cooling costs
Dual-Rack Configuration
PrimaryRack
Single-RackConfiguration
PrimaryRack
PrimaryRack
On September 10, 2007 Hitachi introduced the Hitachi Universal Storage Platform VM
The only intelligent virtual storage controller with the option to add internal disk storage. This enables the Universal Storage Platform VM to deliver Tier 1 storage with 100% data availability along with storage virtualization services.
Converts into a complete platform for delivery of storage services for mainframes and open systems. This reduces the requirement for separate storage arrays for each open systems and mainframes and simplifies management.
Smaller businesses can exploit Hitachi enterprise-class software and Intelligent Storage Controller architecture with their existing modular storage
Reduces complexity with common data management and data mobility software across a heterogeneous storage pool
Non-disruptive data migration between heterogeneous storage systems
Hitachi Volume Migration software or Hitachi Tiered Storage Manager software
Services Oriented Storage Platform with advanced virtualization offers capabilities for block, file and object-based data.
Virtualization Services that simplify:
Non-disruptive Data Migration
Data Replication
Local
Long Distance
Thin Provisioning of internal and virtualized external storage that:
Reduces storage management
Reduces capital expenditures and monthly electrical and cooling costs
6/2/2008
20
20
Unique Embedded Virtualization Layer Simplifies Tiered Storage Management
Simplifying operations with as much as 96PBs of storage managed as one common pool
Increase Efficiency
Simplified infrastructure and management
Maximize current and past investments
Extend life of existing devices Provide the new functionality of the
Universal Storage Platform V to existing storage
Simplify Operations
Move, migrate, or copy data across heterogeneous tiered storage Lightning 9900 V SeriesThunder 9585V WMS100
Universal StoragePlatform VM
EmailDataMiningOrder
SystemPrint
ServiceFile
Service
High Perf.99.99%
100%GeneralPurpose
ArchiveBackup
IBM Shark-ESS 800
EMC DMX2000
Single set of tools for data management and replication
SAN
IBM Shark-ESS 800
ERP
HITACHI
Hitachi Universal Storage Platform VM
This diagram shows EMC DMX, the IBM Shark, and Hitachi storage systems that can be managed.
Universal Storage Platform VM can virtualize multiple storage systems connected to the back-end Fibre Channel ports.
Customers can keep existing storage and add value by being able to include Hitachis latest software functionality on them, and latest host connectivity, which far outpaces anyone else in the industry. Instead of managing all those different storage systems, can manage your entire storage pool through Universal Storage Platform VM. This allows the customer to extend the life of their existing devices and centrally manage and monitor all storage among all this complexity.
Hitachi Thunder 9500 V Series with SATA disks are included in the same environment with Hitachi Lightning 9900 V Series enterprise storage system as high-performance, high-availability disk, and finally the ultra high-performance and availability from the internal disk of the Universal Storage Platform. Customers can provide the right storage to the right application at the right time.
6/2/2008
21
21
Hardware Specifications
72TB (300GB FC) Maximum Internal Capacity
8 (Max 8GB per Virtual Storage Machine)Max Private Virtual Storage Machines
1024 per physical portMax Virtual Host Ports
16,384Max # of LUNs
4GB/16GBMin/Max Control Memory
64GBMaximum Cache
4GBMinimum Cache
96PBMaximum External Capacity
146GB, 300GB FC, 750GB SATA#Drive Types
8/48 Fibre Channel8/24 FICON, 8/24 ESCON
NAS (High Performance NAS)Min/Max Ports
Fibre Channel, FICON, ESCON, NASConnectivity
Specification/QuantityHardware
# - GA November 2007
6/2/2008
22
22
Hardware Comparison of Crossbar Switch Architecture Net Control
Control path bandwidth of Crossbar Switch Architecture Net: 3.6GB/sThe number of paths from CHA/MIX to each SM is 12. Shared memory is installed on BASE PCB
Control path bandwidth of Crossbar Switch Architecture Net : 4.8GB/sThe number of paths from channel adapter/disk adapter to each SMA is increased from 12 to 16.Shared memory is installed on SMA PCB.
Network Storage Controller Universal Storage Platform VM
2Path
Cluster1 Cluster2
CHA (Option3)
CHA (Option1)
CHA (Option2)
CHA (Option1)
CHA (Option2)
CHA (Option3)
DKA (Option1)
DKA (Option1)
2Path
4.8GB SMA SMA
Cluster1 Cluster2
2Path
SM DIMM
CHA(Add.1)
MIX(CHA&DKA)(Basic)
SM
CHA (Add.1)
MIX(CHA&DKA) (Basic)
SM
BASE PK
On the graphic above, CHA stands for channel adapter
6/2/2008
23
23
Features
Scalability Universal Storage Platform VM supports a wide range of configurations to
address the scalability requirements of our customers Front-end directors: 1 to 3 features
Fibre Channel, FICON, ESCON Cache memory: 4GB - 64GB Internal Disk Drives: Zero to 240
Configurations with zero internal disks are referred to as Diskless. These configurations use Externally Attached Storage for all data storage.
Disk drive capacities supported: 73GB, 146GB and 300GB
6/2/2008
24
24
Features
High-performance All disks supported by Universal Storage Platform VM operate at 15K rpm. The data transfer rate between the back-end director Fibre Channel (FC)
disk adapter and the disk drive is 4GB/sec. Overall system performance has been improved by installing
microprocessors on the front-end directors and back-end director disk adapter that operate at twice the speed as those used on the Network Storage Controller.
6/2/2008
25
25
Expanded Configuration
Disk Chassis(DKU-R3)
Disk Chassis(DKU-R2)
Disk Chassis (DKU-R1)
Disk Chassis (DKU-R0)
Disk Controller (DKC)
Operator Panel
Additional SVP/Battery Chassis
Primary Rack
Secondary Rack
12U
12U
2U
10U
Components housed within the Secondary Rack:
OPTIONAL: Disk Chassis Supports up to 60 disks. A maximum of two Disk Chassis may be installed in the Secondary Rack.Note: The secondary rack is only required for those configurations that include three or four Disk Chassis
Components housed within the Primary Rack: Disk Controller Houses Cache/Shared Memory, up to three front-end directors, one
back-end director, Hi-Star Net architectural components and a Service Processor (SVP).
OPTIONAL: Additional SVP/Battery Chassis - Houses optional SVP for customers requiring the highest level of system mgmt availability. Houses an Additional Battery required when Cache Memory capacity exceeds 80B (*Note: Initial release of Chicago will only support a maximum of 64GB of Cache Memory.)
OPTIONAL: Disk Chassis Supports up to 60 disks. A maximum of two Disk Chassis may be installed in the Primary Rack.
(1) Disk ControllerThe disk controller consists of the disk controller box, in which the channel adapters, disk adapters, cache memory adapters, shared memory adapters, and CSW are installed, battery boxes and power supplies that supply power to the components above. Most of main components have been implemented with a duplex or redundant configuration, and achieve non-stop operation against a failure of a single point of the components. In addition, components can be replaced and added, and the microcode can be upgraded while the subsystem is in operation. The control unit is equipped with an SVP, which is used to service the subsystem, monitor its running condition, and analyze faults. Connecting the SVP with a service center enables remote maintenance of the subsystem.(2) Disk ChassisThe disk chassis consists of the four HDU boxes in each of which 15 disk drives, cooling fans, and power supplies that supply power to the components above can be installed. It can have up to 60 disk drives installed.This disk unit is configured from duplex power supply system and cooling fans with redundancy introduced. In addition, the disk drives achieve non-stop operation against the failure of one piece of the components by employing the RAID1, RAID5 or RAID6 level. Components can be replaced and added while the subsystem is in operation.
6/2/2008
26
26
Switched Loop Details
Universal Storage Platform VM introduces a switched back-end, where the drives are still on arbitrated loops, but the switch logic bypasses all targets on that loop except for the one disk being addressed.
On the previous Hitachi Universal Storage Platform model, all of the disks attached to a back-end director PCB were on eight shared loops. A transfer to the last disk on a loop (could be 32 or 48 disks per loop) would have to pass through bypass logic on all of the disks in front of it. The Universal Storage Platform VM introduces a switched back-end, where the drives are still on arbitrated loops (all Fibre Channel disks use Fibre Channel Arbitrated Loops (FC-AL, not FC-SW fabrics), but the switch logic bypasses all targets on that loop except for the one disk being addressed. This reduces the propagation time by some microseconds (not noticeable), but the primary effect of this change is improved accessibility to individual disks. Each HDU has four such FSW switches, two on the front side (32 disks) and two more on the back (32 disks). Each pair of switches is either an upper or a lower switch as seen in the figure above.
6/2/2008
27
27
Universal Storage Platform
Universal Storage Platform
6/2/2008
28
28
Functional Descriptions
Using the Universal Storage Platform: Connect all storage systems into a common storage platform
Reduce complexity and extend the useful life of storage you already own
Share that platform across virtual storage machines Address application-specific performance, availability, cost, and
protection requirements Reduce data management cost by using a single replication engine
Support all of data protection and lifecycle management needs Enhance server, application, and network performance
Offload replication, migration, and data protection tasks Manage all of this from a single pane of glass
6/2/2008
29
29
Pricing Models
Universal Storage Platform 100 - Entry Level Universal Storage Platform 600 - Enhanced Universal Storage Platform 1100 - High Performance
Disk ControllerFrameDKC
Array FrameDKU-L1
Array FrameDKU-R1
Array FrameDKU-L2
Array FrameDKU-R2
Disk ControlFrameDKC
There are three Universal Storage Platform models, ranging from an entry-level to a high-performance configuration. You may nondisruptively upgrade from the smallest model to the maximum configuration.
6/2/2008
30
30
Product Overview
Disk Controller Frame - DKC
Operator Panel
The Integrated Disk Controller (DKC) frame contains the operator panel, SVP, FEDs, BEDs, cache switch modules, cache memory boards, control memory boards, hard disk drives, power supplies, battery boxes, and cooling fans. The Universal Storage Platform consists of a disk controller (DKC) in which 128 disk drives can be installed and disk array frames (DKUs) in each of which 256 disk drives can be installed. The disk controller is capable of controlling up to 1,152 HDDs when it is connected with four disk adapters.
Disk Controller The box frame contains channel adapters, disk adapters, cache memories, shared memories, CSWs, the HDU box containing disk drives, and power supplies and battery boxes.
Most components have a redundant configuration, which achieves nonstop operation against failure of single points.Components can be replaced and added, and the microcode can be upgraded while the storage system is in operation.The control unit is equipped with an SVP (special PC), which is used to service the storage system, monitor its running condition andanalyze faults. Connecting the SVP with a service center enablesremote maintenance of the storage system.
6/2/2008
31
31
Product Overview
Disk Array Frame - DKU
The Universal Storage Platform Disk Array Frame (DKU) contains hard disk drives, power supplies, battery boxes, cooling fans, and communication interfaces to the control frame.
Disk Unit A disk unit consists of four hard drive unit (HDU) boxes each with 64 disk drives, cooling fans, power supplies and battery boxes.It has a redundant power supply system and cooling fans.The disk drives achieve nonstop operation against failure by employing RAID1+0 or RAID5. Components can be replaced and added while the storage system is in operation.
6/2/2008
32
32
Architecture
DKUFRAME(L2)
DKUFRAME(L1)
DKCFRAME
DKUFRAME(R1)
DKUFRAME(R2)
925
1860
3382
650
750
AC-Power Supply
OP Panel
HDD-BOX
SW-PSSW-PS
L/G-BOX
(750) (650)
BatteryBattery
DKC Frame DKU Frame
HDD-BOX
DKC510I and DKU505I
Measurements in millimeters
The Universal Storage Platform consists of a disk controller in which 128 disk drives can be installed and disk array frames (DKUs) in each of which 256 disk drives can be installed. The DKC is capable of controlling up to 1,152 HDDs when it is connected with four DKUs.Disk Controller The box frame contains channel adapters, disk adapters, cache memories, shared memories, CSWs, the HDU box containing disk drives, and power supplies and battery boxes.
The control unit is equipped with an SVP (Special PC), which is used to service the subsystem, monitor its running condition, and analyze faults. Connecting the SVP with a service center enables remote maintenance of the subsystem.
Disk UnitA DKU consists of four hard drive unit (HDU) boxes each with 64 disk drives, cooling fans, and power supplies and battery boxes.It has a redundant power supply system and cooling fans.
6/2/2008
33
33
Universal Storage Platform 100
Up to 256 disks (up to 74TB) Single back-end director (BED) pair Two cache memory cards, two cache switch cards,
two shared memory cards Maximum 64GB cache, 17GB/s data bandwidth
Up to 64 ESCON/32 FICON channels or 128 FC Front-end directors are the only optional features
Upgradeable to Universal Storage Platform 600 Add second BED, cache switch pair and array frame
The model Universal Storage Platform 100 is suitable for small to medium enterprises and or specific applications.
6/2/2008
34
34
Universal Storage Platform 600
Up to 512 disks (96+1 minimum) ~148TB raw capacity
Dual frame standard, specific cabling Two BED director pairs Four cache switch cards, two cache
memory cards, two control memory cards Additional cache memory and control
memory are available as an optional upgrade
Maximum 64GB cache, 128GB after optional upgrade
34GB/sec data bandwidth Up to 48 (96 in later release) FICON, 96
ESCON channels, or 192 FC Upgradeable to model Universal Storage
Platform 1100
The Universal Storage Platform 600 performance capabilities are created to match most of the requirements of Fortune 500 customers. It offers full upgrade ability to the Universal Storage Platform 1100 model and excellent scalability in terms of features and functions.
6/2/2008
35
35
Universal Storage Platform 1100
Up to 1152 disks (128+1 minimum) Aggregate up to 332TB of capacity
Two or four back-end director pairs Two switch pairs, two cache memory pairs and two control memory pairs
Max 256 GB cache, 68 GB/sec data bandwidth Up to 48 (96 in later release) FICON, 96 ESCON channels or 192 FC Ultimate consolidation and transaction machine
The Universal Storage Platform 1100 is the ultimate configuration. It comes with everything standard and the only choices are the number of BEDs and FEDs installed. It is the most high performing configuration of the available of the models.
6/2/2008
36
36
Architecture - Clusters
DKC Logic Box Slots
Power supply sphere boundary
Rear Side - Cluster 2 2X 2W 2V 2U 2T 2CB 2SB/2SD 2CD 2R 2Q 2P 2N 2M
1L 1K 1J 1H 1G 1CC 1SA/1SC 1CA 1F 1E 1D 1B 1A
C
H
A
6
D K A 0
C
H
A
3
C
H
A
0
C
H
A
2
C
H
A
7
C
H
A
1
DKA5
D K A 3 / C H A
C
H
A
4
C
H
A
5
D K A 6 / C H A
CACHE1
CACHE3
C
S
W
3
C
S
W
1
Cache (Add.)
Cache (Basic)
C
S
W
0
C
S
W
2
D K A 7 / C H A
DIMM DIMM
DIMM DIMM D K A 2 / C H A
D K A 4
CSW (Add)
SM3
SM1
SM0
SM2
Front Side - Cluster 1
2SB
2SD
1SC
1SA CACHE2
CA CH E 0
DKA1
DKC-F510I-CSW
Controlled by CSW (Basic)
Logic PL
(Basic)
(Basic)
(Add)
(Add)
Upper
Upper
Lower
Lower
PCB Location
PCB Location
Cache (Basic)
Cache (Add.)
CSW (Add.)
CSW (Basic)
CSW (Basic)
CHA (Basic)
CHA (Basic)
CHA (Add.1)
CHA (Add.1)
CHA (Add.2)
CHA (Add.2)
CHA (Add.3)
CHA (Add.3)
Option B
Option B Option1
Option1Option2
Option2
Option3
Option3
Controlled by CSW (Add)
The Logic Box slots of the DKC are divided into two sections. One section is located on the front side of the DKC, and the other section is located on the rear side. These two sections function as Cluster 1 and Cluster 2, respectively. Each cluster has a structure in which two sets of CHAs, DKAs, Caches, and CSW are installed symmetrically to the right and left. The basic CSWs are installed at the PCB locations, 1D and 2P, and control the Basic CHA. Add CHA1, Option B, and Option DKA 1. When installing the channel adaptor/disk adaptor (CHA/DKA) in the location, 1G/2T, 1H/2U, 1K/2W, or 1L/2X, the DKC-F510I-CSW must be installed in location 1J and 2V. The locations for installing the shared memory PCBs are separated from the locations for other components. The shared memory PCBs are installed in two layers (upper and lower). The shared memory PCBs installed in the upper and lower layers are different from each other. Besides, locations for installing the basic and additional shared memory PCBs in Cluster 1 are different from those in Cluster 2.
6/2/2008
37
37
Cache Memory and Shared Memory
Cache Overview
Cache (Data)
Shared Memory (Control)
Non-volatile
1024MB DIMMs = 12GB
512MB DIMMs = 6GB
2048MB DIMMs = 256GB
1024MB DIMMs = 128GB
Cache DirectoryConfiguration InfoDevice MappingTask Queues
Customer Data
Cache directory information allows a CHA microprocessor to find out if requested data is already cache-resident.Configuration Info is the configuration data specified via the SVP installation, maintenance, and change-configuration capabilities. Device mapping means LUNs mapping to a CU:LDEV, which maps to anarray-group. Logical-addressing has to be converted to physical-addressing to determine the specific drive containing the requested data. There are task queues that support front-end and back-end processor activities. Each MP runs a task created with and RTOS called VxWorks(WindRiver Inc.)
6/2/2008
38
38
Shared Memory
Shared memory stores Cache directory Information Storage system configuration data Path group array information
Dynamic path selection Contains the run-time task list for front-end directors and back-end directors
Size of shared memory storage is determined by Total cache size Number of LDEVs Replication software in use
Shared memory is duplexed Physical location
In the Universal Storage Platform, shared memory is mounted on dedicated printed circuit boards
In the Network Storage Controller, shared memory is mounted on the cache printed circuit boards
The non-volatile shared memory contains the cache directory and configuration information for the Universal Storage Platform. The path group arrays (for example, the dynamic path selection) also reside in the shared memory. The shared memory is duplexed, and each side of the duplex resides on the first two shared memory cards, which are in clusters 1 and 2. The shared memory has separate power supplies and is protected by separate seven-day battery backup.For the Universal Storage Platform model, shared memory is now mounted on separate boards (previously on the cache boards). This new design eliminates the performance degradation (caused by write-through mode) that was previously experienced during shared memory replacement. The basic size of the shared memory is 3GB (two cards), and the maximum size is 6GB (four cards). The size of the shared memory storage is determined by several factors, including total cache size, number of LDEVs and replication functions in use. The replication functions affecting shared memory include Hitachi TrueCopyRemote Replication software Synchronous/Asynchronous software, Hitachi ShadowImage Heterogeneous Replication software, Hitachi Universal Replicator software, Hitachi Copy-on-Write Snapshot software, FlashCopy V2, Volume Migration, Serverless Backup Enabler (E-Copy), and Copy Manager for TPF. Any required increase beyond shared memory stores configuration data and the information for controlling the cache memory and disk drives. The memory can be accessed commonly from the CHA and DKA.
6/2/2008
39
39
Architecture
Hi-Star Architecture
THEORY 02-60
Comprised of:CacheShared memoryNon-blocking cache switches
The Universal Storage Platform has the power supply, DKC, and DKU section in which disk drives are installed. The High Performance Shared Memory Access Model, in which the shared memory-PCB (SM-PCB) is added optionally, realizes the bandwidth of up to 15GB/s. Hi-Star net performance according to system configuration: Cache (Basic) + CSW (Basic) -----------------------------maximum 17GB/sec Cache (Basic) + CSW (Basic + Option) -----------------maximum 34GB/sec Cache (Basic+Option) + CSW (Basic)-------------------maximum 34GB/sec Cache (Basic+Option) + CSW (Basic+Option) --------maximum 68GB/secThe power supply section consists of AC-Boxes, AC-DC power supplies and battery boxes. The system architecture adopts duplicated structure for the AC power reception. The AC power supplied is converted into 56V DC power by the AC-DC power supply and supplied to each component inside the subsystem. Each component has a DC-DC converter and generates necessary voltage from the 56V DC to supply it to itself.
New generation non-blocking switching architecture Faster switch components Enhanced data and control bandwidth Helps consolidations and fast transactions applicationsSeparate control memory region for increased reliability and serviceability
Expanded Cache Memory and flexible front-end/back-end configurationFaster and increased number of RISC processors across the system (2GB/s)Conform better to the applications needsImproved Fibre Channel and FICON designAdditional reliability: reduces outages, increases productivity
Faster back-end design2Gbit/sec disk interface Optional faster back-end director (Later release)Ease performance bottlenecks, helps with applications consolidation and QoS
Enhanced RAID-1+ and RAID-6 RAID-6 (6+2) for increased reliability, recovery and security
6/2/2008
40
40
Optional Disk Features
Also called hard disk drives (HDDs) All Universal Storage Platform
models support 73GB,15Krpm 146GB,10Krpm 146GB,15Krpm 300GB,10Krpm
Dual vendor policy will be applied wherever possible
HGST and Seagate Universal Storage Platform/Network
Storage Controller hard disk drives are not interchangeable with other Hitachi Data Systems Storage Systems
Universal Storage Platform supports four types of disk drives; these drives have a 2Gb/s fibre channel interface. The respective capacities of the disk drives are: 73GB/15k rpm 146GB/10k rpm 146GB/15k rpm 300GB/10k rpm Each disk drive can be replaced nondisruptively on site. The Universal Storage Platform utilizes diagnostic techniques and background dynamic scrubbing that detect and correct disk errors. Dynamic sparing is invoked automatically if needed. For an array group of any RAID level, any spare disk drive can back up any other disk drive of the same rotation speed and the same or lower capacity anywhere in the subsystem, even if the failed disk and the spare disk are in different array domains (attached to different disk adapter pairs). The Universal Storage Platform can be configured with a minimum of one and a maximum of 40 spare disk drives (Four slots for spare disks + 36 slots for spare or data disks). The standard configuration provides one spare drive for each type of drive installed in the storage system. The Hi-Track tool monitoring and reporting tool detects disk failures and notifies the Hitachi Data Systems Support Center automatically and a service representative is sent to replace the disk drive.
6/2/2008
41
41
HDU Box
Configuration in HDU Box in which 32 HDDs are controlled by two Fibre Channel Arbitrated Loops (FC-ALs)
The first FSWA1 is standard and is always installed.When connecting to the HDU using the two FC-ALs, installation of the second FSWA2 is needed.When using the second FSWA2, the HDU is configured as two separate HDUs.
HDU Box
FSW-A2
FSW-A2FSW-A1
FSW-A1
07 06 05 04 03 02 01 00
0F 0E 0D 0C 0B 0A 09 081F 1E 1D 1C 1B 1A 19 18
17 16 15 14 13 12 11 10
07 06 05 04 03 02 01 00
0F 0E 0D 0C 0B 0A 09 081F 1E 1D 1C 1B 1A 19 18
17 16 15 14 13 12 11 10
FCAL boundary
HDU
HDD Location
FC-AL boundary
DKU F505IFSWA
HDU
Extension of FC-AL connection
HDU Right SideHDU Left Side
FSW-A2
FSW-A2FSW-A1
FSW-A1
In the disk controller (DKC) and DKU frames, two HDUs each contain 32 HDDs. The HDDs are connected to the disk adapter (DKA) through the fibre channel interface switches (FSWs) with the FC-AL. When the FSW-A is installed, the HDDs in the HDU are controlled by the two FC-ALs. For the HDU box in the disk controller (DKC) (DKU-R0), the FSW-A is the standard installation. The HDDs are controlled by eight fibre channel ports in the first DKA pair.Fibre Channel interface switch PCB is a board that provides the physical interface (cable connectors) between the ACP ports and the disks housed in a given disk drive.A HDU box has been called a HDD canister in the past.
6/2/2008
42
42
DKU Hardware and Interconnections
High Speed Disk Access Model - Four DKA Pair Configuration
DKC R1 DKUL1 DKUL2 DKU
HDU
R0 DKU
R2 DKU
HDU HDU
HDU HDU
HDU HDU
HDU HDU
HDU HDU
HDU HDU HDU HDU
HDU HDU
DKADKA(Opt.3)
DKADKA(Opt.2)
DKADKA(Opt.1)
DKADKA(Opt.B)
HDU
The DKU section consists of HDU boxes and HDDs.FC-AL connections are used to access the HDDs installed in the HDU-boxes.A maximum of 48 HDDs on two FC-AL loops from the OPT B BED feature is possible and a maximum of 32 HDDs on two FC-AL loops from each of the other three BED features is possible. Every HDD is connected to two FC-ALs.Option B Base Option, standardHigh Performance Disk Access ModelDevice Interface Cable options: R0 R1 DKC R1 R1 R2 (two features) DKC L1 DKC L1 L1 L2 (two features)
6/2/2008
43
43
DKA Options - Enhanced Backend FC-AL
48Processor per DKA
3.212.8 or 6.4Total bandwidth (GBps)
12Bandwidth of FC path (Gbps)
48Number of Backend path DKA
3264Number of Backend path (Max)
Lightning 9900 VSeries system
Universal Storage Platform
Item
In the Universal Storage Platform, the number of ports per disk adapter is increased to eight and furthermore, the transfer rate per fibre port is made higher to 2Gbps. In the storage system with the maximum configuration, disk drives are accessed through the four disk adapter pairs and 64 paths.
The full specification model (DKA-F510I-400) controls one Fibre Channel port with one microprocessor (Eight FC-AL and eight microprocessors (MPs) per PCB).
6/2/2008
44
44
RAID Protection
RAID 0/1 2D+2D (2 Disk+2 Mirror) 4D+4D (4 Disk+4 Mirror)*
N/A Hitachi Lightning 9900 Series enterprise storage systems RAID 5
3D+1P (3 Data Disk+1Parity Disk) 7D+1P (7 Data Disk+1Parity Disk) Also 16 or 32 Disk Groups*
N/A Lightning 9900 Series systems RAID 6
6D+2P (6 Data Disk+2Parity Disk) N/A - Lightning 9900 V Series system or Lightning 9900 Series system
* With Concatenation on Universal Storage Platform, Hitachi Network Storage Controller or Hitachi Universal Storage Platform V only
6/2/2008
45
45
Cache Destaging Process
Cache Destaging (new for the Universal Storage Platform) will beconfigured for either
Backup mode Destaging mode Not supported network storage controller
In the event of a power failure longer then one minute, the Universal Storage Platform will begin the backup process
Backup process is configured when Universal Storage Platform is installed The backup process is set to either
Destaging mode Destage to disk all write I/O in cache
Backup mode Provide power to cache until power resumes
Cache Destage Requires Cache memory batteries Disk adapter batteries Destaging Mode = On
Battery backup and destage option for HDDs. The Universal Storage Platform provides separate battery backup for the hard disk drives with an optional setting to destage data from cache to the (internal) HDDs during a power outage. This feature is new with the Universal Storage Platform.Note: The destage option is not supported when external storage is connected and/or when Cache Residency Manager BIND mode is applied.Shared memory has separate power supplies and is protected by separate seven-day battery backup. Cache memory in the Universal Storage Platform is nonvolatile and is protected by 36-hour battery backup (without the destage option, cache size of 132GB or more) or 48-hour battery backup (without destage option, cache size of 128GB or less).
6/2/2008
46
46
Hi-Track Monitor
Hi-Track Monitor call-home service and remote maintenance tool Hi-Track Monitor is a standard for all of the Universal Storage Platform
models Monitors the operation of the Universal Storage Platform at all times
Collects hardware status and error data Transmits this data through a modem to the Hitachi Data Systems
Support Center The Support Center analyzes the data and implements corrective action
as needed
Hi-Track Monitor enables most problems to be identified and fixed prior to actual failure and the advanced redundancy features enable the system to remain operational even if one or more components fail.
6/2/2008
47
47
Hi-Track Monitor
In the event of a component failure Calls the Hitachi Data Systems Support Center immediately to report
the failure No customer action is required
Provides for remote maintenance Hi-Track Monitor does not have access to any user data stored on
the Universal Storage Platform The Hi-Track Monitor requires a dedicated RJ-11 analog phone line
6/2/2008
48
48
Universal Storage Platform V
Universal Storage Platform V
6/2/2008
49
49
Specification Comparisons
Feature USPV USPMaximum Internal Capacity 332TB (300 GB HDD) 332TB (300GB HDD)Maximum External Capacity 256PB 32PBMaximum Number of HDDs 1152 1152
FC 73GB 15K RPM FC 73GB 15K RPMFC 146GB 10K RPM
FC 146GB 15K RPM FC 146GB 15K RPMFC 300GB 10K RPM FC 300GB 10K RPM
Maximum Cache Memory 256GB 256GBMaximum FC Ports 224 192
Maximum ESCON Ports 112 96Maximum FICON Ports 112 96Maximum iSCSI Ports ** 32
Max NAS Ports ** 32Max Back-End Paths 64 x 4Gbps 64 x 2GbpsInternal Bandwidth 106GBps 81GBps
External Storage Connection Fibre Channel Fibre Channel128K mainframe 64K Mainframe
64K Open Systems 16K Open SystemsMaximum Definable in 1 Ldev 4TB 2TB
HDD Types
Maximum Volumes
** iSCIS and NAS connectivity is scheduled for a later release.See Maintenance Manual pages THEORY03-310, THEORY03-320, THEORY02-220.
In the table above, and subsequent pages,USPV or USP V stands for Universal Storage Platform VUSP stands for Universal Storage Platform
6/2/2008
50
50
Controller &128 drives
Up to256 drives
Overview
Base controller frame and one to four optional disk array frames Controller boards are reduced to half previous size, fewer resources
affected by a service action Improved availability, configurability
and serviceability
CHA TypeUSP USP-V USP USP-V
Open Fibre 4 8 16,32 8,16ESCON 4 8 16 8FICON 4 8 8,16 8
FED Packages Ports / Package
USP USP-V USP USP-V1 BED 16 8 384 1922 BED 32 16 640 3843 BED 48 24 896 5124 BED 64 32 1152 6405 BED - 40 - 7686 BED - 48 - 8967 BED - 56 - 10248 BED - 64 - 1152
Back-end Loops Max Disks
The Universal Storage Platform V is a high performance and large capacity disk storage system at the high end that follows the architecture of the Universal Storage Platform and has an improved Hi-Star Net Architecture and a faster microprocessor. An Universal Storage Platform V can consist of one disk control frame (DKC) which can install 128 HDDs, and up to four disk array frames (DKU) which each can install 256 HDDs and a subsystem is a flexible configuration, which goes from 5 to 1,152 HDDs (minimum and maximum). The Universal Storage Platform V is lined up with two models of a 3-phase AC power model and a single-phase model, and each model is connectable to both mainframe systems and open systems.
Number of disk drives:Up to 256 HDDs/16 disk paths (when 2 DKA pairs are installed), orUp to 640 HDDs/32 disk paths (when 4 DKA pairs are installed), orUp to 896 HDDs/48 disk paths (when 6 DKA pairs are installed), orUp to 1,152 HDDs/64 disk paths (when 8 DKA pairs are installed)
The Universal Storage Platform Vs new half-sized PCBs allow for a less costly, more granular expansion of a system. For instance, there were typically 4-6 front-end director (FED) packages installed in a Model Universal Storage Platform 600, and they could be a mixture of Open Fibre, ESCON, FICON, and iSCSI. However, this gave you a large number of ports of a single type that you may not need, with a substantial reduction of other port types that you may need to maximize. With the new half-sized cards, you can have 8 CHA packages (or up to 16 at the expense of disk BED packages), using any mixture of the interface types as before. Only now though, there are half as many ports per board, smaller numbers of lesser used port types can be installed. Packages are still installed as pairs of PCB cards just as with the Universal Storage Platform.The Universal Storage Platform V back-end disk adapter (BED) has 4-4Gbit/sec loops supporting up to 128 physical disks. The Universal Storage Platform BED pair has 16-2Gbit/sec Fibre loops supporting up to 256 physical disks. There are up to eight BED packages (16 PCBs) in a Universal Storage Platform V, while a Universal Storage Platform has four BED packages (8 PCBs), both having the same number of loops.
6/2/2008
51
51
Overview
Frame Types Disk Controller (DKC) Frame Disk Unit (DKU) or Disk Array
Frame
Disk Controller Frame Disk Array FRAME
Logic-Box
(750 mm) (650 mm)
(1920 mm)
HDD Box
AC-DCPower Supply
AC-DCPower Supply
(75.59 in.)
(25.59 in.)
Disk Controller Frame (DKC):The DKC consists of the DKC box in which the channel adapters, disk adapters, cache memories, shared memories, CSWs are installed, and the HDU Box in which disk drives are installed, and power supplies and Battery Boxes that supply power to the components above.
Disk Array Frame or Disk Unit Frame (DKU):The DKU consists of the four HDU Boxes in each of which 64 disk drives can be installed, cooling fans, and power supplies and Battery Boxes that supply power to the components above. It can have up to 256 disk drives installed.
6/2/2008
52
52
DKC Frame Logic Box Design
The new Logic Box is divided into CL1 a CL2 with a lower and upper layer.
All PCBs are half size.
Power supply boundary
Rear / Cluster 2
1LU 1KU 1JU 1HU 1GU 1CE 1SA 1CA 1FU 1EU 1DU 1BU 1AU
DKA1
CHA6
CHA1
CHA5
CHA2
DKA6/CHA11
CSW2
CSW0
DIMMDIMM
DIMM DIMMDKA5/CHA12
Front / Cluster 1
SMA1
DIMM
DIMMCMA3
CMA1
DKA2
Logic PL
PCB Location
PCB Location
DKA3/CHA14
CHA8
CHA3
CHA7
CHA4
DKA8/CHA9
CSW3
CSW1
DKA7/CHA10
SMA2
CMA4
CMA2
DKA4/CHA13
2XL 2WL 2VL 2UL 2TL 2CD 2SB 2CH 2RL 2QL 2PL 2NL 2ML
CHA7
CHA8
DKA4/CHA13
CHA3
CHA4
DKA7/CHA10
CSW3
CSW1
DKA8/CHA9
CMA2
CMA4
DKA3/CHA14
SMA1
2XU 2WU 2VU 2UU 2TU 2CC 2SD 2CG 2RU 2QU 2PU 2NU 2MU
CHA5
CHA6
DKA2
CHA1
CHA2
DKA5/CHA12
CSW2
CSW0
DKA6/CHA11
CMA1
CMA3
DKA1
SMA2
Option5 Option6 Option2 Option6 Option5 Option1 Option2 Option3 Option2 Option1 Basic Option2 Option1
PCB Location
1LL 1KL 1JL 1HL 1GL 1CF 1SC 1CB 1FL 1EL 1DL 1BL 1AL
Upper
Lower
Lower
Upper
PCB Location
Option7 Option8 Option3 Option8 Option7 Option2 Option1 Option4 Option4 Option3 Option1 Option4 Option3
Option5 Option6 Option2 Option6 Option5 Option3 Option1 Option1 Option2 Option1 Basic Option2 Option1
Option7 Option8 Option3 Option8 Option7 Option4 Option2 Option2 Option4 Option3 Option1 Option4 Option3
DK
A pair 1&
2D
KA
pair 3&4
DKA pair 5&6
DKA pair 7&8
Advantages of half size PCBs:More granular upgrades
Smaller upgrade steps for host connectivity; easier for mixed connectivity type platformsIn a pure mainframe environment a half Fibre option is enough for replication, more Ficon ports for host connectionsiSCSI will not occupy a full sized feature like on the Universal Storage Platform
Less impact on PCB maintenanceOnly half of the host ports need to be switched offline compared with the Universal Storage Platform Only four instead of eight backend loops will be unavailable during DKA maintenance
DKA pairs are installed with two pairs at the time2 pairs of DKAs4 pairs of DKAs6 pairs of DKAs8 pairs of DKAs
6/2/2008
53
53
Back-end Connections
HDU
DKU-R0HDU
USPDKU-L2
L1 (Upper)
HDUHDU
L1 (Lower)
HDUHDU
L2 (Upper)
HDUHDU
L2 (Lower)
HDUHDU
R1 (Upper)
HDUHDU
R1 (Lower)
HDUHDU
R2 (Upper)
HDUHDU
R2 (Lower)
HDUHDU
DKU-L1 DKU-R1 DKU-R2
1st2nd
3rd4th
5th6th
7th8th
DKA
64sp64sp
64sp 64sp 64sp 64sp
64sp 64sp
64sp64sp64sp64sp64sp64sp
64sp 64sp 64sp 64sp
-AKT Kit
Front View of DKU
DKUPS
-xx3
DKUPS
-xx2
DKUPS
-xx1
DKUPS
-xx0
BATTE
RY
-Uxx0
BATTE
RY
-Uxx1
BATTE
RY
-Uxx2
BATTE
RY
-Uxx3
BATTE
RY
-Uxx4
BATTE
RY
-Uxx5
BATTE
RY
-Uxx6
BATTE
RY
-Uxx7
FSWR01-UFSWR01-L
SVRR05-L SVRR01-L
SVRR05-U SVRR01-U
HD
DR
05-0CH
DD
R05-0A
HD
DR
05-08H
DD
R05-06
HD
DR
05-04H
DD
R05-02
HD
DR
05-00H
DD
R01-0E
HD
DR
01-0CH
DD
R01-0A
HD
DR
01-08H
DD
R01-06
HD
DR
01-04H
DD
R01-02
HD
DR
01-00
HD
DR
05-0EH
DD
R05-0D
HD
DR
05-0BH
DD
R05-09
HD
DR
05-07H
DD
R05-05
HD
DR
05-03H
DD
R05-01
HD
DR
01-0FH
DD
R01-0D
HD
DR
01-0BH
DD
R01-09
HD
DR
01-07H
DD
R01-05
HD
DR
01-03H
DD
R01-01
HD
DR
05-0F
SVRR05-EX
The Standard DKC-F605I-18 Disk Unit frame is delivered with power and logic (FSW / SVR) installed in the lower section of the frame. This will allow to install HDDs in the Lower half only.It is now an option to use the Upper part of the frame, the option is:DKC-F605I-AKT = DKU Expansion KitDKUPS 2(FSW) 8(SVR) 18
6/2/2008
54
54
DKU - B4 Numbering
B41-x
B42-x
B43-x
B44-x
B45-x
B46-x
B411-x
B412-x
B413-x
B414-x
B415-x
B416-x
B417-x
B418-x
B47-x
B48-x
B49-x
B410-x
L2 L1 R0 R1 R2
1st DKA Pair2nd DKA Pair3rd DKA Pair4th DKA Pair
5th DKA Pair6th DKA Pair7th DKA Pair8th DKA Pair
See Maintenance Manual page INST03-10A-40 and INST03-14-10.
6/2/2008
55
55
DKU HDD Installation Order
Universal Storage Platform V Universal Storage Platform
HDU
HDU-Box
FSWA-RU
FSWA-RL
FSWA-LU
FSWA-LL
1F 1E 1D 1C 1B 1A 19 18 0F 0E 0D 0C 0B 0A 09 08
17 16 15 14 13 12 11 10 07 06 05 04 03 02 01 00
FSWA-RU
FSWA-RL
FSWA-LU
FSWA-LL
HDD-PL
1F 1E 1D 1C 1B 1A 19 18
17 16 15 14 13 12 11 10
0F 0E 0D 0C 0B 0A 09 08
07 06 05 04 03 02 01 00
Order of HDD
installation
0F 0D 0B 09 07 05 03 01 0F 0D 0B 09 07 05 03 01
0E0C 0A 08 06 04 02 00 0E0C 0A 08 06 04 02 00
HDD-PL
0F 0D 0B 09 07 05 03 01
0E0C 0A 08 06 04 02 00
0F 0D 0B 09 07 05 03 01
0E0C 0A 08 06 04 02 00
FC-ALboundary
FSW-UFSW-L
FSW-UFSW-L
FC-ALboundary
RightHDU
See Maintenance Manual page INST01-200.
6/2/2008
56
56
BED
C
luster 2B
ED
Cluster 1
Switched Loop Back-end Reduces impact during drive failure and/or sparing Improves Performance by reducing disk-to-disk daisy chain latency
FSW Switch
On the previous Universal Storage Platform model, all of the disks attached to a DKA PCB were on eight shared loops. A transfer to the last disk on a loop (could be 32 or 48 disks per loop) would have to pass through bypass logic on all of the disks in front of it. The Universal Storage Platform V introduces a switched back end, where the drives are still on arbitrated loops (all Fibre Channel disks use FC-AL, not FC-SW fabrics), but the switch logic bypasses all targets on that loop except for the one disk being addressed. This reduces the propagation time by some micro-seconds (not noticeable), but the primary effect of this change is improved accessibility to individual disks. Each HDU has four such FSW switches, two on the front side (32 disks) and two more on the back (32 disks).
6/2/2008
57
57
Backend Loops 2Gbit/sec 4Gbit/sec Rules
Disk Adapter supports two kinds of transfer rate settings defined at installation time (4Gbit/sec and 2Gbit/sec).
The setting of transfer rate must be set by the unit of 2 DKA Pairs. HDDs of 2Gbit/sec / 4Gbit/sec can be installed (mixed) in 2 DKA Pairs
that are set to 2Gbit/sec (HDDs will operate at 2Gbit/sec). Only HDDs of 4Gbit/sec type can be installed in 2 DKA Pairs that are set
to 4Gbit/sec. Different transfer rates cannot exist together in the same loop. The HDD-copy (spare and correction copy) between HDDs set by
different transfer rates is not allowed. Off/On of the power supply for HDDs is needed for the switch of
4Gbit/sec / 2Gbit/sec (disruptive change).
6/2/2008
58
58
Parallel Crossbar Switch Architecture
Universal Storage Platform V logical design is similar to Universal Storage Platform
DKA DKA DKA CHA DKA DKA DKA DKA
DKA DKA DKA CHA DKA DKA DKA DKA
CSW CSW CSW CSW
CACHE CMA CACHE CMA
SMA SMA
Channel Interface
FCAL(4Gbps/port)
Cache Path(68GB/s)
SM Path (38.4GB/s)
Max. 48HDD
DKU
BatteryBox Battery
Box
DKC Power Supply
Max. 1,152HDD/subsystem
Disk Path (max.64path)
Input Power
AC-Box AC-Box
AC-DC Power Supply
Input Power
AC-Box AC-Box
AC-DC Power Supply
AC-DC Power Supply
Power Supply
AC-DC Power Supply
BatteryBox Battery
Box
At first glance, it is like the Universal Storage Platform but on a closer look, the details are different:Shared memory bandwidthEffective cache memory bandwidth usageBack-end loop speed and hardware designBattery usage andVery different physical hardware layout in the Logic Box
Main design is like Universal Storage Platform but the differences include:Half sized Logic PCBs, all PCBs are like the shared memory boards on the Universal Storage Platform.The microprocessors (128 of them) have double clock speed compared with the Universal Storage Platform.A more effective (double) use of the 2x cached bandwidth2x speed of backend loops and HDDs to support those speeds
6/2/2008
59
59
Hardware Architecture
CHA CHA
DKA DKA
CSWCSW CSWCSWCSWSMCSW
Logic Box max28
max16
max4max8max8
Connect to Host CPU
FSW PCBS HDDs
HDD Box
Shared Data Path (SHSN)
Main Data Path (CHSN)
Back-end Fiber Pass
Data Path
Data Path
max64max64
Service Processor (SVP)
Maintenance Path (LAN)
Based on R500 architectureEnhanced Hi-StarEnhanced ProcessorEnhanced Back End FCHalf size PCB
CSWCSWCSWCACHECSWCACHECACHECSWCSWCSWCSWCSWCSW
Main design is like Universal Storage Platform, but again, when looked in detail, things are very different.Half sized Logic PCBs, all PCBs are like the shared memory blades on the Universal Storage Platform.Hitachi Data Systems have a microprocessor with double clock speed compared with the Universal Storage Platform.A more effective (double) use of the cached bandwidthDouble speed backend loops and HDDs to support those speeds
In the diagram above, Hi-Star is Hitachi Crossbar Switch Architecture.
6/2/2008
60
60
Microprocessor (MP) clock speed doubled Same amount of MPs in a full system Escon uses the same MP as the Universal Storage Platform Fibre can have 1MP 1Port or 1MP 2Port
Hardware Architecture New Microprocessor
Item USP V USP
Number of CPU (max) 128 128
CPU Core Y-wing H Y-wing
Relative Performance of 1CPU 2 1
USP V = Universal Storage Platform V
6/2/2008
61
61
SVP Specifications
Universal Storage Platform V SVPUniversal Storage Platform SVP
OS Windows XP (SP1 or SP2) Windows XP (SP2)
CPU
Memory
HDD
Intel Celeron 1.2GHz
512MB
80GB 160GB
1GB
FDD
CD Drive CD-ROM Drive None
LAN Ethernet 10Base-T/100Base-TX
6/2/2008
62
62
Summary
The Universal Storage Platform V is an evolution of the Universal Storage Platform architecture with refinements and extensions to existing architecture, functionality, performance, and scalability
Proven 4th generation Hitachi Crossbar Switch Architecture Faster Internal bandwidth = 106GB/sec Increased IOPS/sec = 3.5M Faster Internal Processors = doubled Increased 4Gbit/sec end-to-end (FC Ports, disks, back-end) More Fibre Channel Ports = 224 max 5x external support performance 2x remote replication performance Increased external storage capacity = 247PB
6/2/2008
63
63
Questions/Discussion
6/2/2008
64
64
Module Review
1. Which disk drives does the Universal Storage Platform support? 2. What is the maximum cache capacity in the Universal Storage Platform? 3. What is the maximum number of back-end directors supported by the
Universal Storage Platform? 4. Which of the following components does the disk adapter section of the
Universal Storage Platform contain? A. Front-end director featuresB. Cache switchesC. Shared memoryD. Disk drives
1. 73GB / 15Krpm, 146GB / 10Krpm, 146GB / 15Krpm, 300GB / 10Krpm
Fibre Channel Drives. SATA Drives are not supported2. 128GB of cache with a maximum of 4 cache boards 3. 64 BEDs; 4 BED Features = 8 DKAs x 8 BEDs per DKA4. Disk drives