Symmetrix v-max Maintenance

7/23/2019 Symmetrix v-max Maintenance

1/108

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved. 1

Symmetrix V-Max Maintenance

2009 EMC Corporation. All rights reserved.

Symmetrix V-Max SeriesMaintenance IMPACTSymmetrix V-Max SeriesMaintenance IMPACT

April 2009

Welcome to Symmetrix V-Max Series Maintenance. The AUDIO portion of this course is supplemental to the materialand is not a replacement for the student notes accompanying this course. EMC recommends downloading the StudentResource Guide from the Supporting Materials tab, and reading the notes in their entirety.

Copyright 2009 EMC Corporation. All rights reserved.These materials may not be copied without EMC's written consent.

EMC believes the information in this publication is accurate as of its publication date. The information is subject to changewithout notice.

THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS IS. EMC CORPORATION MAKES NOREPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THISPUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR

A PARTICULAR PURPOSE.

Use, copying, and distribution of any EMC software described in this publication requires an applicable software license.

EMC2, EMC, EMC ControlCenter, AlphaStor, ApplicationXtender, Captiva, Catalog Solution, Celerra, CentraStar,CLARalert, CLARiiON, ClientPak, Connectrix, Co-StandbyServer, Dantz, Direct Matrix Architecture, DiskXtender,DiskXtender 2000, Documentum, EmailXaminer, EmailXtender, EmailXtract, eRoom, FLARE, HighRoad, InputAccel,Navisphere, OpenScale, PowerPath, Rainfinity, RepliStor, ResourcePak, Retrospect, Smarts, SnapShotServer,SnapView/IP, SRDF, Symmetrix, TimeFinder, VisualSAN, VSAM-Assist, WebXtender, where information lives, Xtender,Xtender Solutions are registered trademarks; and EMC Developers Program, EMC OnCourse, EMC Proven, EMC Snap,EMC Storage Administrator, Acartus, Access Logix, ArchiveXtender, Authentic Problems,Automated Resource Manager,

AutoStart, AutoSwap, AVALONidm, C-Clip, Celerra Replicator, Centera, CLARevent, Codebook Correlation Technology,EMC Common Information Model, CopyCross, CopyPoint, DatabaseXtender, Direct Matrix, EDM, E-Lab, Enginuity,FarPoint, Global File Virtualization, Graphic Visualization, InfoMover, Infoscape, Invista, Max Retriever, MediaStor,MirrorView, NetWin, NetWorker, nLayers, OnAlert, Powerlink, PowerSnap, RecoverPoint, RepliCare, SafeLine, SAN

Advisor, SAN Copy, SAN Manager, SDMS, SnapImage, SnapSure, SnapView, StorageScope, SupportMate, SymmAPI,SymmEnabler, Symmetrix DMX, UltraPoint, UltraScale, Viewlets, VisualSRM are trademarks of EMC Corporation.

All other trademarks used herein are the property of their respective owners.


2/108



2009 EMC Corporation. All rights reserved. Course Overview - 2

Course Overview

This course is intended for those involved in the maintenance of Symmetrix V-

Max arrays.Intended Audience

EMC believes the information in this publication is accurate as of its publication date and is based on

PreGA product information. The information is subject to change without notice. For the most currentinformation see the EMC Support Matrix and the product release notes in Powerlink.

This course will present the V-Max array features and enhancements from amaintenance perspective. The focus will be on Field Replaceable Units.

Course Description

This course will present the V-Max Array features and enhancements from a maintenance

perspective. The focus will be on Field Replaceable Units.

This course is intended for those involved in the maintenance of V-Max Symmetrix systems.


3/108




Course Objectives

Upon completion of this course, you should be able to: Differentiate between the Symmetrix V-Max and Symmetrix V-Max SE

systems

Troubleshoot Symmetrix V-Max systems

Replace Field Replaceable Units (FRUs) using SymmWin scripts and

Electrostatic Discharge (ESD) equipment

Upon completion of this course, you should be able to:

Differentiate between the Symmetrix V-Max and Symmetrix V-Max SE systems

Troubleshoot Symmetrix V-Max systems

Replace Field Replaceable Units (FRUs) using SymmWin scripts and ElectrostaticDischarge (ESD) equipment


4/108




Course Topics

Field Replaceable UnitsModule 2:

Architectural OverviewModule 1:

There are two modules in this course that address the following topics:

Architectural Overview

Field Replaceable Units


5/108




List of DemonstrationsElectrostatic DischargeElectrostatic DischargeDemo1:Demo1:

Replace V-Max EngineReplace V-Max EngineDemo

2:Demo2:

Replace Director ModuleReplace Director ModuleDemo

3:Demo

3:

Replace SIB ModuleReplace SIB ModuleDemo

4:Demo4:

Replace Cache Memory ModuleReplace Cache Memory ModuleDemo5:Demo5:

Replace Power Supply ModuleReplace Power Supply ModuleDemo6:Demo6:

Replace Blower ModuleReplace Blower ModuleDemo

7:Demo7:

Replace DriveReplace DriveDemo8:Demo8:

Replace V-Matrix EnclosureReplace V-Matrix EnclosureDemo9:Demo9:

Replace Fabric CableReplace Fabric CableDemo10:Demo10:

Replace I/O Module CarrierReplace I/O Module CarrierDemo

11:Demo

11:

Replace FE I/O ModuleReplace FE I/O ModuleDemo

12:Demo12:

Replace SFP PortReplace SFP PortDemo13:Demo13:

Replace BE I/O ModuleReplace BE I/O ModuleDemo14:Demo14:

Replace Management ModuleReplace Management ModuleDemo

15:Demo15:

This is a list of the demos included with this course.


6/108



2009 EMC Corporation. All rights reserved. Module 1: Architectural Overview - 6

Module 1: Architectural Overview

Upon completion of th is module, you should be able to: Distinguish the Symmetrix V-Max and Symmetrix V-Max SE from each

other based on System Bay component lay-out

Operate switches and interpret light indicators of various Symmetrix V-

Max components

In module 1, we will look at the architectural overview. Upon completion of this module, you

should be able to:

Distinguish the Symmetrix V-Max and Symmetrix V-Max SE from each other based on

System Bay component lay-out Operate switches and interpret light indicators of various Symmetrix V-Max components


7/108




Symmetrix V-Max Series With Enginuity

Higher performance and usable capacity

Over 2X performance of DMX-4

More usable capacity and more efficient cache utilization

More value at better TCO

Leverage the latest drive technologies

Save on energy, footprint, weight, and acquisition cost

Simpler management of virtual & physical environments

Fastest and easiest configuration

Reduce labor and risk of error

Cost and performance-optimized BC capabilit ies

Industrys first zero RPO 2-site long distance replication solution

Accelerate replication tasks and recovery times

Advancing the Worlds Most Trusted Storage Platform

The next few slides will cover Symmetrix V-Max Introduction. Symmetrix V-Max Series with

Enginuity stands out with its higher performance (Over 2X performance of DMX-4) and

usable capacity (more usable capacity and more efficient cache utilization). Total Cost of

Ownership improves as well, by leveraging the latest drive technologies and savings on

energy, footprint, weight, and acquisition cost. The virtual and physical environments of

these systems are easier to manage due to faster and easier configuration options which

translates into a reduction in labor and potential errors. The business continuance

capabilities are optimal (cost and performance) with EMCs offer of the industrys first zero

RPO 2-site long distance replication solution.


8/108




Higher Performance And Usable Capacity

Accelerate OLTP and other Tier 0/1 workloads High performance multi-core CPU processors

Up to twice the IOPS

Twice the front and back end connectivity

Up to 128 front-end ports and 128 back-end ports

Leverage over 2 PB usable capacity (up 3x)

944GB cache (472GB mirrored)

Increased metadata efficiency

Improved performance with TimeFinder/Clone

Streamlined operations and faster replicas

Online Transaction Processes and other Tier 0 or 1 workloads will be accelerated with the

implementation of high performance multi-core CPU processors that perform with up to

twice the IOPS and with twice the front-end and back-end connectivity (up to 128 front-end

and back-end ports) when compared with the DMX-4.

Over 2 PB usable disk capacity is available, as well as 944GB of cache (472GB mirrored)

with increased metadata efficiency.


9/108




Virtual Matrix Architecture: Comparison To DMX

Symmetrix V-Max Engines

Up to 16 CPUs w/8 sli ces each

128 total slices, 256 ports

Up to 128 FE ports

Up to 472GB usable global memory

Over 2PB usable storage capacity

Virtual Matrix Architecture

Separate purpose-built Directors

16 I/O Directors w /4 slices each

64 total slices, 128 ports

Up to 64 FE ports

Up to 256GB usable global memory

Up to 585TB usable storage capacity

Direct Matrix Archi tecture

The Virtual Matrix Architecture uses V-Max Engines, each containing a portion of Global Memory

and two Directors capable of managing hosts, disks, and remote connections simultaneously. As

shown, this architecture allows for scalability in all aspects: Front-end connectivity, Global

Memory, Back-end connectivity, and disk capacity. Global Memory has little meta data overheaddue to improvements found in Enginuity 5874, allowing 2,400 disk devices to be configured with

RAID-1 or other types of RAID.


10/108




Symmetrix V-Max Model Comparison

Two Symmetrix V-Max system variations:

Symmetrix V-Max

Symmetrix V-Max SE

88 - 64GigE/iSCSI Ports

44 - 32SRDF Ports

8

16

128 GB

48 - 360

2

1

Symmetrix V-Max SE

16 - 128Fibre Channel ports

8 - 64FICON Ports

128 1024 GBPhysical Memory

96 - 2400Disks (min/ max)

2 - 16Director Boards

1 - 8V-Max Engines

Symmetrix V-Max

With the introduction of a new line of Symmetrix systems, EMC announces two variations of

the Symmetrix V-Max systems: the Symmetrix V-Max Series with Enginuity models (from

now on: V-Max), and the Symmetrix V-Max SE model (from now on: V-Max SE ).

V-Max arrays contain up to 16 Director boards, 80 to 2,400 disk drives, and either 128 FibreChannel front-end ports, or 64 FICON ports, or 64 GigE/iSCSI ports, or a combination

thereof.

The V-Max SE model always consists of a single V-Max Engine with 2 Director boards.

Depending on the use of the expansion bay, the system contains between 48 and 360 disk

drives, 16 Fibre Channel front-end ports, or 8 FICON ports, or 8 GigE/iSCSI ports.

Note 1: This is the amount of memory that physically can be installed in the system. The

customers usable amount of memory is less due to the systems memory requirements as

well as the mirroring of the memory.


11/108




Symmetrix V-Max Symmetrix V-Max SE

Product Serial Number Tag

The Product Serial Number (PSN) label is no longer the white or yellow label located on the

physical rack. Instead, the Product Serial Number is a tag using an 11 character serial

number with prefixes.

- HK1: Franklin (MA) United States

- CK2: Cork, Ireland

- AP3: Apex (NC) United States

The Symmetrix V-Max has its tag positioned at the front top right of the System Bay. The

Symmetrix V-Max SE has its tag positioned at the front right center of the System Bay

(attached to the bottom and middle rail holes).

Symmetrix V-Max arrays have their prefix followed by 926, i.e. HK1926xxxxx, while

Symmetrix V-Max SE systems continue their prefix with 949, i.e. CK2949xxxxx.


12/108




System Bay Components

FrontView

RearView

Enclosure 3

Enclosure 2

Enclosure 1

UPS

V-Max Engine 4

KVM

Enclosure 7

Enclosure 6

V-Max Engine 5

Enclosure 8

MIBE

Service Processor

Directions

Thisisaninteractivegraphic.

Useyourmousetoexplore

thiscomponent.

The next few slides will cover the Symmetrix V-Max. The important components to focus on

are the Uninterruptible Power Supply (UPS), the Server (Service Processor) with the ,

Keyboard-Video-Mouse (KVM), the Matrix Interface Board Enclosure (MIBE), and the V-Max

Engines which are positioned in Enclosures (up to eight Engines for a Symmetrix V-Max

System Bay).


13/108




Bay Numbering

S 1B 2B 1D 2D 3D3C 2C 1C 2A 1A

Stora

ge

Bay

Stora

ge

Bay

Stora

ge

Bay

Stora

ge

Bay

Stora

ge

Bay

Stora

ge

Bay

Stora

ge

Bay

Syste

m

Bay

Stora

ge

Bay

Stora

ge

Bay

Stora

ge

Bay

S 1B 2B 3B 4B 5B5A 4A 3A 2A 1A

Symmetrix V-Max

Symmetrix DMX-3 and DMX-4

Storage

Bay

Storage

Bay

Storage

Bay

Storage

Bay

Storage

Bay

Storage

Bay

Storage

Bay

Sy

stem

Bay

Storage

Bay

Storage

Bay

Storage

Bay

The numbering of the Storage Bays is different for a Symmetrix V-Max then it is for the DMX

Series. Instead of having all Storage Bays to the left of the System Bay numbered from 1 up

to 5 ending with A (from a front view perspective), and all bays to the right of the System

Bay numbered from 1 up to 5 ending with B, the Symmetrix V-Max uses a different

numbering scheme. This is because, unlike the quadrants used in the DMX-Series, the

Symmetrix V-Max uses octants and therefore has Storage Bays ending with A, B, C, and D

asshown in the graphic.


14/108




1x V-Max Engine

Storage

Bay 1A

Engine 4

Engine

4

Direct

Connect

Engine

4

Daisy

Chain

Storage

Bay 2A

System

Bay

This configuration has only one (1) Engine in the System Bay, which is located in enclosure

#4. The graphic shows a front view.

Drive population is for the lower half of the cabinet of Storage Bay 1A (direct connect) and

2A (daisy chain). This allows for a total of 240 drives in the whole system.


15/108




2x V-Max Engines

Engine 5

Engine

5

Direct

Connect

Engine

5

Daisy

Chain

Storage

Bay 1A

Storage

Bay 2A

System

Bay

Engine 4

Engine

4

Direct

Connect

Engine

4

Daisy

Chain

This configuration has two V-Max Engines in the System Bay, which are located in

enclosures #4 and #5. The graphic shows a front view.

Drive population is for fully populated Storage Bays 1A (direct connect) and 2A (daisy

chain). This allows for a total of 480 drives in the whole system.


16/108




3x V-Max Engines

Engine 5

Engine

5

Direct

Connect

Engine

5

Daisy

Chain

Engine 4

Engine

4

Direct

Connect

Engine

4

Daisy

Chain

Storage Bay

2A

Engine

3

Direct

Connect

Engine

3

Daisy

Chain

Storage Bay

1A

Storage Bay

1B

Storage Bay

2B

System

Bay

Engine 3

This configuration has three V-Max Engines in the System Bay, which are located in

enclosures #3, #4, and #5. The graphic shows a front view. Drive population is for fully

populated Storage Bays 1A and 1B (both direct connect), as well as 2A and 2B (both daisy



17/108




4x V-Max Engines

Engine 5

Engine

5

Direct

Connect

Engine

5

Daisy

Chain

Engine 6

Engine 4

Engine

4

Direct

Connect

Engine

4

Daisy

Chain

Storage Bay

2A

Engine

3

Direct

Connect

Engine

3

Daisy

Chain

Engine

6

Daisy

Chain

Engine

6

Direct

Connect

Storage Bay

1A

Storage Bay

1B

Storage Bay

2B

System

Bay

Engine 3

This configuration has four V-Max Engines in the System Bay, which are located in

enclosures #3, #4, #5, and #6. The graphic shows a front view. Drive population is for fully

populated Storage Bays 1A and 1B (both direct connect), as well as 2A and 2B (both daisy



18/108




5x V-Max Engines

System

Bay

Storage

Bay 2B

Storage

Bay 1B

Storage

Bay 1A

Storage

Bay 2A

Storage

Bay 1C

Storage

Bay 2C

Storage

Bay 3C

Engine 4

Engine 3

Engine 2

Engine 5

Engine 6

Engine

4

Direct

Connect

Engine

5

Direct

Connect

Engine

3

Direct

Connect

Engine

6

Direct

Connect

Engine

3

Daisy

Chain

Engine

6

Daisy

Chain

Engine

4

Daisy

Chain

Engine

5

Daisy

Chain

Engine

2

Direct

Connect

Engine

2

Daisy

Chain

Engine

2

Daisy

Chain

This configuration has five V-Max Engines in the System Bay, which are located in

enclosures #2, #3, #4, #5, and #6. The graphic shows a front view. Drive population is for

fully populated Storage Bays 1A and 1B (both direct connect), half-filled Storage Bays 1C

(direct connect), and half-filled Storage Bays 2C and 3C (daisy chain), as well as fully

populated Storage Bays 2A and 2B (daisy chain). This allows for a total of 1,320 drives in

the whole system.


19/108




6x V-Max Engines

Engine

4

Direct

Connect

Engine

5

Direct

Connect

Engine

3

Direct

Connect

Engine

6

Direct

Connect

Engine

3

Daisy

Chain

Engine

6

Daisy

Chain

Engine

4

Daisy

Chain

Engine

5

Daisy

Chain

Engine

2

Direct

Connect

Engine

2

Daisy

Chain

Engine

2

Daisy

Chain

Engine

7

Direct

Connect

Engine

7

Daisy

Chain

Engine

7

Daisy

Chain

System

Bay

Storage

Bay 2B

Storage

Bay 1B

Storage

Bay 1A

Storage

Bay 2A

Storage

Bay 1C

Storage

Bay 2C

Storage

Bay 3C

Engine 7

Engine 4

Engine 3

Engine 2

Engine 5

Engine 6

This configuration has six V-Max Engines in the System Bay, which are located in

enclosures #2, #3, #4, #5, #6, and #7. The graphic shows a front view. Drive population is

for fully populated Storage Bays 1A, 1B, and 1C (both direct connect), as well as fully

populated Storage Bays 2A, 2B, 2C, and 3C (daisy chain). This allows for a total of 1,680

drives in the whole system.


20/108




7x V-Max Engines

Engine

6

Direct

Connect

Engine

6

Daisy

Chain

Engine

4

Direct

Connect

Engine

5

Direct

Connect

Engine

4

Daisy

Chain

Engine

5

Daisy

Chain

Engine

2

Direct

Connect

Engine

2

Daisy

Chain

Engine

2

Daisy

Chain

Engine

7

Direct

Connect

Engine

7

Daisy

Chain

Engine

7

Daisy

Chain

Engine

3

Direct

Connect

Engine

3

Daisy

Chain

Engine

1

Direct

Connect

Engine

1

Daisy

Chain

Engine

1

Daisy

Chain

System BayStorage

Bay

2B

Storage

Bay

1B

Storage

Bay

1A

Storage

Bay

2A

Storage

Bay

1C

Storage

Bay

2C

Storage

Bay

3C

Storage

Bay

2D

Storage

Bay

1D

Storage

Bay

3D

Engine

1

Engine

7

Engine

4

Engine

3

Engine

2

Engine

5

Engine

6

This configuration has seven V-Max Engines in the System Bay, which are located in the

enclosures numbered 1 through 7. The graphic shows a front view. Drive population is for

fully populated Storage Bays 1A-2A, 1C-3C, 1B-2B, and half-filled bays 1D-3D. This allows

for a total of 2,040 drives in the whole system.


21/108




8x V-Max Engines

Engine

8

Direct

Connect

Engine

8

Daisy

Chain

Engine

8

Daisy

Chain

Engine

8

System BayStorage

Bay

2B

Storage

Bay

1B

Storage

Bay

1A

Storage

Bay

2A

Storage

Bay

1C

Storage

Bay

2C

Storage

Bay

3C

Storage

Bay

2D

Storage

Bay

1D

Storage

Bay

3D

Engine

4

Direct

Connect

Engine

5

Direct

Connect

Engine

4

Daisy

Chain

Engine

5

Daisy

Chain

Engine

2

Direct

Connect

Engine

2

Daisy

Chain

Engine

2

Daisy

Chain

Engine

7

Direct

Connect

Engine

7

Daisy

Chain

Engine

7

Daisy

Chain

Engine

3

Direct

Connect

Engine

3

Daisy

Chain

Engine

1

Direct

Connect

Engine

1

Daisy

Chain

Engine

1

Daisy

Chain

Engine

6

Direct

Connect

Engine

6

Daisy

Chain

Engine

1

Engine

7

Engine

4

Engine

3

Engine

2

Engine

5

Engine

6

This configuration has eight V-Max Engines in the System Bay, which are numbered from 1

through 8. The graphic shows a front view.

Drive population is for fully populated Storage Bays 1A-2A, 1C-3C, 1B-2B, and 1D-3D. This

allows for a total of 2,400 drives in the whole system.


22/108




System Bay Components: V-Max SE Front View

Drive Enclosure 8

Drive Enclosure 7

Drive Enclosure 6

Drive Enclosure 4Drive Enclosure 3

Drive Enclosure 2

Drive Enclosure 1

Drive Enclosure 5

SPS

SPS

V-Max Engine 4

SPS

ServerUPS

MIBE

KVM

Directions



thiscomponent.

The next slides will cover the Symmetrix V-Max SE. The Symmetrix V-Max SE arrays

consists of the following components: 8 Drive Enclosures, 1 V-Max Engine, 3 Standby

Power Supply (SPS) trays, 1 Uninterruptible Power Supply (UPS), a Server (Service

Processor), with Keyboard-Video-Mouse (KVM) assembly, and 1 Matrix Interface Board

Enclosure (MIBE) tray.


23/108




System Bay Components: V-Max SE Rear View

In the Symmetrix V-Max and Symmetrix V-Max SE System Bays, an enclosure points out

the location where a V-Max Engine can be positioned, in the same way as in a DMX-4 a

Director or Memory board is positioned in a slot.

The combined hardware of drives, management modules, directors, power supplies, andblowers is therefore called a V-Max Engine, not an enclosure.


24/108




V-Max SE Configurations

Expansion

Bay

Engine 4

Direct

connect

Drive

Enclosures

System

Bay

SingleBay

DualBay

System

Bay

Direct

connect

Drive

Enclosures

Direct

connect

Drive

Enclosures

Direct

connect

Drive

Enclosures

Daisy

chained

Drive

Enclosures

Engine 4

A Symmetrix V-Max SE is a SINGLE bay system with only one (1) enclosure which is

always occupied with V-Max Engine #4. Eight Drive Enclosures are located in the cabinet

using only direct connect and WITHOUT the addition of a storage bay, and therefore without

daisy chained Drive Enclosures. This allows for a total of up to 120 drives in the system.

A Symmetrix V-Max SE DUAL-bay system is also configured with only one (1) V-Max

Engine (#4) in the System Bay. All eight direct connect Drive Enclosures are located in the

System Bay, whereas an expansion bay is added to increase storage capacity. This allows

for a total of up to 360 drives in the system (240 in the expansion bay and 120 in the System

Bay). From a front view perspective, the expansion bay is always placed to the left of the

System Bay.


25/108




13 14 15 16

9 10

11

12

5 6 7 8

1 2 3 4

S

PS4B

SPS4A

SPS3B

SPS3A

SPS2B

SPS2A

SPS1B

SPS1A

Storage Bay Layout

FrontView

RearView

Directions



thiscomponent.

The next few slides will cover the Storage Bay of the Symmetrix V-Max arrays. V-Max array

Storage Bays are similar to the Storage Bays of the DMX Series.

What is different though is the cabling with unique labels.

A Storage Bay consists of either eight or sixteen Drive Enclosures, contain 48 to 240 drives,

and eight (8) SPS modules.

The drive enclosures are numbered 1 to 16 as in this graphic. They are daisy-chained up,

for example drive enclosure #1 is daisy-chained to drive enclosure #5 while drive enclosure

#9 is daisy-chained to drive enclosure #13.


26/108




Drive Enclosure LCC: Rear View

PRIandEXP

ports

LCC-A/LCC-B

4Gb/s

LoopID

Enclos

ureID

RJ-11

Link Control Card A, referred to as LCC-A, connects to the odd Director of a V-Max Engine,

while LCC-B connects to the even Director of that same V-Max Engine.

The Drive Enclosure has a RJ-11 type connector for a cable that is connected to the SPS

modules for monitoring purposes. That way, the LCC can communicate with the SPSthrough the cable that connects them.

Commands and read status are send from the SPS modules that supplies power for the

Drive Enclosure , using the RJ-11 RX/TX differential data lines, to the director.

Per 4 Drive Enclosures there is 1 SPS tray. That means a total of 8 LCC boards and 2 SPS

units. To monitor the SPS modules, only 2 LCCs are needed.

Six grey-colored RJ-11 cables are therefore missing and those LCCs do not monitor any

SPS, yet depend on the two LCC ports with the grey cables, one for SPS/Zone A and one

for SPS/Zone B, to do all the communication. Both the LCC primary (PRI) ports that

connect directly to the back-end (DA) ports, and the expansion (EXP) ports, that daisy chainDrive Enclosures, are High Speed Serial Data Connectors (HSSDC).


27/108


28/108


29/108




Drive Enclosure

Supports 4Gb FC only

Dual switched loop

configuration provides

redundancy, improved

isolation of faults, port

bypass capability

Utilizes same DMX

chassis, power supply,

and cooling modules

Drives, LCCs, Power

Supplies, and blower

modules are fully

redundant within Drive

Enclosure, and hot

swappable

Drive Enclosure Rear

Drive Enclosure Front

Symmetrix V-Max arrays are configured with capacities of up to 120 disk drives for a half

populated bay or 240 disk drives for a full populated bay.

Each Drive Enclosure includes the following components:

- Redundant power and cooling modules for disk drives

- Two Link Control Cards (LCCs)

- 5 to 15 disk drives


30/108




Drive Support

4 Gb/s FC (15K) 146GB, 300GB, and 450GB

4 Gb/s FC (10K)

400GB

4 Gb/s SATA (7.2K)

1 TB (not for System i)

4 Gb/s Enterprise Flash (EFD)

200GB, 400GB

All Drives are formatted at 520 byte sectors

Except drives used for System i which are formatted at 528

No 2Gb/s drives are supported (4Gb drive only)

Drive

Each disk has a green and amber LED. The green LED will light intermittently to indicate

disk activity, while the amber LED is used to mark the drive and may be turned on manually

or by a replacement script. Note that SATA drives (7.2 krpm) are in reality 3Gb/s adapted to

4Gb/s Fibre Channel.

Drives that are introduced with the Symmetrix V-Max models have dual colored emblem

labels. This differentiates them from DMX-Series drives.


31/108




Power Distribution Panel (PDP)

Provides interface to customer utility power

(AC)

Single-phase or three-phase power

depending on Symmetrix V-Max model and

country

3-Phase 4-wire Delta

3-Phase 5-wire Wye

Single-phase for SE System Bay only

2 AC power drops per cabinet (one per AC

power zone)

Provides central On/Off switch for cabinet

power

On/off switch accessible through cabinet rear

door

Two Power Distribution Panels (PDPs), one for each zone, provide a centralized cabinet

interface and distribution control of the AC power input lines to the Storage Bay PDUs. The

Power Distribution Panels contain the manual AC power On/Off control switches, which are

accessible through the rear door. Power Distribution Panels are available for single phase

and 3-phase depending on the type and geographical location of the V-Max array.


32/108




Standby Power Supply (SPS)

On-line1. SPS B

2. SPS A

3. AC Out

4. AC In5. On/Off Switch

6. RS-232 monitor

1 24 43 3

5 6

On-Battery

Replace Battery

Internal Check

The green LED of the Standby Power Supply (SPS) indicates On-line Enabled if the LED is

steady ON, and indicates On-line and Charging if the LED is flashing. Please keep in mind

that replacing a SPS requires the use of the lift tool as these components are heavy (29 kg

or 65 lbs).

One SPS tray is required for each four Drive Enclosures and contains 2 SPS units with a

total of up to eight SPS units to support up to 16 Drive Enclosures in the Storage Bay. If AC

power fails to both Zone A and Zone B, the SPS assemblies can maintain power for two 5-

minute periods to allow the system to vault. Only then does the Symmetrix system shut

down.


33/108




V-Max Engine

Base configuration is one

Symmetrix V-Max Engine

Maximum configuration is 8 V-Max

Engines per system

V-Max Engines are connected via

Virtual Matrix to aggregate and

share system resources

The next couple of slides will cover the Virtual Matrix Engine. Depending on the type of V-

Max array, a minimum of one single V-Max Engine, the base configuration, and up to eight

V-Max Engines can be configured in the system.


34/108




V-Max SE Engine Components: Front

A B C D

Power

Supply

Power

Supply

Blower Blower Blower Blower

A B

Power On Enclosure fault

V-Max Engines are positioned in specific slots called Enclosures. An example is being given

here of the single V-Max Engine in a Symmetrix V-Max SE system, showing details of the

front view with two (2) power supplies on the side and four (4) blowers, otherwise known as

fans, positioned in the middle.


35/108




V-Max Engine Components: Rear

PS

BE

MM

SIB

FE

Power Supply

Backend I/O Module

Management Module

System Interface Board

Front-end I/O Module

BE

BE

SIB

SIB

FE

PS

MM

PS

MM

FE FE FE

BE

BE

Even DIR

Odd DIR

Even DIR Odd DIR

PS

MM

PS

MM

Besides a still picture of a V-Max Engine, two important lay-outs of the V-Max Engine are

shown.

The first lay-out shows the names of the components and their physical locations. These are

the Power Supplies, Backend I/O Modules, Management Modules, System InterfaceBoards, and Front-end I/O Modules.

The second lay-out shows the locations of the odd and even directors within a V-Max

Engine, including their respective Front-end I/O Module assignments.


36/108




V-Max Engine Port Layout

A0 B1 C0 D1

E0 F1 G0 H1E0 F1 G0 H1

A0 B1 C0 D1PS-APS-B

MM-B MM-A

SIB-B SIB-A

SIB-B SIB-A

Mod 0 Mod 1 Mod 2 and 3

Mod 0 Mod 1 Mod 2 and 3

Mod 4 Mod 5 Mod 4 Mod 5Storage

Bay

Host

A

Host

B

Host

C

Here shown are the port assignments for the backend I/O modules (which use QSFP type

connectors), the front-end I/O modules, and the SIB modules.

This illustration is of a Front-end I/O module with 4 ports per module. Keep in mind that this

configuration and the port assignments are only valid for a fibre channel I/O module. Theseare different for FICON and GigE front-end I/O modules.


37/108




EvenDir

EvenDir

Cable Labels: Back-end I/O Modules

OddDir

OddDir

From: Even I/O Mod 0

To: DAE 1,5,2,6 LCC-B

From: Even I/O Mod 1

To: DAE 3,7,4,8 LCC-B

From: Odd I/O Mod-0

To: DAE 1,5,2,6 LCC-A

From: Odd I/O Mod-1

To: DAE 3,7,4,8 LCC-A

All cables have both From and To labeling showing all information needed to cable up a

system or to trace a cable in the event troubleshooting is necessary.

The graphics and text show the labels of the cables that run between the Back-end I/O

Modules and Direct Connect Drive Enclosures (here depicted as DAE) on the larger V-Maxsystems with one or multiple V-Max Engines. The smaller V-Max SE systems have their

Odd and Even Mod 0 (zero) or 1 connected to either Drive Enclosures 1,2,3,4 or Drive

Enclosures 5,6,7,8.


38/108




System Bay V-Max Engine Upgrade Sequence

1 + 217

3 + 425

5 + 633

7 + 841

5

6

7

8

V-Max EnginePopulationOrder

Directors

8 15 + 16

6 13 + 14

4 11 + 12

2 9 + 10

Enclosure/Engine 3

Enclosure/Engine 2

Enclosure/Engine 1

Enclosure/Engine 4

Enclosure/Engine 7

Enclosure/Engine 6

Enclosure/Engine 5

Enclosure/Engine 8

Enclosures are populated from the inside out, starting with enclosure #4 which holds V-Max

Engine #4 and consists of Directors 7 and 8. Director numbers are derived from the V-Max

Engine number. Dual-Initiator pairs are contained within the same V-Max Engines, while

Memory is mirrored across V-Max Engines.


39/108



2009 EMC Corporation. All rights reserved. Module 1: Architectural Overview - 39- 39

Cable and V-Max Engine Color Coding

Enclosure 8Dir 16

Dir 15

Enclosure 4Dir 8

Dir 7

Enclosure 5Dir 10

Dir 9

Enclosure 1Dir 2

Dir 1

Enclosure 2Dir 4

Dir 3

Enclosure 6Dir 12

Dir 11

Enclosure 7Dir 14

Dir 13

Enclosure 3Dir 6

Dir 5

White

Red

Blue

Green

Yellow

Orange

Purple

Pink

Module 1: Architectural Overview

Specific colors are used to indicate the V-Max Engines. This is very useful in order to

retrace the cables, which have colored sheathes in the same color scheme as the labels on

the cable guides. The Symmetrix V-Max uses octants (one of eight segments) based on the

number of V-Max Engines that can be placed in the System Bay. (Note: This is different in

the DMX-Series where the system is sub-divided into quadrants, and where each back-end

director pair connects to the lower or upper half of the Storage Bays, positioned either left

(A-side) or right (B-side) from the System Bay). The colors for the various octants are as

follows:

- Enclosure 1 (Dir 1 and Dir 2): Pink

- Enclosure 2 (Dir 3 and Dir 4): Purple

- Enclosure 3 (Dir 5 and Dir 6): Orange

- Enclosure 4 (Dir 7 and Dir 8): Yellow

- Enclosure 5 (Dir 9 and Dir 10): Green

- Enclosure 6 (Dir 11 and Dir 12): Blue

- Enclosure 7 (Dir 13 and Dir 14): Red

- Enclosure 8 (Dir 15 and Dir 16): White


40/108




Front-end Labels And Cabling

1. Even Director I/O Mod 4

2. Even Director I/O Mod 5

3. Odd Director I/O Mod 4

4. Odd Director I/O Mod 5

12

3

4

3

The hardware guides for the four (4) front-end I/O Modules are part of the V-Max Engine kits

which are usually found in the empty SPS frame for that particular V-Max Engine. The black

inserts and the blue clip-on parts need to be manually installed. This includes putting the

labels on the blue covers for which there are specific locations, see the numbered items on

this graphic. The picture insert shows a front-end segment (black plastic) without the blue

cover attached to it.


41/108




Director Layout

Backend

0 1 2 3X X

!

= Power good (On)

= Fault or Boot sequence

Rack#

V-Max Engine#

ABBackend

= Module number

!!!!

The next few slides will cover the Directors. The orange LED indicates either a Fault status

or the directors Boot (POST) sequence, as can be seen on power up and during director

replacements. Each Director consists of two Backend I/O modules, one System Interface

Board (SIB), and eight memory slots. The front-end connections for a director are found on

separate Front-end I/O modules. These are either Fibre Channel, iSCSI (or used as GigE),

FICON, or a combination thereof.


42/108




Director Board Memory Modules

1. Shroud

2. Shroud label

3. Cache Memory Module

4. Latch

5. Key alignment slot

6. DIMM alignment notch

0

73

4

5

6

2

6

2 1

The Global Memory for the Symmetrix V-Max systems consists of multiple physically local

memory modules pooled together. Unlike the Symmetrix DMX Series and other legacy

systems, there are no dedicated memory boards or dedicated enclosures for Global Memory

in the Symmetrix V-Max systems. Each director has eight cache memory module slots.

Every cache slot contains a module (DIMM=Dual Inline Memory Module) that has the part

number (e.g. 022-000-119) engraved in the metal shield surrounding the memory module.

The serial number label is attached to the top of the modules shield and is asked for during

cache memory module replacements.


43/108




Memory Rules

Memory is located on each director consisting of eight 2GB, 4GB, or 8GBCache Memory Modules which must all have equal capacities

Maximum physical memory V-Max Engine capacity is 32GB, 64GB, or 128GB

Single (1) enclosure systems have memory mirrored within the same

enclosure (intra-V-Max Engine)

Multiple (2-8) enclosure systems have memory mirrored across

enclosures (inter-V-Max Engine)

Memory is mirrored between V-Max Engines from an odd to an even director

Memory cannot be downgraded on existing installations

Mixed memory sizes are allowed as long as at least two V-Max Engines

have the same amount of memory

There are two important rules which must be observed in order to avoid wasting memory.

Rule number 1 states that the Director boards within the same V-Max Engine must have the

same amount of memory. Rule number 2 enforces that there are at least two V-Max Engines

with the same amount of memory.

In order to accomplish a memory upgrade, both rules must be temporarily broken, as only

one board is physically swapped out at a time. Once all the necessary boards have been

physically changed, the Global Memory can be expanded to include the additional capacity.

At this point, the system will once again adhere to both rules. Upgrades are made per

Director, not per one individual Cache Memory Module. When a new configuration is loaded

on a Symmetrix V-Max array, the actual physical memory of each director is learned.

Symmwin then re-calculates the director memory pairing and saves this into the

configuration file (IMPL.bin). When new V-Max Engines are added to an existing

configuration, the Symmwin upgrade script recalculates the memory pairing and establishes

the new mirroring pairs as needed.

The maximum physical raw V-Max Engine memory capacity when using 2GB Cache

Memory Modules is 32 GB, using 4GB Cache Memory Modules the maximum is 64 GB, and

for 8GB Cache Memory Modules the total capacity is 128GB.


44/108




Memory Upgrade And Replacement

Scenario #1: Memory Upgrade Configured Director boards with Cache Memory Modules are shipped out

from Manufacturing

No exchange of Cache Memory Module from the old to the new board

Scenario #2: Director board failure

The replacement part is a bare Director board

Cache Memory Modules that are on the bad director boards will need to

be moved to the good director board

Scenario #3: Cache Memory Module failure

The replacement part is another Cache Memory Module.

Use Procedure Wizard to replace the Cache Memory Module.

Requires removal of the director.

Whether Cache Memory Modules need to be transferred to a new Director board depends

on the activity, that is: the module that needs to be exchanged. Three scenarios are given

here:

- Scenario #1: Memory Upgrade. Since the Director boards are shipped with CacheMemory Modules, there is no need to exchange any of the Cache Memory Modules from the

old Director board to the new Director board.

- Scenario #2: Director board failure. To keep the number of spare parts to a minimum, the

replacement Director contains no Cache Memory Modules. Those still properly working

Cache Memory Modules on the old director boards will need to be moved to the new director

board.

- Scenario #3: Cache Memory Module failure. Although this activity requires the removal of

the director, the replacement part is simply one single Cache Memory Module.


45/108




Back-end I/O Module

Provides Fibre Channel Connectivity to Disk Drives

Four Back-end Fibre channel cables are aggregated into one single QSFPconnector

QSFP = Quad Small Form-Factor Pluggable

QSFP Connector I/O Module

The next few slides will cover the I/O modules. Each Director within a V-Max Engine

contains two (2) back-end I/O modules. There is only one port on the back-end I/O module,

which holds a single Quad Small Form-Factor Pluggable (QSFP) connector. Quad

because this SFP connection has physically 4 smaller fibre channel cables aggregated into

one cable. On the other end of the connection, four (4) separate cables are routed to

different Drive Enclosures, providing Fibre Channel connectivity to Disk Drives.


46/108




I/O Module Carrier

With or without hardware Compression Offload Engine Supports 2 front-end I/O Modules

Independent N+1 cooling for carrier and two I/O Modules

Remote and reset control of I/O Modules

Fault and Power Good indicators

I/O Module Carrier

The I/O Module Carrier holds two (2) front-end I/O modules. It provides connection between

the director to an Open Systems or Mainframe host through these front-end I/O modules.

I/O Module Carriers are available with or without the hardware Compression Offload Engine.


47/108




Front-end I/O Modules

E0 E1 F0 F1

Module 4

G0 G1 H0 H1

Module 5

E0 F0

Module 4

G0 H0

Module 5

E0 E1

Module 4

G0G1

Module 5

Provides front-end Fibre Channel

connectivity to Open Systems hosts or SRDF

4 Individual SFP ports @ 2 or 4 Gb/s

Provides front-end iSCSI connectivity to

Open Systems hosts or SRDF

2 Individual SFP ports @ 1 Gb/s

Provides FICON connectivity to

Mainframe hosts

2 SFP ports @ 2 or 4 Gb/s

Fibre Channel I/O Module

iSCSI/GigE I/O Module

FICON I/O Module

There are two (2) Front-end I/O Modules directly attached to a V-Max Engines Director,

these are module 4 and module 5.

Fibre Channel Front-end I/O modules support the interface to a front-end host or switch

connection. A Fibre Channel Front-end I/O module supports 4 Fibre ports per module, witheach of the ports operating at 2Gb/s or 4Gb/s. The lower speed is indicated by a green light,

while the higher speed is indicated by the blue light.

iSCSI/GigE Front-end I/O modules support the interface to a front-end iSCSI host or the

SRDF (GigE) connection to another Symmetrix V-Max system. An iSCSI/GigE Front-end I/O

module supports two (2) ports, while each individual port is able to operate at 1.25 Gb/s

(only). (Note 1: SFP port = Small Form-Factor Pluggable port.)

FICON Front-end I/O modules support the interface to a front-end host or switch connection.

A FICON Front-end I/O module supports 2 FICON ports per module, with each of the ports

operating at 2Gb/s or 4Gb/s.


48/108




Virtual Matrix Architecture

The next few slides will cover the Virtual Matrix interface. This graphic shows director-to-

director communication over the systems virtual matrix.

A system can include up to 16 directors in a Symmetrix V-Max array with eight V-Max

Engines. Each of the two MIBEs found in a single V-Max Engine contain 16 ports.

Therefore, the dual redundant MIBEs connect a total of 32 ports, enabling director-to-

director communications. Whether directors store data in Global Memory that ends up on

their own physical memory module banks, or store data on physical memory modules that is

placed on other Directors, the data send to Global Memory always passes through one of

these MIBEs.


49/108




Single Director Components and Ports

SIB

Global Memory

A B C D E F G H

A B

Back-end I/O Module Front-end I/O Module

ure A MIBE B

Storage Bay Hosts

MIBE A

The MIBE is what binds the directors and their respective memory together. Using the SIB

ports A and B connections, all directors communicate though the MIBE. Note that the slice

lay-out chosen in this graphic is only valid for Fibre Channel only configurations since 4 ports

are shown for the Front-end I/O Module.


50/108




MIBE

Dir 7Dir 5Dir 3Dir 1Dir 15Dir 13Dir 11Dir 9

Port 15Port 13Port 11Port 9Port 7Port 5Port 3Port 1

Port 14Port 12Port 10Port 8Port 6Port 4Port 2Port 0

Dir 8Dir 6Dir 4Dir 2Dir 16Dir 14Dir 12Dir 10

Power Supply (4x)

Dir

Port

V-Max Engine

Director number

MIBE

Port number

Each director contains one (1) System Interface Board (SIB) that connects to one (1) port of

each MIBE to provide complete failover capabilities should one of the MIBEs require

maintenance. System Interface Board connectivity through the MIBEs allows for the

directors of all V-Max Engines to communicate with each other.

The order in which the MIBE ports are populated runs from the outside to the inside of the

MIBE enclosure in the same order V-Max Engines are added to the System Bay (that is 1st

Director 7+8, then Dir 9+10, then Dir 5+6, etc.).

The question could arise why a MIBE is needed in a Symmetrix V-Max SE array considering

there is always only one (1) V-Max Engine with two (2) Directors that are both already

connected to the same V-Max Engine midplane. The answer is found in the statement that,

as with the Symmetrix V-Max arrays, the Symmetrix V-Max SE also ALWAYS sends out

data to its cache memory modules using the MIBE, even in the event that the memory

resides on the same Director board that received the I/O from the host.


51/108




System Interface Board (SIB)

Rack#

Enclosure #

To MIBE

The System Interface Board (SIB) provides fabric connectivity between a Director and two

(2) MIBEs.

Besides the two (2) ports on the right-hand side of the graphic, two (2) hex displays are

found on the left-hand side. The first display shows the Rack number. This is the EnclosureID of the System Bay and therefore always 0 (zero). The second display shows the

Enclosure number, which is different from the Enclosure ID. This number is used to identify

in which Enclosure slot a V-Max Engine is positioned in, ranging from 1 to 8 in a Symmetrix

V-Max array, and always found to be 4 in a Symmetrix V-Max SE system since thats the

only V-Max Engine installed.


52/108




MIBE Labels: V-Max Engine 4

Odd

Dir

OddDir

E

venDir

EvenDir

From: Dir 7 Port A

To: MIBE A - Port 14

From: Dir 7 Port B

To: MIBE B - Port 14

From: Dir 8 - Port A

To: MIBE A - Port 15

From: Dir 8 Port B

To: MIBE B - Port 15

The graphics and text show the labels of the cables that run between the System Interface

Boards of the Directors within a V-Max Engine to their respective MIBEs.

Labels will be different for any V-Max Engine other than the V-Max Engine 4 as shown here.

For instance, V-Max Engine 5 will show on its label Dir 9 and Dir 10 which are connected toPort 0 and Port 1 respectively on the MIBEs.


53/108




Management

Module locations

within a V-Max

Engine

Management Module

5

47

6

3

1 2

8

MM-B

PS-B

MM-A

PS-ABackend

Backend

Backend

Backend

SIB Port A + B

SIB Port A + B

Rearview

1. Fault

2. Power good

3. USB port (Service light)

4. Management LAN port

5. Peer Service LAN port

6. Server UPS

7. SPS

8. NMI button

The next slides will cover the Management Module. Within each V-Max Engine, two

management modules monitor and control the environment the V-Max Engine operates in.

There is a similarity in the way the management modules monitor Symmetrix V-Max arrays,

as do XCM boards in DMX Series systems. Three of the management modules activities

are: (1) Monitor the SPS units, (2) Reset the UPS if required, and (3) Communicate with

other V-Max Engines positioned in the same system. Communication to several hardware

components is provided through Ethernet. The Ethernet port as indicated by the number 4

could either be: (1) directly connected to the Service Processor, or (2) connected to another

V-Max Engine. The Management Module is directly connected to the Service Processor

should it be positioned in either the highest or the lowest V-Max Engine number in the

system. Note that when performing a V-Max Engine upgrade (adding a V-Max Engine), the

Ethernet cables needs to be moved accordingly. V-Max Engines are always daisy-chained

to their abutting V-Max Engines, positioned above and below. The management module

provides connectivity to the Service Processor, between V-Max Engines, a Server

connectivity for reset purposes, USB connectivity for the System Bay door light, and RS-232connectivity to the server SPS.


54/108




Light Panel Cabling: System Bay

The light panel cables of the V-Max array System Bay door are connected to the

Management Module USB ports of V-Max Engine number 4. For the Storage Bay, the cable

assembly is connected to the 2nd AC slot in the top PDU on both the left and right side of

the cabinet.

When replacing the light panel assembly, do remember that the labeled cable always goes

into the right side connector. The light panel cable assembly attaches to the two connectors

on the light panel and is secured to the front door of the system bay or storage bay by a

series of tie wraps. The cable assembly is fed through a clip at the top of the bay. For the

system bay, one cable is threaded down through the right side of the system and connected

to the right side management module USB port. The left cable runs along the top

management cable trough down the left side of the system and connected to the USB port

of the left side management module. The light panel cable assembly is replaced from the

front of the System Bay or Storage Bay to the rear of the bay.


55/108




Uninterruptible Power Supply (UPS)

2

3

5

64

1. Battery compartment

2. AC MAIN present

3. On battery

4. Power On/Off

5. AC AUX present

6. Replace battery

1

The next slides will cover the UPS and Server. The system feeds from an Uninterruptible

Power Supply (UPS) to keep the server up and running in the event of an AC power failure.

The UPS contains four status LEDs. Two green LEDs, AC MAIN input present, and ACAUX input present are lit during normal UPS operation. An amber LED (On battery) is lit

when the UPS is operating on battery power. A red LED (Replace battery) is lit if the battery is

detected to be low in capacity or in an out of specification condition.


56/108




Server Front

1. Power On

2. Hard disk activity

3. LAN 1 activity

4. LAN 2 activity

1 2 3 4

The Server acts as the Service Processor that runs the SymmWin and other utilities, e.g.

SMC and call home. The Uninterruptible Power Supply (UPS) will keep the Server, KVM,

and optional modem up and running in the event of an AC power failure. Preference over

the implementation of the ESRS Gateway has made modem setups 2nd choice.


57/108




Server Rear

61

2

1. KVM - Mouse

2. KVM - Keyboard

3. KVM Monitor

4. USB ports

5. Ethernet: CS-Spare

6. Ethernet: Highest V-Max Engine # Purple cable

7. Ethernet: Lowest Engine # Green cable

8. Ethernet: Customer networkBlue cable

KVM

5

43

7 8

Highest Engine #MM-B

Lowest Engine #MM-A

The Symmetrix V-Max server comes with a KVM (Keyboard/Video/Mouse) attached to it. In

the event any of the KVM components fail, any regular VGA display, mouse, or keyboard can

be attached. The integrated keyboard does not need to be detached when a USB keyboard is

attached. They can work simultaneously, which could prove beneficial when the tracker ball ofthe KVM keyboard is still in operation.

Clearly indicated are the connections for the green and purple Ethernet cables that are

attached to the Management Modules of the lowest and highest V-Max Engines as discussed

earlier in the Management Module section.

The V-Max Engine arrays have a blue Ethernet cable attached to the port indicated by

number 8. Use this port for ESRS implementation, not the CS-Spare port.


58/108



2009 EMC Corporation. All rights reserved. Module 2: Field Replaceable Units (FRU) - 58

Module 2: Field Replaceable Units (FRU)

Upon completion of this module, you should be able to:

Identify all Field Replaceable Units (FRUs) including:

Resolve issues during replacement.

MIBE

Fabric Cable

I/O Module Carrier

I/O Module

SFP

Back End I/O Module

Management Module

V-Max Engine

Director

SIB

Cache Memory Module

V-Max Engine Power Supply

Blower Module

Drive

As seen in Module 1 the disk bay components are the same as DMX-3 and DMX-4 when

running replacement scripts.

This module will discuss and demonstrate the components and replacement scripts that arenew to Symmetrix V-Max arrays.

Upon completion of this module, students should be able to:

1. Identify all Field Replaceable Units (FRUs), and

2. Resolve issues during replacement.


59/108




Hardware Failures: System Bay

Visually inspect components for amber failure lights.

V-Max Engines

Drive Enclosure (DE)

Power Components

MIBE

Uninterruptible Power Supply (UPS)

Run HealthCheck Script.

Any failures reported need to be addressed before box can be placed online to customer.

V-Max Engine Front View

Power Supply A Fault LED Power Supply B Fault LEDBlower Fault LEDs V-Max Engine Fault LED

Hardware components in the System Bay such as Power Supplies, Blowers, and SPS

modules have LEDs that show their current condition. Be sure to visually inspect all

components for fault LED indicators and run the Health Check script before running

replacement scripts.


60/108




Hardware Failures: Storage Bay

Visually inspect components for amber failure lights

Drives

DEs

LCCs

Power Components

Run HealthCheck Script

Any failures reported need to be addressed before box can be placed online to customer

Enclosure Fault(Amber LED)

Drive Fault

(Amber LED)

.

.

Drive Enclosure Front View

Hardware components in the Storage Bay such as drives, Link Control Cards, Power

Supplies and SPS modules must be in working order for proper installation.

Be sure to visually inspect all components for fault LED indicators and run the Health Check

script before running replacement scripts.


61/108




Electrostatic Discharge (ESD)

Electrostatic Discharge is the sudden

transfer of electrons from one

body/object to another.

When handling or replacing FRUs, an

Anti-Static Strap must be worn to

prevent ESD.

ESD weakens components and

failures may or may not be apparent

immediately. Failure could occur at a

later time, during normal operations.

Proper precautions must be taken at

all times to prevent damage to the

components.

Use of Anti-static Strap

Use the ESD kit when handling directors, cache memory modules, and I/O modules. If an

emergency arises and an ESD kit is unavailable, follow the procedures under Procedures

without an ESD kit in the maintenance manual.


62/108




DEMO: Electrostatic Discharge (ESD)

This demonstration will

show how to avoid ESD

damage to the sensitive

parts of the Symmetrix

V-Max system hardware

components.

Web Object Placeholder

Address:https://education.emc.com/main/vod_gs/Hard

ware/Symm/FRU/q109/NGS_ESD.html

Displayed in: Ar ticulate Player

Window size:482 X 392

This demonstration will show how to avoid ESD damage to the sensitive parts of the

Symmetrix V-Max system hardware components.


63/108




BE I/O Module 0,1

A0, A1, B0, B1 C0, C1, D0, D1

SIB Module 2 and 3

E0, E1, F0, F1 G0, G1, H0, H1

FE I/O Module 4 and 5

Port B and Port A

V-Max Engine (Even Director)

All V-Max Engines contain two physical director boards with two Back-end I/O Modules that

are identified as Modules 0 and 1, a System Interface Board identified as Modules 2 and

3, and up to 8 logical directors (referred to as slices) identified as A through H.

V-Max Engines contain two I/O Module Carriers, where each I/O Module Carrier containstwo Front-end I/O Modules. Each I/O Module Carrier is an extension to either the odd or

even Director. The even Director is highlighted here with the associated Front-end I/O

Modules 4 and 5. The graphic reveals that both modules 4 are used for Fibre Channel,

while both modules 5 are used for FICON.


64/108




DEMO: Replace V-Max Engine


show the installation

procedure for the

upgrade of a 2nd V-Max

Engine.

The same video can be

used for the

replacement o f a V-Max

Engine.



ware/Symm/FRU/q109/NGS_engine_upgrade.html



This demonstration will show the installation procedure for the upgrade of a second V-Max

Engine.

The same video can be used for the replacement of a V-Max Engine.


65/108




Director (Odd Director)

FE I/O Module

FE I/O Module SIB

BE I/O Module

BE I/O Module

CPU Board

Cache Memory Modules

DirectorI/O Module Carrier

FE I/O Module

FE I/O Module SIB

BE I/O Module

BE I/O Module

CPU Board



When replacing a Director board, the script will warn that the associated Front-end or SRDF

Director will go offline, and that the customer must be notified that I/O activity through these

directors will be interrupted during the replacement process. You should interpret this to the

customer as: I/O activity through these Directors will be interrupted during the replacementprocess unless hosts have EMC PowerPath or suitable failover software configured and

active. If the director slice is an active SRDF link extra precaution must be taken.

Example: Warning! Directors 16e,16f,16g, 16h will soon go unavailable. Please insure

customer has alternate I/O paths. I/O should be suspended on the ports to these directors.


66/108




Director

To replace a Director, select SymmWin Procedure Wizard, followed by FRU Replacement

Tools, then select Enclosure Slot component replacements, and choose Replace Single

director board. Continue the script and it will either identify the failing Director or ask you to

select a director from a list as shown here.


67/108




Director (With BE I/O Module and SIB)

In this example, Director 7 is clearly highlighted in purple in the script diagram and text. When

replacing a director, the original I/O Modules and Cache Memory Modules need to be

removed and re-installed via the script. Since the Director board is heavy on the end opposite

of where the ports are located, careful removal of the Director board is required, not allowingthe board to tip when sliding it out.


68/108




DEMO: Replace Director Module


show the replacement

procedure for a

Director.



ware/Symm/FRU/q109/NGS_rplc_dir.html



This demonstration will show the replacement procedure for a Director.


69/108




SIB (System Interface Board)

FE I/O Module

FE I/O Module SIB

BE I/O Module

BE I/O Module

CPU Board



FE I/O Module

FE I/O Module SIB

BE I/O Module

BE I/O Module

CPU Board



The System Interface board (SIB) provides connectivity between the Director and MIBEs

referred to as Virtual Matrix A and Virtual Matrix B. The SIB contains Quad Small Form-

factor Pluggable (QSFP) cable connections and two hex displays for the Rack and Enclosure

numbers. The LED will illuminate green if power is good and yellow if there is a fault andservice is required.

The QSFP LED is normally off. Yellow indicates a loss of signal or the port is marked for

replacement. The script will warn that logical Directors e, f, g, and h will soon become

unavailable. Please make sure that the customer has alternate I/O paths available since I/O

will be suspended on the ports to the director.


70/108




SIB (System Interface Board) (Continued)

To replace a System Interface Board (SIB), select SymmWin Procedure Wizard, then FRU

Replacement Tools, then Enclosure Slot component replacements, followed by Replace

SIB.

Continue the script and it will identify the failing SIB or ask you to select the failing SIB

location. In this example, Director 7 in V-Max Engine 4 was selected.


71/108




DEMO: Replace SIB Module



procedure for t he SIB.



ware/Symm/FRU/q109/NGS_rplc_sib.html



This demonstration will show the replacement procedure for the SIB.


72/108




Cache Memory Module

FE I/O Module

FE I/O ModuleSIB

BE I/O Module

BE I/O Module

CPU Board



FE I/O Module

FE I/O Module SIB

BE I/O Module

BE I/O Module

CPU Board



The customer should be notified that the associated Front-end Director will go offline during

the Cache Memory Module replacement process.

I/O activity could be halted unless hosts have EMC PowerPath or suitable failover softwareactive.


73/108




Cache Memory Module (Continued)

To replace a Cache Memory Module, select SymmWin Procedure Wizard, then FRU

Replacement Tools, then Enclosure Slot component replacements, followed by Replace

memory (DIMMs). The script will automatically detect the failing Cache Memory Module and

you will be able to select it from the Cache Memory Module list.

If the script can not find a failed cache memory module, the user can select the director and

cache memory module from a list as shown in the graphic on the top right-hand side. In this

example, DIMM 3 on Director 7 of Enclosure Slot 4 was selected. Director 7 is clearly

highlighted in the diagram and text as shown in the graphic on the top left-hand side. This

specific script asks for the customer to be notified that Directors 7E, 7F, and 7G will be taken

offline and to stop I/O activity to these Directors. This means that the customer should have

EMC PowerPath or suitable failover software active. Note that since logical Director 7G is

configured as FiCON, logical Director 7H is configured as Link CPU and not part of the listed

directors for which failover paths were requested.

The Marker LED comes on and asks for the removal of the cables from I/O Module 0, I/O

Module 1, SIB port B, and SIB Port A. Follow the directions as per script in the bottom

graphic, removing the director board as indicated.


74/108





Follow ESD Guidelines

The script asks to follow proper ESD guidelines to avoid static discharge damage to the

hardware. In this example, Cache Memory Module 3 is clearly shown in the diagram and

highlighted in text. The script message reads: IMPORTANT, verify the serial numbers of the

Cache Memory Modules you are removing and replacing!. That serial number label is foundon the top of the Cache Memory Module shield.


75/108





Cache

MemoryModules

Cache Memory

Module shroud

Eight Cache Memory Modules are positioned in their slots on a Director. You must use the

ESD kit when handling directors, including taking out directors for the purpose of replacing

one or more cache memory modules. As can be seen in this slide, memory is accessible after

removing the shroud. Removal of the shroud is done by pressing on all four (4) corners.


76/108





The script requests to slide the Director only halfway into the V-Max Engine after all Director

board modules have been re-installed. Follow the directions on the left side of the screen. At

this point all cables should have been re-connected. Once completed, the board is to be fully

inserted. Click OK and continue following the script until successful completion.


77/108




DEMO: Replace Cache Memory Module



procedure for the

Cache Memory Module.

Web Object Pl

Documents

Symmetrix v-max Maintenance