Upload
mahesh-gulbarga
View
683
Download
10
Tags:
Embed Size (px)
Citation preview
Storage Center™
CT-SC040 and SC8000
Connectivity Guide
Storage Center CT-SC040 and SC8000 Connectivity GuideDocument Number: 680-027-013
Notes, Cautions, and Warnings
Copyright Notice and Trademarks© 2012 Dell Inc.
Trademarks used in this text: Dell™, the Dell logo, and Compellent™ are trademarks of Dell Inc.
Contacting Dell Technical Support ServicesFor technical support, go to support.dell.com/compellent/.
FCC Radio Frequency Interference StatementThis equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense.
Revision Date Description
A December 2012 Initial release of software-version-independent publication.
Note: Indicates important information that helps you complete a procedure.
Caution: Indicates either potential damage to hardware or loss of data and tells you how to avoid the problem.
Warning: Indicates that failure to follow directions could result in property damage, personal injury, or death.
Dell Compellent iii
Contents
1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1Safety Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Electrostatic Discharge (ESD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Weight . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Electrical . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Environmental . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Storage Center Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Controller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5Front End . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6Back End . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6System Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2 Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7SC8000 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
LCD Panel Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
NIC Indicator Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10IO Card Slot Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11Seating IO Cards Properly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
CT-SC040 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13CT-SC040 Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
CT-SC040 Communication Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15IO Card Slot Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
SC200/220 Enclosure Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18SC200/220 Enclosure Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19Enclosure Management Module (EMM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21SAS Enclosure Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21SAS Enclosure Rear View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22Storage Bridge Bay (SBB) Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23SAS 6 Gb and 3 Gb IO Module Comparison . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25SBOD IO Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
iv Storage Center CT-SC040 and SC8000 Connectivity Guide
Contents
SBOD Port ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27Enclosure Speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28SATA Service Control Modules (SCMs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29SATA Enclosure ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30Disk Drive Speeds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30SAS Disk Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31SBOD and SATA Disk Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32Enterprise Plus Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33Standard SAS Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Removing Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35Installing Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4 Back End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37Direct-Connect IPC for Dual-Controller, Single Chain Configurations . . . . . . . . . . . . . . . . . . . . 38SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
5 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94Server HBA Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95Best Practices for Fibre Channel Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
WWN Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96Port Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
System Manager WWN Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97Multipath IO (MPIO) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98SC8000 Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Ethernet Management and iDRAC Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98Single-Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103Fibre Channel Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105iSCSI Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108iSCSI Failover Example (Legacy Mode) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
Dell Compellent v
Contents
CT-SC040 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113Ethernet Management Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113Dual Controller Ethernet Management Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114Single Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115Single Controller, Multiple Servers, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119Fibre Channel (Virtual Ports) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120Fibre Channel Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121iSCSI Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
6 Adding or Removing an Enclosure . . . . . . . . . . . . . . . . . . . . . . . 129Using Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
View Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130Configure Local Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
Adding SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131Creating a New Chain of SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132Adding to an Existing SAS Enclosure Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134Adding a Second SAS Enclosure, Second Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
Removing SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141Release Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141Removing a SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
Adding EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146Creating a New Chain for SAS 12- or 24-Drive Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . 146Adding to an Existing SAS Enclosure Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148Adding a Second SAS Enclosure, Second Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Removing EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155Release Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155Removing a SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Adding SBOD or SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160Before you Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160Adding an SBOD or SATA Enclosure to a New Loop . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160Adding an SBOD or SATA Enclosure to an Existing Loop . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160Connect Back-end Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
vi Storage Center CT-SC040 and SC8000 Connectivity Guide
Contents
Dell Compellent vii
List of Figures
Figure 1. Dell Compellent Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4Figure 2. SC8000 Controller Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5Figure 3. SC8000 Front View — Features and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7Figure 4. LCD Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9Figure 5. SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9Figure 6. NIC Indicator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10Figure 7. IO Card Guide Slots . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12Figure 8. CT-SC040 Front View — Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13Figure 9. CT-SC040 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14Figure 10. CT-SC040 Communication Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15Figure 11. SC200/220 Enclosures Front View — Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . 18Figure 12. SC200/220 Enclosure Back View — Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . 19Figure 13. IO Module Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20Figure 14. SAS Enclosures Front View — Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21Figure 15. SAS Enclosure Rear View — Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22Figure 16. IO Module Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23Figure 17. Rear View of an SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25Figure 18. SBOD Ports (4 Gb IO Card) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26Figure 19. Enclosure ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27Figure 20. Rear View of a SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28Figure 21. SATA SCM Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29Figure 22. Enclosure ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29Figure 23. SAS Disk Numbering, 12-Disk Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31Figure 24. SATA/SBOD Disk Numbering (Front View) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32Figure 25. Enterprise Plus Drive Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33Figure 26. Standard SAS Drive Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Figure 27. Removing a Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35Figure 28. Installing a Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36Figure 29. Single SC8000 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39Figure 30. Single SC8000 Controller, Single SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40Figure 31. Single SC8000 Controller, Four SAS Enclosures, Two IO Cards, Two Chains . . . . . . . . . . 41Figure 32. Dual SC8000 Controllers, One Enclosure, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42Figure 33. Dual SC8000 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43Figure 34. Dual SC8000 Controllers, Four Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . 44Figure 35. Dual SC8000 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . 46Figure 36. Single CT-SC040 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47Figure 37. Single CT-SC040 Controller, Single SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48Figure 38. Single CT-SC040 Controller, Four SAS Enclosures, Two IO Cards, Two Chains . . . . . . . . 49Figure 39. Dual CT-SC040 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . 50Figure 40. Dual CT-SC040 Controllers, Four Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . 51Figure 41. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . 53
viii Storage Center CT-SC040 and SC8000 Connectivity Guide
List of Figures
Figure 42. Single SC8000 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55Figure 43. Single SC8000 Controller, Single 6 Gb Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56Figure 44. Single SC8000 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains . . . . . . . . . . 57Figure 45. Dual SC8000 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58Figure 46. Dual SC8000 Controllers, Two Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . 59Figure 47. Dual SC8000 Controllers, Four Enclosures, One IO Card, One Chain . . . . . . . . . . . . . . . . . 60Figure 48. Dual SC8000 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . 62Figure 49. Single CT-SC040 Controller, Single 6 Gb Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63Figure 50. Single CT-SC040 Controller, Single 6 Gb Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64Figure 51. Single CT-SC040 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains . . . . . . . . 65Figure 52. Dual CT-SC040 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . 66Figure 53. Dual CT-SC040 Controllers, Two Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . 67Figure 54. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . 69Figure 55. Single SC8000 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71Figure 56. Single SC8000 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72Figure 57. Single SC8000 Controller, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73Figure 58. Dual SC8000 Controllers, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74Figure 59. Dual SC8000 Controllers, Multiple Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75Figure 60. Single CT-SC040 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76Figure 61. Single CT-SC040 Controller, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . 77Figure 62. Dual CT-SC040 Controllers, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78Figure 63. Dual CT-SC040 Controllers, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . 79Figure 64. Dual CT-SC040 Controllers, Multiple Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80Figure 65. Single SC8000 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81Figure 66. Single SC8000 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82Figure 67. Single SC8000 Controller, Two SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83Figure 68. Single SC8000 Controller, Five SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84Figure 69. Two SC8000 Controllers, Four SATA Enclosures, Single Loop . . . . . . . . . . . . . . . . . . . . . . 85Figure 70. Two SC8000 Controllers, Seven SATA Enclosures, Two Loops . . . . . . . . . . . . . . . . . . . . . 87Figure 71. Single CT-SC040 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88Figure 72. Single CT-SC040 Controller, Two SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89Figure 73. Single CT-SC040 Controller, Five SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90Figure 74. Two CT-SC040 Controllers, Four SATA Enclosures, Single Loop . . . . . . . . . . . . . . . . . . . . 91Figure 75. Two CT-SC040 Controllers, Seven SATA Enclosures, Two Loops . . . . . . . . . . . . . . . . . . . 92Figure 76. Dual-Controller FC Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95Figure 77. Port WWNs in Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97Figure 78. Single Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98Figure 79. Dual-Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99Figure 80. Single Controller, Single Server, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100Figure 81. Single Controller, Multiple Servers, Fibre Channel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101Figure 82. Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102Figure 83. Front-End Legacy Mode FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103Figure 84. Front-End Virtual Ports FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104Figure 85. FC Failover, Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106Figure 86. FC Failover, Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107Figure 87. iSCSI Failover in Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110Figure 88. iSCSI Failover with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112Figure 89. Single Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113Figure 90. Dual Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114Figure 91. Single Controller, Single Server, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115Figure 92. Single Controller, Single iSCSI Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115Figure 93. Single Controller, Multiple Servers, iSCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116Figure 94. Single Controller, Multiple Servers, Fibre Channel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117Figure 95. Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
Dell Compellent ix
List of Figures
Figure 96. Front-End Legacy FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119Figure 97. Front-End FC with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120Figure 98. FC Failover, Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122Figure 99. FC Failover, Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123Figure 100. iSCSI MPIO in Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125Figure 101. iSCSI Failover with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127Figure 102. List of Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130Figure 103. Configure Local Ports Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131Figure 104. Connecting a New SC200/220 SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133Figure 105. Connect SC200/220 Enclosures to A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135Figure 106. Reconnect SC200/220 A-side Cables to Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136Figure 107. Connect SC200/220 Enclosures to B Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137Figure 108. Reconnect SC200/220 B-side Cables to Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138Figure 109. Adding an SC200/220 SAS Enclosure, Step 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139Figure 110. Adding an SC200/220 SAS Enclosure, B side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140Figure 111. Disconnecting the SC200/220 Enclosure from the A side . . . . . . . . . . . . . . . . . . . . . . . . . . 142Figure 112. Reconnecting the SC200/220 A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143Figure 113. Disconnecting the SC200/220 Enclosure from the B-side Chain . . . . . . . . . . . . . . . . . . . . 144Figure 114. Top SC200/220 Enclosure Disconnected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145Figure 115. Connecting a New SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147Figure 116. Connect Enclosures to A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149Figure 117. Reconnect A-side Cables to Controllers A and B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150Figure 118. Connect Enclosures to B Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151Figure 119. Reconnect B-side Cables to Controllers A and B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152Figure 120. Adding a SAS Enclosure, Step 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153Figure 121. Adding a SAS Enclosure, B side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154Figure 122. Disconnecting the Enclosure from the A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156Figure 123. Reconnecting the A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157Figure 124. Disconnecting the Enclosure from the B-side Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158Figure 125. Top Enclosure Disconnected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159Figure 126. Licensed Features Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161Figure 127. 4 Gb and 2 Gb Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162Figure 128. SBOD and SATA IO Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163Figure 129. Connect Controller A to New Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164Figure 130. Connect Enclosure 1 to Enclosure 2 (B side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165Figure 131. Connect Controller A to Enclosure 2 (A side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166Figure 132. Connect Enclosure 1 to Enclosure 2 (A side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
x Storage Center CT-SC040 and SC8000 Connectivity Guide
List of Figures
Dell Compellent 1
1 Introduction
This chapter includes general hardware safety information to protect the installation and basic system information to help understand concepts throughout the manual.
ContentsSafety Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Storage Center Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Chapter 1 Introduction
2 Storage Center CT-SC040 and SC8000 Connectivity Guide
Safety Considerations
If equipment described in the document is used in a manner not specified by Dell Compellent, the protection provided by the equipment may be impaired. For your safety and protection, observe the following rules:
Electrostatic Discharge (ESD)• Observe all conventional ESD precautions when handling plug-in modules and components.
• Use a suitable ESD wrist or ankle strap.
• Avoid contact with backplane components and module connectors.
Weight• An enclosure can weigh up to 26 kg (57 lb). Do not lift it without assistance.
• Do not lift an enclosure by the handles of the Power Cooling Modules (PCMs). They are not designed to hold the weight of the entire enclosure, and the enclosure cover may become bent.
• Before moving an enclosure, remove the PCMs to minimize weight.
Electrical• Provide a suitable power source with electrical overload protection. All components in the Storage
Center must be grounded before applying power. Make sure there is a safe electrical earth connection to power supply cords. Check the grounding before applying power.
• The plugs on the power supply cords are used as the main disconnect device. Make sure that the socket outlets are located near the equipment and are easily accessible.
• Do not remove covers from the Power Control Module (PCM). Disconnect the power connection before removing a PCM from the enclosure.
• Do not remove a faulty PCM unless you have a replacement model of the correct type ready for insertion. A faulty PCM must be replaced with a fully operational module within 24 hours.
• Permanently unplug the enclosure before you move it or if you think it has become damaged in any way. When powered by multiple AC sources, disconnect all supply power for complete isolation.
Environmental• In order to comply with applicable safety, emission, and thermal requirements, do not remove bay covers
from enclosures. Make sure that all bays are populated with plug-in modules.
• Do not remove bay covers or drives until ready to replace them.
Note: See the safety and regulatory information that shipped with each Storage Center component. Warranty information may be included within this document or as a separate document.
Storage Center Hardware Components
Dell Compellent 3
Storage Center Hardware ComponentsA Dell Compellent Storage Center consists of one or two controllers, switches, and one or more enclosures.
ControllerThe Storage Center controller provides the central processing capability for the Storage Center. A Storage Center can be configured with a single controller (single-controller Storage Center) or a pair of controllers (dual-controller Storage Center). Figure 1 on page 4 shows the Storage Center controllers supported by this manual. The supported controllers are:
• CT-SC040
• SC8000
The controller functional specifications are given below. Controllers are described in more detail in Chapter 2 on page 7.
IO cards are located inside the controller and provide communication between the server and the storage enclosures. IO cards are described in more detail in Chapter 2 on page 7.
In a dual-controller Storage Center configuration, the pair of controllers must be the same controller model. For example, a pair of SC8000 controllers. A dual-controller Storage Center does not support mixed controller models.
SC8000 CT-SC040
Processor 2.56 GHz Dual 6 core 2.53 GHz Quad-Core
Bus Speed 1333 MHz 1333 MHz
System Cache 16 GB (expandable to 64 GB)
6 GB(expandable to 12 GB)
Cache Card 512 MB, PCIe (Slot 7) 512 MB, PCIe (Slot 7)
Expansion Slots Gen 3 PCIe:Three full height,Three low profile
Six PCIe, 2.5 GHz
Transport SpeedsFibre ChannelFCoESASiSCSI
8 Gb10 Gb3 Gba, 6 Gb1 Gb, 10 Gb
a. For SC8000 migrations only: 3 Gb SAS enclosures are supported using a 6 Gb IO Card.
4 Gb, 8 Gb10 Gb3 Gb, 6 Gb1 Gb, 10 Gb
Maximum Front-End (FC) Ports 14(Using two 4-port IO cards plus three 2-port IO cards)
20(Using five 4-port IO cards)
Maximum Back-End Ports 12 (Using three 4-port IO cards)
20 (Using five 4-port IO cards)
Maximum Back-End SAS Chains Supported 6 10
Maximum 6 Gb SAS Drives 168 drives/chain = 1008 168 drives/chain = 1680
Maximum 3 Gba. SAS Drives 48 drives/chain = 288 48 drives/chain = 480
Form Factor 2U 3U
Power Supplies 2 2
Fans 6 5
Chapter 1 Introduction
4 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 1. Dell Compellent Controllers
SwitchesDell Compellent offers Fibre Channel (FC) switches and IO cards as part of the total Storage Center product package. Switches provide robust connectivity to servers, allowing for the use of multiple controllers and redundant transport paths. Cabling between the controller IO cards and switches (and servers) is referred to as front-end connectivity.
CT-SC040 Controller
SC8000 Controller
Communication Links
Dell Compellent 5
EnclosuresEnclosures house and control disks that provide storage. The enclosures are connected directly to controller IO cards, and is referred to as back-end connectivity.
• New Storage Centers contain 2U-size Serial Attached SCSI (SAS) enclosures.
• Fibre Channel Switched Bunch of Disks (SBOD) and Serial Advanced Technology Attachment (SATA) enclosures are supported for existing Storage Centers and for controller migrations only (for example, upgrading an existing Storage Center by migrating from a CT-SC040 controller to an SC8000 controller).
Enclosures and connectivity requirements are described in more detail in Chapter 3: Enclosures, on page 17.
Communication LinksA Storage Center controller uses multiple types of communication links for both data transfer and administrative functions.
Figure 2. SC8000 Controller Communication Links
Ethernet 10 Mb,100 Mb, 1 Gb
Serial, 115,200 Kbps
Controller
SAS Enclosure*
3 Gb/6 Gb per channel
Fibre Channel over Ethernet (FCoE) Server, 10 Gb iSCSI, oriSCSI Server, 1 Gb Ethernet
Ethernet SwitchesFibre Channel Switches
Fibre Channel Server, 8 Gb
* FC Enclosures are supported in CT-SC040 controllers and for SC8000 controller migrations. New systems contain 6 Gb SAS Enclosures.
Chapter 1 Introduction
6 Storage Center CT-SC040 and SC8000 Connectivity Guide
Front EndFront-End connectivity provides connections from servers to controllers using either Ethernet (iSCSI) or Fibre Channel switches. Front-End connectivity also supports all replication traffic. See page 3 for specific transport speeds.
• iSCSI connections provide reads and writes from a server to a controller through an Ethernet switch.
• Fibre Channel Over Ethernet (FCoE) uses the FCoE protocol for data on the front end for lossless transmission of data.
• Fibre Channel (FC) connections on the front end are used to provide reads and writes from a server to a controller.
Back EndBack-end connectivity is strictly between the controllers and enclosures. The following protocols are supported to communicate with the enclosures. See page 3 for specific transport speeds.
• Fibre Channel connections on the back end provide reads and writes to the enclosures for CT-SC040 controllers. Fibre Channel IO cards can be migrated from CT-SC040 controllers to SC8000 controllers.
• SAS uses a point-to-point switched topology on four lanes. Each lane can perform concurrent IO transactions at 6 Gb/sec. (Transfer speeds for earlier versions are 3 Gb/sec.)
System AdministrationThe following connections are used for communicating with computers outside of Storage Center:
• Serial: Used for initial configuration and other service-related tasks.
• Ethernet: The Ethernet ports on the back of the controller can operate at 10 Mb or 1 Gb (the SC8000 has four ports and the CT-SC040 has two ports). These ports are not used for server or enclosure connectivity, but instead are used internally for:
• ETH 0 port: configuration, administration, and management of a Storage Center.
• ETH 1 port: Inter-Process Communications (IPC) between controllers.
• iDRAC: For SC8000 controllers, a dedicated 1 Gb Ethernet port provides access to the Integrated Dell Remote Access Controller (iDRAC) for integrated peer controller management.
Dell Compellent 7
2 Controllers
This chapter describes Dell Compellent Controllers including ports, card slots, and buttons and indicators.
ContentsSC8000 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
CT-SC040 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
CT-SC040 Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
SC8000 Controller Front ViewThe front panel of the controller contains power and reset switches, and an LCD panel that shows system ID, status, and error information.
Figure 3. SC8000 Front View — Features and Indicators
Warning: Turning off system power with the power switch removes the main power but keeps standby power supplied to the Storage Center.
21 4 65
7 8 9
3
Chapter 2 Controllers
8 Storage Center CT-SC040 and SC8000 Connectivity Guide
Item Name Icon Description
1 Power indicator, power button The power indicator is illuminated when the system power is on. The power button controls the power supply output to the controller.
2 NMI button The non-maskable interrupt button is used to troubleshoot software and device driver errors. For the SC8000, this button is disabled in the BIOS.
3 System identification button Used to locate a particular system within a rack. When a System ID button on the front or back panel is pressed, the front LCD panel and the back system status indicator flash until one of the buttons is pressed again.
• Press to toggle the system ID on and off.
• If the system stops responding during POST, press and hold the system ID button for more than five seconds to enter BIOS progress mode.
4 Video connector Allows you to connect a VGA display to the system.
5 LCD menu buttons Allows you to navigate the control panel LCD menu (see page 9 for more information).
6 LCD panel Displays system ID, status information, and system error messages.
• The LCD lights blue during normal system operation.
• The LCD lights amber when the system needs attention, and displays an error code followed by descriptive text.
Note: If the system is connected to a power source and an error is detected, the LCD lights amber regardless of whether the system is turned on or off.
7 vFlash media card slot Not used for the SC8000.
8 USB connectors (2) Allows you to connect USB devices to the system. The ports are USB 2.0 compliant.
9 EST panel A slide-out panel for system information including the Express Service tag, embedded NIC MAC address, and iDRAC7 Enterprise card MAC address.
SC8000 Controller Back View
Dell Compellent 9
LCD Panel FeaturesThe system's LCD panel provides system information, status, and error messages to signify when the system is operating correctly or when the system needs attention.
The LCD backlight lights blue during normal operating conditions and lights amber to indicate an error condition. When the system is in standby mode, the LCD backlight is off and can be turned on by pressing either the Select, Left or Right button on the LCD panel. The LCD backlight will remain off if LCD messaging is turned off through the iDRAC utility, the LCD panel, or other tools.
Figure 4. LCD Panel
SC8000 Controller Back ViewThe SC8000 back view is shown in the following figure.
Figure 5. SC8000 Controller Back View
Button Description
Left Moves the cursor back in one-step increments.
Select Selects the menu item highlighted by the cursor.
Right Moves the cursor forward in one-step increments. During message scrolling:
• Press once to increase scrolling speed.
• Press again to stop.
• Press again to return to default scrolling speed.
• Press again to repeat the cycle.
Item Control/Feature Description
Slots 1–3 Low profile IO card slots Ports are numbered beginning with port 1 on the left.
Slots 4–6 Standard profile IO card slots
Ports are numbered beginning with port 1 on the right.
Slot 7 Standard profile cart slot Cache card (CHA3) is always located in this slot.
SelectLeft Right
3
43 5 76 8
12341 2
1 20IPC MGMT
9
12
1234
21
Chapter 2 Controllers
10 Storage Center CT-SC040 and SC8000 Connectivity Guide
NIC Indicator CodesThe following figure shows the indicators on the embedded Ethernet connectors.
Figure 6. NIC Indicator
1 System identification button
Used to locate a particular controller within a rack. When a System ID button on the front or back panel is pressed, the front LCD panel and the back system status indicator flash until one of the buttons is pressed again.
• Press to toggle the system ID on and off.
• If the controller stops responding during POST, press and hold the system ID button for more than five seconds to enter BIOS progress mode.
2 System identification connector
Connects the optional system status indicator assembly through the optional cable management arm.
3 iDRAC Connects to the Ethernet switch in the rack.
4 Serial port Connects to the Comtrol Ethernet server by means of serial interface.
5 Video connector Connects a monitor to the controller.
6 USB connectors Connect USB devices to the controller. The ports are USB 2.0 compliant.
7 Internal Ethernet connectors
Connect the controller to the Ethernet switch and to the other controller in the rack. The ports function as follows:
• Port 1: ETH 1—10GbE capable, configured for 1GbE. Used for inter-processor communication (IPC) between controllers in a dual-controller system.
• Port 0: ETH 0—1GbE. Management port connects to Ethernet switch for system login, email, alerts, SNMP traps, phone home data, and access for software.
Note: Ports 2 and 3 are not used.
8 Power Supply 1 Hot-swappable, 750 W AC 100-240 V AC, auto-ranging, 50/60 Hz
9 Power Supply 2
Feature Indicator Code
Link indicator • Off: The NIC is not connected to the network.
• Green: The NIC is connected to a valid network at its maximum port speed (1 Gbps or 10 Gbps).
• Amber: The NIC is connected to a valid network at less than its maximum port speed.
Activity indicator • Blinking: Indicates transmit/receive activity
• Steady: Indicates valid network connection
Item Control/Feature Description
Activity indicatorLink indicator
SC8000 Controller Back View
Dell Compellent 11
IO Card Slot PriorityPopulate the slots as follows, making sure that the cards are seated properly as shown in Figure 7:
• Install low-profile IO cards in slots 3 through 1. After filling these slots, low-profile cards may be installed in slots 4, 5, and 6 when used with the adaptive bracket.
• Install full-height IO cards beginning in slot 6, followed by slot 5, then slot 4 if needed.
• Slot 7 is reserved for the Cache Card.
* These IO cards cannot be ordered for SC8000 controllers. An SC8000 controller can contain these IO cards only if they were transferred to the SC8000 controller during an upgrade from a CT-SC030 or CT-SC040 controller.
Note: All low-profile IO cards are shipped with an adaptive full-height bracket that must be installed to use the IO card in a slot designed for a full-height IO card.
Type
Card
Height
Speed (Gb)
Number of Ports
Card Priority
Slot Priority
iSCSI Chelsio S320E-LP-CR Low profile 10 2 10 3, 2, 1, 4, 5
iSCSI Chelsio S320E-CR* Full height 10 2 9 4, 5, 6
iSCSI QLogic QLE4062 Low profile 1 2 7 3, 2, 1, 4, 5
SAS LSI SAS9201-16E Full height 6 4 2 6, 5, 4
Fibre Channel Emulex LPe12004-M8* Full height 8 4 9 4, 5, 6
Fibre Channel Emulex LPe12002-M8* Low profile 8 2 5 3, 2, 1, 4, 5
Fibre Channel QLogic QLE2662 Low profile 16 2 3 3, 2, 1, 4, 5, 6
Fibre Channel QLogic QLE2562 Low profile 8 2 4 3, 2, 1, 4, 5, 6
Fibre Channel QLogic QLE2564 Full height 8 4 8 4, 5, 6
FCoE Qlogic QLE8152(with or without an SFP+ transceiver)
Low profile 10 2 6 3, 2, 1, 4, 5
Cache card Dell CHA3 Full height n/a n/a 1 7
Chapter 2 Controllers
12 Storage Center CT-SC040 and SC8000 Connectivity Guide
Seating IO Cards Properly
Figure 7. IO Card Guide Slots
Caution: When installing cards in the SC8000 controller slots, make sure they are fully seated in the guide slots. Cards that are not in full contact with the connector cause unpredictable failures in the Storage Center.
CT-SC040 Controller Front View
Dell Compellent 13
CT-SC040 Controller Front ViewIndicators on the front of the controller provide information about the controller status. The power and reset switches are also located on the front panel.
Figure 8. CT-SC040 Front View — Controls and Indicators
Warning: Turning off system power with the power switch removes the main power but keeps standby power supplied to the Storage Center.
Item Control/Feature Description
1 Power supply failure Illuminated: One of the redundant power supplies has failed.
2 Overheat and/or fan failure • Flashing light: Fan failure
• Steady light: Overheated condition
3 ETH 0 Flashing light: Network activity on Ethernet Port 0 (Management port)
4 ETH 1 Flashing light: Network activity on Ethernet Port 1 (IPC)
5 Disk activity Illuminated: Activity on the bootable Flash Card IO channel
6 AC power Illuminated: AC power is being supplied to the power supplies
7 Reset button Resets the controller
8 Power button Applies or turns off controller power.
21 3 54 6 7 8
Chapter 2 Controllers
14 Storage Center CT-SC040 and SC8000 Connectivity Guide
CT-SC040 Back ViewThe CT-SC040 controller can hold up to six PCIe cards. Populate the slots as follows:
• Insert the Cache Card in Slot 7.
• Insert IO cards with front-end ports (iSCSI, FCoE) beginning with slot 6 and fill toward slot 1.
• Insert IO cards with back-end ports (Fibre Channel) beginning with slot 1 and fill toward slot 6.
Figure 9. CT-SC040 Controller Back View
Note: When installing three or more 10 Gb iSCSI IO cards, ensure that slots 1, 2, and 3 are not all populated with the 10 Gb iSCSI card type. Instead place two of the 10 Gb iSCSI cards in slots 1 and 2, and insert the remaining 10 Gb iSCSI card(s) in any slot other than PCI Slot 3.
Item Control/Feature Description
Slots 1–6 Standard profile card slots Front-end IO cards starting in slot 6, back-end IO cards starting in slot 1
Slot 7 Standard profile cart slot Cache card (CHA3)
1 Power Supplies Two hot-swappable AC power supplies.
2 Fans Two of five shown.
3 System/internal communication ports
See Figure 10 on page 15
7 6 5 4 3 2 1
1
2
3
4
Ca
che
Slots are numbered from right to left
Ports are numbered from top to bottom1 2
3 Cache card (PCIe)
Back-end IO cards populated right to left
Front-end IO cards populated left to right
CT-SC040 Back View
Dell Compellent 15
CT-SC040 Communication PortsCommunication ports are used for system setup, maintenance, and internal connections between controllers.
Figure 10. CT-SC040 Communication Ports
Item Control/Feature Description
1 Mouse connector Connects to mouse or other pointing device
2 IPMI connector Not Used
3 Link activity LED Flickering light: Indicates transmit/receive activity
Steady light: Indicated valid network connection
4 IO speed LED • Amber: 1 Gpbs
• Green: 100 Mbps
• No light: 10 Mbps
5 Disk keyboard connector Connects to external keyboard
6 USB connector Connect USB devices to the controller
7 COM 1 connector Serial connection to external devices
8 Video connector Connects a VGA monitor to the controller.
9 ETH 0 Management port.
10 ETH 1 IPC.
Note: Ethernet ports marked ETH 0 and ETH 1 do not support iSCSI communication; iSCSI connections are supported by PCI-based IO ports on the IO card.
1098765
21 3 4
Chapter 2 Controllers
16 Storage Center CT-SC040 and SC8000 Connectivity Guide
IO Card Slot PriorityPopulate the slots as follows, making sure that the cards are seated properly.
Description Use Slot Priority
iSCSI, 1 Gb, 2 port, Full Height Front end 6, 5, 4
iSCSI, 10 Gb, 2 port, Full Height Front end 6, 5, 4
FCoE, 10 Gb, 2 Port, Full Height Front end 6, 5, 4
FC, 4 Gb, 4 port, Full Height Front end/ Back end 6, 5, 4/ 1, 2, 3
FC, 4 Gb, 2 port, Full Height Front end/ Back end 6, 5, 4/ 1, 2, 3
FC, 8 Gb, 2 port, Low Profile Front end/ Back end 6, 5, 4/ 1, 2, 3
FC, 8 Gb, 4 port, Full Height Front end/ Back end 6, 5, 4/ 1, 2, 3
SAS, 3 Gb, Full Height Back end 1, 2, 3
SAS, 6 Gb, Full Height Back end 1, 2, 3
Dell Compellent 17
3 Enclosures
This chapter describes Dell Compellent disk enclosures including disk types, ports, and buttons and indicators.
ContentsSC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Chapter 3 Enclosures
18 Storage Center CT-SC040 and SC8000 Connectivity Guide
SC200/220 SAS EnclosuresSAS enclosures hold disks for data storage and connect to the controllers through back-end ports. SAS enclosures are configured to hold either 12-3.5" drives or 24-2.5" drives.
SC200/220 Enclosure Front ViewThe enclosure front panel provides indicators to show the enclosure status. Insert the enclosure into a rack so that the LED display is on the left side.
Figure 11. SC200/220 Enclosures Front View — Controls and Indicators
Item Control/Feature Icon Description
1 Enclosure status Illuminates when the enclosure power is on:
• Steady blue: Normal operation
• Flashing blue: Indicates that Storage Center is identifying the enclosure.
• Steady amber: Enclosure is turning on or reset.
• Flashing amber: Enclosure is in fault state.
2 Power status Illuminates when at least one power supply is supplying power to the enclosure
2
1
SC200 Enclosure
SC220 Enclosure
SC200/220 SAS Enclosures
Dell Compellent 19
SC200/220 Enclosure Back ViewThe enclosure back panel provides controls to power up and reset the enclosure, indicators to show the enclosure status, and connections for back-end cabling.
Figure 12. SC200/220 Enclosure Back View — Controls and Indicators
Table 1.
Item Control/Feature Icon Description
1 PCM status indicator • Green: Normal operation
• Amber: Power supply failure
2 Fan indicator • Green: Normal operation
• Amber: Fan failure
3 AC power indicator • Green: Normal operation
• Amber: No AC power
4 Power switch — Controls power for the enclosure
5 Power Cooling Module (PCM)—one of two — Contains fans that provide cooling for the enclosure
6 Enclosure Management Module (EMM)—one of two
— See Enclosure Management Module (EMM) on page 20
! !
Compellent SC2
Compellent SC2
4
21
5 6
3
Chapter 3 Enclosures
20 Storage Center CT-SC040 and SC8000 Connectivity Guide
Enclosure Management Module (EMM)SAS enclosures include two EMM IO modules in two interface slots. Each EMM can discover the type and capabilities of its partner EMM within the enclosure. Incompatible configurations result in an enclosure system alarm. The EMM indicators provide status as described below.
Figure 13. IO Module Indicators
Item Control/Feature Icon Description
1 System status indicator Not used on SC200/220 enclosures
2 Debug port For engineering use only
3 SAS port A (in) Connects to the controller or to other enclosures
4 Port A link status • Green: All the links to the port are connected
• Amber: One or more links are not connected
• Off: Enclosure is not connected
5 SAS port B (out) Connects to the controller or to other enclosures
6 Port B link status • Green: All the links to the port are connected
• Amber: One or more links are not connected
• Off: Enclosure is not connected
7 EMM status indicator • Steady Green: Normal operation
• Amber: Enclosure did not boot or is not properly configured
• Flashing Green: Automatic update in process
• Flashing Amber Twice: Enclosure is unable to communicate with other enclosures
• Flashing Amber Four Times: Firmware update failed
• Flashing Amber Five Times: Firmware versions are different between the two EMMs
Compellent SC2
1 32 4 5 6 7
EN-SASx6x12/24 Enclosures
Dell Compellent 21
EN-SASx6x12/24 EnclosuresSAS enclosures hold disks for data storage and connect to the controllers through back-end ports. SAS enclosures are configured to hold either 12-3.5" drives or 24-2.5" drives.
SAS Enclosure Front ViewThe enclosure front panel provides controls to power up and reset the enclosure and indicators to show the enclosure status. Insert the enclosure into a rack so that the LED display is on the left side.
Figure 14. SAS Enclosures Front View — Controls and Indicators
Item Control/Feature Icon Description
1 Mute button Mutes the alarm
2 System power indicator • Green: Power is on
• Amber: Unit is on standby
3 Module fault indicator Amber: Enclosure module failure (PCM fault, Fan fault, SSB module fault. Check indicators on individual modules)
4 Logical fault indicator • Amber: Disk drive failure
• Flashing Amber: Unexpected enclosure ID (Module Fault will also be flashing amber)
5 LED display — Indicates the enclosure ID number—this number is set by the software during installation, and matches the Disk ID displayed in the Storage Center System Manager
1
2
345
EN-SASX6X12 Enclosure
EN-SASX6X24 Enclosure
Chapter 3 Enclosures
22 Storage Center CT-SC040 and SC8000 Connectivity Guide
SAS Enclosure Rear View
Figure 15. SAS Enclosure Rear View — Controls and Indicators
Item Control/Feature Icon Description
1 AC power indicator • Green: Normal operation
• Amber: No AC power
2 Fan indicator • Green: Normal operation
• Amber: Fan failure
3 PCM status indicator • Green: Normal operation
• Amber: Power supply failure
4 DC power indicator • Green: Normal operation
• Amber: No DC power
5 Power switch — Controls power for the enclosure
6 Power Cooling Module (PCM)—one of two — Contains fans that provide cooling for the enclosure
7 Storage Bridge Bay (SBB)—one of two — See Storage Bridge Bay (SBB) Module on page 23
42
13
7 5
5
6
EN-SASx6x12/24 Enclosures
Dell Compellent 23
Storage Bridge Bay (SBB) ModuleSAS enclosures include two SBB IO modules in two SBB-compliant interface slots. Each SBB IO Module includes an EEPROM that holds data describing the function and capability of the SBB module. Each SBB module can discover the type and capabilities of its partner SBB module within the enclosure. Incompatible configurations result in an enclosure system alarm.
Each port has four separately arbitrated physical lanes. The status of each lane is indicated by a green LED. The IO Module and Fault indicators provide status as described below.
Figure 16. IO Module Indicators
Item Control/Feature Icon Description
1 IO Module indicator On Steady: Normal operation
2 IO Module fault indicator On: IO module error
3 Lane LEDs — • Solid Green: Connected, No activity
• Flashing: Activity
4 Controller connection (3 Gb SAS) — The port with the in/out arrow connects to the controller.
5 Controller connection (6 Gb SAS) — The 6 Gb C-port always connects to the controller.
1
3 Gb Module
6 Gb Module
3
2
3
4
5
1
2
Chapter 3 Enclosures
24 Storage Center CT-SC040 and SC8000 Connectivity Guide
SAS 6 Gb and 3 Gb IO Module Comparison
6 Gb IO Module Enclosure 3 Gb IO Module Enclosure
Compatibility • 6 Gb controller IO card
• Other 6 Gb enclosures
• 3 Gb controller IO card
• Other 3 Gb enclosures
Drive Configuration
• 3.5" 12-drive enclosure
• 2.5" 24-drive enclosure
3.5" 12-drive enclosure
Drive Speed 3 Gb or 6 Gb drives
Note: A 3 Gb drive in a 6 Gb enclosure can transfer data at no more than 3 Gigabits per second.
3 Gb or 6 Gb drives
Note: A 6 Gb drive in a 3 Gb enclosure can transfer data at no more than 3 Gigabits per second
Speed Indicator Labeled 6 Gb SAS Labeled SAS but speed is not indicated
IO • Input port: A
• Output port: B
• Either In or Out: C
• Input port: Arrow pointing toward a port
• Output port: Arrow pointing away from the port
• Either In or Out: Double-arrow
Controller Connection
Port C Double arrow
Number of Drives
Each cabling side can contain up to 14 IO Modules in the chain, which creates a maximum limit of 14 enclosures.
If all 14 enclosures are fully populated the maximum number of drives is 168 per chain.
Each cabling side can contain up to four IO Modules in the chain, which creates a maximum limit of four enclosures
If all four enclosures are fully populated with 2.5” drives, the maximum number of drives is 96 per chain
SBOD Enclosures
Dell Compellent 25
SBOD EnclosuresSwitched Bunch of Disk (SBOD) enclosures connect using two SBD modules. The SBOD enclosures are internally connected using a Switched Fabric architecture, in which data can be distributed directly to each disk. This architecture supports up to seven SBOD enclosures on a loop.
• SBOD can NOT coexist on a loop with a SATA enclosure
• One loop can contain a maximum of seven SATA enclosures
• An SBOD enclosure can contain only Fibre Channel drives
Figure 17. Rear View of an SBOD Enclosure
On/Off Switch
On/Off Switch SBD Modules Enclosure ID Switch
DIP Switches
Chapter 3 Enclosures
26 Storage Center CT-SC040 and SC8000 Connectivity Guide
SBOD IO ModulesAn SBOD IO module has four ports. Ports on the right IO Modules are numbered Host 0, Host 1, Host 2, and Host 3 from top to bottom. Ports on the left are numbered Host 3, Host 2, Host 1, and Host 0 from top to bottom. Host 0 is the input port, Host 1 is the output port.
Figure 18. SBOD Ports (4 Gb IO Card)
Host 0 Input Port
Host 1Output Port
Host 1 Output Port
Host 0 Input Port
Host 2 and Host 3 are not used
Host 2 and Host 3 are not used
Ho
st 1
Ho
st 0
Ho
st 3
Ho
st
2
Ho
st 1
Ho
st 0
Ho
st 3
Ho
st 2
RS232
RS232
Speed Indicator
SBOD Enclosures
Dell Compellent 27
SBOD Port IDEach enclosure on a fibre channel loop must have a unique ID number. Set the enclosure ID to a unique number from 1–7 using the Enclosure ID switch. New/changed ID settings are read only at power up, so cycle power on the enclosure to implement the changed setting.
Enclosure SpeedSBOD enclosures are shipped set to 4 Gb, so by default only 4 Gb drives can be used. In addition:
• If a 2 Gb drive is installed in a 4 Gb enclosure, the drive goes into bypass mode and is not recognized by the system.
• A 2 Gb enclosure can be changed to 4 Gb by changing the DIP switches. If the disks on a loop are configured at 2 Gb, change the enclosure DIP switches to the 2 Gb setting as shown in Figure 19.
• 4 Gb enclosures can only exist in their own loop.
• Small form plugable transceivers (SFPs) can only be used in 4 Gb enclosures.
• The controller IO cards must be 4 Gb type.
Figure 19. Enclosure ID Switch
Note: Duplicate enclosure ID numbers are one of the most common configuration errors.
Key:
1234
5678
9101112
4 Gb Switch Mode 2 Gb Switch Mode
1234
5678
9101112
Change From 2 Gb to 4 Gb Mode
Change the speed setting of the enclosure to 4 Gb.
1 Set switch 7 from On to Off.
2 Set Switch 8 from Off to On.
All other switches remain in their default settings.
DIP Switches
DIP Switch set to ON
DIP Switch set to OFF
Chapter 3 Enclosures
28 Storage Center CT-SC040 and SC8000 Connectivity Guide
SATA Enclosures SATA disk enclosures support Fibre Channel connectivity to the controller and other enclosures. SATA disks are internally connected by an Arbitrated Loop, and all disks share resources on the Fibre Loop. This means that to write to the target disk, the communication path must go through all preceding disks, which limits the maximum number of SATA enclosures on a loop to five.
• SATA can not coexist on a loop with an SBOD enclosure
• SATA can coexist on a loop with a JBOD enclosure
• One loop can contain a maximum of five (5) SATA enclosures
Figure 20. Rear View of a SATA Enclosure
Note: When installing an enclosure into the rack, make sure that it is oriented so that the DIP switches are located at the bottom.
1
On/Off Switch
On/Off Switch Service Control Modules (SCMs) Enclosure ID Switch
DIP Switches
SATA Enclosures
Dell Compellent 29
SATA Service Control Modules (SCMs)SATA enclosures are connected to the system through the blue ports in the SCM. Arrows pointing toward the port opening are input ports. Arrows pointing away from the port opening are output ports. Dell Compellent supports up to five SATA enclosures per FC loop in a Storage Center system.
Figure 21. SATA SCM Ports
SATA Enclosure IDEach enclosure on a FC loop must have a unique ID number. Set the enclosure ID to a unique number from 1 to 7 using the Enclosure ID switch. New/changed ID settings are read only at system power up, so if changes are made, the entire system needs to be restarted.
Figure 22. Enclosure ID Switch
Note: SATA uses arrows to indicate data transmission direction. Always use the blue ports.
Note: Incorrectly numbered enclosures are one of the most common configuration errors.
Output Port: Arrow points away from port
Input Port: Arrow points toward port
Output Port: Arrow points away from port
Input Port: Arrow points toward port
1
1234
5678
9101112
Invalid Address LED
Alarm Mute Switch
System Fault LED
Hub Mode (not used)
Power On LED
Enclosure ID Switch
Power/Temp Fault LED
2 Gb Link Speed LED
DIP Switches
On Off
Chapter 3 Enclosures
30 Storage Center CT-SC040 and SC8000 Connectivity Guide
Disk DrivesConsolidate drives into as few enclosures as possible. Because drives are massed into a virtual pool of storage, the exact location of a drive is not important.
Observe the following guidelines for handling drives:
• Insert an empty drive carrier in each unused drive bay to maintain a balanced airflow.
• Protect the drive from static discharge.
• Keep each drive in its protective packing container until ready to install.
• Always wear a grounded wrist or ankle strap.
• Install one drive at a time.
• Handle the drives by the edges of the frames.
• Handle drives with care, being careful not to drop or jar the drive.
Disk Drive SpeedsStorage Center enclosures support 7200 RPM, 10,000 RPM, 15,000 RPM, and Enterprise Solid State Drive (ESSD) drives. Drive speeds supported in each enclosure are given below.
Caution: Always fill every slot in the enclosure, either with a disk or with an empty carrier. Operating a Storage Center with any modules missing disrupts airflow, which prevents the drives from being cooled sufficiently.
Enclosure Type 7.2K 10K 15K ESSD
SC200/220 SASa
a. SC200/220 enclosures support only Dell Enterprise Plus drives.
EN-SASx6x12/24
SATA
SBOD
Caution: Populating drives of different spindle rates (7.2K, 10K, or 15K) in the same column creates vibration that can slow IO and possibly produce errors. Make sure that each column contains drives of the same spindle rate.
Disk Drives
Dell Compellent 31
SAS Disk Locations SAS enclosures may contain up to 24 drives installed vertically side by side, or may hold up to 12 drives installed horizontally in a four-column, three-row configuration.
• In a 24-disk enclosure, disks are installed vertically, and are numbered from left to right.
• SC220 enclosure disks begin with drive 0.
• EN-SASx6x24 enclosure disks begin with drive 1.
• In a 12-disk enclosure, disk drives are installed horizontally, and are numbered as shown in Figure 23.
Figure 23. SAS Disk Numbering, 12-Disk Enclosure
When installing drives into the 12-disk enclosure, make sure that all drives in a column are of the same spindle rate as shown in the example below.
Enterprise Solid State Drives (ESSDs)
When present, ESSDs are automatically assigned to Tier 1 by the Storage Center System Manager. These drives can only be used in SC200/220 SAS enclosures. Because solid state drives do not spin, they can be inserted in any column.
Note: Dell Enterprise Plus drives can only be installed in SC200/220 enclosures.
Column 1 Column 2 Column 3 Column 4
Row 1 7.2K 15K 10K 15K
Row 2 7.2K 15K 10K 15K
Row 3 7.2K 15K 10K 15K
Disk 1
Disk 5
Disk 9
Disk 2
Disk 6
Disk 10
Disk 3
Disk 7
Disk 11
Disk 4
Disk 8
Disk 0
Disk 1
Disk 5
Disk 9
Disk 2
Disk 6
Disk 10
Disk 3
Disk 7
Disk 11
Disk 4
Disk 8
Disk 12
SC200 Enclosure
EN-SASx6x12 Enclosure
Chapter 3 Enclosures
32 Storage Center CT-SC040 and SC8000 Connectivity Guide
SBOD and SATA Disk LocationsSBOD and SATA enclosures support up to 16 disks. Disks are accessed from the front and are numbered 1–16, starting with the upper left disk and ending with the lower right disk as shown in Figure 24.
• Install drives in columns, starting with the outer columns first.
• Make sure that all drives in a column are of the same spindle rate.
• There must be a spinning disk in position 1 and in position 16 in every active enclosure.
• If an enclosure contains fewer than 16 drives, insert an empty drive carrier into the unused slots to preserve the cooling air flow.
Enterprise Solid State Drives (ESSDs)
When present, ESSDs are automatically assigned to Tier 1 by the Storage Center System Manager. These drives can be located only in slots 2 through 15 and can only be used in 4 Gb enclosures.
Because solid state drives do not spin, they can be inserted in any column, other than the first and last drive slots as mentioned above.
Figure 24. SATA/SBOD Disk Numbering (Front View)
Caution: Drives of different spindle rates (7.2K, 10K, or 15K) installed in the same column cause vibrations that can slow IO and possibly produce errors. Make sure that each column contains drives of the same spindle rate.
Disk 1
Disk 5
Disk 9
Disk 13
Disk 2
Disk 6
Disk 10
Disk 14
Disk 3
Disk 7
Disk 11
Disk 15
Disk 4
Disk 8
Disk 12
Disk 16
Disk Drives
Dell Compellent 33
Enterprise Plus DrivesEnterprise Plus Drives can only be installed in SC200/220 enclosures. Drives are installed either vertically (SC220) or horizontally (SC200) in the enclosure. Indicators give status and activity information as described below.
Figure 25. Enterprise Plus Drive Indicators
Item Control/Feature Description
1 Hard drive activity indicator
• Flashing green: Indicates drive activity
• Steady green: Indicates no drive activity
2 Hard drive status indicator • Steady green: Normal operation
• Off: No power to the drive
• Flashes amber four times per second: Drive failed
1 2
1
2
Chapter 3 Enclosures
34 Storage Center CT-SC040 and SC8000 Connectivity Guide
Standard SAS DrivesStandard SAS drives can only be installed in EN-SASx6x12/24 enclosures. Drives are installed either vertically or horizontally in the enclosure. Indicators give status and activity information as described below.
Figure 26. Standard SAS Drive Indicators
Item Control/Feature Description
1 Amber LED • Off: No drive, or drive is operating
• On: Drive fault
2 Green LED • Green: Connected, No activity
• Flashing: Activity
3Anti-tamper Indicator (when present)
• Red: Locked
• Black: Unlocked
4 Lock (when present) Insert key or T10 Torx driver and turn to lock/unlock
1
2
3 4
1 2
Disk Drives
Dell Compellent 35
Removing DisksFailed disks may be removed without system downtime. The following instructions show removal of a Dell Enterprise Plus drive from a 24-disk enclosure. Other drive and carrier models are removed in a similar manner.
Figure 27. Removing a Disk
1 Press the release button.
2 Open the hard drive carrier.
3 Slide the drive out until it is free of the hard drive bay.
Chapter 3 Enclosures
36 Storage Center CT-SC040 and SC8000 Connectivity Guide
Installing DisksThe following instructions show installation of the Dell Enterprise Plus drive into a 24-disk enclosure. Dell Enterprise Plus drives can only be installed in SC200/220 enclosures, however other drive and carrier models are installed in a similar manner.
Figure 28. Installing a Disk
1 Insert the hard drive carrier into the hard drive bay.
2 Slide the drive into the bay until the carrier contacts the backplane.
3 Close the hard drive carrier handle to lock the hard drive in place.
4 Continue to push firmly until you hear a click and the handle fully engages.
Dell Compellent 37
4 Back End Cabling
This chapter describes how to connect Dell Compellent controllers to Dell Compellent enclosures.
ContentsSC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
SC200/220 SAS EnclosuresRedundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). Each enclosure chain begins with an initiator port on the IO Card and ends with a target port on the IO Card to provide a complete communications path. Controller ports 1 and 2 on SAS IO Cards function as initiator ports, and ports 3 and 4 are considered target ports.
• The A side of a chain starts at port 1 (initiator) and lands on the A port of the SAS enclosure (target).
• Enclosures are connected from B port to A port, using the top Enclosure Management Module (EMM).
• The B side of an enclosure chain connects enclosure ports B to A on the bottom EMM.
• The enclosure chain is completed by connecting port A on the bottom EMM to port 3 (target) of the SAS IO Card.
Cabling Best Practices• To isolate errors, cable one enclosure chain and then set up Storage Center (as described in the Storage
Center System Setup Guide) before you cable the second chain. After cabling each enclosure chain, check the number of targets in the System Manager Configure Local Ports window, as described in Configure Local Ports on page 131.
• Make sure that each enclosure chain contains no more that 14 enclosures. Enclosure chains that exceed 14 enclosures will generate a Critical warning in the System Manager and to Dell Technical Support.
• Make sure that each enclosure chain contains no more than 168 drives.
• Make sure that cables are labeled at each end. If not, apply labels as directed in the SC8000 Cable Labeling Guide included in the cable package.
Chapter 4 Back End Cabling
38 Storage Center CT-SC040 and SC8000 Connectivity Guide
Direct-Connect IPC for Dual-Controller, Single Chain ConfigurationsDirect-connect IPC provides redundancy for dual-controller Storage Centers that have only one SAS back-end enclosure chain. It is not intended to improve system performance. Extra IO cards are not needed to support a Direct-connect IPC connection. If the Storage Center is configured correctly and IPC is required, add cabling between the initiator and target ports on the controllers. In dual-controller Storage Centers, extra cables are provided for this path.
For Dual-Controller, Single Enclosure Chain
IPC Direct Connect is required. Connect two SAS cables between initiator and target ports on the controllers, and set the port Purpose:
1 Controller A: IO Card port 2 (initiator) → Controller B: IO Card port 4 (target).
2 Controller B: IO Card port 2 (initiator) → Controller A: IO Card port 4 (target).
3 In the Configure Local Ports wizard, set each port Purpose to Unknown.
For Dual-Controller, Multiple Enclosure Chain
If two or more enclosure chains exist, IPC Direct Connect is optional.
SC8000 Controller CablingThis section shows common cabling between the SC8000 controller and SC200/220 SAS enclosures.
Note: It is acceptable to have open ports on SAS IO cards. For additional redundancy, you may connect a SAS cable between initiator and target ports on the two controllers, but this is not necessary.
Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager and visible in the LED display. The System Manager assigns an Index number only after the system is powered up and at least one drive is assigned to a Disk Folder. For more information about assigning disks to a disk folder, see the Storage Center System Setup Guide.
SC200/220 SAS Enclosures
Dell Compellent 39
Single SC8000 Controller, Single Enclosure
Figure 29 illustrates an SC8000 controller cabled to a 6 Gb SAS enclosure.
A side
Controller: slot 6, port 1 → Enclosure: top, port A.
B side
Controller: slot 6, port 3 → Enclosure: bottom, port A.
Figure 29. Single SC8000 Controller, Single SAS Enclosure
4 3 2 1
A
A B
B
Chapter 4 Back End Cabling
40 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single SC8000 Controller, Four Enclosures, Single Chain
Figure 30 illustrates a single SC8000 controller cabled to four SAS enclosures. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
A side:
1 Controller: slot 6, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B → Enclosure 3: top, port A.
4 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side:
1 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
2 Enclosure 2: bottom, port B → Enclosure 3: bottom, port A.
3 Enclosure 3: bottom, port B → Enclosure 4: bottom, port A.
4 Enclosure 4: bottom, port B → Controller: slot 6, port 3.
Figure 30. Single SC8000 Controller, Single SAS Chain
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller4 3 2 1
A
A B
B
A
A B
B
A
A B
B
A
A B
B
SC200/220 SAS Enclosures
Dell Compellent 41
Single SC8000 Controller, Four Enclosures, Two IO Cards, Two Chains
Figure 31 illustrates a single SC8000 controller cabled to four SAS enclosures in two chains. When cabling a second chain of enclosures, use a second IO card to improve redundancy. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
A side, Chain 1
1 Controller: slot 6, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
B side, Chain 1
1 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
2 Enclosure 2: bottom, port B → Controller: slot 5, port 3.
A side, Chain 2
1 Controller: slot 6, port 3 → Enclosure 3: top, port A.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side, Chain 2
1 Enclosure 3: bottom, port B → Enclosure 4: bottom, port A.
2 Enclosure 4: bottom, port B → Controller slot 5, port 1.
Figure 31. Single SC8000 Controller, Four SAS Enclosures, Two IO Cards, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller 4 3 2 1
A
A B
B
A
A B
B
A
A B
B
A
A B
B
4 3 2 1
Chapter 4 Back End Cabling
42 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual SC8000 Controllers, One Enclosure, Single Chain
Figure 32 illustrates two SC8000 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
IPC Connection
1 Controller A: slot 6, port 2 → Controller B: slot 6, port 4.
2 Controller B: slot 6, port 2 → Controller A: slot 6, port 4.
A side
1 Controller A: slot 6, port 1 → Enclosure: top, port A.
2 Enclosure: top, port B → Controller B: slot 6, port 3.
B side
1 Controller B: slot 6, port 1 → Enclosure: bottom, port A.
2 Enclosure: bottom, port B → Controller A: slot 6, port 3.
Figure 32. Dual SC8000 Controllers, One Enclosure, One Chain
Note: In a single-chain configuration, use SAS ports 2 (initiator) and 4 (target) to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown.
Enclosure
Controller A
Controller B
4 3 2 1
A
A B
B
4 3 2 1
SC200/220 SAS Enclosures
Dell Compellent 43
Dual SC8000 Controllers, Two Enclosures, Single Chain
Figure 33 illustrates two SC8000 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
IPC Connection
1 Controller A: slot 6, port 2 → Controller B: slot 6, port 4.
2 Controller B: slot 6, port 2 → Controller A: slot 6, port 4.
A side
1 Controller A: slot 6, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B→ Controller B: slot 6, port 3.
B side
1 Controller B: slot 6, port 1 → Enclosure 1: bottom, port A.
2 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
3 Enclosure 2: bottom, port B → Controller A: slot 6, port 3.
Figure 33. Dual SC8000 Controllers, Two Enclosures, One Chain
Note: In a single-chain configuration, use SAS ports 2 (initiator) and 4 (target) to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown.
Enclosure 1
Enclosure 2
Controller A
Controller B
4 3 2 1
A
A B
B
A
A B
B
4 3 2 1
Chapter 4 Back End Cabling
44 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual SC8000 Controllers, Four Enclosures, Two Chains
Figure 34 illustrates two SC8000 controllers cabled to two 6 Gb enclosures. Each enclosure is on a separate chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. When two chains are used, IPC is optional.
A side, Chain 1
1 Controller A: slot 6, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B →Controller B: slot 6, port 3.
B side, Chain 1
1 Controller B: slot 5, port 1 → Enclosure 1: bottom, port A.
2 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
3 Enclosure 2: bottom, port B →Controller A: slot 5, port 3.
A side, Chain 2
1 Controller A: slot 6, port 3 → Enclosure 3: top, port A.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
3 Enclosure 4: top, port B →Controller B: slot 6, port 1.
B side, Chain 2
1 Controller B: slot 5, port 3 → Enclosure 3: bottom, port A.
2 Enclosure 3: bottom, port B → Enclosure 4: bottom, port A.
3 Enclosure 4: bottom, port B →Controller A: slot 5, port 1.
Enclosure 1
Enclosure 2
Controller A
Controller B
Enclosure 3
Enclosure 4
Figure 34. Dual SC8000 Controllers, Four Enclosures, Two Chains
4 3 2 1
A
A B
B
A
A B
B
A
A B
B
A
A B
B
4 3 2 1
4 3 2 1
4 3 2 1
SC200/220 SAS Enclosures
Dell Compellent 45
Dual SC8000 Controllers, Eight Enclosures, Two Chains
To add redundancy with multiple IO cards, add a second SAS IO card. Create the A-side chain on the IO card in slot 6 and create the B-side chain on the IO card in slot 5. If an IO card, cable, enclosure, or controller fails, at least one side of a loop continues operating. IPC is optional in this configuration.
Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
Refer to Figure 35 on page 46 for cable connections.
1 (Optional) Create IPC connections between both controllers on ports 2 and 4 of each IO card.
2 A side, Chain 1: Controller A: slot 6, port 1 → Enclosure 1: top, port A.
a Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B →next enclosure down: top, port A.
b Finish with Enclosure 4: top, port B → Controller B: slot 6, port 3.
3 B side, Chain 1: Controller A: slot 5, port 3 → Enclosure 4: bottom, port B.
a Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port A →next enclosure up: bottom, port B.
b Finish with Enclosure 1: bottom, port A → Controller B: slot 5, port 1.
4 A side, Chain 2: Controller A: slot 6, port 3 → Enclosure 5: top, port A.
a Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B →next enclosure down: top, port A.
b Finish with Enclosure 8: top, port B → Controller B: slot 6, port 1.
5 B side, Chain 2: Controller A: slot 5, port 1 → Enclosure 8: bottom, port B.
a Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port A →next enclosure up: bottom, port B.
b Finish with Enclosure 5: bottom, port A → Controller B: slot 5, port 3.
Chapter 4 Back End Cabling
46 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 35. Dual SC8000 Controllers, Eight Enclosures, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Enclosure 5
Enclosure 6
Enclosure 7
Enclosure 8
4 3 2 14 3 2 1
4 3 2 1 4 3 2 1
A
A B
B
A
A B
B
A
A B
B
A
A B
B A
A B
B
A
A B
B
A
A B
B
A
A B
B
SC200/220 SAS Enclosures
Dell Compellent 47
CT-SC040 Controller CablingThis section shows common cabling between the CT-SC040 controller and SC200/220 SAS enclosures.
Single CT-SC040 Controller, Single Enclosure
Figure 36 illustrates an CT-SC040 controller cabled to a 6 Gb SAS enclosure.
A side
Controller: slot 1, port 1 → Enclosure: top, port A.
B side
Controller: slot 1, port 3 → Enclosure: bottom, port A.
Figure 36. Single CT-SC040 Controller, Single SAS Enclosure
Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager.
4
3
2
1
A
A B
B
Chapter 4 Back End Cabling
48 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single CT-SC040 Controller, Four Enclosures, Single Chain
Figure 37 illustrates a single CT-SC040 controller cabled to four SAS enclosures. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
A side:
1 Controller: slot 1, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B → Enclosure 3: top, port A.
4 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side:
1 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
2 Enclosure 2: bottom, port B → Enclosure 3: bottom, port A.
3 Enclosure 3: bottom, port B → Enclosure 4: bottom, port A.
4 Enclosure 4: bottom, port B → Controller: slot 1, port 3.
Figure 37. Single CT-SC040 Controller, Single SAS Chain
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
4
3
2
1
A
A B
B
A
A B
B
A
A B
B
A
A B
B
SC200/220 SAS Enclosures
Dell Compellent 49
Single CT-SC040 Controller, Four Enclosures, Two IO Cards, Two Chains
Figure 38 illustrates a single CT-SC040 controller cabled to four SAS enclosures in two chains. When cabling a second chain of enclosures, use a second IO card to improve redundancy. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
A side, Chain 1
1 Controller: slot 1, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
B side, Chain 1
1 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
2 Enclosure 2: bottom, port B → Controller: slot 2, port 3.
A side, Chain 2
1 Controller: slot 1, port 3 → Enclosure 3: top, port A.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side, Chain 2
1 Enclosure 3: bottom, port B → Enclosure 4: bottom, port A.
2 Enclosure 4: bottom, port B → Controller slot 2, port 1.
Figure 38. Single CT-SC040 Controller, Four SAS Enclosures, Two IO Cards, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
4
3
2
1
A
A B
B
A
A B
B
A
A B
B
A
A B
B
Chapter 4 Back End Cabling
50 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual CT-SC040 Controllers, Two Enclosures, Single Chain
Figure 39 illustrates two CT-SC040 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
IPC Connection
1 Controller A: slot 1, port 2 → Controller B: slot 1, port 4.
2 Controller B: slot 1, port 2 → Controller A: slot 1, port 4.
A side
1 Controller A: slot 1, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B→ Controller B: port 3.
B side
1 Controller B: slot 1, port 1 → Enclosure 1: bottom, port A.
2 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
3 Enclosure 2: bottom, port B → Controller A: slot 1, port 3.
Figure 39. Dual CT-SC040 Controllers, Two Enclosures, One Chain
Note: In a single-chain configuration, use SAS ports 2 (initiator) and 4 (target) to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown.
Enclosure 1
Enclosure 2
Controller A
Controller B
A
A B
B
A
A B
B
4
3
2
1
4
3
2
1
SC200/220 SAS Enclosures
Dell Compellent 51
Dual CT-SC040 Controllers, Four Enclosures, Two Chains
Figure 40 illustrates two CT-SC040 controllers cabled to two 6 Gb enclosures. Each enclosure is on a separate chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. When two chains are used, IPC is optional.
A side, Chain 1
1 Controller A: slot 1, port 1 → Enclosure 1: top, port A.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B →Controller B: slot 1, port 3.
B side, Chain 1
1 Controller B: slot 2, port 1 → Enclosure 1: bottom, port A.
2 Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
3 Enclosure 2: bottom, port B →Controller A: slot 2, port 3.
A side, Chain 2
1 Controller A: slot 1, port 3 → Enclosure 3: top, port A.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
3 Enclosure 4: top, port B →Controller B: slot 1, port 1.
B side, Chain 2
1 Controller B: slot 2, port 3 → Enclosure 3: bottom, port A.
2 Enclosure 3: bottom, port B → Enclosure 4: bottom, port A.
3 Enclosure 4: bottom, port B →Controller A: slot 2, port 1.
Enclosure 1
Enclosure 2
Controller A
Controller B
Enclosure 3
Enclosure 4
Figure 40. Dual CT-SC040 Controllers, Four Enclosures, Two Chains
432
1
A
A B
B
A
A B
B
A
A B
B
A
A B
B
4
32
1
Chapter 4 Back End Cabling
52 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual CT-SC040 Controllers, Eight Enclosures, Two Chains
To add redundancy with multiple IO cards, add a second SAS IO card. Create the A-side chain on the IO card in slot 1 and create the B-side chain on the IO card in slot 2. If an IO card, cable, enclosure, or controller fails, at least one side of a loop continues operating. IPC is optional in this configuration.
Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures.
Refer to Figure 41 on page 53 for cable connections.
1 (Optional) Create IPC connections between both controllers on ports 2 and 4 of each IO card.
2 A side, Chain 1: Controller A: slot 1, port 1 → Enclosure 1: top, port A.
a Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B →next Enclosure down: top, port A.
b Finish with Enclosure 4: top, port B → Controller B: slot 1, port 3.
3 B side, Chain 1: Controller A: slot 2, port 3 → Enclosure 4: bottom, port B.
a Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port A →next Enclosure up: bottom, port B.
b Finish with Enclosure 1: bottom, port A → Controller B: slot 2, port 1.
4 A side, Chain 2: Controller A: slot 1, port 3 → Enclosure 5: top, port A.
a Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B →next Enclosure down: top, port A.
b Finish with Enclosure 8: top, port B → Controller B: slot 1, port 1.
5 B side, Chain 2: Controller A: slot 2, port 1 → Enclosure 8: bottom, port B.
a Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port A →next Enclosure up: bottom, port B.
b Finish with Enclosure 5: bottom, port A → Controller B: slot 2, port 3.
SC200/220 SAS Enclosures
Dell Compellent 53
Figure 41. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Enclosure 5
Enclosure 6
Enclosure 7
Enclosure 8
4321
A
A B
B
A
A B
B
A
A B
B
A
A B
B A
A B
B
A
A B
B
A
A B
B
A
A B
B
4321
Chapter 4 Back End Cabling
54 Storage Center CT-SC040 and SC8000 Connectivity Guide
EN-SASx6x12/24 EnclosuresRedundant cabling in Storage Center ensures that in the event one controller, IO card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). Each enclosure chain begins with an initiator port on the IO Card and ends with a target port on the IO Card to provide a complete communications path. Controller ports 1 and 2 on SAS IO Cards function as initiator ports, ports 3 and 4 are considered target ports.
• The A side of a chain starts at port 1 (initiator) and lands on the C port of the SAS enclosure (target).
• Enclosures are connected from B port to A port, using the top Storage Bridge Bay (SBB).
• The B side of an enclosure chain connects enclosure ports B to A on the bottom SBB.
• The enclosure chain is completed by connecting port C on the bottom SBB to port 3 (target) of the SAS IO Card.
This section provides cabling information for SASx6x12 and SASx6x24 enclosures to the following controllers:
• SC8000 Controller Cabling begins on page 55
• CT-SC040 Controller Cabling begins on page 63
Cabling Best Practices• To isolate errors, cable one enclosure chain and then set up Storage Center (as described in the Storage
Center System Setup Guide) before you cable the second chain. After cabling each enclosure chain, check the number of targets in the System Manager Configure Local Ports wizard, as described in Configure Local Ports on page 131.
• 3 Gb versus 6 Gb enclosures:
• Storage Centers sold with SC8000 controllers contain 6 Gb SAS enclosures. 3 Gb SAS enclosures are only used when a CT-SC040 controller with 3 Gb SAS enclosures is migrated to an SC8000 controller. In this case the 3 Gb enclosure is supported by a 6 Gb IO card.
• Make sure that 3 Gb and 6 Gb enclosures are connected on separate enclosure chains.
• Make sure that 3 Gb and 6 Gb enclosures are connected to separate IO cards.
• Make sure that each 6 Gb enclosure chain contains no more than 168 drives.
• Make sure that each 3 Gb enclosure chain contains no more than 48 drives.
• Make sure that each enclosure chain contains no more that 14 enclosures. Enclosure chains that exceed 14 enclosures will generate a critical warning in the System Manager and to Dell Technical Support Services.
Direct-Connect IPC for Dual-Controller, Single-Chain Configurations
Direct-Connect IPC provides redundancy for dual-controller Storage Center that have only one SAS back-end enclosure chain. It is not intended to improve system performance. Extra IO cards are not needed to support a Direct-Connect IPC connection. If the Storage Center is configured correctly and IPC is required, add cabling between the initiator and target ports on the controllers. In dual-controller Storage Centers, extra 0.5 meter cables are provided for this path.
EN-SASx6x12/24 Enclosures
Dell Compellent 55
For Dual-Controller, Single-Enclosure Chain
IPC Direct Connect is required. Connect two SAS cables between initiator and target ports on the controllers, and set the port Purpose:
1 Controller A: IO Card port 2 (initiator) → Controller B: IO Card port 4 (target).
2 Controller B: IO Card port 2 (initiator) → Controller A: IO Card port 4 (target).
3 In the Configure Local Ports wizard, set each port Purpose to Unknown.
For Dual-Controller, Multiple-Enclosure Chain
If two or more enclosure chains exist, IPC Direct Connect is optional.
SC8000 Controller CablingThis section describes cabling for the SC8000 controller and SAS enclosures.
Single SC8000 Controller, Single Enclosure
Figure 42 illustrates an SC8000 controller cabled to a 6 Gb SAS enclosure.
A side
Controller: slot 6, port 1 → Enclosure: top, port C.
B side
Controller: slot 6, port 3 → Enclosure: bottom, port C.
Figure 42. Single SC8000 Controller, Single SAS Enclosure
Note: It is acceptable to have open ports on SAS IO cards. For additional redundancy, you may connect a SAS cable between initiator and target ports on the two controllers, but this is optional.
Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager and visible in the LED display. The System Manager assigns an Index number only after the system is powered up and at least one drive is assigned to a Disk Folder. For more information about assigning disks to a disk folder, see the Storage Center System Setup Guide.
4 3 2 1
Chapter 4 Back End Cabling
56 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single SC8000 Controller, Four Enclosures, Single Chain
Figure 43 illustrates a single SC8000 controller cabled to four 6 Gb enclosures.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
A side:
1 Controller: slot 6, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B → Enclosure 3: top, port A.
4 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side:
1 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
2 Enclosure 2: bottom, port A → Enclosure 3: bottom, port B.
3 Enclosure 3: bottom, port A → Enclosure 4: bottom, port B.
4 Enclosure 4: bottom, port C → Controller: slot 6, port 3.
Figure 43. Single SC8000 Controller, Single 6 Gb Chain
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller4 3 2 1
EN-SASx6x12/24 Enclosures
Dell Compellent 57
Single SC8000 Controller, Four Enclosures, Two IO Cards, Two Chains
Figure 44 illustrates a single SC8000 controller cabled to four SAS enclosures in two chains. When you add a second chain, you should also have a second IO card in the controller.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
A side, Chain 1
1 Controller: slot 6, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
B side, Chain 1
1 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
2 Enclosure 2: bottom, port C → Controller: slot 5, port 3.
A side, Chain 2
1 Controller: slot 6, port 3 → Enclosure 3: top, port C.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side, Chain 2
1 Enclosure 3: bottom, port A → Enclosure 4: bottom, port B.
2 Enclosure 4: bottom, port C → Controller slot 5, port 1.
Figure 44. Single SC8000 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller4 3 2 14 3 2 1
Chapter 4 Back End Cabling
58 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual SC8000 Controllers, Two Enclosures, Single Chain
Figure 45 illustrates two SC8000 controllers cabled to two 6 Gb enclosures forming a single chain.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
IPC Connection
1 Controller A: slot 6, port 2 → Controller B: slot 6, port 4.
2 Controller B: slot 6, port 2 → Controller A: slot 6, port 4.
A side
1 Controller A: slot 6, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port C → Controller B: slot 6, port 3.
B side
1 Controller B: slot 6, port 1 → Enclosure 1: bottom, port C.
2 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
3 Enclosure 2: bottom, port C → Controller A: slot 6, port 3.
Figure 45. Dual SC8000 Controllers, Two Enclosures, One Chain
Note: In a single-chain configuration, use SAS ports 2 and 4 to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown.
Enclosure 1
Enclosure 2
Controller A
Controller B
4 3 2 1
EN-SASx6x12/24 Enclosures
Dell Compellent 59
Dual SC8000 Controllers, Four Enclosures, Two Chains
Figure 46 illustrates two SC8000 controllers cabled to two 6 Gb enclosures. Each enclosure is on a separate chain. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. When two chains are used, IPC is optional.
A side, Chain 1
1 Controller A: slot 6, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port C →Controller B: slot 6, port 3.
B side, Chain 1
1 Controller A: slot 5, port 3 → Enclosure 2: bottom, port C.
2 Enclosure 2: bottom, port B →Enclosure 1: bottom, port A.
3 Enclosure 1: bottom, port C → Controller B: slot 5, port 1.
A side, Chain 2
1 Controller A: slot 6 port 3 → Enclosure 3: top, port C.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
3 Enclosure 4: top, port C →Controller B: slot 6, port 1.
B side, Chain 2
1 Controller A: slot 5 port 1→ Enclosure 4: bottom, port C.
2 Enclosure 4: bottom, port B. →Enclosure 3: bottom, port A.
3 Enclosure 3: bottom, port C → Controller B: slot 5, port 3.
Enclosure 1
Enclosure 2
Controller A
Controller B
Enclosure 3
Enclosure 4
Figure 46. Dual SC8000 Controllers, Two Enclosures, Two Chains
4 3 2 14 3 2 1
Chapter 4 Back End Cabling
60 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual SC8000 Controllers, Four Enclosures, One IO Card, Single Chain
Figure 47 illustrates two SC8000 controllers with one SAS IO Card cabled to four 6 Gb enclosures. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
IPC Connection
1 Controller A: slot 6, port 2 → Controller B: slot 6, port 4.
2 Controller B: slot 6, port 2 → Controller A: slot 6, port 4.
A side
1 Controller A: slot 6, port 1 →Enclosure 1: top, port C.
2 Enclosure 1, top, port B →Enclosure 2, top, port A.
3 Continue to daisy-chain enclosures:top, port B → next enclosure down: top, port A.
4 Enclosure 4: top, port C → Controller B: slot 6, port 3.
B side
1 Controller B: slot 6, port 1 → Enclosure 1: bottom, port C.
2 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
3 Continue to daisy-chain enclosures: bottom, port A → next enclosure down: bottom, port B.
4 Enclosure 4: bottom, port C → Controller A: slot 6, port 3.
Note: In a single-chain configuration, use SAS ports 2 and 4 to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Figure 47. Dual SC8000 Controllers, Four Enclosures, One IO Card, One Chain
4 2 13
EN-SASx6x12/24 Enclosures
Dell Compellent 61
Dual SC8000 Controllers, Eight Enclosures, Two Chains
To add redundancy with multiple IO cards, add a second SAS IO card. Create the A-side chain on the IO card in slot 6 and create the B-side chain on the IO card in slot 5. If an IO card, cable, enclosure, or controller fails, at least one side of a chain continues operating. IPC is optional in this configuration.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
Refer to Figure 48 on page 62 for cable connections.
1 Create IPC connections between both controllers on ports 2 and 4 of each IO card.
2 A side, Chain 1: Controller A: slot 6, port 1 → Enclosure 1: top, port C.
a Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B →next enclosure down: top, port A.
b Finish with Enclosure 4: top, port C → Controller B: slot 6, port 3.
3 B side, Chain 1: Controller A: slot 5, port 3 → Enclosure 4: bottom, port C.
a Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port B →next enclosure up: bottom, port A.
b Finish with Enclosure 1: bottom, port C → Controller B: slot 5, port 1.
4 A side, Chain 2: Controller A: slot 6, port 3 → Enclosure 5: top, port C.
a Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B →next enclosure down: top, port A.
b Finish with Enclosure 8: top, port C → Controller B: slot 6, port 1.
5 B side, Chain 2: Controller A: slot 5, port 1 → Enclosure 8: bottom, port C.
a Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port B →next enclosure up: bottom, port A.
b Finish with Enclosure 5: bottom, port C → Controller B: slot 5, port 3.
Chapter 4 Back End Cabling
62 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 48. Dual SC8000 Controllers, Eight Enclosures, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Enclosure 5
Enclosure 6
Enclosure 7
Enclosure 8
4 2 13
4 2 13
EN-SASx6x12/24 Enclosures
Dell Compellent 63
CT-SC040 Controller CablingThis section describes cabling for the CT-SC040 controller and SAS enclosures.
Single CT-SC040 Controller, Single Enclosure
Figure 49 illustrates a CT-SC040 cabled to a 6 Gb enclosure. Cabling is similar for a 3 Gb enclosure.
A side
Controller: slot 1, port 1 → Enclosure: top, port C.
B side
Controller: slot 1, port 3 → Enclosure: bottom, port C.
Figure 49. Single CT-SC040 Controller, Single 6 Gb Enclosure
Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager and visible in the LED display. The System Manager assigns an Index number only after the system is powered up and at least one drive is assigned to a Disk Folder. For more information about assigning disks to a disk folder, see the Storage Center System Setup Guide.
Enclosure
Controller
Chapter 4 Back End Cabling
64 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single CT-SC040 Controller, Four Enclosures, Single Chain
Figure 50 illustrates a single CT-SC040 controller cabled to four 6 Gb enclosures. Cabling is similar for a 3 Gb enclosure.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
A side
1 Controller: slot 1, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port B → Enclosure 3: top, port A.
4 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side
1 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
2 Enclosure 2: bottom, port A → Enclosure 3: bottom, port B.
3 Enclosure 3: bottom, port A → Enclosure 4: bottom, port B.
4 Enclosure 4: bottom, port C → Controller: slot 1, port 3.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Figure 50. Single CT-SC040 Controller, Single 6 Gb Chain
EN-SASx6x12/24 Enclosures
Dell Compellent 65
Single CT-SC040 Controller, Four Enclosures, Two IO Cards, Two Chains
Figure 51 illustrates a single CT-SC040 controller cabled to four SAS enclosures in two chains. When you add a second chain, you should also have a second IO card in the controller.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
A side, Chain 1
1 Controller: slot 1, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
B side, Chain 1
1 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
2 Enclosure 2: bottom, port C → Controller: slot 2, port 3.
A side, Chain 2
1 Controller: slot 1, port 3 → Enclosure 3: top, port C.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
B side, Chain 2
1 Enclosure 3: bottom, port A → Enclosure 4: bottom, port B.
2 Enclosure 4: bottom, port C → Controller slot 2, port 1.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Figure 51. Single CT-SC040 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains
Chapter 4 Back End Cabling
66 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual CT-SC040 Controllers, Two Enclosures, Single Chain
Figure 52 illustrates two CT-SC040 controllers cabled to two 6 Gb enclosures forming a single chain. Cabling is similar for a 3 Gb enclosure.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
IPC Connection
1 Controller A: port 2 → Controller B: port 4.
2 Controller B: port 2 → Controller A: port 4.
A side
1 Controller A: port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top, port C → Controller B: port 3.
B side
1 Controller B: port 1 → Enclosure 1: bottom, port C.
2 Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
3 Enclosure 2: bottom, port C → Controller A: port 3.
Figure 52. Dual CT-SC040 Controllers, Two Enclosures, One Chain
Note: In a single-chain configuration, use SAS ports 2 and 4 to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown.
Enclosure 1
Enclosure 2
Controller A
Controller B
EN-SASx6x12/24 Enclosures
Dell Compellent 67
Dual CT-SC040 Controllers, Four Enclosures, Two Chains
Figure 53 illustrates dual CT-SC040 controllers cabled to 6 Gb enclosures. Cabling is similar for a 3 Gb enclosure. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. In this dual-chain configuration, IPC cabling is optional.
A side, Chain 1
1 Controller A: slot 1, port 1 → Enclosure 1: top, port C.
2 Enclosure 1: top, port B → Enclosure 2: top, port A.
3 Enclosure 2: top port C →Controller B: slot 1, port 3.
B side, Chain 1
1 Controller A: slot 2, port 3 → Enclosure 2: bottom, port C.
2 Enclosure 2: bottom, port B →Enclosure 1: bottom, port A.
3 Enclosure 1: bottom, port C → Controller B: slot 2, port 1.
A side, Chain 2
1 Controller A: slot 1 port 3 → Enclosure 3: top, port C.
2 Enclosure 3: top, port B → Enclosure 4: top, port A.
3 Enclosure 4: top, port C → Controller B: slot 1, port 1.
B side, Chain 2
1 Controller A: slot 2, port 1 → Enclosure 4: bottom, port C.
2 Enclosure 4: bottom, port B →Enclosure 3: bottom, port A.
3 Enclosure 3: bottom, port C → Controller B: slot 2, port 3.
Enclosure 1
Enclosure 2
Controller A
Controller B
Enclosure 3
Enclosure 4
Figure 53. Dual CT-SC040 Controllers, Two Enclosures, Two Chains
Chapter 4 Back End Cabling
68 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual CT-SC040 Controllers, Eight Enclosures, Two Chains
To add redundancy with multiple IO cards, create the A-side chain on the IO card in slot 1. Create the B-side chain on the IO card in slot 2. If an IO card, cable, enclosure, or controller fails, at least one side of a chain continues operating.
Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures.
Refer to Figure 54 on page 69 for cable connections.
A side, Chain
1 Controller A: slot 1, port 1 → Enclosure 1: top, port C.
2 Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B → next enclosure down: top, port A.
3 Finish with Enclosure 4: top, port C → Controller B: slot 1, port 3.
B side, Chain
1 Controller A: slot 2, port 3 → Enclosure 4: bottom, port C.
2 Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port B → next enclosure up: bottom, port A.
3 Finish with Enclosure 1: bottom, port C → Controller B: slot 2, port 1.
A side, Chain 2
1 Controller A: slot 1, port 3 → Enclosure 5: top, port C.
2 Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B → next enclosure down: top, port A.
3 Finish with Enclosure 8: top, port C → Controller B: slot 1, port 1.
B side, Chain 2
1 Controller A: slot 2, port 1 → Enclosure 8: bottom, port C.
2 Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port B → next enclosure up: bottom, port A.
3 Finish with Enclosure 5: bottom, port C → Controller B: slot 2, port 3.
EN-SASx6x12/24 Enclosures
Dell Compellent 69
Figure 54. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Enclosure 5
Enclosure 6
Enclosure 7
Enclosure 8
Chapter 4 Back End Cabling
70 Storage Center CT-SC040 and SC8000 Connectivity Guide
SBOD EnclosuresRedundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant loop includes an A side (shown in these diagrams in red) and B side (shown in blue). In a dual-controller Storage Center, each side of the loop begins on one controller and ends on the second controller.
This section provides cabling information for SBOD enclosures to the following controllers:
• SC8000 Controller Cabling begins on page 71
• CT-SC040 Controller Cabling begins on page 76
Cabling Best PracticesThe following rules apply to SBOD cabling:
• SBOD supports a maximum of seven enclosures per loop.
• An SBOD loop must contain only SBOD enclosures; do not mix SBOD, SATA, or SAS in the same loop.
• Each loop must contain enclosures of the same transport speed.
• The transport speed of the enclosure must match the transport speed of the IO card.
• Each SBOD enclosure requires a separate Enclosure ID Switch number (1 through 7). See SBOD Port ID on page 27.
• Connect adjacent ports on a Fibre Channel IO card to different enclosures to ensure port-level redundancy. For example, connect ports 1 and 2 to different enclosures. This is typically accomplished using A-side and B-side loops.
Note: SBOD enclosures are supported by the SC8000 controller only when migrated from existing Storage Centers.
SBOD Enclosures
Dell Compellent 71
SC8000 Controller CablingThis section describes cabling for the SC8000 controller and SBOD enclosures.
Single SC8000 Controller, Single Enclosure
In a single-controller, single-enclosure configuration, the controller is connected to the enclosure using two FC paths. For redundancy, the two FC paths connect to separate hardware components in both the controller and the enclosure.
A side
Controller: slot 4, port 1 → Enclosure: right, Host 0.
B side
Enclosure: left, Host 0 → Controller: slot 5, port 1.
Figure 55. Single SC8000 Controller, Single SBOD Enclosure
Enclosure
Controller
Chapter 4 Back End Cabling
72 Storage Center CT-SC040 and SC8000 Connectivity Guide
Using Low-Profile Fibre Channel Ports
The SC8000 Controller includes three slots for low-profile IO cards. When using these ports, make sure that port 1 and port 2 connect to different enclosures, or use port 1 for front-end and port 2 for back-end connections.
A side
Controller: slot 1, port 2 → Enclosure: right, Host 0.
B side
Enclosure: left, Host 0 → Controller: slot 2, port 2.
Figure 56. Single SC8000 Controller, Single SBOD Enclosure
Note: Port numbering on the low profile IO cards in slots 1–3 begins with port 1 on the left. Port numbering on the standard profile IO cards in slots 4–6 begins with port 1 on the right.
Enclosure
Controller
4 2 1321
SBOD Enclosures
Dell Compellent 73
Single SC8000 Controller, Multiple Enclosures
In a single-controller, multiple-enclosure configuration, the back-end cabling is a basic daisy chain. The controller is connected to the enclosures using two pairs of FC cables. For redundancy, the two FC paths connect to separate hardware components in both the controller and the enclosure.
A side
1 Controller: slot 4, port 1 → Enclosure 2: right, Host 0.
2 Enclosure 2: right, Host 1 → Enclosure 1 right, Host 0.
B side
1 Controller: slot 5, port 1 → Enclosure 1: left, Host 0.
2 Enclosure 1: left, Host 1 → Enclosure 2: left, Host 0.
Figure 57. Single SC8000 Controller, Multiple SBOD Enclosures
Note: The SC8000 Controller includes three slots for low-profile IO cards (slots 1–3), which may be used for back-end connections. Keep in mind that port 1 on the low-profile cards is to the left. (See page 72 for an example with low profile card connections.)
Enclosure 1
Enclosure 2
Controller
Chapter 4 Back End Cabling
74 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual SC8000 Controllers, Multiple Enclosures
In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain fashion. Typically, each controller is connected to the enclosure using two FC paths, one connected to the top of the chain and the other connected to the end of the FC path from the other controller.
The cabling in Figure 58 shows typical dual-controller, multiple-enclosure cabling:
A side
1 Controller B: slot 5, port 1→Enclosure 1: right, Host 0.
2 Enclosure 1: right, Host 1 →Enclosure 2 right, Host 0.
3 Enclosure 2: right, Host 1 →Enclosure 3 right, Host 0.
4 Enclosure 3: right, Host 1 →Controller A: slot 5, port 1.
B side
1 Controller A: slot 4, port 1 →Enclosure 1: left, Host 0.
2 Enclosure 1: left, Host 1 →Enclosure 2: left, Host 0.
3 Enclosure 2: left, Host 1 →Enclosure 3: left, Host 0.
4 Enclosure 3: left, Host 1 →Controller B: slot 4, port 1.
Figure 58. Dual SC8000 Controllers, Multiple SBOD Enclosures
Enclosure 1
Enclosure 2
Enclosure 3
Controller B
Controller A
SBOD Enclosures
Dell Compellent 75
Dual SC8000 Controllers, Multiple Enclosures, Multiple Loops
In a dual-controller, multiple-enclosure configuration with more than one loop, the cabling is a modified daisy chain with multiple loops. The cabling in Figure 59 shows typical dual-controller, multiple-enclosure cabling.
A side, Loop 1
1 Controller B: slot 5, port 1 →Enclosure 1: right, Host 0.
2 Enclosure 1: right, Host 1 →Enclosure 2: right, Host 0.
3 Enclosure 2: right, Host 1 →Enclosure 3: right, Host 0.
4 Enclosure 3: right, Host 1 →Controller A: slot 5, port 1.
B side, Loop 1
1 Controller A: slot 4, port 1 →Enclosure 1: left, Host 0.
2 Enclosure 1: left, Host 1 →Enclosure 2: left, Host 0.
3 Enclosure 2: left, Host 1 →Enclosure 3: left, Host 0.
4 Enclosure 3: left, Host 1 →Controller B: slot 4 port 1.
A side, Loop 2
1 Controller B: slot 5, port 2 →Enclosure 4: right, Host 0.
2 Enclosure 4: right, Host 1, →Enclosure 5: right, Host 0.
3 Enclosure 5: right, Host 1, →Enclosure 6: right, Host 0.
4 Enclosure 6: right, Host 1, →Controller A: slot 5, port 2.
B side, Loop 2
1 Controller A: slot 4, port 2 →Enclosure 4: left, Host 0.
2 Enclosure 4: left, Host 1, →Enclosure 5: left, Host 0.
3 Enclosure 5: left, Host 1, →Enclosure 6: left, Host 0.
4 Enclosure 6: left, Host 1, →Controller B: slot 4, port 2.
Figure 59. Dual SC8000 Controllers, Multiple Loops
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Enclosure 5
Enclosure 6
Chapter 4 Back End Cabling
76 Storage Center CT-SC040 and SC8000 Connectivity Guide
CT-SC040 Controller CablingThis section shows typical cabling for CT-SC040 controllers with SBOD enclosures. See Cabling Best Practices on page 70 for general cabling guidelines.
Single CT-SC040 Controller, Single SBOD Enclosure
In a single controller, single enclosure configuration, the controller is connected to the enclosure using two FC paths. For redundancy, the two FC paths connect to separate hardware components in both the controller and the enclosure.
A side
Controller: slot 1, port 4 → Enclosure: right, Host 0.
B side
Enclosure: left, Host 0 → the Controller: slot 2, port 4.
Figure 60. Single CT-SC040 Controller, Single SBOD Enclosure
Note: Connect A sides of all enclosures together with one loop; connect B sides together with a second loop.
Enclosure
Controller
SBOD Enclosures
Dell Compellent 77
Single CT-SC040 Controller, Multiple Enclosures
In a single controller, multiple enclosure configuration, the back-end cabling is a basic daisy chain. The controller is connected to the enclosure using two pairs of FC cables.The two FC paths connect to additional enclosures.
A side
1 Controller: slot 1, port 4 → Enclosure 2: right, Host 0.
2 Enclosure 2: right, Host 1 → Enclosure 1: right, Host 0.
B side
1 Controller: slot 2, port 4 → Enclosure 1: left, Host 0.
2 Enclosure 1: left, Host 1 → Enclosure 2: left, Host 0.
Figure 61. Single CT-SC040 Controller, Multiple SBOD Enclosures
Enclosure 1
Enclosure 2
Controller
Chapter 4 Back End Cabling
78 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual CT-SC040 Controllers, Single Enclosure, Dual IO Cards
In a dual-controller, single-enclosure configuration, the back-end cabling follows the same basic principles as a single-controller, single-enclosure configuration for each controller. Each controller is connected to the enclosure using two FC paths. Both paths connect from one controller to the enclosure to the other controller.
A side
1 Controller A: slot 1, port 4 → Enclosure 1, right, Host 1.
2 Enclosure: right, Host 0 → Controller B, slot 1, port 4.
B side
1 Controller B: slot 2, port 4 → Enclosure: left, Host 1.
2 Enclosure: left, Host 0 → Controller A: slot 2, port 4.
Figure 62. Dual CT-SC040 Controllers, Single SBOD Enclosure
Enclosure
Controller A
Controller B
SBOD Enclosures
Dell Compellent 79
Dual CT-SC040 Controllers, Multiple Enclosures
In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain. Typically, each controller is connected to the enclosure using two FC paths: one connected to the top of the chain, and the other connected to the end of the FC path from the other controller.
The cabling in Figure 63 depicts normal dual-controller, multiple-enclosure cabling:
A side
1 Controller B: slot 1, port 4 →Enclosure 1: right, Host 0.
2 Enclosure 1: right, Host 1 →Enclosure 2 right, Host 0.
3 Enclosure 2: right, Host 1 →Enclosure 3 right, Host 0.
4 Enclosure 3: right, Host 1 →Controller A: slot 1, port 4.
B side
1 Controller A: slot 2, port 4 →Enclosure 1: left, Host 0.
2 Enclosure 1: left, Host 1 →Enclosure 2: left, Host 0.
3 Enclosure 2: left, Host 1 →Enclosure 3: left, Host 0.
4 Enclosure 3: left, Host 1 →Controller B: slot 2, port 4.
Figure 63. Dual CT-SC040 Controllers, Multiple SBOD Enclosures
Enclosure 1
Enclosure 2
Enclosure 3
Controller B
Controller A
Chapter 4 Back End Cabling
80 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual CT-SC040 Controllers, Multiple Enclosures, Multiple Loops
In a dual-controller, multiple-enclosure configuration with more than one loop, the cabling is a modified daisy chain with multiple loops. The cabling in Figure 64 depicts normal dual-controller, multiple-enclosure cabling.
A side, Loop 1
1 Controller B: slot 1, port 4 →Enclosure 1, right, Host 0.
2 Enclosure 1: right, Host 1 →Enclosure 2 right, Host 0.
3 Enclosure 2: right, Host 1 →Enclosure 3 right, Host 0.
4 Enclosure 3: right, Host 1 →Controller A: slot 1, port 4.
B side, Loop 1
1 Controller A: slot 2, port 4 →Enclosure 1, left, Host 0.
2 Enclosure 1: left, Host 1 →Enclosure 2, left, Host 0.
3 Enclosure 2: left, Host 1 →Enclosure 3, left, Host 0.
4 Enclosure 3: left, Host 1 →Controller B: slot 2 port 4.
A side, Loop 2
1 Controller B: slot 1, port 3 →Enclosure 4: right, Host 0.
2 Enclosure 4: right, Host 1 →Enclosure 5: right, Host 0.
3 Enclosure 5: right, Host 1 →Enclosure 6: right, Host 0.
4 Enclosure 6: right, Host 1 →Controller A: slot 1, port 3.
B side, Loop 2
1 Controller A: slot 2, port 3 →Enclosure 4: left, Host 0.
2 Enclosure 4: left, Host 1 →Enclosure 5, left, Host 0.
3 Enclosure 5: left, Host 1 →Enclosure 6, left, Host 0.
4 Enclosure 6: left, Host 1 →Controller B: slot 2, port 3.
Figure 64. Dual CT-SC040 Controllers, Multiple Loops
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller B
Controller A
Enclosure 5
Enclosure 6
SATA Enclosures
Dell Compellent 81
SATA EnclosuresRedundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). For connections to SATA enclosures, connect A sides of all enclosures together with one loop, then connect B sides together with a second loop. The A-side loop starts at the top of the first enclosure, and the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure.
Cabling Best Practices• Make sure that each SATA enclosure has a unique Enclosure ID Switch number (1 through 7). Refer to
SATA Enclosures on page 81.
• One loop can support up to five SATA enclosures.
• For redundancy, make sure that ports 1 and 2 connect to different enclosures, and that ports 3 and 4 connect to different enclosures. This is typically accomplished using A-side and B-side loops. Adjacent ports on a fibre channel IO card are controlled by a single source. For example, ports 1 and 2 are paired, and ports 3 and 4 are paired.
SC8000 Controller CablingThis section describes cabling for the SC8000 controller and SATA enclosures.
Single Controller, Single SATA Enclosure
A side
Controller: slot 5, port 1 → Enclosure: right, port 3.
B side
Enclosure: left, port 2 → Controller: slot 4, port 1.
Figure 65. Single SC8000 Controller, Single SATA Enclosure
Note: SATA enclosures are supported by the SC8000 controller only when migrated from existing Storage Centers.
Enclosure
Controller
Chapter 4 Back End Cabling
82 Storage Center CT-SC040 and SC8000 Connectivity Guide
Using Low-Profile Fibre Channel Ports
The SC8000 Controller includes three slots for low profile IO cards, which may be used for back-end connections. For redundancy, make sure that port 1 and port 2 connect to different enclosures, or use port 1 for front-end and port 2 for back-end connections.
A side
Controller: slot 5, port 1 → Enclosure: right, port 3.
B side
Enclosure: left, port 2 → Controller: slot 3, port 2.
Figure 66. Single SC8000 Controller, Single SATA Enclosure
Note: Port numbering on the low profile IO cards in slots 1–3 begins with port 1 on the left. Port numbering on the standard profile IO cards in slots 4–6 begins with port 1 on the right.
Enclosure
Controller4 2 1321
SATA Enclosures
Dell Compellent 83
Single Controller, Two SATA Enclosures
Figure 67 illustrates a single SC8000 Controller cabled to two SATA Enclosures. Typically, the controller is connected to the enclosure using two Fibre Channel paths.
A side
1 Controller: slot 5, port 1 → Enclosure 2: right, port 3.
2 Enclosure 2: right, port 4 → Enclosure 1: right, port 3.
B side
1 Controller: slot 4, port 1 → Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 → Enclosure 2: left, port 2.
Figure 67. Single SC8000 Controller, Two SATA Enclosures
Enclosure 1
Enclosure 2
Controller
4 2 1321
Chapter 4 Back End Cabling
84 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single Controller, Five SATA Enclosures
In a single controller, multiple enclosure configuration, the back-end cabling is a basic daisy chain. A single loop can contain a maximum of five enclosures.
A side
1 Controller: slot 5, port 1 → Enclosure 5: right, port 3.
2 Enclosure 5: right, port 4 → Enclosure 4: right, port 3.
3 Enclosure 4: right, port 4 → Enclosure 3: right, port 3.
4 Enclosure 3: right, port 4 → Enclosure 2: right, port 3.
5 Enclosure 2: right, port 4 → Enclosure 1: right, port 3.
B side
1 Controller: slot 4, port 1 → Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 → Enclosure 2: left, port 2.
3 Enclosure 2: left, port 1 → Enclosure 3: left, port 2.
4 Enclosure 3: left, port 1 → Enclosure 4: left, port 2.
5 Enclosure 4: left, port 1 → Enclosure 5: left, port 2.
Figure 68. Single SC8000 Controller, Five SATA Enclosures
Enclosure 1
Enclosure 2
Controller
Enclosure 3
Enclosure 4
Enclosure 5
4 2 13
SATA Enclosures
Dell Compellent 85
Two Controllers, Four SATA Enclosures, Single Loop
In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain. This configuration connects to the A side and B side of each enclosure. The A-side loop starts at the top of the first enclosure; the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure.
A side
1 Controller B: slot 4, port 1 →Enclosure 1: right, port 3.
2 Enclosure 1: right, port 4 →Enclosure 2: right, port 3.
3 Enclosure 2: right, port 4 → Enclosure 3: right, port 3.
4 Enclosure 3: right, port 4 →Enclosure 4: right, port 3.
5 Enclosure 4: right, port 4 →Controller A: slot 4, port 1.
B side
1 Controller A: slot 5, port 1 →Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 →Enclosure 2: left, port 2.
3 Enclosure 2: left, port 1 →Enclosure 3: left, port 2.
4 Enclosure 3: left, port 1 →Enclosure 4: left, port 2.
5 Enclosure 4: left, port 1 →Controller B: slot 5, port 1.
Figure 69. Two SC8000 Controllers, Four SATA Enclosures, Single Loop
Enclosure 1
Enclosure 2
Controller B
Enclosure 3
Enclosure 4
Controller A
Chapter 4 Back End Cabling
86 Storage Center CT-SC040 and SC8000 Connectivity Guide
Two Controllers, Seven SATA Enclosures, Two Loops
A single loop can contain a maximum of five enclosures. If a single Storage Center will have more than five enclosures, then multiple loops will have to be used. When you have multiple loops, each controller should have two IO cards as shown in Figure 70 on page 87.
A Side, Loop 1
1 Controller B: slot 5, port 1 → Enclosure 1: right, port 3.
2 Enclosure 1: right, port 4 → Enclosure 2: right, port 3.
3 Enclosure 2: right, port 4 → Enclosure 3: right, port 3.
4 Enclosure 3: right, port 4 → Enclosure 4: right, port 3.
5 Enclosure 4: right, port 4 → Controller A: slot 5, port 1.
B side, Loop 1
1 Controller A: slot 4, port 1 → Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 → Enclosure 2: left, port 2.
3 Enclosure 2: left, port 1 → Enclosure 3: left, port 2.
4 Enclosure 3: left, port 1 → Enclosure 4: left, port 2.
5 Enclosure 4: left, port 1 → Controller B: slot 4, port 1.
A Side, Loop 2
1 Controller B: slot 5, port 2 → Enclosure 5: right, port 3.
2 Enclosure 5: right, port 4 → Enclosure 6: right, port 3.
3 Enclosure 6: right, port 4 → Enclosure 7: right, port 3.
4 Enclosure 7: right, port 4 → Controller A: slot 5, port 2.
B side, Loop 2
1 Controller A: slot 4, port 2 → Enclosure 5: left, port 2.
2 Enclosure 5: left, port 1 → Enclosure 6: left, port 2.
3 Enclosure 6: left, port 1 → Enclosure 7: left, port 2.
4 Enclosure 7: left, port 1 → Controller B: slot 4, port 2.
SATA Enclosures
Dell Compellent 87
Figure 70. Two SC8000 Controllers, Seven SATA Enclosures, Two Loops
Enclosure 1
Enclosure 2
Controller B
Enclosure 3
Enclosure 4
Controller A
Enclosure 5
Enclosure 6
Enclosure 7
Chapter 4 Back End Cabling
88 Storage Center CT-SC040 and SC8000 Connectivity Guide
CT-SC040 Controller CablingThis section shows typical cabling for CT-SC040 controllers with SATA enclosures. See Cabling Best Practices on page 81 for general cabling guidelines.
Single Controller, Single SATA Enclosure
A side
Controller: slot 2, port 1 → Enclosure: right, port 3.
B side
Enclosure: left, port 2 → Controller: slot 1, port 1.
Figure 71. Single CT-SC040 Controller, Single SATA Enclosure
Enclosure
Controller
SATA Enclosures
Dell Compellent 89
Single Controller, Two SATA Enclosures
Figure 72 illustrates a single CT-SC040 Controller cabled to two SATA Enclosures. Typically, the controller is connected to the enclosures using two Fibre Channel paths.
A side
1 Controller: slot 2, port 1 → Enclosure 2: right, port 3.
2 Enclosure 2: right, port 4 → Enclosure 1: right, port 3.
B side
1 Controller: slot 1, port 1 → Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 → Enclosure 2: left, port 2.
Figure 72. Single CT-SC040 Controller, Two SATA Enclosures
Enclosure 1
Enclosure 2
Controller
Chapter 4 Back End Cabling
90 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single Controller, Five SATA Enclosures
In a single-controller, multiple-enclosure configuration, the back-end cabling is a basic daisy chain. A single loop can contain a maximum of five enclosures.
A side
1 Controller: slot 2, port 1 → Enclosure 5: right, port 3.
2 Enclosure 5: right, port 4 → Enclosure 4: right, port 3.
3 Enclosure 4: right, port 4 → Enclosure 3: right, port 3.
4 Enclosure 3: right, port 4 → Enclosure 2: right, port 3.
5 Enclosure 2: right, port 4 → Enclosure 1: right, port 3.
B side
1 Controller: slot 1, port 1 → Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 → Enclosure 2: left, port 2.
3 Enclosure 2: left, port 1 → Enclosure 3: left, port 2.
4 Enclosure 3: left, port 1 → Enclosure 4: left, port 2.
5 Enclosure 4: left, port 1 → Enclosure 5: left, port 2.
Figure 73. Single CT-SC040 Controller, Five SATA Enclosures
Enclosure 1
Enclosure 2
Controller
Enclosure 3
Enclosure 4
Enclosure 5
SATA Enclosures
Dell Compellent 91
Two Controllers, Four SATA Enclosures, Single Loop
In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain. This configuration connects to the A side and B side of each enclosure. The A-side loop starts at the top of the first enclosure, and the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure.
A side
1 Controller B: slot 1, port 1 →Enclosure 1: right, port 3.
2 Enclosure 1: right, port 4 →Enclosure 2: right, port 3.
3 Enclosure 2: right, port 4 →Enclosure 3: right, port 3.
4 Enclosure 3: right, port 4 →Enclosure 4: right, port 3.
5 Enclosure 4: right, port 4 →Controller A: slot 1, port 2.
B side
1 Controller A: slot 1, port 1 →Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 →Enclosure 2: left, port 2.
3 Enclosure 2: left, port 1 →Enclosure 3: left, port 2.
4 Enclosure 3: left, port 1 →Enclosure 4: left, port 2.
5 Enclosure 4: left, port 1 →Controller B: slot 1, port 2.
Figure 74. Two CT-SC040 Controllers, Four SATA Enclosures, Single Loop
Enclosure 1
Enclosure 2
Controller B
Enclosure 3
Enclosure 4
Controller A
Chapter 4 Back End Cabling
92 Storage Center CT-SC040 and SC8000 Connectivity Guide
Two Controllers, Seven SATA Enclosures, Two Loops
A single loop can contain a maximum of five enclosures. If a single Storage Center will have more than five enclosures, then multiple loops will have to be used. When you have multiple loops, each controller should have two IO cards as shown in Figure 70 on page 87.
A Side, Loop 1
1 Controller B: slot 2, port 3 → Enclosure 1: right, port 3.
2 Enclosure 1: right, port 4 → Enclosure 2: right, port 3.
3 Enclosure 2: right, port 4 → Enclosure 3: right, port 3.
4 Enclosure 3: right, port 4 → Enclosure 4: right, port 3.
5 Enclosure 4: right, port 4 → Controller A: slot 2, port 3.
B side, Loop 1
1 Controller A: slot 1, port 3 → Enclosure 1: left, port 2.
2 Enclosure 1: left, port 1 → Enclosure 2: left, port 2.
3 Enclosure 2: left, port 1 → Enclosure 3: left, port 2.
4 Enclosure 3: left, port 1 → Enclosure 4: left, port 2.
5 Enclosure 4: left, port 1→ Controller B: slot 1, port 3.
A Side, Loop 2
1 Controller B: slot 2, port 4 → Enclosure 5: right, port 3.
2 Enclosure 5: right, port 4 → Enclosure 6: right, port 3.
3 Enclosure 6: right, port 4 → Enclosure 7: right, port 3.
4 Enclosure 7: right, port 4 → Controller A: slot 2, port 4.
B side, Loop 2:
1 Controller A: slot 1, port 4 → Enclosure 5: left, port 2.
2 Enclosure 5: left, port 1 → Enclosure 6: left, port 2.
3 Enclosure 6: left, port 1 → Enclosure 7: left, port 2.
4 Enclosure 7: left, port 1 → Controller B: slot 1, port 4.
Figure 75. Two CT-SC040 Controllers, Seven SATA Enclosures, Two Loops
Enclosure 1
Enclosure 2
Controller B
Enclosure 3
Enclosure 4
Controller A
Enclosure 5
Enclosure 6
Enclosure 7
Dell Compellent 93
5 Front-End Cabling
This chapter how to connect Dell Compellent controllers to servers, network appliances, and discusses redundancy.
ContentsOverview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Server HBA Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
Best Practices for Fibre Channel Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
System Manager WWN Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Multipath IO (MPIO) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
SC8000 Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
CT-SC040 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Chapter 5 Front-End Cabling
94 Storage Center CT-SC040 and SC8000 Connectivity Guide
OverviewFront-end cabling refers to connections between the controller and the server. Servers should be connected to the controller through a network switch, which, when combined with cabling techniques provides redundancy through multipathing. Front-end connections can be can be made using iSCSI, Fibre Channel, or Fibre Channel over Ethernet (FCoE).
Legacy Mode vs. Virtual PortsStorage Center uses either Legacy mode or Virtual Port mode to transport data to the storage disks. Figure 76 on page 95 compares a single switch Fibre Channel configuration in Legacy mode with Virtual Port mode.
Legacy Mode
In legacy mode, front-end IO ports are broken into primary and reserve ports based on a fault domain. Fault domains identify port usage when a controller or port fails. During normal operation, IO is transported on primary ports only. Reserve ports remain in a standby mode until a controller failure, at which point the primary port fails over to the reserve port on the running controller.
Virtual Ports
When licensed, Storage Center can use Virtual Ports, which treats all ports as primary ports for transporting data. Virtual ports expand the number of possible server connections on the front end. In virtual port mode, all ports are active, and if one port fails, the load is distributed between the remaining ports within the same domain.
A domain in Virtual Port mode is determined by the number of fabrics. A fabric is determined by the number of independent switches or VLANS, so the number of domains is based on whether separate VLANS or subnets will be used.
To configure Virtual Ports, use the Storage Center System Manager Configure Local Ports wizard. See the Storage Center System Manager Administrator’s Guide for detailed instructions.
Server HBA SettingsSee Appendix B in the Storage Center System Manager Administrator’s Guide for information about server HBA settings for connecting to the SC8000 controller.
Switch Settings
Dell Compellent 95
Switch SettingsSee Appendix C in the Storage Center System Manager Administrator’s Guide for information about switch settings.
Figure 76. Dual-Controller FC Legacy Mode vs. Virtual Ports
Controller A
FC Switch
Server
Controller BPrimary Port — P2
Primary Port — P1 Reserved Port — R1
Reserved Port — R2
FC Switch
Server
Controller A Controller B
Legacy Mode
Virtual Ports
ETH 0 to switch
iDRAC
ETH 0 to switch
iDRAC
Chapter 5 Front-End Cabling
96 Storage Center CT-SC040 and SC8000 Connectivity Guide
Best Practices for Fibre Channel ZoningWhen using Fibre Channel for front-end connectivity, zones must be established to ensure that disk storage is visible to the servers. Zoning can be applied to either the ports on switches or to the World Wide Names (WWNs) of the end devices. Zones should be created using a single initiator (using physical WWNs) and multiple targets (using virtual WWNs). Physical and virtual WWNs are identified in System Manager as shown in Figure 77 on page 97.
In a dual-controller configuration, the virtual WWNs from each controller need to be included in the zone with each host’s WWN. Follow the rules below for Fibre Channel zoning.
WWN ZoningIn WWN zoning, since the switch is seeking a WWN, a device may reside on any port or change physical ports and still be visible.
Legacy Mode
• Include all Storage Center front-end WWNs or ports in a single zone.
• Create server zones that contain a single initiator and multiple targets, and which include the server HBA WWN.
Virtual Port Mode
• Include all Storage Center virtual WWNs in a single zone.
• Include all Storage Center physical WWNs in a single zone.
• Create server zones that contain a single initiator and multiple targets (Storage Center virtual WWNs), and which include the server HBA WWN.
FC Replication Zoning
• Include all Storage Center physical WWNs from System A and B in a single zone.
• Include all Storage Center physical WWNs of System A and the virtual WWNs of System B on the particular Fabric.
• Include all Storage Center physical WWNs of System B and the virtual WWNs of System A on the particular Fabric.
Port ZoningIn port zoning, only specific switch ports are visible, so if a storage device is moved to a different port, it is no longer visible to the switch.
Legacy Mode or Virtual Port Mode
• Include all Storage Center front-end ports.
• Create server zones which contain all Storage Center front-end ports and a single server port.
FC Replication Zoning
Include all Storage Center front-end ports from System A and System B in a single zone.
Note: Some ports may not be used or dedicated for replication, however ports that are used must be in these zones.
Note: Best practice for Virtual Ports mode is to zone with WWNs.
System Manager WWN Identification
Dell Compellent 97
System Manager WWN IdentificationIn Virtual Port mode, two WWNs are created for each front-end port. The Storage Center System Manager indicates physical WWNs using a green IO Card icon and virtual WWNs using a blue icon, as shown in Figure 77 below.
Figure 77. Port WWNs in Storage Center System Manager
Note: If you are using WWN zoning, virtual WWNs and physical WWNs must be in separate zones. Virtual WWNs are used in server connection zones.
Physical WWN
Virtual WWN
Chapter 5 Front-End Cabling
98 Storage Center CT-SC040 and SC8000 Connectivity Guide
Multipath IO (MPIO)MPIO software offers redundancy at the path level. MPIO loads as a driver on the server, and typically operates in a round-robin manner by sending packets first down one path and then the other. If a path fails, MPIO software continues to send packets down the functioning path. MPIO is operating-system specific.
• Windows Server 2003 uses Dell Compellent Multipath Manager. To install and configure the Dell Compellent Multipath Manager, see the Storage Center Multipath IO (MPIO) Manager for Microsoft Servers User Guide.
• Windows Server 2012, 2008, and 2008 R2 use the Microsoft Device-Specific Module (DSM) to manage all aspects of failover and load balancing. To install and configure the Microsoft DSM, see the Storage Center Microsoft Multipath IO (MPIO) Best Practices.
SC8000 Controller Front-End CablingThis section provides examples for connecting front-end cables to the SC8000 controller.
Ethernet Management and iDRAC CablingAll front-end cabling must include the iDRAC and Ethernet connections to the Ethernet switch as described below and on page 98.
• The ETH 0 port supports system login and access to the management software. It is also used to send email, alerts, SNMP traps, and system data using Phone Home.
• The iDRAC connection provides access to the controller for system information and diagnostics.
Single Controller Ethernet Management and iDRAC Cabling
1 During installation and setup, assign a static IP address to ETH 0. See Storage Center System Setup Guide for more detailed information.
2 Connect the 1 Gb ETH 0 (port 0) to an Ethernet switch.
3 Connect the iDRAC port to the Ethernet switch using a 1 Gb Ethernet cable.
Figure 78. Single Controller Ethernet Connection
Corporate/Public Network
Switch
Controller
1 Gb ETH 0iDRAC
31 20IPC MGMT
SC8000 Controller Front-End Cabling
Dell Compellent 99
Dual-Controller Ethernet Management and iDRAC Cabling
To connect Ethernet management for two controllers:
1 Connect the 10 Gb ETH 1 (port 1) on one controller to the same port on the second controller. Use a Category (Cat.) 6 cable for this connection.
2 Connect the 1 Gb ETH 0 (port 0) on each controller to an Ethernet switch or VLAN.
3 Connect the iDRAC port to the same Ethernet switch using a 1 Gb Ethernet cable.
Figure 79. Dual-Controller Ethernet Connection
Note: Storage Center currently runs the 10 Gb ports at 1 Gb speed. Use a Cat. 6 cable to ensure that a hardware change is unnecessary when 10 Gb rates are implemented.
Switch
Controller A
Controller B
ETH 0 Port
1 Gb ETH 0 Port
ETH 1 Port
ETH 1 Port
iDRAC
iDRAC
31 20IPC MGMT
31 20IPC MGMT
Corporate/Public Network
Chapter 5 Front-End Cabling
100 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single-Controller Front-End CablingMake sure that the front-end cables are labeled at each end. If not, apply identification labels as directed in the SC8000 Cable Labeling Guide included in the cable package.
Single Controller, Single Server
Connect a single server to the controller using a switch as shown below. The drawing shows a Fibre Channel connection. iSCSI cabling follows the same pattern, connecting from the iSCSI port on the controller, to the switch, and then to the server. Add Ethernet and iDRAC cabling as shown on page 98.
Figure 80. Single Controller, Single Server, FC
Note: For low-profile cards (slots 1–3), ports are numbered beginning with port 1 on the left.
Switch
Controller
1 2
Corporate/Public Network
SC8000 Controller Front-End Cabling
Dell Compellent 101
Single Controller, Multiple ServersConnect multiple servers to the controller through a switch. Figure 81 shows the cabling for a Fibre Channel connection. iSCSI cabling follows the same pattern, connecting each server through the switch to the iSCSI port on the controller. Add Ethernet and iDRAC cabling as shown on page 98.
Figure 81. Single Controller, Multiple Servers, Fibre Channel
Controller
FC Switch
1 2
Corporate/Public Network
Chapter 5 Front-End Cabling
102 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single Controller, Multiple ServersConnect multiple server types through switches to the controller as shown below. Add Ethernet and iDRAC cabling as shown on page 99.
Figure 82. Single Controller, Multiple Servers
Controller
FC Switch Ethernet Switch
1 2
Corporate/Public Network
SC8000 Controller Front-End Cabling
Dell Compellent 103
Fault DomainsStorage Center cabling supports fault domains to increase redundancy. Fault domains can be implemented in either Legacy mode or in Virtual Port mode.
Legacy Mode (Fibre Channel)
In legacy mode, front-end IO ports are divided into primary and reserve ports based on a fault domain. Fault domains identify allowed port movement when a controller or port fails. During normal operation, IO is transported on primary ports only. The reserve port remains in a standby mode until a controller failure, at which point the primary port fails over to the reserve port on the running controller. Ethernet and iDRAC cabling are added as shown on page 99.
Each fault domain consists of sets of primary and reserve paths (P1-R1, P2-R2, and so on). To provide redundancy, a primary port and its reserve port in that fault domain must connect to the same switch. Connecting ports in this way, the primary paths provide redundancy for a single server path or fabric failure. Reserve paths provide redundancy for single controller failure.
For example, in Figure 83, Fabric A includes Switch 1 and primary data paths for fault domains 1 and 2. Fabric B includes Switch 2 and primary data paths for fault domains 3 and 4. Ethernet and iDRAC cabling would be added as shown on page 99.
This is a highly robust failover solution, but it requires four primary data paths and four reserve data paths for proper failover. In addition, the reserve ports remain unused unless a primary path fails.
Figure 83. Front-End Legacy Mode FC Fault Domains
R4
P1
R2 P3
P2
R1 P4 R3
Controller B
Switch 1
Server 1
Controller A
Server 2
Switch 2
1 2
1 2
Chapter 5 Front-End Cabling
104 Storage Center CT-SC040 and SC8000 Connectivity Guide
Virtual Ports (Fibre Channel)
Fault domains are determined by the number of independent fabrics. In the figure below, each switch carries a separate fault domain. Virtual port mode eliminates the need for reserve ports, since all ports are primary and can read and write IO. If a port fails, any port within the same fault domain takes over for the failed port. Using multipathing, volumes are mapped to ports in more than one fault domain.
To connect independent fabrics to support separate fault domains:
1 Connect each server to both switches.
2 Connect one port on each IO card of each controller to both switches.
3 Connect Ethernet and iDRAC ports as shown on page 99.
Figure 84. Front-End Virtual Ports FC Fault Domains
Controller B
Switch 1
Server 1
Controller A
Server 2
Switch 2
1 2
1 2
SC8000 Controller Front-End Cabling
Dell Compellent 105
Fibre Channel FailoverFor proper failover, associate Fibre Channel connections with a fault domain. The fault domain you use depends on how the switches are connected in the fabric.
Non-MPIO
A dual-controller, dual-fabric FC configuration contains two independent FC switches. By mapping each volume into a separate fault domain, the IO load is spread over all the available primary ports and switches.
Use Storage Center System Manager to map volumes to the following fault domains:
• Volume 1 — Fault Domain 1 (Switch 1)
• Volume 2 — Fault Domain 2 (Switch 1)
• Volume 3 — Fault Domain 3 (Switch 2)
• Volume 4 — Fault Domain 4 (Switch 2)
MPIO
MPIO software allows the servers to support multiple FC connections to the same targets. This gives each server two routes to access each volume, which provides fault tolerance because each route is on a separate switch. You can connect MPIO in either Legacy Mode (Figure 85 on page 106) or using Virtual Ports (Figure 86 on page 107).
Use Storage Center System Manager to map volumes to the following fault domains:
• Volume 1 — Fault Domain 1 (Switch 1)
• Volume 1 — Fault Domain 3 (Switch 2)
• Volume 2 — Fault Domain 2 (Switch 1)
• Volume 2 — Fault Domain 4 (Switch 2)
• Volume 3 — Fault Domain 1 (Switch 1)
• Volume 3 — Fault Domain 3 (Switch 2)
• Volume 4 — Fault Domain 2 (Switch 1)
• Volume 4 — Fault Domain 4 (Switch 2)
Chapter 5 Front-End Cabling
106 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 85. FC Failover, Legacy Mode
Server 1
Switch 1
Server 2
Switch 2
Enclosure 1
Enclosure 2
Controller B
Controller A1 2
1 2
4 3 2 1
4 3 2 1
SC8000 Controller Front-End Cabling
Dell Compellent 107
Figure 86. FC Failover, Virtual Ports
Server 1 Server 2
Switch 2
Enclosure 1
Enclosure 2
Controller B
Controller A4 3 2 1
4 3 2 1
Switch 1
Chapter 5 Front-End Cabling
108 Storage Center CT-SC040 and SC8000 Connectivity Guide
iSCSI FailoverIn virtual port mode, iSCSI follows the same cabling and port setup as Fibre Channel with the exception of the control port. iSCSI uses a control port configured for each fault domain. Servers connect to the control port, which redirects traffic to an appropriate virtual port. Each iSCSI network is isolated by either a Virtual LAN (VLAN) switch configuration or physical separation. When configuring MPIO, assign only the control port in the iSCSI Initiator software.
Create separate and unique subnets for each individual iSCSI network. Separate iSCSI networks with the same subnet can confuse a server trying to determine the proper connection path. In addition, it is difficult to troubleshoot two separate networks in the same IP address range.
In most circumstances, iSCSI networks do not need to be routed to a general use LAN or other local iSCSI networks. The exception is in routing to another iSCSI network at a disaster recovery site for volume replication. By multipathing over isolated iSCSI networks, you can reduce the risk of a network storm or normal LAN traffic affecting a Storage Center.
In a Fibre Channel network, there is an almost immediate connection initiated between all ports that are zoned together. Once a connection is initiated, you can map volumes through that connection. Conversely, iSCSI is used over an IP based network which is not zoned, and you must initiate all connections from the servers.
A Storage Center detects only iSCSI connections that are initiated by the server. Therefore, the server must initiate a connection to the controller before a volume can be presented to the server. The method of initiating a connection depends on whether legacy mode or Virtual ports are used:
• Legacy mode: The server initiates connections from each iSCSI port to the primary connections of the fault domains within the network associated with that server connection.
• Virtual port mode: The initiator connects to the control port. The control port sees all members with the same VLAN or subnet.
SC8000 Controller Front-End Cabling
Dell Compellent 109
iSCSI Failover Example (Legacy Mode)In Legacy Mode, proper failover requires a minimum of four primary and four reserve data paths as shown in Figure 87 on page 110. The redundant primary paths protect against a single server path or fabric failure. The reserve paths protect against a single controller failure. Each fault domain consists of a primary and reserve path (for example P1-R1, P2-R2).
The diagram assumes two iSCSI Networks:
• Network 1, which includes Switch 1 and Primary data paths for fault domains 1 and 3. The IP address range is within subnet 10.10.1.x.
• Network 2, which includes Switch 2 and Primary data paths for fault domains 2 and 4. The IP address range is within subnet 10.10.2.x.
The Server is connected using a dual-port iSCSI IO card to the two networks:
• Port 1 with IP address 10.10.1.50
• Port 2 with IP address 10.10.2.50
Two Storage Center controllers connect to the two networks:
• Controller A primary fault domain connections are IP addresses 10.10.1.10 and 10.10.2.10
• Controller B reserve fault domain connections are IP addresses 10.10.1.11 and 10.10.2.11
• Controller B primary fault domain connections are IP addresses 10.10.1.12 and 10.10.2.12
• Controller A reserve fault domain connections are IP addresses 10.10.1.13 and 10.10.2.13
The server is configured to initiate connections from:
• Port 1 (10.10.1.50) to primaries 10.10.1.10 and 10.10.1.12
• Port 2 (10.10.2.50) to primaries 10.10.2.10 and 10.10.2.12
• The reserve IPs are not used to host volumes, so connections are not initiated
All volumes presented from Controller A are mapped as follows:
• 10.10.1.10 to 10.10.1.50 (fault domain 1)
• 10.10.2.10 to 10.10.2.50 (fault domain 3)
• A specific volume can be mapped only through primary ports on one controller.
All volumes presented from Controller B are mapped as follows:
• 10.10.1.12 to 10.10.1.50 (fault domain 2)
• 10.10.2.12 to 10.10.2.50 (fault domain 4)
• A specific volume can be mapped only through primary ports on one controller.
Chapter 5 Front-End Cabling
110 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 87. iSCSI Failover in Legacy Mode
Ethernet Switch 1iSCSI Network 110.10.1.x
Server
Enclosure 1
Enclosure 2
Ethernet Switch 2iSCSI Network 210.10.2.x
Controller B
Controller A
Server Port 110.10.1.50
Server Port 210.10.2.50
R3 P4R4 P3P1 P2R1 R2
4 3 2 1
4 3 2 1
SC8000 Controller Front-End Cabling
Dell Compellent 111
iSCSI Failover Example (Virtual Port Mode)
In Virtual Port mode, fault domains are determined by the number of fabrics/subnets. Connecting four primary paths on each controller provides port failover capability within an individual controller. The connections shown in Figure 88 on page 112 are divided into two different subnets, making the failover function as separate fabrics.
• This example provides protection for single-server path or fabric failure and for single-controller failure.
• Switch 1 contains members of one fault domain, and Switch 2 contains members of a separate domain.
Chapter 5 Front-End Cabling
112 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 88. iSCSI Failover with Virtual Ports
Controller B
Controller A
Enclosure 1
Enclosure 2
Ethernet Switch 1iSCSI Network 110.10.1.x
Ethernet Switch 2iSCSI Network 210.10.2.x
Server Port 1 10.10.1.50
Server Port 2 10.10.2.50
4 3 2 1
4 3 2 1
CT-SC040 Front-End Cabling
Dell Compellent 113
CT-SC040 Front-End CablingThis section provides examples for connecting front-end cables to the CT-SC040 controller.
Ethernet Management CablingThe ETH 0 port supports system login and access to the management software. It is also used to send email, alerts, SNMP traps, and phone home data. All front-end cabling must include Ethernet connections to the Ethernet switch as described below and on page 114.
Single Controller Ethernet Management Cabling
During Installation and Setup:
1 Assign a static IP address to ETH 0. See Storage Center System Setup Guide for more detailed information.
2 Connect the server Ethernet port through a switch to the controller ETH 0 port.
Figure 89. Single Controller Ethernet Connection
123456
1
2
3
4
Controller
ETH 0 Port
Corporate/Public Network
Chapter 5 Front-End Cabling
114 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dual Controller Ethernet Management CablingTo connect Ethernet management for two controllers:
1 Connect the controller ETH 1 ports together.
2 Connect the ETH 0 port on each controller to an Ethernet switch or VLAN.
Figure 90. Dual Controller Ethernet Connection
Switch
Controller A
Controller B
12
12
1
2
3
4
1
2
3
4
ETH 0 Port
ETH 0 Port
ETH 1 Port
ETH 1 Port
Corporate/Public Network
CT-SC040 Front-End Cabling
Dell Compellent 115
Single Controller Front-End Cabling
Single Controller, Single Server, FC
Connect Fibre Channel servers to the controller through a switch as shown below. Be sure to include Ethernet cabling as shown on page 113.
Figure 91. Single Controller, Single Server, FC
Single Controller, Single Server, iSCSI
Connect iSCSI servers to the controller using a switch as shown below. Be sure to include Ethernet cabling as shown on page 113.
Figure 92. Single Controller, Single iSCSI Server
6 5 4 3 2 1
1
2
3
4
Switch
Controller
Corporate/Public Network
6 5 4 3 2 1
1
2
3
4
iSCSI Switch
Controller
Corporate/Public Network
Chapter 5 Front-End Cabling
116 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single Controller, Multiple Servers, iSCSI
Connect iSCSI servers to the controller through an Ethernet switch. Be sure to include Ethernet cabling as shown on page 113.
Figure 93. Single Controller, Multiple Servers, iSCSI
6 5 4 3 2 1
1
2
3
4
Controller
Ethernet Switch
Corporate/Public Network
CT-SC040 Front-End Cabling
Dell Compellent 117
Single Controller, Multiple Servers, FCConnect Fibre Channel servers to the controller through a Fibre Channel switch. Be sure to include Ethernet cabling as shown on page 113.
Figure 94. Single Controller, Multiple Servers, Fibre Channel
6 5 4 3 2 1
1
2
3
4
Controller
FC Switch
Corporate/Public Network
Chapter 5 Front-End Cabling
118 Storage Center CT-SC040 and SC8000 Connectivity Guide
Single Controller, Multiple ServersConnect multiple server types through switches to the controller as shown below. Be sure to include Ethernet cabling as shown on page 113.
Figure 95. Single Controller, Multiple Servers
6 5 4 3 2 1
1
2
3
4
Controller
FC SwitchEthernet Switch
Corporate/Public Network
CT-SC040 Front-End Cabling
Dell Compellent 119
Fault DomainsStorage Center cabling supports fault domains to increase redundancy. Fault domains can be implemented in either Legacy mode or in Virtual Port mode.
Legacy Mode (Fibre Channel)
Each fault domain consists of sets of primary and reserve paths (P1-R1, P2-R2, and so on). To provide redundancy, a primary port and its reserved port in that fault domain must connect to the same switch. Connecting ports in this way, the primary paths provide redundancy for a single server path or fabric failure. Reserve paths provide redundancy for single controller failure. Ethernet cabling is as shown on page 98.
For example, in Figure 96, Fabric A includes Switch 1 and primary data paths for fault domains 1 and 2. Fabric B includes Switch 2 and primary data paths for fault domains 3 and 4.
This is a highly robust failover solution, but it requires four primary data paths and four reserve data paths for proper failover. In addition, the reserve ports remain unused unless a primary path fails.
Figure 96. Front-End Legacy FC Fault Domains
R4R2
P2
P3R1P1
P4
R3
1
2
3
4
14 3 2
14 3 2
1
2
3
4
Controller B
Switch 1
Server 1
Controller A
Server 2
Switch 2
Chapter 5 Front-End Cabling
120 Storage Center CT-SC040 and SC8000 Connectivity Guide
Fibre Channel (Virtual Ports)When Virtual Ports are enabled on the system, all ports are considered primary ports. Fault domains are determined by the number of independent fabrics. In the figure below, each switch carries a separate fault domain. Ethernet cabling is as shown on page 114. Virtual port mode eliminates the need for reserve ports, since all ports are primary and can read and write IO. If a port fails, any port within the same fault domain takes over for the failed port. Using multipathing, volumes are mapped to ports in more than one fault domain.
Figure 97. Front-End FC with Virtual Ports
1
2
3
4
1
2
3
4
12
12
Controller B
Switch 1
Server 1
Controller A
Server 2
Switch 2
CT-SC040 Front-End Cabling
Dell Compellent 121
Fibre Channel FailoverFor proper failover, associate Fibre Channel connections with a fault domain. The fault domain you use depends on how the switches are connected in the fabric.
Non-MPIO
A dual-controller, dual-fabric FC configuration contains two independent FC switches. By mapping each volume into a separate fault domain, the IO load is spread over all the available primary ports and switches.
Map volumes to the following fault domains:
• Volume 1 — Fault Domain 1 (Switch 1)
• Volume 2 — Fault Domain 2 (Switch 1)
• Volume 3 — Fault Domain 3 (Switch 2)
• Volume 4 — Fault Domain 4 (Switch 2)
MPIO
MPIO software allows the servers to support multiple FC connections to the same targets. This gives each server two routes to access each volume and each route is on a separate switch. You can connect MPIO in either Legacy Mode (Figure 85 on page 106) or using Virtual Ports (Figure 86 on page 107).
Map volumes to the following fault domains:
• Volume 1 — Fault Domain 1 (Switch 1)
• Volume 1 — Fault Domain 3 (Switch 2)
• Volume 2 — Fault Domain 2 (Switch 1)
• Volume 2 — Fault Domain 4 (Switch 2)
• Volume 3 — Fault Domain 1 (Switch 1)
• Volume 3 — Fault Domain 3 (Switch 2)
• Volume 4 — Fault Domain 2 (Switch 1)
• Volume 4 — Fault Domain 4 (Switch 2)
Chapter 5 Front-End Cabling
122 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 98. FC Failover, Legacy Mode
Switch 1
Server 1 Server 2
Switch 2
Enclosure 1
Enclosure 2
Controller B
Controller A
CT-SC040 Front-End Cabling
Dell Compellent 123
Figure 99. FC Failover, Virtual Ports
Switch 1
Server 1 Server 2
Switch 2
Enclosure 1
Enclosure 2
Controller B
Controller A
Chapter 5 Front-End Cabling
124 Storage Center CT-SC040 and SC8000 Connectivity Guide
iSCSI FailoveriSCSI follows the same cabling and port setup as Fibre Channel with the exception of the control port. iSCSI uses a control port configured for each of the fault domains. Servers connect to the control port, which then redirects traffic to the appropriate virtual port. When configuring MPIO, assign only the control port in the iSCSI Initiator software. iSCSI Failover on page 108 describes this in more detail. This section provides cabling examples for the CT-SC040 controller.
iSCSI Failover Example (Legacy Mode)
In Legacy Mode, proper failover requires a minimum of four primary and four reserve data paths as shown in Figure 87 on page 110. The redundant primary paths protect against a single server path or fabric failure. The reserve paths protect against a single controller failure. Each fault domain consists of a primary and reserve path (for example P1-R1, P2-R2).
The diagram assumes two iSCSI Networks:
• Network 1, which includes Switch 1 and Primary data paths for fault domains 1 and 3. The IP address range is within subnet 10.10.1.x.
• Network 2, which includes Switch 2 and Primary data paths for fault domains 2 and 4. The IP address range is within subnet 10.10.2.x.
The Server is connected using a dual-port iSCSI IO card to the two networks:
• Port 1 with IP address 10.10.1.50
• Port 2 with IP address 10.10.2.50
Two Storage Center controllers connect to the two networks:
• Controller A primary fault domain connections are IP addresses 10.10.1.10 and 10.10.2.10
• Controller B reserve fault domain connections are IP addresses 10.10.1.11 and 10.10.2.11
• Controller B primary fault domain connections are IP addresses 10.10.1.12 and 10.10.2.12
• Controller A reserve fault domain connections are IP addresses 10.10.1.13 and 10.10.2.13
The server is configured to initiate connections from:
• Port 1 (10.10.1.50) to primaries 10.10.1.10 and 10.10.1.12
• Port 2 (10.10.2.50) to primaries 10.10.2.10 and 10.10.2.12
• The reserve IPs are not used to host volumes, so connections are not initiated
All volumes presented from Controller A are mapped as follows:
• 10.10.1.10 to 10.10.1.50 (fault domain 1)
• 10.10.2.10 to 10.10.2.50 (fault domain 3)
• A specific volume can be mapped only through primary ports on one controller
All volumes presented from Controller B are mapped as follows:
• 10.10.1.12 to 10.10.1.50 (fault domain 2)
• 10.10.2.12 to 10.10.2.50 (fault domain 4)
• A specific volume can be mapped only through primary ports on one controller
CT-SC040 Front-End Cabling
Dell Compellent 125
Figure 100. iSCSI MPIO in Legacy Mode
Ethernet Switch 1iSCSI Network 110.10.1.x
Server
Enclosure 1
Enclosure 2
Ethernet Switch 2iSCSI Network 210.10.2.x
Controller B
Controller A
Server Port 110.10.1.50
Server Port 210.10.2.50
R4
R2
P2
P3R1P1 P4 R3
Chapter 5 Front-End Cabling
126 Storage Center CT-SC040 and SC8000 Connectivity Guide
iSCSI Failover Example (Virtual Port Mode)
In Virtual Port mode, fault domains are determined by the number of fabrics/subnets. Connecting four primary paths on each controller provides port failover capability within an individual controller. The connections shown in Figure 88 on page 112 are divided into two different subnets, making the failover function as separate fabrics.
• This example provides protection for single-server path or fabric failure and for single-controller failure.
• Switch 1 contains members of one fault domain, and Switch 2 contains members of a separate domain.
CT-SC040 Front-End Cabling
Dell Compellent 127
Figure 101. iSCSI Failover with Virtual Ports
Controller B
Controller A
Enclosure 1
Enclosure 2
Ethernet Switch 1iSCSI Network 110.10.1.x
Ethernet Switch 2iSCSI Network 210.10.2.x
Server Port 1 10.10.1.50
Server Port 2 10.10.2.50
Chapter 5 Front-End Cabling
128 Storage Center CT-SC040 and SC8000 Connectivity Guide
Dell Compellent 129
6 Adding or Removing an Enclosure
This chapter describes how to add or remove Dell Compellent enclosures from a Storage Center.
ContentsUsing Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Adding SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
Removing SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
Adding EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146
Removing EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
Adding SBOD or SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
Using Storage Center System ManagerAdding or removing an enclosure requires access and use of the Storage Center System Manager. This section provides basic information about the System Manager that can help identify and configure enclosures and ports. See the Storage Center System Manager Administrator’s Guide for more detailed information about the Storage Center System Manager.
Chapter 6 Adding or Removing an Enclosure
130 Storage Center CT-SC040 and SC8000 Connectivity Guide
View EnclosuresDisplay a list of enclosures (and their attributes) attached to this Storage Center.
• In the System Explorer Tree, select Enclosures. The right pane displays a list of enclosures.
Figure 102. List of Enclosures
Adding SC200/220 Enclosures
Dell Compellent 131
Configure Local PortsThe Configure Local Ports wizard shows important information about the current configuration:
• Slot/Port column displays the status of each port on an IO card.
• Target Count displays the number of drives recognized by this controller.
1 From the Storage Management menu, select System → Setup → Configure Local Ports.
2 The Configure Local Ports wizard starts, displaying information about every card in each controller.
Local ports are displayed separated by transport type (FC, iSCSI, or SAS). Columns and options displayed may differ depending upon the transport type selected and the operational mode for that transport type.
Figure 103. Configure Local Ports Wizard
Adding SC200/220 EnclosuresUse caution when adding an enclosure to a live Storage Center system to preserve the integrity of the existing data. This section describes two methods of adding enclosures:
• Create a new chain by adding enclosures to available ports on the controller’s IO cards. The current configuration is undisturbed. Creating a new chain is the safest way to increase storage capacity. When you have multiple chains, you should have at least two IO cards in each controller.
• Add an enclosure to an existing chain by failing over to one side of the chain and then connecting into the other side of the chain.
Note: After adding a chain in a system, make sure that the number of drives in the Target Count column equals the number of drives that were added.
Slot/Port Target Count
Chapter 6 Adding or Removing an Enclosure
132 Storage Center CT-SC040 and SC8000 Connectivity Guide
Creating a New Chain of SC200/220 EnclosuresThis method is safe and non-intrusive to the existing disks and chains. Figure 104 on page 133 shows an example of adding a new chain using the steps below.
1 If there is more than one enclosure in the new chain, cable the enclosures together first. Do not connect the chain to the controller yet. Connect the enclosures:
a New Enclosure (3): top, port B → Next Enclosure (4): top, port A.
b New Enclosure (3): bottom port B → Next Enclosure (4): bottom, port A.
2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation.
3 Connect the Controller: slot 6, port 2 → Enclosure 3: top, port A.
4 In the Storage Center System Manager, select Storage Management→ System→ Setup→ Configure Local Ports.
5 Make sure that:
• Slot and slot port (in this case, slot 6, port 2) are Up and the Purpose is set to back-end.
• Target Count equals the number of added drives, demonstrating that the controller recognizes the new enclosures.
6 In the Storage Manager System Tree, confirm the number of enclosures.
7 Connect last Enclosure (4): bottom, port B → Controller: slot 6, port 4.
8 Verify that the last enclosure has been added as described in steps 4 through 6 above.
9 If there are no managed disks in this system, the System Manager does not assign an Index number. If the system contains a managed disk in any enclosure, the System Manager assigns an index number to the new enclosures.
10 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder.
11 To redistribute data across all drives, from the Storage Management menu, select Disk → Rebalance RAID.
Adding SC200/220 Enclosures
Dell Compellent 133
Figure 104. Connecting a New SC200/220 SAS Chain
Two new enclosures added
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Chapter 6 Adding or Removing an Enclosure
134 Storage Center CT-SC040 and SC8000 Connectivity Guide
Adding to an Existing SAS Enclosure Chain The following example shows how to insert an enclosure into an existing enclosure chain by connecting the enclosure to one side of the enclosure chain at a time. During this process, one side of the enclosure chain is disconnected, and the Storage Center fails over to the side that remains connected.
Check Current Disk Count
Displays the number of drives accessible by the Storage Center.
1 From a workstation connected to the network, open the Storage Center System Manager.
2 In the Storage Center System Manager, select Storage Management→ System→ Setup→ Configure Local Ports.
3 Maximize the Configure Local Port wizard so that you can see the Target Count column, and note the number of drives currently viewed by the controllers. This number increases when new enclosures are added. When adding enclosures to an existing configuration, add enclosures to the end of the chain.
Add an Enclosure to an Existing Chain Currently in Service
Disconnect the chain one side at a time to maintain drive availability while adding an enclosure.
1 Disconnect the A-side cables from the controllers as shown in Figure 105 on page 135:
• Controller A, slot 6 port 1.
• Controller B, slot 6 port 3.
IO continues through the B-side cables.
2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation.
3 Move the cable from Enclosure 2: top, port B → Enclosure 4: top, port B.
4 Use new cables to connect the new enclosures to the A-side cabling (Figure 105 on page 135):
• Enclosure 2: top, port B → Enclosure 3: top, port A.
• Enclosure 3: top, port B → Enclosure 4, top, port A.
Enclosures 3 and 4 are now part of the A side chain and can now be connected to Controllers A and B.
Caution: Before adding an enclosure to an existing chain, make sure your data is backed up. For maximum protection, add enclosures during a service outage.
Adding SC200/220 Enclosures
Dell Compellent 135
Figure 105. Connect SC200/220 Enclosures to A side
5 Reconnect the A-side Controller cables:
a Enclosure 4: top, port B → Controller B: slot 6, port 3.
b Enclosure 1: top, port A → Controller A, slot 6, port 1.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Disconnect A side
New Enclosures
Connect Enclosures (A side)
Move Cable from Enclosure 2
Add cable
Add cable
Chapter 6 Adding or Removing an Enclosure
136 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 106. Reconnect SC200/220 A-side Cables to Controllers
6 Check the port configurations:
a In the Configure Local Ports wizard (See Figure 103 on page 131), make sure that both controller ports show their status as Up.
b Make sure that all drives in the new enclosures are recognized.
c Make sure the Target Count equals the number of drives.
7 Disconnect the B-side cables from the controllers as shown in Figure 118:
• Controller A: slot 6 port 3.
• Controller B, slot 6 port 1.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Adding SC200/220 Enclosures
Dell Compellent 137
IO continues through the A-side cables.
8 Move the cable from Enclosure 2: bottom, port B → Enclosure 4: bottom, port B.
9 Use new cables to connect the new enclosures to the existing enclosures (B side):
• Enclosure 2: bottom, port B → Enclosure 3: bottom, port A.
• Enclosure 3: bottom port B → to Enclosure 4: bottom port A.
Enclosures 3 and 4 are now part of the B-side chain and can now be connected to Controllers A and B.
Figure 107. Connect SC200/220 Enclosures to B Side
10 Connect Enclosure 4: bottom, port B → Controller A: slot 6, port 3.
11 Reconnect Enclosure 1: bottom, port A → Controller B: slot 6, port 1.
Disconnect B side
Connect Enclosures (B side)
Move Cable from Enclosure 2
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Add cable
Add cable
Chapter 6 Adding or Removing an Enclosure
138 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 108. Reconnect SC200/220 B-side Cables to Controllers
12 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. For more information, see the Storage Center System Manager Administrator’s Guide.
13 In the Storage Manager System Tree, view the list of enclosures. See Figure 102 on page 130. The System Manager assigns an index number to all managed drives.
14 To redistribute data across all drives, from the Storage Management menu, select Disk → Rebalance RAID.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Adding SC200/220 Enclosures
Dell Compellent 139
Adding a Second SAS Enclosure, Second ChainIn a dual-controller, single SAS enclosure configuration, controller redundancy is created using cross-over cables (IPC) from controller ports 2 to controller ports 4. A second chain performs the same redundancy as the IPC cross-over cables.
Add an Enclosure
Add an additional enclosure while maintaining redundancy.
1 Power on the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation.
2 Remove the two IPC cables from the Controllers, ports 2 and 4.
3 Connect: Controller A, port 2 → new Enclosure 3: top, port A.
4 Connect Enclosure 3: top, port B → Controller B, port 4.
5 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that:
• Status of port 2 of Controller A is Up
• Status of port 4 of Controller B is Up.
• The Target Count of Controller A, port 2 and Controller B, port 4 recognizes the drives in Enclosure 2.
• Purpose for Controller A, port 2 and Controller B, port 4 are set to back-end.
Figure 109. Adding an SC200/220 SAS Enclosure, Step 1
6 Connect Controller A: port 4 → new Enclosure 3: bottom, port B.
Enclosure 1
Enclosure 2
Controller A
Controller B
Enclosure 3
Chapter 6 Adding or Removing an Enclosure
140 Storage Center CT-SC040 and SC8000 Connectivity Guide
7 Connect Enclosure 3: bottom, port A → Controller B: port 2.
8 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that:
• Status of port 4 of Controller A is Up
• Status of port 2 of Controller B is Up.
• The Target Count of Controller A, port 4 and Controller B, port 2 recognizes the drives in Enclosure 2.
• Purpose for Controller A, port 4 and Controller B, port 2 are set to back-end.
Figure 110. Adding an SC200/220 SAS Enclosure, B side
Enclosure 1
Enclosure 2
Controller A
Controller B
Enclosure 2
Removing SC200/220 Enclosures
Dell Compellent 141
Removing SC200/220 EnclosuresThe following procedure describes how to use Storage Center System Manager to move data off the disks in the enclosure to be removed. For more detailed instructions, see the Storage Center System Manager Administrator’s Guide.
Release DisksRelease disks to remove them from the pool in preparation of removing the enclosure.
1 In the Storage Center tree, expand the Disks folder to view the disks in the enclosure.
2 Select all the disks in the enclosure you are removing.
3 From the shortcut menu, select Release Disk. The Release Disk wizard starts.
4 Note the warning and click Yes to continue. The disk is immediately released and a dialog box opens asking if you wish to rebalance RAID devices now, later, or skip balancing.
5 Click Yes. Wait for the rebalance operation to finish.
Enclosures with all drives in the unassigned disk folder are now safe to remove.
Removing a SAS EnclosureThese instructions describe how to remove the top enclosure from a SAS enclosure chain. If the configuration has two enclosure chains (as shown in red and blue below), you do not need to take a system outage; however, the controller must be able to see all drives through one chain while the other side is down.
Caution: Before you remove an enclosure, make sure your data is backed up and that all disks to be removed are empty of data.
Caution: To disconnect the A-side chain without a system outage, it is crucial that you first disconnect the A-side cable from the controller.
Chapter 6 Adding or Removing an Enclosure
142 Storage Center CT-SC040 and SC8000 Connectivity Guide
Disconnect the A-side Chain
Disconnect the enclosure to be removed from the A-side chain.
1 Disconnect the A-side cable from Controller A: slot 6, port 1. The B side continues to carry IO while the A side is disconnected.
2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that port 3 of the controller is Up and the Target Count recognizes the drives through the B side.
3 Remove the cable between: Enclosure 1: top, port B → Enclosure 2: top, port A.
Figure 111. Disconnecting the SC200/220 Enclosure from the A side
4 Move the cable from Enclosure 1: top, port A → Enclosure 2: top, port A.
5 Reconnect the top cable to Controller A: slot 6, port 1.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A Disconnect A side
Remove the A-side cable between enclosures
Controller B
Removing SC200/220 Enclosures
Dell Compellent 143
Figure 112. Reconnecting the SC200/220 A side
Caution: To disconnect the B-side chain without a system outage, it is crucial that you first disconnect the B-side cable from the controller.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller AReconnect A side, after moving the cable below.
Move the A-side cable to next enclosure.
Controller B
Chapter 6 Adding or Removing an Enclosure
144 Storage Center CT-SC040 and SC8000 Connectivity Guide
Disconnect the B-side Chain
Disconnect the enclosure to be removed from the B-side chain.
1 Disconnect the B-side cable from Controller B: slot 5, port 3. The A side continues to carry IO while the B side is disconnected.
2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that Port 1 of the controller is Up and the Target Count recognizes the drives through the A side.
3 Remove the cable between Enclosure 1: bottom, port B → Enclosure 2: bottom, port A.
Figure 113. Disconnecting the SC200/220 Enclosure from the B-side Chain
4 Reconnect the B-side cable to Controller B: slot 5, port 1.
5 The top enclosure is now disconnected and can be removed.
DisconnectB side
Remove the B-side cable between enclosures
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Move to Enclosure 2, bottom, port A
Removing SC200/220 Enclosures
Dell Compellent 145
Figure 114. Top SC200/220 Enclosure Disconnected
Controller AReconnect B side
Controller B
Chapter 6 Adding or Removing an Enclosure
146 Storage Center CT-SC040 and SC8000 Connectivity Guide
Adding EN-SASx6x12/24 EnclosuresUse caution when adding an enclosure to a live Storage Center to preserve the integrity of the existing data. This section describes two methods of adding enclosures:
• Create a new chain by adding enclosures to available ports on the controller’s IO cards. The current configuration is undisturbed. Creating a new chain is the safest way to increase storage capacity. When cabling multiple chains, each controller should have at least two IO cards installed.
• Add an enclosure to an existing chain by failing over to one side of the chain while connecting into the other side of the chain.
Creating a New Chain for SAS 12- or 24-Drive EnclosuresThis method is safe and non-intrusive to the existing disks and chains. Figure 115 on page 147 shows the final cabling diagram after adding the new chain.
1 If there is more than one enclosure in the new chain, cable the enclosures together first. Do not connect the chain to the controller yet. Connect the enclosures:
• New Enclosure (3): top 6, port B → Next Enclosure (4): top, port A.
• New Enclosure (3): bottom port A → Next Enclosure (4): bottom, B.
2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel LED and all drive LEDs are green.
3 Connect the Controller: slot 6, port 4 → Enclosure 3: top, port C.
4 From the Storage Management window, select System → Setup → Configure Local Ports.
5 Verify that Storage Center recognizes the new drives:
a Verify that slot and slot port (in this case, slot 6, port 3) are Up and the Purpose is set to back-end.
b Verify that Target Count equals the number of added drives, demonstrating that the controller recognizes the new enclosures.
c Confirm the number of enclosures in the Storage Manager System Tree.
6 Connect last Enclosure (4): bottom, port C → Controller: slot 6, port 2.
7 Verify that the last enclosure has been added as described in Step 4 through 5c above.
8 If there are no managed disks in this system, the System Manager does not assign an Index number. If the system contains a managed disk in any enclosure, the System Manager assigns an index number to the new enclosures. Make sure that the Index number matches the number on the front panel.
9 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder.
10 To redistribute data across all drives, from the Storage Management menu, select Disk → Rebalance RAID.
Adding EN-SASx6x12/24 Enclosures
Dell Compellent 147
Figure 115. Connecting a New SAS Chain
Two new enclosures added
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Chapter 6 Adding or Removing an Enclosure
148 Storage Center CT-SC040 and SC8000 Connectivity Guide
Adding to an Existing SAS Enclosure Chain
Check Current Disk Count
Verify the number of disks currently available to the controller(s).
1 In the Storage Center System Manager, select Storage Management→ System→ Setup→ Configure Local Ports.
2 Maximize the Configure Local Port wizard so that you can see the Target Count column, and note the number of drives currently viewed by the controllers. This number increases when new enclosures are added. When adding enclosures to an existing configuration, add enclosures to the end of the chain.
Add an Enclosure to an Existing Chain That is in Service
Connect a new enclosure to a Storage Center in service.
1 Disconnect the A-side cables from the controllers as shown in Figure 116 on page 149:
• Controller A: slot 6 port 1.
• Controller B: slot 6 port 3.
IO continues through the B-side cables.
2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the Ops Panel LED (SAS Enclosure Rear View on page 22) and all drive LEDs are green.
3 Use new cables to connect the new enclosures to the existing A-side enclosure connections (Figure 116 on page 149):
• Enclosure 2: top, port B → Enclosure 3: top, port A.
• Enclosure 3: top, port B → Enclosure 4: top, port A.
Enclosures 3 and 4 are now part of the A side chain and can be connected to Controllers A and B.
4 Move the cable from Enclosure 2: top, port C → Enclosure 4: top, port C.
Caution: Before adding an enclosure to an existing chain, make sure your data is backed up. For maximum protection, add enclosures during a service outage.
Adding EN-SASx6x12/24 Enclosures
Dell Compellent 149
Figure 116. Connect Enclosures to A side
5 Reconnect the A-side Controller cables:
• Enclosure 4: top, port C → Controller B: slot 6, port 3.
• Enclosure 1: top, port C → Controller A: slot 6, port 1.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Disconnect A side
New Enclosures
Connect Enclosures (A side)
Move Cable from Enclosure 2
Chapter 6 Adding or Removing an Enclosure
150 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 117. Reconnect A-side Cables to Controllers A and B
6 Check the port configurations:
a In the Configure Local Ports wizard (See Figure 103 on page 131), make sure that both controller ports show their status as Up.
b Make sure that all drives in the new controllers are recognized.
c Make sure the Target Count equals the number of drives.
7 Disconnect the B-side cables from the controllers as shown in Figure 118:
• Controller A: slot 5, port 3.
• Controller B: slot 5, port 1.
IO continues through the A-side cables.
8 Use new cables to connect the new enclosures to the existing enclosures (B side):
• Enclosure 2: bottom, port A → Enclosure 3: bottom, port B.
• Enclosure 3: bottom, port A → to Enclosure 4: bottom, port B.
Enclosures 3 and 4 are now part of the B-side chain and can be connected to Controllers A and B.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Adding EN-SASx6x12/24 Enclosures
Dell Compellent 151
9 Move the cable from Enclosure 2: bottom, port C → Enclosure 4: bottom, port C.
Figure 118. Connect Enclosures to B Side
10 Connect Enclosure 4: bottom, port C → Controller B: slot 5, port 1.
11 Reconnect Enclosure 1: bottom, port C → Controller A: slot 5, port 3.
Disconnect B side
Connect Enclosures (B side)
Move Cable from Enclosure 2
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Chapter 6 Adding or Removing an Enclosure
152 Storage Center CT-SC040 and SC8000 Connectivity Guide
Figure 119. Reconnect B-side Cables to Controllers A and B
12 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. For more information, see the Storage Center System Manager Administrator’s Guide.
13 In the Storage Manager System Tree, view the list of enclosures. See Figure 102 on page 130. The System Manager assigns an index number to all managed drives. Make sure the index number shown in the Enclosures window matches the Index number on the enclosure front panel.
14 To redistribute data across all drives, from the Storage Management menu, select Disk → Rebalance RAID.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller A
Controller B
Adding EN-SASx6x12/24 Enclosures
Dell Compellent 153
Adding a Second SAS Enclosure, Second ChainIn a dual-controller, single SAS enclosure configuration, controller redundancy is created using cross-over cables from controller ports 2 to controller ports 4. A second chain performs the same function as the IPC cross-over cables.
1 Turn on the enclosures being added. When the enclosure spins up, make sure that the Front Panel LED and all drive LEDs are green.
2 Remove the two IPC cables from the Controllers, ports 2 and 4.
3 Connect Controller A: slot 6, port 2 → new Enclosure 2: top, port C.
4 Connect Enclosure 2: top, port B → Controller B: slot 6, port 4.
5 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that:
• Status of slot 6, port 2 of Controller A is Up
• Status of slot 6, port 4 of Controller B is Up.
• The Target Count of Controller A: slot 6, port 2 and Controller B: slot 6, port 4 recognizes the drives in Enclosure 2.
• Purpose for Controller A: slot 6, port 2 and Controller B: slot 6, port 4 are set to back-end.
Figure 120. Adding a SAS Enclosure, Step 1
6 Connect Controller A: slot 6, port 4 → new Enclosure 2: bottom, port B.
7 Connect Enclosure 2: bottom, port C → Controller B: slot 6, port 2.
8 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that:
• Status of slot 6, port 4 of Controller A is Up
Enclosure 1
Enclosure 2
Controller A
Controller B
Chapter 6 Adding or Removing an Enclosure
154 Storage Center CT-SC040 and SC8000 Connectivity Guide
• Status of slot 6, port 2 of Controller B is Up.
• The Target Count of Controller A: slot 6, port 4 and Controller B: slot 6, port 2 recognizes the drives in Enclosure 2.
• Purpose for Controller A: slot 6, port 4 and Controller B: slot 6, port 2 are set to back-end.
Figure 121. Adding a SAS Enclosure, B side
Enclosure 1
Enclosure 2
Controller A
Controller B
Removing EN-SASx6x12/24 Enclosures
Dell Compellent 155
Removing EN-SASx6x12/24 EnclosuresThe following procedure describes how to use the Storage Center System Manager to move data off the disks in the enclosure to be removed. For more detailed instructions, see the Storage Center System Manager Administrator’s Guide.
Release DisksRelease disks to remove them from the pool in preparation of removing the enclosure.
1 In the Storage Center tree, expand the Disks folder to view the disks in the enclosure.
2 Select all the disks in the enclosure you are removing.
3 From the shortcut menu, select Release Disk. The Release Disk wizard starts.
4 Note the warning and click Yes to continue. The disk is immediately released and a dialog box opens asking if you wish to rebalance RAID devices now, later, or skip balancing.
5 Click Yes. Wait for rebalance operation to finish.
Enclosures with all drives in the unassigned disk folder are now safe to remove.
Caution: Before you remove an enclosure, make sure your data is backed up and that all disks to be removed are empty of data.
Chapter 6 Adding or Removing an Enclosure
156 Storage Center CT-SC040 and SC8000 Connectivity Guide
Removing a SAS EnclosureThese instructions describe how to use the top enclosure from a multiple SAS enclosure configuration. If the configuration has two chains A (red) and B (blue), you do not need to take a system outage; however, the controller must be able to see all drives through one chain while the other side is down.
Disconnect the A-side Chain
Disconnect the enclosure to be removed from the A-side chain.
1 Disconnect the A-side cable from controller: slot 6, port 1. The B side continues to carry IO while the A side is disconnected.
2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that slot 6, port 3 of the controller is Up and the Target Count recognizes the drives through the B side.
3 Disconnect the cable between: Enclosure 1: top, port B → Enclosure 2: top, port A.
Figure 122. Disconnecting the Enclosure from the A side
Caution: To disconnect the A-side chain without a system outage, it is crucial that you first disconnect the A-side cable from the controller.
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Disconnect A side
Remove the A-side cable between enclosures
Removing EN-SASx6x12/24 Enclosures
Dell Compellent 157
4 Move the cable from Enclosure 1: top, port C → Enclosure 2: top, port C.
5 Reconnect the top cable to Controller: slot 6, port 1.
Figure 123. Reconnecting the A side
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Reconnect A side, after moving the cable below.
Move the A-side cable to next enclosure.
Chapter 6 Adding or Removing an Enclosure
158 Storage Center CT-SC040 and SC8000 Connectivity Guide
Disconnect the B-side Chain
Disconnect the enclosure to be removed from the B-side chain.
1 Disconnect the B-side cable from controller port 3. The A side continues to carry IO while the B side is disconnected.
2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that slot 6, Port 1 of the controller is Up and the Target Count recognizes the drives through the A side.
3 Remove the cable between: Enclosure 1: bottom, port A → Enclosure 2: bottom, port B.
Figure 124. Disconnecting the Enclosure from the B-side Chain
4 Reconnect the B-side cable to slot 6, port 3 of the controller.
5 The top enclosure is now disconnected and can be removed.
Caution: To disconnect the B-side chain without a system outage, it is crucial that you first disconnect the B-side cable from the controller.
DisconnectB side
Remove the B-side cable between enclosures
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Controller
Removing EN-SASx6x12/24 Enclosures
Dell Compellent 159
Figure 125. Top Enclosure Disconnected
Controller
Reconnect B side
Chapter 6 Adding or Removing an Enclosure
160 Storage Center CT-SC040 and SC8000 Connectivity Guide
Adding SBOD or SATA EnclosuresYou can add SBOD or SATA enclosures to a Storage Center using one of the following methods.
• Add a new loop: When adding enclosures on a new loop with a new set of ports, follow Adding an SBOD or SATA Enclosure to a New Loop.
• Add to an existing loop: When adding the new enclosures onto an existing loop, follow Adding an SBOD or SATA Enclosure to an Existing Loop on page 160.
Before you Begin• Make sure that the new enclosure speed is set correctly prior to powering on the enclosure. If adding to
an existing loop, make sure the Shelf ID is unique.
• Make sure that each IO Module is fully locked in position by pushing on the center post and ensuring that both locking handles close and click into the locked position. If not, pull back and reinsert. Tip: Hold on to the power supply lip to get leverage.
• Make sure that each enclosure has the correct DIP switch settings.
Adding an SBOD or SATA Enclosure to a New LoopIf the Storage Center has spare ports, they can be used to add a new enclosure. This method is safe and non-intrusive to the existing disks and loops.
1 Verify the existing configuration as described in Before you Begin.
2 With new enclosure(s) shut down, connect the cabling on both the A side and B side. Refer to cabling diagrams in SBOD Enclosures on page 70 or SATA Enclosures on page 81.
3 Verify cabling along the entire loop. Check that the connectors have clicked in and verify that all other requirements are met.
4 Verify the IO modules in the new enclosures are fully seated by pushing on the center post and making sure that both locking handles close and click into the locked position. If not, pull back and reinsert.
5 After turning on the enclosure, wait 30 seconds for the IO module to initialize. Verify that lights at each connector are green and there are no alarms. If there is a problem:
a Shut down the enclosure.
b Unseat all IO modules on the side being altered.
c Correct cabling and connections.
d Turn on the enclosure.
6 Verify paths.
a In the Storage Center System Manager, select Storage Management→ System→ Setup→ Configure Local Ports.
b Maximize the Configure Local Port wizard so that you can see the Network, Usage, and Target Count columns. Verify that the Target Count increased equal to the number of drives added.
c Change the Network setting to back-end and Usage setting to In Use on any ports that were previously spares but are now connected to the new enclosure.
Adding an SBOD or SATA Enclosure to an Existing LoopIf there are no spare ports on the Storage Center to add new enclosures, you can use one of the existing loops. First review the current configuration to identify where an enclosure can be added, then make sure you have a license for additional disks, and lastly, add the enclosure.
Note: When shutting down a connected enclosure, power down the controllers first. Otherwise, the Storage Center detects missing disks and takes actions to protect the data.
Adding SBOD or SATA Enclosures
Dell Compellent 161
Verify Paths
Identify if and where an enclosure can be added.
1 In the Storage Center System Manager, select Storage Management→ System→ Setup→ Configure Local Ports.
2 Maximize the Configure Local Port wizard so that you can see the Target Count column. The Target Count column displays the number of drives per loop.
• In a dual-controller configuration, each loop has four system connections, two connections per controller.
• In a single-controller configuration, each loop has two system connections. Before disconnecting any cables, verify that all involved back-end ports can see all disks.
Phone Home
Send the Storage Center information to Dell Technical Support Services using Phone Home.
1 In the Storage Management menu, select System → Phone Home → Phone Home.
2 Click Phone Home Now.
3 Wait for confirmation that the Phone Home completed successfully.
Check Your Disk License
Verify that your license supports the number of disks to add.
In the Storage Management menu, select Help → Licensed Features.
If the number of disks you want to add exceeds the number of licensed disks, contact your Dell Compellent Business Partner for an additional license.
Figure 126. Licensed Features Window
Caution: If all involved back-end ports cannot see all disks, do not proceed any further. Contact Dell Technical Support Services.
Chapter 6 Adding or Removing an Enclosure
162 Storage Center CT-SC040 and SC8000 Connectivity Guide
Enclosure IO Ports
The following example illustrates the procedure to add a third SBOD enclosure to a dual-controller system without taking an outage. SBOD enclosures are used as illustration, but the procedure is the same for SATA. SBOD and SATA rules apply.
Add an Enclosure
Physically prepare the enclosure.
1 Rack the enclosure.
2 Install the disk drives into the enclosure. If you are adding fewer than 16 drives, make sure that drives are installed in slot 1 and slot 16, and that unused slots are filled with empty drive carriers to maintain airflow.
3 Assign a shelf ID to the enclosure that is unique within the loop.
4 Verify DIP switch settings, making sure that you do not have a 4 Gb enclosure and a 2 Gb enclosure in the same loop.
Figure 127. 4 Gb and 2 Gb Switch Settings
5 Turn on the enclosures.
6 Verify that the green LED is illuminated on each drive, indicating that the drives are working.
7 In the Storage Management menu, select System→ Setup→ Configure Local Ports.
8 Verify that the number of back-end ports correlates to the number of Target Count ports, and that the count equals the current number of disks in the system.
123456789101112
4 Gb Switch 2 Gb Switch
123456789101112
Adding SBOD or SATA Enclosures
Dell Compellent 163
Connect Back-end CablingComplete the necessary cable connections between the controller, the new enclosure, and the existing enclosure(s).
The following figure shows the IO ports for both SBOD and SATA enclosures. Note which ports are for input cabling and which are used for output cables.
Figure 128. SBOD and SATA IO Ports
SBOD IO Ports (4 Gb Card shown)
SATA IO Ports
Ho
st 1
Ho
st 0
Ho
st 3
Ho
st
2
Ho
st 1
Ho
st 0
Ho
st 3
Ho
st 2
RS232
RS232 IN
OUT
IN
OUT
IN
OUT
IN
OUT
Chapter 6 Adding or Removing an Enclosure
164 Storage Center CT-SC040 and SC8000 Connectivity Guide
1 Move the B-side cable from Enclosure 1: left module, Host 1 → Enclosure 2: left module, Host 1.
Figure 129. Connect Controller A to New Enclosure
Enclosure 1
Controller A
Enclosure 2
Controller B
Move Controller connection
Adding SBOD or SATA Enclosures
Dell Compellent 165
2 Connect Enclosure 1: left module, Host 1 → Enclosure 2: left module, Host 0.
Figure 130. Connect Enclosure 1 to Enclosure 2 (B side)
3 In the Storage Center System Manager, select Storage Management→ System→ Setup→ Configure Local Ports.
4 Maximize the Configure Local Port wizard so that you can see the Network, Usage, and Target Count columns. Verify that the Target Count increased equal to the number of drives added.
Enclosure 1
Controller A
Enclosure 2
Controller B
Add Enclosure connection
Chapter 6 Adding or Removing an Enclosure
166 Storage Center CT-SC040 and SC8000 Connectivity Guide
5 Move the A-side cable from Enclosure 1: right module, Host 1→ Enclosure 2: right module, Host 1.
Figure 131. Connect Controller A to Enclosure 2 (A side)
Enclosure 1
Controller A
Enclosure 2
Controller B
Move Controller connection
Adding SBOD or SATA Enclosures
Dell Compellent 167
6 Connect Enclosure 1: right module, Host 1 → Enclosure 2: right module, Host 0.
Figure 132. Connect Enclosure 1 to Enclosure 2 (A side)
7 In System manager, refresh the Configure Local Ports wizard by clicking the Refresh button.
8 Verify the that the Target Count increased on the back end that was added.
9 From the Storage Management menu, select Disk → Manage Unassigned Disks. The Add Disk wizard takes you through the disk management process and prompts you to rebalance data on the drives. See the Storage Center System Manager Administrator’s Guide for more information on RAID Rebalance.
Enclosure 1
Controller A
Enclosure 2
Controller B
Add Enclosure connection
Chapter 6 Adding or Removing an Enclosure
168 Storage Center CT-SC040 and SC8000 Connectivity Guide
680-027-013 A