IBM TotalStorage DS4500 User manual

IBM TotalStorage DS4500
Fibre Channel Storage
Subsystem Cabling Guide 򔻐򗗠򙳰
Installation overview
Table 1summarizes the steps required to correctly install, cable, and power on your IBM®TotalStorage®
DS4500 Storage Subsystem. Unless otherwise stated, all the following tasks are detailed in the sections
referenced in the IBM TotalStorage DS4500 Installation, User’s, and Maintenance Guide.Review the
multilingual IBM Safety Information document and read all safety information in the DS4500 Installation,
User’s, and Maintenance Guide before you begin the installation.
Attention: Before powering on the DS4500 Storage Subsystem, each attached storage expansion
enclosure must be populated with at least two drives. If at least two drives are not installed in each
attached storage expansion enclosure, when you power on the DS4500 and its attached storage expansion
enclosure(s), your standard storage partition key might be lost and must be regenerated using
instructions on the IBM DS4000™Solutions and Premium Features Web site:
https://www-912.ibm.com/PremiumFeatures/
In addition, the resulting insufficient load to the enclosure power supplies might cause them to
intermittently appear as failed, falsely indicating the power supplies are bad. All drives in the connected
storage expansion enclosure(s) must contain no prior configuration data.
Table 1. Installation Tasks
Task Detailed Description
1Review the DS4500 installation recommendations and requirements. Chapter 2, ″Handling static-sensitive
devices″
″Preparing for installation″
2Fold down and open the sides of the shipping box. Without removing
the DS4500 from box, you can remove the DS4500 rack mounting rails
and hardware from the box. Install the support rails in the rack
cabinet.
Chapter 2, ″Installing the support
rails″
3Before removing the DS4500 from the shipping box, remove the
components to lighten the unit.
Chapter 2, ″Removing the CRUs″
4Record the serial number, machine type, model number, and RAID
controller MAC addresses for your DS4500.
Appendix A, ″Records,″
5Install and secure the DS4500 chassis in the rack cabinet. Chapter 2, ″Installing the DS4500 into
arack on the support rails″
6Replace the components in the installed DS4500 chassis. Chapter 2, ″Replacing the
components″
7Install in the rack cabinet the DS4000 storage expansion enclosures
that you plan to cable to the DS4500.
Installation, User’s, and Maintenance
Guide for your DS4000 storage
expansion enclosure
8If there is any storage expansion enclosure to be attached to the
DS4500, use SFP modules and FC cables to cable the DS4500 to the
DS4000 storage expansion enclosure.
Chapter 3, ″Connecting storage
expansion enclosures to the DS4500″

Table 1. Installation Tasks (continued)
Task Detailed Description
9After you cable the DS4000 storage expansion enclosures, if there are
EXP710 storage expansion enclosures in the DS4500 configuration, set
their enclosure IDs. If there are EXP810 storage expansion enclosures
in the DS4500 configuration, you do not need to set their enclosure
IDs because they are set automatically by the controller.
Chapter 3, ″Storage expansion
enclosure settings″
10 For out-of-band management: Cable the DS4500 Ethernet ports to
either the management workstation or to the hosts.
Chapter 3, ″Connecting secondary
interface cables″
For in-band management: Cable the DS4500 host channels to the FC
HBAs in either the hosts or the FC switch that connects to the host
FC HBAs.
Chapter 3, ″Connecting hosts to the
DS4500″
11 Connect the power cables for the DS4500 and the storage expansion
enclosures if needed.
Chapter 3, ″Cabling the power
supply″
12 Power on the attached storage expansion enclosures and the DS4500
storage subsystem.
Chapter 4, ″Turning on the storage
subsystem″
13 Review the controller firmware and NVSRAM, drive enclosure
firmware, ESM firmware, and Storage Manager software requirements
and obtain upgrades if necessary.
Chapter 1, ″DS4500 hardware and
software compatibility″
14 Install the DS4000 Storage Manager 9.16 host software on the
management workstation (for out-of-band management) or on the
host (for in-band management). Use the DS4000 Storage Manager
software to verify the configuration.
IBM DS4000 Storage Manager 9.16
Installation and Support Guide for your
operating system
15 Review and perform the DS4000 Health Check process. Chapter 4, ″Performing the DS4000
Health Check process″
2

Installing an SFP module and fibre channel cable
Statement 3:
DANGER: Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the
following: Laser radiation when open. Do not stare into the beam, do not view directly with optical
instruments, and avoid direct exposure to the beam.
All host and drive cabling connections require you to use Small Form-Factor Pluggable (SFP) modules in
the DS4500 host and drive channels used by the cabling connections. The SFP module housing and fibre
channel cable have integrated guide keys that prevent you from inserting these devices incorrectly. You
must insert SFP modules into ports with minimal pressure so that you do not damage either the SFP
module or the port. You can insert an SFP module into an active port without affecting the operational
loop performance. You must connect the fibre channel cable to the SFP module after you insert the SFP
module into the port.
Attention: Remove SFP modules from any unused mini hub ports (both host-side and drive-side) on the
DS4500 Storage Subsystem.
To avoid damage to your fibre-optic cables:
vDo not route the cable along afolding cable-management arm.
vRoute the cable away from places where it can be damaged by other devices in the rack cabinet.
vFor devices on slide rails, leave enough slack in the cable so that it does not bend to adiameter of less
than 76 mm (3 in.) or aradius less than 38 mm (1.5 in.) when extended or become pinched when
retracted.
vDo not use plastic cable ties in place of the provided cable straps.
vDo not put excess weight on the cable at the connection point. Be sure that the cable is well supported.
1. Remove the protective caps from the SFP module and from the fibre channel cable. Do not touch the
exposed fibre-optic cable.
Protective
cap
10
Plastic
tab
SFP
module
Fibre Channel
cable
Protective
caps
Protective
cap
SFP
module
90
o
Wire
tab
o
2. Insert the SFP module into an SFP module port on an IBM DS4500 mini hub.
3. Connect the fibre channel cable to the SFP module.
Figure 1. SFP modules and fibre channel cables
3

To remove an SFP module and fibre channel cable:
1. Remove the fibre-optic cable from the SFP module; then, replace the protective caps on the cable
connector.
Attention: Do not grasp the plastic tab that is part of the SFP module while disconnecting the
fibre-optic cable. Pulling the SFP module plastic tab while disconnecting the fibre-optic cable might
damage the SFP module.
2. For SFPs with plastic tabs, pull the SFP module plastic tab outward at a10° angle while you remove
the SFP module. The plastic tab releases the SFP module latch.
3. For SFPs with wire tabs, pull the SFP module wire tab outward at a90° angle and remove the SFP
module. The wire tab releases the SFP module latch.
4. Replace the protective cap on the SFP module.
Direct-attached host-side fibre channel cabling
Attention: Install the DS4500 Storage Subsystem and all storage expansion enclosures in the rack cabinet
before cabling the configuration.
OUT IN
!
2Gb/s1Gb/s
OUTIN
!
2Gb/s1Gb/s
OUT IN
!
2Gb/s1Gb/s
OUTIN
!
2Gb/s1Gb/s
OUT IN
!
2Gb/s1Gb/s
OUTIN
!
2Gb/s1Gb/s
OUTIN
!
2Gb/s1Gb/s
OUTIN
!
2Gb/s1Gb/s
Host mini hubs
Controller A
Drive mini hubs
Mini hub
Out ports
Mini hub
In ports
Controller B
12
34 1 43
2
1. Connect ahost adapter to the Host 1(top) port on host-side mini hub 1. For redundancy, connect a
second host adapter to the Host 1(top) port on the host-side mini hub 2.
Note: To connect devices to each other, follow the procedure on the other side of this document for
installing SFP modules and fibre channel cables.
2. For asecond redundant host, connect two host adapters to the Host 2(bottom) ports on host-side
mini hubs 1and 2.
3. For athird redundant host, connect two host adapters to the Host 3(bottom) ports on host-side mini
hubs 3and 4.
4. For afourth redundant host, connect two host adapters to the Host 4(top) ports on host-side mini
hubs 3and 4.
Figure 2. DS4500 Storage Subsystem ports and controllers
4

OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
OUT IN
!
2 Gb/s1 Gb/s
Host 1, Host Adapter 1 and 2 Host 4, Host Adapter 1 and 2
Host 2, Host Adapter 1 and 2 Host 3, Host Adapter 1 and 2
Host 1 Host 4
Host 2 Host 3
For additional information about host-side cabling, refer to the IBM TotalStorage DS4500 Fibre Channel
Storage Subsystem Installation, User's, and Maintenance Guide.
Drive-side fibre-channel cabling
The DS4500 Storage Subsystem supports up to two redundant drive loops. Aredundant drive loop
consists of one or more storage expansion enclosures connected to acontroller using two sets of fibre
channel cables. If one data path fails, the controller uses the other data path to maintain the connection to
the drive group.
Figure 3. DS4500 Storage Subsystem host adapter connections (direct-attached)
5

Drive interface ports
DS4500 Storage Subsystems use only redundant drive-loop configurations. Each drive mini hub connects
to Controller Aand Controller Band represents asingle drive loop. The drive loops must be set up in
pairs to support redundant drive loop configurations (two data paths per storage expansion enclosure).
See Figure 4for an illustration of the drive-side mini-hub interface ports.
The maximum number of storage expansion enclosures that can be connected per pair of redundant drive
loops depends on the IBM DS4000 storage expansion enclosure models used. The following DS4000
storage expansion enclosure types are supported by the DS4500 Storage Subsystem:
vFAStT EXP500
vDS4000 EXP700
vDS4000 EXP710
vDS4000 EXP100
vDS4000 EXP810
If the drives are configured using only DS4000 EXP700, EXP710, EXP810, or EXP100 storage expansion
enclosures, the DS4500 Storage Subsystem supports amaximum of 224 hard drives.
If the drives are configured using only FAStT EXP500 storage expansion enclosures, the DS4500 Storage
Subsystem supports amaximum of 220 hard drives.
Important:Ensure that the single digit (x1) of the enclosure ID for every enclosure in aredundant drive
loop pair is unique. Refer to the IBM TotalStorage DS4500 Installation, User's, and Maintenance Guide for
more information on the storage expansion enclosure IDs settings.
To cable two DS4000 10- or 14- drive storage expansion enclosures (EXP500, EXP700, EXP710, or EXP100)
to the DS4500, see “Connecting to EXP500/EXP100/EXP700/EXP710 storage expansion enclosures” on
page 7. To cable two DS4000 16-drive storage expansion enclosures (EXP810) to the DS4500, see
“Connecting to EXP810 storage expansion enclosures” on page 8.
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
OUT
IN
!
2Gb/s
1Gb/s
Drive
mini-hub
ports
Drive loop C and D for
redundant drive loop pair 2
Drive loop A and B for
redundant drive loop pair 1
4
Use one port on each
mini hub to connect
a drive loop cable
Leave one port unoccupied
for future upgrades
GS000043
3 2 1
Figure 4. Drive mini-hub ports
6

Attention: If you need more information about storage expansion enclosure cabling, including how to
cable different storage expansion enclosures types and the latest updates, please see the IBM TotalStorage
DS4500 Installation, User’s and Maintenance Guide and the IBM TotalStorage DS4000 Hard Drive and Storage
Expansion Enclosure Installation and Migration Guide.In addition, you must purchase the FC/SATA
Enclosure Intermix premium option to combine DS4000 EXP100s or DS4000 EXP810s with SATA
enhanced disk drive modules (E-DDMs) with DS4000 EXP700s, DS4000 EXP710s, or DS4000 EXP810s with
fibre channel drives in the same DS4500 Storage Subsystem configuration.
Connecting to EXP500/EXP100/EXP700/EXP710 storage expansion
enclosures
1. If you are cabling two EXP500/EXP100/EXP700/EXP710 storage expansion enclosures to the DS4500,
use afibre channel cable to connect the In port on the left ESM board of the first enclosure to the Out
port on the left ESM board of the second enclosure. Connect the In port on the right ESM board of the
first enclosure to the Out port on the right ESM board of the second enclosure.
If you want to connect additional storage expansion enclosures into drive loops Aand B, then by
starting with the second storage expansion enclosure, connect each additional storage expansion
enclosure into drive loops Aand Bin the same manner. Leave the In port on the right ESM board on
the last storage expansion enclosure in the loop unoccupied.
2. Ensure that each storage expansion enclosure has aunique enclosure ID (switch setting).
3. From the second (or last) enclosure, connect the In port on the left ESM board to the Out (upper) port
on drive-side mini hub 4on the DS4500.
Leave the Out port on the left ESM board on the first enclosure and the In (lower) port on the
drive-side mini hub 4unoccupied.
4. From the first enclosure, connect the Out port on the right ESM board to the In (lower) port on
drive-side mini hub 2on the DS4500.
Leave the In port on the right ESM board on the second (or last) enclosure and the Out (upper) port
on the drive-side mini hub 2unoccupied.
7

Connecting to EXP810 storage expansion enclosures
1. Make sure that each EXP810 storage expansion enclosure has the enclosure speed set to 2Gbps fibre
channel speed.
2. If you are cabling two EXP810 storage expansion enclosures to the DS4500, use afibre channel cable
to connect port 1B on the ESM Aboard of the first enclosure to port 1A on the ESM Aboard of the
second enclosure. Connect port 1A on the ESM Bboard of the first enclosure to port 1B on the ESM B
board of the second enclosure.
If you want to connect additional storage expansion enclosures into drive loops Aand B, then by
starting with the second storage expansion enclosure, connect each additional storage expansion
enclosure into drive loops Aand Bin the same manner. Leave port 1A on the ESM Bboard on the last
storage expansion enclosure in the loop unoccupied.
3. From the second (or last) enclosure, connect port 1B on the ESM Aboard to the Out (upper) port on
drive-side mini hub 4on the DS4500.
First storage
expansion enclosure
Third storage
expansion enclosure
RightESMLeftESM
Ou t Ou t
In
d3nu4043d
RightESMLeftESM
Ou t Ou t
In
Second storage
expansion enclosure
RightESMLeftESM
EXP500/100/7x0
In
In
Ou t Ou t
In
RightESMLeftESM
Ou t Ou t
In
Fourth (last) storage
expansion enclosure
In
In
EXP500/100/7x0
EXP500/100/7x0
EXP500/100/7x0
Loop A Loop B
Drive-side
mini hub 4
Figure 5. EXP100/700/710 storage enclosure
8

Leave port 1A on the ESM Aboard on the first enclosure and the In (lower) port on the drive-side
mini hub 4unoccupied.
4. From the first enclosure, connect port 1B on the ESM Bboard to the In (lower) port on drive-side mini
hub 2on the DS4500.
Leave port 1A on the ESM Bboard on the second (or last) enclosure and the Out (upper) port on the
drive-side mini hub 2unoccupied.
The EXP810 enclosure IDs will automatically set to give each enclosure in the drive loop aunique
enclosure ID.
EXP810
ESM B
ESM A
EXP810
ESM B
ESM A
EXP810
ESM B
ESM A
EXP810
ESM B
ESM A
Port 1B
Port 1B
Port 1A
Port 1B
Port 1A
Port 1A
Port 1B
Port 1A
Port 1B
Port 1B
ds4500_810
7
Loop B
Loop A
First storage
expansion enclosure
Second storage
expansion enclosure
Third storage
expansion enclosure
Fourth storage
expansion enclosure
Port 1A
Port 1B
Port 1A
Port 1B
Drive-side
mini hub 4
Drive-side
mini hub 2
Figure 6. EXP 810 storage expansion enclosure
9

This page left intentionally blank.
10

This page left intentionally blank.
11

Trademarks
The following terms are trademarks of International Business Machines Corporation in the United States,
other countries, or both:
IBM TotalStorage
Other company, product, or service names may be trademarks or service marks of others.
Second edition (October 2006)
©Copyright International Business Machines Corporation 2006. All rights reserved.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
GC26-7813-01 (1P) P/N: 42D3303