IBM TotalStorage DS4800 Operating instructions

IBM System Storage DS4800 Storage Subsystem
Installation, User’s, and Maintenance Guide
GC26-7845-00


IBM System Storage DS4800 Storage Subsystem
Installation, User’s, and Maintenance Guide
GC26-7845-00


Note:
Before using this information and the product it supports, be sure to read the general information in “Notices” on page 189.
First Edition (May 2006)
©Copyright International Business Machines Corporation 2006. All rights reserved.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Safety
The caution and danger statements that this document contains can be referenced
in the multilingual IBM
® Safety Information document that is provided with your IBM
System Storage DS4800 Storage Subsystem. Each caution and danger statement
is numbered for easy reference to the corresponding statements in the translated
document.
vDanger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. Adanger statement is placed just before the
description of apotentially lethal or extremely hazardous procedure, step, or
situation.
vCaution: These statements indicate situations that can be potentially hazardous
to you. Acaution statement is placed just before the description of apotentially
hazardous procedure step or situation.
vAttention: These notices indicate possible damage to programs, devices, or
data. An attention notice is placed just before the instruction or situation in which
damage could occur.
DANGER
Handling the cord on this product or cords associated with accessories
sold with product will expose you to lead, achemical known to the State of
California to cause cancer, birth defects, or other reproductive harm. Wash
hands after handling.
Before installing this product, read the following danger and caution notices.
©Copyright IBM Corp. 2006 iii

Statement 1:
DANGER
Electrical current from power, telephone, and communication cables is
hazardous.
To avoid ashock hazard:
vDo not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
vConnect all power cords to aproperly wired and grounded electrical
outlet.
vConnect to properly wired outlets any equipment that will be attached to
this product.
vWhen possible, use one hand only to connect or disconnect signal
cables.
vNever turn on any equipment when there is evidence of fire, water, or
structural damage.
vDisconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
vConnect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached
devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
iv IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

Statement 2:
CAUTION:
When replacing the lithium battery, use only an equivalent type battery
recommended by the manufacturer. If your system has amodule containing a
lithium battery, replace it only with the same module type made by the same
manufacturer. The battery contains lithium and can explode if not properly
used, handled, or disposed of.
Do not:
vThrow or immerse into water
vHeat to more than 100° C(212° F)
vRepair or disassemble
Dispose of the battery as required by local ordinances or regulations.
Safety v

Statement 3:
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or
transmitters) are installed, note the following:
vDo not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
vUse of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
Class 1Laser statement
IEC 825-11993 CENELEC EN 60 825
vi IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

Statement 4:
≥18 kg (39.7 lb) ≥32 kg (70.5 lb) ≥55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
1
2
Safety vii

Statement 6:
CAUTION:
Never remove the cover on apower supply or any part that has the following
label attached.
Hazardous voltage, current, and energy levels are present inside any
component that has this label attached. There are no serviceable parts inside
these components. If you suspect aproblem with one of these parts, contact
aservice technician.
Statement 7:
DANGER
Handling the cord on this product, or cords associated with accessories
sold with this product, will expose you to lead, achemical known to the
State of California to cause cancer and birth defects or other reproductive
harm. Wash hands after handling.
viii IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

Contents
Safety ............................ iii
Figures ........................... xiii
Tables ............................xv
About this document ..................... xvii
FAStT product renaming ..................... xvii
Who should read this document .................. xvii
How this document is organized .................. xviii
Notices and statements used in this document ............. xviii
Chapter 1. Introduction ......................1
Overview ...........................1
Fibre channel defined ......................2
SATA defined .........................2
Features at aglance ......................2
Clustering support .......................3
Inventory checklist ........................3
Product updates .........................5
Best practices guidelines......................6
Storage server components.....................7
Intermixing the EXP810 and EXP710 in the same drive channel......10
Controllers .........................10
Controller cable connections ..................11
Controller memory .....................14
Power supply-fans ......................15
Interconnect-battery unit ....................16
SFP Modules ........................18
Specifications .........................19
Area requirements ......................19
Dimensions ........................19
Weight ..........................19
Shipping dimensions .....................20
Environmental requirements and specifications ............20
Temperature and humidity ...................20
Altitude ..........................21
Airflow and Heat Dissipation ..................21
Acoustic Noise .......................22
Electrical requirements .....................23
Site wiring and power ....................23
AC power recovery .....................23
Power cords and receptacles..................24
Chapter 2. Installing the storage subsystem .............25
Installation overview .......................25
Handling static-sensitive devices ..................27
Heat output, airflow, and cooling ..................28
Preparing for installation .....................29
Preparing the site .......................31
Preparing the rack cabinet....................31
Installing the support rails .....................32
Installing the DS4800 ......................36
©Copyright IBM Corp. 2006 ix

Releasing and locking acomponent lever ..............37
Removing the components ...................39
Installing the DS4800 on the support rails ..............41
Replacing the components ...................43
Chapter 3. Cabling the storage subsystem..............47
Working with SFPs and fiber-optic cables ...............47
Handling fiber-optic cables ...................48
Installing SFP modules .....................48
Removing SFP modules ....................50
Installing fiber-optic cables ...................51
Using LC-LC fibre-channel cables .................52
Connecting an LC-LC cable to an SFP module ...........53
Removing an LC-LC fibre-channel cable .............55
Using LC-SC fibre-channel cable adapters..............55
Connecting an LC-SC cable adapter to adevice ..........56
Removing an LC-LC cable from an LC-SC cable adapter .......58
Connecting storage expansion enclosures to the DS4800 .........59
DS4800 Storage Subsystem drive cabling topologies ..........69
One DS4800 and one storage expansion enclosure .........70
One DS4800 and two storage expansion enclosures .........71
One DS4800 and four storage expansion enclosures .........72
One DS4800 and eight storage expansion enclosures ........73
One DS4800 and fourteen EXP810 storage expansion enclosures ....74
One DS4800 and sixteen EXP710 storage expansion enclosures ....75
One DS4800 to seven EXP810 and eight EXP710 storage expansion
enclosures........................75
Cabling the storage expansion enclosures to aDS4800 storage subsystem 76
Storage expansion enclosure settings ...............77
Fibre channel loop and ID settings................78
DS4000 storage expansion enclosure ID settings ..........78
Connecting hosts to the DS4800 ..................79
Connecting secondary interface cables ................81
Configuring the storage subsystem .................82
Storage subsystem management methods..............82
Host-agent (in-band) management method.............82
Direct (out-of-band) management method .............83
Fibre channel connections....................84
Fibre channel host loop configurations ...............84
Redundant host and drive loops ................85
Installing the storage subsystem configuration .............88
Connecting the power cables....................88
Chapter 4. Operating the storage subsystem .............93
Performing the DS4000 Health Check process .............94
Web pages .........................95
Hardware responsibilities ....................95
Removing and replacing the front bezel ................96
Turning the storage subsystem on and off ...............96
Turning on the storage subsystem .................97
Turning off the storage subsystem ................ 100
Restoring power after an unexpected shutdown ............ 102
Performing an emergency shutdown ............... 103
Restoring power after an emergency shutdown ........... 103
Responding to the audible alarm .................. 105
Installing the DS4000 Storage Manager client ............. 106
xIBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

Firmware requirements .................... 106
Monitoring status through software ................. 107
Firmware updates ...................... 109
Troubleshooting the storage subsystem .............. 109
Checking the LEDs ....................... 111
Front bezel LEDs....................... 111
RAID controller LEDs .....................113
Numeric display LEDs .....................116
Power supply-fan LEDs ....................118
Interconnect-battery unit LEDs ..................119
Recovering from an overheated power supply-fan ........... 122
Resetting the controller circuit breakers ............... 124
Cache memory and cache battery ................. 129
Cache memory ....................... 129
Subsystem cache battery ................... 130
Chapter 5. Replacing components ................ 133
Handling static-sensitive devices .................. 133
Service Action Allowed Status LED ................. 134
Single component failures ................... 134
Multiple component failures ................... 135
Releasing acomponent lever ................... 136
Replacing acontroller ...................... 137
Upgrading controllers ...................... 142
Replacing apower supply-fan ................... 144
Replacing the interconnect-battery unit................ 148
Replacing abackup battery pack .................. 152
Replacing an SFP module .................... 155
Installing SFPs and fiber-optic cables ................ 158
Chapter 6. Hardware maintenance ................ 159
General checkout ....................... 159
Using the diagnostic hardware.................. 159
Solving problems ...................... 159
Parts list ........................... 166
Appendix A. Additional DS4000 documentation ........... 169
DS4000 Storage Manager Version 9library .............. 169
DS4800 Storage Subsystem library ................. 170
DS4700 Storage Subsystem library ................. 171
DS4500 Fibre Channel Storage Server library ............. 172
DS4400 Fibre Channel Storage Server library ............. 173
DS4300 Fibre Channel Storage Server library ............. 174
DS4100 SATA Storage Server library ................ 175
DS4000 Storage Expansion Enclosure documents ........... 176
Other DS4000 and DS4000-related documents ............ 177
Appendix B. Records ..................... 179
Identification numbers ...................... 179
Appendix C. Rack mounting templates............... 181
Appendix D. Power cords .................... 185
Appendix E. Accessibility .................... 187
Contents xi

Notices ........................... 189
Trademarks.......................... 189
Important notes ........................ 190
Product recycling and disposal .................. 191
Battery return program ..................... 191
Electronic emission notices .................... 192
Federal Communications Commission (FCC) statement ........ 192
Chinese class Acompliance statement............... 192
Industry Canada Class Aemission compliance statement ........ 193
Australia and New Zealand Class Astatement ............ 193
European Union EMC Directive conformance statement ........ 193
Taiwanese Class Awarning statement ............... 193
Japanese Voluntary Control Council for Interference (VCCI) statement 194
Glossary .......................... 195
Index ............................ 205
xii IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

Figures
1. DS4800 Storage Subsystem ...........................8
2. Location of components in the storage subsystem ...................9
3. Controllers in the storage subsystem .......................11
4. Controller connections .............................12
5. DS4800 configuration with 2-Gbps and 4-Gbps enclosures in different drive channel pairs ....13
6. Power supply-fan...............................16
7. Interconnect-battery unit ............................17
8. SFP module with fiber-optic cable ........................18
9. DS4800 Storage Subsystem dimensions ......................19
10. DS4800 Storage Subsystem airflow ........................22
11. Example of cold aisle/hot aisle rack cabinet configuration ................29
12. DS4800 front rack mounting template .......................33
13. DS4800 rear rack mounting template .......................34
14. DS4800 support rail assembly ..........................35
15. DS4800 Storage Subsystem front views and back view ................37
16. Component lever and latch ...........................38
17. Removing the power supply-fans .........................40
18. Removing the interconnect-battery unit .......................40
19. Removing the controllers ............................41
20. Securing the DS4800 to the rack cabinet ......................42
21. Replacing the power supply-fans .........................43
22. Replacing the interconnect-battery unit .......................44
23. Replacing the controllers ............................44
24. Removing the front bezel ............................45
25. Small Form-Factor Pluggable (SFP) module .....................49
26. Replacing an SFP module ...........................50
27. Unlocking the SFP module latch -plastic variety ...................51
28. Unlocking the SFP module latch -wire variety ....................51
29. Removing caps from fiber-optic cables .......................52
30. Connecting fiber-optic cable to SFP ........................52
31. LC-LC fibre-channel cable ...........................53
32. Removing fiber-optic cable protective caps .....................54
33. Inserting an LC-LC fibre-channel cable into an SFP module ...............54
34. LC-LC fibre-channel cable lever and latches .....................55
35. Removing the LC-LC fibre-channel cable ......................55
36. LC-SC fibre-channel cable adapter ........................56
37. Removing the LC-SC cable adapter protective caps ..................57
38. Connecting an LC-LC cable into the LC-SC cable adapter ...............57
39. LC-LC fibre-channel cable lever and latches .....................58
40. Removing the LC-LC fibre-channel cable from an LC-SC fibre-channel cable adapter .....58
41. Example 1of redundant drive channel pairs .....................61
42. Example 2of redundant drive channel pairs .....................62
43. EXP710/EXP100 port labels...........................63
44. Connecting EXP710 or EXP100 enclosures to DS4800.................64
45. EXP810 port labels ..............................65
46. Connecting EXP810 enclosures to DS4800 .....................66
47. DS4800 Storage Subsystem ports and controllers...................70
48. One DS4800 and one storage expansion enclosure —Recommended cabling ........71
49. View 1: One DS4800 and two storage expansion enclosures cabling —Recommended.....71
50. View 2: One DS4800 and two storage expansion enclosures cabling —Not recommended 72
51. One DS4800 and four storage expansion enclosures —Recommended cabling .......73
52. One DS4800 and eight storage expansion enclosures —Recommended cabling .......74
53. One DS4800 and fourteen EXP810 storage expansion enclosures —Recommended cabling 75
©Copyright IBM Corp. 2006 xiii

54. One DS4800 and sixteen EXP710 storage expansion enclosures —Recommended cabling 75
55. One DS4800 to seven EXP810 and eight EXP710 storage expansion enclosures —
Recommended cabling ............................76
56. Installing an SFP module and LC-LC cable in aDS4800 ................77
57. Installing an SFP module and connecting an LC-LC cable to the storage expansion enclosures 77
58. Location of host cables on RAID controllers .....................80
59. Cabling diagram for four redundant host connections .................80
60. Ethernet and serial port locations .........................81
61. Host-agent (in-band) managed storage subsystems ..................83
62. Direct (out-of-band) managed storage subsystems ..................84
63. Examples of redundant host direct attached fibre channel configurations ..........86
64. Example of asingle SAN fabric configuration ....................87
65. Example of two storage subsystems in adual SAN environment .............87
66. Example of atwo-cluster configuration .......................88
67. AC power switch and AC and DC power connectors ..................89
68. Redundant AC power connections to controllers and storage expansion enclosures ......91
69. Installing the front bezel ............................96
70. AC power switches on the controllers .......................98
71. Front bezel LEDs .............................. 111
72. RAID controller LEDs .............................113
73. Numeric display LEDs ............................117
74. Power supply-fan LEDs ............................118
75. Interconnect-battery unit LEDs ......................... 120
76. Power supply-fan Needs Attention LEDs...................... 125
77. RAID controller connections .......................... 126
78. Removing the controller from the storage subsystem ................. 127
79. Circuit breaker access holes .......................... 127
80. Cache Active LEDs ............................. 130
81. Battery LEDs ................................ 131
82. Component lever and latch .......................... 136
83. RAID controller Needs Attention and Service Action Allowed LEDs ............ 138
84. Connectors on the back of each controller ..................... 139
85. Unlocking the SFP module latch -plastic variety ................... 139
86. Unlocking the SFP module latch -wire variety ................... 140
87. Removing acontroller from the DS4800 ...................... 140
88. Overall DS4800 Configuration Needs Attention LED on the DS4800 front bezel ....... 145
89. Power supply-fan LEDs ............................ 146
90. Removing apower supply-fan from the DS4800 ................... 147
91. Overall DS4800 Configuration Needs Attention LED on the DS4800 front bezel ....... 149
92. Interconnect-battery unit Needs Attention and Service Action Allowed LEDs ......... 150
93. Removing an interconnect-battery unit from the DS4800 ................ 151
94. Overall DS4800 Configuration Needs Attention LED on the DS4800 front bezel ....... 153
95. Battery access cover on the interconnect-battery unit ................. 153
96. Overall DS4800 Configuration Needs Attention LED on the DS4800 front bezel ....... 156
97. Needs Attention and SFP Model Bypass LEDs ................... 156
98. Replacing an SFP module ........................... 157
99. DS4800 parts list .............................. 167
100. Location of MAC address labels ......................... 179
101. DS4800 front rack mounting template ....................... 182
102. DS4800 rear rack mounting template ....................... 183
xiv IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

Tables
1. Mapping of FAStT names to DS4000 Series names.................. xvii
2. Features at aglance ..............................3
3. Maximum number of storage expansion enclosures ..................9
4. Supported EXP810 and EXP710 enclosure combinations per redundant drive channel pair 10
5. RAID controller specifications ..........................15
6. DS4800 Storage Subsystem weights .......................19
7. DS4800 Storage Subsystem component weights ...................20
8. DS4800 Storage Subsystem shipping carton dimensions ................20
9. Temperature and humidity requirements ......................20
10. DS4800 Storage Subsystem altitude ranges .....................21
11. DS4800 Storage Subsystem power and heat dissipation ................22
12. DS4800 Storage Subsystem sound levels .....................22
13. IBM System Storage DS4800 AC power requirements .................23
14. Different ways to connect four storage expansion enclosures to the DS4800 .........69
15. DS4800 Storage Subsystem drive ports and drive channels ...............70
16. Recommended enclosure ID settings scheme ....................78
17. Firmware requirements ............................ 106
18. Front bezel LEDs .............................. 111
19. RAID controller LEDs .............................113
20. Host and drive channel LED definitions ......................116
21. Numeric display diagnostic codes ........................118
22. Power supply-fan LEDs ............................119
23. Interconnect-battery unit LEDs ......................... 120
24. DS4800 Symptom-to-FRU index......................... 160
25. Parts list (System Storage DS4800 Storage Subsystem) ................ 167
26. DS4000 Storage Manager Version 9.1 titles by user tasks ............... 169
27. DS4800 Storage Subsystem document titles by user tasks ............... 170
28. DS4700 Storage Subsystem document titles by user tasks ............... 171
29. DS4500 Fibre Channel Storage Server document titles by user tasks ........... 172
30. DS4400 Fibre Channel Storage Server document titles by user tasks ........... 173
31. DS4300 Fibre Channel Storage Server document titles by user tasks ........... 174
32. DS4100 SATA Storage Server document titles by user tasks .............. 175
33. DS4000 Storage Expansion Enclosure document titles by user tasks ........... 176
34. DS4000 and DS4000–related document titles by user tasks .............. 177
35. DS4000 Storage Manager alternate keyboard operations ............... 187
©Copyright IBM Corp. 2006 xv

xvi IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide

About this document
This document provides instructions for installing and customizing the configuration
of your IBM System Storage DS4800 Storage Subsystem. It also provides hardware
maintenance procedures and troubleshooting information.
FAStT product renaming
IBM has renamed some FAStT family products. Table 1identifies each DS4000
product name with its corresponding previous FAStT product name. Note that this
change of product name only indicates no change in functionality or warranty. All
products listed below with new names are functionally-equivalent and
fully-interoperable. Each DS4000 product retains full IBM service as outlined in
service contracts issued for analogous FAStT products.
Table 1. Mapping of FAStT names to DS4000 Series names
Previous FAStT Product Name Current DS4000 Product Name
IBM TotalStorage FAStT Storage Server IBM TotalStorage DS4000
FAStT DS4000
FAStT Family DS4000 Mid-range Disk System
FAStT Storage Manager vX.Y (for example
v9.10)
DS4000 Storage Manager vX.Y (for example
v9.10)
FAStT100 DS4100
FAStT600 DS4300
FAStT600 with Turbo Feature DS4300 Turbo
FAStT700 DS4400
FAStT900 DS4500
EXP700 DS4000 EXP700
EXP710 DS4000 EXP710
EXP100 DS4000 EXP100
FAStT FlashCopy FlashCopy for DS4000
FAStT VolumeCopy VolumeCopy for DS4000
FAStT Remote Mirror (RM) Enhanced Remote Mirroring for DS4000
FAStT Synchronous Mirroring Metro Mirroring for DS4000
Global Copy for DS4000
(New Feature =Asynchronous Mirroring
without Consistency Group)
Global Mirroring for DS4000
(New Feature =Asynchronous Mirroring with
Consistency Group)
Who should read this document
This document is intended for system operators and service technicians who have
extensive knowledge of fibre channel and network technology.
©Copyright IBM Corp. 2006 xvii

How this document is organized
Chapter 1, “Introduction,” on page 1describes the IBM System Storage DS4800
Storage Subsystem. This chapter includes an inventory checklist and an overview
of the storage subsystem features, operating specifications, and components.
Chapter 2, “Installing the storage subsystem,” on page 25 contains instructions for
installing the DS4800 Storage Subsystem in astandard rack cabinet and setting the
interface options.
Chapter 3, “Cabling the storage subsystem,” on page 47 contains fibre channel and
power cabling information for the DS4800 Storage Subsystem.
Chapter 4, “Operating the storage subsystem,” on page 93 contains instructions for
powering the DS4800 Storage Subsystem on or off during either normal or
emergency situations. It also contains information on how to check the LEDs on the
front and back of the storage subsystem.
Chapter 5, “Replacing components,” on page 133 contains step-by-step instructions
for how to install or remove customer replaceable units (CRUs), such as
power-supply fans, RAID controllers, and interconnect-battery units.
Chapter 6, “Hardware maintenance,” on page 159 contains problems, symptoms,
and error messages that are specific to the DS4800 Storage Subsystem. It also
contains the parts listing for the DS4800 Storage Subsystem.
Appendix A, “Additional DS4000 documentation,” on page 169 provides references
to other DS4000 publications.
Appendix B, “Records,” on page 179 provides atable that you can use to record
and update important information about your DS4800, including serial number,
model and machine type, and MAC addresses.
Appendix C, “Rack mounting templates,” on page 181 provides the rack mounting
templates for installation of the DS4800. If you want to tear out the templates from
the document for use during installation, use these copies of the templates.
Appendix D, “Power cords,” on page 185 lists power cord information for the
DS4800.
Appendix E, “Accessibility,” on page 187 provides information about DS4000
Storage Manager accessibility features.
Notices and statements used in this document
The caution and danger statements used in this document also appear in the
multilingual Safety Information document provided with your IBM DS4800. Each
caution and danger statement is numbered for easy reference to the corresponding
statements in the safety document.
The following types of notices and statements are used in this document:
vNote: These notices provide important tips, guidance, or advice.
vImportant: These notices provide information or advice that might help you avoid
inconvenient or problem situations.
xviii IBM System Storage DS4800 Storage Subsystem: Installation, User’s, and Maintenance Guide