IBM TotalStorage EXP100 Operating instructions

IBM TotalStorage DS4000 EXP100
Storage Expansion Enclosure
Installation, User’s and Maintenance Guide
GC26-7694-01


IBM TotalStorage DS4000 EXP100
Storage Expansion Enclosure
Installation, User’s and Maintenance Guide
GC26-7694-01


Note:
Before using this information and the product it supports, be sure to read the general information in “Notices” on page 141.
Second Edition (November 2005)
©Copyright International Business Machines Corporation 2004, 2005. All rights reserved.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Figures ........................... vii
Tables ............................ix
Safety ............................xi
About this document ..................... xvii
FAStT product renaming ..................... xvii
Who should read this document .................. xvii
How this document is organized .................. xviii
DS4000 installation task overview .................. xix
Getting information, help, and service ................ xxi
Before you call ........................ xxi
Using the documentation .................... xxii
Web sites ......................... xxii
Software service and support .................. xxiii
Hardware service and support .................. xxiii
Fire suppression systems ................... xxiii
How to send your comments ................... xxiii
Chapter 1. Introduction ......................1
Overview ...........................1
EXP100 storage expansion enclosure -description ...........1
Host server operating system support ................2
Fibre Channel defined......................2
Serial ATA defined .......................3
New features .........................3
Software, hardware and firmware compatibility and upgrades ........4
Storage Manager software support for the EXP100 ...........4
Current firmware support for the EXP100...............4
EXP100 ESM CRU types, firmware, and release levels explained .....6
EXP100 ESM CRU types ...................6
EXP100 release levels ....................7
ESM failover support considerations ................11
Determining firmware levels ...................11
How to receive the latest product updates ..............12
Inventory checklist .......................14
EXP100 components.......................14
EXP100 bays .........................14
Hot-swap drive bays ......................14
Fan, ESM, and power supply bays ................15
Controls, indicators and connectors .................17
Front controls and indicators ...................17
Rear controls, indicators, and connectors ..............17
Power supply controls, indicators, and connectors ..........17
Fan controls and indicators ..................18
ESMs and user controls ...................19
EXP100 operating environment ...................21
EXP100 specifications .....................22
Heat output, airflow, and cooling .................23
ESM failover architecture .....................24
Understanding ESM failover architecture ..............24
Configuration guidelines ....................27
©Copyright IBM Corp. 2004, 2005 iii
||
||
||
||
||
||
||

Chapter 2. Installing the EXP100..................29
Handling static-sensitive devices ..................30
Preparing for installation .....................30
Preparing the site .......................31
Preparing the rack ......................31
Installing the EXP100 ......................32
Rack mounting template ....................32
Installing the support rails ....................34
Removing the CRUs ......................37
Removing an ESM .....................37
Removing apower supply ...................38
Removing afan ......................39
Removing ahard disk drive ..................39
Installing the EXP100 into arack .................40
Replacing the EXP100 CRUs ..................41
Replacing an ESM .....................42
Replacing apower supply ...................42
Replacing afan.......................43
Replacing ahard disk drive ..................44
Setting the interface options ....................44
Fibre Channel loop and ID settings ................44
Enclosure ID settings .....................44
Expansion enclosure speed settings ................45
Cabling the EXP100 .......................46
Installing SFP modules .....................47
Removing SFP modules ....................49
Handling fiber-optic cables ...................50
Using LC-LC Fibre Channel cables ................50
Connecting an LC-LC cable to an SFP module ...........51
Removing an LC-LC Fibre Channel cable .............52
Cabling the EXP100 to aDS4000 storage subsystem .........53
EXP100 loop redundancy ....................56
Cabling the power supply ....................58
Turning the EXP100 on and off ...................58
Turning on the EXP100 .....................58
Turning off the EXP100 .....................60
Performing an emergency shutdown ................61
Restoring power after an emergency ................61
Chapter 3. Installing and replacing devices .............63
Adding anew EXP100 to an existing and configured drive loop .......63
Determining firmware levels of the new and existing EXP100s ......63
Adding the EXP100 to the existing drive loop.............66
Upgrading ESM firmware after adding the EXP100 to an existing drive loop 68
Working with hot-swap hard disk drives ................73
Notes for installing the new 250 GB SATA drive CRU/FRU (P/N 40K6837) 74
Installing hot-swap hard disk drives ................74
Replacing hot-swap hard disk drives ................76
Replacing multiple drives ....................78
Replacing all drives at the same time ..............79
Replacing the drives one at atime................81
Working with hot-swap power supplies ................83
Removing the failed hot-swap power supply .............84
Replacing the failed hot-swap power supply .............84
Replacing afailed hot-swap ESM ..................85
Receiving the replacement ESM CRU ...............86
iv IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
||
||
||
||

Upgrading firmware when replacing afailed hot-swap ESM .......87
Steps for replacing ahot-swap ESM ................92
Troubleshooting ........................95
Replacing afailed hot-swap cooling fan ................97
Chapter 4. Hardware maintenance .................99
General checkout ........................99
Solving problems ........................99
Parts listing.......................... 104
Appendix A. Upgrading R1-level firmware (DS4300 and DS4500 only) 107
Overview .......................... 107
Upgrading the firmware to enable EXP100 R2 full high-availability support 107
Checking current firmware levels ................. 108
Preparing for the upgrade ................... 109
Downloading the ESM firmware and csb file ............. 111
Downloading the ESM firmware ................ 111
Downloading the csb file ...................112
Downloading the controller firmware and NVSRAM ..........112
Downloading the controller firmware...............112
Downloading the NVSRAM ..................113
Completing the upgrade ....................113
Problem recovery .......................113
Appendix B. Records .....................115
Identification numbers ......................115
Storage subsystem and controller information record ..........116
Sample information record ...................117
Installed device records .....................118
Appendix C. Rack mounting template ...............119
Appendix D. Power cords .................... 123
Appendix E. Additional DS4000 documentation ........... 125
DS4000 Storage Manager Version 9library .............. 125
DS4500 Fibre Channel Storage Server library ............. 126
DS4400 Fibre Channel Storage Server library ............. 127
DS4300 Fibre Channel Storage Server library ............. 128
DS4100 SATA Storage Server library ................ 129
DS4800 Storage Subsystem library ................. 130
Other DS4000 and DS4000-related documents ............ 131
Appendix F. European Directive About Product Recycling and Disposal 133
Appendix G. Battery Return Program ............... 135
Appendix H. Cable Warning ................... 137
Appendix I. Accessibility .................... 139
Notices ........................... 141
Trademarks.......................... 141
Important notes ........................ 142
Electronic emission notices .................... 142
Federal Communications Commission (FCC) statement ........ 142
Contents v
||
||

Chinese class Acompliance statement............... 143
Industry Canada Class Aemission compliance statement ........ 143
Australia and New Zealand Class Astatement ............ 143
United Kingdom telecommunications safety requirement ........ 143
European Union EMC Directive conformance statement ........ 143
Taiwan Class Awarning statement ................ 144
Japanese Voluntary Control Council for Interference (VCCI) statement 144
Glossary .......................... 145
Index ............................ 155
vi IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide

Figures
1. EXP100 hot-swap drive bays ..........................15
2. Hot-swap fan, ESM, and power supply bays .....................16
3. Front controls and indicators ..........................17
4. Power supply controls, indicators, and connectors ..................18
5. Fan controls and indicators ...........................19
6. ESMs and user controls ............................20
7. Enclosure ID Switch..............................21
8. Example of cold aisle/hot aisle rack configuration ...................24
9. EXP100 ESM and drive paths ..........................25
10. The right ESM and controller firmware recover from aloss of connectivity to the input port of the
left ESM ..................................26
11. Right ESM reroutes I/Os along dashed alternate paths .................27
12. Orthogonally striped RAID arrays –Option 1....................28
13. Orthogonally striped RAID arrays –Option 2....................28
14. Front rack mounting template ..........................33
15. Rear rack mounting template ..........................34
16. Alignment pins with and without spacers ......................35
17. Installing the support rails ...........................36
18. Removing an ESM ..............................38
19. Removing apower supply ...........................38
20. Removing afan unit..............................39
21. Removing adrive CRU ............................40
22. Installing the EXP100 .............................41
23. Replacing an ESM ..............................42
24. Replacing apower supply ...........................43
25. Replacing afan ...............................43
26. Enclosure ID switches .............................44
27. Enclosure ID settings .............................45
28. SFP module and protective cap .........................48
29. Installing an SFP module into the host port .....................49
30. Unlocking the SFP module latch -plastic variety ...................49
31. Unlocking the SFP module latch -wire variety ....................50
32. LC-LC Fibre Channel cable ...........................51
33. Removing fiber-optic cable protective caps .....................52
34. Inserting an LC-LC Fibre Channel cable into an SFP module ..............52
35. LC-LC Fibre Channel cable lever and latches ....................53
36. Removing the LC-LC Fibre Channel cable .....................53
37. Connecting cables to the installed SFP on aDS4300 .................54
38. Connecting cables to the installed SFP on aDS4500 .................55
39. Connecting cables to the installed SFP on aDS4800 .................55
40. Installing an SFP module and connecting an LC-LC cable to the EXP100 ..........56
41. EXP100 redundant loop configuration .......................57
42. Cabling the EXP100 to two redundant loops .....................67
43. Hot-swap hard disk drive LEDs .........................75
44. Drive CRU handle ..............................76
45. Moving the power supply lever and replacing the failed hot-swap power supply ........84
46. Connecting the power supply ..........................85
47. Removing the failed ESM............................93
48. Replacing ahot-swap cooling fan.........................98
49. EXP100 storage expansion enclosure parts list ................... 104
50. Front rack mounting template .......................... 120
51. Rear rack mounting template .......................... 121
©Copyright IBM Corp. 2004, 2005 vii
||
||
||
||
||

viii IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide

Tables
1. Mapping of FAStT names to DS4000 Series names.................. xvii
2. Where to find DS4000 installation and configuration procedures ............. xix
3. Minimum firmware versions recommended for use with the EXP100 ............5
4. Compatible ESM firmware version by CRU part number .................7
5. EXP100 firmware release levels, CRU types, and supported DS4000s ...........7
6. IBM TotalStorage EXP100 Storage Expansion Enclosure specifications ...........22
7. Alignment pin requirements for different rack flange hole types ..............35
8. New EXP100 expansion enclosure and existing EXP100 expansion enclosure firmware
compatibility ................................63
9. ESM firmware level by CRU part number ......................64
10. New EXP100 expansion enclosure ESM firmware version by serial number and packaging label 65
11. ESM firmware upgrade procedures for new EXP100s .................70
12. Drive LED activity ..............................73
13. ESM firmware upgrade procedures for replacing ESMs.................88
14. Troubleshooting ESM incompatibility issues .....................95
15. Existing EXP100 ESM and new EXP100 ESM firmware compatibility levels .........96
16. Symptom-to-FRU index ............................ 100
17. Troubleshooting ESM incompatibility issues .................... 103
18. Parts listing (EXP100 storage expansion enclosure) ................. 104
19. Required current firmware levels ........................ 108
20. Storage subsystem and controller information record .................116
21. Sample information record ...........................117
22. Hard disk drive record ............................118
23. TotalStorage DS4000 Storage Manager Version 9.1 titles by user tasks .......... 125
24. TotalStorage DS4500 Fibre Channel Storage Server document titles by user tasks ...... 126
25. TotalStorage DS4400 Fibre Channel Storage Server document titles by user tasks ...... 127
26. TotalStorage DS4300 Fibre Channel Storage Server document titles by user tasks ...... 128
27. TotalStorage DS4100 SATA Storage Server document titles by user tasks ......... 129
28. TotalStorage DS4800 Storage Subsystem document titles by user tasks .......... 130
29. TotalStorage DS4000 and DS4000–related document titles by user tasks ......... 131
30. DS4000 Storage Manager alternate keyboard operations ............... 139
©Copyright IBM Corp. 2004, 2005 ix
||
||
||
|
||
||
||
||
||
||
||

xIBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide

Safety
The caution and danger statements that this document contains can be referenced
in the multilingual IBM Safety Information document that is provided with your IBM
TotalStorage EXP100 Storage Expansion Enclosure. Each caution and danger
statement is numbered for easy reference to the corresponding statements in the
translated document.
vDanger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. Adanger statement is placed just before the
description of apotentially lethal or extremely hazardous procedure, step, or
situation.
vCaution: These statements indicate situations that can be potentially hazardous
to you. Acaution statement is placed just before the description of apotentially
hazardous procedure step or situation.
vAttention: These notices indicate possible damage to programs, devices, or
data. An attention notice is placed just before the instruction or situation in which
damage could occur.
Before installing this product, read the following danger and caution notices.
©Copyright IBM Corp. 2004, 2005 xi

Statement 1:
DANGER
Electrical current from power, telephone, and communication cables is
hazardous.
To avoid ashock hazard:
vDo not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
vConnect all power cords to aproperly wired and grounded electrical
outlet.
vConnect to properly wired outlets any equipment that will be attached to
this product.
vWhen possible, use one hand only to connect or disconnect signal
cables.
vNever turn on any equipment when there is evidence of fire, water, or
structural damage.
vDisconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
vConnect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached
devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
xii IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide

Statement 3:
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or
transmitters) are installed, note the following:
vDo not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
vUse of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
Class 1Laser statement
Class 1 Laser Product
Laser Klasse 1
Laser Klass 1
Luokan 1 Laserlaite
Apparell Laser de Calsse 1À
IEC 825-11993 CENELEC EN 60 825
Safety xiii

Statement 4:
≥18 kg (39.7 lb) ≥32 kg (70.5 lb) ≥55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
1
2
xiv IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide

Statement 8:
CAUTION:
Never remove the cover on apower supply or any part that has the following
label attached.
Hazardous voltage, current, and energy levels are present inside any
component that has this label attached. There are no serviceable parts inside
these components. If you suspect aproblem with one of these parts, contact
aservice technician.
Safety xv

xvi IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide

About this document
This document provides instructions for installing and customizing the configuration
of your IBM
® TotalStorage ® DS4000 EXP100 Storage Expansion Enclosure. It also
provides maintenance procedures and troubleshooting information.
FAStT product renaming
IBM has renamed some FAStT family products. Table 1identifies each DS4000
product name with its corresponding previous FAStT product name. Note that this
change of product name only indicates no change in functionality or warranty. All
products listed below with new names are functionally-equivalent and
fully-interoperable. Each DS4000 product retains full IBM service as outlined in
service contracts issued for analogous FAStT products.
Table 1. Mapping of FAStT names to DS4000 Series names
Previous FAStT Product Name Current DS4000 Product Name
IBM TotalStorage FAStT Storage Server IBM TotalStorage DS4000
FAStT DS4000
FAStT Family DS4000 Mid-range Disk System
FAStT Storage Manager vX.Y (for example
v9.10)
DS4000 Storage Manager vX.Y (for example
v9.10)
FAStT100 DS4100
FAStT600 DS4300
FAStT600 with Turbo Feature DS4300 Turbo
FAStT700 DS4400
FAStT900 DS4500
EXP700 DS4000 EXP700
EXP710 DS4000 EXP710
EXP100 DS4000 EXP100
FAStT FlashCopy FlashCopy for DS4000
FAStT VolumeCopy VolumeCopy for DS4000
FAStT Remote Mirror (RM) Enhanced Remote Mirroring for DS4000
FAStT Synchronous Mirroring Metro Mirroring for DS4000
Global Copy for DS4000
(New Feature =Asynchronous Mirroring
without Consistency Group)
Global Mirroring for DS4000
(New Feature =Asynchronous Mirroring with
Consistency Group)
Who should read this document
This document is intended for system operators and service technicians who have
extensive knowledge of Fibre Channel and network technology.
©Copyright IBM Corp. 2004, 2005 xvii

How this document is organized
Chapter 1, “Introduction,” on page 1describes the IBM TotalStorage EXP100
Storage Expansion Enclosure. This chapter includes an inventory checklist and an
overview of the storage expansion enclosurefeatures, operating specifications, and
components.
Chapter 2, “Installing the EXP100,” on page 29 contains instructions for the
following tasks:
vInstall the storage expansion enclosurein astandard rack cabinet
vSet the interface options
vCable the storage expansion enclosure
vRoute the power cord
vPower the storage expansion enclosure on or off during either normal or
emergency situations
Chapter 3, “Installing and replacing devices,” on page 63 contains step-by-step
instructions for how to install or remove customer replaceable units (CRUs), such
as hard disk drives, power supplies, environmental services modules (ESMs), and
fan units.
“ESM failover architecture” on page 24 contains guidelines for array configurations
that offer maximum protection of data access in the event of ESM failure in the
initial release of the EXP100 storage expansion enclosure.
Chapter 4, “Hardware maintenance,” on page 99 describes problems and symptoms
that are specific to your storage expansion enclosure. It also provides aparts for list
for the EXP100.
Appendix A, “Upgrading R1-level firmware (DS4300 and DS4500 only),” on page
107 contains information on how to enable EXP100 R2 full high-availability support
by upgrading the EXP100 ESM firmware, the DS4000 controller firmware, and
NVSRAM.
Appendix B, “Records,” on page 115 provides atable that you can use to record
and update important information about your EXP100, including serial number and
device records. Whenever you add options to your EXP100, be sure to update the
information in this table.
Appendix C, “Rack mounting template,” on page 119 provides the rack mounting
templates for installation of the EXP100. If you want to tear out the templates from
the document for use during installation, use these copies of the templates.
Appendix D, “Power cords,” on page 123 lists power cord information for the
EXP100.
Appendix E, “Additional DS4000 documentation,” on page 125 lists the documents
that are available in the IBM TotalStorage DS4000 Storage Manager and DS4000
Storage Subsystem product libraries, and other related documents.
Appendix F, “European Directive About Product Recycling and Disposal,” on page
133 provides information regarding the European Directive About Product Recycling
and Disposal, an environmental directive that is in effect throughout the European
Union.
xviii IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide