HP Surestore Disk Array 12h - And FC60 Assembly instructions

This manual was downloaded from http://www.hp.com/support/fc60/
HP SureStore E Disk Array FC60
Advanced User’s Guide
Edition E1200
Printed in U.S.A.
hpHH

2
Notice
© Hewlett-Packard Company, 1999, 2000. All rights
reserved.
Hewlett-Packard Company makes no warranty of
anykindwithregardtothisdocument,including,but
not limited to, the implied warranties of merchant-
ability and fitness for a particular purpose. Hewlett-
Packard shall not be liable for errors contained
herein or for incidental or consequential damages in
connection with the furnishing, performance, or use
of this material.
This document contains proprietary information,
which is protected by copyright. No part of this
document may be photocopied, reproduced, or
translated into another language without the prior
written consent of Hewlett-Packard. The informa-
tion contained in this document is subject to change
without notice.
Trademark Information
Microsoft, Windows, Windows NT, and Windows
2000 are registered trademarks of the Microsoft
Corporation.
Safety Notices
To protect against personal injury and product
damage, do not attempt to lift the product without
the assistance of another person or lift device.
Components bearing this symbol may
be hot to touch.
Components bearing this symbol are
fragile. Handle with care.
Components bearing this symbol are
susceptible to damage by static
electricity. ESD precautions are
required.
Service
Any servicing, adjustment, maintenance, or repair
must be performed only by authorized service-
trained personnel.
Weight Exceeds 100 lbs. (45 kg.)
Do NOT lift unassisted. Use
a lift device or two people.
Warning

3
Format Conventions
Denotes
WARNING A hazard that can cause personal injury
Caution A hazard that can cause hardware or software damage
Note Significant concepts or operating instructions
this font Text to be typed verbatim: all commands, path names, file names, and directory names
this font Text displayed on the screen
Printing History
1st Edition - September 1999
2nd Edition - October 1999
3rd Edition - February 2000
4th Edition - July 2000
5th Edition - September 2000
6th Edition - October 2000
7th Edition - December 2000

4
Manual Revision History
December 2000
Change Page
Added Figure 87 to clarify operation of the write cache flush thresholds. 253
Added note regarding the impact of LUN binding on performance. 250
Added information on Managing the Universal Transport Mechanism (UTM).298
Added information on major event logging available with firmware HP08. 307
Added Allocating Space for Disk Array Logs section describing use of
environment variable AM60_MAX_LOG_SIZE_MB. 308
Added information on Purging Controller Logs. 311
Added information for RAID 0 support on HP-UX. 47
Changed the required minimum number of disk modules per enclosure from
2 to 4 based on power supply requirements for the disk enclosure. 73

5
About This Book
This guide is intended for use by system administrators and others involved in operating and
managing the HP SureStore E Disk Array FC60. It is organized into the following chapters and
section.
Chapter 1, Product Description Describes the features, controls, andoperation of the
disk array.
Chapter 2, Topology and Array Planning Guidelines for designing the disk array configuration
that best meets your needs.
Chapter 3, Installation Instruction for moving the disk array.
Chapter 4, Managing the Disk Array on
HP-UX Complete instructions for managing your disk array
using the available management software.
Chapter 5, HP-UX Diagnostic Tools Information on using STMto gather information about
disk array status.
Chapter 6, Troubleshooting Instructions for isolating and solving common
problems that may occur during disk array operation.
Chapter 7, Removal and Replacement Instructions for removing and replacing all customer-
replaceable components.
Chapter 8, Reference / Legal /
Regulatory Regulatory, environmental, and other reference
information.
GLOSSARY
Index

6
Related Documents and Information
The following items contain information related to the installation and use of the HP SureStore E
Disk Array and its management software.
•HP SureStore E Disk Array FC60 Advanced User’s Guide - this is the expanded version of the
bookyou arereading.Topics that are discussed in more detail in the Advanced User’s Guide are
clearly identified throughout this book.
!"Download: www.hp.com/support/fc60
•HP Storage Manager 60 User’s Guide - this guide describes the features and operation of the
disk array management software for Windows NT and Windows 2000. It is included with the
A5628A software kit.
!"Download: www.hp.com/support/fc60
•HP Storage Manager 60 Introduction Guide- this guide introduces thedisk array management
software for Windows NT and Windows 2000. It is included in electronic format on the HP
Storage Manager 60 CD.
!"Download: www.hp.com/support/fc60
•Fibre Channel Mass Storage Adapters Service and User Manual (A3636-90002) - describes
FibreChannelMassStorage/9000.ItdescribesinstallationoftheFibreChannelI/Oadaptorsinto
K-, D-, T-, and V-class systems.
!"Download: www.hp.com/essd/efc/A3636A_documentation.html
•Using EMS HA Monitors (B5735-90001) - contains information about the EMS environment
used for hardware monitoring.
!"Download: http://www.docs.hp.com/hpux/ha/
•EMS Hardware Monitors User’s Guide - describes how to use the EMS Hardware Monitors to
protect your system from undetected failures.
!"Download: http://www.docs.hp.com/hpux/systems/
•Diagnostic/IPR Media User’s Guide (B6191-90015) - provides information on using STM, and
enabling the EMS Hardware Event Monitors.
!"Download: http://www.docs.hp.com/hpux/systems/
•Managing MC/ServiceGuard (B3939-90024) - provides information on creating package
dependencies for hardware resources.
!"Download: http://www.docs.hp.com/hpux/ha/

7
Contents
1 Product Description
Product Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Operating System Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Management Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
High Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Scalable Storage Capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
LED Status Monitoring. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
EMS Hardware Event Monitoring (HP-UX Only) . . . . . . . . . . . . . . . . . . . . . . . . .22
Disk Enclosure Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Operation Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Disk Enclosure SC10 Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Array Controller Enclosure Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Front Cover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Controller Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Controller Fan Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40
Power Supply Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
Power Supply Fan Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
Battery Backup Unit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Disk Array High Availability Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47
RAID Technology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47
Disk Mirroring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47
Data Parity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Data Striping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
RAID Levels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
RAID Level Comparisons. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57
Global Hot Spare Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
Primary and Alternate I/O Paths . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64
Capacity Management Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65
LUNs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65

8
Disk Groups. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65
Disk Array Caching. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66
Dynamic Capacity Expansion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .67
2 Topology and Array Planning
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70
Array Design Considerations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .71
Array Hardware Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .71
RAID, LUNs, and Global Hot Spares . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
High Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73
Storage Capacity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Expanding Storage Capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Recommended Disk Array Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77
Configuration Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77
One Disk Enclosure Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78
Two Disk Enclosure Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .80
Three Disk Enclosure Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84
Four Disk Enclosure Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88
Five Disk Enclosure Configurations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .92
Six Disk Enclosure Configurations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .96
Total Disk Array Capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .100
For high-availability, one disk per SCSI channel is used as a global hot spare.. .101
Topologies for HP-UX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .102
Basic Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .103
Single-System Distance Topology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .110
High Availability Topology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .115
High Availability, Distance, and Capacity Topology . . . . . . . . . . . . . . . . . . . . .120
Campus Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .125
Performance Topology with Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Topologies for Windows NT and Windows 2000 . . . . . . . . . . . . . . . . . . . . . . . . . . .131

9
Contents
Non-High Availability Topologies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .133
High Availability Topologies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .137
3Installation
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .144
Host System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .145
HP-UX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .145
Windows NT and Windows 2000. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .146
Site Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .147
Environmental Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .147
Electrical Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .147
Power Distribution Units (PDU/PDRU). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .150
Installing PDUs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .152
Recommended UPS Models. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .152
Installing the Disk Array FC60 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .155
Installing the Disk Enclosures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .160
Step 1: Collect Required Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .160
Step 2: Unpack the Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .160
Step 3: Install Mounting Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .162
Step 4: Install the Disk Enclosure. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .162
Step 5: Install Disks and Fillers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .166
Moving a Disk Enclosure from One Disk Array to Another . . . . . . . . . . . . . . .168
Installing the Controller. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .170
Step 1: Gather Required Tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .170
Step 2: Unpack the Product . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .170
Step 3: Install Mounting Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .173
Step 4: Install the Controller Enclosure. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .173
Configuration Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .176
Disk Enclosure (Tray) ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .176
Disk Enclosure DIP Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .176
Fibre Channel Host ID Address Setting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .179

10
Attaching Power Cords . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .183
Attaching SCSI Cables and
Configuring the Disk Enclosure Switches. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .187
Full-Bus Cabling and Switch Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
Split-Bus Switch and Cabling Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . .191
Connecting the Fibre Channel Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .196
Applying Power to the Disk Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .198
Verifying Disk Array Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .206
On Windows NT and Windows 2000. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .206
On HP-UX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .206
Interpreting Hardware Paths. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .208
Installing the Disk Array FC60 Software (HP-UX Only) . . . . . . . . . . . . . . . . . . . . .213
System Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .213
Verifying the Operating System. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .214
Installing the Disk Array FC60 Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .214
Downgrading the Disk Array Firmware for HP-UX 11.11 Hosts. . . . . . . . . . . .215
Configuring the Disk Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .216
HP-UX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .216
Windows NT and Windows 2000. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .220
Using the Disk Array FC60 as a Boot Device (HP-UX Only). . . . . . . . . . . . . . . . . .222
Solving Common Installation Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .223
Adding Disk Enclosures to Increase Capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . .224
General Rules for Adding Disk Enclosures to the Disk Array . . . . . . . . . . . . .224
Step 1. Plan the Expanded Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .225
Step 2. Backup All Disk Array Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .226
Step 3. Prepare the Disk Array for Shut Down . . . . . . . . . . . . . . . . . . . . . . . . . .226
Step 4. Add the New Disk Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .227
Step 5. Completing the Expansion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .230
Capacity Expansion Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .232

11
Contents
4 Managing the Disk Array on HP-UX
Tools for Managing the Disk Array FC60. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .238
System Administration Manager (SAM). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .238
Array Manager 60 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .238
STM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .238
Installing the Array Manager 60 Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .240
AM60Srvr Daemon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .241
Running Array Manager 60. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .241
Managing Disk Array Capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
Configuring LUNs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .242
Selecting Disks for a LUN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .243
Assigning LUN Ownership . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .247
Selecting a RAID Level . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .247
Global Hot Spares . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .248
Setting Stripe Segment Size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .249
Evaluating Performance Impact . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .250
Adding Capacity to the Disk Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .254
Adding More Disk Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .254
Adding Additional Disk Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .256
Replacing Disk Modules with Higher Capacity Modules. . . . . . . . . . . . . . . . . .256
Upgrading Controller Cache to 512 Mbytes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .258
Managing the Disk Array Using SAM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .260
Checking Disk Array Status. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .261
Assigning an Alias to the Disk Array. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .264
Locating Disk Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .265
Binding a LUN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .267
Unbinding a LUN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .271
Replacing a LUN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .271
Adding a Global Hot Spare. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .273
Removing a Global Hot Spare . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .275

12
Managing the Disk Array Using Array Manager 60. . . . . . . . . . . . . . . . . . . . . . . . . .276
Command Syntax Conventions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .279
Array Manager 60 man pages. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .279
Quick Help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .279
Selecting a Disk Array and Its Components . . . . . . . . . . . . . . . . . . . . . . . . . . . .280
Preparing to Manage the Disk Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .281
Checking Disk Array Status. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .282
Managing LUNs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .289
Managing Global Hot Spares. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .295
Managing Disk Array Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .297
Managing the Universal Transport Mechanism (UTM) . . . . . . . . . . . . . . . . . . .298
Managing Cache Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .299
Performing Disk Array Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .304
Managing Disk Array Logs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .307
Upgrading Disk Firmware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .313
Managing the Disk Array Using STM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .314
Checking Disk Array Status Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .314
Binding a LUN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .314
Unbinding a LUN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .315
Adding a Global Hot Spare. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .315
Removing a Global Hot Spare . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .315
Locating Disk Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .316
Status Conditions and Sense Code Information. . . . . . . . . . . . . . . . . . . . . . . . . . . .317
LUN Status Conditions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .317
Disk Status Conditions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .319
Component Status Conditions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .321
FRU Codes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .322
SCSI Sense Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .327
5 HP-UX Diagnostic Tools
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .346

13
Contents
Support Tools Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .347
STM User Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .347
STM Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .351
Using the STM Information Tool. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .352
Interpreting the Information Tool Information Log . . . . . . . . . . . . . . . . . . . . . .354
Interpreting the Information Tool Activity Log. . . . . . . . . . . . . . . . . . . . . . . . . .354
Using the STM Expert Tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .355
6 Troubleshooting
Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .360
About Field Replaceable Units (FRUs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .361
HP-UX Troubleshooting Tools. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .362
Windows NT and Windows 2000 Troubleshooting Tools . . . . . . . . . . . . . . . . .362
EMS Hardware Event Monitoring (HP-UX Only) . . . . . . . . . . . . . . . . . . . . . . . .362
Disk Array Installation/Troubleshooting Checklist . . . . . . . . . . . . . . . . . . . . . . . . .365
Power-Up Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .366
Controller Enclosure Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .367
Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .367
Controller Enclosure LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .368
Master Troubleshooting Table. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .370
SureStore E Disk System SC10 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . .376
Disk Enclosure LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .376
Losing LUN 0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .376
Interpreting Component Status Values (HP-UX Only). . . . . . . . . . . . . . . . . . . .379
Isolating Causes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .380
7 Removal and Replacement
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .384
Disk Enclosure Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .386
Disk Module or Filler Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .386

14
Disk Enclosure Fan Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .392
Disk Enclosure Power Supply Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .394
Controller Enclosure Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .396
Front Cover Removal/Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .397
Controller Fan Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .398
Battery Backup Unit (BBU) Removal/Replacement. . . . . . . . . . . . . . . . . . . . . .400
Power Supply Fan Module Removal/Replacement. . . . . . . . . . . . . . . . . . . . . . .403
Power Supply Module Removal/Replacement . . . . . . . . . . . . . . . . . . . . . . . . . .405
SCSI Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407
8 Reference / Legal / Regulatory
System Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .410
Host Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .410
Supported Operating Systems. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .410
Fibre Channel Host Adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
Models and Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .412
A5277A/AZ Controller Enclosure Models and Options . . . . . . . . . . . . . . . . . . .412
A5294A/AZ Disk Enclosure SC10 Models and Options . . . . . . . . . . . . . . . . . . .414
Disk Array FC60 Upgrade and Add-On Products . . . . . . . . . . . . . . . . . . . . . . . .416
PDU/PDRU Products . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .417
Replaceable Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .418
A5277A/AZ Controller Enclosure Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . .420
Dimensions: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .420
Weight: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .420
AC Power: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .421
Heat Output: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .421
Environmental Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .422
Acoustics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .423
A5294A/AZ Disk Enclosure Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .424
Dimensions: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .424
Weight: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .424

15
Contents
AC Power:. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .425
DC Power Output:. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .425
Heat Output:. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .425
Environmental Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .426
Acoustics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .427
Warranty and License Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .428
Hewlett-Packard Hardware Limited Warranty . . . . . . . . . . . . . . . . . . . . . . . . . .428
Software Product Limited Warranty. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .429
Limitation of Warranty . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .429
Hewlett-Packard Software License Terms. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .431
Regulatory Compliance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .434
Safety Certifications:. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .434
EMC Compliance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .434
FCC Statements (USA Only) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .435
IEC Statement (Worldwide). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .435
CSA Statement (For Canada Only). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .435
VCCI Statement (Japan). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .436
Harmonics Conformance (Japan). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .436
Class A Warning Statement (Taiwan). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .436
Spécification ATI Classe A (France Seulement). . . . . . . . . . . . . . . . . . . . . . . . .437
Product Noise Declaration (For Germany Only) . . . . . . . . . . . . . . . . . . . . . . . .437
Geräuschemission (For Germany Only) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .438
Declaration of Conformity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .439

16

Product Description
17
1 PRODUCT DESCRIPTION
Product Description. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Disk Enclosure Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Array Controller Enclosure Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Disk Array High Availability Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Capacity Management Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65

18 Product Description
Product Description
The HP SureStore E Disk Array FC60 (Disk Array FC60) is a disk storage system that
features high data availability, high performance, and storage scalability. To provide high
availability, the Disk Array FC60 uses redundant, hot swappable modules, which can be
replaced without disrupting disk array operation should they fail.
The Disk Array FC60 consists of two primary components: an FC60 controller enclosure,
and from one to six HP SureStore E Disk System SC10 enclosures (referred to throughout
this document as simply disk enclosures). The controller enclosure is responsible for
providing overall control of the Disk Array FC60 by managing the communication between
the host and the disk enclosures. Host communication is done through dual Fibre Channel
arbitrated loops (when dual controller modules are installed). By using Fibre Channel, the
Disk Array FC60 achieves a high data rate throughput. High data throughput is maintained
to the disks byusing upto six Ultra2 SCSI channels to the disk enclosures (onechannel for
each disk enclosure).
In addition to increased performance, the use of multiple disk enclosures provides
scalability — simplifying the process of adding storage capacity as needed. Up to six disk
enclosures can be added incrementally as storage demands increase. Each disk enclosure
holds up to ten disk modules in capacities of 9.1 Gbyte, 8.2 Gbyte, 36.4 Gbyte, or 73.4
Gbyte. A fully loaded system comprising six disk enclosures, each populated with ten 73.4-
Gbyte disk modules, achieves a capacity of over 3 Tbytes.
The Disk Array FC60 enclosures are designed for installation in HP’s original 19-inch
cabinets, which include the C2785A (1.1m), C2786A (1.6m), C2787A (2m), A1896A (1.1 m),
and A1897A (1.6 m) and the HP Rack System/E Racks which includes the A490xA and
A150xA Rack System/E cabinets. The Disk Array FC60 is also supported in the Rittal 9000
Series racks.

Product Description 19
Product Description
Figure 1 HP SureStore E Disk Array FC60 (Controller with Six Disk Enclosures)
SureStore E
Disk System SC10
Array Controller FC60

20 Product Description
Operating System Support
The Disk Array FC60 is currently supported on the following operating systems:
•HP-UX 11.0, 11.11, and 10.20
•WindowsNT 4.0
•Windows2000
Note Some disk array features are specific to each operating system. These features
are clearly identified throughout this book.
Management Tools
HP-UX Tools
The following tools are available for managing the disk array on HP-UX. These tools are
included with the disk array.
•Array Manager 60 command line utilities
•SAM
•Support Tools Manager (STM)
WindowsNT and Windows2000
The following tools are used to manage the Disk Array FC60 on Windows NT and Windows
2000. This tool is not included with the disk array, but must be ordered separately as
product A5628A.
•HP Storage Manager 60 (A5628A)
Features
The Disk Array FC60 offers the following features
•High availability
•Scalable storage capacity
•LED status monitoring