Rackable Systems OMNISTOR 4000f SERIES User manual

Rackable Systems Inc.
Restricted Rights and Liability
No part of this manual may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic,
mechanical, recording, or otherwise, in whole or part, without prior written permission from Rackable Systems Inc.
Rackable Systems Inc. shall not be liable for any damages or for the loss of any information resulting from the performance or use of the
information contained herein. Your rights to the software are governed by the license agreement included with any accompanying
software. Information in this manual is subject to change without notice. Product features and specifications described are subject to
change without notice.
Copyright © 2005 Rackable Systems Inc. All Rights Reserved.
Rackable Systems Inc.
1933 Milmont Ave.
Milpitas, CA 95035
http://www.rackable.com
Rackable Systems, and OmniStor are trademarks of Rackable Systems Inc.
The names of actual companies and products mentioned herein may be the trademarks of their respective owners.
Agency Notes
WARNING: Drives and controller/adapter cards described in this manual should only be installed in UL-listed and CSA certified computers that give
specific instructions on the installation and removal of accessory cards (refer to your computer installation manual for proper
instructions).
ATTENTION: Les lecteurs et cartes contrôleurs décrits ici ne doivent être montés que sur des ordinateurs homologués (UL et CSA) et livrés avec des
manuels contenant les instructions d’installation et de retrait des accessoires. Reportez-vous au manuel d’installation de votre ordinateur.
SERVICE NOTE: Remove the power cables prior to servicing this equipment.
!

i
Contents
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v
Welcome . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v
Typographical Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Customer Care . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
1Getting Started . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
At a Glance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Front Bezel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Power System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Cooling Fan Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
SES Controller Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Disk I/O Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Control and Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Status Indicator LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Drive LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Audible Alarm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2Topologies and Operating Modes . . . . . . . . . . . . . . . . . . . . 19
Operating Mode Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
JBOD Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Fibre Channel Media Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
3Setup and Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Storage System Detailed Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Installing the Storage System Enclosure into the Rack Cabinet . . . . . . . . . 24
Installing the Storage System into the Tower Stand . . . . . . . . . . . . . . . . . . . 27
Completing the Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Before You Continue... . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Special Note for Microsoft Windows 2000 Installations . . . . . . . . . . . . . . . 33

Table of Contents
ii
Operating Mode Configuration and Cabling . . . . . . . . . . . . . . . . . . . . . . . . 34
Upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Powering On the Storage System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Powering Off the Storage System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
4Managing and Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Enclosure Component Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Status Indicator LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Drive LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Audible Alarm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
One-Touch Annunciation Configuration Display . . . . . . . . . . . . . . . . . . . . 59
VT-100 Interface Enclosure Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
SES Commands Debug . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Uploading SES Controller Card Firmware . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Enclosure Fan Speed Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
5Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
General Enclosure Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Common Fibre Loop/Bus Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Common Problems and Interpreting the LEDs . . . . . . . . . . . . . . . . . . . . . . 71
Terminal and COM Port Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Problems During Bootup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
6Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Removing the Front Bezel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Replacing the Cooling Fans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Replacing an AC Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
Replacing a DC Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Replacing a Disk Drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
Replacing the Disk I/O Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Replacing the SES Controller Card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
Replacing the Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
ATechnical Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
BPort Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
SES Controller Card Service Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Null-Modem Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Optical SFP Transceiver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93

Table of Contents
iii
DC Power Supply Connector Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
CRegulatory Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
Compliance Information Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
FCC Class A Radio Frequency Interference Statement . . . . . . . . . . . . . . . . 96
Class A Taiwanese Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Class A Japanese Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
CE Notice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Power Cord Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99

Table of Contents
iv

v
Preface
About this Manual
Welcome
Congratulations on the purchase of your new Omni Stor
®
4000F Series Storage System
from Rackable Systems Inc. This
Omni Stor 4000F Series is a very high-performance fully
fault-tolerant 2 Gb Fibre Channel-to-Fibre Channel JBOD storage system. It’s unique 2U
design is optimized to fit in the compact space of today’s data centers rack environments
and as a deskside tower system.
The storage enclosure supports up to twelve hot pluggable 1-inch high Fibre Channel disk
drives in a 2U (3.47-inch) form factor.
Full component redundancy is provided through a
hot pluggable cooling fan module which contains dual in-line fans that will continue to
provide adequate cooling should one fan fail, dual
Disk IO cards and a n N+1 power system
with dual independent power supplies. Each power supply is a hot swappable component
that continues to operate without interruption to normal service with the loss of one power
supply.
Product Identification
Storage Enclosure Number of Controllers Model of Controller
OmniStor 4000F 0JBOD

About this Manual
Welcome
vi
The Omni Stor 4000F is a 12-Bay 3.5" (2U) rackmount JBOD storage solution. The storage
enclosure includes dual Disk IO cards, four optical transceivers, dual power supplies, dual
AC power cords, SES Controller card, and a removable cooling fan module. It also includes
configuration software, DB-9 null modem cable, and a rackmount rail kit.þ
This user’s guide is your complete documentation to set up the storage system hardware,
add components, cable the storage system components, replace parts, and diagnose/repair
your system.
Refer to “Managing and Monitoring” on page 55 for enclosure management operations.
For details on software configuration, refer to the operating system guide included with
your host system.

About this Manual
Typographical Conventions vii
Typographical Conventions
The following typographical conventions are used in the user’s guide:
nMenu items are displayed in the format: “Array Configuration menu, choose View
Unused Drives.”
nCode font will indicate literal text used in examples.
nItalic code font indicates a replaceable or variable item in code.
nItalic text indicates the item that is selected or chosen.
nKey strokes are enclosed in brackets, e.g., <Esc>, <K>, or <Enter>.
Customer Care
You will find warranty, customer service and technical support on the Rackable Systems
web site. Refer to http://www.rackable.com.

About this Manual
Features
viii
Features
The Omni Stor 4000F Series Storage Systems are designed for mission critical applications
that require the highest performance with uncompromised data reliability, while
maintaining exceptionally high throughput. The storage system is ideally suited for high
bandwidth data intensive applications, such as electronic commerce, digital video, CAD,
seismic research, digital pre-press, 3-D imaging, and SAN environments.
The following are major features:
n2 Gb Fibre Channel-to-Fibre Channel storage system enclosure.
nHot pluggable disk drives, 12 per enclosure.
nHot pluggable cooling fan module.
nDual redundant AC power supplies.
n(Optional) Dual redundant DC power supplies.
nDual 2 Gb/sec disk side channels for high performance, failure resilient paths to the
drives. Disk channels are optimized with full duplex operations.
nSES Enclosure management includes onboard environmental monitoring.
nDesigned to fit standard 19-inch rack enclosures or a deskside tower.
nFront panel LEDs provide notifications of system component status, and logical
and physical drive status.
nReduced noise levels through the “whisper mode” automatic fan control.
nOperating system independence – no special software or drivers required.
nSupports JBOD (just a bunch of disks) applications.

1
Chapter 1
Getting Started
This chapter provides a description of the enclosure components and its onboard
monitoring systems.
The Components section identifies and gives a complete description of each major
component. The Monitoring section describes the enclosure’s LEDs, and the manner in
which normal and abnormal conditions are presented.
OmniStor 4000F Storage System
Tower Model
Rack-Mount Model

Chapter 1 - Getting Started
At a Glance
2
At a Glance
The following illustrations show the featured components of the OmniStor 4000F Series
Storage System. Familiarize yourself with its components prior to installing and using the
storage system.
Component Views
SES CONTROLLER
PART NUMBER 08-9-96322001
ARTWORK REVISION -1
JP1
JP2
RS-232
A
D
0
A
D
1
A
D
2
S
P
1
S
P
2
B
D
R
D
L
Y
R
M
T
SES
D1
DISK I/O
D2
Tx Tx
Tx
Fibre Disk IO LRC
P/N 08-9-96318001
A/W Rev-1 INSTALL JUMPERS 1 & 2
FOR HARDWARE
FAILURE DETECT
ADD JUMPER FOR
1G OPERATION
JP2
JP2
JP3
JP1
ADD JUMPER FOR
SPLIT BUS MODE
D1
DISK I/O
D2
Tx Tx
Tx
Fibre Disk IO LRC
P/N 08-9-96318001
A/W Rev-1 INSTALL JUMPERS 1 & 2
FOR HARDWARE
FAILURE DETECT
ADD JUMPER FOR
1G OPERATION
JP2
JP2
JP3
JP1
ADD JUMPER FOR
SPLIT BUS MODE
350-watt hot-pluggable
i
ndependent power supplies
Dual in-line 80-CFM hot
swappable cooling fans
SES Card
Disk I/O Cards
Blank Plate

Chapter 1 - Getting Started
Components 3
Components
This section provides a description of each of the major components that comprise the
OmniStor 4000F Series Storage System.
Front Bezel
The front bezel houses the Status LEDs, Drive LEDs, and alarm reset button. When
removed, the user has access to the disk drives. The front bezel can be installed or removed
without interruption to system activities.
Embedded within the front bezel is the electronic package that provides the communication
with the SES controller. The SES controller manages the signals to the front panel through
a smart interconnect. Power is applied to the front bezel through the interface edge
connector, where a control circuit monitors the bezel for proper connection. When the
bezel is properly installed and power is applied to the enclosure, the bezel is immediately
energized.
Refer to “Control and Monitoring” on page 15 for details on the monitoring functions.
Removable Front Bezel
To remove the bezel and gain access to the disk drives, use a Phillips screwdriver to release
both bezel fasteners, then grasp and remove the bezel. The fasteners rotate one-quarter turn
clockwise to lock and counter-clockwise to unlock.

Chapter 1 - Getting Started
Power System
4
Power System
Standard AC Hot Swappable Power Supplies
The AC power system consists of two 350-watt hot-pluggable power supplies, each with
independent AC power cords and cooling fans. This power system provides the enclosure
with “N+1” redundant power. Each power supply has auto-switching circuitry for use with
either 100V or 240V AC systems.
AC Power Supply
Power is applied to the enclosure by pressing each of the two power supply On/Off
switches to their “On” position. A Power On LED located on each power supply will be
illuminated indicating that AC power has been applied. The front bezels’ Power On LED
will also be illuminated indicating that power has been applied.
Each power supply also incorporates an amber general Fault LED. If the power supply is
installed and power is not applied to the power supply or the power supply cooling fan fails,
the Fault LED will illuminate, along with an audible alarm.
The front bezels’ Power Supply Status LED will illuminate green when both power
supplies are on and operating normally. If only one power supply is operational, the Power
Supply Status LED will be illuminated amber.
Each power supply has an AC Power Cord Module. The module has a power cord bale
incorporated into the design which secures the power cord once it has been properly
inserted, preventing inadvertent cord disconnects.
P
ower On LED
(green)
Fault LED
(amber)
Release
Latch
Power Connector
Module

Chapter 1 - Getting Started
Optional DC Hot Swappable Power Supplies 5
Optional DC Hot Swappable Power Supplies
The DC power system is designed to allow the storage system to be installed with Telco
system hardware installations. It consists of two 350-watt hot-pluggable power supplies, each
with independent DC power cables and cooling fans. It provides the enclosure with “N+1”
redundant power with Telco hardware. Each power supply cables directly with your DC
power feed system.
DC Power Supply
The DC power supply has the same user features to that of the AC Power Supplies
described on the previous page with the exception of the power cord bale.
NOTE: The DC system must be installed in a restricted access location, in accordance
with intent of the National Electrical Code. A restricted access location is defined
as an area intended only for qualified or trained personnel only. Access should be
controlled by key lock or access card.
Each power supply has a special cable connector that plugs into the face of the power
supply and mechanically connects to your DC feed system. Refer to the Installation chapter
for cabling procedures.
DC Source Site Requirements
Electrical Equipment Requirement
Voltage -36 to -72 VDC
Max. Operating Current 13.5 amp to 6.3 amps
Max. Input Surge Current 20.25 amps
P
ower On LED
(green)
Fault LED
(amber)
Release
Latch
Power Connector

Chapter 1 - Getting Started
Cooling Fan Module
6
The power feed must be electrically isolated from any AC power source, provide a reliable
connection to earth (battery room positive bus is connected to the grounding electrode),
and capable of providing up to 600 watts of continuous power per feed pair.
Overcurrent Protection Requirements
Overcurrent protection devices must be provided as part of each equipment rack. Circuit
breakers must be located between the DC power feed source and the power supplies (two
20 amp double-pole fast rip DC-rated circuit breakers for each power supply).
NOTE: Overcurrent protection devices must meet applicable national and local electrical
safety codes and be approved for the intended application.
Power supply overload protection will shut down the power supply when the output power
rating exceeds 110% to 130% of maximum rated output current.
DC Supply and Ground
You DC supply and ground conductor must meet the following requirements:
nSuitable conductor material: copper only.
nPower supply connections through the input connectors; 12AWG:
-48V
-48V Return
Ground to the power supply
nSystem ground conductor: 8 AWG.
nCable insulation rating: minimum of 75 C, low smoke fume (LSF), flame retardant.
nBranch circuit cable insulation color: per applicable national electrical codes.
nCable type: UL style 1028, UL 1581(VW-1), IEEE 383 compliant, or IEEE
1202-1991 compliant.
nGrounding insulation color: green/yellow.
Cooling Fan Module
The cooling system consists of two high-performance (80-CFM) cooling fans mounted in a
single fan module which slides into a bay at the rear of the enclosure. The design of the fan
module provides for an easy-to-install user-
replaceable component in a live environment without interruption of service.

Chapter 1 - Getting Started
Cooling Fan Module 7
If any one fan should fail, cooling redundancy and efficiency are degraded. The cooling fans
and enclosure temperature are constantly monitored by the SES processor for fault
conditions. In the event of a fault condition the front panel Fan Status LED will change from
a green state to a solid amber state in the case of a fan failure, or to a blinking amber green
state in the case of an over-temperature condition. In both cases an audible alarm sounds.
The SES processor will also provide notification data to monitoring software, such as
StorView.
WARNING: Do not operate the enclosure for extended periods of time (greater than 5
minutes) with the cooling fan module removed.
Cooling Fan Module
The enclosure has temperature sensors in two different areas, the drive bay, and the power
supplies. There are several steps the storage system performs to prevent component
damage due to over temperature conditions.
If the drive bay area reaches a temperature of 50°C (122°F) an audible alarm will sound, the
front panel Fan Status LED will toggle amber green, and the monitoring software will post a
warning message. These notifications give the user a warning that some condition is causing
the enclosure temperature to exceed the preset value, and an action is required by the user to
determine the cause and take corrective measures. It may be due to a blockage of air flow or a
low fan speed.
If any power supply reaches 85°C (185°F) the power supply will shut down.
Jumpers JP1 and JP2
Fan Speed Override Contro
l

Chapter 1 - Getting Started
Cooling Fan Module
8
The SES Controller card has a firmware-based VT-100 interface which provides an option to
manage fan speed. This option provides a whisper mode fan operation for noise sensitive
environments. When enabled (default), and based on a set of conditions, the software will
manage the cooling fans RPM speed to maintain the enclosure temperature while minimizing
noise levels. Refer to “Enclosure Fan Speed Control” on page 124 for more details on using
this option.
A manual override of the fan speed control is available for special circumstance
environments. Referring to the illustration on the preceding page, two jumpers are provided
on the fan module printed circuit board to override the software control of the fan speeds.
This hardware setting routes full power voltage to the fans for maximum operational speed,
which is greater than the maximum speed set by the automatic software control. This
configuration is normally used when fan speed noises are not an issue, and the ambient
operating temperature is at or above 30°C (86°F), thus ensuring that maximum available
cooling is being provided.
The jumpers JP1 and JP2 by default are offset, which enables the automatic fan speed
control. The jumper JP1 controls Fan 0 and JP2 controls Fan 1. Placing the jumper on both
pins for each jumper will override the automatic setting and configure the fans to
maximum power.