Rackable Systems OmniStor 4000S Series User manual

Rackable Systems Inc.
Restricted Rights and Liability
No part of this manual may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic,
mechanical, recording, or otherwise, in whole or part, without prior written permission from Rackable Systems Inc.
Rackable Systems Inc. shall not be liable for any damages or for the loss of any information resulting from the performance or use of the
information contained herein. Your rights to the software are governed by the license agreement included with any accompanying
software. Information in this manual is subject to change without notice. Product features and specifications described are subject to
change without notice.
Copyright © 2005 Rackable Systems Inc. All Rights Reserved.
Rackable Systems Inc.
1933 Milmont Ave.
Milpitas, CA 95035
http://www.rackable.com
Rackable Systems, and OmniStor are trademarks of Rackable Systems Inc.
The names of actual companies and products mentioned herein may be the trademarks of their respective owners.
Agency Notes
WARNING: Drives and controller/adapter cards described in this manual should only be installed in UL-listed and CSA certified computers that give
specific instructions on the installation and removal of accessory cards (refer to your computer installation manual for proper
instructions).
ATTENTION: Les lecteurs et cartes contrôleurs décrits ici ne doivent être montés que sur des ordinateurs homologués (UL et CSA) et livrés avec des
manuels contenant les instructions d’installation et de retrait des accessoires. Reportez-vous au manuel d’installation de votre ordinateur.
SERVICE NOTE: Remove the power cables prior to servicing this equipment.
!

Contents
About this Manual ................................................................................ v
Welcome .......................................................................................................................... v
Features ........................................................................................................................... vi
1Getting Started..................................................................................... 1
At a Glance....................................................................................................................... 2
Components...................................................................................................................... 3
Front Bezel.................................................................................................................. 3
Power System.............................................................................................................. 4
Standard AC Hot Swappable Power Supplies........................................................ 4
Optional DC Hot Swappable Power Supplies....................................................... 5
Cooling Fan Module.................................................................................................... 6
SAF-TE Disk I/O Card.............................................................................................. 8
SCSI SAF-TE Cluster Card........................................................................................ 10
Spin-Up Settings........................................................................................................... 11
Single Bus Module...................................................................................................... 12
RS-232 Service Ports.................................................................................................. 14
Control and Monitoring.................................................................................................... 15
Status Indicator LEDs................................................................................................ 15
Power-On LED.................................................................................................... 16
Channel Status LED............................................................................................. 16
Power Supply Status............................................................................................. 16
Fan Status............................................................................................................. 16
Drive LEDs................................................................................................................ 16
Audible Alarm............................................................................................................ 16
2 Theory of Controller Operation........................................................... 17
Operating Modes Overview............................................................................................. 17
A Word about Clustering.................................................................................................. 18
Minimizing Downtime for Maximum Data Availability.............................................. 18
3 Setup and Installation......................................................................... 21
Overview.......................................................................................................................... 21
Storage System Detailed Installation................................................................................ 22
Installing the Storage System Enclosure into the Rack Cabinet................................. 22
Installing the Storage System into the Tower Stand................................................... 25
Completing the Installation........................................................................................ 27

Cabling the DC Power Supplies................................................................... 29
Before You Continue........................................................................................ 31
Special Note for Microsoft Windows 2000/2003 Installations.......................... 31
Operating Mode Configuration and Cabling...................................................... 32
JBOD - 12 Drive Configuration................................................................... 32
JBOD - 24 Drive Configuration................................................................... 37
Topology Host Cabling...................................................................................... 40
Single Bus Clustering Configuration............................................................ 41
Powering On the Storage System....................................................................... 43
Powering Off the Storage System...................................................................... 43
4 Monitoring Systems............................................................................ 44
Enclosure Component Monitoring................................................................................... 44
Status Indicator LEDs................................................................................................... 45
Power-On LED....................................................................................................... 45
Channel Status LED................................................................................................ 45
Power Supply Status................................................................................................ 45
Fan Status................................................................................................................ 45
Drive LEDs................................................................................................................... 45
Drive Status LEDs.................................................................................................. 47
Drive Activity LEDs............................................................................................... 47
Audible Alarm............................................................................................................... 47
LED Matrix............................................................................................................. 48
One-Touch Annunciation............................................................................................. 50
Enclosure SAF-TE Monitoring........................................................................................ 54
Uploading SAF-TE Disk I/O & SCSI SAF-TE Cluster Card Firmware........................... 56
Enclosure Fan Speed Control........................................................................................ 60
SAFTE Commands Debug............................................................................................ 62
5 Troubleshooting.................................................................................. 64
General Enclosure Problems............................................................................................ 64
Common SCSI Bus Problems............................................................................................ 64
Terminal Emulator and COM Port Problems.................................................................... 66
Device SCSI Channel Problems........................................................................................ 67
Problems During Bootup.................................................................................................. 68
Common Problems and Interpreting the LEDs................................................................. 69

Contents
Warning and Error Events................................................................................................ 70
Warnings..................................................................................................................... 70
Errors.......................................................................................................................... 70
Disk Errors........................................................................................................................... 71
6 Maintenance...................................................................................... 74
Removing the Front Bezel................................................................................................ 74
Replacing the Cooling Fans.............................................................................................. 76
Replacing an AC Power Supply......................................................................................... 78
Replacing a DC Power Supply.......................................................................................... 80
Replacing a Disk Drive..................................................................................................... 82
Replacing the SAF-TE Disk I/O or SCSI SAF-TE.......................................................... 84
Clustering Card................................................................................................................. 84
Replacing the Enclosure................................................................................................... 86
A Technical Information........................................................................ 90
Specifications................................................................................................................... 90
B Port Information................................................................................. 92
VHD/CI SCSI Connectors............................................................................................... 92
SAF-TE Service Port........................................................................................................ 95
Null-Modem Cable........................................................................................................... 95
DC Power Supply Connector Pinout................................................................................. 96
C Regulatory Information...................................................................... 98
Compliance Information Statement.................................................................................. 98
FCC Class A Radio Frequency Interference Statement..................................................... 99
Class A Taiwanese Statement......................................................................................... 100
Class A Japanese Statement............................................................................................ 100
CE Notice...................................................................................................................... 100
Power Cord Selection..................................................................................................... 101
Index............................................................................................................................... 102

v
Preface
About this Manual
Welcome
Congratulations on the purchase of your new OmniStor 4000S Series JBOD Storage
System from Rackable Systems. The OmniStor 4000S Series is a very high-performance
fully fault-tolerant Ultra320/160 SCSI storage system. Its unique 2U design is optimized to
fit in the compact space of today’s data center rack enclosures and as a deskside tower
system.
At its core is the OmniStor 4000S Ultra320/160 SCSI JBOD storage enclosure which
supports up to twelve hot pluggable 1-inch high Ultra320 or Ultra160 disk drives all in a 2U
(3.47-inch) form factor enclosure. Full component redundancy is provided through hot
pluggable cooling fan module and independent power supplies.
This user’s guide is your complete documentation to set up the storage system hardware,
add components, cable the storage system components, replace parts, and diagnose/repair
your system.
For information on the software control, management and configuration, refer to one of
the following: VT-100 Software Guide or the AdminiStor Software Guide.
Product Identification
Storage Enclosure Number of Controllers Model of Controller
OmniStor 4000S 0JBOD

About this Manual
Features
vi
Features
The OmniStor 4000S Series Storage Systems is designed for mission critical applications
requiring the highest performance with uncompromised data reliability, such as mid-range
and enterprise server storage. They maintain exceptionally high throughput and are ideally
suited for high bandwidth data intensive applications, such as electronic commerce, digital
video, CAD, seismic research, digital pre-press, and 3-D imaging.
The following are major features of the OmniStor 4000S
Series Storage Systems:
nUltra320/160 storage system enclosure.
nUltra160-to-Ultra160 SCSI RAID Controller.
nSupports up to 12 drives in JBOD mode.
nA standard AC power supply with an option for a redundant second power supply.
nOptional DC power supply with an option for a redundant second power supply.
nDesigned to fit standard 19-inch rack enclosures or a deskside tower.
nFront panel LEDs provide notifications of system component status, and logical
and physical drive status.
nSequential data transfers from disk arrays at over 320 MB per second sustained in
JBOD mode.
nOperating system independent – no special software or drivers required.
nUltra320/160 low-voltage differential single (LVDS) host ports.
nUp to thwo 320/160 MB/sec SCSI disk channels
nSupports clustering environments.
nAll SCSI channels are backward compatible Ultra2 LVD and
Ultra/Fast/Asynchronous single-ended SCSI modes.
nAll SCSI channels support SPI-3 Cyclic Redundancy Check (CRC) and Domain
Validation.
nSupport for just a bunch of disks (JBOD).
nFirmware can be upgraded either in-band over the SCSI bus or out-of-band via the
RS-232 service port.
n
nContinuous runtime diagnostics for warnings and automatic shutdown for
out-of-spec temperature and voltages, and internal errors.

1
Chapter 1
Getting Started
This chapter provides a description of the enclosure components and its onboard
monitoring systems.
The Components section identifies and gives a complete description of each major
component. The Monitoring section describes the enclosure’s LEDs, and the manner in
which the normal and abnormal conditions are presented.
OmniStor 4000S Series Storage System
Tower Model
Rack-Mount Model

Chapter 1 - Getting Started
At a Glance
2
At a Glance
The following illustrations show the featured components of the OmniStor 4000S Series
Storage System. Familiarize yourself with its components prior to installing and using the
storage system.
Enclosure Component Identification
CTRL 2
CTRL 1
JP7
ADDJUMPER
TODISABLE
TERMINATION
ADDJUMPER
TOSUPPL
Y
TERMPOWER
JP6
JP5
CNFG 1
CNFG 2
RAID
SPARE1
SPARE2
BAUD SEL
DLYSTRT
RMT STRT
JP8
ADDJUMPER
TODISABLE
TERMINATION
ADDJUMPER
TOSUPPL
Y
TERMPOWER
CHANNEL -1
CHANNEL -2
JP1
ADDJUMPER
TODISABLE
TERMINATION
ADDJUMPER
TOSUPPL
Y
TERMPOWER
JP3
JP2 JP4
Channel 3
JP1
ADDJUMPER
TODISABLE
TERMINATION
ADDJUMPER
TOSUPPL
Y
TERMPOWER
JP3
JP2 JP4
350-watt hot pluggable
independent power
supplies (AC shown)
Dual in-line
80-CFM hot
swappable
cooling fans
SAF-TE Disk I/O Card or
SCSI SAF-TE Cluster Card
Host SCSI I/O Cards
SAF-TE Service &
Controller Service Ports
Controller 2
Controller 1
Controller
Cover Plate
Optional Dual
SCSI-to-SCSI
RAID Controllers
Channel 1
CH 3
Channel 0
CH 0
Channel 2

Chapter 1 - Getting Started
Components 3
Components
This section provides a descriptive overview of each of the major components that
comprise the OmniStor 4000S Series Storage System.
Front Bezel
The front bezel houses the Status LEDs, Drive LEDs, and alarm reset button. When
removed, the user has access to the disk drives. The front bezel can be installed or removed
without interruption to system activities.
Embedded within the front bezel is the electronic package that provides the communication
with the SAF-TE processors (SEP). The SAF-TE processors control the signals to the front
panel through a smart interconnect. Refer to “Control and Monitoring” on page 15 for
details on the monitoring functions.
Power is applied to the front bezel through a smart interconnect edge connector, where a
control circuit monitors the bezel for a proper connection. When the bezel is properly
installed and power is applied to the enclosure, the bezel is immediately energized.
Removable Front Bezel
To remove the bezel and gain access to the disk drives, use a Phillips screwdriver to release
both bezel fasteners, then grasp and remove the bezel. The fasteners rotate one-quarter turn
clockwise to lock and counter-clockwise to unlock.

Chapter 1 - Getting Started
Power System
4
Power System
Standard AC Hot Swappable Power Supplies
The AC power system consists of two 350-watt hot-pluggable power supplies, each with
independent AC power cords and cooling fans. This power system provides the enclosure
with “N+1” redundant power. Each power supply has auto-switching circuitry for use with
either 100V or 240V AC systems.
Power Supply
Power is applied to the enclosure by pressing each of the two power supply On/Off
switches to their “On” position. A Power On LED located on each power supply will be
illuminated indicating that AC power has been applied. The front bezels’ Power On LED
will also be illuminated indicating that power has been applied.
Each power supply also incorporates an amber general Fault LED. If the power supply is
installed and power is not applied to the power supply or the power supply cooling fan fails,
the Fault LED will illuminate, along with an audible alarm.
The front bezels’ Power Supply Status LED will illuminate green when both power
supplies are on and operating normally. If only one power supply is operational, the Power
Supply Status LED will be illuminated amber.
Each power supply has an AC Power Cord Module. The module has a power cord bale
incorporated into the design to secure the power cord once it has been properly inserted.
The bale prevents inadvertent disconnects.
Fault LED
Power On LE
D
Blank Plate

Chapter 1 - Getting Started
Optional DC Hot Swappable Power Supplies 5
Optional DC Hot Swappable Power Supplies
The DC power system is designed to allow the storage system to be installed with Telco
system hardware isntallations. It consists of two 350-watt hot-pluggable power supplies, each
with independent DC power cables and cooling fans. It provides the enclosure with “N+1”
redundant power with Telco hardware. Each power supply cables directly with your DC
power feed system.
DC Power Supply
The DC power supply has the same user features to that of the AC Hot Swappable Power
Supplies described on the previous page.
NOTE: The DC system must be installed in a restricted access location, in accordance
with intent of the National Electrical Code. A restricted access location is defined
as an area intended only for qualified or trained personnel only. Access should be
controlled by key lock or access card.
Each power supply has a special cable connector that plugs into the face of the power
supply and mechanically connects to your DC feed system. Refer to the Installation chapter
for cabling procedures.
DC Source Site Requirements
Electrical Equipment Requirement
Voltage -36 to -72 VDC
Max. Operating Current 13.5 amp to 6.3 amps
Max. Input Surge Current 20.25 amps
P
ower On LED
(green)
Fault LED
(amber)
Release
Latch
Power Connector

Chapter 1 - Getting Started
6
The power feed must be electrically isolated from any AC power source, provide a reliable
connection to earth (battery room positive bus is connected to the grounding electrode),
and capable of providing up to 600 watts of continuous power per feed pair.
Overcurrent Protection Requirements
Overcurrent protection devices must be provided as part of each equipment rack. Circuit
breakers must be located between the DC power feed source and the power supplies (two
20 amp double-pole fast rip DC-rated circuit breakers for each power supply).
NOTE: Overcurrent protection devices must meet applicable national and local electrical
safety codes and be approved for the intended application.
Power supply overload protection will shut down the power supply when the output power
rating exceeds 110% to 130% of maximum rated output current.
DC Supply and Ground
You DC supply and ground conductor must meet the following requirements:
nSuitable condustor material: copper only.
nPower supply connections through the input connectors; 12AWG:
-48V
-48V Return
Ground to the power supply
nSystem ground conductor: 8 AWG.
nCable insulation rating: minimum of 75 C, low smoke fume (LSF), flame retardant.
nBranch circuit cable insulation color: per applicable national electrical codes.
nCable type: UL style 1028, UL 1581(VW-1), IEEE 383 compliant, or IEEE
1202-1991 compliant.
nGrounding insulation color: green/yellow.
Cooling Fan Module
The cooling system consists of two high-performance (80-CFM) cooling fans mounted in a
single fan module which slides into a bay at the rear of the enclosure. The design of the fan
module provides for an easy-to-install user-
replaceable component in a live environment without interruption of service.

Chapter 1 - Getting Started
Cooling Fan Module 7
If any one fan should fail, cooling redundancy and efficiency are degraded. The cooling fans
and enclosure temperature are constantly monitored by the SAF-TE processor for fault
conditions. In the event of a fault condition the front panel Fan Status LED will change from
a green state to a solid amber state in the case of a fan failure, or to a blinking amber green
state in the case of an over-temperature condition. In both cases an audible alarm sounds.
The SAF-TE processor will also provide notification data to monitoring software, such as
StorView.
WARNING: Do not operate the enclosure for extended periods of time (greater than 5
minutes) with the cooling fan module removed.
Cooling Fan Module
The enclosure has temperature sensors in two different areas, the drive bay, and the power
supplies. There are several processes the storage system takes to prevent component damage
due to over temperature conditions.
If the drive bay area reaches a temperature of 50°C (122°F) an audible alarm will sound, the
front panel Fan Status LED will toggle amber green, and the monitoring software will post a
warning message. These notifications give the user a warning that some condition is causing
the enclosure temperature to exceed the preset value, and an action is required by the user to
determine the cause and take corrective measures. It may be due to a blockage of air flow or a
low fan speed.
If any power supply reaches 85°C (185°F) the power supply will shut down.
Jumpers JP1 and JP2
Fan Speed Override Contro
l

Chapter 1 - Getting Started
SAF-TE Disk I/O Card
8
The SAF-TE Disk I/O card has a firmware-based VT-100 interface which provides an
option to manage fan speed. This option provides a whisper mode fan operation for noise
sensitive environments. When enabled (default), and based on a set of conditions, the
software will manage the cooling fans RPM speed to maintain the enclosure temperature
while minimizing noise levels. Refer to “Enclosure Fan Speed Control” on page 105 for more
details on using this option.
A manual override of the fan speed control is available for special circumstance
environments. Referring to the illustration on the preceding page, two jumpers are provided
on the fan module printed circuit board to override the software control of the fan speeds.
This hardware setting routes full power voltage to the fans for maximum operational speed,
which is greater than the maximum speed set by the automatic software control. This
configuration is normally used when fan speed noises are not an issue, and the ambient
operating temperature is at or above 30°C (86°F), thus ensuring that maximum available
cooling is being provided.
The jumpers JP1 and JP2 by default are offset, which enables the automatic fan speed
control. The jumper JP1 controls Fan 0 and JP2 controls Fan 1. Placing the jumper on both
pins for each jumper will override the automatic setting and configure the fans to
maximum power.
SAF-TE Disk I/O Card
WARNING: The SAF-TE Disk I/O card is NOT HOT SWAPPABLE. You must POWER
DOWN the enclosure prior to removing or installing this card.
The SAF-TE Disk I/O card provides the built-in environmental and system status
monitoring, as well as, host connectivity to the disk drives, It also houses the switches for
setting SCSI IDs, VT-100 communication protocols, and drive spin up options.
This card has two SAF-TE processors (SEPs) that continuously monitors the enclosure for
temperature status, fan status, power supply status, and SCSI channel status. The SEPs are
responsible for reporting environmentals and system status to the front bezel
LEDs/audible alarms and external monitoring software. The monitoring system is fully
compliant with SAF-TE specification protocol version 1.0.

Chapter 1 - Getting Started
SAF-TE Disk I/O Card 9
At power up, the SAF-TE processors read the SCSI switch settings and configures the
system for the appropriate addresses. It then executes instructions from firmware
performing a self-test diagnostics. The firmware is flash upgradeable using the SAF-TE
RS-232 Service port located below the I/O card slots at the rear of the enclosure. The
firmware also contains the necessary functions for enclosure management via a VT-100
interface.
NOTE: Specific switch settings are discussed later in the Installation chapter.
SAF-TE Disk I/O Card
The SAF-TE Disk I/O card has two 68-pin VHD/CI SCSI connectors which provides the
connectivity from the host computer(s) to the disk drives and drive connectivity to the
expansion JBOD enclosures. The connectors are labeled “Channel 1” and “Channel 2.”
In JBOD dual-bus mode, the Channel 1 connector provides SCSI bus access to drive
slots 1 through 6, and the Channel 2 connector provides access to the drives in slots 7
through 12.
In JBOD single-bus mode, the Channel 1 connector provides SCSI bus access to all
the drives, slots 1 through 12.
NOTE: Termination is automatic and provided internally on the drive mid-plane circuit
board. It is configured using two sets of jumpers on the card.
In daisy-chain configurations, you will be required to make changes to the jumper settings
in the enclosure’s SAF-TE Disk I/O card in that appears at the end of the daisy-chain. In
each supported configuration, a OmniStor 4000S (JBOD) enclosure will be the enclosure
at the end of the daisy chain. In some configurations multiple JBOD enclosures can appear
JP7
ADD JUMPER
TO DISABLE
TERMINATION
JP8
CNFG 1
CNFG 2
RAID
SPARE 1
SPARE 2
BAUD SEL
DLY STRT
RMT STRT
ADD JUMPER
TO DISABLE
TERMINATION
CHANNEL -1
CHANNEL -2
R
D
A
0
123 4 5678
A
1
S
0
S
1
B
D
D
L
R
M
UP
Channel 2
Termination Jumper
Channel 1
Termination Jumper
Channel 1 Channel 2
DOWN
Configuration1
Configuration2
RAID
Spa
re
1
Spa
re
2
BAUD Rate Select
Delay Drive Start
Re
m
ote
D
rive S
t
art

Chapter 1 - Getting Started
SCSI SAF-TE Cluster Card
10
at the end of the chain. Those enclosures will need to have their jumper settings, JP7 and
JP8, set to the jumpered position. During installation setup, instructions are provided to
correctly configure the daisy-chain enclosure settings.
These jumpers enable and disable the automatic termination. Add the jumper (installed on
both pins) for JP8 on Channel 1 and JP7 for Channel 2 which disables the automatic
termination feature. (The default position is the jumper is offset or unjumpered.)
SCSI SAF-TE Cluster Card
WARNING: The SCSI SAF-TE Cluster card is NOT HOT SWAPPABLE. You must
POWER DOWN the enclosure prior to removing or installing this card.
The SCSI SAF-TE Cluster card provides the host connectivity to the disk drives and the
built-in environmental and system status monitoring. The card incorporates dual Ultra320
SCSI bus expanders to couple and isolate bus segments without any impact to the protocol.
The card provides switches for setting the SCSI IDs, VT-100 communication protocols,
and drive spin up options. Two jumpers are provided to control the ability to enable or
disable the clustering bus isolation capabilities.
SCSI SAF-TE Cluster Card
The Ultra320 bus expanders re-time the SCSI signals as necessary to guarantee SCSI bus
signal timings. They provide precise delay control which maintains precise SCSI bus
timings.
JP7
ADDJUMPER
TODISABLE
TERMINATION
JP8
CNFG1
CNFG2
RAID
SPARE1
SPARE2
BAUDSEL
DL
YSTRT
RMTSTRT
ADDJUMPER
TODISABLE
TERMINATION
CHANNEL-1
CHANNEL-2
R
D
A
0
123 4 5678
A
1
S
0
S
1
B
D
D
L
R
M
UP
Channel 2
Termination Jumper
Channel 1
Termination Jumper
Channel 1 Channel 2
DOWN
Configuration1
Configuration2
RAID
Spa
re
1
Spa
re
2
BAUD Rate Select
Delay Drive Start
Re
m
ote
D
rive S
t
art