IBM Netfinity Series Owner's manual

This Manual Supports:
Fibre Channel HUB Type 3523
Fibre Channel Long-Wave GBIC
Fibre Channel PCI Adapter (FRU 01K7354)
Fibre Channel RAID Controller Type 3526
Fibre Channel Short-Wave GBIC
S10L-9845-00
IBM Netfinity Fibre Channel
Hardware Maintenance Manual
September 1998
Use this manual with the
IBM Servers
Hardware Maintenance Manuals
We Want Your Comments!
(Please see page 72)

S10L-9845-00
IBM Netfinity Fibre Channel
Hardware Maintenance Manual
September 1998
Use this manual with the
IBM Servers
Hardware Maintenance Manuals
We Want Your Comments!
(Please see page 72)
IBM

Note
Before using this information and the product it
supports, be sure to read the general information
under “Notices” on page 71.
First Edition (September 1998)
The following paragraph does not apply to the United
Kingdom or any country where such provisions are
inconsistent with local law: INTERNATIONAL
BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY
KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE. Some states do not allow disclaimer of
express or implied warranties in certain transactions,
therefore, this statement may not apply to you.
This publication could include technical inaccuracies or
typographical errors. Changes are periodically made to
the information herein; these changes will be incorporated
in new editions of the publication. IBM may make
improvements and/or changes in the product(s) and/or the
program(s) described in this publication at any time.
This publication was developed for products and services
offered in the United States of America. IBM may not offer
the products, services, or features discussed in this
document in other countries, and the information is subject
to change without notice. Consult your local IBM
representative for information on the products, services,
and features available in your area.
Requests for technical information about IBM products
should be made to your IBM reseller or IBM marketing
representative.
 Copyright International Business Machines
Corporation 1998. All rights reserved.
Note to U.S. Government users–Documentation related to
Restricted rights–Use, duplication, or disclosure is subject
to restrictions set forth in GSA ADP Schedule Contract
with IBM Corp.
ii IBM Netfinity Fibre Channel HMM

About This Manual
This manual contains diagnostic and service information
for the IBM Netfinity Fibre Channel products listed below:
Fibre Channel HUB (Type 3523)
– Fibre Channel Long-Wave GBIC
– Fibre Channel Short-Wave GBIC
Fibre Channel PCI Adapter
Fibre Channel RAID Controller (Type 3526)
This manual should be used with the Hardware
Maintenance Manual for the system you are servicing.
Important
This manual is intended for trained servicers who are
familiar with IBM PC Server and IBM Netfinity Server
products.
Important Safety Information
Be sure to read all caution and danger statements in this
book before performing any of the instructions.
Leia todas as instruções de cuidado e perigo antes de
executar qualquer operação.
iii

Prenez connaissance de toutes les consignes de type
Attention et
Danger avant de procéder aux opérations décrites par les
instructions.
Lesen Sie alle Sicherheitshinweise, bevor Sie eine
Anweisung ausführen.
Accertarsi di leggere tutti gli avvisi di attenzione e di
pericolo prima di effettuare qualsiasi operazione.
Lea atentamente todas las declaraciones de precaución y
peligro ante
de llevar a cabo cualquier operación.
Online Support
Use the IBM Personal computing solutions (BBS) or the
World Wide Web (WWW) to download Diagnostic, BIOS
Flash, and Device Driver files.
File download address is:
http://www.pc.ibm.com/us/files.html
The IBM BBS can be reached at [phone].
IBM Online Addresses:
The HMM manuals online address is:
http://www.pc.ibm.com/us/cdt/hmm.html
The IBM Support Page is:
http:///www.pc.ibm.com/support/
The IBM Personal computing solutions page is:
http://www.pc.ibm.com
iv IBM Netfinity Fibre Channel HMM

Related Publications
The following publications are available for IBM products.
For more information, contact IBM or an IBM Authorized
Dealer.
For Information About See Publication
PC Servers IBM PC Servers Hardware
Maintenance Manual
(S30H-2501)
PS/2 Computers IBM Personal System/2
Hardware Maintenance
Manual (S52G-9971)
PS/ValuePoint Computers IBM PS/ValuePoint
Hardware Maintenance
Service and Reference
(S61G-1423)
Laptop, Notebook, Portable,
and ThinkPad Computers
(L40, CL57, N45, N51,
P70/P75, ThinkPad 300,
350, 500, 510, 710T,
Expansion Unit, Dock I,
Dock II)
IBM Mobile Systems
Hardware Maintenance
Manual Volume 1
(S82G-1501)
ThinkPad Computers
(ThinkPad 340, 355, 360,
370, 700, 701, 720, 750,
755)
IBM Mobile Systems
Hardware Maintenance
Manual Volume 2
(S82G-1502)
ThinkPad Computers
(ThinkPad 365, 760) IBM Mobile Systems Hardware Maintenance
Manual Volume 3
(S82G-1503)
Monitors (Displays)
(February 1993) IBM PS/2 Display HMM Volume 1 (SA38-0053)
Monitors
(December 1993) IBM Color Monitor HMM Volume 2 (S71G-4197)
IBM Monitors (P Series)
(February 1996) IBM Monitor HMM Volume 3 (S52H-3679)
IBM 2248 Monitor
(February 1996) IBM Monitor HMM Volume 4 (S52H-3739)
Disk Array technology
overview and using the IBM
RAID Configuration Program
Configuring Your Disk Array
booklet (S82G-1506)
Installation Planning for
Personal System/2
computers
Personal System/2
Installation Planning and
Beyond (G41G-2927)
Installation Planning for
Advanced Personal
System/2 Servers
Advanced PS/2 Servers
Planning and Selection
Guide (GG24-3927)
v

vi IBM Netfinity Fibre Channel HMM

Contents
About This Manual ................ iii
Important Safety Information ............ iii
Online Support . . . . . . . . . . . . . . . . iv
Related Publications . . . . . . . . . . . . . . . v
IBM Netfinity Fibre Channel ........... 1
Diagnostics and Test Information ......... 1
Type 3523 Fibre Channel Hub and GBIC ..... 3
General Checkout . . . . . . . . . . . . . . . . . 3
Features . . . . . . . . . . . . . . . . . . . . . 6
Additional Service Information ........... 9
Locations . . . . . . . . . . . . . . . . . . . . . 12
Symptom-to-FRU Index . . . . . . . . . . . . . . 16
Parts Listing (Type 3523 Fibre Channel Hub & GBIC) 18
Fibre Channel Adapter (FRU 01K7354) ...... 21
General Checkout . . . . . . . . . . . . . . . . . 21
Features . . . . . . . . . . . . . . . . . . . . . 21
Additional Service Information ........... 23
Locations . . . . . . . . . . . . . . . . . . . . . 28
Type 3526 Fibre Channel RAID Controller .... 31
General Checkout . . . . . . . . . . . . . . . . . 31
Features . . . . . . . . . . . . . . . . . . . . . 32
Additional Service information ........... 33
Locations . . . . . . . . . . . . . . . . . . . . . 37
Symptom-to-FRU Index . . . . . . . . . . . . . . 47
Parts Listing (Type 3526 Fiber Channel RAID
Controller) . . . . . . . . . . . . . . . . . . . 49
Related Service Information ........... 51
Safety Information . . . . . . . . . . . . . . . . 51
Laser Compliance Statement ........... 51
Declaração de Conformidade do Laser ....... 52
Conformités aux normes relatives aux appareils à laser 53
Hinweise zur Lasersicherheit ........... 54
Informazioni relative al laser ............ 55
Declaración de conformidad de láser ........ 56
Problem Determination Tips ............ 68
Phone Numbers, U.S. and Canada ......... 69
Notices . . . . . . . . . . . . . . . . . . . . . . 71
Send Us Your Comments! ............. 72
Trademarks . . . . . . . . . . . . . . . . . . . 73
 Copyright IBM Corp. 1998 vii

viii IBM Netfinity Fibre Channel HMM

IBM Netfinity Fibre Channel
Diagnostics and Test Information
Important
These service procedures are designed to help you
isolate problems. They are written with the
assumption that you have model-specific training on
all computers, or that you are familiar with the
computers, functions, terminology, and service-related
information provided in this manual and the
appropriate IBM Netfinity Server Hardware
Maintenance Manual.
Start with the General Checkout in this HMM to assist you
in diagnosing the IBM Netfinity Fibre Channel products
listed within this manual.
For Error Codes/Error Messages, refer to the
Symptom-to-FRU Index of the server that the Fibre
Channel Hub, Adapter, or RAID Controller is connected to.
 Copyright IBM Corp. 1998 1

2IBM Netfinity Fibre Channel HMM

Type 3523 Fibre Channel Hub and
GBIC
General Checkout
Installation and operational problems in an arbitrated loop
environment are typically caused by one of the following:
Faulty cabling or cable connector
Incorrect cable length
Faulty GBIC
Invalid Fibre Channel signaling from the host bus
adapter (HBA) or disk array
Device driver or microcode conflicts between the
HBAs and other devices.
The following information will help you to isolate and
correct the physical layer problems. For protocol-related
problems, such as inoperability between devices, see the
documentation that came with the individual devices.
Port Status LEDs
The hub provides two status LEDs for each port. Use
these LEDs to help you quickly diagnose and recover from
problems.
The upper, green LED is lit when an operational GBIC is
installed. The lower, amber LED is lit when the port is in
the bypass mode. In the bypass mode, a port is disabled,
which prevents erratic signals or data from disrupting loop
activity. The bypass mode could be triggered by the loss
of valid signal or by a GBIC fault. The combination of
green and amber LEDs indicate the four following states.
Green LED Amber LED Port State
Off Off No GBIC Installed
On Off Operational GBIC;
Valid Signal
Off On Faulty GBIC; Port
Bypassed
On On Operational GBIC;
No Valid Signal;
Port Bypassed
 Copyright IBM Corp. 1998 3

Verifying GBIC and Cable Signal
Presence
Note
Do Not look directly into any fiber cable or GBIC
optical output. Read “Safety Information” on page 51.
To view an optical signal, use a mirror to view the
reflected light.
Verifying Signal Presence: In addition to
verifying port LED status, you can verify signal presence
by using a mirror to look for a reflected light at the
fiber-optic cable ends and the GBIC transmitter. To verify
signal presence at the hub end of a link, insert a GBIC into
the hub and place a mirror at the bottom of the SC
connector. If a signal is present, you will see a low
intensity red light in the mirror reflecting from the GBIC
transmitter.
Verifying Node End: To verify the integrity of the
fiber optic cable at the node end of a link, make sure the
cable is attached to the GBIC at the hub and the hub is
turned on. Dual SC fiber-optic cable connectors are keyed
and will insert into a GBIC in one direction only. Place a
mirror at the node end of the link. A low intensity red light
is visible in the mirror reflection of one of the SC leads, as
shown in the following illustration.
Connector
Keys
If a fiber-optic cable has good transmitter output but a
broken or degraded receiver lead, the end node might
sense a
loop down state. Because the transmitter is good,
the hub responds to the end node valid Fibre Channel
signal and adds the device to the loop. But, because the
end node is not receiving Fibre Channel signals, it will
stream loop-down sequences onto the loop. This prevents
all data communications among the devices on the loop
and will continue to do so until the condition is corrected.
4IBM Netfinity Fibre Channel HMM

Verifying Hub End: To verify the integrity of the
fiber-optic cable at the hub end, make sure the fiber-optic
cable is plugged into the host bus adapter at the host or
into a disk-array controller and that the device is enabled
on the loop. Using a mirror, examine the cable SC leads
to verify that a low-intensity red light is visible on the
receiver lead.
Note
Some fiber optic cables are marked with an "A" on the
receiver lead and a "B" on the transmitter lead and are
keyed. Some multimode cables plugged into a GBIC,
HBA, or disk array controller are key-oriented with the
"B" lead inserted into the device transmitter. Place a
mirror on the opposite end of the cable to see the
low-intensity red light on the "A" receiver lead.
Type 3523 Fibre Channel Hub and GBIC 5

Features
The Fibre Channel Hub is designed with seven modular
user configurable interface ports. These seven ports
comply with the GigaBit Interface Converter (GBIC)
Specification. GBICs are available in two media types:
Long-Wave optical
Short-Wave optical
This section covers both the Fibre Channel Hub and the
GBICs.
The following list summarizes the features of the Fibre
Channel Hub:
Seven configurable media-interface optical ports
providing high performance.
Plug and Play provides fault tolerance for online
system configuration changes.
Modular Gigabit Interface Converter (GBIC)
transceiver design allows you to use ports when
needed.
Cascadable ports allows up to 127 connections
(where one port is reserved for connection to fabric or
switch active ports) or support of multiple loop
implementations.
Simplified cable management can be used for
centralized storage management applications.
Hot pluggable GBIC provides an optimal solution for
entry storage interconnect needs.
Half-rack width (1U = 1.75 in.) low profile hub
packaging offers highest port density in single 1 unit
height rack mount.
 Auto-sensing power-supply - supports 95 to 250 V ac
and 50 to 60 Hz.
Description
The IBM Fibre Channel Hub is a 7-port central
interconnection for Fibre Channel Arbitrated Loops that
follow the ANSI FC-AL standard. Each Fibre Channel Hub
port receives serial data from an attached node and
retransmits the data out of the next hub port to the next
node attached in the loop. Each reception includes data
regeneration (both signal timing and amplitude) supporting
full-distance optical links.
The Fibre Channel Hub detects any loop node that is
missing or is inoperative and automatically routes the data
to the next operational port and attached node in the loop.
LED indicators provide status information to indicate
whether the port is active or bypassed.
Each port requires a Gigabit Interface Converter (GBIC) to
connect it to each attached node. The Fibre Channel Hub
supports any combination of short-wave or long-wave
optical GBICs. The GBICs are
hot-pluggable into the Fibre
6IBM Netfinity Fibre Channel HMM

Channel Hub, which means you can add host computers,
servers, and storage modules to the arbitrated loop
dynamically without powering off the Fibre Channel Hub or
any connected devices. If you remove a GBIC from a
Fibre Channel Hub port, that port is automatically
bypassed. The remaining hub ports continue to operate
normally with no degradation of system performance.
Conversely, if you plug a GBIC into the Fibre Channel
Hub, it will automatically be inserted and become a node
on the loop if valid Fibre Channel data is received from the
device.
Data transfer within the Fibre Channel Hub is implemented
in serial differential Positive Emitter Coupled Logic (PECL)
AC coupled logic. Each Fibre Channel Hub port monitors
the serial data input stream as well as the GBIC connected
to it.
The following conditions will cause the Fibre Channel Hub
to bypass a port:
TX_FAULT: Detects a GBIC transmitter fault.
RX_LOS: Detects a loss of received signal amplitude
from the device.
MOD_DEF: Detects the absence of a GBIC.
The Fibre Channel Hub circuitry detects off-frequency data,
excessive jitter, or inadequate edge transition density on a
per-port basis. The Fibre Channel Hub uses the
standardized AMP SCA2 20-pin connector to implement
hot plugging. Surge currents, caused by hot plugging, are
minimized by slow-start circuitry and a pin-sequencing
procedure on the GBIC. Electrostatic discharge (ESD)
transients are minimized by means of sequenced
connector contacts.
The Fibre Channel Hub includes a universal power supply
that can operate from 95 to 250 V ac and from 50 to 60
Hz.
Fibre Channel Long-Wave GBIC
Features of the long-wave optical GBIC include:
Full-speed: 1.0625 Gbps
Uses single-mode 9 µm fiber
Wavelength: 1310 nm
Non-OFC laser
Uses dual SC fiber optic connectors
Fiber lengths: 2 meters minimum, 10 kilometers
maximum
Fibre Channel Short-Wave GBIC
Features of the short-wave optical GBIC include:
Compliant with Fibre Channel FC-PH-2 physical layer
option 100-M5-SN-I
Full-speed: 1.0625 Gbps
Type 3523 Fibre Channel Hub and GBIC 7

Wavelength: 780 nm
Non-OFC laser
Supports multimode 50 µm fiber (2 meters/minimum,
500 meters/maximum)
Uses dual SC fiber optic connectors
Fibre Channel-Arbitrated Loop
The Fibre Channel-Arbitrated Loop (FC-AL) is an ANSI
standard (X3T11) product designed to provide shared
bandwidth over low-cost media. Early adapters primarily
use the SCSI protocol transported over Fibre Channel for
distributed server and storage-cluster applications. The
Fibre Channel Hub is a central point of interconnection
designed to maintain a fault-tolerant physical loop
topology. The Fibre Channel Hub can also be used to
implement configurations which extend the size of the
FC-AL loop to its maximum size of 127 active loop ports
(includes one optional Fabric-Loop port).
8IBM Netfinity Fibre Channel HMM

Additional Service Information
Applications and Configurations
The Fibre Channel Hub modular interface provides
flexibility and is upgradable to available short-wave and
long-wave optical Fibre Channel product port interfaces.
Fibre Channel products that are commonly interconnected
to the Fibre Channel Hub are Fibre Channel host bus
adapters, FC-AL storage devices, and FC-AL storage
arrays. SCSI initiators (workstations and servers) set up
and initiate the transfer of data to or from the storage
devices. The storage devices that receive the requests
made by the SCSI initiators are the SCSI targets. Initiators
and targets represent individual nodes that are linked by
the shared FC-AL.
Power On Systems Check - Fibre
Channel Hub
Power-on the storage modules first, then the controller and
the Fibre Channel Hub, then everything else.
Note
Make sure the Fibre Channel Hub is powered on
before the host adapter to insure proper loop
initialization.
To insure proper operation:
1. Connect the power cord to the Fibre Channel Hub,
then to the electrical outlet.
Power Connector
2. Power-on the attached FC-AL compatible nodes.
Type 3523 Fibre Channel Hub and GBIC 9

3. Check the Device Active (green) LEDs on the Fibre
Channel Hub ports.
Active On
Green LEDs on Top Row
LED On This indicates that a GBIC is present
and functioning properly.
LED Off This indicates a fault condition.
Examples of a fault condition include: a
GBIC transmitter fault, an improperly
seated GBIC, an absent GBIC, or
another failed device. The port will be
in the bypass state, which precludes the
port from participating in the FC-AL.
This is the normal status of operation
for Fibre Channel Hub ports in which
GBICs are not installed.
Note
FC-AL compatible nodes must perform loop
initialization procedures at power-on to function
properly on the loop. The Fibre Channel driver
software on FC-AL nodes performs the loop
initialization or re-initialization depending on its
prior state of operation.
4. Check the Port Bypass (amber) LEDs.
Bypass
Amber LEDs on Bottom Row
LED On If the Active (green) LED of the port is
off, the port is nonoperational and the
Bypass (amber) LED for the port is on.
If a properly functioning port (the Active
green LED is on) with a GBIC present
also has the Bypass LED on, either the
loss of signal or poor signal integrity
has caused the port to go into the
bypass state. When the port is in this
state, it cannot participate in the FC-AL.
The bypass state is also the normal
status condition when no GBIC is
present in the port, a GBIC is present
but not attached to a FC-AL node, or a
GBIC is attached to a cable assembly
with nothing attached at the opposite
end. Replacing such a port (or
removing and reinserting the GBIC into
the same port twice) is considered to be
a loop configuration change which
invokes the Loop Initialization
Procedure.
10 IBM Netfinity Fibre Channel HMM