IBM RS/6000 SP User manual

RS/6000 SP
SP Switch Service Guide
GA22-7443-04
IBM

RS/6000 SP
SP Switch Service Guide
GA22-7443-04
IBM

Note!
Before using this information and the product it supports, read the information in “Safety and environmental notices” on
page ix and “Notices” on page A-1.
Fifth Edition (April 2002)
This book replaces GA22-7443-03.
IBM welcomes your comments. A form for readers’ comments may be provided at the back of this publication or you
may address your comments to the following address:
International Business Machines Corporation
Department 55JA, Mail Station P384
2455 South Road
Poughkeepsie, NY 12601-5400
United States of America
FAX (United States & Canada): 1+845+432-9405
FAX (Other Countries):
Your International Access Code+1+845+432-9405
IBMLink (United States customers only): IBMUSM10(MHVRCFS)
Internet e-mail: [email protected]
If you would like a reply, be sure to include your name, address, telephone number, or FAX number.
Make sure to include the following in your comment or note:
vTitle and order number of this book
vPage number or topic related to your comment
When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any
way it believes appropriate without incurring any obligation to you.
© Copyright International Business Machines Corporation 1999, 2002. All rights reserved.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Figures ....................................v
Tables ....................................vii
Safety and environmental notices ..........................ix
Safety notices ..................................ix
Danger notices.................................ix
Caution notices ................................xi
Laser safety information .............................xiii
Environmental notices...............................xiii
Product recycling and disposal ..........................xiii
About this book ................................xv
Who should use this book .............................xv
Related information ................................xv
How to send your comments ............................xvi
Summary of changes ..............................xvii
GA22-7443-04 .................................xvii
GA22-7443-03 .................................xvii
GA22-7443-02 .................................xvii
GA22-7443-01 .................................xvii
GA22-7443-00 .................................xvii
Chapter 1. Maintenance Analysis Procedures (MAPs)..................1-1
SP Switch MAPs ................................1-1
SP Switch description and problem determination (MAP 0590) ..............1-1
SP Switch environment (MAP 0600) ........................1-5
SP Switch power (MAP 0610) ..........................1-13
SP Switch function (MAP 0620) .........................1-17
Chapter 2. Locations ..............................2-1
Naming standard for RS/6000 SP components .....................2-1
Format structure ...............................2-1
Location diagrams of the RS/6000 SP components....................2-2
Front and rear views of RS/6000 SP frame......................2-3
Frame locations................................2-6
Switch assembly locations ............................2-8
Connector details ...............................2-9
Cable routing.................................2-9
Cable routing in a multi-switch frame (F/C 2030/1)...................2-11
Switch data cables ..............................2-13
Chapter 3. Service procedures ..........................3-1
Personal ESD requirements ............................3-1
Tools and files overview..............................3-1
Using the css.snap script .............................3-3
Switch supervisor self-test .............................3-4
Verification tests using Perspectives .........................3-4
Node supervisor verification ...........................3-4
Frame supervisor verification ...........................3-5
Switch supervisor verification ...........................3-5
Selecting appropriate switch clocks..........................3-6
© Copyright IBM Corp. 1999, 2002 iii

Selecting the switch clock source .........................3-6
Determining the correct switch clock source .....................3-6
Removing and restoring switch resources .......................3-7
Removing a switch assembly from the active configuration ................3-7
Restoring a switch assembly to the active configuration .................3-8
Viewing switch partitions ............................3-8
Service position procedures ............................3-9
Placing a switch assembly into service position ....................3-9
Replacing a switch assembly from service position ...................3-9
Resetting the clock and bootlist after servicing a node...................3-9
Installing firmware updates on SP nodes .......................3-10
Installing adapter microcode packages ........................3-10
Running diagnostics on a switch port ........................3-12
Chapter 4. FRU removals and replacements .....................4-1
Handling static-sensitive devices ..........................4-1
Procedures for switch assemblies ..........................4-2
Removing the switch assembly ..........................4-2
Replacing the switch assembly ..........................4-2
Removing the switch fans ............................4-3
Replacing the switch fans ............................4-3
Removing the switch front chassis cable.......................4-3
Replacing the switch front chassis cable.......................4-4
Removing the switch supervisor card ........................4-4
Replacing the switch supervisor card ........................4-5
Removing the switch inner chassis cable ......................4-5
Replacing the switch inner chassis cable ......................4-6
Removing the switch power cards .........................4-6
Replacing the switch power cards .........................4-7
Chapter 5. Parts catalog .............................5-1
SPS, SPS-8 Switch assembly (feature) (view 1) .....................5-2
SPS, SPS-8 Switch assembly (feature) (view 2) .....................5-4
SPS, SPS-8 Switch assembly (feature) (view 3) .....................5-6
Switch cables (feature) ..............................5-8
Multi-switch frame (F/C 2030/1) ..........................5-10
Notices ...................................A-1
Trademarks ..................................A-1
Electronic emissions notices ............................A-2
Federal Communications Commission (FCC) statement .................A-2
European Union (EU) statement..........................A-2
United Kingdom telecommunications safety requirements ................A-2
Industry Canada compliance statement .......................A-2
For installations in Japan: ............................A-3
Electromagnetic interference (EMI) statement - Taiwan .................A-3
Radio protection for Germany ..........................A-3
Index ....................................X-1
iv RS/6000 SP: SP Switch Service Guide

Figures
1-1. SP Switch high-level diagram.........................1-2
1-2. SP Switch wrap plugs ...........................1-4
1-3. SP Switch inner chassis and front chassis cables .................1-8
2-1. Front view of frame locations .........................2-3
2-2. Front view of multi-switch frame locations ....................2-4
2-3. Front view of 49-inch frame locations ......................2-5
2-4. Rear view of frame locations .........................2-6
2-5. SPS/SPS-8 assembly............................2-8
2-6. RS/6000 SP connector details (as seen at receiving ends, not at cable ends) .......2-9
2-7. Frame cabling routing path in rear of RS/6000 SP frame — 1.93 m frame ........2-10
2-8. Frame cabling routing path in rear of RS/6000 SP frame — 2.01 m frame ........2-10
2-9. Frame cable routing paths in rear of RS/6000 SP multi-switch frame (F/C 2030/1) — 1.93 m
frame .................................2-12
2-10. Frame cable routing paths in rear of RS/6000 SP multi-switch frame (F/C 2030/1) — 2.01 m
frame .................................2-12
4-1. Handling an anti-static device.........................4-1
4-2. Removing the SP Switch fans ........................4-3
4-3. Removing the SP Switch fan control cable ....................4-4
4-4. Removing the SP Switch supervisor card ....................4-5
4-5. Removing the SP Switch inner chassis cable ...................4-6
4-6. Removing the SP Switch power supply cards ...................4-7
© Copyright IBM Corp. 1999, 2002 v

vi RS/6000 SP: SP Switch Service Guide

Tables
1-1. Switch problem diagnostics .........................1-4
1-2. Environmental messages for switches .....................1-5
1-3. Switch connector resistance values ......................1-6
1-4. Fan failure diagnostics ...........................1-8
1-5. Inner chassis cable continuity ........................1-16
1-6. Front chassis cable continuity ........................1-16
1-7. SP Switch error conditions .........................1-19
1-8. Problem messages from the out.top file ....................1-22
1-9. Service Request Number (SRN) table for SP Switch adapters ............1-24
1-10. Switch problem priority listing ........................1-26
2-1. External cable routing ...........................2-11
2-2. SPS Switch data cable chart ........................2-13
2-3. SPS-8 Switch data cable chart ........................2-13
3-1. Service procedure tools ...........................3-2
3-2. Setup output files .............................3-2
3-3. Tuning output files .............................3-2
3-4. Setting switch clock sources .........................3-7
5-1. SPS, SPS-8 Switch assembly (feature) (view 1) ..................5-3
5-2. SPS, SPS-8 Switch assembly (feature) (view 2) ..................5-5
5-3. SPS, SPS-8 Switch assembly (feature) (view 3) ..................5-7
5-4. Switch cables (feature) ...........................5-8
5-5. Multi-switch frame (F/C 2030/1) .......................5-11
© Copyright IBM Corp. 1999, 2002 vii

viii RS/6000 SP: SP Switch Service Guide

Safety and environmental notices
For general information concerning safety, refer to Electrical Safety for IBM Customer Engineers ,
S229-8124. For a copy of the publication, contact your IBM account representative or the IBM branch
office serving your locality.
Safety notices
The following is a list of all safety notices (in English only) pertaining to SP hardware maintenance tasks
from this and other RS/6000 SP hardware publications. Translations of each of the safety notices into
other languages are included in
RS/6000 SP: Safety Information .
DANGER notices warn you of conditions or procedures that can result in death or severe personal
injury.
CAUTION notices warn you of conditions or procedures that can cause personal injury that is neither
lethal nor extremely hazardous.
Each notice contains a reference number (
SPSFXXXX ) which you can use to help find a specific notice in
other languages.
Danger notices
DANGER
Do not attempt to open the covers of the power supply. Power supplies are not serviceable and
are to be replaced as a unit. (
SPSFD001 )
DANGER
An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of
the system or the devices that attach to the system. It is the responsibility of the customer to
ensure that the outlet is correctly wired and grounded to prevent an electrical shock.
Before installing or removing signal cables, ensure that the power cables for the system unit
and all attached devices are unplugged.
When adding or removing any additional devices to or from the system, ensure that the power
cables for those devices are unplugged before the signal cables are connected. If possible,
disconnect all power cables from the existing system before you add a device.
Use one hand, when possible, to connect or disconnect signal cables to prevent a possible
shock from touching two surfaces with different electrical potentials.
During an electrical storm, do not connect cables for display stations, printers, telephones, or
station protectors for communications lines. (
SPSFD002 )
DANGER
In the U.S., Canada, and Japan, this product has a 4-wire power cable with a 4-prong plug. Use
this power cable with a correctly grounded power receptacle to prevent possible electric shock.
(
SPSFD003 )
© Copyright IBM Corp. 1999, 2002 ix

DANGER
Before you connect the power cable of this product to ac power, verify that the power receptacle
is correctly grounded and has the correct voltage. (
SPSFD004 )
DANGER
During an electrical storm, do not connect or disconnect any cable that has a conductive outer
surface or a conductive connector. (
SPSFD005 )
DANGER
Switch off power and unplug the machine power cable from the power receptacle, before
removing or installing any part that is connected to primary power. (
SPSFD006 )
DANGER
To prevent possible electrical shock during machine installation, relocation, or reconfiguration,
connect the primary power cable only after connecting all electrical signal cables. (
SPSFD007 )
DANGER
High voltage present. Perform ″Lockout safety procedures″to remove primary power to the
frame. (
SPSFD008 )
DANGER
High voltage present. Perform ″Lockout safety procedures″to remove primary power to the
frame (and high-voltage transformer if present). (
SPSFD009 )
DANGER
High voltage present at test points. Use high voltage test probes. (
SPSFD010 )
DANGER
High energy present. Do not short 48V to frame or 48VRtn. Shorting will result in system outage
and possible physical injury. (
SPSFD011 )
DANGER
If a unique power module fails, all LEDs will be off. The high voltage LED will be off even though
the high voltage is still present. (
SPSFD012 )
xRS/6000 SP: SP Switch Service Guide

DANGER
The remaining steps of the procedure contain measurements that are taken with power on.
Remember that hazardous voltages are present. (
SPSFD013 )
DANGER
The frame main circuit breaker and the controller must not be switched on again now.
Before disconnecting the power cables from the power receptacles, ensure that the customer’s
branch distribution circuit breakers (customer power source circuit breakers) are Off and tagged
with DO NOT OPERATE tags, S229-0237. Refer to “Lockout safety procedures” in
RS/6000 SP:
System Service Guide
, before proceeding. ( SPSFD014 )
DANGER
Before connecting ac power cabless to electrical outlets, ensure that:
vThe customer’s branch distribution circuit breakers (customer power source circuit breakers)
are off and tagged with DO NOT OPERATE tags, S229-0237 (or national language equivalent).
vThe activities in ″Performing the Customer 50/60 Hz Power Receptacle Safety Check″have
been performed on all customer power source outlets and cable connectors. (
SPSFD015 )
DANGER
Ensure that the customer’s branch distribution circuit breakers (customer power source circuit
breakers) to the ac power outlets are off and tagged with DO NOT OPERATE tags, S229-0237 (or
national language equivalent). (
SPSFD016 )
DANGER
Both the SEPBU power chassis and the PDU 48 V dc power chassis are field replaceable units
(FRUs) which contain NO serviceable parts; they are labeled as such. Do not attempt to isolate
or repair these components, since doing so may result in severe injury or even death.
(
SPSFD017 )
Caution notices
CAUTION:
The weight of the PDU assembly, 48 V dc power chassis, and the SEPBU power chassis is greater
than 18 Kg (40 lbs). Be careful when removing or installing. Remove all 48 V dc power supplies
from the power chassis before removing or installing the power chassis. (
SPSFC001 )
CAUTION:
The unit weight exceeds 18 Kg (40 lbs) and requires two service personnel to lift. (
SPSFC002 )
Safety and environmental notices xi

CAUTION:
The covers are to be closed at all times except for service by trained service personnel.
(
SPSFC003 )
CAUTION:
When the unit is being serviced, the covers should not be left off or opened while the machine is
running unattended. ( SPSFC004 )
CAUTION:
Due to weight of each thin node (under 18 Kg [40 lbs]), use care when removing and replacing thin
nodes above shoulder height. ( SPSFC005 )
CAUTION:
The wide node weight may exceed 32 Kg (70.5 lbs). (
SPSFC006 )
CAUTION:
Do not open more than one wide node or switch assembly drawer at a time. (
SPSFC007 )
CAUTION:
Make sure the stability foot and wheel chocks are installed on the frame. These are required to
maintain frame balance and position during service operations. ( SPSFC008 )
CAUTION:
Outer edges of chassis may be sharp. Care must be taken when removing and installing chassis.
(
SPSFC009 )
CAUTION:
The ground strip may have sharp edges. (
SPSFC010 )
CAUTION:
Do not remove wide nodes or switch assemblies from the mounting slides. Caution must be
observed when working with mounting slides to prevent pinched fingers or accidental release of
the unit. (
SPSFC011 )
CAUTION:
Do not remove the drawer case mounting screws at the bottom of both sides. (
SPSFC012 )
CAUTION:
Once the latch is released, push the drawer closed. Do not pull, as the drawer may disengage from
the rails, creating a safety hazard. ( SPSFC013 )
CAUTION:
Due to the weight of each wide node, use care when sliding and closing wide processor nodes
above shoulder height. (
SPSFC014 )
xii RS/6000 SP: SP Switch Service Guide

CAUTION:
vWhen moving frames into position, team members should work together. Using one person on
each corner of the frame can prevent strain.
vIn raised floor installations, mechanically safe moldings should be installed around floor
cutouts. Extreme caution should be used when moving frames during installation or removal
because of the proximity of floor cutouts to casters. (
SPSFC015 )
CAUTION:
When using step ladder or step stool, be sure that the work surface is level and the step ladder or
step stool is in good working order. ( SPSFC016 )
CAUTION:
Portable ladders present a serious safety hazard if not used properly. Follow these general
guidelines:
vMake sure the ladder is firm and steady, and has no defective rungs or braces.
vWork only on a level surface.
vNever use a metal ladder near electrical power lines.
vNever overreach. Instead, move the ladder.
Be as careful on a short ladder as on a 30-foot extension ladder. False security can lead to
carelessness and falls which can cause painful injuries. (
SPSFC017 )
CAUTION:
All IBM laser modules are designed so that there is never any human access to laser radiation
above a class 1 level during normal operation, user maintenance, or prescribed service conditions.
Data processing environments can contain equipment transmitting on system links with laser
modules that operate at greater than class 1 power levels. For this reason, never look into the end
of an optical fiber cable or open receptacle. Only trained service personnel should perform the
inspection or repair of optical fiber cable assemblies and receptacles. (
SPSFC018 )
Laser safety information
The RS/6000 SP might contain certain communication adaptors, such as ESCON or FDDI, which are fiber
optic based and use lasers.
Laser Compliance
All lasers are certified in the U.S. to conform to the requirements of DHHS 21 CFR Subchapter J for class
1 laser products. Outside the U.S., they are certified to be in compliance with the IEC 825 (first edition
1984) as a class 1 laser product. Consult the label on each part for laser certification numbers and
approval information.
Environmental notices
Product recycling and disposal
This product contains materials such as circuit boards, cables, electromagnetic compatibility gaskets, and
connectors which might contain lead and copper/beryllium alloys that require special handling and disposal
at end of life. Before this unit is disposed of, these materials must be removed and recycled or discarded
according to applicable regulations. IBM offers product return programs in several countries. You can find
country-specific instructions at www.ibm.com/ibm/environment/products/prp.phtml.
Safety and environmental notices xiii

This product might contain nickel-cadmium or lithium batteries in communication adapters. The batteries
must be recycled or disposed of properly. Recycling facilities might not be available in your area. In the
United States, IBM has established a collection process for reuse, recycling, or proper disposal of used
sealed lead-acid, nickel-cadmium and nickel metal hydride batteries and battery packs from IBM
equipment. For information on proper disposal of batteries in this product, please contact IBM at
1-800-426-4333. For information on disposal of batteries outside the United States, contact your local
waste disposal or recycling facility.
xiv RS/6000 SP: SP Switch Service Guide

About this book
This book is part of the RS/6000
®
SP
™
hardware service library and applies to the RS/6000 SP Switch.
Use this book to assist you in performing the following tasks:
vIdentify field replaceable unit (FRU) locations
vIsolate RS/6000 SP failures using Maintenance Analysis Procedures (MAPs)
vPerform diagnostic service procedures
vPerform removal and replacement procedures
vIdentify FRUs and their corresponding part numbers
If you are attempting to isolate an SP system failure, use the Maintenance Analysis Procedures (MAPs)
beginning with the Start MAP in
RS/6000 SP: System Service Guide (GA22-7442). For a listing of the
complete RS/6000 SP hardware service library, see “Related information”.
Who should use this book
This book is intended for RS/6000 SP product-trained service personnel.
Related information
The following books make up the complete RS/6000 SP hardware service library:
v RS/6000 SP: Safety Information , GA22-7467. Safety notices, in English and translated into other
national languages, which are compiled from all the book in the library.
v
RS/6000 SP: Installation and Relocation , GA22-7441. Installation and relocation procedures,
maintenance agreement and qualification procedures, frame and component identification information.
v
RS/6000 SP: System Service Guide , GA22-7442. General SP system service procedures, the system
Start MAP, and MAPs and parts catalog for the frames and power subsystems. Use this book to begin a
diagnostic procedure to isolate a problem to a specific major component of the SP system.
v
RS/6000 SP: SP Switch Service Guide , GA22-7443 (this book).
v RS/6000 SP: SP Switch2 Service Guide , GA22-7444. Service procedures, MAPs, and parts catalog
information specific to the SP Switch2.
v
RS/6000 SP: Uniprocessor Thin and Wide Node Service Guide , GA22-7445. Service procedures,
MAPs, and parts catalog information specific to all uniprocessor-type nodes.
v
RS/6000 SP: 604 and 604e SMP High Node Service Guide , GA22-7446. Service procedures, MAPs,
and parts catalog information specific to these nodes.
v
RS/6000 SP: SMP Thin and Wide Node Service Guide , GA22-7447. Service procedures, MAPs, and
parts catalog information specific to these nodes.
v
RS/6000 SP: POWER3 SMP High Node Service Guide , GA22-7448. Service procedures, MAPs, and
parts catalog information specific to this node.
This book and other RS/6000 SP hardware and software documentation are available both on-line and, for
some books, in printed form from the following sources:
vThe Web site at http://www.ibm.com/servers/eserver/pseries/library/sp_books/index.html
vThe Resource Center on the PSSP product media
vPrinted and CD-ROM versions (which can be ordered from IBM)
For more information on these sources and an extensive listing of RS/6000 SP related publications, see
the bibliography in
RS/6000 SP: Installation and Relocation .
© Copyright IBM Corp. 1999, 2002 xv

How to send your comments
Your feedback is important in helping to provide the most accurate and highest quality information. If you
have any comments about this book or any other RS/6000 SP documentation:
vSend your comments by e-mail to [email protected]. Be sure to include the name of the book, the
order number of the book, and, if applicable, the specific location of the text you are commenting on (for
example, a page number or table number).
vFill out one of the forms at the back of this book and return it by mail, by fax, or by giving it to an IBM
®
representative.
xvi RS/6000 SP: SP Switch Service Guide

Summary of changes
GA22-7443-04
This edition contains replaces GA22-7443-03 and any update versions made to that level and makes them
obsolete. This edition contains minor changes and fixes to softcopy cross-book links.
GA22-7443-03
This edition contains replaces GA22-7443-02 and any update versions made to that level and makes them
obsolete. This edition contains minor changes and fixes to softcopy cross-book links.
GA22-7443-02
This edition contains replaces GA22-7443-01 and any update versions made to that level and makes them
obsolete. This edition contains minor changes and corrections throughout the book.
GA22-7443-01
This edition replaces GA22-7443-00 and makes it obsolete.
Added cross-book links for reference links between this publication and the other RS/6000 SP hardware
publications. These links assist navigating between documents, in the softcopy environment, when using
the Adobe Acrobat Reader.
GA22-7443-00
First edition of the restructured RS/6000 SP hardware service library. This publication, along with the other
SP service publications (see “Related information” on page xv), replaces The Maintenance Information
Manuals Volumes 1–4 (GA22-7375, GA22-7376, GA22-7377, and GA22-7378) and makes them obsolete.
© Copyright IBM Corp. 1999, 2002 xvii

xviii RS/6000 SP: SP Switch Service Guide