IBM 86604RU - Netfinity 5500 - 4RU Owner's manual

This Manual Supports
The Following Models:
11U,
41U,
4RU,
51U,
5RU,
61U,
6RU,
71U,
11X,
41X,
4RX,
51X,
5RX,
61X,
6RX,
72U,
1RX,
42X,
4SX,
52X,
5SX,
62X,
6SX,
7SU
1RU,
42U,
4SU,
52U,
5SU,
62U,
6SU,
7RU,
S10L-9800-03
IBM Netfinity Servers
IBM Netfinity 5500 - Type 8660
Hardware Maintenance Manual
June 1999
We Want Your Comments!
(Please see page 389)

S10L-9800-03
IBM Netfinity Servers
IBM Netfinity 5500 - Type 8660
Hardware Maintenance Manual
June 1999
We Want Your Comments!
(Please see page 389)
IBM

Note
Before using this information and the product it
supports, be sure to read the general information
under “Notices” in the manual.
Fourth Edition (June 1999)
The following paragraph does not apply to the United
Kingdom or any country where such provisions are
inconsistent with local law: INTERNATIONAL
BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY
KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE. Some states do not allow disclaimer of
express or implied warranties in certain transactions,
therefore, this statement may not apply to you.
This publication could include technical inaccuracies or
typographical errors. Changes are periodically made to
the information herein; these changes will be incorporated
in new editions of the publication. IBM may make
improvements and/or changes in the product(s) and/or the
program(s) described in this publication at any time.
This publication was developed for products and services
offered in the United States of America. IBM may not offer
the products, services, or features discussed in this
document in other countries, and the information is subject
to change without notice. Consult your local IBM
representative for information on the products, services,
and features available in your area.
Requests for technical information about IBM products
should be made to your IBM reseller or IBM marketing
representative.
 Copyright International Business Machines
Corporation 1999. All rights reserved.
Note to U.S. Government users–Documentation related to
Restricted rights–Use, duplication, or disclosure is subject
to restrictions set forth in GSA ADP Schedule Contract
with IBM Corp.
ii Netfinity Server HMM

About this supplement
This supplement contains diagnostic information,
Symptom-to-FRU Indexes, service information, error
codes, error messages, and configuration information for
the Netfinity 5500 - Type 8660.
Important
This manual is intended for trained servicers who are
familiar with IBM PC Server products.
Important safety information
Leia todas as instruções de cuidado e perigo antes de
executar qualquer operação.
Be sure to read all caution and danger statements in this
book before performing any of the instructions.
Prenez connaissance de toutes les consignes de type
Attention et
Danger avant de procéder aux opérations décrites par les
instructions.
Lesen Sie alle Sicherheitshinweise, bevor Sie eine
Anweisung ausführen.
iii

Accertarsi di leggere tutti gli avvisi di attenzione e di
pericolo prima di effettuare qualsiasi operazione.
Lea atentamente todas las declaraciones de precaución y
peligro ante
de llevar a cabo cualquier operación.
Online support
Use the World Wide Web (WWW) or the IBM BBS to
download Diagnostic, BIOS Flash, and Device Driver files.
File download address is:
http://www.ibm.com/pc/files.html
The IBM BBS can be reached at [phone].
IBM Online addresses:
The HMM manuals online address is:
http://www.ibm.com/pc/us/cdt/hmm.html
The IBM Support Page is:
http://www.ibm.com/support/
The IBM Home Page is:
http://www.ibm.com
iv Netfinity Server HMM

Contents
About this supplement ............... iii
Important safety information .......... iii
Online support . . . . . . . . . . . . . . . . . iv
Netfinity 5500 - Type 8660 ............ 1
General Checkout . . . . . . . . . . . . . . . . . 7
Diagnostic tools . . . . . . . . . . . . . . . . . . 10
Features . . . . . . . . . . . . . . . . . . . . . 15
Additional service information ........... 17
Locations . . . . . . . . . . . . . . . . . . . . 141
Symptom-to-FRU index . . . . . . . . . . . . . 264
Undetermined problems . . . . . . . . . . . . . 291
Parts listing (Type 8660) ............ 293
Related service information .......... 307
Safety information . . . . . . . . . . . . . . . . 308
2-way Xeon upgrade installation ........ 339
Before you begin ................ 339
Installing the software .............. 341
Installing the hardware ............. 347
Processor board component locations ...... 358
Parts listing (2-way upgrade kit) ......... 360
4-way Xeon upgrade installation ........ 361
Before you begin ................ 361
Important . . . . . . . . . . . . . . . . . . . . 364
Updating the system BIOS ........... 365
Removing the shuttle and processor housing . . . 366
Replacing the diagnostic panel and front panel
assemblies . . . . . . . . . . . . . . . . . . 369
Replacing the power backplane, ac box, and power
supplies . . . . . . . . . . . . . . . . . . . 370
Installing a microprocessor kit .......... 372
Installing memory-modules . . . . . . . . . . . 376
Installing the processor housing ......... 379
Completing the upgrade installation ....... 384
Parts listing (4-way upgrade kit) ......... 388
Send us your comments! ............ 389
Problem determination tips ........... 390
Phone numbers, U.S. and Canada ........ 391
Trademarks . . . . . . . . . . . . . . . . . . 393
 Copyright IBM Corp. 1999 v

vi Netfinity Server HMM

Netfinity 5500 - Type 8660
General Checkout . . . . . . . . . . . . . . . . . 7
Diagnostic tools . . . . . . . . . . . . . . . . . . 10
Diagnostic programs . . . . . . . . . . . . . . 10
Power-on self-test (POST) ........... 11
POST beep codes ............... 11
Error messages . . . . . . . . . . . . . . . . 12
POST error messages ........... 12
Diagnostic error messages ......... 12
Software-generated error messages ..... 12
System error log .............. 12
Option diskettes . . . . . . . . . . . . . . 12
Diagnostic programs . . . . . . . . . . . . . . 13
Running Diagnostic programs ........ 13
Viewing the test log ............. 14
Features . . . . . . . . . . . . . . . . . . . . . 15
Additional service information ........... 17
Administration and Monitoring Utility Program . . 18
Before you begin .............. 19
Installing the Server Utility Programs ..... 20
Installing the Server Utility Programs using
ServerGuide . . . . . . . . . . . . . . 20
Installing the Server Utility Programs using
Diskettes . . . . . . . . . . . . . . . 20
IBM OS/2 Server Utility Programs .... 20
Microsoft Windows NT Server 4.x Utility
Program . . . . . . . . . . . . . . . . 21
Novell NetWare/Intranetware Server Utility
Program . . . . . . . . . . . . . . . . 22
SCO OpenServer Server Utility Program . 23
Using the Server Utility Programs ...... 23
Server security file ............ 24
Server Utility name resolution ...... 25
Installing the Administration and Monitoring
Utility Program . . . . . . . . . . . . . . 25
Installing the Administration and Monitoring
Utility Program using ServerGuide . . . 25
Installing the Administration and Monitoring
Utility Programs using diskettes ..... 25
Using the Administration and Monitoring Utility
Program . . . . . . . . . . . . . . . . . 26
Options pull-down menu ......... 27
Network settings . . . . . . . . . . . . 28
General options . . . . . . . . . . . . . 29
Netfinity alert options .......... 30
Using the ServeRAID administration functions 31
Array administration . . . . . . . . . . . 31
Logical drive administration ....... 34
Initializing logical drives ......... 36
Synchronizing logical drives ....... 36
Unblocking logical drives ......... 38
Logical drive migration administration .... 38
 Copyright IBM Corp. 1999 1

Changing RAID levels .......... 39
Adding a physical drive ......... 40
Physical device administration ........ 42
Setting Physical device states ...... 42
Rebuilding drives . . . . . . . . . . . . 43
ServeRAID controller administration ..... 45
Copying the drive configuration to the
ServeRAID controller . . . . . . . . . . 45
Copying the ServeRAID controller
configuration to the drives ....... 45
Initializing the ServeRAID II controller . . . 46
Scanning for new drives ......... 46
Using the ServeRAID monitoring functions . . 48
Monitoring status information ....... 48
Monitoring event logs .......... 50
Device event log ............ 50
Hard event log ............. 51
Soft event log .............. 52
Monitoring the logical drive information .... 52
Monitoring the physical device information . . 53
Configuring the Ethernet controller ....... 55
Configuring options . . . . . . . . . . . . . . 57
Configuration overview . . . . . . . . . . . . . 58
Configuration/Setup Utility program ....... 60
Configuring ISA and PCI adapters ....... 61
Failover for redundant Ethernet ......... 62
Special considerations when combining failover
and hot-plug functions ........... 62
Configuring for failover ........... 62
Windows NT . . . . . . . . . . . . . . 63
IntraNetware . . . . . . . . . . . . . . 64
Netfinity System Management Processor .... 65
System requirements for the Advanced System
Management Service with Netfinity Manager 66
Accessing the System Management Processor
without Netfinity Manager ......... 66
System Power menu selections ..... 68
Boot menu selections .......... 69
Using remote video mode to monitor and
access POST . . . . . . . . . . . . . 71
Resolving configuration conflicts ........ 73
Changing the software configuration setup . . 73
Changing the hardware configuration setup . 73
ServeRAID Configuration program ....... 74
Software installation . . . . . . . . . . . . . . 74
Specifications . . . . . . . . . . . . . . . . . 75
Starting the ServeRAID Configuration program . 77
During the initial startup of the server .... 77
After an operating system is installed .... 77
Using diskettes to start the ServeRAID
Configuration program . . . . . . . . . . . 77
Status LEDs . . . . . . . . . . . . . . . . . . 79
Power supply LEDs ............. 79
Understanding disk array technology ...... 81
2Netfinity Server HMM

Hard disk drive capacities .......... 81
Logical drives . . . . . . . . . . . . . . . 81
RAID classifications . . . . . . . . . . . . . 82
RAID level 0 .............. 82
RAID level 1 .............. 82
RAID level 5 .............. 83
ServeRAID menus, screens, and drive states . 83
Main menu . . . . . . . . . . . . . . . . . 84
Screens and pop-up windows ...... 85
Physical device states .......... 86
Logical drive states ........... 88
Using the Advanced Configuration functions . . . 89
Setting the BootCd feature ......... 90
Using the Configuration/Setup Utility Main menu . 91
System summary . . . . . . . . . . . . . . 92
System information . . . . . . . . . . . . . 92
Product data . . . . . . . . . . . . . . 92
System card data ............ 92
PCI routing . . . . . . . . . . . . . . . 92
Devices and I/O ports ............ 92
Date and time ............... 93
System security . . . . . . . . . . . . . . 94
Using the power-on password menu . . . 95
Using the administrator password menu . 96
Start options . . . . . . . . . . . . . . . . 97
Advanced setup . . . . . . . . . . . . . . 97
ACPI control . . . . . . . . . . . . . . 98
Cache control . . . . . . . . . . . . . . 98
PCI bus control ............. 98
Memory settings . . . . . . . . . . . . . 98
Advanced ISA settings .......... 98
System Service Processor settings .... 98
Plug and Play ............... 99
Error logs . . . . . . . . . . . . . . . . . 99
POST error log ............. 99
System error log ............ 99
Save settings . . . . . . . . . . . . . . . . 99
Restore settings . . . . . . . . . . . . . 100
Load default settings ........... 100
Exit setup . . . . . . . . . . . . . . . . 100
Using the ServeRAID Configuration program . 101
Creating disk arrays ........... 102
Using the EZ-RAID configuration feature 102
Creating disk arrays manually ..... 104
Defining logical drives ......... 105
Initializing/Synchronizing logical drives at
the same time ............ 108
Initializing logical drives ........ 109
Synchronizing logical drives ...... 110
Defining hot-spare drives ....... 111
Enabling or disabling hot-swap rebuild . 112
Viewing or changing the configuration . . . 113
Viewing the disk-array configuration . . 113
Viewing the drive information ...... 114
Netfinity 5500 - Type 8660 3

Viewing or changing the ServeRAID
controller parameters . . . . . . . . . 115
Changing device states ........ 116
Changing the RAID parameters .... 118
Changing the write policy ....... 120
Copying logical drives and disk arrays . . . 122
Copying logical drives ......... 122
Copying an existing disk array ..... 123
Deleting Logical drives and disk arrays . 124
Deleting logical drives ......... 124
Deleting disk arrays .......... 125
Maintaining the disk-array configuration . . 125
Backing up the disk-array configuration . 126
Restoring the disk-array configuration . . 127
Testing the RAID subsystem ...... 127
Formatting drives . . . . . . . . . . . . . 128
Clearing the device event log ..... 128
Replacing a faulty drive ........ 129
Understanding the drive rebuild process 131
Automatic rebuild process ....... 131
Initializing, viewing, or synchronizing the
ServeRAID II controller configuration . 133
Configuration synchronization . . . . . 135
Using the ServeRAID Mini-Configuration program 137
Viewing the ServeRAID II controller status . 139
Viewing the configuration ......... 140
Locations . . . . . . . . . . . . . . . . . . . . 141
Adapters . . . . . . . . . . . . . . . . . . 142
LEDs for hot-plug PCI slots ........ 143
Adapter considerations . . . . . . . . . . 144
Plug and Play technology ......... 144
Plug and Play adapters ........ 145
Legacy adapters . . . . . . . . . . . 145
Configuration/Setup Utility program . . . 145
Battery replacement . . . . . . . . . . . . . 147
Before you begin .............. 150
Changing jumper positions .......... 151
Two-pin jumper blocks .......... 151
Three-pin jumper blocks ......... 153
Completing the installation .......... 154
Installing the top cover .......... 155
Installing the trim bezels and server door . . 156
Updating device records and reconfiguring the
server . . . . . . . . . . . . . . . . . 156
Controls and indicators ............ 158
CD-ROM drive . . . . . . . . . . . . . . . . 161
Handling a CD .............. 161
Loading a CD .............. 161
DASD backplane removal .......... 163
Diagnostics panel LEDs ........... 164
External options . . . . . . . . . . . . . . . 165
Connecting external SCSI devices ..... 165
Cabling requirements . . . . . . . . . 165
Setting SCSI IDs for external devices . . 165
4Netfinity Server HMM

Installation procedure . . . . . . . . . 165
Input/Output ports and connectors ..... 166
Serial ports . . . . . . . . . . . . . . 166
Management port C .......... 167
Parallel port . . . . . . . . . . . . . . 167
Video port . . . . . . . . . . . . . . 168
Keyboard and auxiliary-device ports . . 169
Ethernet port . . . . . . . . . . . . . 170
Universal serial bus ports ....... 171
Front bezel removal ............. 172
Hot-plug PCI adapter installation ....... 173
Installing a non-hot-plug adapter ...... 177
Verifying compatibility between network
adapters and device drivers ....... 180
Hot-swap power supply installation ...... 181
Hot-swap power supply removal ....... 185
Hot-swap fan assembly ........... 187
Information LED panel ............ 189
Information panel cover removal ....... 191
Information panel LED assembly removal . . . 192
Input/Output connectors and expansion slots . 194
Interior LED and speaker assembly ...... 196
Internal drive installation ........... 197
Internal drive bays ............ 197
SCSI drives . . . . . . . . . . . . . . . 198
SCSI IDs . . . . . . . . . . . . . . . 199
Termination (internal SCSI devices) . . 199
Preinstallation steps (all bays) ....... 200
Installing a 5.25-inch removable-media drive 200
Installing a drive in a hot-swap bay .... 203
Replacing a drive in a hot-swap bay .... 205
Installing devices in the NetBAY3 ....... 209
General considerations . . . . . . . . . . 209
Removing the rear panel ......... 210
Installing devices on side rails ....... 210
Removing cage nuts ........... 211
Installing cage nuts ............ 212
Installing cantilevered devices ....... 212
Installing devices on the NetBAY3 base plate 213
Memory-module kits . . . . . . . . . . . . . 214
Microprocessor kit . . . . . . . . . . . . . . 217
Preparing to install options .......... 220
Power backplane removal .......... 222
Power supplies . . . . . . . . . . . . . . . 224
Power supply filler plate ........... 225
NetBAY3 bezel installation .......... 226
Processor board component locations ..... 227
Processor board jumpers ........... 229
Processor board removal ........... 232
Rack installation . . . . . . . . . . . . . . . 233
Before you begin ............. 233
Installing and removing the server ..... 233
Preparing the rack ........... 234
Installing the server in the rack ..... 240
Netfinity 5500 - Type 8660 5

Removing the server from a rack .... 246
SCSI backplane component locations ..... 249
SCSI backplane option jumpers ........ 250
Server cabling . . . . . . . . . . . . . . . . 251
Server door and trim bezels removal ..... 252
Shuttle removal . . . . . . . . . . . . . . . 253
Side cover(s) removal ............ 254
System board component locations ...... 255
System board jumpers ............ 257
Bypassing an unknown power-on password 258
System board removal ............ 259
Top cover removal .............. 262
Voltage regulator card removal ........ 263
Symptom-to-FRU index . . . . . . . . . . . . . 264
Beep symptoms . . . . . . . . . . . . . . . 264
No beep symptoms ............. 267
Control panel system error LED ....... 267
Diagnostic error codes ............ 270
Error symptoms . . . . . . . . . . . . . . . 277
Power supply LED errors ........... 278
POST error codes .............. 280
SCSI error codes .............. 285
ServeRAID II controller error codes/messages . 286
System board LEDs ............. 290
System board SCSI LEDs .......... 290
Undetermined problems . . . . . . . . . . . . . 291
Parts listing (Type 8660) ............ 293
System . . . . . . . . . . . . . . . . . . . 294
Hard disk drives and cables ......... 302
Keyboards . . . . . . . . . . . . . . . . . 303
Power cords . . . . . . . . . . . . . . . . . 305
6Netfinity Server HMM

General Checkout
The server diagnostic programs are stored in nonvolatile
random-access memory (NVRAM) on the system board.
These programs are the primary method of testing the
major components of the server: the system board,
Ethernet controller, video controller, RAM, keyboard,
mouse (pointing device), diskette drive, serial port, and
parallel port. You can also use them to test some external
devices.
Also, if you cannot determine whether a problem is caused
by the hardware or by the software, you can run the
diagnostic programs to confirm that the hardware is
working properly.
When you run the diagnostic programs, a single problem
might cause several error messages. When this occurs,
work to correct the cause of the first error message. After
the cause of the first error message is corrected, the other
error messages might not occur the next time you run the
test.
A failed system might be part of a shared DASD cluster
(two or more systems sharing the same external storage
device(s)). Prior to running diagnostics, verify that the
failing system is not part of a shared DASD cluster.
A system might be part of a cluster if:
The customer identifies the system as part of a
cluster.
One or more external storage units are attached to
the system and at least one of the attached storage
units is additionally attached to another system or
unidentifiable source.
One or more systems are located near the failing
system.
If the failing system is suspect to be part of a shared
DASD cluster, all diagnostic tests can be run except
diagnostic tests which tests the storage unit (DASD
residing in the storage unit) or the storage adapter
attached to the storage unit.
Netfinity 5500 - Type 8660 7

(CONTINUED)
Notes
1. For systems that are part of a shared DASD
cluster, run one test at a time in looped mode.
Do not run all tests in looped mode, as this could
enable the DASD diagnostic tests.
2. If multiple error codes are displayed, diagnose
the first error code displayed.
3. If the computer hangs with a POST error, go to
the “Symptom-to-FRU index” on page 264.
4. If the computer hangs and no error is displayed,
go to “Undetermined problems” on page 291.
5. Power Supply problems, see “Symptom-to-FRU
index” on page 264.
6. Safety information, see “Safety information” on
page 308.
7. For intermittent problems, check the error log;
see, “Error logs” on page 99.
001
IS THE SYSTEM PART OF A CLUSTER?
Yes No
002
Go to Step 004.
003
Schedule maintenance with the customer. Shut down all
systems related to the cluster. Run storage test.
004
– Power-off the computer and all external devices.
– Check all cables and power cords.
– Set all display controls to the middle position.
– Power-on all external devices.
– Power-on the computer.
– Check the control panel system error LED; if on, see
“Control panel system error LED” on page 267.
– Check the error log. If an error was recorded by the
system, see “Symptom-to-FRU index” on page 264.
– Start the Diagnostic Programs. See “Running
Diagnostic programs” on page 13.
– Check for the following responses:
1. No beep.
2. Readable instructions or the Main Menu.
(Step 004 continues)
8Netfinity Server HMM

004 (continued)
DID YOU RECEIVE THE CORRECT RESPONSES?
Yes No
005
Find the failure symptom in “Symptom-to-FRU index”
on page 264.
006
– Run the Diagnostic Programs. If necessary, refer to
“Running Diagnostic programs” on page 13.
If you receive an error, go to “Symptom-to-FRU index”
on page 264.
If the diagnostics completed successfully and you still
suspect a problem, see “Undetermined problems” on
page 291.
Netfinity 5500 - Type 8660 9

Diagnostic tools
The following tools are available to help identify and
resolve hardware-related problems:
Diagnostic programs
The server diagnostic programs are stored in upgradable
read-only memory (ROM) on the system board. These
programs are the primary method of testing the major
components of the server: the system board, Ethernet
controller, video controller, RAM, keyboard, mouse
(pointing device), diskette drive, serial port, and parallel
port. You can also use them to test some external
devices.
Also, if you cannot determine whether a problem is caused
by the hardware or by the software, you can run the
diagnostic programs to confirm that the hardware is
working properly.
Note: When you run the diagnostic programs, a single
problem might cause several error messages. When this
occurs, work to correct the cause of the first error
message. After the cause of the first error message is
corrected, the other error messages might not occur the
next time you run the test.
10 Netfinity Server HMM

Power-on self-test (POST)
When you turn on the server, it performs a series of tests
to check the operation of server components and some of
the options installed in the server. This series of tests is
called the power-on self-test or POST.
POST does the following:
Checks the operation of some basic system board
operations
Checks the memory
Compares the current server configuration with the
stored server configuration information
Configures PCI adapters
Starts the video operation
Verifies that drives (such as the diskette, CD-ROM,
and hard disk drives) are connected properly
If you have a power-on password or administrator
password set, you must type the password and press
Enter, when prompted, before POST will continue.
While the memory is being tested, the amount of available
memory appears on the screen. These numbers advance
as the server progresses through POST and the final
number that appears on the screen represents the total
amount of memory available. If POST finishes without
detecting any problems, a single beep sounds, the first
screen of the operating system or application program
appears, and the System POST Complete (OK) light is
illuminated on the information LED panel.
If POST detects a problem, more than one beep sounds
and an error message appears on the screen.
Note: A single problem might cause several error
messages. When this occurs, work to correct the cause of
the first error message. After the cause of the first error
message is corrected, the other error messages usually
will not occur the next time you run the test.
For a complete list of error codes, see “Symptom-to-FRU
index” on page 264.
POST beep codes
POST generates beep codes to indicate successful
completion or the detection of a problem.
One beep indicates the successful completion of
POST.
For a complete list of error codes, see
“Symptom-to-FRU index” on page 264.
Netfinity 5500 - Type 8660 11

Error messages
Error messages indicate that a problem exists; they are not
intended to be used to identify a failing part.
Troubleshooting and servicing of complex problems
indicated by error messages should be performed by
trained service personnel.
Hardware error messages that occur can be text, numeric,
or both. Messages generated by the software generally
are text messages, but they also can be numeric.
POST error messages: POST error messages
occur during startup when POST finds a problem with the
hardware or detects a change in the hardware
configuration. For more information, see
“Symptom-to-FRU index” on page 264..
Diagnostic error messages: Diagnostic error
messages occur when a test finds a problem with the
server hardware. These error messages are alphanumeric
and they are saved in the Test Log. For more information,
see “Error symptoms” on page 277.
Software-generated error messages: These
messages occur if a problem or conflict is found by an
application program, the operating system, or both.
Messages are generally text messages, but they also can
be numeric. For information about these error messages,
refer to the documentation that comes with the software.
System error log: The system error log contains all
error and warning messages issued during POST and all
system status messages from the the system management
processor. See “System error log” on page 99 for
information about how to view the system error log.
Option diskettes: An optional device or adapter can
come with an Option Diskette. Option Diskettes usually
contain option-specific diagnostic test programs or
configuration files.
If the optional device or adapter comes with an Option
Diskette, follow the instructions that come with the option.
Different instructions apply depending on whether the
Option Diskette is startable or not.
12 Netfinity Server HMM