IBM 8500R - Netfinity - 8681 Owner's manual

S37L-5123-00
IBM Netfinity Servers
IBM Netfinity 8500R - Type 8681
Models 4RY, 4RG, 5RY
5RG, 6RY, 6RG
Hardware Maintenance Manual
September 1999
We Want Your Comments!
(Please see page 277)

S37L-5123-00
IBM Netfinity Servers
IBM Netfinity 8500R - Type 8681
Models 4RY, 4RG, 5RY
5RG, 6RY, 6RG
Hardware Maintenance Manual
September 1999
We Want Your Comments!
(Please see page 277)
IBM

Note
Before using this information and the product it
supports, be sure to read the general information
under “Notices” on page 281.
First Edition (September 1999)
The following paragraph does not apply to the United
Kingdom or any country where such provisions are
inconsistent with local law: INTERNATIONAL
BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY
KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE. Some states do not allow disclaimer of
express or implied warranties in certain transactions,
therefore, this statement may not apply to you.
This publication could include technical inaccuracies or
typographical errors. Changes are periodically made to
the information herein; these changes will be incorporated
in new editions of the publication. IBM may make
improvements and/or changes in the product(s) and/or the
program(s) described in this publication at any time.
This publication was developed for products and services
offered in the United States of America. IBM may not offer
the products, services, or features discussed in this
document in other countries, and the information is subject
to change without notice. Consult your local IBM
representative for information on the products, services,
and features available in your area.
Requests for technical information about IBM products
should be made to your IBM reseller or IBM marketing
representative.
 Copyright International Business Machines
Corporation 1998, 1999. All rights reserved.
Note to U.S. Government users–Documentation related to
Restricted rights–Use, duplication, or disclosure is subject
to restrictions set forth in GSA ADP Schedule Contract
with IBM Corp.
ii Netfinity Server HMM

About this manual
This manual contains diagnostic information, a
Symptom-to-FRU Index, service information, error codes,
error messages, and configuration information for the
Netfinity 8500R - Type 8681.
Important
This manual is intended for trained servicers who are
familiar with IBM PC Server products.
Important safety information
Be sure to read all caution and danger statements in this
book before performing any of the instructions.
Leia todas as instruções de cuidado e perigo antes de
executar qualquer operação.
Prenez connaissance de toutes les consignes de type
Attention et
Danger avant de procéder aux opérations décrites par les
instructions.
Lesen Sie alle Sicherheitshinweise, bevor Sie eine
Anweisung ausführen.
iii

Accertarsi di leggere tutti gli avvisi di attenzione e di
pericolo prima di effettuare qualsiasi operazione.
Lea atentamente todas las declaraciones de precaución y
peligro ante
de llevar a cabo cualquier operación.
Online support
Use the World Wide Web (WWW) to download Diagnostic,
BIOS Flash, and Device Driver files.
File download address is:
http://www.ibm.com/pc/files.html
IBM online addresses:
The HMM manuals online address is:
http://www.ibm.com/pc/us/cdt/hmm.html
The IBM Support Page is:
http://www.ibm.com/support/
The IBM Home Page is:
http://www.ibm.com/pc/
iv Netfinity Server HMM

Contents
About this manual ................. iii
Important safety information .......... iii
Online support . . . . . . . . . . . . . . . . . iv
Netfinity 8500R - Type 8681 ........... 1
General checkout . . . . . . . . . . . . . . . . . 5
Diagnostics . . . . . . . . . . . . . . . . . . . . 8
Features . . . . . . . . . . . . . . . . . . . . . 15
Configuring the server ............... 18
Specifications . . . . . . . . . . . . . . . . . . . 40
Locations . . . . . . . . . . . . . . . . . . . . . 42
Symptom-to-FRU index . . . . . . . . . . . . . 166
Undetermined problems . . . . . . . . . . . . . 211
Parts listing (Netfinity 8500R - Type 8681) .... 229
Related service information .......... 239
Safety information . . . . . . . . . . . . . . . . 240
Send us your comments! ............ 277
Problem determination tips ........... 278
Phone numbers, U.S. and Canada ........ 279
Notices . . . . . . . . . . . . . . . . . . . . . 281
Trademarks . . . . . . . . . . . . . . . . . . 281
 Copyright IBM Corp. 1999 v

vi Netfinity Server HMM

Netfinity 8500R - Type 8681
General checkout . . . . . . . . . . . . . . . . . 5
Diagnostics . . . . . . . . . . . . . . . . . . . . 8
Diagnostic programs . . . . . . . . . . . . 8
Power-on self-test (POST) ......... 8
POST beep codes ............. 9
Error messages . . . . . . . . . . . . . . 9
POST error messages ........... 9
System-monitoring messages . . . . . . . . 9
Diagnostic error messages ......... 10
Software-Generated error messages ..... 10
POST error log ................ 10
System error log ................ 10
Option diskettes . . . . . . . . . . . . . . . . 10
Diagnostic programs . . . . . . . . . . . . . . 10
Running the diagnostic programs ...... 11
Starting the diagnostic programs ....... 12
Using the Online Manual .......... 13
Viewing the test log .............. 14
Features . . . . . . . . . . . . . . . . . . . . . 15
Configuring the server ............... 18
Accessing server programs ........... 19
Configuration overview . . . . . . . . . . . . . 19
The Configuration/Setup Utility program ..... 20
Using the Configuration/Setup Utility main menu . 21
System summary . . . . . . . . . . . . . . 23
System information . . . . . . . . . . . . . 23
Product data . . . . . . . . . . . . . . 23
System card data ............ 23
Devices and I/O ports ............ 23
Date and time ............... 24
System security . . . . . . . . . . . . . . 24
Using the power-on password menu . . . 25
Using the administrator password menu . 27
Start options . . . . . . . . . . . . . . . . 28
Advanced setup . . . . . . . . . . . . . . 28
Processor serial number access ..... 29
Modify front panel text .......... 29
PCI slot/device information ........ 30
Cache control . . . . . . . . . . . . . . 30
Memory settings . . . . . . . . . . . . . 31
Processor settings . . . . . . . . . . . . 31
MPS version control ........... 32
Error logs . . . . . . . . . . . . . . . . . 32
POST error log ............. 32
System error log ............ 32
Save settings . . . . . . . . . . . . . . . . 32
Restore settings . . . . . . . . . . . . . . 32
Load default settings ............ 32
Exit setup . . . . . . . . . . . . . . . . . 32
Using the System Partition ........... 33
Configuring options . . . . . . . . . . . . . . 33
 Copyright IBM Corp. 1999 1

Resolving configuration conflicts ........ 34
Resolving hardware configuration conflicts . . 34
Resolving software configuration conflicts . . 35
Using the SCSISelect Utility program ...... 36
Starting the SCSISelect Utility program . . . 36
SCSISelect Utility program choices ..... 36
Configure/view host adapter settings . . . 36
SCSI disk utilities ............ 37
Performing a low-level disk format .... 38
When to use the low-level format program 38
Starting the low-level format program . . . 38
Specifications . . . . . . . . . . . . . . . . . . . 40
Locations . . . . . . . . . . . . . . . . . . . . . 42
Adapters . . . . . . . . . . . . . . . . . . . 43
PCI slot LED descriptions .......... 44
Adapter considerations . . . . . . . . . . . 45
Configuring adapters . . . . . . . . . . . . 46
Advanced System Management PCI adapter . . 47
Advanced System Management PCI Adapter
component locations . . . . . . . . . . . 48
Battery replacement . . . . . . . . . . . . . . 49
Before you begin to install optional hardware . . 52
Lifting the server .............. 53
CD-ROM drive removal ............ 55
Completing the installation ........... 56
Installing the top cover ........... 56
Installing the front bezel ........... 58
Reconfiguring the server and updating server
records . . . . . . . . . . . . . . . . . . 59
Controls and indicators ............. 60
DIMM and memory board installation ...... 63
Diskette drive removal ............. 69
External options . . . . . . . . . . . . . . . . 70
Connecting external SCSI devices ...... 70
Cabling requirements . . . . . . . . . . 70
Setting SCSI IDs for external devices . . . 70
Installing external devices ........ 70
Input/Output port connectors ........ 71
Serial port . . . . . . . . . . . . . . . 71
Parallel port . . . . . . . . . . . . . . . 72
Video port . . . . . . . . . . . . . . . 73
Keyboard and auxiliary-device ports . . . 73
Wide Ultra-2 SCSI (LVD) ports ...... 74
Universal Serial Bus ports ........ 76
Advanced System Management PCI Adapter
10/100 Mbps Ethernet port ....... 76
Advanced System Management dual serial
port . . . . . . . . . . . . . . . . . . 77
Advanced System Management Interconnect
port . . . . . . . . . . . . . . . . . . 77
Front panel . . . . . . . . . . . . . . . . . . 79
Hot-swap Power supplies ........... 80
Hot-swap fan installation/removal ........ 83
Hot-plug PCI adapter installation ........ 84
2Netfinity Server HMM

Installing a non-hot-plug PCI adapter .... 89
Verifying compatibility between network
adapters and device drivers ........ 89
Cabling internal hard disk drives to a ServeRAID
adapter (optional) . . . . . . . . . . . . . 90
Hot-swap power supply installation/removal . . . 92
Installing the server in and removing the server
from the rack enclosure ............ 96
Installing the server in the rack enclosure . . 97
Preparing the rack enclosure ....... 97
Installing the server .......... 102
Removing the server from the rack enclosure 107
Internal drives installation .......... 110
Internal drive bays ............ 111
Hard disk drives ............. 112
SCSI IDs . . . . . . . . . . . . . . . . . 112
Termination . . . . . . . . . . . . . . . 113
Preinstallation steps . . . . . . . . . . . 113
Installing or replacing a drive ....... 113
I/O board component locations ........ 116
I/O board removal .............. 117
VRM latch releases ............ 119
I/O function card component locations ..... 120
I/O function card jumpers ......... 121
Input/output connectors and expansion slots . . 122
Jumper settings . . . . . . . . . . . . . . . 125
Two-pin jumper blocks .......... 125
Three-Pin jumper blocks ......... 126
LED card removal .............. 129
Memory board component locations ...... 130
Midplane removal . . . . . . . . . . . . . . 132
Power control card removal ......... 133
Preparing to install options .......... 134
Removing the top cover .......... 136
Removing the front bezel ......... 137
Removing the memory-access panel .... 138
Processor-controller board component locations 140
Processor-controller board jumpers ...... 141
Processor-daughterboard component locations 143
Processor fan replacement .......... 144
Replacing an I/O fan ........... 145
Processor housing assembly ......... 146
Removing the processor housing assembly 149
Installing or replacing a processor ..... 151
Installing or replacing a processor
daughterboard . . . . . . . . . . . . . 153
Installing an optional processor
daughterboard and cache coherency filter
cards . . . . . . . . . . . . . . . . 155
Replacing the standard processor
daughterboard . . . . . . . . . . . . 156
Reinstalling the processor housing assembly 159
SCSI backplane component locations ..... 160
SCSI backplane removal ........... 161
Netfinity 8500R - Type 8681 3

System reliability considerations ....... 162
Understanding the Netfinity 8500R server design 163
I/O board . . . . . . . . . . . . . . . . 163
I/O function card ............. 163
Midplane . . . . . . . . . . . . . . . . . 164
Processor controller board ........ 164
Processor daughterboard . . . . . . . . . 164
Memory board . . . . . . . . . . . . . . 164
Working inside a server with power on .... 165
Symptom-to-FRU index . . . . . . . . . . . . . 166
Beep symptoms . . . . . . . . . . . . . . . 167
No beep symptoms ............. 172
Power supply LED errors ........... 173
AC LED on/DC LED off .......... 174
Power control card LED ........... 176
Server component fault indicators ....... 182
Diagnostic error codes ............ 183
Other error symptoms ............ 190
POST error codes .............. 194
DASD LEDs for hardfiles running in a RAID
environment . . . . . . . . . . . . . . . . 206
SCSI errors . . . . . . . . . . . . . . . . . 206
SM BUS error (3-3-2) ............ 208
Undetermined problems . . . . . . . . . . . . . 211
System management codes ......... 222
System Management Interrupt (SMI) Handler . 227
Parts listing (Netfinity 8500R - Type 8681) .... 229
System . . . . . . . . . . . . . . . . . . . 230
Processor Housing Assembly ....... 232
I/O Housing Assembly .......... 234
Keyboards (101/102 Key) .......... 236
Power cords . . . . . . . . . . . . . . . . . 238
4Netfinity Server HMM

General checkout
The server diagnostic programs are stored in flash RAM
on the I/O function card. These programs are the primary
method of testing the major components of the server.
You can also use them to test some external devices.
Also, if you cannot determine whether a problem is caused
by the hardware or by the software, you can run the
diagnostic programs to confirm that the hardware is
working properly.
When you run the diagnostic programs, a single problem
might cause several error messages. When this occurs,
work to correct the cause of the first error message. After
the cause of the first error message is corrected, the other
error messages might not occur the next time you run the
test.
Note
Some error conditions will generate error messages
that are displayed in the front panel video fluorescent
display (VFD). Some of these messages will
automatically be cleared once the problem is
corrected. Others will need to be cleared manually.
To ensure you have correctly identified the failing FRU
during your diagnosis, manually clear any messages
from the front panel display using the scroll and enter
buttons on the right side of the front panel after you
have replaced any FRU(s). This can be done with the
system in the Standby mode before power up. Then,
once you reboot the system, if a problem still exists
which normally generates a message on the front
panel, the new message generated will alert you to
the continued or new error condition.
A failed system might be part of a shared DASD cluster
(two or more systems sharing the same external storage
device(s)). Prior to running diagnostics, verify that the
failing system is not part of a shared DASD cluster.
A system might be part of a cluster if:
The customer identifies the system as part of a
cluster.
One or more external storage units are attached to
the system and at least one of the attached storage
units is additionally attached to another system or
unidentifiable source.
One or more systems are located near the failing
system.
If the failing system is suspect to be part of a shared
DASD cluster, all diagnostic tests can be run except
diagnostic tests which tests the storage unit (DASD
residing in the storage unit) or the storage adapter
attached to the storage unit.
Netfinity 8500R - Type 8681 5

(CONTINUED)
Notes
1. If you hear beep codes, see “Beep symptoms” on
page 167.
2. If you hear beep code 1-3-1, see "1st 1MB RAM
test failed" (Beep code 1-3-1) in “Beep
symptoms” on page 167.
3. If you hear beep code 3-3-2, see "SM Bus error"
(Beep code 3-3-2) in “Beep symptoms” on
page 167.
4. If you do not hear beep codes, and have no
other error indications but the system will not
boot or will not power off, see “No beep
symptoms” on page 172.
5. If you have SCSI errors posted on the monitor,
see “SCSI errors” on page 206.
6. If you have symptoms relating to fans, CD-ROM,
diskette drive, SCSI devices, or monitor, see
“Other error symptoms” on page 190.
7. If you do not have two LED's lit on each power
supply, see “Power supply LED errors” on
page 173.
8. If you have a power fault message in the system
error log, see “Power control card LED” on
page 176.
9. If you have server component fault indicator
LEDs lit, see “Server component fault indicators”
on page 182.
10. If you have a flashing attention light and error
messages posted in the front panel, see “System
management codes” on page 222.
11. If you have run diagnostics which generated
diagnostic error codes, see “Diagnostic error
codes” on page 183.
12. If you have a SMI error posted in the front panel,
see “System Management Interrupt (SMI)
Handler” on page 227.
13. If your system is hung, will not boot, or exhibits
symptoms other than those above, see
“Undetermined problems” on page 211.
14. For systems that are part of a shared DASD
cluster, run one test at a time in looped mode.
Do not run all tests in looped mode, as this could
enable the DASD diagnostic tests.
15. If multiple error codes are displayed, diagnose
the first error code displayed.
16. If there are multiple errors logged in the system
error log, diagnose the errors in the order they
were posted according to the date/time stamp.
17. If you have intermittent problems, check the
system error log; see, “System error log” on
page 32.
18. If you need safety information, see “Safety
information” on page 240.
6Netfinity Server HMM

001
IS THE SYSTEM PART OF A CLUSTER?
Yes No
002
Go to Step 004.
003
Schedule maintenance with the customer. Shut down all
failing systems related to the cluster. Run storage test.
004
– Power-off the computer and all external devices.
– Check all cables and power cords.
– Set all display controls to the middle position.
– Power-on all external devices.
– Power-on the computer.
– Check the front panel system error LED; if blinking,
check the error message on the front panel and see
“System management codes” on page 222.
– Attempt to boot to the Configuration/Setup utility and
check the system error log. If an error was recorded by
the system, see “Symptom-to-FRU index” on page 166.
If this is not possible, connect to the System
Management Adapter and access the system error log
remotely.
– Attempt to boot the system and start the Diagnostic
programs. See “Running the diagnostic programs” on
page 11. If the diagnostics will not load, record the
symptoms you observe and go to “Symptom-to-FRU
index” on page 166.
If the diagnostics completed successfully and you
still suspect a problem, go to “Undetermined
problems” on page 211.
Netfinity 8500R - Type 8681 7

Diagnostics
Server problems can be caused by hardware, software, or
a user error. An example of a user error is pressing the
wrong key on the keyboard.
The following tools are available to help identify and
resolve hardware-related problems:
Diagnostic programs
Power-on self-test (POST)
POST beep codes
Error messages
System error log
Option diskettes
Diagnostic programs: The Diagnostics Utility
program contains several server diagnostic programs.
These diagnostic programs are stored on electrically
erasable programmable read-only memory (EEPROM).
These programs are the primary method of testing the
major components of your server and some external
devices.
Also, if you cannot determine whether a problem is caused
by the hardware or by the software, you can run the
diagnostic programs to confirm that the hardware is
working properly.
Note
When you run the diagnostic programs, a single
problem might cause several error messages. When
this occurs, work to correct the cause of the first error
message. After the cause of the first error message is
corrected, the other error messages might not occur
the next time that you run the test.
Power-on self-test (POST): When you turn on
the server, it performs a series of tests to check the
operation of server components and some of the options
installed in the server. This series of tests is called the
power-on self-test or POST.
POST does the following:
Checks the operation of some basic I/O function card,
processor daughterboard, and I/O board operations
Checks the memory
Compares the current server configuration with the
stored server configuration information
Configures PCI adapters
Starts the video operation
Verifies that drives (such as the diskette, CD-ROM,
and hard disk drives) are connected properly
8Netfinity Server HMM

If you have a power-on password or administrator
password set, you must type the password and press
Enter before POST will continue.
While the memory is being tested, the amount of available
memory appears on the screen. These numbers advance
as the server progresses through POST and the final
number that appears on the screen represents the total
amount of memory available. If POST finishes without
detecting any problems, a single beep sounds and the first
screen of your operating system or application program
appears.
If POST detects a problem, more than one beep sounds,
or an error message appears on your screen.
Note
A single problem might cause several error messages.
When this occurs, work to correct the cause of the first
error message. After the cause of the first error
message is corrected, the other error messages
usually will not occur the next time you run the test.
POST beep codes: POST generates beep codes to
indicate successful completion or the detection of a
problem.
One beep indicates the successful completion of
POST.
No beep indicates that a unrecoverable error occurred
during POST.
More than one beep indicates that POST detected a
problem. For more information, see “Beep
symptoms” on page 167.
Error messages: Error messages indicate that a
problem exists; they are not intended to be used to identify
a failing part. Troubleshooting and servicing of complex
problems indicated by error messages should be
performed by trained service personnel.
Hardware error messages that occur can be text, numeric,
or both. Messages generated by your software generally
are text messages, but they also can be numeric.
POST error messages: POST error messages
occur during startup when POST finds a problem with the
hardware or detects a change in the hardware
configuration. For more information, see “Viewing the test
log” on page 14.
System-monitoring messages:
System-monitoring messages occur as the Advanced
System Management PCI Adapter monitors critical system
functions.
Netfinity 8500R - Type 8681 9

DIAGNOSTIC PROGRAMS
Diagnostic error messages: Diagnostic error
messages occur when a diagnostic test finds a problem
with the server hardware. These error messages are
alphanumeric and they are saved in the test log. For more
information, see “Viewing the test log” on page 14.
Software-Generated error messages: These
messages occur if a problem or conflict is found by an
application program, the operating system, or both.
Messages are generally text messages, but they also can
be numeric. For information on these error messages,
refer to the documentation that comes with your software.
POST error log
The POST error log contains a maximum of three error
and warning messages issued during POST and all system
status messages from the Advanced System Management
PCI Adapter (service processor). See “POST error log” on
page 32 for information on how to view the POST error
log.
System error log
The system error log contains all error and warning
messages issued during POST, all system status
messages from the Advanced System Management PCI
Adapter (service processor), and all error messages issued
during diagnostic testing. See “System error log” on
page 32 for information on how to view the system error
log.
Option diskettes
An optional device or adapter can come with an Option
Diskette. Option Diskettes usually contain option-specific
diagnostic test programs or configuration files.
If your optional device or adapter comes with an Option
Diskette, follow the instructions that come with the option.
Different instructions apply depending on whether or not
the Option Diskette is startable.
Diagnostic programs
This section includes useful information on running the
diagnostic programs. These programs are designed to test
the IBM Netfinity 8500R server. If you want to test a
non-IBM product, refer to the information that comes with
that product.
10 Netfinity Server HMM

DIAGNOSTIC PROGRAMS
Notes
1. When you run the diagnostic programs, a single
problem might cause several error messages.
When this occurs, work to correct the cause of
the first error message. After the cause of the
first error message is corrected, the other error
messages usually will not appear the next time
that you run the test.
2. You can also run the diagnostic programs
remotely with the Advanced System Management
PCI Adapter in conjunction with the Advanced
System Management service capabilities of
Netfinity Manager, a terminal program, or a Web
browser. Refer to the “Advanced System
Management Information” section of this
Server
Library for more information.
Running the diagnostic programs: While you
are running the diagnostic programs, pressing F1 displays
help information. Pressing F1 from within a help screen
provides a help index from which you can select different
categories. Pressing Esc closes the Help window and
returns to running the diagnostic programs.
Netfinity 8500R - Type 8681 11

DIAGNOSTIC PROGRAMS
Notes
1. To run the diagnostic programs, you must start
the server with the highest level password.
That is, if you enter the power-on password and
an administrator password is set, you cannot run
the programs. You can only view the error
messages in the Test Log.
You must enter the administrator password to run
the diagnostic programs.
2. If the server stops during testing and you cannot
continue, restart the server and try running the
diagnostic programs again. If the problem
persists, have the system serviced.
3. If the diagnostic tests do not find a problem, but
the problem persists during normal operations,
see “Undetermined problems” on page 211 and
look for the problem symptom.
4. You might have to install a wrap connector on
your active parallel or serial port to obtain
accurate test results for these ports. If you do
not have a wrap connector, contact your IBM
reseller or IBM marketing representative.
5. You might need a scratch diskette to obtain
accurate test results when testing the diskette
drive.
6. The keyboard and mouse (pointing device) tests
assume that a keyboard and mouse are attached
to the server.
Starting the diagnostic programs: To start the
diagnostic programs:
1. Ensure that there is no diskette in the diskette drive.
If the diskette drive contains a diskette, remove it.
2. Turn on the server and watch for the IBM logo
screen. If the server is turned on already, shut down
your operating system and restart the server.
3. After you start the server, several prompts appear on
the IBM logo screen. When the prompt Press F2 for
Diagnostics appears, press F2.
If a power-on password or administrator password is
set, the server prompts you for it. Type in the
appropriate password; then, press Enter.
The Diagnostics Utility program window appears.
After you start the Diagnostics Utility program, the
following menu headings will appear at the top of the
screen:
Extended
Basic
Utility
Hardware Info
Quit
12 Netfinity Server HMM