IBM RS/6000 Enterprise Server M80 User manual

RS/6000 Enterprise Server Model M80
Eserver pSeries 660 Model 6M1
Service Guide
SA38-0571-01


Second Edition (September 2001)
Before using this information and the product it supports, read the information in “Safety Notices” on page xi,
Appendix A, “Environmental Notices,” on page 491, and Appendix B, “Notices,” on page 497.
Areader’s comment form is provided at the back of this publication. If the form has been removed, address
comments to Information Development, Department H6DS-905-6C006, 11501 Burnet Road, Austin, Texas
78758-3493. To send comments electronically, use this commercial internet address: [email protected].Any
information that you supply may be used without incurring any obligation to you.
©International Business Machines Corporation, 2000, 2001. All rights reserved.
Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is
subject to restrictions set forth is GSA ADP Schedule Contract with IBM Corp.

Contents
Safety Notices .................................xi
Rack Safety Instructions ..............................xi
Electrical Safety ................................. xii
Laser Safety Information .............................. xiii
Laser Compliance ............................... xiii
Data Integrity and Verification ...........................xv
About This Book ................................ xvii
ISO 9000 ................................... xvii
Online Publications ............................... xvii
Related Publications ............................... xvii
Trademarks .................................. xvii
Chapter 1. Reference Information ..........................1
Overview ....................................1
Processors ..................................2
Memory ...................................2
Primary I/O Drawer ...............................3
Data Flow....................................4
Powering the System On and Off ...........................5
Console Strategy .................................6
Power-On Self-Test ................................6
POST Indicators .................................6
POST Keys ...................................7
1Key ....................................7
5Key ....................................7
6Key ....................................8
8Key ....................................8
System Locations .................................9
CEC Drawer Front View With Bezel Removed .....................10
CEC Drawer Rear View .............................11
CEC Card Cage ................................12
Primary I/O Drawer Front View With Cover On.....................13
Secondary I/O Drawer Front View With Cover On ...................14
Primary I/O Drawer Rear View...........................15
Primary I/O Drawer Front View with Covers Removed ..................16
Secondary I/O Drawer Rear View .........................17
I/O Drawer Backplane PCI Slot Locations ......................17
System Board Locations .............................18
Memory Riser Card and Memory DIMM Locations ...................19
Primary I/O Drawer Operator Panel .........................20
Secondary I/O Drawer Operator Panel........................21
SCSI IDs and Bay Locations ...........................22
Primary I/O Drawer SCSI IDs ...........................22
System Memory .................................23
Riser Card Memory Placement Rules ........................23
I/O Drawer Features ...............................24
I/O Drawer Addressing .............................24
I/O Drawer and Power Supply LED Status ......................25
Secondary I/O Drawer Operator Panel Message Hierarchy ................26
Primary I/O Drawer Operator Panel Behavior During Power-On ..............27
Secondary I/O Drawer Operator Panel Behavior During Power-On .............28
iii

Logical and Physical Locations ...........................28
Physical Location Codes ..............................28
Location Code Format..............................28
Multiple FRU Callout Instructions ..........................29
AIX Location Codes ...............................30
AIX and Physical Location Code Reference Tables ...................31
Cabling the CEC Drawer, Primary I/O Drawer, and Secondary I/O Drawer(s)...........46
Connecting JTAG and V/S COMM Cables ......................46
Connecting RIO and SPCN Cables .........................46
System Cable Diagrams ..............................55
CEC Drawer Cable ...............................55
Primary I/O Drawer Cable ............................56
Secondary I/O Drawer Cable ...........................57
DC Power Cable Routings ............................58
Specifications ..................................59
CEC Drawer .................................59
Noise Emission Notes ..............................63
Power Cables ..................................64
Service Inspection Guide..............................65
Chapter 2. Diagnostics Overview ..........................67
Maintenance Analysis Procedures (MAPs) .......................67
Checkpoints ..................................68
FRU Isolation ..................................69
Electronic Service Agent for the Eserver pSeries and RS/6000 ...............69
Using the Service Processor and Electronic Service Agent Features ..............69
Service Processor ...............................69
Electronic Service Agent .............................70
Chapter 3. Maintenance Analysis Procedures (MAPs) ..................71
Entry MAP ...................................71
Quick Entry MAP ................................72
Quick Entry MAP Table of Contents .........................72
MAP 1020: Problem Determination ..........................78
MAP 1520: Power ................................83
Map 1521: Cannot Power On the Primary I/O Drawer, Operator Panel Does Not Show OK Prompt 85
Map 1522: Cannot Power On the CEC Drawer .....................92
Map 1523: Cannot Power On the Secondary I/O Drawer, Operator Panel Power Present LED Does
Not Come On .................................98
Map 1524: The SPCN Error Codes Table Directed You Here and the Error Code is 1011 1C0x ... 106
MAP 1540: Minimum Configuration .........................110
Chapter 4. Checkpoints ............................. 135
IPL Flow ................................... 135
Service Processor Checkpoints ........................... 138
Firmware Checkpoints .............................. 144
Boot Problems and Concerns ........................... 155
Step 1................................... 155
Step 2................................... 155
Step 3................................... 156
Step 4................................... 156
Step 5................................... 157
Chapter 5. Error Code to FRU Index ........................ 159
Four-Character Checkpoints ............................ 159
Replacing the Primary Drawer Operator Panel ..................... 159
iv Service Guide

Replacing the Network Adapter ........................... 159
Analyzing SPCN Errors on Secondary Drawers ..................... 160
Isolating the I/O Drawer Failure ........................... 160
Determining Location Code ............................ 160
Checkpoint and Error Code Index .......................... 161
Performing Slow Boot .............................. 162
Confirming Initial Error Code ............................ 162
Memory-Related Error Codes ........................... 163
Operator Panel Error Codes ............................ 164
SPCN Error Codes ............................... 165
Firmware/POST Error Codes ............................ 194
Service Processor Error Codes ........................... 209
System Firmware Update Messages ......................... 337
Common Firmware Error Codes .......................... 338
Scan Log Dump Progress Codes .......................... 346
Problem Determination-Generated Error Codes ..................... 347
Chapter 6. Loading the System Diagnostics In Service Mode .............. 349
Default Boot List and Service Mode Bootlist ...................... 350
Chapter 7. Using the Capacity Upgrade on Demand Feature ............... 351
System Processors ............................... 351
Process Flow for Capacity Upgrade on Demand..................... 352
Installing aSystem with Capacity Upgrade on Demand .................. 353
Verifying System Communication Capabilities..................... 353
Configuring the Capacity Upgrade on Demand Feature ................. 353
Enabling the Capacity Upgrade on Demand Feature .................. 354
Enabling Additional Capacity Upgrade on Demand Processors ............... 356
Determining Processor Configuration ........................ 356
Adding Processor Capacity ........................... 357
Chapter 8. Using the Service Processor ....................... 359
Service Processor Menus ............................. 360
Accessing the Service Processor Menus Locally ................... 360
Accessing the Service Processor Menus Remotely................... 360
Saving and Restoring Service Processor Settings ................... 360
Menu Inactivity ................................ 360
General User Menu ............................... 361
Privileged User Menus .............................. 361
Main Menu ................................. 362
Service Processor Setup Menu .......................... 364
Passwords ................................. 365
System Power Control Menu ........................... 368
System Information Menu ............................ 372
Memory Riser Card 1Memory DIMM Locations for Service Processor Menus ......... 376
Memory Riser Card 2Memory DIMM Locations for Service Processor Menus ......... 377
Language Selection Menu ............................ 379
Call-In/Call-Out Setup Menu ........................... 380
Modem Configuration Menu ........................... 381
Serial Port Selection Menu ........................... 382
Serial Port Speed Setup Menu .......................... 382
Telephone Number Setup Menu.......................... 383
Call-Out Policy Setup Menu ........................... 384
Customer Account Setup Menu .......................... 385
Service Processor Procedures in Service Mode ..................... 385
Service Processor Functions ............................ 386
Contents v

System Power-On Methods ............................ 386
Service Processor Reboot/Restart Recovery ...................... 387
Boot (IPL) Speed ............................... 387
Failure During Boot Process ........................... 388
Failure During Normal System Operation ...................... 388
Service Processor Reboot/Restart Policy Controls ................... 388
System Firmware Updates............................. 390
General Information on System Firmware Updates ................... 390
Determining the Level of Firmware on the System ................... 390
System Firmware Update Using aLocally Available Image ................ 391
Updating System Firmware From the Service Processor Menus .............. 391
Updating System Firmware from the AIX Service Aids ................. 392
Updating System Firmware from the AIX Command Line ................ 392
Recovery Mode................................ 392
Configuring and Deconfiguring Processors or Memory .................. 392
Run-Time CPU Deconfiguration (CPU Gard) ..................... 393
Service Processor System Monitoring -Surveillance ................... 393
System Firmware Surveillance .......................... 393
Operating System Surveillance .......................... 393
Call-Out (Call-Home)............................... 394
Console Mirroring ................................ 395
System Configuration ............................. 395
Service Processor Error Log ............................ 396
LCD Progress Indicator Log ............................ 397
Service Processor Operational Phases ........................ 398
Pre-Standby Phase .............................. 398
Standby Phase ................................ 398
Bring-Up Phase ............................... 399
Run-Time Phase ............................... 400
Chapter 9. Using System Management Services ................... 401
402
Password Utilities ............................... 402
Display Error Log ............................... 403
Remote Initial Program Load Setup ........................ 403
SCSI Utilities................................. 407
Select Console ................................ 407
MultiBoot .................................. 408
Select Language ...............................411
OK Prompt .................................411
Exiting System Management Services .......................411
Chapter 10. Removal and Replacement Procedures .................. 413
Handling Static-Sensitive Devices .......................... 414
Powering Off and Powering On the System ...................... 415
Powering Off the System ............................ 415
Powering On the System ............................ 415
Powering Off and Powering On the System Using the Service Processor .......... 415
Hot-Pluggable FRUs ............................... 416
I/O Drawer PCI Slot LED Definitions ......................... 416
PCI Adapters ................................. 417
Non-Hot-Pluggable PCI Adapter........................... 417
Removal .................................. 417
Replacement................................. 418
Hot-Pluggable PCI Adapter ............................ 419
Removing aHot-Pluggable PCI Adapter....................... 419
Replacing aHot-Pluggable PCI Adapter....................... 420
vi Service Guide

Installing aHot-Pluggable PCI Adapter ....................... 422
PCI Hot-Plug Manager Access ........................... 423
Accessing Hot-Plug Management Functions ..................... 423
PCI Hot-Plug Manager Menu........................... 424
Memory Riser Cards and Memory Modules ...................... 426
Removal .................................. 426
Replacement................................. 426
CEC Regulator Card ............................... 429
Removal .................................. 429
Replacement................................. 429
Processor Card................................. 430
Removal .................................. 430
Replacement................................. 432
CEC Fans................................... 434
Removal .................................. 434
Replacement................................. 435
CEC Power Supplies............................... 436
Removal .................................. 436
Replacement................................. 436
CEC RIO Bus Adapter .............................. 437
Removal .................................. 437
Replacement................................. 439
CEC Backplane ................................ 440
Removal .................................. 440
Replacement................................. 442
I/O Drawer Backplane Assembly .......................... 442
Removal .................................. 442
Replacement................................. 444
I/O Drawer RIO Bus Adapter ............................ 445
Removal .................................. 445
Replacement................................. 446
I/O Drawer Power Distribution Board ......................... 447
Removal .................................. 447
Replacement................................. 448
I/O Drawer Power Supplies and Power Supply Fan Assemblies ............... 448
Removal .................................. 450
Replacement................................. 451
Power Supply Test Switch Procedure......................... 452
Internal Disk Drives ............................... 453
Removal .................................. 453
Replacement................................. 454
Fan Controller Card ............................... 456
Removal .................................. 456
Replacement................................. 456
CD-ROM Drive ................................. 457
Removal .................................. 457
Replacement................................. 458
Tape Drive .................................. 459
Removal .................................. 459
Replacement................................. 459
Diskette Drive ................................. 460
Removal .................................. 460
Replacement................................. 460
Operator Panel ................................. 461
Removal .................................. 461
Replacement................................. 462
Contents vii

Rear Service Position .............................. 463
Front Service Position .............................. 464
Battery .................................... 465
Removal .................................. 465
Replacement................................. 466
Chapter 11. Parts Information ........................... 467
CEC Drawer Card Assembly ............................ 468
CEC Drawer Backplane.............................. 470
CEC Drawer Power Supplies............................ 472
CEC Drawer Fan Assemblies ........................... 474
I/O Drawer .................................. 476
CEC Drawer Internal Cables ........................... 479
Primary I/O Drawer Cables ........................... 481
Secondary I/O Drawer Cables .......................... 483
External Cables ................................ 485
CEC Drawer to PDU Line Cords ......................... 486
Keyboards and Mouse ............................. 486
Keyboards and Mouse (Black) .......................... 488
Appendix A. Environmental Notices ........................ 491
Product Recycling and Disposal........................... 491
Environmental Design .............................. 495
Acoustical Noise Emissions ............................ 496
Declared Acoustical Noise Emissions......................... 496
Noise Emission Notes ............................. 496
Appendix B. Notices .............................. 497
Product Recycling and Disposal........................... 497
Battery Return Program.............................. 498
Appendix C. Service Processor Setup and Test .................... 499
Service Processor Setup Checklist.......................... 499
Testing the Setup ................................ 500
Testing Call-In ................................ 500
Testing Call-Out ............................... 500
Serial Port Configuration ............................ 500
Appendix D. Using the chcod Command ...................... 503
Description .................................. 503
Flags .................................... 503
Appendix E. Verifying Capacity Upgrade on Demand Processors ............. 505
Determining Current Configuration .......................... 505
Recovery Procedures .............................. 505
Capacity Upgrade on Demand Diagnostics ...................... 505
Testing the System in the Capacity Upgrade on Demand Environment ........... 506
Appendix F. Modem Configurations ........................ 509
Sample Modem Configuration Files ......................... 509
Generic Modem Configuration Files ........................ 509
Specific Modem Configuration Files ........................ 509
Configuration File Selection ............................ 510
Examples for Using the Generic Sample Modem Configuration Files ............511
Customizing the Modem Configuration Files ..................... 512
IBM 7852-400 DIP Switch Settings ........................ 513
viii Service Guide

Xon/Xoff Modems ............................... 513
Ring Detection ................................ 514
Terminal Emulators .............................. 514
Recovery Procedures ............................. 514
Transfer of aModem Session ........................... 515
Recovery Strategy............................... 516
Prevention Strategy .............................. 516
Modem Configuration Sample Files ......................... 517
Sample File modem_m0.cfg ........................... 517
Sample File modem_m1.cfg ........................... 520
Sample File modem_z.cfg ............................ 522
Sample File modem_z0.cfg ........................... 525
Sample File modem_f.cfg ............................ 528
Sample File modem_f0.cfg ........................... 530
Sample File modem_f1.cfg ........................... 532
Appendix G. Rack Drawer Rail Instructions ..................... 535
Front Drawer-Stop Installation ........................... 535
Drawer Rail Assembly and Installation ........................ 536
Rails for an S00 Type Rack ............................ 536
Rails for aT00 Type Rack ............................. 536
Rail Installation ................................. 536
Cable Routing ................................. 537
Index .................................... 541
Contents ix

xService Guide

Safety Notices
Adanger notice indicates the presence of ahazard that has the potential of causing death or serious
personal injury. Danger notices appear on the following pages:
vxii
v83
v413
v450
Acaution notice indicates the presence of ahazard that has the potential of causing moderate or minor
personal injury. Caution notices appear on the following pages:
vxii
vxiii
v83
v413
v457
v465
Note: For atranslation of these notices, see the System Unit Safety Information manual, SA23-2652.
Rack Safety Instructions
vDo not install this unit in arack where the internal rack ambient temperatures will exceed 40 degrees C.
vDo not install this unit in arack where the air flow is compromised. Any side, front or back of the unit
used for air flow through the unit must not be in indirect contact with the rack.
vEnsure that ahazardous condition is not created due to uneven mechanical loading when installing this
unit in arack. If the rack has astabilizer it must be firmly attached before installing or removed this unit.
vConsider the connection of the equipment to the supply circuit so that the overloaded circuits do not
compromise the supply wiring or overcurrent protection.
vAn electrical outlet that is not correctly wired could place hazardous voltage on the metal parts of the
system or the devices that attach to the system. It is the responsibility of the customer to ensure that
the outlet is correctly wired and grounded to prevent an electrical shock.
xi

Electrical Safety
Observe the following safety instructions any time you are connecting or disconnecting devices attached to
the workstation.
DANGER
An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of
the system or the devices that attach to the system. It is the responsibility of the customer to
ensure that the outlet is correctly wired and grounded to prevent an electrical shock.
Before installing or removing signal cables, ensure that the power cables for the system unit
and all attached devices are unplugged.
When adding or removing any additional devices to or from the system, ensure that the power
cables for those devices are unplugged before the signal cables are connected. If possible,
disconnect all power cables from the existing system before you add adevice.
Use one hand, when possible, to connect or disconnect signal cables to prevent apossible
shock from touching two surfaces with different electrical potentials.
During an electrical storm, do not connect cables for display stations, printers, telephones, or
station protectors for communications lines.
D05
CAUTION:
This product is equipped with athree-wire power cable and plug for the user’s safety. Use this
power cable with aproperly grounded electrical outlet to avoid electrical shock.
C01
DANGER
To prevent electrical shock hazard, disconnect all power cables from the electrical outlet before
relocating the system.
D01
CAUTION:
This unit has more than one power supply cord. To reduce the risk of electrical shock, disconnect
two power supply cords before servicing.
C21
xii Service Guide

Laser Safety Information
CAUTION:
Energy hazard, remove power before servicing. Disconnect two power supply cords.
C23
Laser Compliance
All lasers are certified in the U.S. to conform to the requirements of DHHS 21 CFR Subchapter Jfor class
1laser products. Outside the U.S., they are certified to be in compliance with the IEC 825 (first edition
1984) as aclass 1laser product. Consult the label on each part for laser certification numbers and
approval information.
CAUTION:
All IBM laser modules are designed so that there is never any human access to laser radiation
above aclass 1level during normal operation, user maintenance, or prescribed service conditions.
Data processing environments can contain equipment transmitting on system links with laser
modules that operate at greater than class 1power levels. For this reason, never look into the end
of an optical fiber cable or open receptacle. Only trained service personnel should perform the
inspection or repair of optical fiber cable assemblies and receptacles.
C25, C26
Preface xiii

xiv Service Guide

Data Integrity and Verification
IBM computer systems contain mechanisms designed to reduce the possibility of undetected data corruption
or loss. This risk, however, cannot be eliminated. Users who experience unplanned outages, system failures,
power fluctuations or outages, or component failures must verify the accuracy of operations performed and
data saved or transmitted by the system at or near the time of the outage or failure. In addition, users must
establish procedures to ensure that there is independent data verification before relying on such data in
sensitive or critical operations. Users should periodically check the IBM support websites for updated
information and fixes applicable to the system and related software.
xv

xvi Service Guide

About This Book
This book provides maintenance information that is specific to the RS/6000 Enterprise Server Model M80
and Eserver pSeries 660 Model 6M1, as well as to adapters and attached devices that do not have their
own service information. In this book, the RS/6000 Enterprise Server Model M80 and Eserver pSeries
660 Model 6M1 are hereafter referred to as the ″system″or the ″server.″
This book contains maintenance analysis procedures (MAPs) that are not common to other systems.
MAPs that are common to all systems are contained in the RS/6000 and Eserver pSeries Diagnostic
Information for Multiple Bus Systems.
This book is used by the service technician to repair system failures. This book assumes that the service
technician has had training on the system unit.
ISO 9000
ISO 9000 registered quality systems were used in the development and manufacturing of this product.
Online Publications
RS/6000 and pSeries publications are available online. To access the online books, visit our Web site at:
http://www.rs6000.ibm.com/resource/hardware_docs/
Related Publications
The following publications provide additional information about your system unit:
vThe System Unit Safety Information,order number SA23-2652, contains translations of safety
information used throughout this book.
vThe RS/6000 Enterprise Server Model M80, Eserver pSeries 660 Model 6M1 User’s Guide,order
number SA38-0565, contains information on how to use the system, use diagnostics, use service aids,
and verify system operations.
vThe 7014 Series Model T00 and T42 Rack Installation and Service Guide,order number SA38-0577,
contains information regarding the 7014 Series Model T00 Rack, in which the Enterprise Server Model
M80 and Eserver pSeries 660 Model 6M1 may be installed.
vThe RS/6000 and Eserver pSeries Diagnostic Information for Multiple Bus Systems,order number
SA38-0509, contains common diagnostic procedures, error codes, service request numbers, and failing
function codes. This manual is intended for trained service technicians.
vThe RS/6000 and Eserver pSeries Adapters, Devices, and Cable Information for Multiple Bus
Systems,order number SA38-0516 contains information about adapters, devices, and cables for your
system. This manual is intended to supplement information found in the RS/6000 and Eserver pSeries
Diagnostic Information for Multiple Bus Systems.
vThe PCI Adapter Placement Reference,order number SA38-0538, contains information regarding slot
restrictions for adapters that can be used in this system.
vThe Site and Hardware Planning Information,order number SA38-0508, contains information to help
you plan your installation.
Trademarks
The following terms are trademarks of International Business Machines Corporation in the United States,
other countries, or both:
vAIX
ve(logo)
vpSeries
xvii

vRS/6000
Other company, product, and service names may be trademarks or service marks of others.
xviii Service Guide

Chapter 1. Reference Information
This chapter provides an overview of the system, including alogical description and aphysical overview.
Additional details pertaining to the system are also provided, as follows:
vMemory overview and placement
vGeneral description of the operator panel
vCabling rules
vSystem location rules and descriptions
vPowering on and off the system
vPower flow
vData flow
Overview
The RS/6000 Enterprise Server Model M80 and Eserver pSeries 660 Model 6M1 systems are
multiprocessor, multibus systems packaged in two to five drawers. The processors and memory are
packaged in an 8EIA-unit central electronics complex (CEC) drawer, and the optional DASD and I/O
devices are in 5EIA-unit I/O drawers. The basic system consists of one CEC drawer and one I/O drawer
in the same rack. You can expand the system by adding up to three additional I/O drawers in aminimum
of two racks.
Anumber of cables connect the CEC and I/O drawers. These cables include:
vSPCN (System Power Control Network) cables
vV/S COMM cables
vRIO (Remote Input Output) cables
vJTAG cable
An ac power cord (dc power cord in adc-powered system) is connected to the CEC drawer (drawer 1),
primary I/O drawer (drawer 0), and secondary I/O drawer (drawer 2). You can also connect two additional
secondary drawers (drawers 3and 4) in another rack with aseparate power distribution unit and ac power
cord (dc power cord in adc-powered system). Adc-powered system has no power distribution unit.
1

Processors
The CEC drawer is powered independently from the I/O drawer and supports two processor cards.
Model M80:
vCan have any combination of 2-way or 4-way processor cards running at 500 MHz
vAll 500 MHz processors can have their own 4MB L2 cache
Model 6M1:
vCan be ordered with 500 MHz processors or 750 MHz processors
vSystems with 500 MHz processors can have one or two 2-way processor cards
vSystems with 750 MHz processors can have any combination of 2-way and 4-way processor cards
vAll 500 MHz processors can have their own 4MB L2 cache
vAll 750 MHz processors can have their own 8MB L2 cache
The Capacity Upgrade on Demand feature is available for this system when aminimum of four processors
running at 750 MHz are installed. The Capacity Upgrade on Demand feature is not available on systems in
which 500 MHz processors are installed. For more information about Capacity Upgrade on Demand, see
Chapter 7, “Using the Capacity Upgrade on Demand Feature,” on page 351.
Note: In order for the system to boot, the first processor card slot must be populated.
Memory
vModel M80: 1GB (minimum) to 32 GB (maximum)
vModel 6M1: 1GB (minimum) to 64 GB (maximum)
vOne or two memory riser cards; each riser card has thirty-two sockets. 128 MB, 256 MB, 512 MB, and
1GB dual inline memory modules (DIMMs) are available.
vCertain 32 MB DIMMs from older RS/6000 systems can also be used when upgrading the system
memory.
2Service Guide