IBM eserver pSeries 690 User manual

pSeries 690
Service Guide
SA38-0589-05
ERserver
򔻐򗗠򙳰

pSeries 690
Service Guide
SA38-0589-05
ER s e r v e r
򔻐򗗠򙳰

Sixth Edition (February 2004)
Before using this information and the product it supports, read the information in “Safety Notices” on page vii,
Appendix A, “Environmental Notices,” on page 1067, and Appendix B, “Notices,” on page 1073.
A reader’s comment form is provided at the back of this publication. If the form has been removed, address
comments to Information Development, Department H6DS-905-6C006, 11501 Burnet Road, Austin, Texas
78758-3493. To send comments electronically, use this commercial internet address: [email protected]. Any
information that you supply may be used without incurring any obligation to you.
© Copyright International Business Machines Corporation, 2001, 2004. All rights reserved.
Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is
subject to restrictions set forth is GSA ADP Schedule Contract with IBM Corp.

Contents
Safety Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Rack Safety Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Electrical Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Laser Safety Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .ix
Data Integrity and Verification . . . . . . . . . . . . . . . . . . . . . . . . . . .xi
About This Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
ISO 9000 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Highlighting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Accessing Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Related Publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Chapter 1. Reference Information . . . . . . . . . . . . . . . . . . . . . . . . . .1
pSeries 690 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Hardware Management Console (HMC) . . . . . . . . . . . . . . . . . . . . . . . . .3
Capacity Upgrade on Demand . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
Powering the System On and Off . . . . . . . . . . . . . . . . . . . . . . . . . .13
pSeries 690 Data Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Power-On Self-Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
POST Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
POST Keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
pSeries 690 System Locations . . . . . . . . . . . . . . . . . . . . . . . . . . .16
7040 Model 61D I/O Subsystem Locations . . . . . . . . . . . . . . . . . . . . . . .27
Power Subsystem Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Power Distribution Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
I/O Subsystem Power Distribution Cabling . . . . . . . . . . . . . . . . . . . . . . .36
Integrated Battery Feature Locations . . . . . . . . . . . . . . . . . . . . . . . . .38
Subsystem Positioning and Cabling . . . . . . . . . . . . . . . . . . . . . . . . . .39
System Memory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63
I/O Subsystem Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65
Logical and Physical Locations . . . . . . . . . . . . . . . . . . . . . . . . . . .67
Physical Location Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .67
AIX Location Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69
Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
Service Inspection Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
Preventive Maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 145
Chapter 2. Diagnostics Overview . . . . . . . . . . . . . . . . . . . . . . . . . 147
Maintenance Analysis Procedures (MAPs) . . . . . . . . . . . . . . . . . . . . . . . 147
Checkpoints . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147
FRU Isolation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
FRU Identify LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Service Agent for the Eserver pSeries 690 . . . . . . . . . . . . . . . . . . . . . . 150
Using the Service Processor and Service Agent Features . . . . . . . . . . . . . . . . . 150
Running Diagnostics on the Native Serial Port on a Full Machine Partition with an HMC Attached 150
Chapter 3. Maintenance Analysis Procedures (MAPs) . . . . . . . . . . . . . . . . . 151
Entry MAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
Quick Entry MAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
MAP 1020: Problem Determination . . . . . . . . . . . . . . . . . . . . . . . . . 160
MAP 1230: Linux Platform Error Problem Resolution . . . . . . . . . . . . . . . . . . . 165
iii

MAP 1235: System Array Self-Repair Problem Resolution for Linux . . . . . . . . . . . . . 170
MAP 1320: Service Focal Point . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
MAP 1321: Quick Entry MAP for Systems with Service Focal Point . . . . . . . . . . . . . . 172
MAP 1322: End of Call MAP for Systems with Service Focal Point . . . . . . . . . . . . . . 185
MAP 1420: Recovery Procedures for Hot-Pluggable PCI Adapters . . . . . . . . . . . . . . 190
MAP 1520: Power . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194
MAP 1521: The System Will Not Power On And No Error Codes Are Available . . . . . . . . . 198
MAP 1522: UEPO Switch On The BPC Is In The Bypass Position . . . . . . . . . . . . . . 201
MAP 1523: There Is a Bulk Power Regulator (BPR) Communications Fault . . . . . . . . . . . 202
MAP 1524: An Open Room EPO Switch Has Been Detected From One Side . . . . . . . . . . 203
MAP 1525: There Is a 350 Volt Bulk Failure . . . . . . . . . . . . . . . . . . . . . . 205
MAP 1526: There Is An Integrated Battery Feature (IBF) Failure . . . . . . . . . . . . . . . 208
MAP 1527: An Airflow Loss Has Been Detected . . . . . . . . . . . . . . . . . . . . .211
MAP 1528: There Is A Processor (Critical/Warning) Overtemperature Fault . . . . . . . . . . . 213
MAP 1529: There Is A Bulk Power Assembly (BPA) Communication Failure . . . . . . . . . . 214
MAP 152a: Loss of ac Power or Phase Missing . . . . . . . . . . . . . . . . . . . . . 216
MAP 152b: 2.5 V Current/Voltage Problem in Processor Subsystem . . . . . . . . . . . . . 218
MAP 152c: 1.8 V Current/Voltage Problem in Processor Subsystem . . . . . . . . . . . . . 225
MAP 152d: 1.5 V Auxiliary Current/Voltage Problem in Processor Subsystem . . . . . . . . . . 233
MAP 152e: 1.5 V CPU Current/Voltage Problem in Processor Subsystem . . . . . . . . . . . 242
MAP 152f: 3.3 V Current/Voltage Problem in Processor Subsystem . . . . . . . . . . . . . 247
MAP 152g: 5.0 V Current/Voltage Problem in Processor Subsystem . . . . . . . . . . . . . 255
MAP 152h: 3.3V Current/Voltage Problem in I/O Subsystem . . . . . . . . . . . . . . . . 261
MAP 152i: 5.0 V Current/Voltage Problem in I/O Subsystem . . . . . . . . . . . . . . . . 269
MAP 152j: 2.5 V Current/Voltage Problem in I/O Subsystem . . . . . . . . . . . . . . . . 278
MAP 152k: 12.0 V Current/Voltage Problem in I/O Subsystem . . . . . . . . . . . . . . . 286
MAP 152l: -12.0V Current/Voltage Problem in I/O Subsystem . . . . . . . . . . . . . . . . 295
MAP 152m: Cable Problem in Power Subsystem . . . . . . . . . . . . . . . . . . . . 302
MAP 152n: DASD Subsystem Power Problem . . . . . . . . . . . . . . . . . . . . . 306
MAP 1540: Problem Isolation Procedures . . . . . . . . . . . . . . . . . . . . . . . 310
MAP 1541: JTAG Problem Isolation . . . . . . . . . . . . . . . . . . . . . . . . . 312
MAP 1542: I/O Problem Isolation . . . . . . . . . . . . . . . . . . . . . . . . . . 320
MAP 1543: MCM Module Problem Isolation . . . . . . . . . . . . . . . . . . . . . . 339
MAP 1544: Inner L3 Module Problem Isolation . . . . . . . . . . . . . . . . . . . . . 342
MAP 1545: Outer L3 Module Problem Isolation . . . . . . . . . . . . . . . . . . . . . 344
MAP 1546: Memory Book Problem Isolation . . . . . . . . . . . . . . . . . . . . . . 347
MAP 1547: I/O Book Problem Isolation . . . . . . . . . . . . . . . . . . . . . . . . 350
MAP 1548: Memory and Processor Problem Isolation . . . . . . . . . . . . . . . . . . . 352
MAP 1549: Attention Problem Isolation . . . . . . . . . . . . . . . . . . . . . . . . 355
MAP 154A: I2C Bus Problem Isolation . . . . . . . . . . . . . . . . . . . . . . . . 363
MAP 154B: Insufficient Hardware Resources Problem Isolation . . . . . . . . . . . . . . . 368
Chapter 4. Checkpoints . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371
IPL Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371
Service Processor Checkpoints . . . . . . . . . . . . . . . . . . . . . . . . . . . 374
Firmware Checkpoints . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 381
Chapter 5. Error Code to FRU Index . . . . . . . . . . . . . . . . . . . . . . . . 415
Performing Slow Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 415
Confirming Initial Error Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416
Four-Character Checkpoints . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
Replacing the Media Subsystem Operator Panel . . . . . . . . . . . . . . . . . . . . 417
Replacing the Network Adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
Determining Location Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
Checkpoints and Error Codes Index . . . . . . . . . . . . . . . . . . . . . . . . . 418
Operator Panel Error Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . 421
iv Eserver pSeries 690 Service Guide

SPCN Error Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422
Firmware/POST Error Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . 490
Service Processor Error Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . 518
System Firmware Update Messages . . . . . . . . . . . . . . . . . . . . . . . . . 749
Capacity Upgrade on Demand (CUoD) Messages . . . . . . . . . . . . . . . . . . . . 749
Scan Dump Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 749
Common Firmware Error Codes . . . . . . . . . . . . . . . . . . . . . . . . . . 750
Problem Determination-Generated Error Codes . . . . . . . . . . . . . . . . . . . . . 770
Hypervisor Dump Retrieval Procedure . . . . . . . . . . . . . . . . . . . . . . . . 771
Chapter 6. Using the Online and Standalone Diagnostics . . . . . . . . . . . . . . . . 773
Operating Considerations for Online and Standalone Diagnostics . . . . . . . . . . . . . . 773
Online Diagnostics Modes of Operation . . . . . . . . . . . . . . . . . . . . . . . . 774
Standalone Diagnostic Operation . . . . . . . . . . . . . . . . . . . . . . . . . . 778
Chapter 7. Using the Service Processor . . . . . . . . . . . . . . . . . . . . . . . 783
Service Processor Menus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 783
General User Menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 785
Privileged User Menus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 786
Service Processor Parameters in Service Mode (Full System Partition) . . . . . . . . . . . . 815
System Power-On Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . 816
Service Processor Reboot/Restart Recovery . . . . . . . . . . . . . . . . . . . . . . 817
System Firmware Updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 819
Frame (Power Subsystem) Firmware Update with a pSeries High Performance Switch Installed . . . 825
Installing Corrective Service on the Frame . . . . . . . . . . . . . . . . . . . . . . . 826
Reconfiguration Procedure for SNI Adapters . . . . . . . . . . . . . . . . . . . . . . 827
Configuring and Deconfiguring Processors or Memory . . . . . . . . . . . . . . . . . . 828
Service Processor System Monitoring - Surveillance . . . . . . . . . . . . . . . . . . . 829
Call-Out (Call-Home) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 831
Console Mirroring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 832
Service Processor Error Logs . . . . . . . . . . . . . . . . . . . . . . . . . . . 833
LCD Progress Indicator Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . 834
Resetting the Service Processor . . . . . . . . . . . . . . . . . . . . . . . . . . 835
Service Processor Operational Phases . . . . . . . . . . . . . . . . . . . . . . . . 836
Chapter 8. Using System Management Services . . . . . . . . . . . . . . . . . . . 839
Select Language . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 840
Change Password Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . 841
View Error Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 841
Setup Remote IPL (Initial Program Load) . . . . . . . . . . . . . . . . . . . . . . . 842
Change SCSI Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 844
Select Console . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 844
Select Boot Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 845
Select Boot Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 847
Display Current Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 849
Restore Default Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 850
Multiboot Startup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 850
Exiting System Management Services . . . . . . . . . . . . . . . . . . . . . . . . 850
Chapter 9. Removal and Replacement Procedures . . . . . . . . . . . . . . . . . . . 851
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 853
Powering Off and Powering On the System . . . . . . . . . . . . . . . . . . . . . . 854
Hot-Pluggable FRUs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 858
Power Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 860
Processor Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 869
I/O Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 929
Contents v

Media Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1017
Chapter 10. Parts Information . . . . . . . . . . . . . . . . . . . . . . . . . . 1027
7040 Model 61R Rack Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . 1028
7040 Model 681 Processor Subsystem (Front) . . . . . . . . . . . . . . . . . . . . . 1030
7040 Model 681 Processor Subsystem (Front) . . . . . . . . . . . . . . . . . . . . . 1032
7040 Model 681 Processor Subsystem (Rear) . . . . . . . . . . . . . . . . . . . . . 1036
7040 Model 681 Media Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . 1039
Power and SCSI Cables to the Media Subsystem . . . . . . . . . . . . . . . . . . . 1041
7040 Model 61D I/O Subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . 1043
Power Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1045
RIO Cables and I/O Power Cables . . . . . . . . . . . . . . . . . . . . . . . . . 1047
Keyboards and Mouse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1049
System Power Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1050
Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1051
Chapter 11. SRNs for Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . 1053
Appendix A. Environmental Notices . . . . . . . . . . . . . . . . . . . . . . . . 1067
Product Recycling and Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . 1067
Environmental Design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1071
Acoustical Noise Emissions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1072
Appendix B. Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1073
Appendix C. Service Processor Setup and Test . . . . . . . . . . . . . . . . . . . 1075
Service Processor Setup Checklist . . . . . . . . . . . . . . . . . . . . . . . . . 1075
Testing the Service Processor Setup . . . . . . . . . . . . . . . . . . . . . . . . 1076
Appendix D. Modem Configurations . . . . . . . . . . . . . . . . . . . . . . . . 1079
Sample Modem Configuration Files . . . . . . . . . . . . . . . . . . . . . . . . . 1079
Configuration File Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1080
Transfer of a Modem Session . . . . . . . . . . . . . . . . . . . . . . . . . . . 1084
Modem Configuration Sample Files . . . . . . . . . . . . . . . . . . . . . . . . . 1086
Appendix E. Ground Path . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1107
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1109
vi Eserver pSeries 690 Service Guide

Safety Notices
A danger notice indicates the presence of a hazard that has the potential of causing death or serious
personal injury. Danger notices appear on the following pages:
v viii
v 194
v 853
v 877
v 1006
A caution notice indicates the presence of a hazard that has the potential of causing moderate or minor
personal injury. Caution notices appear on the following pages:
v viii
v ix
v 136
v 194
v 853
v 875
v 924
v 1017
v 951
v 962
For a translation of the safety notices contained in this book, see the System Unit Safety Information,
order number SA23-2652.
Rack Safety Instructions
v Do not install this unit in a rack where the internal rack ambient temperatures will exceed 35 degrees C.
v Do not install this unit in a rack where the airflow is compromised. Any side, front or back of the unit
used for air flow through the unit must not be in direct contact with the rack.
v Care should be taken to ensure that a hazardous condition is not created due to uneven mechanical
loading when installing this unit in a rack. If the rack has a stabilizer it must be firmly attached before
installing or removing this unit.
v Consideration should be given to the connection of the equipment to the supply circuit so that
overloading of circuits does not compromise the supply wiring or overcurrent protection. To provide the
correct power connection to the rack, refer to the rating labels located on the equipment in the rack to
determine the total power requirement for the supply circuit.
v An electrical outlet that is not correctly wired could place hazardous voltage on the metal parts of the
system or the devices that attach to the system. It is the responsibility of the customer to ensure that
the outlet is correctly wired and grounded to prevent an electrical shock.
Electrical Safety
Observe the following safety instructions any time you are connecting or disconnecting devices attached to
the system.
vii

DANGER
An
electrical outlet that is not correctly wired could place hazardous voltage on metal parts of
the system or the devices that attach to the system. It is the responsibility of the customer to
ensure that the outlet is correctly wired and grounded to prevent an electrical shock.
Use one hand, when possible, to connect or disconnect signal cables to prevent a possible
shock from touching two surfaces with different electrical potentials.
During an electrical storm, do not connect cables for display stations, printers, telephones, or
station protectors for communications lines.
D06
CAUTION:
This product is equipped with a four-wire (three-phase and ground) power cable for the user’s
safety. Use this power cable with a properly grounded electrical outlet to avoid electrical shock.
C27
DANGER
To
prevent electrical shock hazard, disconnect all power cables from the electrical outlet before
relocating the system.
D01
CAUTION:
This unit has more than one power supply cord. Follow procedures for removal of power from the
system when directed.
C28
CAUTION:
Energy hazard, remove power before servicing.
C22
CAUTION:
Energy hazard, remove all jewelry before servicing.
C29
viii Eserver pSeries 690 Service Guide

Laser Safety Information
CAUTION:
This product may contain a CD-ROM, DVD-ROM, or laser module on a PCI card, which are class 1
laser products.
C30
Laser Compliance
All lasers are certified in the U.S. to conform to the requirements of DHHS 21 CFR Subchapter J for class
1 laser products. Outside the U.S., they are certified to be in compliance with the IEC 825 (first edition
1984) as a class 1 laser product. Consult the label on each part for laser certification numbers and
approval information.
CAUTION:
All IBM laser modules are designed so that there is never any human access to laser radiation
above a class 1 level during normal operation, user maintenance, or prescribed service conditions.
Data processing environments can contain equipment transmitting on system links with laser
modules that operate at greater than class 1 power levels. For this reason, never look into the end
of an optical fiber cable or open receptacle. Only trained service personnel should perform the
inspection or repair of optical fiber cable assemblies and receptacles.
C25,
C26
Preface ix

x Eserver pSeries 690 Service Guide

Data Integrity and Verification
IBM computer systems contain mechanisms designed to reduce the possibility of undetected data corruption
or loss. This risk, however, cannot be eliminated. Users who experience unplanned outages, system failures,
power fluctuations or outages, or component failures must verify the accuracy of operations performed and
data saved or transmitted by the system at or near the time of the outage or failure. In addition, users must
establish procedures to ensure that there is independent data verification before relying on such data in
sensitive or critical operations. Users should periodically check the IBM support websites for updated
information and fixes applicable to the system and related software.
xi

xii Eserver pSeries 690 Service Guide

About This Book
This book provides maintenance information that is specific to the Eserver pSeries 690, adapters, and
attached devices that do not have their own service information. It also contains Maintenance Analysis
Procedures (MAPs) that are not common to other systems.
MAPs that are common to all systems are contained in the RS/6000 and Eserver pSeries Diagnostic
Information for Multiple Bus Systems.
This book is used by the service representative to repair system failures. This book assumes that the
service representative has had training on the system.
ISO 9000
ISO 9000 registered quality systems were used in the development and manufacturing of this product.
Highlighting
The following highlighting conventions are used in this book:
Bold Identifies commands, subroutines, keywords, files, structures, directories, and other items
whose names are predefined by the system. Also identifies graphical objects such as buttons,
labels, and icons that the user selects.
Italics Identifies parameters whose actual names or values are to be supplied by the user.
Monospace Identifies examples of specific data values, examples of text similar to what you might see
displayed, examples of portions of program code similar to what you might write as a
programmer, messages from the system, or information you should actually type.
Accessing Information
Documentation for the IBM Eserver pSeries is available online. Visit the IBM Eserver pSeries
Information Center at http://publib16.boulder.ibm.com/pseries/en_US/infocenter/base.
v To access the pSeries publications, click Hardware documentation.
v To view information about the accessibility features of Eserver pSeries hardware and the AIX operating
system, click AIX and pSeries accessibility.
xiii

Related Publications
The following publications are available:
v The System Unit Safety Information, order number SA23-2652, contains translations of safety
information used throughout this book.
v The IBM Hardware Management Console for pSeries Installation and Operations Guide, order number
SA38-0590, contains information on how to set up and cable the hardware management console and
verify system operation.
v The IBM Hardware Management Console for pSeries Maintenance Guide, order number SA38-0603,
contains MAPS, removal and replacement procedures, error codes, and parts information that help
trained service representatives diagnose and repair the hardware management console.
v The eServer Cluster 1600: pSeries High Performance Switch Planning, Installation, and Service Guide,
order number GA22-7951, contains information on installing and servicing the pSeries High
Performance Switch (machine type 7045-SW4), which is an option on this system.
v The Eserver pSeries 690 Installation Guide, order number SA38-0587, contains information on how to
set up and cable the system, install and remove options, and verify system operation.
v The Eserver pSeries 690 User’s Guide, order number SA38-0588, contains information on how to use
the system, use diagnostics, use service aids, and operations.
v The RS/6000 and Eserver pSeries Diagnostic Information for Multiple Bus Systems, order number
SA38-0509, contains common diagnostic procedures, error codes, service request numbers, and failing
function codes. This manual is intended for trained service technicians.
v The RS/6000 and Eserver pSeries Adapters, Devices, and Cable Information for Multiple Bus
Systems, order number SA38-0516, contains information about adapters, external devices, and cabling.
This manual is intended to supplement information found in the RS/6000 and Eserver pSeries
Diagnostic Information for Multiple Bus Systems.
v The PCI Adapter Placement Reference, order number SA38-0538, contains information regarding slot
restrictions for adapters that can be used in this system.
v The Site and Hardware Planning Information, order number SA38-0508, contains information to help
you plan your installation.
v The Electronic Service Agent For pSeries and RS/6000 User’s Guide, order number LCD4-1060,
contains information for use by the service representative to help set up and use the Service Director
package.
v The AIX Installation Guide and Reference, order number SC23-4389, describes how to install systems,
and to use a network server to do functions such as installing the operating system or diagnostics on
systems connected to the network.
Trademarks
The following terms are trademarks of International Business Machines Corporation in the United States,
other countries, or both:
v AIX
v Electronic Service Agent
v Eserver
v IBM
®
v LANstreamer
v pSeries
v RS/6000
Other
company, product, and service names may be trademarks or service marks of others.
xiv Eserver pSeries 690 Service Guide

Chapter 1. Reference Information
This chapter provides an overview of the Eserver pSeries 690, including a logical description and a
physical overview of the system. Additional details pertaining to the server are also provided. They include
the following:
v Memory overview and ordering rules
v General description of the operator panel
v Cabling rules
v System location rules and descriptions
v Powering on and powering off the system
v Power flow
v Data flow
pSeries 690 Overview
The pSeries 690 server is a multiprocessor, multibus system composed of the following subsystems:
v 7040 Model 61R, a 24-inch wide and 42-EIA-high rack unit that also contains the following:
– An 8-EIA unit power subsystem, consisting of two redundant bulk power assemblies that distribute
bulk power at 350 V to each of the subsystems.
– An optional 2 EIA-unit integrated battery feature (IBF), which is available in either a redundant or
non-redundant configuration.
v
7040 Model 681 Processor Subsystem, a 17 EIA-unit processor subsystem, which contains the
processors, L3 cache, memory, and service processor and a 1 EIA-unit media subsystem containing a
diskette drive, a CD-ROM, and an operator panel, with space for up to three additional optional media
devices.
There is an option to expand the number of RIO (in this case RIO-2) ports to 28. This allows up to eight
RIO-2 I/O subsystems, if cabled in RIO or some combination of RIO and RIO-2, each with 2
GB-per-second transfers on each planar. Processor speeds up to 1.5 GHz and 1.7 GHz are also
available. Additional memory cards that operate at the higher 567 MHz bus speed are available.
v 7040 Model 61D I/O Subsystem, 4 EIA-units, which can have up to 20 PCI adapters and up to 16
DASD disk drives.
This subsystem may also be purchased to allow 10 or 20 PCI-X adapters, for use with the RIO-2
cabling option. Additionally, there is an option that allows 1 GB RIO-2 on each remote I/O port. RIO-2
allows up to 2 GB I/O transfers when cabled as a single planar loop (four CEC RIO-2 ports per I/O
subsystem).
v A Hardware Management Console (HMC), which provides a standard user interface for configuring and
operating partitioned systems. One HMC can support multiple partitions on multiple systems.
1

The basic system consists of the redundant bulk power subsystem, one processor subsystem, a media
subsystem, and one I/O subsystem in the same rack, and one HMC, as shown in the following illustration:
1 Hardware Management Console 5, 6* 7040 Model 61R primary Integrated
Battery Feature (IBF), optional for the
primary power subsystem.
Redundant IBF, also optional, and installs
from the rear.
2 7040 Model 61R Bulk Power Subsystem 7 7040 Model 61D I/O Subsystem
3 7040 Model 681 Processor Subsystem 8 7040 Model 61D I/O Subsystem (Optional)
4 7040 Model 681 Media Subsystem 9 7040 Model 61D I/O Subsystem (Optional)
* 7040 Model 61D I/O Subsystem (Optional,
If features 5 and 6 are not installed)
You can expand the system by adding I/O subsystems for a total of eight in a minimum of two racks. The
preceding figure shows the single rack. Additional I/O drawers and integrated battery features are installed
in a second rack.
A number of cables connect the power, processor, and I/O subsystems. These cables include the
following:
v UPIC (Universal Power Interface Controller) cables
v RIO (Remote Input Output) cables
The
ac power cords are connected to the bulk power subsystem, which distributes the power throughout
the system.
Each I/O subsystem contains two I/O backplanes. Each backplane is capable of supporting the following:
v Up to 10 adapters each (20 per subsystem)
v Up to 8 disk drives (16 per subsystem) in two DASD 4-packs (4 per subsystem)
v One distributed converter assembly (DCA) (2 per subsystem)
v Two I/O subsystem fans (4 per subsystem)
On
each I/O backplane, PCI bus slots 1 through 7 are 3.3 V dc connectors running at 66 MHz, supporting
64-bit PCI adapters. Slots 8 through 10 are 64-bit 5 V dc slots, running at 33 MHz.
2 Eserver pSeries 690 Service Guide

The media subsystem provides space for up to three media devices (diskette drive, CD-ROM drive, and
optional tape drive or DVD-RAM) in the front and two additional optional devices in the rear.
Hardware Management Console (HMC)
The Hardware Management Console (HMC) supports your system with features that allow you to manage
configuration and operation of partitions in a system, as well as add and remove hardware without
interrupting system operation.
In this book, a system that is managed by the HMC is referred to as the managed system. The HMC uses
its serial connection to the managed system to perform various functions. The HMC’s main functions
include the following:
v Creating and maintaining a multiple partition environment
v Detecting, reporting, and storing changes in hardware conditions
v Acting as a service focal point for service representatives to determine an appropriate service strategy
Partitioning
the system is similar to partitioning a hard drive. When you partition a hard drive, you divide a
single hard drive so that the operating system recognizes it as a number of separate hard drives. The
same holds true for the HMC’s partitioning capabilities, except the HMC allows you to divide the system’s
processors, memory, and I/O. On each of these divisions, you can install an operating system and use
each partition as you would a separate physical machine. This division of system resources is called a
logical partition.
The objective of partitioning is to provide users with the capability to split a single system into several
independent systems, each capable of running applications in multiple, independent environments
simultaneously. For example, partitioning makes it possible for a user to run a single application using
different sets of data on separate partitions, as if it were running independently on separate physical
systems.
Service representatives use Service Focal Point (SFP), an application that runs on the HMC, to start and
end their service calls. SFP provides service representatives with the serviceable event, vital product data
(VPD), and diagnostic information.
The HMC is a closed system. Additional applications cannot be installed on the HMC. All the tasks needed
to maintain the platform, the underlying operating system, and the HMC application code are available by
using the HMC’s management applications.
Partition Standby and Full System Partition Power-On Options
Booting your system in partition standby is markedly different from booting your system in a traditional
single-machine full system partition. In partition standby, the system sets aside system memory for
partition management.
Partition Standby Memory Issues
Unique issues are associated with assigning memory to each partition created in partition standby. In
partition standby, the HMC allocates a portion of each assigned memory block to the system.
Each partition requires a minimum of 1 gigabyte (GB) of system memory. When you start creating
partitions, the system sets aside 256 megabytes (MB) of contiguous memory for its own use, and allocates
another 256 MB of contiguous memory for each 16 GB allocated.
Page Table Memory Usage: Partition page tables are additional memory required for a partition to
operate, and is in addition to the total logical memory size of a partition. The partition table is outside of a
partition’s accessible memory. The partition page table must be constructed with contiguous real system
memory segments. Use the following table to help you keep track of the system’s page-table memory
usage:
Chapter 1. Reference Information 3

Partition Memory Size
(256 MB increments)
Partition Page Table Size
(4 16-byte entries per 4 K
real page)
Partition Page Table
Alignment
Assigned Memory Segments
(256 MB)
1 GB 16 MB 16 MB 1
1 GB - 2 GB 32 MB 32 MB 1
2 GB - 3 GB 64 MB 64 MB 1
4 GB - 7 GB 128 MB 128 MB 1
8 GB - 15 GB 256 MB 256 MB 1
16 GB - 31 GB 512 MB 512 MB 2
32 GB - 63 GB 1 GB 1 GB 4
64 GB - 96 GB 2 GB 2 GB 8
In a full system partition, the operating system uses all of the installed memory; the system does not set
aside contiguous memory for its own use. Keep this in mind when you record the amount of memory used
when you are completing the planning worksheets in the IBM Hardware Management Console for pSeries
Installation and Operations Guide, order number SA38-0590.
Partition Requirements
To activate a partition, you need a minimum of the following:
v 1 GB of available system memory
v One available system processor
v One available network adapter (for error reporting)
If
you attempt to activate a partition and the resources that you specified are not available at that time,
activation fails. It is important to keep track of your system’s resources and your activation times to avoid
failures.
Service Focal Point
This chapter provides information about using the Service Focal Point application.
The Service Focal Point application is used to help the service representative diagnose and repair
problems on partitioned systems. Service representatives use the HMC as the starting point for all service
issues. The HMC groups various system management issues at one control point, allowing service
representatives to use the Service Focal Point application to determine an appropriate service strategy.
Traditional service strategies become more complicated in a partitioned environment. Each partition runs
on its own, unaware that other partitions exist on the same system. If one partition reports an error for a
shared resource, such as a managed system power supply, other active partitions report the same error.
The Service Focal Point application enables service representatives to avoid long lists of repetitive
call-home information by recognizing that these errors repeat, and by filtering them into one error code.
The following types of errors are reported to Service Focal Point:
v Permanent hardware errors (detected by the managed system or operating system)
v LAN surveillance errors detected by Service Focal Point
v Hardware boot failure errors
The
following errors are not reported to Service Focal Point:
v Software errors
v Temporary hardware errors
v Undetermined hardware errors
4 Eserver pSeries 690 Service Guide