Sun Microsystems Netra X4450 User manual

Submit comments about this document at: http://docs.sun.com/app/docs
Sun Netra™X4450 Server
Service Manual
Part No. 820-4017-10
August 2008, Revision A
Sun Microsystems, Inc.
www.sun.com

Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in
the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, Java, Netra, Solaris, the Netra logo, the Solaris logo and Sun are trademarks or registered trademarks of
Sun Microsystems, Inc. in the U.S. and other countries
All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other
countries. Products bearing SPARC trademarks are based upon architecture developed by Sun Microsystems, Inc.
Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S.
export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, Californie 95054, États-Unis. Tous droits réservés.
Des parties de ce produit peuvent dériver des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque déposée
aux États-Unis et dans d’autres pays, licenciée exclusivement par X/Open Company, Ltd.
Sun, Sun Microsystems, le logo Sun, Java, Netra, Solaris, le logo Netra, le logo Solaris et Sun sont des marques de fabrique ou des marques
déposées de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays.
Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc.
aux Etats-Unis et dans d’autres pays. Les produits portant les marques SPARC sont basés sur une architecture développée par Sun
Microsystems, Inc.
L’utilisation de pieces detachees ou d’unites centrales de remplacement est limitee aux reparations ou a l’echange standard d’unites centrales
pour les produits exportes, conformement a la legislation americaine en matiere d’exportation. Sauf autorisation par les autorites des Etats-
Unis, l’utilisation d’unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L’ÉTAT" ET TOUTES AUTRES CONDITIONS, DÉCLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES DANS LA LIMITE DE LA LOI APPLICABLE, Y COMPRIS NOTAMMENT TOUTE
GARANTIE IMPLICITE RELATIVE À LA QUALITÉ MARCHANDE, À L’APTITUDE À UNE UTILISATION PARTICULIÈRE OU À
L’ABSENCE DE CONTREFAÇON.

iii
Contents
Preface ix
1. Server Diagnostics 1–1
1.1 Fault on Initial Power Up 1–1
1.2 Server Diagnostics Overview 1–2
1.2.1 Memory Fault Handling 1–4
1.3 Using the Status Indicators to Identify the State of Devices 1–4
1.3.1 Hard Drive Indicators 1–8
1.3.2 Power Supply Indicators 1–9
1.3.3 Ethernet Port Indicators 1–10
1.4 Using the Service Processor Firmware for Diagnosis and Repair
Verification 1–11
1.5 Using the Solaris Predictive Self Healing Feature 1–12
1.5.1 Identifying PSH Detected Faults 1–13
▼Use the fmdump Command to Identify Faults 14
▼Clear PSH Detected Faults 15
1.6 Collecting Information From Solaris OS Files and Commands 1–15
▼Check the Message Buffer 16
▼View System Message Log Files 16
1.7 Additional Service Related Information 1–17

iv Sun Netra X4450 Server Service Manual • August 2008
2. Preparing for Service 2–1
2.1 Safety Information 2–1
2.1.1 Safety Symbols 2–2
2.1.2 Electrostatic Discharge Safety 2–2
2.1.2.1 Use an Antistatic Wrist Strap 2–2
2.1.2.2 Use an Antistatic Mat 2–2
2.2 Required Tools 2–3
2.3 Preparing for Component Replacement 2–3
▼Power Off the Server 3
▼Disconnect the Cables From the Server 4
▼Remove the Server From the Rack 4
▼Remove the Top Cover 5
▼Remove the Air Baffle 6
▼Remove the Memory Mezzanine 6
▼Remove the PCI Mezzanine 7
3. Replacing Components 3–1
3.1 Replacing the Air Filter 3–2
▼Remove the Air Filter 2
▼Install the Air Filter 3
3.2 Replacing a Power Supply 3–4
▼Remove a Power Supply 5
▼Install a Power Supply 6
3.3 Replacing a Hard Drive 3–7
▼Remove a Hard Drive 7
▼Install a Hard Drive 10
3.4 Replacing the Optical Media Drive 3–11
▼Remove the Optical Media Drive 11
▼Install the Optical Media Drive 12

Contents v
3.5 Replacing FB-DIMMs 3–14
▼Locate a Faulty FB-DIMM 17
▼Remove FB-DIMMs 17
▼Install FB-DIMMs 18
3.6 Replacing System Fan 0 3–20
▼Remove System Fan 0 20
▼Install System Fan 0 21
3.7 Replacing System Fan 1 3–22
▼Remove System Fan 1 22
▼Install System Fan 1 23
3.8 Replacing System Fan 2 3–24
▼Remove System Fan 2 24
▼Install System Fan 2 24
3.9 Replacing PCI Cards 3–25
3.9.1 Replace PCI-X and PCIe Cards in Slots 0-3 3–25
▼Remove PCI-X and PCIe Cards in Slots 0-3 25
▼Install PCI-X and PCIe Cards in Slot 0-3 27
3.9.2 Replacing PCI Cards in the PCI Mezzanine 3–28
▼Remove PCI Cards in the PCI Mezzanine 28
▼Install PCI Cards in the PCI Mezzanine 30
3.10 Replacing the System/Alarm LED Board 3–30
▼Remove the System/Alarm LED Board 30
▼Install the System/Alarm LED Board 31
3.11 Replacing the SAS Expander Card 3–32
▼Remove the SAS Expander Card 32
▼Install the SAS Expander Card 33
3.12 Replacing the Battery 3–35
▼Remove the Battery 35

vi Sun Netra X4450 Server Service Manual • August 2008
▼Install the Battery 36
3.13 Replacing the Motherboard Assembly 3–37
▼Remove the Motherboard Assembly 37
▼Install the Motherboard Assembly 40
3.14 Replacing the Power Board 3–43
▼Remove the Power Board 44
▼Install the Power Board 46
4. Returning the Server to Service 4–1
4.1 Returning the Server to Service 4–1
▼Install the PCI Mezzanine 1
▼Install the Memory Mezzanine 3
▼Install the Air Baffle 4
▼Install the Top Cover 4
▼Reinstall the Server in the Rack 5
▼Reconnect the Cables to the Server 5
▼Power On the Server 6
A. Configuring BIOS and POST 5–7
A.1 Using BIOS Menu Items 5–7
▼Access BIOS Configuration Screens and Change the System’s
Parameters 8
A.2 BIOS Considerations 5–8
A.2.1 Peripheral Component Interconnect (PCI) Card Slot Booting
Priority 5–8
A.2.2 Ethernet Port (NIC) Device and Driver Naming 5–9
A.2.3 NIC Naming 5–10
A.2.3.1 Sun Netra X4450 Server NIC Booting Priority 5–10
A.3 BIOS Setup Screens 5–11
A.3.1 BIOS Setup Menu Screens 5–12

Contents vii
A.3.1.1 BIOS Main Menu Screens 5–13
A.3.1.2 BIOS Advanced Menu Screens 5–14
A.3.1.3 BIOS Boot Menu Screens 5–20
A.3.1.4 BIOS Server Menu Screens 5–23
A.3.1.5 BIOS Security Menu Screens 5–27
A.3.1.6 BIOS Exit Menu Screens 5–27
A.4 Viewing Event Logs 5–31
▼View Event Logs 31
A.5 Power-On Self-Test (POST) 5–31
A.5.1 How BIOS POST Memory Testing Works 5–32
▼Redirect Console Output 32
▼Change POST Options 33
A.5.2 POST Codes 5–34
A.5.3 POST Code Checkpoints 5–36
B. Signal Pinouts A–1
A.1 Gigabit Ethernet Ports A–1
A.2 Network Management Port A–2
A.3 Serial Ports A–3
A.3.1 Serial Management Port A–3
A.3.1.1 RJ-45 to DB-9 Adapter Crossovers A–5
A.3.1.2 RJ-45 to DB-25 Adapter Crossovers A–5
A.3.2 Serial Port TTYA A–6
A.4 Alarm Port A–6
A.5 USB Ports A–7
Index Index–1

viii Sun Netra X4450 Server Service Manual • August 2008

ix
Preface
This manual provides detailed procedures that describe the removal and
replacement of replaceable parts in the Sun Netra™ X4450 server. This manual also
includes detailed and comprehensive diagnostics information and procedures. This
document is written for technicians, system administrators, authorized service
providers (ASPs), and users who have advanced experience troubleshooting and
replacing hardware.
Related Documentation
The following table lists the documentation for this product. The online
documentation is available at:
http://docs.sun.com/app/docs/prod/server.nebs
Application Title
Part
Number Format Location
Installation Sun Netra X4450 Server Installation Guide 820-4015 PDF and
HTML
Online
Issues and
updates
Sun Netra X4450 Server Product Notes 820-4018 PDF and
HTML
Online
ILOM Reference Sun Integrated Lights Out Management 2.0
Supplement for the Sun Netra X4450 Server
820-5244 PDF and
HTML
Online

xSun Netra X4450 Server Service Manual • August 2008
Platform safety
and compliance
Sun Netra X4450 Server Safety and Compliance
Guide
820-4183 PDF and
HTML
Online
Generic safety Important Safety Information for Sun Hardware
Systems
816-7190 PDF and
printed
Online and
shipping kit
Getting started Sun Netra Servers Getting Started Guide 820-3016 Printed Shipping kit
Application Title
Part
Number Format Location

1-1
CHAPTER 1
Server Diagnostics
This chapter describes the diagnostics that are available for monitoring and
troubleshooting the server.
The following topics are covered:
■Section 1.1 “Fault on Initial Power Up” on page 1-1
■Section 1.2 “Server Diagnostics Overview” on page 1-2
■Section 1.3 “Using the Status Indicators to Identify the State of Devices” on page
1-4
■Section 1.4 “Using the Service Processor Firmware for Diagnosis and Repair
Verification” on page 1-11
■Section 1.5 “Using the Solaris Predictive Self Healing Feature” on page 1-12
■Section 1.6 “Collecting Information From Solaris OS Files and Commands” on
page 1-15
■Section 1.7 “Additional Service Related Information” on page 1-17
1.1 Fault on Initial Power Up
If you have installed the server, and upon initial power up, you see errors indicating
faults with the Fully Buffered DIMMs (FB-DIMMs), PCI cards, or other components,
the suspect component might have become loose during shipment.
Conduct a visual inspection of the server internals and its components. Remove the
top cover and physically reseat the cable connections, the PCI cards, and the FB-
DIMMs.

1-2 Sun Netra X4450 Server Service Manual • August 2008
1.2 Server Diagnostics Overview
There are a variety of diagnostic tools, commands, and indicators you can use to
monitor and troubleshoot a server:
■Status indicators – These indicators provide a quick visual notification of the
status of the server and of some of the FRUs.
■Fault management architecture – FMA provides simplified fault diagnostics
through use of the /var/adm/messages file, the fmdump command, and a Sun
Microsystems web site.
■ILOM firmware – This system firmware runs on the service processor. In
addition to providing the interface between the hardware and OS, ILOM also
tracks and reports the health of key server components. ILOM works closely with
POST and Solaris™ Predictive Self Healing technology to keep the system up and
running even when there is a faulty component.
■Power-on self-test (POST) – POST performs diagnostics on system components
upon system reset to ensure the integrity of those components. POST is
configurable and works with ILOM to take faulty components offline if needed.
■Solaris Predictive Self-Healing (PSH) – This technology continuously monitors
the health of the CPU and memory, and works with ILOM to take a faulty
component offline if needed. The Predictive Self Healing technology enables
Sun™ systems to accurately predict component failures and mitigate many
serious problems before they occur.
■Log files and console messages – These provide the standard Solaris Operating
System (OS) log files and investigative commands that can be accessed and
displayed on the device of your choice.
The LEDs, ILOM, Solaris PSH, and many of the log files and console messages are
integrated. For example, a fault detected by the Solaris software will display the
fault, log it, pass information to ILOM where it is logged, and, depending on the
fault, might light one or more LEDs.

Chapter 1 Server Diagnostics 1-3
TABLE 1-1 Diagnostic Actions
Action
No. Diagnostic Action Resulting Action Additional Information
1Check Power OK
and Input OK
LEDs on the server.
The Power OK LED is located on the front and rear
of the chassis.
The Input OK LED is located on the rear of the
server on each power supply.
If these LEDs are not on, check the power source
and power connections to the server.
Section 1.3 “Using the
Status Indicators to
Identify the State of
Devices” on page 1-4
2Check the Solaris
log files for fault
information.
The Solaris message buffer and log files record
system events and provide information about faults.
If system messages indicate a faulty device, replace
the FRU.
Section 1.6 “Collecting
Information From Solaris
OS Files and Commands”
on page 1-15
3Determine if the
fault is an
environmental
fault.
Environmental faults can be caused by faulty FRUs
(power supply, fan, or blower), or by environmental
conditions such as when computer room ambient
temperature is too high, or the server airflow is
blocked. When the environmental condition is
corrected, the fault will automatically clear.
Section 1.4 “Using the
Service Processor Firmware
for Diagnosis and Repair
Verification” on page 1-11
If the fault indicates that a fan, blower, or power
supply is bad, you can perform a hot-swap of the
FRU. You can also use the fault indicators on the
server to identify the faulty FRU (fans, blower, and
power supplies).
Section 1.3 “Using the
Status Indicators to
Identify the State of
Devices” on page 1-4
4Determine if the
fault was detected
by PSH.
If the fault message displays the following text, the
fault was detected by the Solaris Predictive Self
Healing software:
Host detected fault
Section 1.5 “Using the
Solaris Predictive Self
Healing Feature” on page
1-12
If the fault is a PSH detected fault, identify the
faulty FRU from the fault message and replace the
faulty FRU.
“Clear PSH Detected
Faults” on page 1-15
After replacing the FRU, perform the procedure to
clear PSH detected faults.
5Contact Sun for
Support.
The majority of hardware faults are detected by the
server’s diagnostics. In rare cases, a problem might
require additional troubleshooting. If you are unable
to determine the cause of the problem, contact Sun
for support.
Sun Support information:
http://www.sun.com/s
upport

1-4 Sun Netra X4450 Server Service Manual • August 2008
1.2.1 Memory Fault Handling
The server uses an advanced ECC technology, called chipkill, that corrects up to 4
bits in error on nibble boundaries, as long as all of the bits are in the same DRAM. If
a DRAM fails, the FB-DIMM continues to function.
The Predictive Self Healing (PSH) technology in the Solaris OS uses the fault
manager daemon (fmd) to watch for various kinds of faults. When a fault occurs, the
fault is assigned a unique fault ID (UUID), and logged. PSH reports the fault and
provides a recommended proactive replacement for the FB-DIMMs associated with
the fault.
If you suspect that the server has a memory problem, see Section 3.5 “Replacing FB-
DIMMs” on page 3-14 for FB-DIMM replacement instructions. You must perform the
instructions in that chapter to clear the faults and enable the replaced FB-DIMMs.
1.3 Using the Status Indicators to Identify
the State of Devices
The server provides status indicators in the upper left corner of the front panel
(FIGURE 1-1) and on the rear panel (FIGURE 1-2). These indicators provide a visual
means of determining the state of the system or individual components.

Chapter 1 Server Diagnostics 1-5
FIGURE 1-1 Front Panel Status and Alarm Status Indicators
Figure Legend
1White Locator Indicator and Button 5Red Critical Alarm Indicator
2Yellow Service Required Indicator 6Red Major Alarm Indicator
3Green Running Indicator 7Amber Minor Alarm Indicator
4On/Standby Button 8Amber User Alarm Indicator

1-6 Sun Netra X4450 Server Service Manual • August 2008
FIGURE 1-2 Rear Panel Status Indicators
Figure Legend
1Alarm port 5Management network port indicators
2White Locator Indicator and button 6Ethernet port indicators
3Yellow Service Required Indicator 7Power supply indicators
4Green Running Indicator 8Video port

Chapter 1 Server Diagnostics 1-7
TABLE 1-2 lists and describes the front and rear panel indicators.
TABLE 1-2 Front and Rear Panel Indicators
LED Location Color Description
Locator
Indicator and
Button
Front upper
left and rear
left
White Enables you to identify a particular server. The LED is activated
using one of the following methods:
• Issuing the setlocator on or off command.
• Pressing the button to toggle the indicator on or off.
This LED provides the following indications:
• Off – Normal operating state.
• Fast blink – The server received a signal as a result of one of the
preceding methods.
Fault Indicator Front upper
center and
rear center
Yellow If on, indicates that service is required.
Activity
Indicator
Front upper
right and rear
right
Green • On – Drives are receiving power. Solidly on if drive is idle.
• Flashing – Drives are processing a command.
• Off – Power is off.
Power Button Front upper
right
Turns the host system on and off. This button is recessed to prevent
accidental server power-off. Use the tip of a pen to operate this
button. Press this button once for a graceful shutdown. Press this
button for 4 seconds for an emergency shutdown.
Power OK
Indicator
Rear center Green Provides the following indications:
• Off – The system is unavailable. Either the system has no power
or ILOM is not running.
• Steady on – Indicates that the system is powered on and is
running it its normal operating state.
• Standby blink – Indicates that the service processor is running
while the system is running at a minimum level in Standby
mode, and is ready to be returned to its normal operating state.
• Slow blink – Indicates that a normal transitory activity is taking
place. The system diagnostics might be running, or the system
might be booting.
Critical Alarm
Indicator
Front left Red Indicates a critical alarm.
Major Alarm
Indicator
Front left Red Indicates a major alarm.
Minor Alarm
Indicator
Front left Amber Indicates a minor alarm.
User Alarm
Indicator
Front left Amber Indicates a user alarm.

1-8 Sun Netra X4450 Server Service Manual • August 2008
1.3.1 Hard Drive Indicators
The hard drive indicators (FIGURE 1-3 and TABLE 1-3) are located on the front of each
hard drive that is installed in the server chassis.
FIGURE 1-3 Hard Drive Indicators
Figure Legend
1OK to Remove
2Fault
3Activity
TABLE 1-3 Hard Drive Indicators
Indicator Color Description
OK to
Remove
Blue • On – The drive is ready for hot-plug removal.
• Off – Normal operation.
Fault Amber • On – The drive has a fault and requires attention.
• Off – Normal operation.
Activity Green • On – The drive is receiving power. Solidly lit if drive is idle.
• Flashing – The drive is processing a command.
• Off – Power is off.

Chapter 1 Server Diagnostics 1-9
1.3.2 Power Supply Indicators
The power supply indicators (FIGURE 1-4 and TABLE 1-4) are located on the rear of
each power supply.

1-10 Sun Netra X4450 Server Service Manual • August 2008
FIGURE 1-4 Power Supply Indicators
1.3.3 Ethernet Port Indicators
The ILOM management Ethernet port and the four 10/100/1000 Mbps Ethernet
ports each have two indicators, as shown in FIGURE 1-5 and described in TABLE 1-5.
Figure Legend
1Power OK incdicator
2Fault indicator
3Input OK indicator
TABLE 1-4 Power Supply Indicators
Indicator Color Description
Power OK Green • On – Normal operation. DC output voltage is within normal
limits.
• Off – Power is off.
Fault Amber • On – Power supply has detected a failure.
• Off – Normal operation.
Input OK Green • On – Normal operation. Input power is within normal limits.
• Off – No input voltage, or input voltage is below limits.