Sun Microsystems Blade X6450 User manual

Sun Microsystems, Inc.
www.sun.com
Submit comments about this document by clicking the Feedback[+] link at: http://docs.sun.com
Sun Blade X6450 Server Module
Service Manual
Part No. 820-3539-13
May 2009, Revision A

Please
Recycle
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.
This distribution may include materials developed by third parties.
Sun, Sun Microsystems, the Sun logo, Java, Netra, Solaris, Sun Ray, Sun™ ONE Studio, Sun Blade X6450 Server Module, Sun StorageTek™
RAID Manager software and Sun company logo are trademarks or registered trademarks of Sun Microsystems, Inc. in the U.S. and other
countries.
Intel® is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Intel® Xeon® is a
trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Intel Inside® is a trademark
or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries.
Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S.
export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés.
Cette distribution peut comprendre des composants développés par des tierces parties.
Sun, Sun Microsystems, le logo Sun, Java, Netra, Solaris, Sun Ray, Sun™ ONE Studio, Sun Blade X6450 Server Module, Sun StorageTek™ RAID
Manager software et Sun company logo sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc. aux Etats-Unis et
dans d'autres pays.
Intel® est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d'autres pays. Intel®
Xeon® est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d'autres pays. Intel
Inside® est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d'autres pays.
L'utilisation de pieces detachees ou d'unites centrales de remplacement est limitee aux reparations ou a l'echange standard d'unites centrales
pour les produits exportes, conformement a la legislation americaine en matiere d'exportation. Sauf autorisation par les autorites des Etats-
Unis, l'utilisation d'unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L'ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L'APTITUDE A UNE UTILISATION PARTICULIERE OU A
L'ABSENCE DE CONTREFACON.

iii
Contents
Preface xv
1. Introduction to the Sun Blade X6450 Server Module 1–1
1.1 Features of the Servers 1–2
1.2 Service Processor 1–3
1.3 Sun Blade X6450 Server Module Overview 1–4
1.3.1 Server Module Front Panel 1–4
1.3.2 Server Module Components 1–6
1.4 Identifying Sun Blade X6450 Server Module Revisions 1–7
▼To Identify MB Revision Using a Hardware Check 7
▼To Identify MB Revision Using the ELOM or ILOM Web Interface or
CLI 8
1.5 Using the Multi-Port Dongle Cable for Testing 1–9
▼To Use a Multi-Port Dongle Cable for Testing 9
1.6 Accessory Kits 1–11
1.7 Additional Options and Replaceable Components 1–11
1.8 Customer Replaceable Units (CRUs) and Field Replaceable Units (FRUs)
1–11
2. Powering On the Server Module, Configuring BIOS and Resetting BIOS, SP and
CMOS 2–1

iv Sun Blade X6450 Server Module Service Manual • May 2009
2.1 Powering On the Server Module 2–2
▼To Power On the Server Module 2
2.2 Powering Off the Server 2–4
2.3 Configuring BIOS Settings 2–5
2.3.1 Viewing the BIOS Setup Utility 2–5
2.3.2 Configuring the BIOS 2–5
▼To Configure the BIOS 6
2.3.3 BIOS Considerations 2–6
2.3.3.1 PCIe ExpressModule Slot Booting Priority 2–6
2.3.3.2 Ethernet Port Device and Driver Naming 2–7
2.3.3.3 Ethernet Port (NIC) Booting Priority 2–7
2.3.3.4 BIOS Option ROM Size Limitation 2–8
2.3.3.5 Descriptions of the BIOS Setup Screens 2–8
2.3.4 BIOS Setup Menu Screens 2–10
2.3.4.1 BIOS Main Menu Screen 2–10
2.3.4.2 Advanced Settings 2–11
2.3.4.3 CPU Configuration 2–12
2.3.4.4 Memory Configuration 2–13
2.3.4.5 IDE Configuration 2–14
2.3.4.6 Super I/O 2–15
2.3.4.7 Trusted Computing 2–16
2.3.4.8 USB Configuration 2–17
2.3.4.9 PCI Configuration 2–18
2.3.4.10 MPS Configuration 2–19
2.3.4.11 Event Log Configuration 2–20
2.3.4.12 Boot Menu 2–21
2.3.4.13 Boot Settings Configuration 2–22
2.3.4.14 Boot Device Priority 2–23

Contents v
2.3.4.15 Hard Disk Drives 2–24
2.3.4.16 Server 2–25
2.3.4.17 AST2000 LAN Configuration 2–26
2.3.4.18 Remote Access Configuration 2–27
2.3.4.19 Reset BMC Password 2–28
2.3.4.20 Security Settings 2–29
2.3.4.21 Exit 2–30
2.4 Resetting the BMC, BIOS, and CMOS 2–33
▼To Reset the SP Password Using the BIOS Setup Utility 33
▼To Reset the BIOS Password and Clear CMOS Using J42 34
2.5 Recovering from a Corrupt Service Processor 2–38
▼To Recover from a Corrupt Service Processor 39
2.6 Power-On Self-Test (POST) 2–43
3. Maintaining the Server 3–1
3.1 Monitoring System Components 3–2
3.1.1 Monitoring System Components Using the External Service Action
Required Indicator LED 3–2
3.1.2 Monitoring the System and Components Using the SP Web
Interface 3–5
▼To Monitor the System and Components Using the SP Web Interface 5
3.1.3 Monitoring System Components Using the SP CLI 3–9
▼To Monitor System Components Using the ELOM CLI 9
▼To Monitor System Components Using the ILOM CLI 12
3.2 Servicing the Server Module 3–12
3.2.1 Tools and Supplies Needed 3–13
3.2.2 Components and Part Numbers 3–13
3.2.3 Preparing the Server Module for Service 3–13
▼To Remove the Server Module From the Chassis 13
▼To Remove the Main Cover 15

vi Sun Blade X6450 Server Module Service Manual • May 2009
▼To Insert the Server Module 15
3.3 Troubleshooting Server Issues 3–17
▼To Troubleshoot Server Issues 17
3.3.1 Troubleshooting Using the Internal Fault Indicator LEDs 3–17
▼To Troubleshoot Using the Internal Fault Indicator LEDs 18
3.4 Replaceable Component Procedures 3–20
3.4.1 Replacing the System Battery (CRU) 3–21
▼To Replace the System Battery 21
3.4.2 Replacing the Compact Flash Card (CRU) 3–22
▼To Replace the Compact Flash Card 22
3.4.3 Replacing DIMMs (CRU) 3–24
3.4.3.1 DIMM Population Rules 3–24
▼To Replace a DIMM 25
3.4.4 Replacing a CPU and Heatsink (FRU) 3–28
▼To Replace a CPU and Heatsink 28
3.4.5 Installing and Removing a RAID Expansion Module 3–32
3.4.5.1 Installing a RAID Expansion Module (CRU) 3–33
▼To Install a Sun Blade RAID 5 Expansion Module Battery 33
▼To Install a RAID Expansion Module 35
3.4.5.2 Removing a RAID Expansion Module and Battery
(CRU) 3–38
▼To Remove a RAID Expansion Module 38
▼To Remove a Sun Blade RAID 5 Expansion Module Battery 39
3.4.6 Installing and Replacing a Fabric Expansion Module 3–40
▼To Install a Fabric Expansion Module 40
▼To Remove a Fabric Expansion Module 42
3.4.7 Installing or Replacing an Optional Solid-State Drive (FRU) 3–44
3.4.7.1 Conditions for Provisioning SSDs 3–44
3.4.7.2 Installing an Optional Solid State Drive 3–45

Contents vii
▼To Install an Optional Solid State Drive 45
▼To Replace an Optional Solid State Drive 49
3.4.8 Replacing the Motherboard (FRU) 3–50
▼To Replace the Motherboard 51
4. Performing Diagnostic Tests 4–1
4.1 Pc-Check Diagnostics Overview 4–1
▼To Access the Pc-Check Diagnostics 2
4.2 System Information Menu 4–3
4.3 Advanced Diagnostics 4–5
4.4 Hard Disk Testing 4–6
▼To Select and Test a Hard Drive 6
4.5 Burn-In Testing 4–8
4.5.1 Performing Immediate Burn-In Testing 4–9
▼To Perform Immediate Burn-in Testing 9
4.5.2 Performing Deferred Burn-In Testing 4–10
▼To Perform Deferred Burn-in Testing 10
4.6 Show Results Summary 4–11
4.7 Print Results Report 4–12
4.8 About Pc-Check 4–12
4.9 Exit 4–12
5. Updating ELOM Firmware 5–1
5.1 Updating the BIOS, SP, CPLD and REM Firmware 5–1
5.1.1 Updating the BIOS and the SP Firmware Using the ELOM Web
Interface 5–2
▼To Update the BIOS and the SP Firmware Using the ELOM Web
Interface 2
5.1.2 Updating the BIOS and SP Firmware Using the Command-Line
Interface (CLI) 5–3

viii Sun Blade X6450 Server Module Service Manual • May 2009
▼To Update the BIOS and SP Firmware Using the Command-Line
Interface (CLI) 3
5.1.3 Updating the BIOS from a DOS-Bootable USB Disk 5–4
▼To Update the BIOS From a DOS-Bootable USB Disk 5
5.1.4 Updating the CPLD Using the ELOM Web Interface 5–5
▼To Update CPLD Using the ELOM Web Interface 5
5.1.5 Updating the REM Firmware 5–6
▼To Update the REM Firmware from a DOS-Bootable USB Thumb
Drive 7
A. System Specifications A–1
A.1 Server Module Specifications A–1
B. BIOS Power-On Self-Test (POST) Codes B–1
B.1 Introduction B–1
B.2 How BIOS POST Memory Testing Works B–2
B.3 Redirecting Console Output B–2
▼To Redirect Console Output 2
B.4 Changing POST Options B–3
▼To Change POST Options 3
B.5 POST Codes B–4
Index Index–1

ix
Figures
FIGURE 1-1 Server Module Front Panel 1–5
FIGURE 1-2 Server Module Replaceable Component Locations 1–6
FIGURE 1-3 The Location of the FRU ID Label 1–8
FIGURE 1-4 Dongle Cable Connections 1–10
FIGURE 2-1 Power Button and Power/OK LED Location 2–3
FIGURE 2-2 Ethernet Port Chassis Labeling Designations 2–7
FIGURE 2-3 Server Module BIOS Configuration Utility Menu Tree 2–9
FIGURE 2-4 BIOS Setup Menu Main Screen 2–10
FIGURE 2-5 BIOS Setup Menu Advanced Screen 2–11
FIGURE 2-6 BIOS Setup Menu Advanced Configure CPU Screen 2–12
FIGURE 2-7 BIOS Setup Menu Advanced Memory Screen 2–13
FIGURE 2-8 BIOS Setup Menu Advanced IDE Configuration Screen 2–14
FIGURE 2-9 BIOS Setup Menu Advanced Super I/O Screen 2–15
FIGURE 2-10 BIOS Setup Menu Advanced Trusted Computing Screen 2–16
FIGURE 2-11 BIOS Setup Menu Advanced USB Configuration Screen 2–17
FIGURE 2-12 BIOS Setup Menu Advanced PCI Configuration Screen 2–18
FIGURE 2-13 BIOS Setup Menu Advanced MPS Configuration Screen 2–19
FIGURE 2-14 BIOS Setup Menu Advanced Event Logging Screen 2–20
FIGURE 2-15 BIOS Setup Menu Boot Screen 2–21
FIGURE 2-16 BIOS Setup Menu Boot Configuration Screen 2–22

xSun Blade X6450 Server Module Service Manual • May 2009
FIGURE 2-17 BIOS Setup Menu Boot Device Priority Screen 2–23
FIGURE 2-18 BIOS Setup Menu Boot Hard Disk Drives Screen 2–24
FIGURE 2-19 BIOS Setup Menu Server Screen 2–25
FIGURE 2-20 BIOS Setup Menu Server LAN Configuration Screen 2–26
FIGURE 2-21 BIOS Setup Menu Server Remote Access Configuration Screen 2–27
FIGURE 2-22 BIOS Setup Menu Server Reset BMC Password Screen 2–28
FIGURE 2-23 BIOS Setup Menu Security Change Supervisor Password Screen 2–29
FIGURE 2-24 BIOS Setup Menu Exit Screen 2–30
FIGURE 2-25 BIOS Setup Menu Exit Load Optimal Defaults Screen 2–31
FIGURE 2-26 BIOS Setup Menu Exit Load Failsafe Defaults Screen 2–32
FIGURE 2-27 Location of J42 on the Motherboard With Pin 1 Shown 2–35
FIGURE 2-28 Pinout for Jumper J42 and the Caps in the Safe Position 2–36
FIGURE 2-29 J42 With the Jumper Set to Reset the BIOS Password. 2–36
FIGURE 2-30 J42 With the Jumper Set to Clear the CMOS Password. 2–37
FIGURE 2-31 J42 With the Jumpers Set to Reset the BIOS Password and Clear the CMOS Password. 2–
37
FIGURE 2-32 Location of Jumpers J19 and J44 on the Motherboard. 2–40
FIGURE 2-33 The Location and Default Setting of J51 2–41
FIGURE 3-1 External LEDs 3–3
FIGURE 3-2 The Components Submenu Tabs 3–6
FIGURE 3-3 Removing a Server Module 3–14
FIGURE 3-4 Removing the Main Cover 3–15
FIGURE 3-5 Inserting the server module. 3–16
FIGURE 3-6 CPU and DIMM Fault Reminder LEDs 3–19
FIGURE 3-7 Removing the Battery 3–22
FIGURE 3-8 Replacing the Compact Flash 3–23
FIGURE 3-9 DIMM Numbering and Position 3–25
FIGURE 3-10 Removing a DIMM 3–26
FIGURE 3-11 Installing a DIMM with Slot Alignment Key 3–27
FIGURE 3-12 The Internal Numbering Designation of the CPUs and the CPU Fault LEDs 3–29

Figures xi
FIGURE 3-13 Removing the Heatsink and CPU 3–30
FIGURE 3-14 Replacing the CPU 3–31
FIGURE 3-15 Installing a RAID Expansion Module Battery 3–34
FIGURE 3-16 Removing the Cap From the REM Connector 3–35
FIGURE 3-17 Routing the Cable and Installing the RAID Expansion Module 3–37
FIGURE 3-18 Removing a RAID Expansion Module 3–39
FIGURE 3-19 Removing the connector cap 3–41
FIGURE 3-20 Installation of a Fabric Expansion Module 3–42
FIGURE 3-21 Removing a Fabric Expansion Module 3–43
FIGURE 3-22 SSD Cable Routing and Connectors 3–46
FIGURE 3-23 Installation of the SSD Mounting Bracket 3–47
FIGURE 3-24 Installation of the SSD 3–48
FIGURE 3-25 Removal of the SSD Cable 3–49
FIGURE 3-26 Removal of the SSD 3–50

xii Sun Blade X6450 Server Module Service Manual • May 2009

xiii
Tables
TABLE 1-1 Summary of Features 1–2
TABLE 1-2 Accessory Kit 1–11
TABLE 1-3 CRU and FRU List 1–12
TABLE 2-1 Server Module NIC Naming 2–7
TABLE 2-2 BIOS Setup Screens Summary 2–8
TABLE 3-1 Front Panel LED Functions 3–4
TABLE 3-2 The ELOM System Monitoring Tab Submenu Screens and Tasks 3–6
TABLE 3-3 The ELOM System Monitoring Tab Submenu Screens and Tasks 3–7
TABLE 3-4 The ILOM System Information Tab Submenu Screens and Tasks 3–7
TABLE 3-5 The ILOM System Monitoring Tab Submenu Screens and Tasks 3–8
TABLE 3-6 CLI Namespaces and Related Tasks 3–9
TABLE 3-7 Internal LED Functions 3–19
TABLE 3-8 DIMM Slots and Locations 3–24
TABLE 4-1 System Information Menu Options 4–4
TABLE 4-2 Advanced Diagnostics Test Menu Options 4–5
TABLE 4-3 Continuous Burn-In Testing Options 4–9
TABLE A-1 Server Module Physical Specifications A–1
TABLE A-2 Server Module Environmental Specifications A–1
TABLE B-1 Error Messages and Responses B–5

xiv Sun Blade X6450 Server Module Service Manual • May 2009

xv
Preface
This Sun Blade X6450 Server Module Service Manual contains information and
procedures for maintaining and upgrading the Sun Blade X6450 server module.
Before You Read This Document
It is important that you review the safety guidelines in the Sun Blade 6000 Modular
System Safety and Compliance Guide (820-0053).
Product Updates
For product updates that you can download for the Sun Blade X6450 server module,
go to:
http://www.sun.com/servers/blades/downloads.jsp
This site contains updates for firmware and drivers, as well as CD-ROM images.

xvi Sun Blade X6450 Server Module Service Manual • May 2009
Related Documentation
All Sun hardware documentation is available at:
http://docs.sun.com
For the most up-to-date information about the Sun Blade X6450 server module,
navigate to the Sun Blade X6450 server module document collection using the High-
End Servers and Blade Servers product category links.
Translated versions of some of these documents might also be available after the
product’s world-wide release date. Select a language from the drop-down list and
browse or navigate to the product name x64 document collection. Available
translations for the Sun Fire servers include Simplified Chinese, Traditional Chinese,
French, Japanese, and Korean.
English documentation is revised more frequently and might be more up-to-date
than the translated documentation.
Using UNIX Commands
This document might not contain information about basic UNIX®commands and
procedures such as shutting down the system, booting the system, and configuring
devices. Refer to the following for this information:
■Software documentation that you received with your system
■Solaris™ operating system documentation, available at:
http://docs.sun.com

Preface xvii
Typographic Conventions
Third-Party Web Sites
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites or
resources. Sun will not be responsible or liable for any actual or alleged damage or
loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
Typeface*
* The settings on your browser might differ from these settings.
Meaning Examples
AaBbCc123 The names of commands, files,
and directories; on-screen
computer output
Edit your.login file.
Use ls -a to list all files.
% You have mail.
AaBbCc123 What you type, when contrasted
with on-screen computer output
%su
Password:
AaBbCc123 Book titles, new words or terms,
words to be emphasized.
Replace command-line variables
with real names or values.
Read Chapter 6 in the User’s Guide.
These are called class options.
You must be superuser to do this.
To delete a file, type rm filename.

xviii Sun Blade X6450 Server Module Service Manual • May 2009
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include this title and document part number with your feedback:
Sun Blade X6450 Server Module Service Manual, 820-3539-13

1-1
CHAPTER 1
Introduction to the Sun Blade X6450
Server Module
This chapter provides an overview of the Sun Blade X6450 server module, and
contains the following sections:
■Section 1.1, “Features of the Servers” on page 1-2
■Section 1.3, “Sun Blade X6450 Server Module Overview” on page 1-4
■Section 1.5, “Using the Multi-Port Dongle Cable for Testing” on page 1-9
■Section 1.6, “Accessory Kits” on page 1-11
■Section 1.7, “Additional Options and Replaceable Components” on page 1-11
■Section 1.8, “Customer Replaceable Units (CRUs) and Field Replaceable Units
(FRUs)” on page 1-11

1-2 Sun Blade X6450 Server Module Service Manual • May 2009
1.1 Features of the Servers
The Sun Blade X6450 server module is designed to fit into the Sun Blade 6000 and
Sun Blade 6048 chassis systems. TABLE 1-1 summarizes the features of the server
module.
TABLE 1-1 Summary of Features
Feature or
Component Specifications
CPU Up to four Intel Xeon 7000 series quad-core processors
Memory Up to 24 FB DIMMs blade (up to 6 per Channel)
Service Processor
(SP)
• Onboard IPMI 2.0 compliant SP
• One 10/100 management Ethernet port to midplane
• Remote keyboard, video, mouse, and storage (RKVMS) over IP
• See Section 1.2, “Service Processor” on page 1-3 for more information
Midplane I/O • Two x8 PCI-Express (PCIe) lanes
• Two x2 SAS Links (to on-board REM connector)
• Two 10/100/1000 Base-T GigabitEthernet
• One 10/100 Base-T Ethernet
• 12C Bus
• Two x4 PCIe Lanes (can also be configured as two XAUI interfaces
when used with FEM)
Module Support • Sun Blade RAID 5 Expansion Module
• Sun Blade RAID 0/1 Expansion Module
• Sun Blade 10 GigabitEthernet Multi-Fabric Network Express Module
• Sun Blade 6000 10GbE Multi-Fabric Network Express Module
• Power support for two PCIe ExpressModules (EM)
• Network expansion module (NEM)
Front Panel I/O Universal Connector Port (UCP) for use with the multi-port dongle
cable, which provides the following interface connections*:
• VGA graphics
• Serial console to SP
• Dual USB ports (keyboard/mouse)
* There are two versions of the multi-port dongle cable (see Section 1.5, “Using the Multi-Port Dongle Cable for
Testing” on page 1-9).
Compact Flash On-board IDE compact flash module interface