Sun Microsystems Blade X6450 User manual

Sun Microsystems, Inc.
www.sun.com
Submit comments about this document at: http://www.sun.com/hwdocs/feedback
Sun Blade™ X6450 Server Module
Installation Guide
Part No. 820-3535-12
September 2008, Revision A

Please
Recycle
Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.
This distribution may include materials developed by third parties.
Sun, Sun Microsystems, the Sun logo, Java, Netra, Solaris, Sun Ray, Sun™ ONE Studio, Sun Blade X6450 Server Module, Sun StorageTek™
RAID Manager software and Sun company logo are trademarks or registered trademarks of Sun Microsystems, Inc., or its subsidiaries, in the
U.S. and other countries.
Intel® is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Intel® Xeon® is a
trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Intel Inside® is a trademark
or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries.
Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S.
export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés.
Cette distribution peut comprendre des composants développés par des tierces parties.
Sun, Sun Microsystems, le logo Sun, Java, Netra, Solaris, Sun Ray, Sun™ ONE Studio, Sun Blade X6450 Server Module, Sun StorageTek™ RAID
Manager software et Sun company logo sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc., ou ses filales, aux
Etats-Unis et dans d'autres pays.
Intel® est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d'autres pays. Intel®
Xeon® est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d'autres pays. Intel
Inside® est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d'autres pays.
L'utilisation de pieces detachees ou d'unites centrales de remplacement est limitee aux reparations ou a l'echange standard d'unites centrales
pour les produits exportes, conformement a la legislation americaine en matiere d'exportation. Sauf autorisation par les autorites des Etats-
Unis, l'utilisation d'unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L'ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L'APTITUDE A UNE UTILISATION PARTICULIERE OU A
L'ABSENCE DE CONTREFACON.

iii
Contents
Preface vii
1. Introduction 1
Terms and References Used in This Book 1
Installation Overview 2
Routine Power On and Power Off 3
▼To Apply Standby Power 3
▼To Power On Main Power for All Server Components 3
▼To Shut Down Main Power 4
About Diskless Servers 5
Compact Flash Drive 6
Solid State Disk Drive (SSD) 7
Connecting to SAS Devices 7
Internal Connection to a Sun Blade 6000 Disk Module 9
External Connecton to the 10 GbE Ethernet Connections 9
Connecting to Exterior Storage Devices Using a Fibre Channel Connection
10
About the Boot Process 10
BIOS and BIOS Configuration Utilities 11
Bootloader 11

iv Sun Blade X6450 Server Module Installation Guide • September 2008
GRUB 12
Windows Bootloader 12
Accessing BIOS Configuration Utilities and Selecting a Boot Device 13
▼To Configure Netboot or Compact Flash Boot in the BIOS 14
▼To Configure the QLogic Fibre Channel in the BIOS 14
▼To Configure the Emulex Fibre Channel PCIe ExpressModule in the
BIOS 14
▼To Load an OS Over the Network (Netboot) 15
RAID Configuration 15
▼To Configure the Sun Blade RAID 5 Expansion Module 16
▼To Configure the Sun Blade 0/1 RAID Expansion Module 16
Installing an Operating System 17
Directing Console Output 17
2. Installing and Configuring the Server Module 19
Inserting the Server Module 19
▼To Insert the Server Module 19
LED Behavior 21
Accessing and Configuring the ILOM 22
Displaying the Service Processor’s (ILOM) IP Address 23
▼To Display the Service Processor’s (ILOM) IP Address 23
Connecting to the ILOM 23
▼To Connect to the ILOM Web GUI 24
▼To Connect to the ILOM CLI 25
Accessing and Configuring the ELOM 26
Displaying the Service Processor’s (ELOM) IP Address 27
▼To Display the Service Processor’s (ELOM) IP Address 27
Connecting to the ELOM 28
▼To Connect to the ELOM Web GUI 28

Contents v
▼To Connect to the ELOM CLI 29
Configuring the Service Processor’s Network Settings (Optional) 30
▼To Configure the Service Processor’s Network Configuration: 30
Accessing the System Console 31
▼To Access the System Console Directly 31
▼To Access the System Console Using the ILOM CLI 32
▼To Access the System Console Using the ELOM CLI 32
▼To Access the System Console Using the ILOM Web GUI 33
▼To Access the System Console Using the ELOM Web GUI 35
Dongle Cable Connections 38
A. Installation Worksheet 41
B. Using the BIOS Configuration Utility to Configure the Sun Blade RAID 5
Expansion Module 45
Introduction to the BIOS RAID Configuration Utility 46
Understanding Hot-Plug Limitations and Conditions Within the BIOS RAID
Configuration Utility 46
Hot-Unplug Removal Conditions 47
Hot-Plug Addition Conditions 47
Hot-Unplug and Plug Replacement or Reinsertion Conditions 47
Running the BIOS RAID Configuration Utility 48
▼To Start the BIOS RAID Configuration Utility 48
▼To Navigate the BIOS RAID Configuration Utility 49
Using the ACU to Create and Manage Arrays 49
▼To Start the ACU 50
▼To Create a New Array With the ACU 50
▼To Manage Existing Arrays With the ACU 51
▼To Make an Array Bootable With the ACU 51
▼To Initialize Disk Drives With the ACU 51

vi Sun Blade X6450 Server Module Installation Guide • September 2008
▼To Rescan Disk Drives With the ACU 52
▼To Perform a Secure Erase on Disk Drives With the ACU 52
▼To Stop a Secure Erase in Progress With the ACU 52
Using the -Select Utility to Modify REM Settings 53
▼To Start Using a -Select Utility 53
▼To Apply Changes and Exit a -Select Utility 53
▼To Modify General Settings With a -Select Utility 54
▼To Modify SAS-Specific REM Settings With a -Select Utility 55
Using the Disk Utilities to Manage Disk Drives 56
▼To Format or Verify a Disk Drive With the Disk Utilities 56
▼To Locate Disk Drives With the Disk Utilities 56
▼To Identify Disk Drives With the Disk Utilities 57
Initializing a RAID Array 57
Index 1

vii
Preface
This Sun Blade X6450 Server Module Installation Guide contains procedures for
installing the server module in a chassis, and connecting to the service processor
administrator account.
Using UNIX Commands
This document might not contain information about basic UNIX®commands and
procedures such as shutting down the system, booting the system, and configuring
devices. Refer to the following for this information:
■Software documentation that you received with your system
■Solaris™ Operating System (Solaris OS) documentation, which is at
http://docs.sun.com

viii Sun Blade X6450 Server Module Installation Guide • September 2008
Shell Prompts
Typographic Conventions
Related Documentation
For a description of the document set, see the Where to Find Documentation sheet that
is packed with your system and also posted at the product’s documentation site. Go
to the following URL, then navigate to your product.
http://docs.sun.com/app/docs/prod/blade.x6450
Shell Prompt
C shell machine-name%
C shell superuser machine-name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #
Typeface*
* The settings on your browser might differ from these settings.
Meaning Examples
AaBbCc123 The names of commands, files,
and directories; on-screen
computer output
Edit your.login file.
Use ls -a to list all files.
% You have mail.
AaBbCc123 What you type, when contrasted
with onscreen computer output
%su
Password:
AaBbCc123 Book titles, new words or terms,
words to be emphasized.
Replace command-line variables
with real names or values.
Read Chapter 6 in the User’s Guide.
These are called class options.
You must be superuser to do this.
To delete a file, type rm filename.

Preface ix
Translated versions of some of these documents are available at the web site
described above in Simplified Chinese, French, and Japanese. English documentation
is revised more frequently and might be more up-to-date than the translated
documentation.
For all Sun hardware and software documentation, go to the following URL:
http://docs.sun.com
Documentation, Support, and Training
Product Updates
For product updates that you can download, please visit the following web site:
http://www.sun.com/download/
Find the Hardware Drivers section and click x64 Servers & Workstations. The Sun
Blade™ X6450 Server Module site contains updates for firmware and drivers, as well
as CD-ROM ISO images.
Third-Party Web Sites
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites
Sun Function URL
Documentation http://docs.sun.com/
Support http://www.sun.com/support/
Training http://www.sun.com/training/

xSun Blade X6450 Server Module Installation Guide • September 2008
or resources. Sun will not be responsible or liable for any actual or alleged damage
or loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun Blade X6450 Server Module Installation Guide, part number 820-3535-12

1
CHAPTER 1
Introduction
This chapter contains the following topics:
■“Terms and References Used in This Book” on page 1
■“Installation Overview” on page 2
■“Routine Power On and Power Off” on page 3
■“About Diskless Servers” on page 5
■“About the Boot Process” on page 10
■“RAID Configuration” on page 15
■“Installing an Operating System” on page 17
■“Directing Console Output” on page 17
■“Accessing BIOS Configuration Utilities and Selecting a Boot Device” on page 13
Terms and References Used in This Book
Note the following terms used in this book:
■The term server module refers to the Sun Blade X6450 server hardware.
■The term chassis refers to the Sun Blade 6000 modular system.
■The term remote drive refers to a disk drive that is located outside the server
module, but is configured to serve as a local drive.
■The server module includes a service processor (SP), which is IPMI-compatible
software integrated into the motherboard. This can be either:
■Integrated Lights Out Manager (ILOM) – Sun Blade X6450 server modules are
currently shipped with an ILOM service processor.

2Sun Blade X6450 Server Module Installation Guide • September 2008
■Embedded Lights Out Manager (ELOM) – Earlier server modules were
shipped with an ELOM. Current server modules can be downgraded to the
ELOM, for compatability with older server modules. See the ELOM-to-ILOM
Migration User’s Guide for details.
References to other manuals are in italic text. These manuals should be available on
the server module’s section of http://docs.sun.com.
Installation Overview
The following overview outlines the steps to install the server module. The actual
procedures are in Chapter 2.
Unpack the server module before proceeding.
1. Insert the server module into the chassis.
When you are done, the server module comes up to standby mode. See “Inserting
the Server Module” on page 19.
2. Access and configure the service processor. Using the service processor, you can:
■Access the system console remotely over the network.
■Access the service processor’s IP address and MAC address.
■Change the service processor’s IP address, and configure whether the service
processor uses DHCP or static addressing.
■For server modules equipped with an ILOM service processor, see“Accessing
and Configuring the ILOM” on page 22.
■For server modules equipped with an ELOM service processor, see “Accessing
and Configuring the ELOM” on page 26.
When you are done, you can access the service processor from the Ethernet.
You can also set the service processor’s network settings, including its IP
address at this time.
3. Configure any additional network hardware. See “About Diskless Servers” on
page 5 for more information.
4. Configure or select a boot device. See “Accessing BIOS Configuration Utilities and
Selecting a Boot Device” on page 13 for more information.
5. Install or configure your operating system.
■To install a supported Solaris, Linux, or VMware operating system, see the Sun
Blade X6450 Server Module Operating System Installation Guide.

Chapter 1 Introduction 3
■To install a supported Windows operating system, see the Sun Blade X6450
Server Module Windows Operating System Installation Guide.
Routine Power On and Power Off
This section describes how to apply standby power to the server module so you can
operate the service processor. It also includes procedures for powering on and for
shutting down the server module.
Note – You can also power on and power off the server module remotely using the
service processor. Powering on is described in “Accessing the System Console” on
page 31. More complete instructions are provided in the corresponding service
processor documentation.
▼To Apply Standby Power
When standby power is applied, the service processor is powered on, and
everything else is powered off.
If the chassis is powered on, standby power is automatically applied to the server
module. No action is required.
▼To Power On Main Power for All Server
Components
1. Insert the server module into a powered chassis.
The server module comes up to standby power mode automatically.
In standby power mode, the green OK LED on the front panel flashes and the
blue OK to Remove LED remains on. See FIGURE 1-1.
2. Use a non-conducting pointed object, such as a stylus, to press and release the
recessed Power button on the server front panel.
When main power is applied to the full server, the green OK LED above the
Power button lights and remains lit.

4Sun Blade X6450 Server Module Installation Guide • September 2008
FIGURE 1-1 Server Module Front Panel
Figure Legend
▼To Shut Down Main Power
To power off the server, use one of the following two methods:
1White LED - Locate
- A service processor command causes the locate LED to blink.
- You can also control the locate LED manually by pressing it momentarily to toggle its
state, turning it On or Off.
2Blue LED - Ready to remove
3Amber LED - Service action required
4Green LED - OK
5Power on button/standby
6For service use only
7UCP (universal connector port), used for dongle cable

Chapter 1 Introduction 5
■Graceful shutdown. Use a non-conducting pointed object, such as a stylus, to
press and release the Power button on the front panel. This causes Advanced
Configuration and Power Interface (ACPI) enabled operating systems to perform
an orderly shutdown of the operating system. Servers not running ACPI-enabled
operating systems will shut down to standby power mode immediately.
■Emergency shutdown. Press and hold the Power button for four seconds to force
main power off and enter standby power mode.
When main power is off, the Power/OK LED on the front panel begins flashing,
indicating that the server is in standby power mode.
Note – To power off the server completely, you must remove it from the chassis, or
disconnect the AC power cords from the back panel of the chassis.
Note – Pressing the Power button for four seconds or more always causes the
subsystems in the server module (except for the service processor) to be powered off,
even if the server module is already in the powered-off state.
If the server module is already in the powered-off state when the Power button is
pressed for four seconds or more, power is briefly applied to the system, then it is
turned off again.
About Diskless Servers
The Sun Blade X6450 is a diskless server. This means that you cannot install the
operating system on a local disk because it does not have one.
Instead, you have other choices. These include:
■Installing the operating system on the compact flash, which shares characteristics
with a hard drive, and which can support some operating systems. This option is
described in “Compact Flash Drive” on page 6.
■Installing the operating system on the SSD, or Solid State Disk device. See “Solid
State Disk Drive (SSD)” on page 7.
■Configure diskless network boot, which boots the server module from a boot
image on another server. See the Sun Blade X6450 Server Module Operating
System Installation Guide or your operating system documentation for more
information.

6Sun Blade X6450 Server Module Installation Guide • September 2008
■Installing the operating system on a remote drive, which might be in the chassis
(connected through the SAS-NEM module to a Sun Blade 6000 Disk Module) or
outside the chassis, in a storage device such as a SAN. See “Connecting to SAS
Devices” on page 7 and “Connecting to Exterior Storage Devices Using a Fibre
Channel Connection” on page 10
The following sections describe methods of configuring remote drives:
■“Connecting to SAS Devices” on page 7.
■“Connecting to Exterior Storage Devices Using a Fibre Channel Connection”
on page 10.
After you have configured one or more remote drives, you can proceed with the
operating system installation. From the point of view of the operating system
installation, when remote drives are installed and configured correctly, they operate
the same as local drives. They should appear in the list when the operating system
installation procedure queries for where to install the operating system.
If the operating system installation procedure requires you to select a boot device in
the BIOS, see “Accessing BIOS Configuration Utilities and Selecting a Boot Device”
on page 13.
Compact Flash Drive
The Sun Blade X6450 is equipped with a compact flash device that can support some
operating systems. It is the only local option for installing an operating system.
The following operating systems support booting from compact flash:
■S10 U4 (64-bit) or later
■RHEL4.6 (32/64-bit) or later
■RHEL5.0 (64-bit) or later
■SLES9Sp4 (64-bit)
■SLES10 sp1 (64-bit) or later
■VMware ESX 3.0.2+
■Windows 2003 32- and 64-bit
The compact flash drive supports a finite number of writes before its performance
degrades. You can mitigate the limited number of writes by configuring it to redirect
the log files (the /var and /tmp directories) to another location. See your operating
system documentation for details.

Chapter 1 Introduction 7
Solid State Disk Drive (SSD)
The SSD is a 32-gigabyte solid-state SATA drive that mounts on the motherboard.
Note – This feature requires a F540-7821-01 or newer motherboard, with 2.0
software installed. The motherboard part number appears on the motherboard, and
can be read using the service processor.
When an SSD is present, it appears as a disk device, and you can install an operating
system on it.
Note the following conditions:
■The SSD can only be driven by the onboard SATA controller.
■A server module with an SSD cannot have a Sun Blade RAID 5 Expansion
Module.
■A server module with an SSD can have a Sun Blade RAID 0/1 G2 RAID
Expansion Module, however it cannot drive the SSD.
For instructions to install an SSD, see the Sun Blade X6450 Server Module Service
Manual.
Connecting to SAS Devices
The SAS-NEM module, mounted in the back of the chassis, allows to the Sun Blade
X6450 Server Module to connect to SAS devices inside the chassis and outside of the
chassis. Each chassis can support one or two SAS-NEM modules.
These configurations require the Sun Blade X6450 Server Module to have either a
REM or a FEM.
■Inside the chassis, the Sun Blade 6000 Disk Module provides eight SAS drives.
The Sun Blade 6000 Disk Module and the Sun Blade X6450 Server Module work
in pairs, with the server module in an even-numbered slot, directly to the left of
the disk module. Thus, the pairs can be in slots 0+1, 2+3, 4+5, 6+7, or 8+9.
In this configuration, the eight disks on the disk module are available to the
server module, and appear in the boot list as local drives.
■Outside the chassis, the Sun Blade 6000 10GbE Multi-Fabric Network Express
Module provides four 10 GbE SAS external ports as well as connections to the
Sun Blade 6000 Disk Module.
For more information, see the Sun Blade 6000 Disk Module Installation Guide
(820-1702), and the documentation for the corresponding SAS NEM module.

8Sun Blade X6450 Server Module Installation Guide • September 2008
The following devices require software 2.0 or newer.
■Sun Blade RAID 5 Expansion Module
■Sun Blade RAID 0/1 G2 Expansion Module
■Sun Blade 6000 Multi-Fabric Network Express Module
The following devices require a F540-7821-01 or newer motherboard, with 2.0
software installed. The motherboard part number appears on the motherboard, and
can be read using the service processor.
■Sun Blade 6000 10GbE Multi-Fabric Network Express Module
■Sun Dual 10GbE Fabric Expansion Module
The combinations, and the configurations they support appear in TABLE 1-1.
FIGURE 1-2 shows a Sun Blade X6450 server module in slot 0 and a Sun Blade 6000
Disk Module in slot 1, with a pair of Sun Blade 6000 10GbE Multi-Fabric Network
Express Modules.
TABLE 1-1 SAS Connection Summary
REM SAS-NEM Module Supported Connections
Sun Blade RAID 5 Expansion Module, or
Sun Blade RAID 0/1 G2 Expansion Module
NEM None
Sun Blade RAID 5 Expansion Module, or
Sun Blade RAID 0/1 G2 Expansion Module
Sun Blade 6000 Multi-Fabric
Network Express Module
Sun Blade 6000 Disk Module
External SAS connectors
Sun Blade RAID 5 Expansion Module, or
Sun Blade RAID 0/1 G2 Expansion Module
Sun Blade 6000 10GbE Multi-Fabric
Network Express Module
Note - This SAS-NEM also
supports the 10GbE Ethernet
connectors. See “External
Connecton to the 10 GbE Ethernet
Connections” on page 9.
Sun Blade 6000 Disk Module
External SAS connectors

Chapter 1 Introduction 9
FIGURE 1-2 Connections to a SAS NEM Module
Internal Connection to a Sun Blade 6000 Disk Module
Inside the chassis, the Sun Blade 6000 Disk Module provides eight SAS drives.
The Sun Blade 6000 Disk Module and the Sun Blade X6450 Server Module work in
pairs, with the server module in an even-numbered slot, directly to the left of the
disk module. Thus, the pairs can be in slots 0+1, 2+3, 4+5, 6+7, or 8+9.
In this configuration, the eight disks on the disk module are available to the server
module, and appear in the boot list as local drives.
External Connecton to the 10 GbE Ethernet Connections
In addition to the four external SAS connectors, the Sun Blade 6000 10GbE Multi-
Fabric Network Express Module provides ten 10GbE ports. To use the 10GbE ports,
you must have a Sun Blade 6000 10GbE Multi-Fabric Network Express Module
installed.
For more information, see the Sun Blade 6000 Disk Module Installation Guide, and
the documentation for the SAS NEM module.

10 Sun Blade X6450 Server Module Installation Guide • September 2008
Connecting to Exterior Storage Devices Using a
Fibre Channel Connection
The Sun Blade X6450 supports connections to an external SAN over a fibre channel
link provided by a PCIe ExpressModule card in the corresponding PCIe
ExpressModule slot. The PCIe ExpressModule card provides a fibre channel
connection to the external SAN.
FIGURE 1-3 shows the configuration.
FIGURE 1-3 PCIe ExpressModule with Fibre Channel and SAN
The chassis supports two PCIe ExpressModule slots for each server slot. They are
numbered N-0 and N-1, where Nis the server slot number. The numbering is
described in the chassis documentation.
See the documentation provided with the PCIe ExpressModule card for more details.
To configure a boot device on the SAN device, see “Accessing BIOS Configuration
Utilities and Selecting a Boot Device” on page 13.
About the Boot Process
This section provides an overview of the boot process.
When you start your server module, it offers two chances to select the way it boots: