Sun Microsystems SUN FIRE X4500 Instruction Manual

Sun Microsystems, Inc.
www.sun.com
Submit comments about this document at: http://www.sun.com/hwdocs/feedback
Sun Fire™X4500/X4540 Servers
Administration Guide
Part No. 819-6562-16
October 2008, Revision A

Please
Recycle
Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.
This distribution may include materials developed by third parties. Sun, Sun Microsystems, the Sun logo, Java, Netra, Solaris, Sun Ray and Sun
Fire X4540 Backup Server are trademarks or registered trademarks of Sun Microsystems, Inc., and its subsidiaries, in the U.S. and other
countries.
This product is covered and controlled by U.S. Export Control laws and may be subject to the export or import laws in other countries. Nuclear,
missile, chemical biological weapons or nuclear maritime end uses or end users, whether direct or indirect, are strictly prohibited. Export or
reexport to countries subject to U.S. embargo or to entities identified on U.S. export exclusion lists, including, but not limited to, the denied
persons and specially designated nationals lists is strictly prohibited. Use of any spare or replacement CPUs is limited to repair or one-for-one
replacement of CPUs in products exported in compliance with U.S. export laws. Use of CPUs as product upgrades unless authorized by the
U.S. Government is strictly prohibited.
Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés.
Cette distribution peut incluire des élements développés par des tiers. Sun, Sun Microsystems, le logo Sun, Java, Netra, Solaris, Sun Ray et Sun
Fire X4540 Backup Server sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc., et ses filiales, aux Etats-Unis et
dans d'autres pays.
Ce produit est soumis à la législation américaine sur le contrôle des exportations et peut être soumis à la règlementation en vigueur dans
d'autres pays dans le domaine des exportations et importations. Les utilisations finales, ou utilisateurs finaux, pour des armes nucléaires, des
missiles, des armes biologiques et chimiques ou du nucléaire maritime, directement ou indirectement, sont strictement interdites. Les
exportations ou reexportations vers les pays sous embargo américain, ou vers des entités figurant sur les listes d'exclusion d'exportation
américaines, y compris, mais de maniere non exhaustive, la liste de personnes qui font objet d'un ordre de ne pas participer, d'une façon directe
ou indirecte, aux exportations des produits ou des services qui sont régis par la législation américaine sur le contrôle des exportations et la liste
de ressortissants spécifiquement désignés, sont rigoureusement interdites. L'utilisation de pièces détachées ou d'unités centrales de
remplacement est limitée aux réparations ou à l'échange standard d'unités centrales pour les produits exportés, conformément à la législation
américaine en matière d'exportation. Sauf autorisation par les autorités des Etats-Unis, l'utilisation d'unités centrales pour procéder à des mises
à jour de produits est rigoureusement interdite..

iii
Contents
Preface ix
Part I Sun Fire X4500 Server Administration Guide
1. Introduction to the Sun Fire X4500 Server 1
Features of the Server 1
Exterior Features, Controls, and Indicators 3
Front Panel 3
Disk Drive and Fan Tray LEDs 6
About Reliability, Availability, and Serviceability Features 9
Hot-Pluggable and Hot-Swappable Components 9
Hot Pluggable Components Overview 10
Hot Swappable Components Overview 10
2. Software and Operating Environment 11
Using the Zettabyte File System (ZFS) 11
About ZFS 12
Administering ZFS File Systems 12
12
Integrated Lights Out Manager ILOM 13
Intelligent Platform Management (IPMI) 13

iv Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
3. Identifying and Configuring Components 15
Solaris System Commands 15
prtconf Command 16
prtdiag Command 17
psrinfo Command 18
showrev Command 18
cfgadm Command 19
Component Configuration Information 22
Attachment Points Overview 22
Determining Attachment Points 23
Changing to Attachment Points 23
States and Conditions 24
Drive and Drive Slot States 24
Drive Conditions 25
Component States 25
4. Disk Administration and Management 27
Hard Disk Drive Locations 27
Disk Drive Status and LEDs 29
EFI Disk Label Overview 30
Converting EFI Label to SMI (Solaris) Label On The Sun Fire X4500 Disk 31
Adding Disks 34
Adding a Disk to a Mirrored ZFS Configuration 36
Replacing a Device in a ZFS Storage Pool 37
Removing a Disk From Service 37
Correcting Unconfigure Operation Failure 38
Unconfiguring a Disk in Use 38
5. Sun Fire X4500 Fault Management Architecture 41

Contents v
Fault Management Architecture Overview 41
Sun Fire X4500 Fault Management Utility Commands 42
fmd Command 43
fmdump Command 44
Diagnosing Disk Faults 44
Clearing Disk Faults 46
Using thefmadm Command to Clear Faults 46
Displaying Fault Statistics Using the fmstat Command 47
6. Rebuilding the Preinstalled OS 49
Preinstalled OS Overview 49
Creating Preinstalled OS Disk Mirrors (RAID-1) 50
metadb Command 51
metainit Command 51
metaroot Command 52
Recreating the Preinstalled OS 52
Create a Mirror for the root (/) File System 53
Create a Mirror for the swap Partition 54
Create a Mirror for the /var Partition 54
Create / root,/swap, and /var Mirrors 55
Attach / root,/swap, and /var Mirrors 55
Display Current Status of the Metadevices 56
Install GRUB on the Boot Disk 56
Configure the Alternate Boot Device 57
7. Using Disk Control and Monitor Utility (DCMU) 59
Overview of the Disk Control and Monitor Utility 59
Using DCMU 60
cfgdisk Command 60

vi Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
cfgdisk Command Options 60
Examples Using the cfgdisk Command 60
hotplugmon 61
faultmond Command 61
Examples Using the faultmond Command 62
Part II Sun Fire X4540 Server Administration Guide
8. Introduction to the Sun Fire X4540 Server 65
X4540 Server Features 65
Exterior Features, Controls, and Indicators 67
Front Panel 67
Disk Drive and Fan Tray LEDs 71
About Reliability, Availability, and Serviceability Features 74
Hot-Pluggable and Hot-Swappable Components 74
Hot-pluggable Components Overview 75
Hot-swappable Components Overview 75
9. Software and Operating Environment 77
About ZFS 77
Overview 78
Devices 78
Structure 78
Using the ZFS File System 79
Additional information 79
About Integrated Lights Out Manager (ILOM) 79
About Intelligent Platform Management (IPMI) 80
10. Identifying and Configuring Components 81
Solaris System Commands 81

Contents vii
prtconf Command 82
prtdiag Command 83
psrinfo Command 84
showrev Command 85
cfgadm Command 85
Component Configuration Information 89
Attachment Points Overview 89
Determining Attachment Points 90
Changing to Attachment Points 90
States and Conditions 91
Drive and Drive Slot States 91
Drive Conditions 92
Component States 92
11. Managing Hard Disk Drives 93
Hard Disk Drive Locations 93
Disk Drive Status and LEDs 95
EFI Disk Label Overview 96
Converting EFI Label to SMI (Solaris) Label on the Sun Fire X4540 Disk 97
About HDtool 101
Removing a Disk From Service 101
Correcting Unconfigure Operation Failure 102
Adding a Disk 103
Checking Disk Usage 104
12. Sun Fire X4540 Fault Management Architecture 107
Fault Management Architecture Overview 107
Sun Fire X4540 Fault Management Utilities 108
fmd Command 109

viii Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
fmdump Command 110
Using the fmdump Command to Identify Faults 110
Diagnosing Disk Faults 111
Clearing Disk Faults 112
fmadm Command 112
Using the fmadm Command to Clear Faults 112
Displaying Fault Statistics Using the fmstat Command 113
13. Rebuilding the Preinstalled OS 115
Preinstalled OS Overview 115
Creating Preinstalled OS Disk Mirrors (RAID-1) 116
metadb Command 117
metainit Command 117
metaroot Command 118
Re-creating the Preinstalled OS 118
Create a Mirror for the root (/) File System 119
Create a Mirror for the swap Partition 120
Create a Mirror for the /var Partition 120
Create /root,/swap, and /var Mirrors 120
Attach /root,/swap, and /var Mirrors 121
Display Current Status of the Metadevices 121
Install GRUB on the Boot Disk 122
Configure the Alternate Boot Device 123
Glossary 125
Index 139

ix
Preface
How This Book Is Organized
This manual consists of two parts:
The Sun Fire X4500 Server Administration Guide describes how to perform various
administration, configuration, and monitoring tasks associated with the Sun Fire™
X4500 Server.
This guide contains the following chapters:
■Chapter 1 provides an introduction to the Sun Fire X4500 server information.
■Chapter 2 provides system and operating environment information.
■Chapter 3 provides information on how to identify and configure components.
■Chapter 4 provides hard disk management information.
■Chapter 4 provides disk administration and management information.
■Chapter 5 provides fault management architecture information.
■Chapter 6 provides information about how to rebuild the preinstalled OS.
The Sun Fire X4540 Server Administration Guide describes how to administer,
configure, and monitor the Sun Fire™ X4540 Server.
This guide contains the following chapters:
■Chapter 8 provides an introduction to the Sun Fire X4540 server information.
■Chapter 9 provides system and operating environment information.
■Chapter 10 provides information on how to identify and configure
components.
■Chapter 11 provides hard disk management information.

xSun Fire X4500/ X4540 Servers Administration Guide • October 2008
■Chapter 13 provides disk administration and management information.
■Chapter 12 provides fault management architecture information.
■Chapter 13 provides information about how to rebuild the preinstalled OS.
Before You Read This Book
It is important that you review the safety guidelines in the Safety and Compliance
Guide (819-4365).
This document is intended for the Sun Fire system administrator, who has a working
knowledge of UNIX® systems, particularly those based on the Solaris™ Operating
System (OS). If you do not have this knowledge, read the Solaris User and System
Administrator documentation provided with your system, and consider UNIX
system administration training.
Related Documentation
Sun Fire X4500 Specific Documents
Refer to the Sun Fire X4540 Server Installation Guide (819-4358) for system installation
information with default settings.
The Sun Fire X4500 specific documents listed in the following table are available at:
http://docs.sun.com/app/docs/prod/sf.x4500#hic
Application Title Part Number
System setup information Sun Fire X4500 Server Installation Guide 819-4358
Overview and service information Sun Fire X4500 Server Diagnostics Guide 819-4363
Product Notes Sun Fire X4500 Server Product Notes 819-4364
Safety information Sun Fire X4500 Server Safety and Compliance Guide 819-4365

Preface xi
Sun Fire X4540 Specific Documents
The Sun Fire X4540 specific documents listed in the following table are available at:
http://docs.sun.com/app/docs/prod/sf.X4540#hic
General Documents
The related general documents listed in the following table are available at:
http://docs.sun.com
Application Title Part Number
System setup information Sun Fire X4540 Server Installation Guide 819-4358
Overview and service information Sun Fire X4540 Server Diagnostics Guide 819-4363
Product Notes Sun Fire X4540 Server Product Notes 819-4364
Safety information Sun Fire X4540 Server Safety and Compliance Guide 819-4365
Application Title Part Number
hdtool x64 Servers Utilities Reference Manual 820-1120
Solaris basic administration System Administration Guide: Basic Administration 817-1985
Solaris advanced administration System Administration Guide: Advanced Administration 817-0403
Solaris device and file system
administration
System Administration Guide: Devices and File Systems 817-5093
Solaris Volume Manager
administration
Solaris Volume Manager Administration Guide 819-2789
ZFS administration ZFS (Zettabyte File System) Administration Guide 819-5461

xii Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
Documentation, Support, and Training
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit comments to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun Fire X4500/X4540 Servers Administration Guide, (819-6562-16).
Sun Function URL Description
Documentation http://docs.sun.com/app/ Download PDF and HTML documents,
and order printed documents.
Support and
training
http://www.sun.com/support/
http://www.sun.com/training/
Obtain technical support, download
patches, and learn about Sun courses.

PA RT I Sun Fire X4500 Server Administration
Guide
This part contains the Sun Fire X4500 Server Administration Guide and includes the
following chapters:
■Chapter 1 provides an introduction to the Sun Fire X4500 server information.
■Chapter 2 provides system and operating environment information.
■Chapter 3 provides information on how to identify and configure components.
■Chapter 4 provides hard disk management information.
■Chapter 4 provides disk administration and management information.
■Chapter 5 provides fault management architecture information.
■Chapter 6 provides information about how to rebuild the preinstalled OS.

1
CHAPTER 1
Introduction to the Sun Fire X4500
Server
This chapter introduces you to the Sun Fire X4540 Server and describes some of its
features.
The following information is covered in this chapter:
■“Features of the Server” on page 1
■“Exterior Features, Controls, and Indicators” on page 3
Features of the Server
The Sun Fire X4500 server is a mid-level, modular, rack-optimized server in the Sun
x64 product family. The family platform includes servers engineered for AMD
Opteron CPUs and deployment into commercial server markets in a slide-mounted,
horizontally biased enclosure for rack cabinet installations, primarily in datacenter
locations.
The server provides the following maximum system configurations:
■8 DDR-I DIMM slots (4 per processor), up to 2 GB per DIMM (16 GB per system)
■Up to forty-eight 3.5 SATA Type-1 drives, of 250 GB-500 GB capacity each (over 24
TB total system capacity)
■Two 133 MHz PCI-X slots
■4 USB ports
Standard I/O includes four 10/100/1000BASE-T Gigabit Ethernet ports, VGA video,
serial, four USB ports, and one 10/100BASE-T Gigabit Ethernet management port.

2Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
The Sun Fire X4500 server includes an extensive set of reliability, availability, and
serviceability (RAS) features, such as hot-pluggable and redundant hard disk drives
(when RAID1 is used), and hot-swappable fans, and power supplies. The servers
also provide an Integrated Lights Out Management (ILOM) service processor
function that includes remote boot and remote software upgrades.
TABLE 1-1 summarizes the features of the Sun Fire X4500 server.
TABLE 1-1 Summary of X4500 Server Features
Feature or
Component Sun Fire X4500 Server
CPU Two Revision E AMD64 Opteron dual-core processors on two CPU
modules.
Processor BIOS 8-Mbit Flash with LPC interface.
Memory 8 DDR-I DIMM slots (4 per processor), up to 2 GB per DIMM (16 GB
per system).
Hard disk drives
(HDDs)
Up to forty-eight 3.5 SATA Type-1 drives, of 250 GB-500 GB capacity
each (over 24 TB total system capacity).
Service Processor Integrated Lights Out Manager (ILOM) as described in the ILOM
documentation (see the Integrated Lights Out Manager (ILOM)
Administration Guide (819-0280).
RAID options RAID is done through software.
Network I/O • Four 10/100/1000BASE-T Gigabit Ethernet ports (RJ-45 connectors)
• One 10/100BASE-T Ethernet net management port (RJ-45
Connector)
• One RS-232 serial port (RJ-45 Connector)
PCI I/O Two 133-MHz low-profile PCI-X slots.
Other I/O • Four USB 2.0 ports
• One VGA video port
Power 1500 W DC max output per power supply, two bays, 1+1 redundancy,
hot swappable.
1130 W AC max system input power = 3856 BTU/hr = 0.321 Tons of
Air Conditioning, 200–240 VAC.
Fans Five fan modules; also additional fans in each power supply.
Cooling is front-to-back forced air.

Chapter 1 Introduction to the Sun Fire X4500 Server 3
Exterior Features, Controls, and
Indicators
This section describes the features, controls, and indicators on the front and rear
panels of the Sun Fire X4500 server.
Front Panel
FIGURE 1-2 shows the front panel.
FIGURE 1-1 Sun Fire X4500 Server Front Panel
FIGURE 1-1 shows a close up of the controls and indicators.
USB connectors Serial number labels on ledge

4Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
FIGURE 1-2 Sun Fire X4500 Server Front Panel Controls and Indicators
FIGURE 1-3 shows features of the rear panel.
TABLE 1-2 Sun Fire X4500 Server Front Panel
# Name Color Description
1 Locate
button/LED
White Operators can turn this LED on remotely
to help them locate the server in a
crowded server room. Press to turn off.
2 System Fault Amber On - When service action is required.
3 Power/Operation Green Steady - Power is on.
Blink - Standby power is on but main
power is off.
Off - Power is off.
4 System power
button
Grey To power on main power for all the
server components.
4 Top failure LED Amber On - HDD or fan fault.
6 Rear failure LED Amber On - Power supply or system controller
fault (service is required).
7 Over temperature
LED
Amber On - When system is over temperature.
(1) (2) (3) (4) (5) (6) (7)

Chapter 1 Introduction to the Sun Fire X4500 Server 5
FIGURE 1-3 Sun Fire X4500 Server Rear Pane
TABLE 1-3 Sun Fire X4500 Server Rear Panel
# Name Description
1 AC power connectors Each power supply has its own AC connector with a
clip to secure its power cable.
2 Chassis ground Connect grounding straps here.
3 Mounting plate for CMA
bracket
Use this mounting plate to secure the CMA (optional).
Refer to the Sun Fire X4500 Server Installation Guide.
4 PCIX-0 and PCIX-1 Slots for PCIX cards.
5 NET MGT (S) Net management and service processor port.
6 Video connector Connect video monitor.
7 SER MGT Serial management port (serial connection to service
processor).
(1) (2) (3)
(4)
(5) (6) (7) (8) (9) (12)(10) (11) (13) (14)

6Sun Fire X4500/ X4540 Servers Administration Guide • October 2008
Disk Drive and Fan Tray LEDs
FIGURE 1-4 shows the location of the internal LEDs. FIGURE 1-5 shows a close-up view
of the disk drive and fan trays, including the symbols that identify the LEDs.
8 Locate button/LED White
Operators can turn this LED on remotely to help them
locate the server in a crowded server room. Press to
turn off.
9 Fault LED Amber – When on, service action required.
10 OK LED Green – Service action allowed.
When on, service action is required.
Blink – Standby power is On but main power is off.
11 USB connectors Connect USB devices.
12 10/100/1000 gigabit
Ethernet ports
Connect server to Ethernet.
13 System controller status
LEDs
Blue – Ready to remove.
Amber – Fault, service action required.
Green – Operational, no action required.
14 NMI and reset buttons Do not use these buttons unless instructed by Sun
service personnel. To operate these buttons, insert a
stylus or a straightened paper clip into the recess.
• NMI – Non-Maskable Interrupt dump. Sends an NMI
to the CPU. Used for debugging only.
• Reset – Resets the CPU but not the service processor
# Name Description