Dell PowerEdge C8000 User manual

Dell PowerEdge C8000
Hardware Owner’s
Manual
Regulatory Model: B10S
Regulatory Type: B10S001

Notes, Cautions, and Warnings
NOTE: A NOTE indicates important information that helps you make better use of
your computer.
CAUTION: A CAUTION indicates potential damage to hardware or loss of data if
instructions are not followed.
WARNING: A WARNING indicates a potential for property damage, personal
injury, or death.
____________________
Information in this publication is subject to change without notice.
© 2012 Dell Inc. All rights reserved.
Reproduction of these materials in anymanner whatsoever without the written permissionof Dell Inc.
is strictly forbidden.
Trademarks used in this text: Dell™, the DELL logo, PowerEdge™ are trademarks of Dell Inc.
Intel is a registered trademark of Intel Corporation in the United State or other countries.
Othertrademarksandtradenamesmaybeusedinthispublicationtorefertoeithertheentitiesclaiming
the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and
trade names other than its own.
Regulatory Model B10S
Regulatory Type: B10S001
2012 - 07 P/N XXXXX Rev. A00

Contents 3
Contents
1 About the System . . . . . . . . . . . . . . . . . . . 9
Accessing System Features During Startup. . . . . . . 10
Front-Panel Features and Indicators . . . . . . . . . . 11
Back-Panel Features and Indicators . . . . . . . . . . 12
Server Enclosure Indicator Codes. . . . . . . . . . . . 14
NIC Indicator Codes . . . . . . . . . . . . . . . . . . . 16
Sled Bay Numbering. . . . . . . . . . . . . . . . . . . 18
Fan Bay Numbering . . . . . . . . . . . . . . . . . . . 19
Sled Module Configuration . . . . . . . . . . . . . . . 20
Sled Features . . . . . . . . . . . . . . . . . . . . . . 21
Power Sleds . . . . . . . . . . . . . . . . . . . . 21
Compute Sleds . . . . . . . . . . . . . . . . . . . 23
Storage Sleds. . . . . . . . . . . . . . . . . . . . 29
Service Tag. . . . . . . . . . . . . . . . . . . . . . . . 31
POST Error Codes . . . . . . . . . . . . . . . . . . . . 35
Collecting System Event Log for
Investigation . . . . . . . . . . . . . . . . . . . . 35
System Event Log. . . . . . . . . . . . . . . . . . . . . 43
Processor Error. . . . . . . . . . . . . . . . . . . 43
Memory Ecc . . . . . . . . . . . . . . . . . . . . 44
PCIe Error . . . . . . . . . . . . . . . . . . . . . . 46

4Contents
IOH Core Error . . . . . . . . . . . . . . . . . . . 47
SB Error . . . . . . . . . . . . . . . . . . . . . . . 48
POST Start Event . . . . . . . . . . . . . . . . . . 49
POST End Event . . . . . . . . . . . . . . . . . . . 50
POST Error Code Event . . . . . . . . . . . . . . . 51
BIOS Recovery Event . . . . . . . . . . . . . . . . 52
ME Fail Event . . . . . . . . . . . . . . . . . . . . 52
SEL Generator ID . . . . . . . . . . . . . . . . . . 53
BMC . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Other Information You May Need . . . . . . . . . . . . 59
2 Using the System Setup Program . . . . . 61
System Setup Menu . . . . . . . . . . . . . . . . . . . 61
System Setup Options at Boot . . . . . . . . . . . . . . 62
Using the System Setup Program
Navigation Keys . . . . . . . . . . . . . . . . . . . . . 62
General Help . . . . . . . . . . . . . . . . . . . . . . . 63
Console Redirection . . . . . . . . . . . . . . . . . . . 63
Enabling and Configuring Console
Redirection . . . . . . . . . . . . . . . . . . . . . 63
Main Menu . . . . . . . . . . . . . . . . . . . . . . . . 68
Main Screen . . . . . . . . . . . . . . . . . . . . 68
System Settings. . . . . . . . . . . . . . . . . . . 69
Advanced Menu . . . . . . . . . . . . . . . . . . . . . 71
Power Management . . . . . . . . . . . . . . . . 72
CPU Configuration . . . . . . . . . . . . . . . . . 78
Memory Configuration . . . . . . . . . . . . . . . 81
SATA Configuration . . . . . . . . . . . . . . . . . 83

Contents 5
PCI Configuration . . . . . . . . . . . . . . . . . . 86
USB Configuration . . . . . . . . . . . . . . . . . 93
Security Menu . . . . . . . . . . . . . . . . . . . . . . 94
Server Menu . . . . . . . . . . . . . . . . . . . . . . . 96
View System Log . . . . . . . . . . . . . . . . . . 101
Boot Menu . . . . . . . . . . . . . . . . . . . . . . . . 102
Exit Menu . . . . . . . . . . . . . . . . . . . . . . . . 104
Command Line Interfaces for System
Setup Options . . . . . . . . . . . . . . . . . . . . . . 106
IPMI Command List . . . . . . . . . . . . . . . . . . . 129
Power Management Settings . . . . . . . . . . . . . . 138
3 Installing System Components . . . . . . . 141
Safety Instructions. . . . . . . . . . . . . . . . . . . . 141
Recommended Tools. . . . . . . . . . . . . . . . . . . 142
Inside the System . . . . . . . . . . . . . . . . . . . . 143
Sled Blank . . . . . . . . . . . . . . . . . . . . . . . . 144
Removing a Sled Blank . . . . . . . . . . . . . . . 144
Installing a Sled Blank . . . . . . . . . . . . . . . 144
Compute Sleds . . . . . . . . . . . . . . . . . . . . . . 145
Removing a Compute Sled . . . . . . . . . . . . . 145
Installing a Compute Sled . . . . . . . . . . . . . 146
Storage Sled . . . . . . . . . . . . . . . . . . . . . . . 147
Removing a Storage Sled. . . . . . . . . . . . . . 147
Installing a Storage Sled . . . . . . . . . . . . . . 148

6Contents
Power Sled . . . . . . . . . . . . . . . . . . . . . . . 148
Inside a Power Sled. . . . . . . . . . . . . . . . 150
Removing a Power Sled. . . . . . . . . . . . . . 150
Installing a Power Sled . . . . . . . . . . . . . . 152
Removing the PSU1/3 Module Assembly . . . . . 153
Installing the PSU1/3 Module Assembly . . . . . 155
Removing the PSU2/4 Module Assembly . . . . . 155
Installing the PSU2/4 Module Assembly . . . . . 156
Removing the PSU Module . . . . . . . . . . . . 157
Installing the PSU Module . . . . . . . . . . . . 158
Fan Modules . . . . . . . . . . . . . . . . . . . . . . 159
Removing a Fan Module . . . . . . . . . . . . . 159
Installing a Fan Module . . . . . . . . . . . . . . 160
Front Panel Board . . . . . . . . . . . . . . . . . . . 161
Removing the Front Panel Board . . . . . . . . . 161
Installing the Front Panel Board . . . . . . . . . 162
Fan Controller Board . . . . . . . . . . . . . . . . . . 163
Removing the Fan Controller Board . . . . . . . 163
Installing the Fan Controller Board . . . . . . . . 164
4 Troubleshooting. . . . . . . . . . . . . . . . . . . 165
Safety First—For You and Your System . . . . . . . . 165
Installation Problems . . . . . . . . . . . . . . . . . 165
Troubleshooting System Startup Failure. . . . . . . . 166
Troubleshooting External Connections . . . . . . . . 166
Troubleshooting the Video Subsystem. . . . . . . . . 166
Troubleshooting a USB Device . . . . . . . . . . . . 166

Contents 7
Troubleshooting a Serial I/O Device . . . . . . . . . . 167
Troubleshooting a NIC . . . . . . . . . . . . . . . . . . 168
Troubleshooting a Wet Enclosure . . . . . . . . . . . . 169
Troubleshooting a Damaged Enclosure . . . . . . . . . 170
Troubleshooting Enclosure Components . . . . . . . . 171
Troubleshooting Enclosure Fan Modules . . . . . 171
Troubleshooting the Power Sled . . . . . . . . . . 173
Troubleshooting Power Supplies. . . . . . . . . . 173
Troubleshooting Sled Components . . . . . . . . . . . 174
Troubleshooting System Memory . . . . . . . . . 174
Troubleshooting a Hard-Drive . . . . . . . . . . . 176
Troubleshooting Expansion Cards . . . . . . . . . 177
Troubleshooting Processors . . . . . . . . . . . . 177
Troubleshooting the System Board . . . . . . . . 178
Troubleshooting the System Battery . . . . . . . . 179
IRQ Assignment Conflicts . . . . . . . . . . . . . . . . 180
5 Jumpers and Connectors . . . . . . . . . . . 181
Server Enclosure Boards . . . . . . . . . . . . . . . . 181
Front Panel Board Connectors . . . . . . . . . . . 181
Fan Controller Board Connectors . . . . . . . . . 182
Power Management Board Connectors . . . . . . 183
Power Sled Boards . . . . . . . . . . . . . . . . . . . 184
Power Distribution Boards Connectors . . . . . . 184
Power Interposer Board Connectors. . . . . . . . 186

8Contents
6 Getting Help . . . . . . . . . . . . . . . . . . . . . . 187
Contacting Dell . . . . . . . . . . . . . . . . . . 187
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189

About the System 9
1
About the System
The PowerEdge C8000 server enclosure features ten vertically aligned sled
bays which support a full sled or a mixed sled enclosure. A full sled enclosure
can include up to five C8220X double-wide compute sleds, ten C8220
single-wide compute sleds, or five C8000XD storage sleds. A mixed sled
enclosure can support a mixture of differing sled types. To function as a
system, a compute sled is inserted into the PowerEdge C8000 server enclosure
that supports fans and optional power sleds. The fans are shared resources of
the sleds in the PowerEdge C8000 server enclosure.
NOTE: To ensure proper operation and cooling, all bays in the enclosure must be
populated at all times with either a sled or with a sled blank.

10 About the System
Accessing System Features During Startup
The following keystrokes provide access to system features during startup.
The SAS/SATA card or PXE hotkey support are available only in the BIOS
boot mode. Hotkey function is not available in the Unified Extensible
Firmware Interface (UEFI) boot mode.
Keystroke Description
<F2> Enters the System Setup program. See "System Setup Menu" on
page 61.
<F11> Enters the BIOS Boot Manager or the Unified Extensible
Firmware Interface (UEFI) Boot Manager, depending on the
system's boot configuration. See "System Setup Options at Boot"
on page 62.
<F12> Starts Preboot eXecution Environment (PXE) boot.
<Ctrl><C> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the SAS adapter documentation.
<Ctrl><H> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the documentation for your SAS RAID
card.
<Ctrl><S> Enters the utility to configure onboard NIC settings for PXE boot.
For more information, see the documentation for your integrated
NIC.
<Ctrl><I> Enters the onboard SAS and SATA controller’s configuration
utility.

About the System 11
Front-Panel Features and Indicators
Figure 1-1. Front-Panel Features and Indicators
Item Feature Icon Description
1, 2, 3,
4, 7, 8,
9, 10
Sled bays Installs up to five C8220X compute sleds,
ten C8220 compute sleds, five C8000XD
sleds, or a mixture of differing sled types.
NOTE: The sled bays must always be
populated with either a sled or a sled blank
to ensure proper system cooling.
5, 6 Sled bays Sled bays 5 and 6 installs up to two power
sleds or two C8220 compute sleds or a
combination of the two sled types.
NOTE: If the enclosure is configured with
only one power sled, a C8220 compute sled
or a power sled blank must be mounted into
the adjacent sled bay.
11 Chassis status
indicator
Indicates the power and health status of
the whole system.
12 Chassis
identification
indicator
Lights blue when the chassis ID signal is
generated.

12 About the System
Back-Panel Features and Indicators
Figure 1-2. Back-Panel Features and Indicators
13 Thermal sensor Monitors the inlet ambient temperature.
14 Ethernet connector Embedded 10/100 Mbit NIC connector.
15 NIC link/activity
indicator
Indicates state of the network link and
activity.
Item Feature Icon Description
1 Fan modules Provides cooling solution to the enclosure.
Item Feature Icon Description

About the System 13
2 AC power sockets Connect the power cables to these power
sockets. When connected to a power
source, main power is automatically
distributed to the enclosure.
NOTE: Always connect the enclosure's AC
power sockets to a single power source,
switch, or PDU.
NOTE: Before installing a compute or
storage sled to the front of the enclosure,
install the power sleds and connect power to
the enclosure.
3, 4, 5 Fan fault indicators
1 to 6
Indicates the function status of the system
fans.
6Servicemode
button
Press this button to enter service mode.
7ExternalPDU
connector
Connects to a PDU control connector.
8 BMC management
port
Dedicated management port.
9 Chassis
identification
indicator
Lights blue when the chassis ID signal is
generated.
10 Power/event
indicator
Indicates the power and health status of the
enclosure.
Item Feature Icon Description

14 About the System
Server Enclosure Indicator Codes
The indicators on the front and back of the server enclosure displays
operational status of the enclosure, fan modules, and chassis controller
boards.
Figure 1-3. Server Enclosure Front-Panel Indicators
Item Indicator Color Status Indicator Code
1 Chassis status
indicator
Green Solid Indicates a valid power source is
connected to the server enclosure
and that the enclosure is
operational.
Off Off Power is not connected.
Amber Blinking Indicates a fault event occurred.
2 Chassis
identification
indicator
Blue Blinking Indicates a chassis ID signal is
generated.
Blue Off Chassis ID signal is not generated.
3 NIC link/activity
indicator
Green Solid Linking at 100 Mbps speed
(maximum).
Green Blinking Transmit or receive activity.
Off Off No activity.

About the System 15
Figure 1-4. Server Enclosure Back-Panel Indicators
Item Indicator Color Status Indicator Code
1Power/event
indicator
Green Solid Indicates a valid power source is
connected to the server enclosure
and that the enclosure is
operational and power is applied to
the fan controller board.
Green Blinking Power is connected to the
enclosure but the managed devices’
or sleds’ power is off.
Amber Blinking Indicates a fault event occurred.
Off Off Power is not connected.
2Chassis
identification
indicator
Blue Blinking Indicates a chassis ID signal is
generated.
Blue Off Chassis ID signal is not generated.
3 Fan 1 and 2
fault indicator
Amber Blinking Indicates a fault event occurred in
fans 1 and 2.
Off Off Fans 1 and 2 are operational.

16 About the System
NIC Indicator Codes
Figure 1-5. NIC Indicators (Front-Panel Ethernet Connector)
4 Fan 3 and 4
fault indicator
Amber Blinking Indicates a fault event occurred in
fans 3 and 4.
Off Off Fans 3 and 4 are operational.
5 Fan 5 and 6
fault indicator
Amber Blinking Indicates a fault event occurred in
fans 5 and 6.
Off Off Fans 5 and 6 are operational.
1 link indicator 2 activity indicator
Indicator Status Indicator Code
Link indicator Solid amber Linking at 10 Mbps port speed
Solid green Linking at 100 Mbps port speed (maximum)
Activity
indicator
Solid green No activity
Blinking green Transmit or receive activity
Off Idle
Item Indicator Color Status Indicator Code

About the System 17
Figure 1-6. NIC Indicators (BMC management port)
1 link indicator 2 activity indicator
Indicator Status Indicator Code
Link indicator Blinking amber Linking at 10 Mbps port speed
Blinking green Linking at 100 Mbps port speed (maximum)
Activity
indicator
Solid green No activity
Blinking green Transmit or receive activity
Off Idle

18 About the System
Sled Bay Numbering
The front of the server enclosure is divided into ten vertical bays. A C8220
single-wide compute sled or a power sled occupies one sled bay in the server
enclosure and a C8220X double-wide compute sled or C8000XD storage sled
occupies two sled bays in the server enclosure. When installing a sled module
into the server enclosure, you should install the sled module in sled bay 1 first,
then work toward the right of the enclosure.
Figure 1-7. Sled Bay Numbering
a. Sled bays 5 and 6 support installation of two power sleds or two C8220 sleds or a combination of
the two sled types.
b. The power sleds install in sled bays 5 and 6 only.
Sled module type
Sled Bays
12345
a6a78910
Single-wide compute sled 
Power sledb   
Double-wide compute sled 
Storage sled 

About the System 19
Fan Bay Numbering
The back of the PowerEdge C8000 server enclosure includes three hot-
swappable fan modules that provide the system with redundant cooling
source. Each fan module contains two cooling fans. All three fan modules
must be installed at all times to ensure proper cooling.
Figure 1-8. Fan Bay Numbering
Fan Bay Cooling Fans
Fan module 1 Fan 2
Fan 1
Fan module 2 Fan 4
Fan 3
Fan module 3 Fan 6
Fan 5

20 About the System
Sled Module Configuration
The following illustrations are sample sled module configurations available on
the PowerEdge C8000 server enclosure.
Figure 1-9. Sample Sled Module Configuration — C8220 Single-Wide Compute Sleds
Figure 1-10. Sample Sled Module Configuration — C8220X Double-Wide Compute
Sleds
Figure 1-11. Sample Sled Module Configuration — Mixed Sleds