Dell PowerEdge C8000 User manual

Dell PowerEdge C8000
Hardware Owner’s
Manual
Regulatory Model: B10S
Regulatory Type: B10S001

Notes, Cautions, and Warnings
NOTE: A NOTE indicates important information that helps you make better use of
your computer.
CAUTION: A CAUTION indicates potential damage to hardware or loss of data if
instructions are not followed.
WARNING: A WARNING indicates a potential for property damage, personal
injury, or death.
____________________
Information in this publication is subject to change without notice.
© 2014 Dell Inc. All rights reserved.
Reproduction of these materials in anymanner whatsoever without the written permissionof Dell Inc.
is strictly forbidden.
Trademarks used in this text: Dell™, the DELL logo, PowerEdge™ are trademarks of Dell Inc.
Intel is a registered trademark of Intel Corporation in the United State or other countries.
Othertrademarksandtradenamesmaybeusedinthispublicationtorefertoeithertheentitiesclaiming
the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and
trade names other than its own.
Regulatory Model B10S
Regulatory Type: B10S001
2014 - 01 P/N XXXXX Rev. A08

Contents 3
Contents
1 About the System . . . . . . . . . . . . . . . . . . 11
Accessing System Features During Startup. . . . . . . 12
Front-Panel Features and Indicators . . . . . . . . . . 13
Back-Panel Features and Indicators . . . . . . . . . . 15
Server Enclosure Indicator Codes. . . . . . . . . . . . 18
NIC Indicator Codes . . . . . . . . . . . . . . . . . . . 20
Sled Bay Numbering. . . . . . . . . . . . . . . . . . . 22
Fan Bay Numbering . . . . . . . . . . . . . . . . . . . 23
Sled Module Configuration . . . . . . . . . . . . . . . 24
Sled Features . . . . . . . . . . . . . . . . . . . . . . 26
Compute Sleds . . . . . . . . . . . . . . . . . . . 26
Storage Sleds. . . . . . . . . . . . . . . . . . . . 34
Power Sleds . . . . . . . . . . . . . . . . . . . . 36
Service Tag. . . . . . . . . . . . . . . . . . . . . . . . 38
Server Enclosure . . . . . . . . . . . . . . . . . . 38
Sleds . . . . . . . . . . . . . . . . . . . . . . . . 38
POST Error Codes . . . . . . . . . . . . . . . . . . . . 41
Collecting System Event Log for
Investigation . . . . . . . . . . . . . . . . . . . . 41

4Contents
System Event Log. . . . . . . . . . . . . . . . . . . . . 49
Processor Error . . . . . . . . . . . . . . . . . . . 49
Memory Ecc. . . . . . . . . . . . . . . . . . . . . 50
PCIe Error . . . . . . . . . . . . . . . . . . . . . . 52
IOH Core Error . . . . . . . . . . . . . . . . . . . 53
SB Error . . . . . . . . . . . . . . . . . . . . . . . 54
POST Start Event . . . . . . . . . . . . . . . . . . 55
POST End Event . . . . . . . . . . . . . . . . . . . 56
POST Error Code Event . . . . . . . . . . . . . . . 57
BIOS Recovery Event . . . . . . . . . . . . . . . . 58
ME Fail Event . . . . . . . . . . . . . . . . . . . . 58
SEL Generator ID . . . . . . . . . . . . . . . . . . 59
BMC . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Other Information You May Need . . . . . . . . . . . . 65
2 Using the System Setup Program . . . . . 67
System Setup Menu . . . . . . . . . . . . . . . . . . . 67
System Setup Options at Boot . . . . . . . . . . . . . . 68
Using the System Setup Program Navigation
Keys. . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
General Help . . . . . . . . . . . . . . . . . . . . . . . 69
Console Redirection . . . . . . . . . . . . . . . . . . . 69
Enabling and Configuring Console
Redirection . . . . . . . . . . . . . . . . . . . . . 69
Main Menu . . . . . . . . . . . . . . . . . . . . . . . . 74
Main Screen . . . . . . . . . . . . . . . . . . . . 74
System Settings. . . . . . . . . . . . . . . . . . . 75

Contents 5
Advanced Menu . . . . . . . . . . . . . . . . . . . . . 77
Power Management . . . . . . . . . . . . . . . . 78
CPU Configuration . . . . . . . . . . . . . . . . . 88
Memory Configuration . . . . . . . . . . . . . . . 92
SATA Configuration. . . . . . . . . . . . . . . . . 95
PCI Configuration . . . . . . . . . . . . . . . . . . 98
USB Configuration . . . . . . . . . . . . . . . . . 105
Security Menu . . . . . . . . . . . . . . . . . . . . . . 107
Server Menu . . . . . . . . . . . . . . . . . . . . . . . 109
View System Log . . . . . . . . . . . . . . . . . . 115
Boot Menu . . . . . . . . . . . . . . . . . . . . . . . . 116
Exit Menu . . . . . . . . . . . . . . . . . . . . . . . . 118
Command Line Interfaces for System Setup
Options . . . . . . . . . . . . . . . . . . . . . . . . . . 120
IPMI Command List . . . . . . . . . . . . . . . . . . . 146
Power Management Settings . . . . . . . . . . . . . . 155
SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . 157
About MIB and Traps. . . . . . . . . . . . . . . . 157
SNMP Support for the Server Enclosure
Fan Controller Board . . . . . . . . . . . . . . . . 157
FCB Firmware Behavior . . . . . . . . . . . . . . 159
MIB Tree Diagram for FCB . . . . . . . . . . . . . 161
FCB SNMP MIB. . . . . . . . . . . . . . . . . . . 162
SNMP Support for the External PDU Power
Management Controller Board . . . . . . . . . . . 168
PMC Firmware Behavior . . . . . . . . . . . . . . 170
MIB Tree Diagram for PMC . . . . . . . . . . . . 171
PMC SNMP MIB . . . . . . . . . . . . . . . . . . 172

6Contents
3 Installing System Components . . . . . . . 187
Safety Instructions . . . . . . . . . . . . . . . . . . . 187
About the Illustrations . . . . . . . . . . . . . . . . . 188
Recommended Tools . . . . . . . . . . . . . . . . . . 188
Inside the System. . . . . . . . . . . . . . . . . . . . 189
Sled Blank . . . . . . . . . . . . . . . . . . . . . . . 190
Removing a Double-Wide Sled Blank . . . . . . 190
Installing a Double-Wide Sled Blank . . . . . . . 190
Removing a Single-Wide Sled Blank . . . . . . . 191
Installing a Single-Wide Sled Blank . . . . . . . 191
Compute Sleds . . . . . . . . . . . . . . . . . . . . . 192
Removing a Compute Sled . . . . . . . . . . . . 192
Installing a Compute Sled. . . . . . . . . . . . . 194
Storage Sled . . . . . . . . . . . . . . . . . . . . . . 194
Removing a Storage Sled . . . . . . . . . . . . . 194
Installing a Storage Sled . . . . . . . . . . . . . 195
Power Sled . . . . . . . . . . . . . . . . . . . . . . . 196
Inside a Power Sled. . . . . . . . . . . . . . . . 198
Removing a Power Sled. . . . . . . . . . . . . . 198
Installing a Power Sled . . . . . . . . . . . . . . 200
Removing the PSU1/3 Module Assembly . . . . . 201
Installing the PSU1/3 Module Assembly . . . . . 203
Removing the PSU2/4 Module Assembly . . . . . 203
Installing the PSU2/4 Module Assembly . . . . . 204
Removing the PSU Module . . . . . . . . . . . . 205
Installing the PSU Module . . . . . . . . . . . . 206

Contents 7
Fan Modules . . . . . . . . . . . . . . . . . . . . . . . 207
Removing a Fan Module . . . . . . . . . . . . . . 207
Installing a Fan Module. . . . . . . . . . . . . . . 208
Front Panel Board . . . . . . . . . . . . . . . . . . . . 209
Removing the Front Panel Board . . . . . . . . . . 209
Installing the Front Panel Board . . . . . . . . . . 210
Fan Controller Board. . . . . . . . . . . . . . . . . . . 211
Removing the Fan Controller Board . . . . . . . . 211
Installing the Fan Controller Board . . . . . . . . . 212
Backplane/Fan Bay Cage . . . . . . . . . . . . . . . . 212
Removing the Backplane/Fan Bay Cage . . . . . . 212
Installing the Backplane/Fan Bay Cage . . . . . . 216
PDU Power Supply. . . . . . . . . . . . . . . . . . . . 217
PDU Power Supply Indicator Code . . . . . . . . . 217
Removing a PDU Power Supply . . . . . . . . . . 217
Installing a PDU Power Supply . . . . . . . . . . . 219
4 Rack Mount Configuration . . . . . . . . . . 221
Installation Guidelines . . . . . . . . . . . . . . . . . 221
Recommended Tools. . . . . . . . . . . . . . . . . . . 222
Installation Tasks . . . . . . . . . . . . . . . . . . . . 222
Installing the Tool-Less Rail Solution
in the Rack . . . . . . . . . . . . . . . . . . . . . . . . 223
Removing Sled Modules from the Server
Enclosure . . . . . . . . . . . . . . . . . . . . . . . . 228
Installing the Server Enclosure into the Rack . . . . . 228

8Contents
Replacing Sled Modules in the Server
Enclosure. . . . . . . . . . . . . . . . . . . . . . . . 230
Installing the External PDU into the Rack . . . . . . . 231
Connecting the Power Cables . . . . . . . . . . . . . 237
Connecting the Power Cables to the
Server Enclosure with Internal Power
Source . . . . . . . . . . . . . . . . . . . . . . 237
Connecting the Power Cable to the
Server Enclosure with External Power
Source . . . . . . . . . . . . . . . . . . . . . . 238
Connecting the Server Enclosure to a Rack
PDU . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
Connecting a Network Switch to a Rack PDU . . . . 242
Connecting the PDU to the Network. . . . . . . . . . 243
Powering Up the Systems . . . . . . . . . . . . . . . 246
5 Troubleshooting. . . . . . . . . . . . . . . . . . . 251
Safety First—For You and Your System . . . . . . . . 251
Installation Problems . . . . . . . . . . . . . . . . . 251
Troubleshooting System Startup Failure. . . . . . . . 252
Troubleshooting External Connections . . . . . . . . 252
Troubleshooting the Video Subsystem. . . . . . . . . 252
Troubleshooting a USB Device . . . . . . . . . . . . 252
Troubleshooting a Serial I/O Device. . . . . . . . . . 253
Troubleshooting a NIC . . . . . . . . . . . . . . . . . 254

Contents 9
Troubleshooting a Wet Enclosure . . . . . . . . . . . . 255
Troubleshooting a Damaged Enclosure . . . . . . . . . 256
Troubleshooting Enclosure Fan Modules . . . . . . . . 257
Troubleshooting Cooling Problems . . . . . . . . . . . 262
Troubleshooting Sled Components . . . . . . . . . . . 267
Troubleshooting System Memory . . . . . . . . . 267
Troubleshooting a Hard-Drive . . . . . . . . . . . 269
Troubleshooting Expansion Cards . . . . . . . . . 270
Troubleshooting Processors . . . . . . . . . . . . 270
Troubleshooting the System Board . . . . . . . . 271
Troubleshooting the System Battery . . . . . . . . 272
IRQ Assignment Conflicts . . . . . . . . . . . . . . . . 273
6 Updating Firmware Images
and Monitoring the PDU Power
Status . . . . . . . . . . . . . . . . . . . . . . . . . . 275
Verifying and Updating the Fan Controller
Board Firmware Via the Compute Sled . . . . . . . . . 275
Viewing the Fan Controller Board
Firmware Version Information . . . . . . . . . . . 275
Updating the Fan Controller Board
Firmware . . . . . . . . . . . . . . . . . . . . . . 275
Verifying and Updating the Fan Controller
Board Firmware Via SNMP . . . . . . . . . . . . . . . 276
Before You Begin . . . . . . . . . . . . . . . . . . 276
Checking FCB Indicators . . . . . . . . . . . . . . 277
Resetting the FCB Network Connection . . . . . . 277
Viewing or Changing the FCB Configuration
Information . . . . . . . . . . . . . . . . . . . . . 278

10 Contents
Configuring the SNMP Traps . . . . . . . . . . . 278
Updating the FCB Firmware. . . . . . . . . . . . 279
Viewing the FCB Firmware Version
Information . . . . . . . . . . . . . . . . . . . . 280
Monitoring the External PDU Power Status
and Updating the PDU PMC Firmware. . . . . . . . . 280
Before You Begin . . . . . . . . . . . . . . . . . 280
Checking PDU Indicators . . . . . . . . . . . . . 281
Resetting the PDU Network Connection . . . . . 281
Viewing or Changing the PMC
Configuration Information. . . . . . . . . . . . . 282
Configuring the SNMP Traps . . . . . . . . . . . 282
Updating the PMC Firmware . . . . . . . . . . . 283
Viewing the PMC Firmware Version
Information . . . . . . . . . . . . . . . . . . . . 284
7 Jumpers and Connectors. . . . . . . . . . . . 285
Server Enclosure Boards . . . . . . . . . . . . . . . 285
Front Panel Board Connectors . . . . . . . . . . 285
Fan Controller Board Connectors. . . . . . . . . 286
Power Management Board Connectors . . . . . 287
8 Getting Help . . . . . . . . . . . . . . . . . . . . . . 289
Contacting Dell . . . . . . . . . . . . . . . . . . 289
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291

About the System 11
1
About the System
The PowerEdge C8000 server enclosure features ten vertically aligned sled
bays which support a full sled or a mixed sled enclosure. A full sled enclosure
can include up to five C8220X double-wide compute sleds, ten C8220
single-wide compute sleds, or five C8000XD storage sleds. A mixed sled
enclosure can support a mixture of differing sled types. To function as a
system, a compute sled is inserted into the PowerEdge C8000 server enclosure
that supports fans and is connected to an external power source or an internal
power source (power sleds). The redundant system fans are shared resources
of the sleds in the PowerEdge C8000 server enclosure.
NOTE: To ensure proper operation and cooling, all bays in the enclosure must be
populated at all times with either a sled or with a sled blank.
NOTE: Throughout this manual, the PowerEdge C8000 server enclosure is referred
to as simply the "server enclosure" or the "chassis".

12 About the System
Accessing System Features During Startup
The following keystrokes provide access to system features during startup.
The SAS/SATA card or PXE hotkey support are available only in the BIOS
boot mode. Hotkey function is not available in the Unified Extensible
Firmware Interface (UEFI) boot mode.
Keystroke Description
<F2> Enters the System Setup program. See "System Setup Menu" on
page 67.
<F11> Enters the BIOS Boot Manager or the Unified Extensible
Firmware Interface (UEFI) Boot Manager, depending on the
system's boot configuration.
<F12> Starts Preboot eXecution Environment (PXE) boot.
<Ctrl><C> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the SAS adapter documentation.
<Ctrl><H> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the documentation for your SAS RAID
card.
<Ctrl><S> Enters the utility to configure onboard NIC settings for PXE boot.
For more information, see the documentation for your integrated
NIC.
<Ctrl><I> Enters the onboard SAS and SATA controller’s configuration
utility.

About the System 13
Front-Panel Features and Indicators
Figure 1-1. Front-Panel Features and Indicators
Item Feature Icon Description
1 - 10 Sled bays 1 to 10 Installs up to five C8220X compute sleds,
ten C8220 compute sleds, five C8000XD
storage sleds, or a mixture of differing sled
types.
NOTE: Sled bays 1 and 2 support installation
of two C8220 or one C8220X compute sleds.
For server enclosure with internal power
source, C8000XD storage sleds install in sled
bays 3 to 10 only.
Sled bays 5 and 6 Installs up to two power sleds or two C8220
compute sleds or a combination of the two
sled types.
NOTE: If the enclosure is configured with
only one power sled, a C8220 compute sled
or a power sled blank must be mounted into
the adjacent sled bay.
NOTE: The sled bays must always be
populated with either a sled or a sled blank
to ensure proper system cooling.

14 About the System
11 Chassis status
indicator
Indicates the power and health status of
the whole system.
12 Chassis
identification
indicator
Lights blue when the chassis ID signal is
generated.
13 Thermal sensor Monitors the inlet ambient temperature.
14 Ethernet connector Embedded 10/100 Mbit NIC connector.
15 NIC link/activity
indicator
Indicates state of the network link and
activity.
Item Feature Icon Description

About the System 15
Back-Panel Features and Indicators
Figure 1-2. Back-Panel Features and Indicators — Server Enclosure with Internal
Power Source
Item Feature Icon Description
1 Fan modules Provides cooling solution to the enclosure.
2 AC power sockets Connect the power cables to these power
sockets. When connected to a power
source, main power is automatically
distributed to the enclosure.
NOTE: Always connect the enclosure's AC
power sockets to a single power source,
switch, or PDU.
NOTE: Before installing a compute or
storage sled to the front of the enclosure,
install the power sleds and connect power to
the enclosure.
3, 4, 5 Fan fault indicators
1 to 6
Indicates the function status of the system
fans.
1
22 3
4
5
6
7
8910

16 About the System
Figure 1-3. Back-Panel Features and Indicators — Server Enclosure with External
Power Source
6Servicemode
button
Press this button within 4 seconds to enter
service mode.
7ExternalPDU
connector
Connects to a PDU control connector.
8 BMC management
port
Dedicated management port.
9Chassis
identification
indicator
Lights blue when the chassis ID signal is
generated.
10 Power/event
indicator
Indicates the power and health status of the
enclosure.
Item Feature Icon Description
1
2
3
4
5
6
789
10

About the System 17
Item Feature Icon Description
1 Fan modules Provides cooling solution to the enclosure.
2, 3, 4 Fan fault indicators
1 to 6
Indicates the function status of the system
fans.
5Servicemode
button
Press this button within 4 seconds to enter
service mode.
6ExternalPDU
connector
Connects to a PDU control connector.
7 BMC management
port
Dedicated management port.
8 Chassis
identification
indicator
Lights blue when the chassis ID signal is
generated.
9Power/event
indicator
Indicates the power and health status of the
enclosure.
10 DC power socket Connect the DC power cable to this power
socket. When connected to an external
PDU, main power is automatically
distributed to the enclosure.
NOTE: Always connect the enclosure's DC
power socket to a PDU.
NOTE: Before installing a compute or
storage sled to the front of the enclosure,
connect power to the enclosure.

18 About the System
Server Enclosure Indicator Codes
The indicators on the front and back of the server enclosure displays
operational status of the enclosure, fan modules, and chassis controller
boards.
Figure 1-4. Server Enclosure Front-Panel Indicators
Item Indicator Color Status Indicator Code
1 Chassis status
indicator
Green Solid Indicates a valid power source is
connected to the server enclosure
and that the enclosure is
operational.
Off Off Power is not connected.
Amber Blinking Indicates a fault event occurred.
2 Chassis
identification
indicator
Blue Blinking Indicates a chassis ID signal is
generated.
Blue Off Chassis ID signal is not generated.
3 NIC link/activity
indicator
Green Solid Linking at 100 Mbps speed
(maximum).
Green Blinking Transmit or receive activity.
Off Off No activity.

About the System 19
Figure 1-5. Server Enclosure Back-Panel Indicators
Item Indicator Color Status Indicator Code
1Power/event
indicator
Green Solid Indicates a valid power source is
connected to the server enclosure
and that the enclosure is
operational and power is applied to
the fan controller board.
Green Blinking Power is connected to the
enclosure but the managed devices’
or sleds’ power is off.
Amber Blinking Indicates a fault event occurred.
Off Off Power is not connected.
2Chassis
identification
indicator
Blue Blinking Indicates a chassis ID signal is
generated.
Blue Off Chassis ID signal is not generated.
3 Fan 1 and 2
fault indicator
Amber Blinking Indicates a fault event occurred in
fans 1 and 2.
Off Off Fans 1 and 2 are operational.
4 Fan 3 and 4
fault indicator
Amber Blinking Indicates a fault event occurred in
fans 3 and 4.
Off Off Fans 3 and 4 are operational.
5
4
3
21

20 About the System
NIC Indicator Codes
Figure 1-6. NIC Indicators (Front-Panel Ethernet Connector)
5 Fan 5 and 6
fault indicator
Amber Blinking Indicates a fault event occurred in
fans 5 and 6.
Off Off Fans 5 and 6 are operational.
1 link indicator 2 activity indicator
Indicator Status Indicator Code
Link indicator Solid amber Linking at 10 Mbps port speed
Solid green Linking at 100 Mbps port speed (maximum)
Activity
indicator
Solid green No activity
Blinking green Transmit or receive activity
Off Idle
Item Indicator Color Status Indicator Code