Dell PowerEdge C8000 User manual

Dell PowerEdge C8220X
Hardware Owner’s
Manual
Regulatory Model: B06B
Regulatory Type: B06B001

Notes, Cautions, and Warnings
NOTE: A NOTE indicates important information that helps you make better use of
your computer.
CAUTION: A CAUTION indicates potential damage to hardware or loss of data if
instructions are not followed.
WARNING: A WARNING indicates a potential for property damage, personal
injury, or death.
____________________
Information in this publication is subject to change without notice.
© 2012 Dell Inc. All rights reserved.
Reproduction of these materials in anymanner whatsoever without the written permissionof Dell Inc.
is strictly forbidden.
Trademarks used in this text: Dell™, the DELL logo, and PowerEdge™ are trademarks of Dell Inc.
Intel is a registered trademark of Intel Corporation in the U.S. and other countries.
Othertrademarksandtradenamesmaybeusedinthispublicationtorefertoeithertheentitiesclaiming
the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and
trade names other than its own.
Regulatory Model B06B
Regulatory Type: B06B001
2012 - 08 P/N XXXXX Rev. A00

Contents 3
Contents
1 About Your System . . . . . . . . . . . . . . . . . 13
Accessing System Features During Startup. . . . . . . 13
Front-Panel Features and Indicators . . . . . . . . . . 14
NIC Indicator Codes . . . . . . . . . . . . . . . . . . . 18
Management Interface . . . . . . . . . . . . . . . . . 20
Non-Central Independent Mode . . . . . . . . . . 20
Non-Central Consolidated Mode . . . . . . . . . . 22
Hard-Drive Indicator Patterns . . . . . . . . . . . . . . 24
Hot-Plug Hard-Drive Indicators . . . . . . . . . . 24
Sled Hard-Drive LEDs. . . . . . . . . . . . . . . . 25
Power and System Board Indicator Codes . . . . . . . 26
BMC Heartbeat Indicator Codes. . . . . . . . . . . . . 27
Service Tag. . . . . . . . . . . . . . . . . . . . . . . . 28
POST Error Codes . . . . . . . . . . . . . . . . . . . . 30
Collecting System Event Log for
Investigation . . . . . . . . . . . . . . . . . . . . 30
System Event Log. . . . . . . . . . . . . . . . . . . . . 38
Processor Error. . . . . . . . . . . . . . . . . . . 38
Memory Ecc . . . . . . . . . . . . . . . . . . . . 39
PCIe Error . . . . . . . . . . . . . . . . . . . . . . 41
IOH Core Error . . . . . . . . . . . . . . . . . . . 42
SB Error . . . . . . . . . . . . . . . . . . . . . . . 43

4Contents
POST Start Event . . . . . . . . . . . . . . . . . . 44
POST End Event . . . . . . . . . . . . . . . . . . . 45
POST Error Code Event . . . . . . . . . . . . . . . 46
BIOS Recovery Event . . . . . . . . . . . . . . . . 47
ME Fail Event . . . . . . . . . . . . . . . . . . . . 48
SEL Generator ID . . . . . . . . . . . . . . . . . . 48
BMC . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Other Information You May Need . . . . . . . . . . . . 54
2 Using the System Setup Program . . . . . 55
System Setup Menu . . . . . . . . . . . . . . . . . . . 55
System Setup Options at Boot . . . . . . . . . . . . . . 56
Using the System Setup Program Navigation
Keys. . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
General Help . . . . . . . . . . . . . . . . . . . . . . . 57
Console Redirection . . . . . . . . . . . . . . . . . . . 57
Enabling and Configuring Console
Redirection . . . . . . . . . . . . . . . . . . . . . 57
Main Menu . . . . . . . . . . . . . . . . . . . . . . . . 63
Main Screen . . . . . . . . . . . . . . . . . . . . 63
System Settings. . . . . . . . . . . . . . . . . . . 64
Advanced Menu . . . . . . . . . . . . . . . . . . . . . 66
Power Management . . . . . . . . . . . . . . . . 67
CPU Configuration . . . . . . . . . . . . . . . . . 73
Memory Configuration . . . . . . . . . . . . . . . 76
SATA Configuration . . . . . . . . . . . . . . . . . 78
PCI Configuration . . . . . . . . . . . . . . . . . . 81
USB Configuration . . . . . . . . . . . . . . . . . 88

Contents 5
Security Menu . . . . . . . . . . . . . . . . . . . . . . 89
Server Menu . . . . . . . . . . . . . . . . . . . . . . . 91
View System Log . . . . . . . . . . . . . . . . . . 96
Boot Menu . . . . . . . . . . . . . . . . . . . . . . . . 97
Exit Menu . . . . . . . . . . . . . . . . . . . . . . . . 99
Command Line Interfaces for System Setup
Options . . . . . . . . . . . . . . . . . . . . . . . . . . 101
IPMI Command List . . . . . . . . . . . . . . . . . . . 124
Power Management Settings . . . . . . . . . . . . . . 133
3 Installing System Components . . . . . . . 135
Safety Instructions. . . . . . . . . . . . . . . . . . . . 135
Recommended Tools. . . . . . . . . . . . . . . . . . . 136
Inside the System . . . . . . . . . . . . . . . . . . . . 137
Sled Configuration . . . . . . . . . . . . . . . . . . . . 140
Sled. . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
Removing a Sled . . . . . . . . . . . . . . . . . . 141
Installing a Sled. . . . . . . . . . . . . . . . . . . 142
Sled Blank . . . . . . . . . . . . . . . . . . . . . . . . 142
Removing a Sled Blank . . . . . . . . . . . . . . . 142
Installing a Sled Blank . . . . . . . . . . . . . . . 143
Hard-Drive . . . . . . . . . . . . . . . . . . . . . . . . 143
Hard-Drive Locations . . . . . . . . . . . . . . . . 143
Front-Access Hard-Drives . . . . . . . . . . . . . 146
Removing a Hard-Drive Blank . . . . . . . . . . . 146

6Contents
Installing a Hard-Drive Blank . . . . . . . . . . . 147
Removing a Hard-Drive Carrier . . . . . . . . . 147
Installing a Hard-Drive Carrier . . . . . . . . . . 148
Removing a Hard-Drive From
a Hard-Drive Carrier . . . . . . . . . . . . . . . 149
Hard-Drive Cage Hard-Drives . . . . . . . . . . 150
Removing a Hard-Drive Carrier
Located on the Sled Cover . . . . . . . . . . . . 150
Installing a Hard-Drive Carrier
on the Sled Cover . . . . . . . . . . . . . . . . . 152
Removing a Hard-Drive From
a Hard-Drive Carrier . . . . . . . . . . . . . . . 153
Installing a Hard-Drive Into
a Hard-Drive Carrier . . . . . . . . . . . . . . . 154
Internal Hard-Drives . . . . . . . . . . . . . . . 154
Removing a Hard-Drive Carrier
Located on the Sled Tray . . . . . . . . . . . . . 154
Installing a Hard-Drive Carrier
on the Sled Tray. . . . . . . . . . . . . . . . . . 156
Removing a Hard-Drive From
a Hard-Drive Carrier . . . . . . . . . . . . . . . 156
Installing a Hard-Drive Into
a Hard-Drive Carrier . . . . . . . . . . . . . . . 157
Removing the Hard-Drive Tray . . . . . . . . . . 158
Installing the Hard-Drive Tray . . . . . . . . . . 159
SD Card . . . . . . . . . . . . . . . . . . . . . . . . . 160
Removing a SD Card . . . . . . . . . . . . . . . 160
Installing a SD Card . . . . . . . . . . . . . . . . 161
Sled Covers. . . . . . . . . . . . . . . . . . . . . . . 161
Removing the Front and Back Sled
Covers. . . . . . . . . . . . . . . . . . . . . . . 161
Installing the Front and Back Sled
Covers. . . . . . . . . . . . . . . . . . . . . . . 165
Removing the Sled Cover . . . . . . . . . . . . . 166

Contents 7
Installing the Sled Cover . . . . . . . . . . . . . . 168
Hot-Plug Hard-Drive Backplane. . . . . . . . . . . . . 169
Removing the Hot-Plug Hard-Drive
Backplane . . . . . . . . . . . . . . . . . . . . . 169
Installing the Hot-Plug Hard-Drive
Backplane . . . . . . . . . . . . . . . . . . . . . 173
Hard-Drive LED Board Assembly . . . . . . . . . . . . 173
Removing the Hard-Drive LED Board
Assembly . . . . . . . . . . . . . . . . . . . . . . 173
Installing the Hard-Drive LED Board
Assembly . . . . . . . . . . . . . . . . . . . . . . 174
Removing the Hard-Drive LED Board. . . . . . . . 175
Installing the Hard-Drive LED Board . . . . . . . . 176
Removing the RAID Battery . . . . . . . . . . . . 176
Installing the RAID Battery . . . . . . . . . . . . . 177
Expansion Cards . . . . . . . . . . . . . . . . . . . . . 178
Removing the MegaRAID SAS 9265-8i
Card . . . . . . . . . . . . . . . . . . . . . . . . . 178
Installing the MegaRAID SAS 9268-8i
Card . . . . . . . . . . . . . . . . . . . . . . . . . 184
Expansion Card Risers. . . . . . . . . . . . . . . . . . 185
Removing the Expansion Card Risers . . . . . . . 185
Installing the Expansion Card Risers . . . . . . . . 186
GPGPU Card Assembly . . . . . . . . . . . . . . . . . 187
Removing the Front GPGPU Card
Assembly . . . . . . . . . . . . . . . . . . . . . . 188
Installing the Front GPGPU Card
Assembly . . . . . . . . . . . . . . . . . . . . . . 193
Removing the Back GPGPU Card
Assembly . . . . . . . . . . . . . . . . . . . . . . 194
Installing the Back GPGPU Card
Assembly . . . . . . . . . . . . . . . . . . . . . . 200

8Contents
Removing the NVIDIA Tesla M2090
GPGPU Card. . . . . . . . . . . . . . . . . . . . 201
Installing the NVIDIA Tesla M2090
GPGPU Card. . . . . . . . . . . . . . . . . . . . 202
GPGPU Card Risers . . . . . . . . . . . . . . . . . . 202
Removing the Front GPGPU Card Riser. . . . . . 202
Installing the Front GPGPU Card Riser . . . . . . 203
Removing the Back GPGPU Card Riser. . . . . . 204
Installing the Back GPGPU Card Riser . . . . . . 205
Hard-Drive Cage Backplane . . . . . . . . . . . . . . 205
Removing the 2.5-inch Hard-Drive
Cage Backplane. . . . . . . . . . . . . . . . . . 205
Installing the 2.5-inch Hard-Drive
Cage Backplane. . . . . . . . . . . . . . . . . . 207
Removing the 3.5-inch Hard-Drive
Cage Backplane. . . . . . . . . . . . . . . . . . 208
Installing the 3.5-inch Hard-Drive
Cage Backplane. . . . . . . . . . . . . . . . . . 209
Cooling Shroud . . . . . . . . . . . . . . . . . . . . . 210
Removing the Cooling Shroud . . . . . . . . . . 210
Installing the Cooling Shroud . . . . . . . . . . . 211
Heat Sink . . . . . . . . . . . . . . . . . . . . . . . . 212
Removing a Heat Sink. . . . . . . . . . . . . . . 212
Installing a Heat Sink . . . . . . . . . . . . . . . 214
Processors . . . . . . . . . . . . . . . . . . . . . . . 215
Removing a Processor . . . . . . . . . . . . . . 215
Installing a Processor. . . . . . . . . . . . . . . 217
System Memory . . . . . . . . . . . . . . . . . . . . 218
Memory Module Installation Guidelines . . . . . 218
Supported DIMM Configuration . . . . . . . . . 219
Removing Memory Modules . . . . . . . . . . . 221

Contents 9
Installing Memory Modules . . . . . . . . . . . . 222
Mezzanine Cards. . . . . . . . . . . . . . . . . . . . . 223
Removing the SAS Mezzanine Card . . . . . . . . 223
Installing the SAS Mezzanine Card. . . . . . . . . 229
Removing the Infiniband Mezzanine Card . . . . . 229
Installing the Infiniband Mezzanine Card . . . . . 232
Removing the 10 GbE Mezzanine Card . . . . . . . 233
Installing the 10 GbE Mezzanine Card . . . . . . . 236
SD Card Reader . . . . . . . . . . . . . . . . . . . . . 237
Removing the SD Card Reader . . . . . . . . . . . 237
Installing the SD Card Reader . . . . . . . . . . . 239
Removing the SD Card Reader Support
Bracket . . . . . . . . . . . . . . . . . . . . . . . 240
Installing the SD Card Reader Support
Bracket . . . . . . . . . . . . . . . . . . . . . . . 241
Interposer Extender . . . . . . . . . . . . . . . . . . . 242
Removing the Interposer Extender . . . . . . . . . 242
Installing the Interposer Extender . . . . . . . . . 243
BMC Management Cable (Optional) . . . . . . . . . . 244
Removing the BMC Management Cable . . . . . . 244
Installing the BMC Management Cable . . . . . . 245
Node Power Distribution Board . . . . . . . . . . . . . 246
Removing the Node Power Distribution
Board . . . . . . . . . . . . . . . . . . . . . . . . 246
Installing the Node Power Distribution
Board . . . . . . . . . . . . . . . . . . . . . . . . 248
Removing the Node Power Distribution
Board Located on the Sled Cover . . . . . . . . . 248
Installing the Node Power Distribution
Board on the Sled Cover . . . . . . . . . . . . . . 251

10 Contents
System Battery . . . . . . . . . . . . . . . . . . . . . 252
Removing the System Battery . . . . . . . . . . 252
Installing the System Battery . . . . . . . . . . . 253
System Board. . . . . . . . . . . . . . . . . . . . . . 254
Removing the System Board . . . . . . . . . . . 254
Installing the System Board . . . . . . . . . . . 256
4 Troubleshooting. . . . . . . . . . . . . . . . . . . 259
Safety First—For You and Your System . . . . . . . . 259
Installation Problems . . . . . . . . . . . . . . . . . 259
Troubleshooting System Startup Failure. . . . . . . . 260
Troubleshooting External Connections . . . . . . . . 260
Troubleshooting the Video Subsystem. . . . . . . . . 260
Troubleshooting a USB Device . . . . . . . . . . . . 260
Troubleshooting a Serial I/O Device. . . . . . . . . . 261
Troubleshooting a NIC . . . . . . . . . . . . . . . . . 262
Troubleshooting a Wet Enclosure . . . . . . . . . . . 263
Troubleshooting a Damaged Enclosure . . . . . . . . 264
Troubleshooting the Enclosure Fan Modules . . . . . 265
Troubleshooting the Power Sled . . . . . . . . . . . 267
Troubleshooting System Memory . . . . . . . . . . . 267
Troubleshooting a Hard-Drive . . . . . . . . . . . . . 269
Troubleshooting a Storage Controller . . . . . . . . . 270

Contents 11
Troubleshooting Expansion Cards. . . . . . . . . . . . 271
Troubleshooting Processors. . . . . . . . . . . . . . . 272
Troubleshooting the System Board . . . . . . . . . . . 273
Troubleshooting the System Battery. . . . . . . . . . . 274
IRQ Assignment Conflicts . . . . . . . . . . . . . . . . 275
5 Jumpers and Connectors . . . . . . . . . . . 277
System Board Jumper Settings . . . . . . . . . . . . . 277
System Board Connectors . . . . . . . . . . . . . . . . 279
Backplane Connectors . . . . . . . . . . . . . . . . . 281
2.5-inch Hot-Plug Hard-Drive Backplane. . . . . . 281
2.5-inch Hard-Drive Cage Backplane . . . . . . . 282
3.5-inch Hard-Drive Cage Backplane . . . . . . . 283
Hard-Drive LED Board Connectors . . . . . . . . . . . 284
Interposer Extender Connectors. . . . . . . . . . . . . 285
SD Card Reader Connectors . . . . . . . . . . . . . . . 286
Node Power Distribution Board Connectors . . . . . . 287
6 Getting Help. . . . . . . . . . . . . . . . . . . . . . 289
Contacting Dell . . . . . . . . . . . . . . . . . . . 289
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291

12 Contents

About Your System 13
1
About Your System
Accessing System Features During Startup
The following keystrokes provide access to system features during startup.
The SAS/SATA card or PXE hotkey support are available only in the BIOS
boot mode. Hotkey function is not available in the Unified Extensible
Firmware Interface (UEFI) boot mode.
Keystroke Description
<F2> Enters the System Setup program. See "System Setup Menu" on
page 55.
<F11> Enters the BIOS Boot Manager or the Unified Extensible
Firmware Interface (UEFI) Boot Manager, depending on the
system's boot configuration. See "System Setup Options at Boot"
on page 56.
<F12> Starts Preboot eXecution Environment (PXE) boot.
<Ctrl><C> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the SAS adapter documentation.
<Ctrl><H> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the documentation for your SAS RAID
card.
<Ctrl><S> Enters the utility to configure onboard NIC settings for PXE boot.
For more information, see the documentation for your integrated
NIC.
<Ctrl><I> Enters the onboard SAS and SATA controller’s configuration
utility.

14 About Your System
Front-Panel Features and Indicators
Figure 1-1. Sled Front Features — C8220X Double-Wide Compute Sled with
Front-Access 2.5-inch Hot-Plug Hard-Drives
Item Indicator, Button, or
Connector
Icon Description
1 USB connectors Connects USB devices to the system. The
ports are USB 2.0 compliant.
2 Mezzanine card
expansion slot
Installs an I/O module mezzanine card.
3 Hard-drive LED
0 to 7
Indicates drive activity and status.
4, 5 Hard-drive bay Installs two 2.5-inch hot-plug hard-drives.
6, 7 Low profile PCIe
expansion slots
Installs up to two low profile PCI Express
x8 card when plugged into horizontal
expansion card connectors.
8 Sled release latch Press to release the sled from the
enclosure.

About Your System 15
9 Power on indicator/
power button
The power-on indicator lights when the
sled power is on.
The power-on indicator lights amber
when the system critical event occurs.
The power button turns the compute
sled on.
NOTE: When powering on the sled, the
video monitor can take from several
seconds to over 2 minutes to display an
image, depending on the amount of memory
installed in the system.
NOTE: On ACPI-compliant operating
systems, turning off the sled using the
power button causes the sled to perform a
graceful shutdown before power to the sled
is turned off.
NOTE: To force an ungraceful shutdown,
press and hold the power button for five
seconds.
10 VGA connector Connects a VGA display to the system.
11 Serial connector Connects a serial device to the system.
12 BMC management
port
Dedicated management port.
13 Ethernet connector 2 Embedded 10/100/1000 Mbit NIC
connector.
14 Ethernet connector 1 Embedded 10/100/1000 Mbit NIC
connector.
15 Sled identification
indicator
Lights blue to identify a particular system
and system board.
16 Handle Hold to pull the sled from the enclosure.
Item Indicator, Button, or
Connector
Icon Description
2
1

16 About Your System
Figure 1-2. Sled Features — C8220X Double-Wide Compute Sled with GPGPU Card
Item Indicator, Button, or
Connector
Icon Description
1 USB connectors Connects USB devices to the system. The
ports are USB 2.0 compliant.
2 Mezzanine card
expansion slot
Installs an I/O module mezzanine card.
3Sledcover/GPGPU
card assembly
Installs up to two general-purpose
graphics processing unit (GPGPU) cards
when plugged into horizontal expansion
card risers.
4 Sled release latch Press to release the sled from the
enclosure.
1
3
4
5
6
7
8
9
10
11
2
12

About Your System 17
5 Power on indicator/
power button
The power-on indicator lights when the
sled power is on.
The power-on indicator lights amber
when the system critical event occurs.
The power button turns the compute
sled on.
NOTE: When powering on the sled, the
video monitor can take from several
seconds to over 2 minutes to display an
image, depending on the amount of memory
installed in the system.
NOTE: On ACPI-compliant operating
systems, turning off the sled using the
power button causes the sled to perform a
graceful shutdown before power to the sled
is turned off.
NOTE: To force an ungraceful shutdown,
press and hold the power button for five
seconds.
6 VGA connector Connects a VGA display to the system.
7 Serial connector Connects a serial device to the system.
8 BMC management
port
Dedicated management port.
9 Ethernet connector 2 Embedded 10/100/1000 Mbit NIC
connector.
10 Ethernet connector 1 Embedded 10/100/1000 Mbit NIC
connector.
11 Sled identification
indicator
Lights blue to identify a particular system
and system board.
12 Handle Hold to pull the sled from the enclosure.
Item Indicator, Button, or
Connector
Icon Description
2
1

18 About Your System
NIC Indicator Codes
Figure 1-3. NIC Indicators
1 link indicator 2 activity indicator
Indicator Status Indicator Code
Link indicator Solid amber Linking at 100 Mbps port speed
Solid green Linking at 1 Gbps port speed (maximum)
Blinking green Linking at 1 Gbps port speed
Network activity is present
•PreOSPOST
• OS without driver
•OSwithdriver
Blinks at speed relative to packet density
Off Linking at 10 Mbps port speed
Activity
indicator
Solid green No activity
Blinking green Transmit or receive activity
Off Idle

About Your System 19
Figure 1-4. NIC Indicators (BMC management port)
1 link indicator 2 activity indicator
Indicator Status Indicator Code
Link indicator Blinking amber Linking at 10 Mbps port speed
Blinking green Linking at 100 Mbps port speed (maximum)
Activity
indicator
Solid green No activity
Blinking green Transmit or receive activity
Off Idle

20 About Your System
Management Interface
The sled includes a BMC that is responsible for monitoring the sled for
critical events by communicating with various sensors on the system board,
the node power distribution board and if installed in the PowerEdge C8000
server enclosure it also communicates with the enclosure’s fan controller
board and send alerts and log events when certain parameters exceed their
preset thresholds.
You can access BMC using two modes of operation: non-central independent
mode or non-central consolidated mode. In the non-central independent
mode, you access BMC through dedicated-NIC using the sled’s BMC
management port. In the non-central consolidated mode, you access BMC
through shared-NIC using the PowerEdge C8000 server enclosure’s BMC
management port and Ethernet port.
Non-Central Independent Mode
To setup BMC connection using the non-central independent mode:
1
Before you setup BMC, you must first connect the sled to a local console
and configure the necessary system BIOS, network, and serial connection
settings to enable access to the BMC. See "Enabling and Configuring
Console Redirection Via BMC SOL" on page 59.
2 Remove the port cover on the sled’s BMC management port by using a
small flat blade screwdriver and pry the port cover off of the sled’s BMC
management port. Save the port cover for future use. See Figure 1-5.
3 Connect one end of the network cable to the sled’s BMC management
port.
4 Connect the other end of the network cable to an available port on the
Ethernet switch.
NOTE: Make sure to install the port covers in the PowerEdge C8000 server
enclosure’s BMC management port and Ethernet port. See Figure 1-6.