Dell PowerEdge C8220X User manual

Dell PowerEdge C8220X
Hardware Owner’s
Manual
Regulatory Model: B06B
Regulatory Type: B06B001

Notes, Cautions, and Warnings
NOTE: A NOTE indicates important information that helps you make better use of
your computer.
CAUTION: A CAUTION indicates potential damage to hardware or loss of data if
instructions are not followed.
WARNING: A WARNING indicates a potential for property damage, personal
injury, or death.
____________________
Information in this publication is subject to change without notice.
© 2014 Dell Inc. All rights reserved.
Reproduction of these materials in anymanner whatsoever without the written permissionof Dell Inc.
is strictly forbidden.
Trademarks used in this text: Dell™, the DELL logo, and PowerEdge™ are trademarks of Dell Inc.
Intel is a registered trademark of Intel Corporation in the U.S. and other countries.
Othertrademarksandtradenamesmaybeusedinthispublicationtorefertoeithertheentitiesclaiming
the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and
trade names other than its own.
Regulatory Model B06B
Regulatory Type: B06B001
2014 - 01 P/N XXXXX Rev. A07

Contents 3
Contents
1 About Your System . . . . . . . . . . . . . . . . . 15
Accessing System Features During Startup. . . . . . . 15
Front-Panel Features and Indicators . . . . . . . . . . 16
NIC Indicator Codes . . . . . . . . . . . . . . . . . . . 20
Management Interface . . . . . . . . . . . . . . . . . 22
Non-Central Independent Mode . . . . . . . . . . 22
Non-Central Consolidated Mode . . . . . . . . . . 24
Hard-Drive Indicator Patterns . . . . . . . . . . . . . . 27
Hot-Plug Hard-Drive Indicators . . . . . . . . . . 27
Sled Hard-Drive LEDs. . . . . . . . . . . . . . . . 28
Power and System Board Indicator Codes . . . . . . . 29
BMC Heartbeat Indicator Codes. . . . . . . . . . . . . 30
Service Tag. . . . . . . . . . . . . . . . . . . . . . . . 31
POST Error Codes . . . . . . . . . . . . . . . . . . . . 33
Collecting System Event Log for
Investigation . . . . . . . . . . . . . . . . . . . . 33
System Event Log. . . . . . . . . . . . . . . . . . . . . 41
Processor Error. . . . . . . . . . . . . . . . . . . 41
Memory Ecc . . . . . . . . . . . . . . . . . . . . 42
PCIe Error . . . . . . . . . . . . . . . . . . . . . . 44
IOH Core Error . . . . . . . . . . . . . . . . . . . 45
SB Error . . . . . . . . . . . . . . . . . . . . . . . 46

4Contents
POST Start Event . . . . . . . . . . . . . . . . . . 47
POST End Event . . . . . . . . . . . . . . . . . . . 48
POST Error Code Event . . . . . . . . . . . . . . . 49
BIOS Recovery Event . . . . . . . . . . . . . . . . 50
ME Fail Event . . . . . . . . . . . . . . . . . . . . 51
SEL Generator ID . . . . . . . . . . . . . . . . . . 51
BMC . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Other Information You May Need . . . . . . . . . . . . 57
2 Using the System Setup Program . . . . . 59
System Setup Menu . . . . . . . . . . . . . . . . . . . 59
System Setup Options at Boot . . . . . . . . . . . . . . 60
Using the System Setup Program Navigation
Keys. . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
General Help . . . . . . . . . . . . . . . . . . . . . . . 61
Console Redirection . . . . . . . . . . . . . . . . . . . 61
Enabling and Configuring Console
Redirection . . . . . . . . . . . . . . . . . . . . . 61
Main Menu . . . . . . . . . . . . . . . . . . . . . . . . 67
Main Screen . . . . . . . . . . . . . . . . . . . . 67
System Settings. . . . . . . . . . . . . . . . . . . 68
Advanced Menu . . . . . . . . . . . . . . . . . . . . . 70
Power Management . . . . . . . . . . . . . . . . 71
CPU Configuration . . . . . . . . . . . . . . . . . 81
Memory Configuration . . . . . . . . . . . . . . . 85
SATA Configuration . . . . . . . . . . . . . . . . . 88
PCI Configuration . . . . . . . . . . . . . . . . . . 91
USB Configuration . . . . . . . . . . . . . . . . . 98

Contents 5
Security Menu . . . . . . . . . . . . . . . . . . . . . . 100
Server Menu . . . . . . . . . . . . . . . . . . . . . . . 102
View System Log . . . . . . . . . . . . . . . . . . 108
Boot Menu . . . . . . . . . . . . . . . . . . . . . . . . 109
Exit Menu . . . . . . . . . . . . . . . . . . . . . . . . 111
Command Line Interfaces for System Setup
Options . . . . . . . . . . . . . . . . . . . . . . . . . . 113
IPMI Commands List . . . . . . . . . . . . . . . . . . . 138
Power Management Settings . . . . . . . . . . . . . . 147
3 Installing System Components . . . . . . . 149
Safety Instructions. . . . . . . . . . . . . . . . . . . . 149
About the Illustrations . . . . . . . . . . . . . . . . . . 150
Recommended Tools. . . . . . . . . . . . . . . . . . . 150
Inside the System . . . . . . . . . . . . . . . . . . . . 151
Sled Configuration . . . . . . . . . . . . . . . . . . . . 154
Sled. . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
Removing a Sled . . . . . . . . . . . . . . . . . . 155
Installing a Sled. . . . . . . . . . . . . . . . . . . 156
Sled Blank . . . . . . . . . . . . . . . . . . . . . . . . 156
Removing a Double-Wide Sled Blank . . . . . . . 156
Installing a Double-Wide Sled Blank . . . . . . . . 157
Removing a Single-Wide Sled Blank . . . . . . . . 157
Installing a Single-Wide Sled Blank . . . . . . . . 157

6Contents
Hard-Drive . . . . . . . . . . . . . . . . . . . . . . . 158
Hard-Drive Locations . . . . . . . . . . . . . . . 158
Front-Access Hard-Drives . . . . . . . . . . . . 160
Removing a Hard-Drive Blank . . . . . . . . . . 160
Installing a Hard-Drive Blank . . . . . . . . . . . 161
Removing a Hard-Drive Carrier . . . . . . . . . 162
Installing a Hard-Drive Carrier . . . . . . . . . . 163
Removing a Hard-Drive From
a Hard-Drive Carrier . . . . . . . . . . . . . . . 164
Hard-Drive Cage Hard-Drives . . . . . . . . . . 165
Removing a Hard-Drive Carrier
Located on the Sled Cover . . . . . . . . . . . . 165
Installing a Hard-Drive Carrier
on the Sled Cover . . . . . . . . . . . . . . . . . 167
Removing a Hard-Drive From
a Hard-Drive Carrier . . . . . . . . . . . . . . . 168
Installing a Hard-Drive Into
a Hard-Drive Carrier . . . . . . . . . . . . . . . 169
Internal Hard-Drives . . . . . . . . . . . . . . . 169
Removing a Hard-Drive Carrier
Located on the Sled Tray . . . . . . . . . . . . . 169
Installing a Hard-Drive Carrier
on the Sled Tray. . . . . . . . . . . . . . . . . . 170
Removing a Hard-Drive From
a Hard-Drive Carrier . . . . . . . . . . . . . . . 171
Installing a Hard-Drive Into
a Hard-Drive Carrier . . . . . . . . . . . . . . . 172
Removing the Hard-Drive Tray . . . . . . . . . . 172
Installing the Hard-Drive Tray . . . . . . . . . . 173
MicroSD Card . . . . . . . . . . . . . . . . . . . . . 174
Removing a MicroSD Card . . . . . . . . . . . . 174
Installing a MicroSD Card . . . . . . . . . . . . 175

Contents 7
Sled Covers . . . . . . . . . . . . . . . . . . . . . . . 176
Removing the Front and Back
Sled Covers . . . . . . . . . . . . . . . . . . . . . 176
Installing the Front and Back
Sled Covers . . . . . . . . . . . . . . . . . . . . . 180
Removing the Sled Cover . . . . . . . . . . . . . . 181
Installing the Sled Cover . . . . . . . . . . . . . . 183
Hot-Plug Hard-Drive Backplane. . . . . . . . . . . . . 185
Removing the Hot-Plug Hard-Drive
Backplane . . . . . . . . . . . . . . . . . . . . . 185
Installing the Hot-Plug Hard-Drive
Backplane . . . . . . . . . . . . . . . . . . . . . 188
Hard-Drive LED Board Assembly . . . . . . . . . . . . 189
Removing the Hard-Drive LED Board
Assembly . . . . . . . . . . . . . . . . . . . . . . 189
Installing the Hard-Drive LED Board
Assembly . . . . . . . . . . . . . . . . . . . . . . 190
Removing the Hard-Drive LED Board. . . . . . . . 190
Installing the Hard-Drive LED Board . . . . . . . . 191
Expansion Cards . . . . . . . . . . . . . . . . . . . . . 192
Removing the MegaRAID SAS 9265-8i
RAID Controller Card . . . . . . . . . . . . . . . . 192
Installing the MegaRAID SAS 9265-8i
RAID Controller Card . . . . . . . . . . . . . . . . 197
Removing the MegaRAID SAS 9285CV-8e
RAID Controller Card . . . . . . . . . . . . . . . . 198
Installing the MegaRAID SAS 9285CV-8e
RAID Controller Card . . . . . . . . . . . . . . . . 200
RAID Battery . . . . . . . . . . . . . . . . . . . . . . . 201
Removing the MegaRAID SAS 9265-8i
RAID Battery . . . . . . . . . . . . . . . . . . . . 201
Installing the MegaRAID SAS 9265-8i
RAID Battery . . . . . . . . . . . . . . . . . . . . 202

8Contents
Removing the MegaRAID SAS 9285CV-8e
RAID Battery . . . . . . . . . . . . . . . . . . . 203
Installing the MegaRAID SAS 9285CV-8e
RAID Battery . . . . . . . . . . . . . . . . . . . 204
Removing the RAID Battery Holder . . . . . . . . 205
Installing the RAID Battery Holder . . . . . . . . 207
Expansion Card Riser . . . . . . . . . . . . . . . . . 207
Removing the Expansion Card Riser . . . . . . . 207
Installing the Expansion Card Riser. . . . . . . . 208
GPGPU/Xeon Phi Cards . . . . . . . . . . . . . . . . 209
Removing the NVIDIA Tesla M2090
GPGPU Cards . . . . . . . . . . . . . . . . . . . 209
Installing the NVIDIA Tesla M2090
GPGPU Cards . . . . . . . . . . . . . . . . . . . 221
Removing the NVIDIA Tesla K10
GPGPU Cards . . . . . . . . . . . . . . . . . . . 223
Installing the NVIDIA Tesla K10 GPGPU
Cards . . . . . . . . . . . . . . . . . . . . . . . 235
Removing the NVIDIA Tesla K20 GPGPU
Cards . . . . . . . . . . . . . . . . . . . . . . . 237
Installing the NVIDIA Tesla K20 GPGPU
Cards . . . . . . . . . . . . . . . . . . . . . . . 249
Removing the Xeon Phi 5110P/7120P
Cards . . . . . . . . . . . . . . . . . . . . . . . 251
Installing the Xeon Phi 5110P/7120P
Cards . . . . . . . . . . . . . . . . . . . . . . . 262
GPGPU Card Risers . . . . . . . . . . . . . . . . . . 265
Removing the Front GPGPU Card Riser. . . . . . 265
Installing the Front GPGPU Card Riser . . . . . . 267
Removing the Back GPGPU Card Riser. . . . . . 267
Installing the Back GPGPU Card Riser . . . . . . 269

Contents 9
Hard-Drive Cage Backplane. . . . . . . . . . . . . . . 271
Removing the 2.5-inch Hard-Drive Cage
Backplane . . . . . . . . . . . . . . . . . . . . . 271
Installing the 2.5-inch Hard-Drive Cage
Backplane . . . . . . . . . . . . . . . . . . . . . 273
Removing the 3.5-inch Hard-Drive Cage
Backplane . . . . . . . . . . . . . . . . . . . . . 274
Installing the 3.5-inch Hard-Drive Cage
Backplane . . . . . . . . . . . . . . . . . . . . . 275
Cooling Shroud. . . . . . . . . . . . . . . . . . . . . . 276
Removing the Cooling Shroud . . . . . . . . . . . 276
Installing the Cooling Shroud. . . . . . . . . . . . 277
Heat Sink. . . . . . . . . . . . . . . . . . . . . . . . . 278
Removing a Heat Sink . . . . . . . . . . . . . . . 278
Installing a Heat Sink . . . . . . . . . . . . . . . . 280
Heat Sink Blank . . . . . . . . . . . . . . . . . . . . . 281
Removing a Heat Sink Blank . . . . . . . . . . . . 281
Installing a Heat Sink Blank . . . . . . . . . . . . 282
Processors . . . . . . . . . . . . . . . . . . . . . . . . 283
Removing a Processor . . . . . . . . . . . . . . . 283
Installing a Processor . . . . . . . . . . . . . . . 285
System Memory . . . . . . . . . . . . . . . . . . . . . 286
Memory Module Installation Guidelines . . . . . . 286
Supported DIMM Configuration . . . . . . . . . . 287
Removing Memory Modules . . . . . . . . . . . . 289
Installing Memory Modules . . . . . . . . . . . . 290
Mezzanine Cards. . . . . . . . . . . . . . . . . . . . . 291
Removing the SAS Mezzanine Card . . . . . . . . 291
Installing the SAS Mezzanine Card. . . . . . . . . 297

10 Contents
Removing the Infiniband Mezzanine Card . . . . 298
Installing the Infiniband Mezzanine Card. . . . . 301
Removing the 10 GbE Mezzanine Card . . . . . . 302
Installing the 10 GbE Mezzanine Card . . . . . . 304
MicroSD Card Reader . . . . . . . . . . . . . . . . . 305
Removing the MicroSD Card Reader . . . . . . . 305
Installing the MicroSD Card Reader . . . . . . . 308
Removing the MicroSD Card Reader
Support Bracket. . . . . . . . . . . . . . . . . . 308
Installing the MicroSD Card Reader
Support Bracket. . . . . . . . . . . . . . . . . . 310
Interposer Extender . . . . . . . . . . . . . . . . . . 311
Removing the Interposer Extender . . . . . . . . 311
Installing the Interposer Extender . . . . . . . . 312
BMC Management Cable (Optional). . . . . . . . . . 313
Removing the BMC Management Cable . . . . . 313
Installing the BMC Management Cable . . . . . 314
Node Power Distribution Board . . . . . . . . . . . . 315
Removing the Node Power Distribution
Board . . . . . . . . . . . . . . . . . . . . . . . 315
Installing the Node Power Distribution
Board . . . . . . . . . . . . . . . . . . . . . . . 317
Removing the Node Power Distribution
Board Located on the Sled Cover. . . . . . . . . 318
Installing the Node Power Distribution
Board on the Sled Cover . . . . . . . . . . . . . 320
System Battery . . . . . . . . . . . . . . . . . . . . . 321
Removing the System Battery . . . . . . . . . . 321
Installing the System Battery . . . . . . . . . . . 322

Contents 11
System Board . . . . . . . . . . . . . . . . . . . . . . 323
Removing the System Board . . . . . . . . . . . . 323
Installing the System Board . . . . . . . . . . . . 329
4 Troubleshooting . . . . . . . . . . . . . . . . . . 333
Safety First—For You and Your System . . . . . . . . . 333
Installation Problems . . . . . . . . . . . . . . . . . . 333
Troubleshooting System Startup Failure . . . . . . . . 334
Troubleshooting External Connections . . . . . . . . . 334
Troubleshooting the Video Subsystem . . . . . . . . . 334
Troubleshooting a USB Device . . . . . . . . . . . . . 334
Troubleshooting a Serial I/O Device . . . . . . . . . . 335
Troubleshooting a NIC . . . . . . . . . . . . . . . . . . 336
Troubleshooting a Wet Enclosure . . . . . . . . . . . . 337
Troubleshooting a Damaged Enclosure . . . . . . . . . 338
Troubleshooting the Power Sled . . . . . . . . . . . . 339
Troubleshooting System Memory . . . . . . . . . . . . 340
Troubleshooting a Hard-Drive . . . . . . . . . . . . . . 341
Troubleshooting a Storage Controller . . . . . . . . . . 342
Troubleshooting Expansion Cards. . . . . . . . . . . . 343
Troubleshooting Processors. . . . . . . . . . . . . . . 344
Identifying System Board Model Number . . . . . . . . 346

12 Contents
Troubleshooting the System Board . . . . . . . . . . 346
Troubleshooting the System Battery . . . . . . . . . . 347
IRQ Assignment Conflicts . . . . . . . . . . . . . . . 348
5 Jumpers and Connectors. . . . . . . . . . . . 349
System Board Types . . . . . . . . . . . . . . . . . . 349
System Board Jumper Settings . . . . . . . . . . . . 350
System Board V1.0 Jumper Settings . . . . . . . 350
System Board V1.1 Jumper Settings . . . . . . . 351
System Board V1.2 Jumper Settings . . . . . . . 353
System Board Connectors . . . . . . . . . . . . . . . 355
System Board V1.0 Connectors. . . . . . . . . . 355
System Board V1.1 Connectors. . . . . . . . . . 356
System Board V1.2 Connectors. . . . . . . . . . 358
Backplane Connectors. . . . . . . . . . . . . . . . . 360
2.5-inch Hot-Plug Hard-Drive Backplane. . . . . 360
2.5-inch Hard-Drive Cage Backplane. . . . . . . 361
3.5-inch Hard-Drive Cage Backplane. . . . . . . 362
Expansion Card Riser Connectors . . . . . . . . . . . 363
Hard-Drive LED Board Connectors . . . . . . . . . . 364
Interposer Extender Connectors . . . . . . . . . . . . 365
Interposer Extender Types . . . . . . . . . . . . 365
MicroSD Card Reader Connectors . . . . . . . . . . 367
Node Power Distribution Board Connectors . . . . . 368

Contents 13
6 Getting Help. . . . . . . . . . . . . . . . . . . . . . 369
Contacting Dell . . . . . . . . . . . . . . . . . . . 369
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371

14 Contents

About Your System 15
1
About Your System
Accessing System Features During Startup
The following keystrokes provide access to system features during startup.
The SAS/SATA card or PXE hotkey support are available only in the BIOS
boot mode. Hotkey function is not available in the Unified Extensible
Firmware Interface (UEFI) boot mode.
NOTE: Throughout this manual, the PowerEdge C8000 server enclosure is referred
to as simply the "server enclosure" or the "chassis".
Keystroke Description
<F2> Enters the System Setup program. See "System Setup Menu" on
page 59.
<F11> Enters the BIOS Boot Manager or the Unified Extensible
Firmware Interface (UEFI) Boot Manager, depending on the
system's boot configuration.
<F12> Starts Preboot eXecution Environment (PXE) boot.
<Ctrl><C> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the SAS adapter documentation.
<Ctrl><H> Enters the LSI 2008 SAS Mezzanine Card Configuration Utility.
For more information, see the documentation for your SAS RAID
card.
<Ctrl><S> Enters the utility to configure onboard NIC settings for PXE boot.
For more information, see the documentation for your integrated
NIC.
<Ctrl><I> Enters the onboard SAS and SATA controller’s configuration
utility.

16 About Your System
Front-Panel Features and Indicators
Figure 1-1. Sled Front Features — C8220X Double-Wide Compute Sled with
Front-Access 2.5-inch Hot-Plug Hard-Drives
Item Indicator, Button, or
Connector
Icon Description
1 USB connectors Connects USB devices to the system. The
ports are USB 2.0 compliant.
2 Mezzanine card
expansion slot
Installs an I/O module mezzanine card.
3 Hard-drive LED
0 to 7
Indicates drive activity and status.
4, 5 Hard-drive bay Installs two 2.5-inch hot-plug hard-drives.
6, 7 Low profile PCIe
expansion slots
Installs up to two low profile PCI Express
x8 card when plugged into horizontal
expansion card connectors.
8 Sled release latch Press to release the sled from the
enclosure.
123
4
5
6
7
8
9
10
11
12
13
14
15
16

About Your System 17
9Power-onindicator/
power button
The power-on indicator lights when the
sled power is on. The power-on indicator
lights amber when the system critical
event occurs.
NOTE: The power-on indicator lights amber
according to critical system error log (SEL)
assertion. If the SEL is full or a deassertion
event occurred while sensor monitoring is
paused (e.g. fan monitoring is paused during
system power off), the power-on indicator
turns amber. To turn off an amber LED and
reset the power-on indicator to normal
condition (solid green), either perform a
BMC cold reset or reseat the sled in the
server enclosure.
The power button turns the compute
sled on.
NOTES:
• When powering on the sled, the video
monitor can take from several seconds
to over 2 minutes to display an image,
depending on the amount of memory
installed in the system.
• On ACPI-compliant operating
systems, turning off the sled using the
power button causes the sled to
perform a graceful shutdown before
power to the sled is turned off.
• To force an ungraceful shutdown, press
and hold the power button for five
seconds.
10 VGA connector Connects a VGA display to the system.
11 Serial connector Connects a serial device to the system.
12 BMC management
port
Dedicated management port.
Item Indicator, Button, or
Connector
Icon Description

18 About Your System
Figure 1-2. Sled Features — C8220X Double-Wide Compute Sled with GPGPU/Xeon Phi
Card
13 Ethernet connector 2 Embedded 10/100/1000 Mbit NIC
connector.
14 Ethernet connector 1 Embedded 10/100/1000 Mbit NIC
connector.
15 Sled identification
indicator
Lights blue to identify a particular system
and system board.
16 Handle Hold to pull the sled from the enclosure.
Item Indicator, Button, or
Connector
Icon Description
1 USB connectors Connects USB devices to the system. The
ports are USB 2.0 compliant.
2 Mezzanine card
expansion slot
Installs an I/O module mezzanine card.
Item Indicator, Button, or
Connector
Icon Description
2
1
1
3
4
5
6
7
8
9
10
11
2
12

About Your System 19
3Sledcoveror
GPGPU/Xeon Phi
card assembly
Installs up to two general-purpose graphics
processing unit (GPGPU) or Xeon Phi
cards when plugged into horizontal
expansion card risers.
4 Sled release latch Press to release the sled from the enclosure.
5Power-onindicator/
power button
The power-on indicator lights when the
sled power is on. The power-on indicator
lights amber when the system critical event
occurs.
NOTE: The power-on indicator lights amber
according to critical system error log (SEL)
assertion. If the SEL is full or a deassertion
event occurred while sensor monitoring is
paused (e.g. fan monitoring is paused during
system power off), the power-on indicator
turns amber. To turn off an amber LED and
reset the power-on indicator to normal
condition (solid green), either perform a
BMC cold reset or reseat the sled in the
server enclosure.
The power button turns the compute
sled on.
NOTES:
• When powering on the sled, the video
monitor can take from several seconds
to over 2 minutes to display an image,
depending on the amount of memory
installed in the system.
• On ACPI-compliant operating systems,
turning off the sled using the power
button causes the sled to perform a
graceful shutdown before power to the
sled is turned off.
• To force an ungraceful shutdown, press
and hold the power button for five
seconds.
Item Indicator, Button, or
Connector
Icon Description

20 About Your System
NIC Indicator Codes
Figure 1-3. NIC Indicators
6 VGA connector Connects a VGA display to the system.
7 Serial connector Connects a serial device to the system.
8 BMC management
port
Dedicated management port.
9 Ethernet connector 2 Embedded 10/100/1000 Mbit NIC
connector.
10 Ethernet connector 1 Embedded 10/100/1000 Mbit NIC
connector.
11 Sled identification
indicator
Lights blue to identify a particular system
and system board.
12 Handle Hold to pull the sled from the enclosure.
1 link indicator 2 activity indicator
Indicator Status Indicator Code
Link indicator Solid amber Linking at 100 Mbps port speed
Solid green Linking at 1 Gbps port speed (maximum)
Item Indicator, Button, or
Connector
Icon Description
2
1