Dell PowerEdge C410X User manual

Dell PowerEdge C410x
Hardware Owner’s Manual

Notes, Cautions, and Warnings
NOTE: A NOTE indicates important information that helps you make better use of your computer.
CAUTION: A CAUTION indicates potential damage to hardware or loss of data if instructions are not
followed.
WARNING: A WARNING indicates a potential for property damage, personal injury, or death.
Information in this publication is subject to change without notice.
© 2010-2013 Dell Inc. All rights reserved.
Reproduction of these materials in any manner whatsoever without the written permission of Dell Inc. is strictly
forbidden.
Trademarks used in this text: Dell™, the DELL logo, and PowerEdge™ are trademarks of Dell Inc.
Other trademarks and trade names may be used in this publication to refer to either the entities claiming the marks
and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and trade names other than its
own.
Regulatory Model B02S
2013-12 Rev. A04

Contents | 3
Contents
NOTES, CAUTIONS, AND WARNINGS .................................................................................................................. 1
CONTENTS ......................................................................................................................................................... 3
1INTRODUCTION ............................................................................................................................................ 6
POWER SEQUENCE..........................................................................................................................................................6
SUPPORTED GPGPU CONFIGURATIONS ............................................................................................................................10
GPGPU SUPPORT LIMITATION........................................................................................................................................10
INFINIBAND (IB) SUPPORT LIMITATION.............................................................................................................................10
CHECKLIST ...................................................................................................................................................................10
2PRODUCT OVERVIEW ..................................................................................................................................11
ATOUR OF THE SYSTEM.................................................................................................................................................11
System Front View ...............................................................................................................................................11
System Back View ................................................................................................................................................11
SYSTEM LEDS DESCRIPTION............................................................................................................................................13
Front System LEDs................................................................................................................................................13
Static / Dynamic IP Switch Function Instruction ..................................................................................................14
3REMOVING AND INSTALLING HARDWARE ...................................................................................................15
SAFETY MEASURES........................................................................................................................................................15
SYSTEM COVER ............................................................................................................................................................15
Removing System Cover.......................................................................................................................................15
Installing the system cover ..................................................................................................................................18
PCI CAGE....................................................................................................................................................................19
Removing the PCI Cage........................................................................................................................................19
Installing the PCI cage..........................................................................................................................................20
PCIE CARD ..................................................................................................................................................................20
Replacing PCIe Card.............................................................................................................................................20
For M1060 Card ...................................................................................................................................................20
Installing the M1060 card....................................................................................................................................21
Installing the Intel 5110P Card.............................................................................................................................25
Removing the 5110P card....................................................................................................................................28
Installing the NVIDIA K10/K20 Card.....................................................................................................................30
Removing the NVIDIA K10/K20 Card ...................................................................................................................36
Replacing System Fans.........................................................................................................................................41
Installing the system fans ....................................................................................................................................43
FAN CAGE....................................................................................................................................................................44
Replacing System Fan Cage .................................................................................................................................44
Installing the system fan cage .............................................................................................................................48
POWER SUPPLY ............................................................................................................................................................49
Replacing Power Supplies ....................................................................................................................................49
POWER DISTRIBUTION BOARD (PDB)...............................................................................................................................52

Contents | 4
Replacing Power Distribution Board (PDB)..........................................................................................................52
Installing the power distribution board ...............................................................................................................58
IPASS BOARD ...............................................................................................................................................................59
Replacing iPass Board..........................................................................................................................................59
Installing the iPass board.....................................................................................................................................67
MIDDLE BOARD............................................................................................................................................................68
Replacing Middle Board.......................................................................................................................................68
Installing the system middle board......................................................................................................................69
FRONT I/O PANEL ........................................................................................................................................................70
Removing Front I/O Panel....................................................................................................................................70
Installing the Front IO panel ................................................................................................................................71
INSTALLING THE RAIL AND THE SYSTEM .............................................................................................................................72
4CABLE ROUTINGS ........................................................................................................................................75
IPASS PORT MAPPING ...................................................................................................................................................76
5BMC REMOTE MANAGEMENT CONSOLE ......................................................................................................77
INITIAL CONFIGURATION USING A DHCP SERVER ................................................................................................................77
STATIC/DHCP IP CONTROLLED BY FRONT PANEL BUTTON ...................................................................................................78
REMOTE MANAGEMENT CONSOLE OVERVIEW ...................................................................................................................79
ENTER DELL REMOTE MANAGEMENT CONSOLE..................................................................................................................80
Properties.............................................................................................................................................................80
CONFIGURATION ..........................................................................................................................................................81
Network ...............................................................................................................................................................81
Security ................................................................................................................................................................82
Users ....................................................................................................................................................................83
Services ................................................................................................................................................................84
IPMI..........................................................................................................................................................................85
SESSIONS ....................................................................................................................................................................87
UPDATES ....................................................................................................................................................................88
Utilities.................................................................................................................................................................89
SERVER INFORMATION...................................................................................................................................................90
Power Control ......................................................................................................................................................90
Power Consumption.............................................................................................................................................91
GPU Power Consumption.....................................................................................................................................92
Thermal................................................................................................................................................................93
Fans......................................................................................................................................................................93
Temperatures.......................................................................................................................................................93
SYSTEM EVENT LOG ......................................................................................................................................................94
Platform Events....................................................................................................................................................95
Traps Settings ......................................................................................................................................................96
Email Settings ......................................................................................................................................................97
Port Map..............................................................................................................................................................98
6TROUBLESHOOTING YOUR SYSTEM .............................................................................................................99

Contents | 5
S AFETY F IRST —F OR Y OU AND Y OUR S YSTEM ...........................................................................................................................99
Checking GPU Card ............................................................................................................................................100
Checking iPass Cable..........................................................................................................................................100
Checking iPass Connector to Host System .........................................................................................................101
Check if iPass Board (GS-IPASS2 / GS-IPASS3) is installed properly ...................................................................101
7JUMPERS AND CONNECTORS..................................................................................................................... 102
D ELL P OWER E DGE C410X M IDDLE B OARD C ONNECTORS AND J UMPERS ........................................................................................102
8GETTING HELP ........................................................................................................................................... 103
C ONTACTING D ELL ........................................................................................................................................................103
9INDEX........................................................................................................................................................ 104

Introduction | 6
1
Introduction
Power Sequence
It is recommended that the following power sequence be followed when using the C410x and BMC 1.34 (or
newer) with a host server not Intel E5-2600 Series based:
1. For a single host server connected to a C410x:
a. Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Power up the host server.
b. Power Down Sequence:
i. Power down the host server.
ii. Wait for the host server to power off.
iii. Power down the C410x.
2. For multiple host servers connected to a C410x:
a. Initial Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Power up the host server.
b. Power Up Sequence:
i. Power up the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be applied by pressing the cage power button or
using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
i. Wait for the Green power LEDs on the cage(s) to light.
ii. Power up the host server.
iii. Repeat for each host server connected to the C410x.
b. Power Down Sequence:
i. Power down the host server.
ii. Wait for the host server to power off.
iii. Power down the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be removed by pressing the cage power button
or using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
iv. Wait for the Green power LEDs on the cage(s) to turn off.
v. Repeat for each host serve connected to the C410x.
It is recommended that the following power sequence be followed when using the C410x and BMC 1.34 (or
newer) with a host server that is Intel E5-2600 Series based:
1. For a single host server connected to a C410x:
a. Power Up Sequence:
i. Power up the C410x.

Introduction | 7
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Power up the host server.
b. Power Down Sequence:
i. Power down the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to turn off and the fans to
turn off.
NOTE: The host server may report errors of missing devices on the PCIe bus.
iii. Power down the host server.
iv. Wait for the host server to power off.
2. For multiple host servers connected to a C410x:
a. Initial Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Power up the host server.
b. Power Up Sequence:
i. Power up the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be applied by pressing the cage power button or
using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
vi. Wait for the Green power LEDs on the cage(s) to light.
vii. Power up the host server.
viii. Repeat for each host server connected to the C410x.
c. Power Down Sequence:
i. Power down the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be removed by pressing the cage power button
or using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
ii. Wait for the Green power LEDs on the cage(s) to turn off.
NOTE: The host server may report errors of missing devices on the PCIe bus.
iii. Power down the host server.
iv. Wait for the host server to power off.
v. Repeat for each host serve connected to the C410x.
It is recommended that the following power sequence be followed when using the C410x and BMC 1.32 with a
host server not Intel E5-2600 Series based:
3. For a single host server connected to a C410x:
a. Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Wait for the Blue UID LED on the left ear tab to stop blinking and then turn
off. When the UID LED turns off the PCIe bus initialization is complete.
NOTE: After the C410x power up the PCIe bus initialization will start. The PCIe
bus initialization status can be checked using IPMITool commands identified in the
“Using the C410x Base Board Management Controller”.
iv. Power up the host server.
b. Power Down Sequence:
i. Power down the host server.
ii. Wait for the host server to power off.

Introduction | 8
iii. Power down the C410x.
4. For multiple host servers connected to a C410x:
a. Initial Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Wait for the Blue UID LED on the left ear tab to stop blinking and then turn
off. When the UID LED turns off the PCIe bus initialization is complete.
NOTE: After the C410x power up the PCIe bus initialization will start. The PCIe bus
initialization status can be checked using IPMITool commands identified in the
“Using the C410x Base Board Management Controller”.
iv. Power up the host server.
b. Power Up Sequence:
i. Power up the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be applied by pressing the cage power button or
using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
vi. Wait for the Green power LEDs on the cage(s) to light.
vii. Power up the host server.
viii. Repeat for each host server connected to the C410x.
d. Power Down Sequence:
i. Power down the host server.
ii. Wait for the host server to power off.
iii. Power down the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be removed by pressing the cage power button
or using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
iv. Wait for the Green power LEDs on the cage(s) to turn off.
v. Repeat for each host serve connected to the C410x.
It is recommended that the following power sequence be followed when using the C410x and BMC 1.32 with a
host server that is Intel E5-2600 Series based:
3. For a single host server connected to a C410x:
a. Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Wait for the Blue UID LED on the left ear tab to stop blinking and then turn
off. When the UID LED turns off the PCIe bus initialization is complete.
NOTE: After the C410x
power up the PCIe bus initialization will start. The PCIe bus initialization status
can be checked using IPMITool commands identified in the “Using the C410x Base
Board Management Controller”.
iv. Power up the host server.
b. Power Down Sequence:
i. Power down the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to turn off and the fans to
turn off.
NOTE: The host server may report errors of missing devices on the PCIe bus.
iii. Power down the host server.

Introduction | 9
iv. Wait for the host server to power off.
4. For multiple host servers connected to a C410x:
a. Initial Power Up Sequence:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Wait for the Blue UID LED on the left ear tab to stop blinking and then turn
off. When the UID LED turns off the PCIe bus initialization is complete.
NOTE: After the C410x power up the PCIe bus initialization will start. The PCIe
bus initialization status can be checked using IPMITool commands identified in the
“Using the C410x Base Board Management Controller”.
iv. Power up the host server.
b. Power Up Sequence:
i. Power up the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be applied by pressing the cage power button or
using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
vi. Wait for the Green power LEDs on the cage(s) to light.
vii. Power up the host server.
viii. Repeat for each host server connected to the C410x.
e. Power Down Sequence:
i. Power down the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be removed by pressing the cage power button
or using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
ii. Wait for the Green power LEDs on the cage(s) to turn off.
NOTE: The host server may report errors of missing devices on the PCIe bus.
iii. Power down the host server.
iv. Wait for the host server to power off.
v. Repeat for each host serve connected to the C410x.
It is recommended that the following power sequence be followed when using the C410x and BMC 1.28 with a
host server:
1. For a single host server connected to a C410x:
a. Power Up Sequenc:
i. Power up the C410x.
ii. Wait for the Green power LEDs on the individual PCI cages to light.
iii. Power up the host server.
b. Power Down Sequence:
i. Power down the host server.
ii. Wait for the host server to power off.
iii. Power down the C410x.
2. For multiple host servers connected to a C410x:
a. Power Up Sequence:
i. Power up the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be applied by pressing the cage power button or
using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
ii. Wait for the Green power LEDs on the cage(s) to light.

Introduction | 10
iii. Power up the host server.
iv. Repeat for each host server connected to the C410x.
b. Power Down Sequence:
i. Power down the host server.
ii. Wait for the host server to power off.
iii. Power down the PCI cage(s) associated with the iPass port connected to the C410x.
NOTE: The PCI cage power can be removed by pressing the cage power button
or using IPMITool commands identified in the “Using the C410x Base Board
Management Controller” document.
iv. Wait for the Green power LEDs on the cage(s) to turn off.
v. Repeat for each host serve connected to the C410x.
Supported GPGPU Configurations
The C410x supports installing different GPGPU and other devices in the chassis.
Mixing different GPGPUs connected to the same host server is not supported. All GPGPUs connected to a
host server must be the same type.
Mixing other devices with GPGPUs connected to the same host server is supported.
GPGPU Support Limitation
There are some host servers that have multiple PCIex16 expansion slots. This allows multiple Host
Interface Cards (HIC) to be installed in a single host server. The flexibility of the C410x system allows 16
GPGPUs to be connected to a single host server with multiple PCIex16 expansion slots. Host servers that
are based on x86 architecture have a 16 bit (total 64 K) IO address space hardware limit. The 16 bit IO
address space hardware limit limits the number of PCI devices that can be connected to the host server.
The host server does not boot or other POST errors occur if the IO address space limit is exceeded. The
number of onboard host server PCI devices utilize a fixed amount of IO address space. The remaining IO
address space is used to determine the number of GPGPU that can be installed in a C410x that is
connected to the single host server. Each GPGPU requires 4K of IO address space. The number of
onboard PCI devices plus the number of GPGPUs determine the amount of IO address space used.
Therefore, the 16 bit IO address space limitation does not allow a single host server to support 16
GPGPUs installed in a C410x.
InfiniBand (IB) Support Limitation
Host servers will not support more than one IB card installed in a C410x.
If more than one IB card is installed in a C410x and connected to a single host server issues may be
observed.
Checklist
Carefully unpack the Dell PowerEdge C410X server and check that the following items were included.
•One Dell PowerEdge C410X system
•Dell PowerEdge C410x Getting Started Guide
•Safety, Environmental, and Regulatory Information (SERI)
•Warranty and Support Information (WSI) or End User License Agreement (EULA)

Product Overview | 11
2
Product Overview
A Tour of the System
The following sections describe the external features of the Dell PowerEdge C410X server.
System Front View
Figure 1 – Front View
1
Power LED/Button
8
PCI Cage 5
2
System LED
9
PCI Cage 6
3
UID LED/Button
10
PCI Cage 7
4
PCI Cage 1
11
PCI Cage 8
5
PCI Cage 2
12
PCI Cage 9
6
PCI Cage 3
13
PCI Cage 10
7
PCI Cage 4
System Back View
Back view of system is shown below:

Product Overview | 12
Figure 2 – Back View
1
Power Module 1
11
iPass connector 6
2
Power Module 2
12
iPass connector 7
3
Power Module 3
13
iPass connector 8
4
Power Module 4
14
PCI Cage 11
5
BMC LAN Cable
15
PCI Cage 12
6
iPass connector 1
16
PCI Cage 13
7
iPass connector 2
17
PCI Cage 14
8
iPass connector 3
18
PCI Cage 15
9
iPass connector 4
19
PCI Cage 16
10
iPass connector 5

Product Overview | 13
System LEDs Description
Front System LEDs
The front system LEDs contain System LED, Power LED and UID LED information.
The detailed LEDs information is listed below:
Figure 3 – Front System LEDs
Table 1-1. Front System LEDs
System LED Displays status/errors and is controlled by BMC.
Color
Condition
Occurrence
Amber Blink Fast Power supply fail
On FAN fail or sensor error
Blink GPU card fail
UID LED Lights when front or rear ID button is pressed.
Color Condition Occurrence
Blue Off No identification
Blinking ID Button pressed on system (ID command
executed)
Power LED
Lights green when server is powered on.
Color Condition Occurrence
Green
On Power on
Off Power off
Blinking Power on fail or without
any GPU card

Product Overview | 14
Static / Dynamic IP Switch Function Instruction
To switch from DHCP to static or vice versa:
Hold down the ID button for 5 seconds
While pressing the ID button, press and hold the power button for 5 seconds
Release the power button, and then the ID button
It will take ~30 seconds to change the configuration
The ID light will indicate which mode has been selected:
- Solid for 5 seconds indicates static IP
- Flashing for 5 seconds indicates DHCP
If the default IP address is changed, switching DHCP to static IP will change the IP address back to the
default.
Default IP address is 192.168.0.120

Removing and Installing Hardware | 15
3
Removing and Installing Hardware
Safety Measures
CAUTION: Many repairs may only be done by a certified service technician. You should only perform
troubleshooting and simple repairs as authorized in your product documentation, or as directed by the
online or telephone service and support team. Damage due to servicing that is not authorized by Dell is not
covered by your warranty. Read and follow the safety instructions that came with the product.
CAUTION: Computer components and electronic circuit boards can be damaged by discharges of
static electricity. Working on computers that are still connected to a power supply can be extremely
dangerous. Follow the simple guidelines below to avoid damage to your computer or injury to yourself.
•Always disconnect the computer from the power outlet whenever you are working inside the
computer case.
•If possible, wear a grounded wrist strap when you are working inside the computer case.
Alternatively, discharge any static electricity by touching the bare metal system of the
computer case, or the bare metal body of any other grounded appliance.
•Hold electronic circuit boards by the edges only. Do not touch the components on the board
unless it is necessary to do so. Do not flex or stress the circuit board.
•Leave all components inside the static-proof packaging until you are ready to use the
component for the installation.
System Cover
Removing System Cover
CAUTION:
Before you remove or install the system cover: Make sure the system is not
turned on or connected to AC power.
Follow these instructions to remove the system cover:
1. Loosen and remove the screws securing the middle cover.

Removing and Installing Hardware | 16

Removing and Installing Hardware | 17
2. Remove the middle top cover from the system.
3. Loosen and remove the screws securing the back cover.

Removing and Installing Hardware | 18
4. Slide the cover horizontally to the back using the traction pad and remove the back cover in
the direction of the arrow.
NOTE: This system must be operated with the system cover installed to ensure proper cooling.
Installing the system cover
To install the system cover follow the instructions for removing the system cover in the reverse order.

Removing and Installing Hardware | 19
PCI Cage
Removing the PCI Cage
NOTE:
•Take note of the drive tray orientation before sliding it out.
•The tray will not fit back into the bay if inserted incorrectly.
1. Lift the release lever and pull on the cage handle at the same time.
2. Slide the cage assembly out of the system.

Removing and Installing Hardware | 20
Installing the PCI cage
To install the PCI cage follow the instructions for removing the PCI cage in the reverse order.
PCIe Card
Replacing PCIe Card
CAUTION:
Before you remove or install the PCIe card, press PCI cage power button to
turn off the specific single PCI cage power before replacing PCIe card.
Follow these instructions to replace a PCIE card:
For M1060 Card
1. See to Chapter 4 Cable Routings on page 57 to connect switch button cable and PCI power cable.
2. Insert the PCIe card by 45 degree and push it into the socket vertically.
CAUTION: Care should be taken to prevent damage to components on the back side of the PCIe card.
Make sure the card does not drag across the card mounting standoffs of the cage when inserting the card
into the socket.