HP Cluster Platform Express v2010 Installation guide

HP Cluster Platform
ProLiant G6 and G7 Server Overview
Abstract
This document provides an overview of the core infrastructure components for all HP Cluster Platform models and associated platforms for
experienced hardware administrators of large-scale computer systems and for HP Global Service representatives. This guide refers to the original
component documentation, which should be available during installation, configuration, and maintenance operations.
Part Number: 614066-002
February 2011
Edition: 2

© Copyright 2010, 2011 Hewlett-Packard Development Company, L.P.
The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express
warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall
not be liable for technical or editorial errors or omissions contained herein.
Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
AMD is a trademark of Advanced Micro Devices, Inc.

Contents 3
Contents
Introduction.................................................................................................................................. 5
Overview ................................................................................................................................................. 5
HP ProLiant servers (rack)............................................................................................................... 6
HP ProLiant Rack Servers (Intel® Xeon®) ...................................................................................................... 6
HP ProLiant DL160 G6 Server ........................................................................................................... 6
HP ProLiant DL1000 Multi Node Servers............................................................................................. 9
HP ProLiant DL2000 Multi Node Servers........................................................................................... 12
HP ProLiant DL380 G6 Server ......................................................................................................... 18
HP ProLiant DL380 G7 Server ......................................................................................................... 23
HP ProLiant Rack Servers (AMD Opteron) ................................................................................................... 27
HP ProLiant DL165 G6 Server ......................................................................................................... 27
HP ProLiant DL165 G7 Server ......................................................................................................... 31
HP ProLiant DL385 G6 Server ......................................................................................................... 35
HP ProLiant DL385 G7 Server ......................................................................................................... 39
HP ProLiant DL585 G6 Server ......................................................................................................... 42
HP ProLiant servers (scalable) ....................................................................................................... 47
HP ProLiant SL6000 G6 Servers ................................................................................................................ 47
HP ProLiant SL6500 G6 Servers ................................................................................................................ 47
HP ProLiant Scalable Servers (Intel® Xeon®)............................................................................................... 47
HP ProLiant SL170s G6 Server ........................................................................................................ 47
HP ProLiant SL2x170z G6 Server .................................................................................................... 52
HP ProLiant SL390s G7 Server ........................................................................................................ 54
HP ProLiant Scalable Servers (AMD Opteron).............................................................................................. 60
HP ProLiant SL165z G7 Server........................................................................................................ 60
HP ProLiant BL c-Class Server Blades ............................................................................................. 63
HP BladeSystem c7000 Enclosure ............................................................................................................. 63
HP BladeSystem c7000 Enclosure documentation .............................................................................. 63
Enclosure front components............................................................................................................. 64
Enclosure rear components ............................................................................................................. 65
Device bay numbering ................................................................................................................... 65
Interconnect module bay numbering................................................................................................. 67
Port mapping: HP BladeSystem c7000 Enclosure interconnect module bay to server blade ..................... 67
Server blade type to gigabit Ethernet blade switch bandwidth ratios .................................................... 68
HP BladeSystem c-Class Switch Modules........................................................................................... 68
Mezzanine HCA cards................................................................................................................... 70
HP ProLiant BL c-Class Server Blades (Intel® Xeon®) .................................................................................... 70
HP ProLiant BL280c G6 Server Blade............................................................................................... 70
HP ProLiant BL2x220c G6 Server Blade ........................................................................................... 73
HP ProLiant BL2x220c G7 Server Blade ........................................................................................... 75
HP ProLiant BL460c G6 Server Blade............................................................................................... 76
HP ProLiant BL460c G7 Server Blade ............................................................................................... 79
HP ProLiant BL c-Class Server Blades (AMD Opteron)................................................................................... 81
HP ProLiant BL465c G6 Server Blade............................................................................................... 81
HP ProLiant BL465c G7 Server Blade............................................................................................... 83

Contents 4
Support and other resources ........................................................................................................ 85
Technical support .................................................................................................................................... 85
Contacting HP............................................................................................................................... 85
Documentation feedback.......................................................................................................................... 85
Related documentation............................................................................................................................. 86
Cluster component documentation ................................................................................................... 86
HP Cluster Platform documentation................................................................................................... 86
Bracket installation guides .............................................................................................................. 87
Important safety information...................................................................................................................... 87
Typographic conventions.......................................................................................................................... 87
Acronyms and abbreviations........................................................................................................ 89
Index......................................................................................................................................... 91

Introduction 5
Introduction
Overview
This document provides an overview of the HP ProLiant G6 and G7 servers used in HP Cluster Platform
solutions. This document refers to the original component documentation for detailed information, except
where information or procedures for the cluster differ from the standalone components. In such cases, this
document supersedes information supplied in existing component documentation.
Some server options are not supported in HP Cluster Platform configurations. For more information, contact
an HP representative.
Processor Supported server
Intel® Xeon® HP ProLiant DL160 G6 Server
HP ProLiant DL170e G6 Server
HP ProLiant DL170h G6 Server
HP ProLiant DL380 G6 Server
HP ProLiant DL380 G7 Server
HP ProLiant SL170s G6 Server
HP ProLiant SL2x170z G6 Server
HP ProLiant SL390s G7 Server
HP ProLiant BL280c G6 Server Blade
HP ProLiant BL2x220c G6 Server Blade
HP ProLiant BL2x220c G7 Server Blade
HP ProLiant BL460c G6 Server Blade
HP ProLiant BL460c G7 Server Blade
AMD Opteron HP ProLiant DL165 G6 Server
HP ProLiant DL165 G7 Server
HP ProLiant DL385 G6 Server
HP ProLiant DL385 G7 Server
HP ProLiant DL585 G6 Server
HP ProLiant SL165z G7 Server
HP ProLiant BL465c G6 Server Blade
HP ProLiant BL465c G7 Server Blade
This document does not include the procedures or tools required to install and configure the system hardware
or software. It includes references for cluster components and pointers to the server documentation on the HP
website.

HP ProLiant servers (rack) 6
HP ProLiant servers (rack)
HP ProLiant Rack Servers (Intel® Xeon®)
Several Intel® Xeon® servers are supported in HP Cluster Platform solutions. This section presents information
for the HP ProLiant servers that are used in HP Cluster Platform solutions only. The content in this section
includes the following additional information for the ProLiant Intel® Xeon® servers:
•Front and rear views
•InfiniBand HCA PCI slot assignment
•Specific cable management instructions, if necessary
•HP Cluster Platform specific maintenance instructions, if applicable
HP ProLiant DL160 G6 Server
The HP ProLiant DL160 G6 Server is used as a control node, a utility node, and a compute node in HP Cluster
Platform configurations.
HP ProLiant DL160 G6 Server documentation
For server-specific information, see the server documentation:
•For a complete list of features and specifications, see the HP ProLiant DL160 Generation 6 (G6)
QuickSpecs on the HP website
(http://h18004.www1.hp.com/products/quickspecs/13247_na/13247_na.html).
•For installation and service information, see the HP ProLiant DL100 Series Server User Guide and the HP
ProLiant DL160 G6 Server Maintenance and Service Guide on the HP website
(http://www.hp.com/support/manuals).
Under servers, select ProLiant ML/DL and TC series servers, and then select HP ProLiant DL160 G6
Server series.
Front panel components (DL160 G6)
This figure shows the LFF hard drive model. The server is also available in a two-drive LFF model, a four-drive
non-hot plug LFF model, and an 8-drive SFF model. Each model contains the same components in the same
or similar orientations.

HP ProLiant servers (rack) 7
Item Description
1 Optical drive (optional)
2 Serial label pull tab
3 USB connectors (2)
4 Rack mounting thumbscrews (2)
5 Hard drive bays (4)
Front panel LEDs and buttons (DL160 G6)
This figure shows the LFF hard drive model. The server is also available in a two-drive LFF model, a four-drive
non-hot-plug LFF model, and an 8-drive SFF model. Each model contains the same components in the same
or similar orientations.
Item Description Status
1 Optical drive LED Flashing green = Drive is in use.
Off = Drive is not active.
2 Health LED Green = System health is normal.
Amber = System health is degraded (non-critical).
Red = System health is critical.
Off = System health is normal (when in standby mode).
3 NIC 1 activity LED Green = Network link exists.
Flashing green = Network link and activity exist.
Off = No network link exists.
4 NIC 2 activity LED Green = Network link exists.
Flashing green = Network link and activity exist.
Off = No network link exists.
5 Hard drive activity LED Flashing green = Drive activity exists.
Off = No drive activity exists.
6 Power button/LED Green = Normal (system on)
Amber = System is in standby, but power is still applied.
Off = Power cord is not attached, or the power supply has failed.
There is no power to the system.
7 UID button/LED Blue = Identification is activated.
Flashing blue = System is being managed remotely.
Off = Identification is deactivated.

HP ProLiant servers (rack) 8
Item Description Status
8 Drive online/error LED Blue = Drive identified
Amber = Drive failure
Off = No fault-process activity
9 Drive activity LED Flashing green = Drive activity
Off = No drive activity
Rear panel components (DL160 G6)
The figure shown in this section is a non-hot-plug power supply model. The HP ProLiant DL160 G6 Server is
also available in a hot-plug power supply model.
Item Description
1
Power supply cable connector
2 Serial connector
3 Video connector
4 USB connectors (2)
5
NIC 2 connector
6 Dedicated management connector (optional)
7 Low-profile PCI expansion card slot
8 Full-height/full-length PCI expansion card slot
9
T-10/T-15 Torx screwdriver
10 PCI cage thumbscrews (2)
11 NIC 1 connector

HP ProLiant servers (rack) 9
Rear panel LEDs and buttons (DL160 G6)
The figure shown in this section is a non-hot-plug power supply model. The HP ProLiant DL160 G6 Server is
also available in a hot-plug power supply model.
Item Description Status
1 NIC link LED Green = Linking at 100 Mbps speed
Off = No connection or linking at 10 Mbps speed
2 NIC activity LED Green = LAN is linking.
Flashing green = LAN is active.
Off = No connection
3 UID button/LED Blue = Identification
Flashing blue = System is being managed
remotely.
Off = Off
4 Dedicated
management
connector activity
LED (optional)
Green = LAN is linking.
Flashing green = LAN is active.
Off = No connection
5 Dedicated
management
connector link LED
(optional)
Green = Linking at 100 Mbps speed
Off = No connection or linking at 10 Mbps speed
PCI expansion slot definitions (DL160 G6)
Always install an InfiniBand PCIe HCA in slot 1 of this server.
Slot Type Length Connector Interconnect
1 PCIe2 Full x16 x16
1 Optional PCI-X Full 133 MHz/3.3 V 64 bit
2 PCIe Half x16 x4
HP ProLiant DL1000 Multi Node Servers
The DL1000 consists of up to four independent DL170h G6 servers in the 2U HP ProLiant h1000 G6 Chassis
and is available in 2-node and 4-node models. Only the 4-node model (HP ProLiant DL4x170h G6 Server)
of the HP ProLiant DL170h G6 Server is supported in the HP Cluster Platform.

HP ProLiant servers (rack) 10
HP ProLiant DL170h G6 Server
The HP ProLiant DL4x170h G6 Server is used as a compute node in HP Cluster Platform configurations.
HP ProLiant DL170h G6 Server documentation
For server-specific information, see the server documentation:
•For a complete list of features and specifications, see the HP ProLiant DL1000 Multi Node Server
QuickSpecs on the HP website
(http://h18004.www1.hp.com/products/quickspecs/13309_na/13309_na.html).
•For service information, see the HP ProLiant DL170h G6 Server Maintenance and Service Guide on the
HP website
(http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01806355/c01806355.pdf).
Front panel components (DL170h G6)
Item Description
1 Hard drive bay (populated)
2 Rack-mounting thumbscrews (2)
Front panel LEDs and buttons (DL170h G6)
Item Description
1 Power button (node 3)
2 Health LED (node 3)
3 Health LED (node 4)
4 Power button (node 4)
5 Chassis UID LED button

HP ProLiant servers (rack) 11
Item Description
6 Health LED (node 1)
7 Power button (node 1)
8 Power button (node 2)
9 Health LED (node 2)
10 Hard drive activity LED
11 Hard drive fault/UID LED
Rear panel components (DL170h G6)
The table below describes components for node 1 only. Each node contains the same components in the
same orientation, except for the power supply. The four nodes have only two power supplies.
Item Description
1 Video connector
2 PCIe2, low-profile expansion slot
3 Serial connector
4 1-Gb NIC 1 connector
5 1-Gb NIC 2/management connector (shared)
6 USB connectors (2)
7 Dedicated management port (IPMI) (optional)
8 Power supply cable connector

HP ProLiant servers (rack) 12
Rear panel LEDs and buttons (DL170h G6)
The table below describes LEDs for node 1 only. Each node contains the same LEDs in the same orientation.
Item Description
1 UID LED/button
2 Health LED
3 Power button
4 NIC activity LED
5 NIC link LED
PCI expansion slot definitions (DL170h G6)
The HP ProLiant DL170h G6 Server has one available low-profile PCIe2 x16 slot per node.
HP ProLiant DL2000 Multi Node Servers
The HP ProLiant DL2000 Multi Node Servers are supported in the HP Cluster Platform. The DL2000 Multi
Node Servers consist of up to four independent DL170e G6 servers in the 2U HP ProLiant e2000 G6 Chassis.
HP ProLiant DL170e G6 Server
The HP ProLiant DL170e G6 Server is used as a compute node in HP Cluster Platform configurations.
HP ProLiant DL170e G6 Server documentation
For server-specific information, see the server documentation:
•For a complete list of features and specifications, see the HP ProLiant DL2000 Multi Node Server
QuickSpecs on the HP website
(http://h18004.www1.hp.com/products/quickspecs/13847_na/13847_na.html).
•For installation and service information, see the HP ProLiant DL170e G6 Server Installation Sheet and
the HP ProLiant DL170e G6 Server Maintenance and Service Guide on the HP website
(http://www.hp.com/support/manuals).
Under servers, select ProLiant ML/DL and TC series servers, and then select HP ProLiant DL170e G6
Server series.

HP ProLiant servers (rack) 13
Front panel components (DL170e G6)
The HP Cluster Platform supports the following three models of the HP ProLiant DL170e G6 Server:
•Four-node server with 8-bay LFF hard drive cage
Item Description
1 LFF hard drive bays, populated (8)
2 Rack-mounting thumbscrews (2)
•Four-node server with 16-bay SFF hard drive cage
Item Description
1 SFF hard drive bays, populated (16)
2 Rack-mounting thumbscrews (2)
•Four-node server with 24-bay SFF hard drive cage

HP ProLiant servers (rack) 14
Item Description
1 SFF hard drive bays, populated (24)
2 Rack-mounting thumbscrews (2)
Front panel LEDs and buttons (DL170e G6)
The HP Cluster Platform supports the following three models of the HP ProLiant DL170e G6 Server:
•Four-node server with 8-bay LFF hard drive cage
Item Description Status
1 Power button (node 2) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
2 Health LED (node 2) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
3 Health LED (node 1) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
4 Power button (node 1) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
5 Power button (node 3) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
6 Health LED (node 3) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
7 Chassis UID LED button Blue = Identification is activated.
Flashing blue = System is being managed remotely.
Off = Off

HP ProLiant servers (rack) 15
Item Description Status
8 Health LED (node 4) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
9 Power button (node 4) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
•Four-node server with 16-bay SFF hard drive cage
Item Description Status
1
Power button (node 2)
Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
2 Health LED (node 2) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
3 Health LED (node 1) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
4 Power button (node 1) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
5 Power button (node 3) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
6 Health LED (node 3) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
7 Chassis UID LED button Blue = Identification is activated.
Flashing blue = System is being managed remotely.
Off = Off

HP ProLiant servers (rack) 16
Item Description Status
8 Health LED (node 4) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
9 Power button (node 4) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
•Four-node server with 16-bay SFF hard drive cage
Item Description Status
1
Power button (node 2)
Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
2 Health LED (node 2) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
3 Health LED (node 1) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
4 Power button (node 1) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
5 Power button (node 3) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
6 Health LED (node 3) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
7 Chassis UID LED button Blue = Identification is activated.
Flashing blue = System is being managed remotely.
Off = Off

HP ProLiant servers (rack) 17
Item Description Status
8 Health LED (node 4) Green = System health is normal.
Flashing amber = System health is degraded (non-critical). For more
information, see SEL.
Flashing red = System health is critical. For more information, see SEL.
Off = System is off and health is normal.
9 Power button (node 4) Green—Normal (system on)
Amber—The node is off or in hibernation with AC power.
Off—Off without AC power
Rear panel components (DL170e G6)
The table below describes components for node 1 only. Each node contains the same components in the
same orientation, except for the power supply. The four nodes have only two power supplies.
Item Description
1 Power supply 2
2 Power supply 1
3 PCIe2, low-profile expansion slot
4 Dedicated management port (optional)
5 USB connectors (2)
6 1-Gb NIC 1 connector
7 1-Gb NIC 2/management connector (shared)
8 Serial connector
9 Video connector

HP ProLiant servers (rack) 18
Rear panel LEDs and buttons (DL170e G6)
The table below describes LEDs for node 1 only. Each node contains the same LEDs in the same orientation.
Item Description Status
1 UID LED/button —
2 Health LED —
3 Power button —
4 LAN network speed LED 10/100 speed
Green—The LAN connection is using a 100 Mbps link.
Off—The LAN connection is using a 10 Mbps link.
GbE speed
Green—The LAN connection is using a 100 Mbps link.
Flashing green—The LAN connection is using a 10 Mbps/100 Mbps
link for port identification.
Amber—The LAN connection is using a 1 Gbps link.
Flashing amber—The LAN connection is using a 1 Gbps link for port
identification.
Off—The LAN connection is using a 10 Mbps link.
5 LAN activity status LED Green—Normal LAN connection. No activity.
Flashing green—Ongoing network data activity
Off—No network data activity or no connection
6 Management port activity
LED (optional)
Green—Linking at 100 Mbps speed
Off—No connection or linking at 10 Mbps speed
7 Management port link LED
(optional) Flashing amber—LAN is active.
PCI expansion slot definitions (DL170e G6)
The HP ProLiant DL170e G6 Server has one available low-profile PCIe2 x16 slot per node.
HP ProLiant DL380 G6 Server
The HP ProLiant DL380 G6 Server is used as a control node in HP Cluster Platform configurations.

HP ProLiant servers (rack) 19
HP ProLiant DL380 G6 Server documentation
For server-specific information, see the server documentation:
•For a complete list of features and specifications, see the HP ProLiant DL380 Generation 6 (G6)
QuickSpecs on the HP website
(http://h18004.www1.hp.com/products/quickspecs/13234_na/13234_na.pdf).
•For installation and service information, see the HP ProLiant DL380 G6 Server User Guide and the HP
ProLiant DL380 G6 Server Maintenance and Service Guide on the HP website
(http://www.hp.com/support/manuals).
Under servers, select ProLiant ML/DL and TC series servers, and then select HP ProLiant DL380 G6
Server series.
Front panel components (DL380 G6)
•SFF hard drive model
Item Description
1 Quick release levers (2)
2
Systems Insight Display
3 Hard drive bays (8)
4 SATA optical drive bay
5 Video connector
6 USB connectors (2)
•SFF hard drive model with optional hard drive cage

HP ProLiant servers (rack) 20
Item Description
1 Quick release levers (2)
2 Systems Insight Display
3 Hard drive bays (8)
4 Optional hard drive bays (8)
5 Video connector
6 USB connectors (2)
•LFF hard drive model
Item Description
1 Quick release levers (2)
2 Systems Insight Display
3
Hard drive bays (6)
4 USB connectors (2)
5 Video connector
Front panel LEDs and buttons (DL380 G6)