HP ProLiant DL60 Gen9 User manual

HPE ProLiant DL60 Gen9 Server
User Guide
Abstract
This document is for the person who installs, administers, and troubleshoots servers and storage systems. Hewlett Packard Enterprise
assumes you are qualified in the servicing of computer equipment and trained in recognizing hazards in products with hazardous energy
levels.
Part Number: 786245-003
April 2016
Edition: 3

© Copyright 2014, 2016 Hewlett Packard Enterprise Development LP
The information contained herein is subject to change without notice. The only warranties for Hewlett Packard Enterprise products and services
are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting
an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein.
Linux® is the registered trademark of Linus Torvalds in the U.S. and other countries.
Microsoft® and Windows® are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries.
microSD® is a trademark or a registered trademark of SD-3C in the United States, other countries or both.
Intel® and Xeon® are registered trademarks of Intel Corporation in the U.S. and other countries.

Contents 3
Contents
Component identification ............................................................................................................................ 6
Front panel components.............................................................................................................................................6
Front panel LEDs and buttons ...................................................................................................................................7
Front panel LED power fault codes.................................................................................................................8
Rear panel components .............................................................................................................................................8
Rear panel LEDs ........................................................................................................................................................9
PCIe riser board slot definitions .................................................................................................................................9
System board components ......................................................................................................................................10
DIMM slot locations .......................................................................................................................................11
System maintenance switch..........................................................................................................................11
NMI functionality............................................................................................................................................12
Drive numbering .......................................................................................................................................................12
Hot-plug drive LED definitions..................................................................................................................................13
Fan locations ............................................................................................................................................................14
Operations................................................................................................................................................. 15
Power up the server .................................................................................................................................................15
Power down the server.............................................................................................................................................15
Extend the server from the rack...............................................................................................................................15
Access the product rear panel .................................................................................................................................17
Opening the cable management arm............................................................................................................17
Remove the server from the rack.............................................................................................................................18
Remove the security bezel (optional).......................................................................................................................18
Remove the access panel........................................................................................................................................18
Install the access panel............................................................................................................................................19
Remove the air baffle ...............................................................................................................................................19
Install the air baffle ...................................................................................................................................................20
Remove the PCI riser cage ......................................................................................................................................21
Install the PCI riser cage ..........................................................................................................................................23
Setup......................................................................................................................................................... 26
Optional services......................................................................................................................................................26
Optimum environment ..............................................................................................................................................26
Space and airflow requirements....................................................................................................................26
Temperature requirements............................................................................................................................27
Power requirements ......................................................................................................................................27
Electrical grounding requirements ................................................................................................................28
Server warnings and cautions..................................................................................................................................28
Rack warnings..........................................................................................................................................................29
Identifying the contents of the server shipping carton .............................................................................................29
Installing hardware options ......................................................................................................................................30
Installing the server into the rack .............................................................................................................................30
Installing the rack rail hook-and-loop strap ..............................................................................................................33
Installing the operating system.................................................................................................................................34
Powering on and selecting boot options in UEFI Boot Mode ..................................................................................35
Registering the server ..............................................................................................................................................35
Hardware options installation ................................................................................................................... 36
Introduction...............................................................................................................................................................36
Security bezel option................................................................................................................................................36
Drive options.............................................................................................................................................................36
Drive installation guidelines...........................................................................................................................37
Installing a non-hot-plug drive .......................................................................................................................37
Installing a hot-plug drive ..............................................................................................................................38
Storage controller options ........................................................................................................................................39

Contents 4
Installing a storage controller and FBWC module ........................................................................................40
Installing a Smart Storage Battery ................................................................................................................42
Drive cable options...................................................................................................................................................43
Mini-SAS cable options .................................................................................................................................43
Optical drive option...................................................................................................................................................45
Redundant fan option...............................................................................................................................................46
Fan population guidelines .............................................................................................................................47
Installing a hot-swap fan module...................................................................................................................47
Memory options........................................................................................................................................................49
Memory-processor compatibility information ................................................................................................49
SmartMemory................................................................................................................................................50
Memory subsystem architecture ...................................................................................................................51
Single-, dual-, and quad-rank DIMMs ...........................................................................................................51
DIMM identification........................................................................................................................................52
Memory configurations..................................................................................................................................52
General DIMM slot population guidelines .....................................................................................................53
Identifying the processor type .......................................................................................................................54
Installing a DIMM...........................................................................................................................................54
Processor option.......................................................................................................................................................55
Processor installation cautions......................................................................................................................56
Installing a processor ....................................................................................................................................56
FlexibleLOM option ..................................................................................................................................................61
Full-height half-length riser option............................................................................................................................63
Expansion board options..........................................................................................................................................65
M.2 SSD enablement option ....................................................................................................................................68
Dual 8Gb microSD Enterprise Midline USB device .................................................................................................70
Redundant power supply option...............................................................................................................................71
Power input module and RPS backplane characteristics .............................................................................71
Installing the redundant power supply option ...............................................................................................71
HP Trusted Platform Module option.........................................................................................................................76
Installing the Trusted Platform Module board...............................................................................................76
Retaining the recovery key/password ...........................................................................................................78
Enabling the Trusted Platform Module..........................................................................................................78
Cabling ...................................................................................................................................................... 80
Cabling overview ......................................................................................................................................................80
Storage cabling.........................................................................................................................................................80
Four-bay LFF non-hot-plug drive cabling......................................................................................................80
Four-bay LFF hot-plug drive cabling .............................................................................................................81
M.2 SSD cabling............................................................................................................................................83
FBWC cabling...........................................................................................................................................................85
Smart Storage battery cabling..................................................................................................................................87
Power supply cabling ...............................................................................................................................................88
Optical drive cabling.................................................................................................................................................89
Front I/O cabling.......................................................................................................................................................89
Software and configuration utilities........................................................................................................... 90
Server mode.............................................................................................................................................................90
Product QuickSpecs.................................................................................................................................................90
HPE iLO....................................................................................................................................................................90
Active Health System ....................................................................................................................................91
RESTful API support for iLO .........................................................................................................................92
Integrated Management Log.........................................................................................................................92
Intelligent Provisioning .............................................................................................................................................92
HPE Insight Diagnostics................................................................................................................................93
HPE Insight Diagnostics survey functionality................................................................................................93
Erase Utility ...................................................................................................................................................93
Scripting Toolkit for Windows and Linux..................................................................................................................94
Service Pack for ProLiant.........................................................................................................................................94
HP Smart Update Manager...........................................................................................................................94
HPE UEFI System Utilities .......................................................................................................................................94
Using UEFI System Utilities ..........................................................................................................................95

Contents 5
Flexible boot control ......................................................................................................................................95
Restoring and customizing configuration settings ........................................................................................96
Secure Boot configuration.............................................................................................................................96
Embedded UEFI shell ...................................................................................................................................96
Embedded Diagnostics option ......................................................................................................................97
RESTful API support for UEFI.......................................................................................................................97
Re-entering the server serial number and product ID ..................................................................................97
Utilities and features.................................................................................................................................................97
HPE Smart Storage Administrator ................................................................................................................97
Automatic Server Recovery ..........................................................................................................................98
USB support ..................................................................................................................................................98
Redundant ROM support ..............................................................................................................................98
Keeping the system current .....................................................................................................................................99
Access to Hewlett Packard Enterprise Support Materials ............................................................................99
Updating firmware or System ROM ..............................................................................................................99
Drivers .........................................................................................................................................................101
Software and firmware ................................................................................................................................101
Operating System Version Support ............................................................................................................101
Version control.............................................................................................................................................101
Operating systems and virtualization software support for ProLiant servers.............................................102
HPE Technology Service Portfolio..............................................................................................................102
Change control and proactive notification...................................................................................................102
Troubleshooting ...................................................................................................................................... 103
Troubleshooting resources.....................................................................................................................................103
System battery replacement................................................................................................................... 104
Warranty and regulatory information ...................................................................................................... 106
Warranty information..............................................................................................................................................106
Regulatory information ...........................................................................................................................................106
Safety and regulatory compliance...............................................................................................................106
Belarus Kazakhstan Russia marking ..........................................................................................................106
Turkey RoHS material content declaration .................................................................................................107
Ukraine RoHS material content declaration................................................................................................107
Electrostatic discharge............................................................................................................................ 108
Preventing electrostatic discharge .........................................................................................................................108
Grounding methods to prevent electrostatic discharge .........................................................................................108
Specifications.......................................................................................................................................... 109
Environmental specifications..................................................................................................................................109
Mechanical specifications ......................................................................................................................................109
Power supply specifications ...................................................................................................................................109
Hot-plug power supply calculations .......................................................................................................................110
Support and other resources .................................................................................................................. 111
Accessing Hewlett Packard Enterprise Support ....................................................................................................111
Information to collect ...................................................................................................................................111
Accessing updates .................................................................................................................................................111
Websites.................................................................................................................................................................111
Customer Self Repair .............................................................................................................................................112
Remote support......................................................................................................................................................119
Acronyms and abbreviations .................................................................................................................. 120
Documentation feedback........................................................................................................................ 124
Index........................................................................................................................................................ 125

Component identification 6
Component identification
Front panel components
Item Description
1
Optical drive (optional)
2
Serial label pull tab
The serial number/iLO information pull tab is double-sided. The
top side shows the server serial number and the customer asset
tag label. The reverse side shows the default iLO account
information and QR code label. Use your mobile device to scan
the QR code label to display the server mobile product page
(http://www.hpe.com/qref/dl60gen9). This page contains
links to server setup information, spare part numbers,
QuickSpecs, troubleshooting resources, and other useful
product links.
3
USB 2.0 connector
4
LFF drives

Component identification 7
Front panel LEDs and buttons
Item Description Status
1
UID button/LED
Solid blue = Activated
Flashing blue:
•
1 flash per second = Remote management or firmware upgrade
in progress
•
4 flashes per second = iLO manual reboot sequence initiated
•
8 flashes per second = iLO manual reboot sequence in
progress
Off = Deactivated
2
Health LED
Solid green = Normal
Flashing green (1 flash per second) = iLO is rebooting
Flashing amber = System degraded
Flashing red (1 flash per second) = System critical
If the health LED indicates a degraded or critical state, review the
system IML ("Integrated Management Log" on page 92) or use iLO
("HPE iLO" on page 90) to review the system health status.
3
NIC status LED
Solid green = Link to network
Flashing green (1 flash per second) = Network active
Off = No network activity
4
Power On/Standby button
and system power LED
Solid green = System on
Flashing green (1 flash per second) = Performing power on
sequence
Solid amber = System in standby
Off = No power present
If the system power LED is off, verify the following conditions:
•
Facility power is present.
•
The power supply is installed and is working correctly.
•
The power cord is attached and is connected to a power source.
•
The front I/O cable is connected.

Component identification 8
When all four LEDs described in this table flash simultaneously, a power fault has occurred. For more
information, see "Power fault LEDs ("Front panel LED power fault codes" on page 8)."
Front panel LED power fault codes
The following table provides a list of power fault codes, and the subsystems that are affected. Not all
power faults are used by all servers.
Subsystem Front panel LED
behavior
System board
1 flash
Processor
2 flashes
Memory
3 flashes
Riser board PCIe slots
4 flashes
FlexibleLOM
5 flashes
Removable HPE Flexible Smart Array
controller/Smart SAS HBA controller
6 flashes
System board PCIe slots
7 flashes
Power backplane or storage backplane
8 flashes
Power supply
9 flashes
For more information, see "Front panel LEDs and buttons (on page 7)."
Rear panel components
Item
Description
1
Slot 3 PCIe3 x8 (8, 4, 1)
2
Slot 2 PCIe3 x8 (8, 4, 1)
3
Slot 1 PCIe3 x16 (16, 8, 4, 1)
4
Non-hot-plug power supply
5
Power supply blank (bay 2 of optional redundant power
supply module)
6
Hot-plug power supply (bay 1 of optional redundant
power supply module)
7
NIC connector 2
8
NIC connector 1/iLO connector
9
Video connector
10
USB 3.0 connectors

Component identification 9
Rear panel LEDs
Item Description Status
1
UID LED
Solid blue = Activated
Flashing blue:
•
1 flash per second = Remote management
or firmware upgrade in progress
•
4 flashes per second = iLO manual reboot
sequence initiated
•
8 flashes per second = iLO manual reboot
sequence in progress
Off = Deactivated
2
NIC link LED
Green = Network link
Off = No network link
3
NIC activity LED
Solid green = Link to network
Flashing green = Network active
Off = No network activity
4
Power supply LED
Solid green = Normal
Off = One or more of the following conditions
exists:
•
Power is unavailable
•
Power supply failed
•
Power supply is in standby mode
•
Power supply error
PCIe riser board slot definitions
Expansion
Slots
Riser
board
options
Technology Bus
Width
Connector
Width
Form Factor
1
PCIe riser
PCIe 3.0
x16
x16
Low-profile
2
PCIe riser
PCIe 3.0
x8
x8
Low-profile
3
PCIe riser
FlexibleLOM
PCIe 3.0
x8
x8
x8
x8
Full-height/Half-length
FlexibleLOM

Component identification 10
System board components
Item Description
1
Primary PCIe riser board connector*
2
TPM connector
3
System battery
4
SATA connector
5
Storage backup power connector for PCIe slots 1-2
6
Reserved
7
Secondary PCIe riser board connector*
8
MicroSD slot
9
Storage backup power connector for PCIe slot 3
10
System maintenance switch
11
NMI header
12
Reserved
13
Reserved
14
Front I/O connector
15
Fan 6 connector
16
Fan 5 connector
17
Fan 4 connector
18
Fan 3 connector
19
Fan 2 connector
20
Fan 1 connector
21
Smart Storage Battery connector
22
6-pin drive backplane power connector
23
Internal USB 3.0 connector
24
24-pin power connector
25
16-pin PS connector
26
Mini-SAS connector 1
27
Mini-SAS connector 2
* For more information on the riser board slots supported by the onboard PCI riser connectors, see "PCIe
riser board slot definitions (on page 9)."

Component identification 11
DIMM slot locations
DIMM slots are numbered sequentially (1 through 4) for each processor. The supported AMP modes use
the letter assignments for population guidelines.
The arrow points to the front of the server.
System maintenance switch
Position Default Function
S1
Off
Off = iLO 4 security is enabled.
On = iLO 4 security is disabled.
S2
Off
Off = System configuration can be
changed.
On = System configuration is locked.
S3
Off
Reserved
S4
Off
Reserved
S5
Off
Off = Power-on password is enabled.
On = Power-on password is disabled.
S6
Off
Off = No function
On = ROM reads system
configuration as invalid.
S7
Off
Off = Set default boot mode to UEFI.
On = Set default boot mode to legacy.
S8
—
Reserved
S9
—
Reserved
S10
—
Reserved
S11
—
Reserved
S12
—
Reserved
To access the redundant ROM, set S1, S5, and S6 to On.
When the system maintenance S6 switch is set to the On position, the system will erase all system
configuration settings from both CMOS and NVRAM on the next reboot.

Component identification 12
CAUTION: Clearing CMOS and/or NVRAM deletes configuration information. Be sure to
properly configure the server or data loss could occur.
Before using the S7 switch to change the boot mode to Legacy BIOS Mode, you must first disable the
Dynamic Smart Array B140i Controller.
To disable the Dynamic Smart Array B140i Controller:
1. Reboot the server.
The server restarts and the POST screen appears.
2. Press F9.
The System Utilities screen appears.
3. Select System Configuration →BIOS/Platform Configuration (RBSU) →System Options →
SATA Controller Options →Embedded SATA Configuration, and then press Enter.
4. Select Enable SATA AHCI Support, and then press Enter.
5. Press F10 to save the selection.
6. Press Yto save the changes.
The Change saved confirmation prompt appears.
7. Select Exit and resume system boot, and press Enter.
The server continues the normal boot process.
NMI functionality
An NMI crash dump creates a crash dump log before resetting a system which is not responding.
Crash dump log analysis is an essential part of diagnosing reliability problems, such as failures of
operating systems, device drivers, and applications. Many crashes freeze a system, and the only
available action for administrators is to restart the system. Resetting the system erases any information
which could support problem analysis, but the NMI feature preserves that information by performing a
memory dump before a system reset.
To force the system to invoke the NMI handler and generate a crash dump log, do one of the following:
•Use the iLO Virtual NMI feature.
•Short the NMI header ("System board components" on page 10).
For more information, see the Hewlett Packard Enterprise website
(http://www.hpe.com/support/NMI-CrashDump).
Drive numbering

Component identification 13
Hot-plug drive LED definitions
Item LED Status Definition
1
Locate
Solid blue
The drive is being identified by a host application.
Flashing blue
The drive carrier firmware is being updated or requires an
update.
2
Activity ring
Rotating green
Drive activity
Off
No drive activity
3
Do not remove
Solid white
Do not remove the drive. Removing the drive causes one or
more of the logical drives to fail.
Off
Removing the drive does not cause a logical drive to fail.
4
Drive status
Solid green
The drive is a member of one or more logical drives.
Flashing green
The drive is rebuilding or performing a RAID migration, strip size
migration, capacity expansion, or logical drive extension, or is
erasing.
Flashing
amber/green
The drive is a member of one or more logical drives and predicts
the drive will fail.
Flashing amber
The drive is not configured and predicts the drive will fail.
Solid amber
The drive has failed.
Off
The drive is not configured by a RAID controller.
The blue Locate LED is behind the release lever and is visible when illuminated.
IMPORTANT: The Dynamic Smart Array B140i Controller is only available in UEFI Boot
Mode. It cannot be enabled in Legacy BIOS Boot Mode. If the B140i controller is disabled,
drives connected to the system board Mini-
SAS connectors operate in AHCI or Legacy mode.
Under this condition:
•The drives cannot be a part of a hardware RAID or a logical drive.
•The Locate, Drive status, and Do not remove LEDs of the affected drives are disabled.
Use BIOS/Platform Configuration (RBSU) in the UEFI System Utilities ("HPE UEFI System
Utilities" on page 94) to enable or disable the B140i controller (System Configuration →
BIOS/Platform Configuration (RBSU) →System Options →SATA Controller Options →
Embedded SATA Configuration).

Component identification 14
Fan locations

Operations 15
Operations
Power up the server
1. Connect each power cord to the server.
2. Connect each power cord to the power source.
3. Press the Power On/Standby button.
The server exits standby mode and applies full power to the system. The system power LED
changes from amber to green.
Power down the server
Before powering down the server for any upgrade or maintenance procedures, perform a backup of
critical server data and programs.
WARNING: To reduce the risk of personal injury, electric shock, or damage to the equipment,
disconnect the power cord to remove power from the server. The front panel Power
On/Standby button does not completely shut off system power. Portions of the power supply
and some internal circuitry remain active until the power cord is disconnected.
IMPORTANT:
When the server is in standby mode, auxiliary power is still being provided to
the system.
To power down the server, use one of the following methods:
•Press and release the Power On/Standby button.
This method initiates a controlled shutdown of applications and the OS before the server enters
standby mode.
•Press and hold the Power On/Standby button for more than 4 seconds to force the server to enter
standby mode.
This method forces the server to enter standby mode without properly exiting applications and the
OS. If an application stops responding, you can use this method to force a shutdown.
•Use a virtual power button selection through iLO 4.
This method initiates a controlled remote shutdown of applications and the OS before the server
enters standby mode.
Before proceeding, verify the server is in standby mode by observing that the system power LED is
amber.
Extend the server from the rack
To extend the server from a Hewlett Packard Enterprise, Compaq-branded, Telco, or third-party rack:
WARNING:
To reduce the risk of personal injury or equipment damage, be sure that the rack
is adequately stabilized before extending a component from the rack.
WARNING: To reduce the risk of personal injury, be careful when pressing the server
rail-release latches and sliding the server into the rack. The sliding rails could pinch your
fingers.

Operations 16
1. If the rear panel cables are not secured by a cable management arm, do the following:
a. Power down the server (on page 15).
b. Disconnect all peripheral cables from the server.
c. Disconnect each power cord from the server.
2. Do one of the following:
oIn a server that uses thumbscrew rack ears, loosen the captive thumbscrews that secure the
server faceplate to the front of the rack, and then slide the server out of the rack.
oIn a server that uses quick-release latch rack ears:
i. Open the latches on both sides of the server.
ii. If necessary, use a T-25 Torx screwdriver to loosen the shipping screws.
iii. Slide the server out of the rack.
3. After performing the installation or maintenance procedure, slide the server back into the rack, and
then press the server firmly into the rack to secure it in place.
4. Do one of the following:
oIn a server that uses thumbscrew rack ears, tighten the captive thumbscrews.

Operations 17
oIn a server that uses quick-release latch rack ears, if necessary, tighten the shipping screws.
5. If the rear panel cables were disconnected because a cable management arm is not in use, do the
following:
a. Connect each power cord to the server.
b. Connect all peripheral cables to the server.
c. Power up the server (on page 15).
Access the product rear panel
Opening the cable management arm
To access the server rear panel:
1. Release the cable management arm.
2. Open the cable management arm. The cable management arm can be right-mounted or
left-mounted.

Operations 18
Remove the server from the rack
WARNING:
This server is very heavy. To reduce the risk of personal injury or damage to the
equipment:
•Observe local occupational health and safety requirements and guidelines for manual
material handling.
•
Get help to lift and stabilize the product during installation or removal, especially when the
product is not fastened to the rails. Hewlett Packard Enterprise recommends that a
minimum of two people are required for all rack server installations. A third person may be
required to help align the server if the server is installed higher than chest level.
•Use caution when installing the server in or removing the server from the rack; it is unstable
when not fastened to the rails.
To remove the server from a Hewlett Packard Enterprise, Compaq-branded, Telco, or a third-party rack:
1. Power down the server (on page 15).
2. Disconnect all peripheral cables from the server.
3. Disconnect each power cord from the server.
4. Extend the server on the rack rails until the server rail-release latches engage.
5. Remove the server from the rack.
For instructions on how to extend or remove the server from the rack, see the documentation that
ships with the rack rail system.
6. Place the server on a sturdy, level surface.
Remove the security bezel (optional)
The security bezel is only supported in servers using the quick-release latch rack ears.
To access the front panel components, unlock and then remove the security bezel.
Remove the access panel
WARNING:
To reduce the risk of personal injury from hot surfaces, allow the drives and the
internal system components to cool before touching them.

Operations 19
CAUTION: To prevent damage to electrical components, take the appropriate anti-static
precautions before beginning any installation, removal, or replacement procedure. Improper
grounding can cause electrostatic discharge.
CAUTION: Do not operate the server for long periods with the access panel open or
removed. Operating the server in this manner results in improper airflow and improper cooling
that can lead to thermal damage.
1. Power down the server (on page 15).
2. If you are performing a non-hot-plug procedure, remove all power:
a. Disconnect each power cord from the power source.
b. Disconnect each power cord from the server.
3. Do one of the following:
oExtend the server from the rack (on page 15).
oRemove the server from the rack (on page 18).
4. Open the access panel latch, slide the access panel to the rear of the chassis, and then remove the
access panel.
If the access panel latch is locked, use a T-15 Torx screwdriver to unlock the latch.
Install the access panel
1. Place the access panel on top of the server with the access panel latch open. Allow the panel to
extend past the rear of the server by approximately 1.25 cm (0.5 inch).
2. Close the access panel latch. The access panel slides to a closed position.
3. Use a T-15 Torx screwdriver to tighten the access panel latch screw.
Remove the air baffle
CAUTION: For proper cooling, do not operate the server without the access panel, baffles,
expansion slot covers, or blanks installed. If the server supports hot-plug components,
minimize the amount of time the access panel is open.

Operations 20
To remove the component:
1. Power down the server (on page 15).
2. If you are performing a non-hot-plug procedure, remove all power:
a. Disconnect each power cord from the power source.
b. Disconnect each power cord from the server.
3. Do one of the following:
oExtend the server from the rack (on page 15).
oRemove the server from the rack (on page 18).
4. Remove the access panel (on page 18).
5. Remove the air baffle.
l
Install the air baffle
CAUTION: For proper cooling, do not operate the server without the access panel, baffles,
expansion slot covers, or blanks installed. If the server supports hot-plug components,
minimize the amount of time the access panel is open.