HPE Cloudline CL2600 Gen10 Operating instructions

HPE Cloudline CL2600 Gen10 Server
User and Maintenance Guide
Part Number: P08745-003
Published: February 2019
Edition: 3
Abstract
This document is for the person who installs, administers, and troubleshoots servers and
storage systems. Hewlett Packard Enterprise assumes you are qualified in the servicing of
computer equipment and trained in recognizing hazards in products with hazardous energy
levels.

© Copyright 2018, 2019 Hewlett Packard Enterprise Development LP
Notices
The information contained herein is subject to change without notice. The only warranties for Hewlett
Packard Enterprise products and services are set forth in the express warranty statements accompanying
such products and services. Nothing herein should be construed as constituting an additional warranty.
Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained
herein.
Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession,
use, or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer
Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government
under vendor's standard commercial license.
Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard
Enterprise has no control over and is not responsible for information outside the Hewlett Packard
Enterprise website.
Acknowledgments
Intel® and Xeon® are trademarks of Intel Corporation in the United States and other countries.
Microsoft® and Windows® are either registered trademarks or trademarks of Microsoft Corporation in the
United States and/or other countries.
Open Source Software: This product includes code licensed under the GNU GENERAL PUBLIC
LICENSE, GNU LESSER GENERAL PUBLIC LICENSE, and/or certain other open source licenses. A
complete machine-readable copy of the source code corresponding to such code is available upon
request. This offer is valid to anyone in receipt of this information and shall expire three years following
the date of the final distribution of this product version by Hewlett Packard Enterprise. For information
about acquiring the open source code for this product, send an email to the Account Manager for this
product, listing the product name and version information for which the source code is being requested.
Because such information can become outdated quickly, Hewlett Packard Enterprise does not publish
mailing addresses and telephone numbers for open source queries. Available source code distribution
methods include network transmission of the source code and sending the source code on physical
media to a mailing address. Physical media distribution might require a fee to cover the media and
mailing costs.

Contents
Component identification.......................................................................8
Front panel components............................................................................................................... 8
8SFF front panel components............................................................................................8
8+2SFF and 10SFF front panel components..................................................................... 8
Front panel LEDs and buttons...................................................................................................... 9
Rear panel components..............................................................................................................10
Rear panel LEDs.........................................................................................................................10
System board components......................................................................................................... 12
System maintenance switch descriptions........................................................................ 13
DIMM slot locations..........................................................................................................13
DIMM label identification.................................................................................................. 14
Drive bay numbering...................................................................................................................16
8SFF device bay numbering............................................................................................ 16
10SFF device bay numbering.......................................................................................... 16
Hot-plug drive LED definitions.................................................................................................... 17
Hot-plug fans...............................................................................................................................18
Operations............................................................................................. 20
Power up the server....................................................................................................................20
Power down the server............................................................................................................... 20
Setup...................................................................................................... 21
Optimum environment.................................................................................................................21
Space and airflow requirements.......................................................................................21
Temperature requirements............................................................................................... 22
Power requirements......................................................................................................... 22
Electrical grounding requirements....................................................................................22
Connecting a DC power cable to a DC power source......................................................23
Rack warnings.............................................................................................................................24
Identifying the contents of the server shipping carton.................................................................24
Installing hardware options ........................................................................................................ 25
Installing the server into the rack................................................................................................ 25
Installing the operating system................................................................................................... 25
Selecting boot options in BIOS Setup.........................................................................................26
Selecting boot options.................................................................................................................26
Registering the server.................................................................................................................27
Software and configuration utilities.................................................... 28
HPE BMC....................................................................................................................................28
Using BMC....................................................................................................................... 28
Firmware Information....................................................................................................... 29
Firmware update.............................................................................................................. 29
Troubleshooting.................................................................................... 31
Hardware Issue...........................................................................................................................31
3

Power issue......................................................................................................................31
Server does not power on..................................................................................... 31
Power source issue............................................................................................... 31
Power supply issue................................................................................................32
General hardware issue..............................................................................................................32
New hardware issue.........................................................................................................32
Unknown issue.................................................................................................................33
Third party device issue................................................................................................... 33
Internal system issue.................................................................................................................. 34
Drive issue........................................................................................................................34
Drives are failed.....................................................................................................34
Drives are not recognized..................................................................................... 35
Data is inaccessible...............................................................................................35
Server response time is slower than usual............................................................36
Storage issue.............................................................................................................................. 36
RAID Controller drivers are not recognized..................................................................... 36
Data failure or disk errors on a server with HDD backplane............................................ 36
Fan issue.....................................................................................................................................37
General fan issues........................................................................................................... 37
Fans running at a higher than expected speed................................................................37
Excessive fan noise (high speeds)...................................................................................38
Excessive fan noise (low speeds).................................................................................... 38
Memory issue..............................................................................................................................39
General memory issues................................................................................................... 39
Server is out of memory................................................................................................... 39
Server fails to recognize new memory............................................................................. 40
Uncorrectable memory error............................................................................................ 40
Correctable memory error threshold exceeded................................................................41
Processor issue...........................................................................................................................41
Troubleshooting the processor.........................................................................................41
Uncorrectable machine check exception......................................................................... 42
System battery is low or lost power..................................................................................43
System board or PDB issue............................................................................................. 43
USB drive key issue....................................................................................................................43
System does not boot from the USB drive key................................................................ 43
ODD drive issue..........................................................................................................................44
System does not boot from the CD-ROM or DVD drive...................................................44
Data read from the USB CD-ROM or DVD is inconsistent, or USB CD-ROM or DVD
cannot read data.............................................................................................................. 44
Drive is not detected........................................................................................................ 45
Graphics and Video adapter issue..............................................................................................45
Troubleshooting general graphics and video adapter issue.............................................45
External device issue.................................................................................................................. 46
Video issue.......................................................................................................................46
Screen is blank for more than 60 seconds after you power up the server............ 46
Monitor does not function properly with energy saver features.............................47
Video colors are wrong..........................................................................................47
Slow-moving horizontal lines are displayed.......................................................... 47
Mouse and keyboard issues..................................................................................48
Network controller issue...................................................................................................48
Network controller has stopped working............................................................... 48
Software issue.............................................................................................................................49
Operating system issue....................................................................................................49
Operating system locks up.................................................................................... 49
Errors are displayed in the error log...................................................................... 49
Issues occur after the installation of a service pack.............................................. 49
Updating the operating system........................................................................................ 49
4

Reconfiguring or reloading software................................................................................ 50
Application software issues..............................................................................................50
Software locks up.................................................................................................. 50
Errors occur after a software setting is changed................................................... 51
Errors occur after the system software is changed............................................... 51
Errors occur after an application is installed..........................................................51
ROM update issue............................................................................................................52
Remote BIOS or BMC Firmware flash issues....................................................... 52
System utilities......................................................................................54
BIOS setup..................................................................................................................................54
Accessing the BIOS setup menu screen..........................................................................54
Navigating the BIOS setup menu screen......................................................................... 55
Remote Flash BIOS......................................................................................................... 56
BIOS setup menu screen............................................................................................................56
Main menu........................................................................................................................57
Advanced menu............................................................................................................... 58
iSCSI Configuration...............................................................................................59
Intel® Virtual RAID on CPU................................................................................... 59
HPE Ethernet 1Gb 4-port 331i Adapter - NIC....................................................... 61
VLAN Configuration...............................................................................................62
Driver Health..........................................................................................................63
Trusted Computing................................................................................................ 64
ACPI Settings........................................................................................................ 65
Serial Port Console Redirection............................................................................ 66
SIO Configuration..................................................................................................67
PCI Subsystem Settings........................................................................................68
Network Stack Configuration.................................................................................69
USB Configuration.................................................................................................70
NVMe Drive Configuration.....................................................................................72
NVMe SSD Drives List.......................................................................................... 73
Platform menu..................................................................................................................74
Socket menu.................................................................................................................... 75
Server Management menu...............................................................................................76
Security menu.................................................................................................................. 78
Boot menu........................................................................................................................79
Save & Exit menu.............................................................................................................80
Restore manufacturing defaults............................................................................ 81
Illustrated parts catalog........................................................................82
Mechanical components............................................................................................................. 82
Access panel spare parts.................................................................................................82
PCIe riser cage spare part............................................................................................... 82
PCIe riser blank spare parts.............................................................................................83
Miscellaneous blank spare parts......................................................................................83
Server ear and front bezel spare parts.............................................................................83
Rack mounting hardware spare parts.............................................................................. 83
Cable management arm spare parts................................................................................83
System components................................................................................................................... 84
Heatsink spare parts........................................................................................................ 84
Processor spare parts...................................................................................................... 84
DIMM spare parts.............................................................................................................85
Controller spare parts.......................................................................................................86
Controller spare parts............................................................................................86
5

Network adapter spare parts................................................................................. 86
PCIe riser board spare parts............................................................................................ 87
System board assembly spare parts................................................................................87
Server options.............................................................................................................................87
Fan spare parts................................................................................................................ 88
Power supply spare parts.................................................................................................88
Battery spare parts...........................................................................................................88
Drive spare parts..............................................................................................................88
Power switch spare parts................................................................................................. 90
Drive blackplane spare parts............................................................................................90
Cable kit spare parts........................................................................................................ 90
HPE Trusted Platform Module 2.0 spare part.................................................................. 90
Removal and replacement procedures............................................... 92
Required tools.............................................................................................................................92
Safety considerations..................................................................................................................92
Electrostatic discharge..................................................................................................... 92
Server warnings and cautions..........................................................................................93
Rack warnings..................................................................................................................93
Preparation procedures.............................................................................................................. 94
Power down the server.................................................................................................... 94
Extend the server from the rack....................................................................................... 95
Remove the server from the rack.....................................................................................95
Remove the access panel................................................................................................95
Removing and replacing the bezel..............................................................................................96
Removing the drive tray.............................................................................................................. 96
Removing a SAS/SATA drive ..................................................................................................... 97
Removing and replacing a power supply blank.......................................................................... 98
Removing and replacing the AC power supply........................................................................... 98
Removing and replacing a fan.................................................................................................... 99
Removing and replacing a fan blank.........................................................................................101
Removing and replacing a PCIe blank......................................................................................101
Removing and replacing a riser cage....................................................................................... 104
Removing and replacing a primary riser card........................................................................... 106
Removing and replacing a PCIe expansion board....................................................................107
Removing and replacing a rear serial port interface ................................................................ 109
Removing and replacing a DIMM..............................................................................................110
Removing and replacing a processor heatsink assembly......................................................... 111
Installing a processor heatsink assembly....................................................................... 111
Installing a high-performance heatsink...........................................................................113
Removing and replacing the system board...............................................................................117
Removing and replacing the 8SFF drive backplane..................................................................118
Removing and replacing the 10SFF drive backplane................................................................119
HPE Trusted Platform Module 2.0 Gen10 option......................................................................120
Overview........................................................................................................................ 120
HPE Trusted Platform Module 2.0 Guidelines................................................................120
Installing and enabling the HPE TPM 2.0 Gen10 Kit..................................................... 121
Installing the Trusted Platform Module board......................................................121
Enabling the Trusted Platform Module................................................................ 124
Retaining the recovery key/password................................................................. 124
Cabling................................................................................................. 125
Storage Cabling Guidelines ..................................................................................................... 125
SFF cables................................................................................................................................125
6

SFF configuration cable routing..................................................................................... 126
8SFF to RAID controller with CVPM05 ...............................................................126
8SFF to controller................................................................................................126
8SFF to system board......................................................................................... 127
2SFF NVMe + 8SFF embedded SATA................................................................127
2SFF NVMe + 8SFF SAS/SATA..........................................................................128
10SFF combo to NVMe riser with embedded SATA............................................128
10SFF combo to NVMe riser with SAS............................................................... 129
Removing and replacing the system battery....................................130
Specifications......................................................................................132
Environmental specifications.................................................................................................... 132
Server specifications.................................................................................................................132
Power supply specifications......................................................................................................133
HPE 500W Flex Slot Platinum Hot Plug Low Halogen Power Supply........................... 133
HPE 800W Flex Slot Platinum Hot Plug Low Halogen Power Supply........................... 134
HPE 800W Flex Slot Titanium Hot Plug Low Halogen Power Supply............................135
HPE 800W Flex Slot Universal Hot Plug Low Halogen Power Supply.......................... 136
HPE 800W Flex Slot -48VDC Hot Plug Low Halogen Power Supply.............................136
HPE 1600W Flex Slot Platinum Hot Plug Low Halogen Power Supply......................... 137
Support and other resources.............................................................139
Open Source Software..............................................................................................................139
Accessing Hewlett Packard Enterprise Support....................................................................... 139
Accessing updates....................................................................................................................139
Customer self repair..................................................................................................................140
HPE Cloudline Support Services.............................................................................................. 140
HPE Packaged Support Services.................................................................................. 140
Service benefits...................................................................................................140
Service feature highlights.................................................................................... 140
Warranty information.................................................................................................................140
Regulatory information..............................................................................................................141
Documentation feedback.......................................................................................................... 141
7

Component identification
Front panel components
8SFF front panel components
Item Description
1 SAS/SATA drive bays
2 USB 3.0 port
8+2SFF and 10SFF front panel components
Item Description
1 SAS/SATA drive bays
2 USB 3.0 port
IMPORTANT: When the 10SFF NVMe/SAS backplane option is installed, NVMe drives must be
installed in bays 8 and 9. The other bays support a mix of NVMe and SAS drives.
8 Component identification

Front panel LEDs and buttons
8SFF/10SFF
NOTE: When all four LEDs described in the following table flash simultaneously, a power fault has
occurred.
Item Description Status
1 UID button/LED Solid blue = Identified platform
Off = Deactivated 1
2 Power On/Standby button and
system power LED Solid green = System on and normal operation
Flashing green = Performing power on sequence
Solid amber = System in standby
Off = No power present
3 Health LED Solid green = Normal
Flashing amber = System degraded
Flashing red = System critical 2
4 NIC status LED Solid green = Link to network
Flashing green = Network active
Off = No network activity
1 Facility power is not present, power cord is not attached, no power supplies are installed, power supply failure has
occurred, or the power button cable is disconnected.
2 If the health LED indicates a degraded or critical state, review the system event log.
Component identification 9

Rear panel components
Item Description
1 Slot 1 PCIe3 x16 (16, 8, 4 1)
2 Rear UID LED
3 Slot 2 PCIe3 x 8 (8, 4, 1)
4 Slot 3 PCIe3 x 16 (16, 8, 4, 1) (optional - requires second
processor)
5 Power supply 2 (PS2)
6 Power supply 1 (PS1)
7 Video port
8 NIC ports (1-4)
9 BMC management port
10 Serial port (optional)
11 USB 3.0 ports
Rear panel LEDs
Item Description Status
1 UID LED Solid blue = Identification is activated.
2 BMC/standard NIC
link LED
Solid green = Link exists.
Off = No link exists.
Table Continued
10 Component identification

Item Description Status
3BMC/standard NIC
activity LED
Solid green = Activity exists.
Flashing green = Activity exists.
Off = No activity exists.
4 Power supply 2
LED
Solid green = Normal
Off = One or more of the following
conditions exists:
• AC power unavailable
• Power supply failed
• Power supply in standby mode
• Power supply exceeded current
limit.
5 Power supply 1
LED
Solid green = Normal
Off = One or more of the following
conditions exists:
• AC power unavailable
• Power supply failed
• Power supply in standby mode
• Power supply exceeded current
limit.
Component identification 11

System board components
Item Description
1 Primary (processor 1) PCIe riser connector
2 System maintenance switch
3 Reserved
4 x4 SATA port 1
5 x4 SATA port 2
6 Reserved
7 Reserved
8 Front power/USB 3.0 connector
9 Reserved
10 microSD card slot
11 Dual internal USB 3.0 connector
12 Reserved
13 Secondary (processor 2) PCIe riser connector 1
14 System battery
15 TPM connector
16 Serial port connector
12 Component identification

1 Requires a second processor.
System maintenance switch descriptions
Position Functions:
OFF = Default
ON = Activates this function
1BMC security override
5Password clear
6Restore BIOS default manufacturing settings
IMPORTANT: When the system maintenance switch position 6 is set to the On position, the system
is prepared to restore all configuration settings to their manufacturing defaults. When the system
maintenance switch position 6 is set to the On position and Secure Boot is enabled, some
configurations cannot be restored.
IMPORTANT: BMC security is disabled when the maintenance switch 1 (SW1) is ON. BMC allows
user to log in BMC using an “anonymous user” account. The “anonymous user” account can only be
used through the IPMI tool on server, but cannot be used through the web GUI in remotely.
DIMM slot locations
DIMM slots are numbered sequentially (1 through 12) for each processor. The supported AMP modes use
the letter assignments for population guidelines.
The following figure shows the population guidelines for DIMMs in HPE Gen10 servers with twelve DIMM
slots per CPU. For a given number of DIMMs per CPU, populate those DIMMs in the corresponding
numbered DIMM slot(s) on the corresponding row.
Component identification 13

DIMM label identification
To determine DIMM characteristics, see the label attached to the DIMM. The information in this section
helps you to use the label to locate specific information about the DIMM.
14 Component identification

Item Description Example
1 Capacity 8 GB
16 GB
32 GB
64 GB
128 GB
2 Rank 1R = Single rank
2R = Dual rank
4R = Quad rank
8R = Octal rank
3 Data width on DRAM x4 = 4-bit
x8 = 8-bit
x16 = 16-bit
4 Memory generation PC4 = DDR4
5 Maximum memory speed 2133 MT/s
2400 MT/s
2666 MT/s
Table Continued
Component identification 15

Item Description Example
6 CAS latency P = CAS 15-15-15
T = CAS 17-17-17
U = CAS 20-18-18
V = CAS 19-19-19 (for RDIMM, LRDIMM)
V = CAS 22-19-19 (for 3DS TSV LRDIMM)
7 DIMM type R = RDIMM (registered)
L = LRDIMM (load reduced)
For more information about product features, specifications, options, configurations, and compatibility, see
the product QuickSpecs.
Drive bay numbering
8SFF device bay numbering
In the following graphic, item 1 represents the NVMe drive bays and item 2 represents the SAS/SATA
drive bays.
Item Description
1 NVMe drive bays
2 SAS/SATA drive bays
System BIOS without VMD BIOS/VMD
NVMe SSD0 Driver bay 0 Slot 87
NVMe SSD1 Driver bay 1 Slot 88
10SFF device bay numbering
16 Component identification

System BIOS without VMD BIOS/VMD
NVMe SSD0 Driver bay 0 Slot 102
NVMe SSD1 Driver bay 1 Slot 103
NVMe SSD2 Driver bay 2 Slot 104
NVMe SSD3 Driver bay 3 Slot 105
NVMe SSD4 Driver bay 4 Slot 111
NVMe SSD5 Driver bay 5 Slot 110
NVMe SSD6 Driver bay 6 Slot 106
NVMe SSD7 Driver bay 7 Slot 107
NVMe SSD8 Driver bay 8 Slot 108
NVMe SSD9 Driver bay 9 Slot 109
Hot-plug drive LED definitions
Item LED Status Definition
1 Activity Off Drive is not present
Solid Green Drive Present, no activity
Blinking (4Hz)
Green
Drive Present, activity
2 Locate/Fault/
Rebuilding
Off No Fault/Rebuilding Status or Location queries
Solid Orange Drive Failure
Blinking (4Hz)
Blue
Drive Identified by Location Query
Blinking (1Hz)
Orange
RAID array rebuilding
9300-8i HBA cards only support activity and locate on the drive carriers. Fault and Rebuild status are not
displayed by the LEDs.
When using PCH SW RAID, only the activity LEDs of the drive carrier are supported. Locate, fault, and
rebuild are not supported.
Component identification 17

Hot-plug fans
CAUTION: To avoid damage to server components, fan blanks must be installed in fan bays 1 and
2 in a single-processor configuration.
CAUTION: To avoid damage to the equipment, do not operate the server for extended periods of
time if the server does not have the optimal number of fans installed. Although the server might
boot, Hewlett Packard Enterprise does not recommend operating the server without the required
fans installed and operating.
The valid fan configurations are listed in the following tables.
One-processor configuration
Fan bay 1 Fan bay 2 Fan bay 3 Fan bay 4 Fan bay 5 Fan bay 6 Fan bay 7
Fan blank Fan blank Fan Fan Fan Fan Fan
Two-processor configuration
Fan bay 1 Fan bay 2 Fan bay 3 Fan bay 4 Fan bay 5 Fan bay 6 Fan bay 7
Fan Fan Fan Fan Fan Fan Fan
The loss of a single fan rotor (one standard fan) causes loss of redundancy.
The server supports variable fan speeds. The server shuts down during the following temperature-related
scenarios:
• At POST, BMC performs an orderly shutdown if a cautionary temperature level is detected.
• In the OS, BMC performs an orderly shutdown if a shutdown point is triggered. The actual shutdown
behavior will be impacted by the OS settings.
High-performance fans
High-performance fans are used for 8SFF +2SFF NVMe and 10SFF drive configurations when NVMe
drives are installed in the server.
18 Component identification

High-performance fans are also required for ASHRAE-compliant configurations. For more information on
ASHRAE-compliant configurations, see the Hewlett Packard Enterprise website.
Component identification 19

Operations
Power up the server
To power up the server, use one of the following methods:
• Press the Power On/Standby button.
• Use Power Control function through BMC web interface.
Power down the server
Before powering down the server for any upgrade or maintenance procedures, perform a backup of
critical server data and programs.
IMPORTANT: When the server is in standby mode, auxiliary power is still being provided to the
system.
To power down the server, use one of the following methods:
• Press and release the Power On/Standby button.
This method initiates a controlled shutdown of applications and the OS before the server enters
standby mode.
• Press and hold the Power On/Standby button for more than 4 seconds to force the server to enter
standby mode.
This method forces the server to enter standby mode without properly exiting applications and the OS.
If an application stops responding, you can use this method to force a shutdown.
• Use the Power Control function through the BMC web interface.
This method initiates a controlled remote shutdown of applications and the OS before the server
enters standby mode.
Before proceeding, verify that the server is in standby mode by observing that the system power LED is
amber.
20 Operations