HPE AR44z User manual

HPE AR44z Server User Guide
Part Number: P03078-003
Published: July 2019
Edition: 3
Abstract
This document is for the person who installs, administers, and troubleshoots server and
storage systems. Hewlett Packard Enterprise assumes you are qualified in the servicing of
computer equipment and trained in recognizing hazards in products with hazardous energy
levels.

© Copyright 2018–2019 Hewlett Packard Enterprise Development LP
Notices
The information contained herein is subject to change without notice. The only warranties for Hewlett
Packard Enterprise products and services are set forth in the express warranty statements accompanying
such products and services. Nothing herein should be construed as constituting an additional warranty.
Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained
herein.
Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession,
use, or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer
Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government
under vendor's standard commercial license.
Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard
Enterprise has no control over and is not responsible for information outside the Hewlett Packard
Enterprise website.
Acknowledgments
AMI® and MegaRAC® are trademarks of American Megatrend Incorporation.
Arm® is a registered trademark of Arm Limited (or its subsidiaries) in the U.S. and/or elsewhere.
Linux® is the registered trademark of Linus Torvalds in the U.S. and other countries.
Marvell® and ThunderX2® are registered trademarks of Marvell and/or its affiliates.
Mellanox® is a trademark of Mellanox Technologies, Ltd.
Red Hat® Enterprise Linux® are registered trademarks of Red Hat, Inc. in the United States and other
countries.

Contents
HPE Apollo 70 System............................................................................6
Component identification.......................................................................7
Rear panel components................................................................................................................7
Server information pull tab................................................................................................. 7
Rear panel LEDs and button.........................................................................................................8
Server UID LED..................................................................................................................8
System board components........................................................................................................... 9
System maintenance switch descriptions........................................................................ 10
DIMM slot locations.......................................................................................................... 11
DIMM label identification.................................................................................................. 11
System component health status................................................................................................13
Operations............................................................................................. 14
Power up the server....................................................................................................................14
Power down the server............................................................................................................... 14
Remove the server......................................................................................................................14
Install the server..........................................................................................................................15
BMC configuration...................................................................................................................... 16
Accessing the system health log.................................................................................................16
Setup...................................................................................................... 18
General site planning.................................................................................................................. 18
HPE Installation Service............................................................................................................. 18
Product QuickSpecs................................................................................................................... 18
Compiling the documentation..................................................................................................... 18
Setting up the system................................................................................................................. 18
Operational requirements........................................................................................................... 20
Site requirements............................................................................................................. 20
Space and airflow requirements.......................................................................................20
Temperature requirements............................................................................................... 21
Power requirements......................................................................................................... 21
Grounding requirements.................................................................................................. 21
Device bay thermal requirements.................................................................................... 21
Rack warnings and cautions....................................................................................................... 22
Server warnings and cautions.....................................................................................................23
Electrostatic discharge................................................................................................................23
Locating the IP address.............................................................................................................. 24
OS deployment options...............................................................................................................24
Deploying an OS from an installation media.................................................................... 24
Linux OS documentation and download resource........................................................... 25
Hardware options installation..............................................................26
Introduction................................................................................................................................. 26
SUV cable option........................................................................................................................ 26
3

Using an SUV cable for a KVM setup.............................................................................. 26
Using an SUV cable to access USB drives in a KVM setup............................................ 27
Memory options...........................................................................................................................27
DIMM population information........................................................................................... 27
Installing a DIMM..............................................................................................................27
M.2 SATA SSD option................................................................................................................. 30
Installing an M.2 SATA SSD.............................................................................................31
RAID configuration........................................................................................................... 31
OCP network adapter option.......................................................................................................32
Installing the OCP network adapter................................................................................. 32
Transceiver option.......................................................................................................................34
Transceiver warnings and cautions..................................................................................34
Installing a transceiver..................................................................................................... 35
Software and configuration utilities.................................................... 37
HPE Performance Cluster Manager........................................................................................... 37
HPE Message Passing Interface................................................................................................ 37
AMI MegaRAC SP-X GUI........................................................................................................... 37
AMI Aptio Setup Utility................................................................................................................ 37
Launching the Embedded UEFI Shell ............................................................................. 37
USB support................................................................................................................................38
External USB support.......................................................................................................38
Keeping the system current........................................................................................................ 38
Updating firmware using IPMItool ................................................................................... 38
Drivers..............................................................................................................................39
Downloading software and firmware updates.................................................................. 39
Operating system version support................................................................................... 39
HPE Pointnext Portfolio.............................................................................................................. 39
Proactive notifications................................................................................................................. 39
System battery replacement................................................................ 41
System battery information......................................................................................................... 41
Removing and replacing the system battery...............................................................................41
Safety, warranty, and regulatory information..................................... 43
Regulatory information................................................................................................................43
Notices for Eurasian Economic Union..............................................................................43
Turkey RoHS material content declaration.......................................................................44
Ukraine RoHS material content declaration..................................................................... 44
Warranty information...................................................................................................................44
Specifications........................................................................................45
Environmental specifications...................................................................................................... 45
Limited system operating temperature requirements.......................................................45
Mechanical specifications........................................................................................................... 46
Websites................................................................................................ 47
Support and other resources...............................................................48
Accessing Hewlett Packard Enterprise Support......................................................................... 48
4

Accessing updates......................................................................................................................48
Customer self repair....................................................................................................................49
HPE Proactive Care service........................................................................................................49
Documentation feedback............................................................................................................ 49
Acronyms and abbreviations...............................................................50
5

HPE Apollo 70 System
The HPE Apollo 70 System is an Arm-based platform that delivers the density and scalability required for
large HPC cluster deployments. The system is powered by Marvell 64-bit Arm v8-A ThunderX2
processors with maximum DDR4 memory bandwidth and Mellanox interconnect fabric options in a
compact 2U form factor.
The HPE Apollo 70 System consists of the:
• HPE Apollo z70 Chassis ─ 2U chassis with an eight-bay LFF drive cage, eight single-rotor fans, and
two HPE Flexible Slot Power Supply bays.
• HPE Apollo server nodes:
◦ HPE AR44z Server ─ 1U server node, maximum of four nodes per chassis
◦ HPE AR64z Server ─ 2U server node, maximum of two nodes per chassis
6 HPE Apollo 70 System

Component identification
Rear panel components
Item Description
1 SFP+ port 11
2 SFP+ port 21
3 QSFP port (optional)
4 USB 3.0 port
5 Dedicated management NIC port
6 SUV port
7Server information pull tab on page 7
1 These ports support both SFP and SFP+ DAC and AOC connections, as well as SFP and SFP+ transceiver module
installation.
Server information pull tab
A double-sided server information pull tab is located in the port side of the server node. The following
server labels are attached to this pull tab:
• Top side ─ Factory default BMC user name and password label and the QR code label that also
shows the MAC addresses for the LOM and BMC.
• Reverse side ─ Server serial number and product ID labels
Use a mobile device to scan the QR code label to display the server mobile product page (http://
www.hpe.com/qref/ar44z). This page contains links to the server setup information, spare part numbers,
QuickSpecs, and other useful product links.
Component identification 7

Rear panel LEDs and button
Item Description Status Definition
1 and 5 NIC link LED Solid green Network link
Off No network link
2 and 4 NIC status LED Flashing green Network active
Off No network activity
3 Power On/Standby button
and system power LED
Solid green System on and normal
operation
Flashing green Performing power-on
sequence
Solid amber System in standby
Off No power present1
6 Reserved — —
7UID LED Flashing blue Activated
Off Deactivated
1 Facility power is not present, power cord is not attached, no power supplies are installed, power supply failure has
occurred, or the front I/O cable is disconnected.
Server UID LED
The UID LED is used to locate a particular server when it is deployed in a dense rack with many other
servers. Activating the UID LED allows an onsite technician to quickly identify a server for maintenance
tasks.
8Component identification

Authorized users can remotely toggle the UID LED on and off using the IPMI tool. When activated
through IPMItool, the UID LED will continue to flash blue until it is turned off again in IPMItool.
Remotely toggling the server UID LED on and off
Prerequisites
This procedure is done in the IPMItool CLI. If this tool is not yet installed, download the tool from the
Sourceforge website (https://sourceforge.net/projects/ipmitool.)
Procedure
1. To open a Linux terminal, click Applications > Terminal.
2. Do one of the following:
• To remotely turn on the UID LED, enter the following command:
ipmitool -H <IP> -U admin -P <Password> raw 0x00 0x04 0x00 0x01 turn on UID LED
The UID LEDs on the server and on the chassis flashes blue.
• To remotely turn off the UID LED, enter the following command:
ipmitool -H <IP> -U admin -P <Password> raw 0x00 0x04 0x00 0x01 turn off UID LED
Where:
IP is the server IP address.
Password is the AMI MegaRAC SP-X GUI login password.
3. Close the Linux terminal.
The procedure is complete.
System board components
Item Description
1 Bayonet board connector
2 M.2 slot for processor 2(A)
Table Continued
Component identification 9

Item Description
3 Processor 2(A)
4 DIMM slots for processor 2(A)
5 Processor 1(B)
6 DIMM slots for processor 1(B)
7 OCP network adapter connectors
8 SFP+ riser connector
9 M.2 slot for processor 1(B)
10 System maintenance switch
11 System battery
System maintenance switch descriptions
Position Default Function
S1 Off Off = Processor UART output is enabled.
On = BMC UART output is enabled.
S2 Off Off = Processor UART output is from the SUV port.
On = Processor UART output is from the BMC (for SOL).
S4 Off Off = Connection from the dedicated management NIC port to the BMC is
enabled.
On = Connection from the IPMI ports on the RCM module to the BMC is
enabled.
S3, S5 to
S12
— Reserved
10 Component identification

DIMM slot locations
The arrow in the image points to the direction of the front chassis.
DIMM label identification
To determine DIMM characteristics, see the label attached to the DIMM. The information in this section
helps you to use the label to locate specific information about the DIMM.
Component identification 11

Item Description Example
1 Capacity 8 GB
16 GB
32 GB
64 GB
128 GB
2 Rank 1R = Single rank
2R = Dual rank
4R = Quad rank
8R = Octal rank
3 Data width on DRAM x4 = 4-bit
x8 = 8-bit
x16 = 16-bit
4 Memory generation PC4 = DDR4
5 Maximum memory speed 2133 MT/s
2400 MT/s
2666 MT/s
2933 MT/s
6 CAS latency P = CAS 15-15-15
T = CAS 17-17-17
U = CAS 20-18-18
V = CAS 19-19-19 (for RDIMM, LRDIMM)
V = CAS 22-19-19 (for 3DS TSV LRDIMM)
Y = CAS 21-21-21 (for RDIMM, LRDIMM)
Y = CAS 24-21-21 (for 3DS TSV LRDIMM)
7 DIMM type R = RDIMM (registered)
L = LRDIMM (load reduced)
E = Unbuffered ECC (UDIMM)
12 Component identification

For more information about product features, specifications, options, configurations, and compatibility, see
the HPE DDR4 SmartMemory QuickSpecs on the Hewlett Packard Enterprise website (http://
www.hpe.com/support/DDR4SmartMemoryQS).
System component health status
The Sensor Monitoring list in the Dashboard page of the AMI MegaRAC SP-X GUI shows the health
status of individual system components. More detailed sensor information is available in the Server
Health > Sensor Readings page.
For more information, see the HPE Apollo 70 System BMC Web UI User Guide on the Hewlett Packard
Enterprise website (http://www.hpe.com/support/apollo70-BMC-UG).
Component identification 13

Operations
Power up the server
The chassis firmware initiates an automatic power-up sequence when the servers are installed. If the
default setting is changed, use one of the following methods to power up each server:
Procedure
• Select a power up action in the AMI MegaRAC SP-X GUI.
• Press and release the Power On/Standby button.
When the server goes from standby mode to full power mode, the power LED changes from amber to
green.
Power down the server
IMPORTANT: When the server is in standby mode, auxiliary power is still being provided to the
system.
Prerequisites
Before powering down the server for any upgrade or maintenance procedures, perform a backup of
critical server data and programs.
Procedure
• Press and release the Power On/Standby button.
This method initiates a controlled shutdown of applications and the OS before the server enters
standby mode.
• Press and hold the Power On/Standby button for more than 4 seconds to force the server to enter
standby mode.
This method forces the server to enter standby mode without properly exiting applications and the OS.
If an application stops responding, you can use this method to force a shutdown.
• Select a power down action in the AMI MegaRAC SP-X GUI.
This method initiates a controlled remote shutdown of applications and the OS before the server
enters standby mode.
Before proceeding, verify that the server is in standby mode by observing that the power LED is amber.
Remove the server
CAUTION: To prevent improper cooling and thermal damage, do not operate the chassis unless all
bays are populated with a component or a blank.
CAUTION: To avoid damage to the server or server blank:
• Always support the bottom of the server or server blank when removing it from the chassis.
• Do not use the release lever to carry the server or server blank.
14 Operations

Procedure
1. Back up all server data.
2. Power down the server on page 14.
3. Disconnect all peripheral cables from the server.
4. Remove the server:
a. Loosen the release lever thumbscrew.
b. Open the release lever.
c. Use the release lever to pull the server out of the chassis.
Install the server
Procedure
1. Slide the server into the chassis.
2. Close the release lever.
3. Tighten the release lever thumbscrew.
Operations 15

BMC configuration
The BMC is the remote server management processor embedded on the server. The AMI MegaRAC SP-
X GUI is the software component of the system remove server management solution. Use the browser-
based MegaRAC SP-X GUI to remotely monitor and configure the server.
For first-time login to the AMI MegaRAC SP-X GUI, you need the:
•BMC IP address
•Factory default user name and password on the server serial number information pull tab
For more information on using the AMI MegaRAC SP-X GUI, see the HPE Apollo 70 System BMC Web
UI User Guide on the Hewlett Packard Enterprise website (http://www.hpe.com/support/apollo70-
BMC-UG).
Accessing the system health log
The event log lists the events generated by the system sensors. The event entries have a time stamp of
when the event log was generated.
Procedure
1. In a remote browser, enter the BMC IP address, and then press Enter.
2. In the AMI MegaRAC SP-X GUI login page, enter the BMC user name and password, and then click
Login.
3. Click Server Health > Event Log.
4. Do one of the following:
• To view an event, click the event ID, and then press Enter.
• To customize the event log display, select an option from the event log category and sensor
drop‑down menus.
16 Operations

• To download an event log as an Excel sheet, click Save Event Logs.
• To delete all events from the log, click Clear All Event Logs.
Operations 17

Setup
General site planning
Before you begin installing the HPE Apollo 70 System, Hewlett Packard Enterprise recommends that you
plan and coordinate the installation process with an authorized HPE representative or partner. Proper
planning provides a more efficient installation process and leads to greater availability, reliability, and
serviceability of the system.
HPE Installation Service
HPE Installation Service provides basic installation of Hewlett Packard Enterprise branded equipment,
software products, as well as HPE-supported products from other vendors that are sold by HPE or by
HPE authorized resellers. The Installation Service is part of a suite of HPE deployment services that are
designed to give users the peace of mind that comes from knowing that their HPE and HPE-supported
products have been installed by an HPE specialist.
The HPE Installation Service provides the following benefits:
• Installation by an HPE authorized technical specialist.
• Verification prior to installation that all service prerequisites are met.
• Delivery of the service at a mutually scheduled time convenient to your organization.
• Allows your IT resources to stay focused on their core tasks and priorities.
• Full coverage during the warranty period for products that require installation by an HPE authorized
technical specialist.
For more information on the features, limitations, provisions, and ordering information of the HPE
Installation Service, see this Hewlett Packard Enterprise website:
http://www.hpe.com/support/installation-service
Product QuickSpecs
For more information about product features, specifications, options, configurations, and compatibility, see
the product QuickSpecs on the Hewlett Packard Enterprise website (http://www.hpe.com/info/qs).
Compiling the documentation
The documentation, while delivered individually and in various formats, works as a system. Consult these
documents before attempting installation. These documents provide the required important safety
information and decision-making steps for the configuration. To access these documents, see the Hewlett
Packard Enterprise website (http://www.hpe.com/info/apollo70-docs).
Setting up the system
Prerequisites
Before installing the server node in the chassis, be sure to do the following:
• Note the factory default BMC user name and password on the server information pull tab.
• Read the following:
◦Operational requirements on page 20
◦ Safety and compliance information on the HPE website:
18 Setup

http://www.hpe.com/support/safety-compliance-enterpriseproducts
◦Rack warnings and cautions on page 22
◦Server warnings and cautions on page 23
Procedure
1. Unbox the server node and verify the contents:
• Server node
• Documentation
2. (Optional) Install the server hardware options. For installation instructions, see Hardware options
installation on page 26.
3. Install the server into the chassis.
4. Connect all peripheral cables to the servers and chassis.
5. Connect each power cord to the chassis.
6. Connect each power cord to the power source.
7. Decide how to manage the server:
• To manage the server locally, use an SUV cable for a KVM setup.
• To manage the server remotely, you will need a remote browser to connect to the AMI MegaRAC
SP-X GUI.
a. Verify that a network cable is connected to the dedicated management NIC port.
b. Locate the BMC IP address:
◦ If a DHCP server assigns the IP address, locate the IP address.
◦ If a static IP address is assigned, use that IP address.
c. In a remote browser, type the IP address, and then press Enter.
d. In the AMI MegaRAC SP-X GUI login page, enter the factory default BMC user name and
password, and then click Login.
e. In the Dashboard menu, click Launch.
The remote management Java console window appears.
8. Do one of the following:
• If you are managing the server locally, press the Power On/Standby button.
• If you are managing the server remotely, in the AMI MegaRAC SP-X GUI:
a. Select Remote Control > Server Power Control.
b. Select a power on action.
c. Click Perform Action.
9. Deploy an OS or virtualization software.
Setup 19

10. As a best practice, Hewlett Packard Enterprise recommends that you install the latest
firmware, drivers, and system software before using the server for the first time.
To get the latest firmware and software updates, see the server support page:
https://www.hpe.com/support/ar44z
11. Register the system (https://myenterpriselicense.hpe.com).
Operational requirements
Site requirements
The server must be located in a computer room or server room. The room must:
• Be only accessible to authorized technicians trained the room restriction reasons and precautions.
• Be within an area that is ideally locked or at minimum not accessible to unauthorized personnel.
Space and airflow requirements
To allow for servicing and adequate airflow, observe the following space and airflow requirements when
deciding where to install a rack:
• Leave a minimum clearance of 63.5 cm (25 in) in front of the rack.
• Leave a minimum clearance of 76.2 cm (30 in) behind the rack.
• Leave a minimum clearance of 121.9 cm (48 in) from the back of the rack to the back of another rack
or row of racks.
Hewlett Packard Enterprise servers draw in cool air through the front door and expel warm air through the
rear door. Therefore, the front and rear rack doors must be adequately ventilated to allow ambient room
air to enter the cabinet, and the rear door must be adequately ventilated to allow the warm air to escape
from the cabinet.
CAUTION: To prevent improper cooling and damage to the equipment, do not block the ventilation
openings.
When vertical space in the rack is not filled by a server or rack component, the gaps between the
components cause changes in airflow through the rack and across the servers. Cover all gaps with
blanking panels to maintain proper airflow.
CAUTION: Always use blanking panels to fill empty vertical spaces in the rack. This arrangement
ensures proper airflow. Using a rack without blanking panels results in improper cooling that can
lead to thermal damage.
CAUTION: If a third-party rack is used, observe the following additional requirements to ensure
adequate airflow and to prevent damage to the equipment:
• Front and rear doors—If the 42U rack includes closing front and rear doors, you must allow
5,350 sq cm (830 sq in) of holes evenly distributed from top to bottom to permit adequate airflow
(equivalent to the required 64 percent open area for ventilation).
• Side—The clearance between the installed rack component and the side panels of the rack must
be a minimum of 7 cm (2.75 in).
20 Setup