HPE Apollo z70 User manual

HPE Apollo z70 Chassis User Guide
Part Number: P03076-002
Published: September 2018
Edition: 2
Abstract
This document is for the person who installs, administers, and troubleshoots the server and
storage systems. Hewlett Packard Enterprise assumes you are qualified in the servicing of
computer equipment and trained in using safe practices when dealing with hazardous energy
levels.

© Copyright 2018 Hewlett Packard Enterprise Development LP
Notices
The information contained herein is subject to change without notice. The only warranties for Hewlett Packard
Enterprise products and services are set forth in the express warranty statements accompanying such
products and services. Nothing herein should be construed as constituting an additional warranty. Hewlett
Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein.
Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use,
or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software
Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under
vendor's standard commercial license.
Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard
Enterprise has no control over and is not responsible for information outside the Hewlett Packard Enterprise
website.
Acknowledgments
AMI® and MegaRAC® are trademarks of American Megatrend Incorporation.
Arm® is a registered trademark of Arm Limited (or its subsidiaries) in the U.S. and/or elsewhere.
Cavium™ and ThunderX2™ are registered trademarks of Cavium Inc. in the United States and other countries
Linux® is the registered trademark of Linus Torvalds in the U.S. and other countries.
Mellanox® is a trademark of Mellanox Technologies, Ltd.
Red Hat® is a registered trademark of Red Hat, Inc. in the United States and other countries.

Contents
HPE Apollo 70 System................................................................................ 6
Component identification........................................................................... 7
System components............................................................................................................................7
Front panel components......................................................................................................................7
1U system front panel components.......................................................................................... 7
2U system front panel components.......................................................................................... 8
Front panel LEDs and buttons.............................................................................................................8
Chassis UID LED......................................................................................................................9
Remotely toggling the server UID LED on and off......................................................... 9
Rear panel components.................................................................................................................... 10
1U system rear panel components.........................................................................................10
2U system rear panel components......................................................................................... 11
Power supply LED............................................................................................................................. 11
Fans...................................................................................................................................................12
Fan bay numbering.................................................................................................................12
Fan mode behavior.................................................................................................................12
Drive bay numbering......................................................................................................................... 12
1U system drive bay numbering............................................................................................. 12
2U system drive bay numbering............................................................................................. 13
Low profile LFF drive LED definitions................................................................................................13
RCM module ports.............................................................................................................................14
RCM module LEDs............................................................................................................................15
System component health status...................................................................................................... 15
Setup...........................................................................................................16
General site planning.........................................................................................................................16
Optional service.................................................................................................................................16
Product QuickSpecs..........................................................................................................................16
Compiling the documentation............................................................................................................16
Setup overview..................................................................................................................................16
Operational requirements..................................................................................................................17
Site requirements....................................................................................................................17
Space and airflow requirements............................................................................................. 18
Temperature requirements......................................................................................................18
Power requirements................................................................................................................19
Grounding requirements.........................................................................................................19
Device bay thermal requirements........................................................................................... 19
Rack warnings and cautions..............................................................................................................19
Server warnings and cautions........................................................................................................... 20
Electrostatic discharge...................................................................................................................... 21
Remove the shipping bracket............................................................................................................22
Operations..................................................................................................23
Power up the server.......................................................................................................................... 23
Power down the server......................................................................................................................23
3

Remove the chassis from the rack.................................................................................................... 23
Remove the front bezel..................................................................................................................... 25
Remove the LFF hot-plug drive.........................................................................................................25
Remove the RCM module................................................................................................................. 26
Remove the power supply.................................................................................................................26
Remove the server blank...................................................................................................................27
Remove the server............................................................................................................................ 28
Install the server................................................................................................................................ 29
Install the server blank.......................................................................................................................30
Install the chassis into the rack..........................................................................................................31
Install the shipping bracket................................................................................................................32
Hardware options installation.................................................................. 35
Introduction........................................................................................................................................35
Rack rail option..................................................................................................................................35
Rack depth compatibility.........................................................................................................35
Installing the rack rails............................................................................................................ 35
Installing the front bezel and bezel lock options ...............................................................................37
Drive options......................................................................................................................................38
Drive support information........................................................................................................38
Drive installation guidelines.................................................................................................... 38
Installing an LFF hot-plug drive.............................................................................................. 38
RAID configuration..................................................................................................................39
Power supply options........................................................................................................................ 40
Hot-plug power supply calculations........................................................................................ 40
Power supply warnings and cautions..................................................................................... 40
Installing a Flexible Slot power supply....................................................................................40
RCM module option...........................................................................................................................42
RCM module operational requirements.................................................................................. 42
Installing the RCM module......................................................................................................42
Cabling........................................................................................................44
Cabling guidelines............................................................................................................................. 44
Front I/O cabling................................................................................................................................45
Server node power cabling................................................................................................................46
1U server node power cabling................................................................................................46
2U server node power cabling................................................................................................46
Drive power cabling...........................................................................................................................47
Fan cabling........................................................................................................................................47
Fan signal cabling...................................................................................................................47
Fan power cabling.................................................................................................................. 48
PDB pass-through cabling ................................................................................................................48
RCM internal cabling......................................................................................................................... 49
RCM module network cabling............................................................................................................49
Software and configuration utilities.........................................................50
HPE Performance Cluster Manager..................................................................................................50
HPE Message Passing Interface.......................................................................................................50
AMI MegaRAC SP-X GUI..................................................................................................................50
AMI Aptio Setup Utility.......................................................................................................................50
Launching the Embedded UEFI Shell ....................................................................................50
USB support...................................................................................................................................... 51
External USB support............................................................................................................. 51
4

Keeping the system current...............................................................................................................51
Updating firmware using IPMItool ..........................................................................................51
Drivers.................................................................................................................................... 52
Downloading software and firmware updates.........................................................................52
Operating system version support.......................................................................................... 52
HPE Pointnext Portfolio.....................................................................................................................52
Proactive notifications........................................................................................................................52
Specifications............................................................................................ 54
Environmental specifications.............................................................................................................54
Mechanical specifications..................................................................................................................54
Power supply specifications.............................................................................................................. 55
HPE 1600W Flex Slot Platinum Hot-plug Low Halogen Power Supply.................................. 55
Safety, warranty, and regulatory information..........................................56
Regulatory information...................................................................................................................... 56
Local representative information.............................................................................................56
Turkey RoHS material content declaration............................................................................. 57
Ukraine RoHS material content declaration............................................................................57
Warranty information......................................................................................................................... 57
Websites..................................................................................................... 58
Support and other resources................................................................... 59
Accessing Hewlett Packard Enterprise Support................................................................................ 59
Accessing updates............................................................................................................................ 59
Customer self repair.......................................................................................................................... 60
HPE Proactive Care service..............................................................................................................60
Documentation feedback...................................................................................................................60
Acronyms and abbreviations................................................................... 61
5

HPE Apollo 70 System
The HPE Apollo 70 System is an Arm-based platform that delivers the density and scalability required for
large HPC cluster deployments. The system is powered by Cavium 64-bit ARMv8-A ThunderX2 processors
with maximum memory bandwidth and Mellanox interconnect fabric options in a compact 2U form factor.
The HPE Apollo 70 System consists of the:
• HPE Apollo z70 Chassis ─ 2U chassis with an eight-bay LFF drive cage and two-bay Flexible Slot power
supply support.
• HPE Apollo server node options:
◦ HPE AR44z Server ─ 1U server node, maximum of four nodes per chassis.
◦ HPE AR64z Server ─ 2U server node, maximum of two nodes per chassis.
6 HPE Apollo 70 System

Component identification
System components
Item Description
1 2U server node
2 Fan
3 Chassis
4 Server blank
5 1U server node
6 RCM module (optional)
7 Power supply
Front panel components
1U system front panel components
Component identification 7

Item Description
1 Low-profile LFF hot-plug drives
2 Chassis serial number information pull tab
2U system front panel components
Item Description
1 Low-profile LFF hot-plug drives
2 Chassis serial number information pull tab
Front panel LEDs and buttons
Item Description Status Definition
1Power On/Standby button
and system power LED
(Node 1)
Solid green System on and normal operation
Flashing green Performing power-on sequence
Solid amber System in standby
Off No power present1
2Power On/Standby button
and system power LED
(Node 2)
Solid green System on and normal operation
Flashing green Performing power-on sequence
Table Continued
8Component identification

Item Description Status Definition
Solid amber System in standby
Off No power present1
3 to 6 Reserved — —
7Power On/Standby button
and system power LED
(Node 4)
Solid green System on and normal operation
Flashing green Performing power-on sequence
Solid amber System in standby
Off No power present1
8UID button/LED Flashing blue Activated
Off Deactivated
9Power On/Standby button
and system power LED
(Node 3)
Solid green System on and normal operation
Flashing green Performing power-on sequence
Solid amber System in standby
Off No power present1
1 Facility power is not present, power cord is not attached, no power supplies are installed, power supply failure has
occurred, or the front I/O cable is disconnected.
Chassis UID LED
The UID button on the chassis has no function.
The chassis UID LED is used to locate a particular chassis when it is deployed in a dense rack with other
equipment. When the UID LED of any of the servers installed in the chassis is activated, the chassis UID LED
also flashes blue. Activating the UID LED allows an onsite technician to quickly identify a chassis for
maintenance tasks.
Authorized users can remotely toggle the UID LED on and off using the IPMItool. When activated through
IPMItool, the UID LED will continue to flash blue until it is turned off again in IPMItool.
Remotely toggling the server UID LED on and off
Prerequisites
This procedure is done in the IPMItool CLI. If this tool is not yet installed, download the tool from the
Sourceforge website (https://sourceforge.net/projects/ipmitool.)
Component identification 9

Procedure
1. To open a Linux terminal, click Applications > Terminal.
2. Do one of the following:
• To remotely turn on the UID LED, enter the following command:
ipmitool -H <IP> -U admin -P <Password> raw 0x00 0x04 0x00 0x01 turn on UID LED
The UID LEDs on the server and on the chassis flashes blue.
• To remotely turn off the UID LED, enter the following command:
ipmitool -H <IP> -U admin -P <Password> raw 0x00 0x04 0x00 0x01 turn off UID LED
Where:
IP is the server IP address.
Password is the AMI MegaRAC SP-X GUI login password.
3. Close the Linux terminal.
The procedure is complete.
Rear panel components
1U system rear panel components
Item Description
1 Server node 4
2 Server node 3
3 RCM module (optional)
4 Power supply 2
5 Power supply 1
6 Server node 2
7 Server node 1
10 Component identification

2U system rear panel components
Item Description
1 Server node 3
2 RCM module (optional)
3 Power supply 2
4 Power supply 1
5 Server node 1
Power supply LED
Component identification 11

Status Definition
Solid green The power supply is operating normally.
Off One or more of the following conditions exists
• Power is unavailable
• Power supply failure
• Power supply is in standby mode
• Power supply error
Fans
Fan bay numbering
Fan mode behavior
The server supports redundant fan mode. If a fan fails, the following system behavior is exhibited:
• A single fan failure or a missing fan, the system continues to operate.
• A second fan failure or a missing fan in different fan cages, the system continues to operate.
• A second fan failure or a missing fan in the same fan cage, the operating system performs a graceful
shutdown.
Fan failure events are logged in the Sensor Monitoring list of the AMI MegaRAC SP-X GUI Dashboard
page.
Drive bay numbering
1U system drive bay numbering
A single 1U server node supports two low-profile LFF SATA hot-plug drives.
12 Component identification

2U system drive bay numbering
A single 2U server node supports two low-profile LFF SATA hot-plug drives.
Low profile LFF drive LED definitions
Item LED Status Definition
1 Fault
\Locate
Solid amber The drive has failed.
Solid blue The drive is operating normally and being identified by a
management application.
Flashing amber/blue
(1 flash per second)
The drive has failed, or a predictive failure alert has been
received for this drive; it also has been identified by a
management application.
Flashing amber
(1 flash per second)
A predictive failure alert has been received for this drive.
Replace the drive as soon as possible.
2 Online
\Activity
Solid green The drive is online and has no activity.
Flashing green
(4 flashes per second)
The drive is operating normally and has activity.
Table Continued
Component identification 13

Item LED Status Definition
Flashing green
(1 flash per second)
The drive is doing one of the following:
• Rebuilding
• Performing a RAID migration
• Performing a strip size migration
• Performing a capacity expansion
• Performing a logical drive extension
• Erasing
• Spare part activation
Off The drive is not configured by a RAID controller or a spare
drive.
RCM module ports
Item Description
1 IPMI port
2 Reserved
3 IPMI port
14 Component identification

RCM module LEDs
Item LED Status Definition
1 and 4 BMC activity LED Green or flashing green Network active
Off No network connection
2 and 3 BMC link LED Green Network link
Off No network connection
System component health status
The Sensor Monitoring list in the Dashboard page of the AMI MegaRAC SP-X GUI shows the health status
of individual system components. More detailed sensor information is available in the Server Health >
Sensor Readings page.
For more information, see the HPE Apollo 70 System BMC Web UI User Guide on the Hewlett Packard
Enterprise website (http://www.hpe.com/support/apollo70-BMC-UG).
Component identification 15

Setup
General site planning
Before you begin installing the HPE Apollo 70 System, Hewlett Packard Enterprise recommends that you plan
and coordinate the installation process with an authorized HPE representative or partner. Proper planning
provides a more efficient installation process and leads to greater availability, reliability, and serviceability of
the system.
Optional service
Delivered by experienced, certified engineers, Hewlett Packard Enterprise support services help you keep
your servers up and running with support packages tailored specifically for HPE Apollo systems. Hewlett
Packard Enterprise support services let you integrate both hardware and software support into a single
package. A number of service level options are available to meet your business and IT needs.
For more information on supported HPE Pointnext services, see the product QuickSpecs on the Hewlett
Packard Enterprise website (http://www.hpe.com/info/qs).
Product QuickSpecs
For more information about product features, specifications, options, configurations, and compatibility, see the
product QuickSpecs on the Hewlett Packard Enterprise website (http://www.hpe.com/info/qs).
Compiling the documentation
The documentation, while delivered individually and in various formats, works as a system. Consult these
documents before attempting installation. These documents provide the required important safety information
and decision-making steps for the configuration. To access these documents, see the Hewlett Packard
Enterprise website (http://www.hpe.com/info/apollo70-docs).
Setup overview
Prerequisites
Before installing the chassis, be sure to read the following:
•Operational requirements on page 17
• Safety and compliance information on the HPE website:
http://www.hpe.com/support/safety-compliance-enterpriseproducts
•Rack warnings and cautions
•Server warnings and cautions
Procedure
1. Unbox the chassis and verify the contents:
• Chassis
• Power cord
16 Setup

• Rack rail kit
• Documentation
2. Remove the external chassis components.
A fully populated chassis is heavy. Hewlett Packard Enterprise recommends removing the external chassis
components before installing the chassis into the rack.
a. If installed, remove the front bezel.
b. Remove the LFF hot-plug drives.
c. If installed, remove the RCM module.
d. Remove the power supplies.
e. If installed, remove the server blanks.
f. Remove the server nodes.
3. Install the rack rails.
4. (Optional) Install the server hardware options.
For installation instructions, see the server user guide on Hewlett Packard Enterprise website (http://
www.hpe.com/info/apollo70-docs).
5. Install the chassis into the rack on page 31.
6. Install the external chassis components:
a. Install the server nodes.
b. If removed, install the server blanks.
c. Install the power supplies.
d. If removed, install the RCM module.
e. Install the LFF hot-plug drives.
f. If removed, install the front bezel.
7. Configure the servers.
For more information, see the server user guide on Hewlett Packard Enterprise (http://www.hpe.com/
info/apollo70-docs).
8. Register the system (https://myenterpriselicense.hpe.com).
Operational requirements
Site requirements
The server must be located in a computer room or server room. The room must:
• Be only accessible to authorized technicians trained the room restriction reasons and precautions.
• Be within an area that is ideally locked or at minimum not accessible to unauthorized personnel.
Setup 17

Space and airflow requirements
To allow for servicing and adequate airflow, observe the following space and airflow requirements when
deciding where to install a rack:
• Leave a minimum clearance of 63.5 cm (25 in) in front of the rack.
• Leave a minimum clearance of 76.2 cm (30 in) behind the rack.
• Leave a minimum clearance of 121.9 cm (48 in) from the back of the rack to the back of another rack or
row of racks.
Hewlett Packard Enterprise servers draw in cool air through the front door and expel warm air through the
rear door. Therefore, the front and rear rack doors must be adequately ventilated to allow ambient room air to
enter the cabinet, and the rear door must be adequately ventilated to allow the warm air to escape from the
cabinet.
CAUTION: To prevent improper cooling and damage to the equipment, do not block the ventilation
openings.
When vertical space in the rack is not filled by a server or rack component, the gaps between the components
cause changes in airflow through the rack and across the servers. Cover all gaps with blanking panels to
maintain proper airflow.
CAUTION: Always use blanking panels to fill empty vertical spaces in the rack. This arrangement
ensures proper airflow. Using a rack without blanking panels results in improper cooling that can lead to
thermal damage.
CAUTION: If a third-party rack is used, observe the following additional requirements to ensure
adequate airflow and to prevent damage to the equipment:
• Front and rear doors—If the 42U rack includes closing front and rear doors, you must allow 5,350 sq
cm (830 sq in) of holes evenly distributed from top to bottom to permit adequate airflow (equivalent to
the required 64 percent open area for ventilation).
• Side—The clearance between the installed rack component and the side panels of the rack must be
a minimum of 7 cm (2.75 in).
Temperature requirements
To ensure continued safe and reliable equipment operation, install or position the system in a well-ventilated,
climate-controlled environment.
The maximum recommended ambient operating temperature (TMRA) for most server products is 35°C
(95°F). The temperature in the room where the rack is located must not exceed 35°C (95°F).
CAUTION: To reduce the risk of damage to the equipment when installing third-party options:
• Do not permit optional equipment to impede airflow around the server or to increase the internal rack
temperature beyond the maximum allowable limits.
• Do not exceed the manufacturer’s TMRA.
18 Setup

Power requirements
Installation of this equipment must comply with local and regional electrical regulations governing the
installation of IT equipment by licensed electricians. This equipment is designed to operate in installations
covered by NFPA 70, 1999 Edition (National Electric Code) and NFPA-75, 1992 (code for Protection of
Electronic Computer/Data Processing Equipment). For electrical power ratings on options, refer to the product
rating label or the user documentation supplied with that option.
WARNING: To reduce the risk of personal injury, fire, or damage to the equipment, do not overload the
AC supply branch circuit that provides power to the rack. Consult the electrical authority having
jurisdiction over wiring and installation requirements of your facility.
CAUTION: Protect the server from power fluctuations and temporary interruptions with a regulating
UPS. This device protects the hardware from damage caused by power surges and voltage spikes and
keeps the server in operation during a power failure.
Grounding requirements
• The building installation must provide a means of connection to protective earth.
• The equipment must be connected to that means of connection.
• A service person must check whether the socket-outlet from which the equipment is to be powered
provides a connection to the building protective earth. If the outlet does not provide a connection, the
service person must arrange for the installation of a protective earthing conductor from the separate
protective earthing terminal to the protective earth wire in the building.
Device bay thermal requirements
Operate the chassis only when a device or blank is installed in all device bays. Before powering up the
chassis, be sure to do the following:
• Install a drive or drive blank into all drive bays.
• Install a server or a blank into all server bays.
• Install a power supply or power supply blank into all power supply bays.
Rack warnings and cautions
WARNING: When all components are removed, the system weighs 17.21 kg (37.94 lb). When all
components are installed, the system can weigh up to 22.65 kg (49.93 lb).
Before configuring your rack solution, be sure to check the rack manufacturer weight limits and
specifications. Failure to do so can result in physical injury or damage to the equipment and the facility.
Setup 19

WARNING: To reduce the risk of personal injury or damage to the equipment, be sure that:
• The rack has anti-tip measures in place. Such measures include floor-bolting, anti-tip feet, ballast, or
a combination as specified by the rack manufacturer and applicable codes.
• The leveling jacks (feet) are extended to the floor.
• The full weight of the rack rests on the leveling jacks (feet).
• The stabilizing feet are attached to the rack if it is a single-rack installation.
• The racks are coupled together in multiple rack installations.
WARNING: The chassis is heavy. To reduce the risk of personal injury or damage to the equipment, do
the following:
• Observe local occupational health and safety requirements and guidelines for manual material
handling.
• Get help to lift and stabilize the product during installation or removal, especially when the product is
not fastened to the rails. The chassis weighs more than 17.21 kg (37.94 lb), so at least two people
must lift the chassis into the rack together. An additional person may be required to help align the
chassis if the chassis is installed higher than chest level.
• Use caution when installing the chassis into or removing the chassis from the rack.
• Adequately stabilized the chassis before extending a component outside the rack. Extend only one
component at a time. The rack might become unstable if more than one component is extended.
• Do not stack anything on top of rail-mounted component or use it as a work surface when extended
from the rack.
WARNING: The rack rails form only a shelf for the chassis to rest on. The chassis is not attached to the
rails by any other means. Slipping and falling chassis will cause bodily injury or damage the chassis, so
use extreme care when pulling the chassis out from the rack. Hewlett Packard Enterprise is not
responsible for any injury or damage caused by the mishandling of the chassis.
CAUTION: Before installing the system into a rack, be sure to properly scope the limitations of the rack.
Before proceeding with the installation, consider the following:
• You must fully understand the static and dynamic load carrying capacity of the rack and be sure that
it can accommodate the maximum weight of the system.
• Be sure sufficient clearance exists for cabling, installation and removal of the system, and movement
of the rack doors.
CAUTION: Always plan the rack installation so that the heaviest item is on the bottom of the rack. Install
the heaviest item first, and continue to populate the rack from the bottom to the top.
Server warnings and cautions
WARNING: To reduce the risk of personal injury, electric shock, or damage to the equipment,
disconnect the power cord to remove power from the server. Pressing the Power On/Standby button
does not shut off system power completely. Portions of the power supply and some internal circuitry
remain active until AC power is removed.
20 Setup