Huawei G5500 User manual

FusionServer G5500 Server
1.0.0
User Guide
Issue 02
Date 2017-12-15
HUAWEI TECHNOLOGIES CO., LTD.

Copyright © Huawei Technologies Co., Ltd. 2017. All rights reserved.
No part of this document may be reproduced or transmitted in any form or by any means without prior written
consent of Huawei Technologies Co., Ltd.
Trademarks and Permissions
and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective
holders.
Notice
The purchased products, services and features are stipulated by the contract made between Huawei and the
customer. All or part of the products, services and features described in this document may not be within the
purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information,
and recommendations in this document are provided "AS IS" without warranties, guarantees or
representations of any kind, either express or implied.
The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.
Huawei Technologies Co., Ltd.
Address: Huawei Industrial Base
Bantian, Longgang
Shenzhen 518129
People's Republic of China
Website: http://e.huawei.com
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
i

About This Document
Purpose
This document describes the full-width general-purpose compute module G560 and half-
width general-purpose compute module G530 V2 as well as the full-width heterogeneous
compute module GP608 and half-width heterogeneous compute module GP316 of the G5500
in terms of components, common operations, basic configurations, optional component
installation, troubleshooting, software and configuration utilities, static electricity discharge,
and product specifications.
Intended Audience
This document is intended for:
lTechnical support engineers
lMaintenance engineers
Symbol Conventions
The following table lists the symbols that may be found in this document.
Symbol Description
Indicates an imminently hazardous situation which, if not
avoided, will result in death or serious injury.
Indicates a potentially hazardous situation which, if not
avoided, could result in death or serious injury.
Indicates a potentially hazardous situation which, if not
avoided, may result in minor or moderate injury.
FusionServer G5500 Server
User Guide About This Document
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
ii

Symbol Description
Indicates a potentially hazardous situation which, if not
avoided, could result in equipment damage, data loss,
performance deterioration, or unanticipated results.
NOTICE is used to address practices not related to
personal injury.
Calls attention to important information, best practices
and tips.
NOTE is used to address information not related to
personal injury, equipment damage, and environment
deterioration.
Change History
Changes between document issues are cumulative. The latest document issue contains all the
changes made in earlier issues.
Issue 02 (2017-12-15)
This issue is the second official release.
Mode Change Description
New Added information about G530 V2 and GP316. For details, see 4.4.4
Installing a G530 V2 and 4.4.3 Installing a GP316.
Issue 01 (2017-11-01)
The issue is the first official release.
FusionServer G5500 Server
User Guide About This Document
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
iii

Contents
About This Document.....................................................................................................................ii
1 Overview......................................................................................................................................... 1
2 Components....................................................................................................................................3
2.1 Physical Structure........................................................................................................................................................... 4
2.2 Front Panel Components................................................................................................................................................ 8
2.3 Front Panel Indicators and Buttons...............................................................................................................................11
2.4 Rear Panel Components................................................................................................................................................13
2.5 Rear Panel Indicators and Ports....................................................................................................................................14
2.6 Hard Disk Slot Numbers...............................................................................................................................................17
2.7 Mainboard Components............................................................................................................................................... 18
2.7.1 PCIe Slots.................................................................................................................................................................. 22
2.7.2 DIMM Slots...............................................................................................................................................................29
3 Basic Operations.......................................................................................................................... 32
3.1 Powering Off the Compute Node................................................................................................................................. 33
3.2 Powering On the Compute Node..................................................................................................................................34
3.3 Removing the G560......................................................................................................................................................36
3.4 Removing the GP608....................................................................................................................................................37
3.5 Removing a G530 V2................................................................................................................................................... 39
3.6 Removing a GP316.......................................................................................................................................................41
3.7 Cover............................................................................................................................................................................ 42
4 Setup.............................................................................................................................................. 49
4.1 Installation Environment Requirements....................................................................................................................... 50
4.2 Installing the Chassis.................................................................................................................................................... 50
4.3 Installing Components..................................................................................................................................................54
4.3.1 Installing GP608 Components...................................................................................................................................54
4.3.2 Installing G560 Components..................................................................................................................................... 54
4.3.3 Installing GP316 Components...................................................................................................................................54
4.3.4 Installing G530 V2 Components............................................................................................................................... 55
4.4 Installing the Node........................................................................................................................................................55
4.4.1 Installing the GP608.................................................................................................................................................. 55
4.4.2 Installing the G560.................................................................................................................................................... 57
4.4.3 Installing a GP316..................................................................................................................................................... 60
FusionServer G5500 Server
User Guide Contents
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
iv

4.4.4 Installing a G530 V2..................................................................................................................................................63
4.5 Installing an I/O Module...............................................................................................................................................65
4.6 Internal Cabling............................................................................................................................................................ 65
4.6.1 SAS Cable..................................................................................................................................................................65
4.6.2 8-Pin Power Cable..................................................................................................................................................... 66
5 Configuring the G5500............................................................................................................... 67
5.1 Configuration Overview............................................................................................................................................... 68
5.2 Default Data..................................................................................................................................................................68
5.3 Configuring the Management Module......................................................................................................................... 71
5.3.1 Logging In to the Management Module CLI.............................................................................................................71
5.3.1.1 Logging In to the Management Module over a Serial Port Using PuTTY.............................................................71
5.3.1.2 Logging In to the Management Module CLI Through the Management Network Port........................................ 73
5.3.1.3 Logging In to the Management Module CLI Through the Management IP Address of the Server Node............. 76
5.3.2 Checking the Management Module Health Status.................................................................................................... 79
5.3.3 Changing the Initial Management Module User Password....................................................................................... 79
5.3.4 Recovering the Default Management Module Configuration................................................................................... 80
5.3.5 Configuring Basic Management Module Data..........................................................................................................81
5.4 Configuring the G560...................................................................................................................................................82
5.4.1 Logging In to the iBMC WebUI................................................................................................................................84
5.4.2 Configuring the iBMC...............................................................................................................................................88
5.4.3 Logging In to the Remote Virtual Console................................................................................................................91
5.4.4 Logging In to the iBMC CLI.....................................................................................................................................92
5.4.5 Configuring RAID.....................................................................................................................................................93
5.4.6 Configuring the BIOS................................................................................................................................................94
5.4.7 Installing an OS....................................................................................................................................................... 100
5.5 Configuring the G530 V2........................................................................................................................................... 100
5.5.1 Logging In to the iBMC WebUI..............................................................................................................................102
5.5.2 Configuring the iBMC.............................................................................................................................................106
5.5.3 Logging In to the Remote Virtual Console..............................................................................................................109
5.5.4 Logging In to the iBMC CLI................................................................................................................................... 111
5.5.5 Configuring RAID................................................................................................................................................... 112
5.5.6 Configuring the BIOS..............................................................................................................................................112
5.5.7 Installing an OS....................................................................................................................................................... 120
5.6 Configuring the PCIe Topologies............................................................................................................................... 120
6 Optional Part Installation........................................................................................................ 121
6.1 Precautions..................................................................................................................................................................122
6.2 G560 Optional Part Installation..................................................................................................................................122
6.2.1 Hard Disk.................................................................................................................................................................122
6.2.2 CPU......................................................................................................................................................................... 124
6.2.3 DIMM......................................................................................................................................................................124
6.2.3.1 DIMM and CPU Compatibility............................................................................................................................ 124
6.2.3.2 Memory Subsystem Architecture......................................................................................................................... 125
FusionServer G5500 Server
User Guide Contents
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
v

6.2.3.3 DIMM Ranks........................................................................................................................................................126
6.2.3.4 DIMM Identification............................................................................................................................................ 127
6.2.3.5 Memory Configuration......................................................................................................................................... 128
6.2.3.6 DIMM Installation Rules......................................................................................................................................129
6.2.3.7 DIMM...................................................................................................................................................................129
6.2.3.8 Air Duct................................................................................................................................................................ 130
6.2.4 RAID Controller Card............................................................................................................................................. 131
6.2.5 Supercapacitor......................................................................................................................................................... 133
6.2.6 BIOS Battery........................................................................................................................................................... 134
6.2.7 TPM......................................................................................................................................................................... 135
6.2.7.1 TPM...................................................................................................................................................................... 135
6.2.7.2 Enabling the TPM.................................................................................................................................................137
6.2.8 USB Flash Drive......................................................................................................................................................137
6.3 GP608 Optional Part Installation................................................................................................................................138
6.3.1 3.5-inch Hard Disk.................................................................................................................................................. 138
6.3.2 GPU Card and GPU Filler Module..........................................................................................................................140
6.4 G530 V2 Optional Part Installation............................................................................................................................ 144
6.4.1 Installing a hard disk................................................................................................................................................144
6.4.2 CPU......................................................................................................................................................................... 145
6.4.3 DIMM......................................................................................................................................................................148
6.4.3.1 DIMM and CPU Compatibility............................................................................................................................ 148
6.4.3.2 Memory Subsystem Architecture......................................................................................................................... 149
6.4.3.3 DIMM Ranks........................................................................................................................................................151
6.4.3.4 DIMM Identification............................................................................................................................................ 151
6.4.3.5 Memory Configuration......................................................................................................................................... 152
6.4.3.6 DIMM Installation Rules......................................................................................................................................153
6.4.3.7 DIMM...................................................................................................................................................................154
6.4.3.8 Air Duct................................................................................................................................................................ 154
6.4.4 RAID Controller Card............................................................................................................................................. 155
6.4.5 BIOS Battery........................................................................................................................................................... 157
6.4.6 TPM......................................................................................................................................................................... 158
6.4.6.1 TPM...................................................................................................................................................................... 158
6.4.6.2 Enabling the TPM.................................................................................................................................................159
6.4.7 USB......................................................................................................................................................................... 159
6.5 GP316 Optional Part Installation................................................................................................................................161
6.5.1 Riser Card Tray........................................................................................................................................................161
6.5.2 PCIe Card................................................................................................................................................................ 162
6.6 PSU.............................................................................................................................................................................163
6.7 I/O Module................................................................................................................................................................. 166
6.7.1 Installing a PCIe Card..............................................................................................................................................166
6.7.2 Installing an I/O Module..........................................................................................................................................167
6.8 Management Module..................................................................................................................................................168
FusionServer G5500 Server
User Guide Contents
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
vi

6.8.1 RTC Battery.............................................................................................................................................................168
6.8.2 Installing a Management Module............................................................................................................................ 169
6.9 Fan Module.................................................................................................................................................................170
7 Troubleshooting........................................................................................................................ 172
8 Software and Configuration Utilities....................................................................................173
8.1 iBMC.......................................................................................................................................................................... 174
8.2 BIOS........................................................................................................................................................................... 174
8.3 Management Module..................................................................................................................................................175
9 Regulatory Information............................................................................................................176
9.1 Safety Instructions...................................................................................................................................................... 177
9.2 Warranty..................................................................................................................................................................... 180
10 Electrostatic Discharge........................................................................................................... 181
10.1 Preventing Electrostatic Discharge...........................................................................................................................182
10.2 Grounding Methods to Prevent Electrostatic Discharge.......................................................................................... 182
11 Specifications........................................................................................................................... 183
11.1 Product Specifications.............................................................................................................................................. 184
11.2 PSU Specifications................................................................................................................................................... 188
11.3 Environmental Specifications................................................................................................................................... 189
11.4 G560 Specifications..................................................................................................................................................190
11.5 GP608 Specifications................................................................................................................................................191
11.6 G530 V2 Specifications............................................................................................................................................ 191
11.7 GP316 Specifications................................................................................................................................................192
12 Other Resources....................................................................................................................... 193
12.1 Product Information Resources................................................................................................................................ 194
12.2 Product Configuration Resources.............................................................................................................................194
A How to Obtain Help.................................................................................................................196
A.1 Preparations For Contacting Huawei.........................................................................................................................197
A.2 Contacting Huawei Technical Support...................................................................................................................... 197
A.3 Making Debugging Preparations............................................................................................................................... 197
A.4 How to Use the Document.........................................................................................................................................197
A.5 How to Obtain Help from Website............................................................................................................................ 197
A.6 Ways to Contact Huawei............................................................................................................................................198
B Appendix.................................................................................................................................... 199
B.1 Acronyms and Abbreviations.................................................................................................................................... 200
B.2 Logical Structure........................................................................................................................................................204
FusionServer G5500 Server
User Guide Contents
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
vii

1 Overview
This document describes basic functions and components of the FusionServer G5500 server
server.
The FusionServer G5500 server (the G5500 for short) is a heterogeneous computing server
developed by Huawei for applications including artificial intelligence (AI), high-performance
computing (HPC), cloud computing, and big data processing. Its architecture has optimized to
support deep learning training and reasoning and HPC. Therefore, the server is ideal for AI
research and industrial deployment.
The G5500 is a 4U modular server that features high-performance computing, flexible
orchestration, high-performance large-capacity built-in storage, and easy maintenance.
Market positioning of the G5500 is as follows:
lA flexibly orchestratable, high-performance, and easy-to-maintain basic hardware
platform for AI training and cloud services in Internet and data center scenarios
lA high-density high-bandwidth AI reasoning hardware platform for safe city video
analytics
lA high-performance AI integration-oriented basic hardware platform for HPC
applications
The G5500 consists of compute modules and heterogeneous modules. There are full-width
compute node and half-width compute node.
Different node configuration requires different heterogeneous modules. Table 1-1 describes
the nodes types in different configurations.
Table 1-1
Name Configuration Figure
Full-
width
comput
e node
The G5500 full-width node
supports one full-width compute
node, including one G560 and
one GP608.
lThe G560 is in the lower slot.
lthe GP608 is in the upper slot.
FusionServer G5500 Server
User Guide 1 Overview
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
1

Name Configuration Figure
Half-
width
comput
e node
The G5500 half-width node
supports one or two half-width
compute nodes.
Each half-width compute node
includes one G530 V2 and one
GP316.
lThe G530 V2s are installed in the two
lower slots of the chassis, corresponding
to G530 V2-1 and G530 V2-2.
lThe GP316s are installed in the two
upper slots of the chassis, corresponding
to GP316-1 and GP316-2.
FusionServer G5500 Server
User Guide 1 Overview
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
2

2 Components
About This Chapter
2.1 Physical Structure
2.2 Front Panel Components
2.3 Front Panel Indicators and Buttons
2.4 Rear Panel Components
2.5 Rear Panel Indicators and Ports
2.6 Hard Disk Slot Numbers
2.7 Mainboard Components
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
3

2.1 Physical Structure
Figure 2-1 shows components of the G5500.
Figure 2-1 G5500 components
1 Chassis 2 Management modules
3 I/O modules 4 Fan modules
5 PSUs - -
Figure 2-2 shows components of the G560.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
4

Figure 2-2 G560 components
1 G560 case 2 2.5-inch SAS/SATA hard disks
3 2.5-inch NVMe SSDs 4 NVMe SSD backplane
5 SAS/SATA hard disk backplane 6 TPM (optional)
7 Supercapacitor (optional) 8 BIOS battery
9 Mainboard 10 RAID controller card (optional)
11 DIMMs 12 CPUs
13 Heat sinks 14 Air ducts
15 Mezzanine cards - -
Figure 2-3 shows components of the GP608.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
5

Figure 2-3 GP608 components
1 3.5-inch hard disks 2 GP608 case
3 Hard disk backplanes 4 PCIe board
5 GPU cards 6 GPU filler modules
Figure 2-4 shows components of a G530 V2.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
6

Figure 2-4 G530 V2 components
1 G530 V2 case 2 VGA adapter
3 Hard disk tray 4 CPUs
5 Mainboard 6 Mezzanine card
7 BIOS battery 8 Heat sinks
9 RAID controller card (optional) 10 Supercapacitor (reserved)
11 TPM (optional) 12 USB flash drive (optional)
13 2.5-inch hard disks 14 DIMMs
15 Air ducts - -
Figure 2-5 shows components of a GP316.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
7

Figure 2-5 GP316 components
1 GP316 case 2 PCIe board
3 PCIe switches 4 Riser card trays
5 Half-height half-length single-width
cards
6 Riser cards
For details about the supported components and their BOM numbers, see Server
Compatibility Checker.
2.2 Front Panel Components
Figure 2-6 shows front panel components of a full-width compute node.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
8

Figure 2-6 Front panel components of a full-width compute node
1 2.5-inch SAS/SATA hard disks 2 G560
3 2.5-inch NVMe SSDs 4 G560 release button
5 G560 ejector lever 6 GP608 ejector lever
7 GP608 release button 8 3.5-inch SAS/SATA hard disks
9 GP608 10 Label plate
Figure 2-7 shows front panel components of a half-width compute node.
Figure 2-7 Front panel components of a half-width compute node
1 Label plate 2 USB 3.0 port
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
9

3 VGA port 4 G530 V2 release button
5 G530 V2 ejector lever 6 2.5-inch hard disks
7 Product model 8 G530 V2
9 GP316 release button 10 GP316 ejector lever
11 GP316 - -
SNs
The SN on the label is a string that uniquely identifies a server. The SN is required when you
contact Huawei technical support.
Figure 2-8 shows the SN format.
Figure 2-8 SN example
No. Description
1 SN ID (two digits), which is 21 fixedly.
2 Material identification code (eight digits), that is, processing code.
3 Vendor code (two digits). The code is 10 for Huawei and other value
for outsourcing vendors.
4 Year and month (two characters).
The first character indicates the year. Digits 1 to 9 indicate 2001 to
2009, and letters A to Z indicate 2010 to 2035. The second character
indicates the month. Digits 1 to 9 indicate January to September, and
letters A to C indicate October to December.
5 Serial number (six digits).
6 RoHS compliance (one character). Y indicates environmental
protection processing.
7 Internal model, that is, product name.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
10

2.3 Front Panel Indicators and Buttons
Figure 2-9 shows front panel indicators and buttons of a full-width compute node.
Figure 2-9 Front panel indicators and buttons of a full-width compute node
1 3.5-inch SAS/SATA hard disk activity indicator 2 3.5-inch SAS/SATA hard disk fault indicator
3 2.5-inch NVMe SSD fault indicator 4 2.5-inch NVMe SSD activity indicator
5 HLY indicator 6 UID button/indicator
7 Power button/indicator 8 2.5-inch SAS/SATA hard disk activity indicator
9 2.5-inch SAS/SATA hard disk fault indicator - -
Figure 2-10 shows front panel indicators and buttons of a half-width compute node.
Figure 2-10 Front panel indicators and buttons of a half-width compute node
1 Power button/indicator 2 UID button/indicator
3 HLY indicator 4 2.5-inch hard disk fault indicator
5 2.5-inch hard disk activity indicator - -
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
11

Table 2-1 shows Indicator and button description Front panel indicators of G5500.
Table 2-1 Indicator and button description
Silk
Screen
Indicator/Button State Description
Power button/indicator lOff: The compute node is not connected to a
power source.
lBlinking yellow: The power button is locked.
The power button is locked when the iBMC is
being started during the compute node startup.
lSteady yellow: The compute node is ready to
be powered on.
lSteady green: The compute node is properly
powered on.
NOTE
lWhen the compute node is powered on, pressing the
power button for less than 1 second will power it
off.
lWhen the compute node is powered on, holding
down this button for 6 seconds will forcibly power
it off.
lWhen the compute node is ready to be powered on,
you can press this button for less than 1 second to
start it.
UID UID button/indicator The UID indicator is used to locate the compute
node in a chassis. You can remotely control the
UID indicator status (off, on, or blinking) by
using the iBMC.
lOff: The compute node is powered off or not
being located.
lSteady blue: The compute node is located.
lBlinking blue: The compute node is located
and differentiated from other located compute
nodes.
NOTE
lYou can press this button for less than 1 second to
turn on or off the UID indicator.
lYou can hold down the UID button for 4 to 6
seconds to reset the iBMC.
FusionServer G5500 Server
User Guide 2 Components
Issue 02 (2017-12-15) Huawei Proprietary and Confidential
Copyright © Huawei Technologies Co., Ltd.
12