Lenovo ThinkSystem DG5000 Operating manual

ThinkSystem DG5000
Hardware Installation and Maintenance Guide
Machine Type: 7DE4

Note
Be ore using this in ormation and the product it supports, be sure to read and understand the sa ety
in ormation and the sa ety instructions, which are available at:
http://thinksystem.lenovo iles.com/help/topic/sa ety_documentation/pd _ iles.html
In addition, be sure that you are amiliar with the terms and conditions o the Lenovo warranty or your
system, which can be ound at:
http://datacentersupport.lenovo.com/warrantylookup
First Edition (July 2023)
© Copyright enovo 2023.
LIMITED AND RESTRICTED RIGHTS NOTICE: I data or so tware is delivered pursuant to a General Services
Administration (GSA) contract, use, reproduction, or disclosure is subject to restrictions set orth in Contract No. GS-35F-
05925.

Contents
Contents . . . . . . . . . . . . . . . . . i
Safety . . . . . . . . . . . . . . . . . . iii
Chapter 1. Introduction . . . . . . . . . 1
System package contents. . . . . . . . . . . . 1
Speci ications . . . . . . . . . . . . . . . . 1
Management so tware . . . . . . . . . . . . . 4
Tech Tips . . . . . . . . . . . . . . . . . . 4
Security advisories . . . . . . . . . . . . . . 4
Chapter 2. System components. . . . . 5
Front view . . . . . . . . . . . . . . . . . . 5
Rear view . . . . . . . . . . . . . . . . . . 6
Rear view LEDs . . . . . . . . . . . . . . . . 8
PCIe slots . . . . . . . . . . . . . . . . . 10
Chapter 3. System installation and
setup . . . . . . . . . . . . . . . . . . 11
Quick guide . . . . . . . . . . . . . . . . 11
Detailed guide . . . . . . . . . . . . . . . 11
Preparing or installation . . . . . . . . . 11
Installing the hardware . . . . . . . . . . 12
Cabling controllers . . . . . . . . . . . . 13
Completing system setup and con iguration . . 20
Chapter 4. Hardware replacement
procedures . . . . . . . . . . . . . . . 23
Replacing a power supply . . . . . . . . . . . 23
Replacing a power supply . . . . . . . . . 23
Completing the replacement process . . . . 24
Replacing a an . . . . . . . . . . . . . . . 25
Shutting down the impaired node . . . . . . 25
Removing the controller module . . . . . . 25
Replacing a an . . . . . . . . . . . . . 26
Reinstalling the controller module . . . . . . 27
Completing the replacement process . . . . 29
Replacing the controller module . . . . . . . . 29
Shutting down the impaired controller . . . . 30
Replacing the controller module hardware . . 30
Running diagnostics . . . . . . . . . . . 40
Completing the replacement process . . . . 40
Replacing a DIMM. . . . . . . . . . . . . . 40
Shutting down the impaired controller . . . . 41
Removing the controller module . . . . . . 41
Replacing a DIMM . . . . . . . . . . . . 43
Installing the controller module . . . . . . . 44
Running diagnostics . . . . . . . . . . . 47
Completing the replacement process . . . . 47
Replacing the boot media . . . . . . . . . . . 47
Pre-shutdown checks or onboard encryption
keys . . . . . . . . . . . . . . . . . 48
Shutting down the impaired controller . . . . 50
Removing the controller module . . . . . . 51
Replacing the boot media . . . . . . . . . 53
Trans erring the boot image to the boot
media . . . . . . . . . . . . . . . . . 53
Booting the recovery image . . . . . . . . 57
Completing the replacement process . . . . 59
Replacing the real-time clock battery . . . . . . 60
Shutting down the impaired controller . . . . 60
Removing the controller module . . . . . . 60
Replacing the RTC battery . . . . . . . . . 63
Reinstalling the controller module . . . . . . 64
Completing the replacement process . . . . 66
Replacing mezzanine cards . . . . . . . . . . 66
Shutting down the impaired controller . . . . 66
Removing the controller module . . . . . . 67
Replacing or installing a mezzanine card . . . 69
Reinstalling the controller module . . . . . . 70
Completing the replacement process . . . . 71
Replacing the NVMEM battery . . . . . . . . . 71
Shutting down the impaired controller . . . . 71
Removing the controller module . . . . . . 72
Replacing the NV battery . . . . . . . . . 73
Installing the controller module . . . . . . . 74
Running diagnostics . . . . . . . . . . . 76
Completing the replacement process . . . . 76
Replacing the chassis . . . . . . . . . . . . 76
Shutting down the controllers when replacing
a chassis . . . . . . . . . . . . . . . 76
Removing the controller modules . . . . . . 77
Moving drives to the new chassis . . . . . . 78
Replacing a chassis rom within the
equipment rack or system cabinet. . . . . . 79
Installing the controller modules . . . . . . 79
Running diagnostics . . . . . . . . . . . 80
Completing the replacement process . . . . 80
Chapter 5. System level
diagnostics. . . . . . . . . . . . . . . 81
Introduction to system-level diagnostics . . . . . 81
Scan system . . . . . . . . . . . . . . . . 81
Test system . . . . . . . . . . . . . . . . 84
© Copyright Lenovo 2023 i

Test example: Run CPU Test . . . . . . . . 85
Test memory . . . . . . . . . . . . . . . . 86
Con igure Memory Test Range . . . . . . . 87
Memory Test Selection and Loop Count . . . 87
Show VPD in ormation . . . . . . . . . . . . 90
Show FW revision . . . . . . . . . . . . . . 92
Show MAC address . . . . . . . . . . . . . 93
Show logs . . . . . . . . . . . . . . . . . 94
Show Logs Selection . . . . . . . . . . . 95
Reboot (BMC power cycle) controller to
LOADER . . . . . . . . . . . . . . . . 97
Appendix A. Getting help and
technical assistance . . . . . . . . . . 99
Be ore you call . . . . . . . . . . . . . . . 99
Collecting service data . . . . . . . . . . . . 100
Contacting Support . . . . . . . . . . . . . 100
Appendix B. Notice of Privacy
Practices . . . . . . . . . . . . . . . . 103
Appendix C. Notices. . . . . . . . . . 105
Trademarks . . . . . . . . . . . . . . . . 106
Important notes . . . . . . . . . . . . . . . 106
Particulate contamination . . . . . . . . . . . 106
ASHRAE class compliance in ormation. . . . . . 108
Telecommunication regulatory statement. . . . . 108
Electronic emission notices . . . . . . . . . . 108
Taiwan region BSMI RoHS declaration . . . . 109
Taiwan Region import and export contact
in ormation . . . . . . . . . . . . . . . . 109
Index . . . . . . . . . . . . . . . . . . 111
ii ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Safety
Be ore installing this product, read the Sa ety In ormation.
Antes de instalar este produto, leia as In ormações de Segurança.
在安装本产品之前，请仔细阅读 Sa ety In ormation （安全信息）。
Læs sikkerheds orskri terne, ør du installerer dette produkt.
Lees voordat u dit product installeert eerst de veiligheidsvoorschri ten.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Sa ety In ormation.
Avant d'installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le In ormazioni sulla Sicurezza.
Les sikkerhetsin ormasjonen (Sa ety In ormation) ør du installerer dette produktet.
Antes de instalar este produto, leia as In ormações sobre Segurança.
© Copyright Lenovo 2023 iii

Antes de instalar este producto, lea la in ormación de seguridad.
Läs säkerhetsin ormationen innan du installerar den här produkten.
iv ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Chapter 1. Introduction
This chapter provides a brie introduction to your system. This chapter contains in ormation about product
speci ications, management so tware, tech tips, and security advisories.
System package contents
When you receive your system, veri y that the shipment contains everything that you expected to receive.
The system package includes the ollowing items:
Note: Items marked with asterisk (*) are available on some models only.
• 1 DG5000 unit
• 2 Rail kit*. Detailed instructions or installing the rail kit are provided in the package with the rail kit.
• 3 Material box, including items such as cable management arm*, accessory kit, power cords* and
documentation
Specifications
The ollowing in ormation is a summary o the eatures and speci ications o the DG5000 storage unit.
Depending on the model, some eatures might not be available, or some speci ications might not apply.
Table 1. Storage specifications
Specification Description
Dimension • 2U
• Height: 87 mm (3.43 inches)
• Width:
– With mounting langes: 483 mm (19.0 inches)
– Without mounting langes: 447 mm (17.6 inches)
• Depth: 543 mm (21.38 inches)
Weight 24.6 kg (54.3 lb)
Processor • Intel 2.1 GHz 12-core processor
• One 12-core processors per node
• 24 total processor core per system
Power supplies Two hot-swap power supplies or redundancy support
Memory • Memory: 64 GB per node, 128 GB in total
• NVRAM: 8 GB per node, 16 GB in total
• Type:
– DDR4-2666, dual-rank, 32 GB ECC RDIMM
Note: 8 GB o NVRAM used rom controller 64 GB memory.
© Copyright Lenovo 2023 1

Table 1. Storage specifications (continued)
Specification Description
Expansion slots • Two PCIe mezzanine slots per node
• Four PCIe mezzanine slots per system
For detailed in ormation, see “Rear view” on page 6.
Input/Output (I/O) eatures Rear panel (per node):
• Two 25 GbE SFP28 connectors( or cluster and HA interconnect)
• Two 10 Gbase-T RJ45 connectors
• One RJ-45 1 GbE management port
• One RJ-45 console port
• One Micro-USB console port
• One USB Type-A connector (Netboot & OS update)
Storage controller adapters • 4-port 25Gb Ethernet, SFP28 port
• 2-port 100Gb Ethernet, QSFP28 port
• 4-port 32GB Fiber Channel, SFP+ port
System ans • Five hot-swap system ans per node
• System can operate with a single an ailure
Electrical input The storage system supports up to two hot-swap power supplies or node or
redundancy.
Power supply 100–120 V ac 200–240 V ac
1600-watt 80 PLUS
Platinum
(50–60 Hz) (50–60 Hz)
Yes Yes
1600-watt 80 PLUS
Titanium
(50–60 Hz) (50–60 Hz)
Yes Yes
Acoustical noise emissions • Sound power: 7.2 bels
• Sound pressure: 69.1 dBA
Environment The system is supported in the ollowing environment:
• Air temperature:
– Operating: ASHRAE class A2: 10–35°C (50–95°F)
– Shipping or storage: -40–70°C (-40–158°F)
• Maximum altitude:
– Operating: 3048 m (10000 t)
– Shipping or storage: 12 192 m (40000 t)
• Relative humidity (non-condensing):
– Operating: ASHRAE class A2: 8%–80%; maximum dew point: 21°C (70°F)
– Shipping or storage: 10%–95%
Your storage complies with ASHARE class A2 speci ications. For detailed
in ormation, see “ASHRAE class compliance in ormation” on page 108.
2ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Chapter 1.Introduction 3

Management software
ONTAP is available or managing your system. For detailed in ormation about how to use ONTAP, go to:
http://thinksystem.lenovo iles.com/help/topic/ontap_so tware/overview.html
Tech Tips
Lenovo continually updates the support website with the latest tips and techniques that you can use to solve
issues that you might have with your system. These Tech Tips (also called retain tips or service bulletins)
provide procedures to work around issues related to the operation o your system.
To ind the Tech Tips available or your system:
1. Go to http://datacentersupport.lenovo.com and navigate to the support page or your system.
2. Click How-tos & Solutions.
Expand Symptom to choose a category or the type is problem that you are having.
Security advisories
Lenovo is committed to developing products and services that adhere to the highest security standards in
order to protect our customers and their data. When potential vulnerabilities are reported, it is the
responsibility o the Lenovo Product Security Incident Response Team (PSIRT) to investigate and provide
in ormation to our customers so they may put mitigation plans in place as we work toward providing
solutions.
The list o current advisories is available at the ollowing site:
https://datacentersupport.lenovo.com/product_security/home
4ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Chapter 2. System components
This section provides in ormation to help you locate your DG5000 components.
Front view
The ollowing illustration shows the ront view o the DG5000 with the ront bezel removed.
Front view without bezel
Figure 1. Front view without bezel
1 Chassis power LED 2 System attention LED
3 Location LED 4 Drive activity LED
5 Drive ault LED 6 Shel ID
1 Chassis power ED
The power status LED helps you to determine the current power status.
Status Color Description
Solid on Green The system is on and running.
O None No power supply is delivering power to the system.
2 System attention ED
The system attention LED provides basic diagnostic unctions or your storage system. I the system
attention LED is lit, one or more LEDs elsewhere in the system might also be lit to direct you to the source o
the error.
© Copyright Lenovo 2023 5

Status Color Description Action
On Yellow An error has been detected on the system. Causes
might include but not limited to the ollowing errors:
• A an ailure
• A memory error
• A storage ailure
• A PCIe device ailure
• A power supply ailure
• A port ailure
• A system board error
Check the event log to determine
the exact cause o the error.
O None The system is o , or the system is on and working
correctly.
None.
3 ocation ED
The blue system location LED is used to visually locate a system.
4 Drive activity ED
The drive activity LED is used to determine the status o a drive.
Status Color Description Action
On Green Drive has power. None.
Blinking Green Drive servicing IO. None.
5 Drive fault ED
The drive ault LED is used to determine the status o a drive.
Status Color Description Action
On Amber An error has occurred with the drive. Replace the drive.
Blinking Amber Drive rebuild action is underway. None.
O None The drive is working normally. None.
6 Shelf ED
The shel ID is used to show the ID number o the shel . Each shel in a con iguration needs to have a unique
ID.
Rear view
The rear view o the storage provides access to the system connectors and components.
6ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Figure 2. Rear view with dual, high availabilit , nodes
1 Top controller, node A 2 Bottom controller, node B
Figure 3. Rear view of controller nodes
1 Host Inter ace Card slot 1 2 Host Inter ace Card slot 2
3 Power Supply 4 RJ-45 console port
5 USB Type-A port 6 Micro-USB console port
7 1 GbE RJ-45 management port 8 10 Gbase-T Ethernet RJ45 ports (2)
9 25 GbE SFP28 connectors (2)
1 2 Host Interface Card (HIC) slots
You can ind the Host Inter ace Card (HIC) slot numbers on the rear o each controller.
3 Power supply
The hot-swap redundant power supplies help you avoid signi icant interruption to the operation o the
system when a power supply ails.
On each power supply, there are multi-color status LEDs near the power cord connector. For in ormation
about the status LEDs, see “Rear view LEDs” on page 8.
4 RJ-45 console port
The RJ-45 console port connection provides serial access to the nodes BMC management network device.
5 USB Type-A port
The USB Type-A port is a Read-Only connection that can be used or ONTAP netboot and system updates.
6 Micro-USB console port
Chapter 2.System components 7

The Micro-USB console port connection provides serial access to the nodes BMC management network
device.
7 1 GbE RJ-45 management port
The RJ-45 console port connection provides 1 Gb Ethernet connectivity to the node or systems
management using the DM Storage Manager.
8 10 GbE RJ-45 console ports (2)
Each controller includes two 10 Gb Ethernet ports that are used or host I/O connectivity.
9 25 GbE SFP28 connectors (2)
Each controller includes two 25 Gb Ethernet ports that are used to provide node-to-node clustering or switch
node clustering on a DG5000.
Rear view EDs
The illustration in this section shows the LEDs on the rear o the storage unit.
Figure 4. Rear view LEDs
Table 2. LEDs on the rear of the s stem
1 RJ45 management port link LED 2 RJ45 management port link LED
3 NVMEM discharge LED 4 Controller location LED
5 Controller attention LED 6 Controller activity LED
7 10 GbE port link LEDs (2) 8 10 GbE port activity LEDs (2)
9 25 GbE port link LEDs (2) 10 25 GbE port attention LEDs (2)
11 Power supply LED
1 2 RJ45 management port status EDs
The RJ45 management port is a 1Gb Ethernet port that has two status LEDs.
Status ED Status Color Description
1 RJ45 management port
link LED
On Green A link is established between the port and
some upstream device.
O None No link is established.
2 RJ45 management port
activity LED
Blinking Green Tra ic is lowing over the connection.
O None No tra ic is lowing over the connection.
8ThinkSystem DG5000 Hardware Installation and Maintenance Guide

3 NVMEM discharge ED
The NVMEM discharge LED provides the status o ONTAP running on the controller.
Status Color Description
Blinking Green NVMEM destage events are occurring.
Solid Green NVMEM destage events completed success ully.
O None The system is running normally and the NVMEM is
ready i ONTAP is running.
4 Controller location ED
The controller location LED is a blue LED that helps to show the location o a speci ic controller in a system.
5 Controller attention ED
The controller attention LED indicates that there is an issue with a controller. Check other LEDs and event
logs to determine the cause o the issue.
Status Color Description
On Amber The controller has a ault.
O None The controller is operating normally.
6 Controller activity ED
The controller activity LED provides the status o ONTAP running on the controller.
Status Color Description
Blinking Green The controller is running ONTAP. The length o time the
light remains on is proportional to the controller activity.
O None ONTAP is not running on the controller.
7 8 10 Gb Ethernet RJ45 port status EDs
The Ethernet port has two status LEDs.
Status ED Status Color Description
7 10 GbE port link LEDs (2) On Green A connection is established between the port
and some upstream devices.
O None No connection is established on the port.
8 10 GbE port activity LEDs
(2)
Blinking Green Tra ic is lowing over the connection.
O None No tra ic is lowing over the connection.
9 10 25 Gb Ethernet port status EDs
The Ethernet port has two status LEDs.
Status ED Status Color Description
9 25 GbE port link LEDs (2) On Green A connection is established on the port.
O None No connection is established on the port.
Chapter 2.System components 9

Status ED Status Color Description
10 25 GbE port attention
LEDs (2)
On Amber The port requires attention.
O None The port operates normally.
11 Power supply ED
The power supply has a multi-color status LED.
Status Color Description
On Green The power supply is connected to the AC power source.
Red The power supply is ailed or the AC power source is
removed.
O None The system is o .
PCIe slots
The DG5000 supports two (2) x16 PCIe mezzanine host inter ace cards (HIC) per controller. These slots are
used to add extra adapters or host, storage, or cluster connectivity. The tables below show the supported
adapters, the max number supported per controller and the adapter slot priority.
Host interface card support
Name Option PN Feature
Code
Plug Type Supported
Protocol(s)
Per
Controller
Slot Priority
Host Interface
HIC, 10/25Gb
iSCSI,4-ports
4C57A67132 BEVQ SFP28 Ethernet 10/
25Gb
2 2,1
HIC, 16/32Gb
FC,4-ports
4C57A67133 BEVP SFP+ Fibre Channel
8/16/32 Gb
NVMe/FC 8/
16/32 Gb
2 2,1
Expansion
HIC, 2x100Gb
NVMe-RoCE,2-
ports1
4C57A67134 BEVR QSFP28 Ethernet
100Gb
1 1
1: Used with DM240N expansion, restricted to 100 GbE only.
10 ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Chapter 3. System installation and setup
Quick guide
This guide gives graphic instructions or a typical installation o your system rom racking and cabling,
through initial system bring-up. Use this guide i you are amiliar with installing Lenovo systems.
Access the Installation and Setup Instructions PDF poster: DG5000 Systems Installation and Setup Instructions
Detailed guide
This guide gives detailed step-by-step instructions or installing a typical Lenovo system. Use this guide i
you want more detailed installation instructions.
Preparing for installation
To install your DG5000 system, you need to create an account and register the system. You also need to
inventory the appropriate number and type o cables or your system and collect speci ic network
in ormation.
You need to have access to the Lenovo Press or in ormation about site requirements as well as additional
in ormation on your con igured system.
Lenovo Press
Attention: Customers with speci ic power requirements must check Lenovo Press or their con iguration
options.
You need to provide the ollowing at your site:
• Rack space or the storage system
• Phillips #2 screwdriver
• Additional networking cables to connect your system to your network switch and laptop or console with a
Web browser
Step 1. Unpack the contents o all boxes.
Step 2. Record the system serial number rom the controllers.
Step 3. Set up your account:
a. Log in to your existing account or create an account. Lenovo Support Registration
b. Register your system. Lenovo Product Registration
Step 4. Inventory and make a note o the number and types o cables you received.The ollowing table
identi ies the types o cables you might receive. I you receive a cable not listed in the table, see
Lenovo Press to locate the cable and identi y its use.
Lenovo Press
© Copyright Lenovo 2023 11

Type of cable Part number and
length
Connector type For...
25 GbE cable
(SFP28)
7Z57A03557, 1m
7Z57A03558, 3m
7Z57A03559, 5m
Cluster interconnect/HA
and Ethernet data
(order-dependent)
100 GbE cable
(QSFP28)
7Z57A03561, 1m
7Z57A03562, 3m
7Z57A03563, 5m
Storage (order-
dependent)
Optical cables 4Z57A10845, .5M
LC-LC OM4
4Z57A10846, 1M LC-
LC OM4
4Z57A10847, 3M LC-
LC OM4
4Z57A10848, 5M LC-
LC OM4
4Z57A10849, 10M
LC-LC OM4
4Z57A10850, 15M
LC-LC OM4
Fiber channel or
Ethernet data (order-
dependent)
RJ-45 (order
dependant)
Various Management and
Ethernet network
Micro-USB
console cable
Not applicable Console connection
during so tware setup
Power cables Various Powering up the system
Step 5. Review the DG5000 Installation and Setup Instructions or Cluster Management Using Storage
Manager and collect the required in ormation listed in that guide.
DG5000 Installation and Setup Instructions
Cluster Management Using ThinkSystem Storage Manager or DM Series
Installing the hardware
You need to install your system in a 4-post rack or Lenovo system cabinet, as applicable.
Step 1. Install the rail kits, as needed.
Step 2. Install and secure your system using the instructions included with the rail kit.
Note: You need to be aware o the sa ety concerns associated with the weight o the system.
12 ThinkSystem DG5000 Hardware Installation and Maintenance Guide

Step 3. Identi y and manage cables because this system does not have a cable management device.
Step 4. Place the bezel on the ront o the system.
Cabling controllers
There is required cabling or your plat orm's cluster using the two-node switchless cluster method or the
cluster interconnect network method. There is optional cabling to the Fibre Channel or iSCSI host networks
or direct-attached storage. This cabling is not exclusive; you can have cabling to a host network and storage.
Cabling controllers to a cluster
You can cable the controllers to a cluster by using the two-node switchless cluster method or by using the
cluster interconnect network.
Cabling a two node switchless cluster
The management, Fibre Channel, and data or host network ports on the controller modules are connected to
switches. The cluster interconnect ports are cabled on both controller modules.
You must have contacted your network administrator or in ormation about connecting the system to the
switches.
Be sure to check the illustration arrow or the proper cable connector pull-tab orientation.
Pull-tab
Note: As you insert the connector, you should eel it click into place; i you do not eel it click, remove it, turn
it around and try again.
Step 1. Use the step-by-step instructions to complete the cabling between the controllers and to the
switches:
Chapter 3.System installation and setup 13

Step Perform on each controller
1
Cable the cluster interconnect ports to each other with the 25GbE cluster interconnect cable
:
• e0c to e0c
• e0d to e0d
2
Cable ports 1a through 1d to data or host network switches:
Cable ports 2a through 2d to the FC host network switches:
14 ThinkSystem DG5000 Hardware Installation and Maintenance Guide