Lenovo ThinkSystem DM240N User manual

Hot-add a shelf - DM240N shelves
(support for DG5000 and DG7000)
DM240N

First Edition (July 2023)
© Copyright Lenovo 2023.
LIMIT D AND R STRICT D RIGHTS NOTIC : If data or software is delivered pursuant to a General Services
Administration (GSA) contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-
05925.

Contents
1. Hot-add a shelf - DM240N shelves 1
1.1. Requirements for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê1
1.2. Considerations for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê1
1.3. Prepare for a hot-add. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê2
1.3.1. Prepare non-dedicated RoCE-capable ports for a hot-add. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê2
1.3.2. Prepare a DM7100F or DG7000 HA pair to hot-add a second shelf . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê4
1.3.3. Prepare to manually assign drive ownership for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê5
1.4. Install a drive shelf for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê6
1.5. Cable a drive shelf for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê8
1.5.1. Considerations when cabling for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê8
1.5.2. Cable a hot-add shelf for a DM5100F or DG5000 HA pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê8
1.5.3. Cable a hot-add shelf for a DM7100F HA pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê10
1.5.4. Cable a hot-add shelf for a DG7000 HA pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê12
1.6. Complete the hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê14
2. Appendix 16
2.1. Contacting support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê16
2.2. Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê16
2.3. Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê17

Chapter 1. Hot-add a shelf - DM240N shelves
You can hot-add a DM240N drive shelf after your HA pair meets certain
requirements, and after the preparation tasks applicable to your HA pair are
completed.
1.1. Requirements for a hot-add
Your HA pair must meet certain requirements before hot-adding a DM240N drive shelf.
•Your system and version of ONTAP must support the DM240N shelf and drives you are hot-
adding.
•You must have the correct number and type of cables to connect the shelf.
•Your HA pair must have enough available RoCE-capable ports to support the number of
shelves you are hot-adding.
For each shelf you are hot-adding, you need a minimum of two RoCE capable ports on each
controller. These ports can be on board the controllers, on RoCE-capable PCIe cards, a
combination of both, or on RoCE-capable I/O modules, as supported by your system.
If your HA pair does not have enough available RoCE-capable ports, and your system supports
the use of RoCE-capable PCIe cards or I/O modules, you must have installed the additional
cards or I/O modules into the correct controller slots, as supported by your system.

Non-dedicated RoCE-capable ports must be configured for storage use (not
networking use).
Prepare non-dedicated RoCE-capable ports for a hot-add
•Your HA pair must have less than the maximum number of shelves supported, by at least the
number of shelves you plan to hot-add.
You cannot have exceeded the maximum number of shelves supported by your HA pair after
hot-adding shelves.
•If you are hot-adding a shelf to an HA pair that already has a DM240N shelf, your HA pair
cannot have any storage cabling error messages, and it must be cabled as multipath HA.
•To change the DM240N shelf ID, you can use a paper clip or ballpoint pen to access the shelf
ID button behind the Operator Display Panel (ODP).
1.2. Considerations for a hot-add
You should familiarize yourself with best practices and aspects about this procedure before hot-
adding a DM240N drive shelf.
1

•Best practice: The best practice is to have the current version of ONTAP software installed
before hot-adding a shelf.
Having the most current version of ONTAP software also will install the latest Disk Qualification
Package (DQP) and NVMe shelf module (NSM) firmware. The DQP allows your system to
recognize and use newly qualified drives. This avoids system event messages about having
noncurrent drive information and prevention of drive partitioning because drives are not
recognized. The DQP also notifies you of noncurrent drive firmware.
Do not revert firmware to a version that does not support your shelf and its
components.
•After you have cabled a hot-added shelf, ONTAP recognizes the shelf:
◦Drive ownership is assigned if automatic drive assignment is enabled.
◦NSM shelf firmware and drive firmware should be updated automatically, if needed.
Firmware updates can take up to 30 minutes.
1.3. Prepare for a hot-add
You must complete the preparation tasks applicable to your HA pair before hot-adding a DM240N
drive shelf.
1.3.1. Prepare non-dedicated RoCE-capable ports for a hot-add
If your HA pair has non-dedicated RoCE-capable ports that you are using to hot-add a DM240N
drive shelf, you must make sure the ports are configured for storage use (not networking use).
Depending on your system, the RoCE-capable ports are on board the controllers, on RoCE-capable
PCIe cards, a combination of both, or on RoCE-capable I/O modules.
Before you begin
You must have met the system requirements.
Requirements for a hot-add
About this task
•For some systems, when a RoCE-capable PCIe card or I/O module is installed in a supported
slot on a controller, the ports automatically default to storage use (instead of networking);
however, it is recommended that you complete this procedure to verify the RoCE-capable ports
are configured for storage use.
•If you determine that the non-dedicated RoCE-capable ports in your HA pair are not configured
for storage use, it is a nondisruptive procedure to configure them.
2

If your HA pair is running a version of ONTAP 9.6, you need to reboot the
controllers, one at a time.
If your HA pair is running ONTAP 9.7 or later, you do not need to reboot the
controllers, unless one or both controllers are in maintenance mode. This
procedure assumes that neither controller is in maintenance mode.
Steps
1. Verify if the non-dedicated ports in the HA pair are configured for storage use: storage port
show
You can enter the command on either controller module.
If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display storage in the
Mode column.
If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the
Is Dedicated? column, also display enabled in the State column.
2. If the non-dedicated ports are configured for storage use, you are done with this procedure.
Otherwise, you need to configure the ports by completing steps 3 through 6.

When non-dedicated ports are not configured for storage use, the command
output displays the following:
If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display
network in the Mode column.
If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which
display false in the Is Dedicated?` column, also display disabled in the
State column.
3. Configure the non-dedicated ports for storage use, on one of the controller modules:
You must repeat the applicable command for each port you are configuring.
If your HA pair is
running…
Then…
ONTAP 9.8 or later storage port modify -node node name -port port name -mode
storage
ONTAP 9.7 or 9.6 storage port enable -node node name -port port name
4. If your HA pair is running ONTAP 9.6, reboot the controller module so that the port changes
take effect: system node reboot -node node name -reason reason for the reboot
3

Otherwise, go to the next step.
The reboot can take up to 15 minutes.
5. Repeat steps for the second controller module:
If your HA pair is
running…
Then…
ONTAP 9.7 or later a. Repeat step 3.
b. Go to step 6.
ONTAP 9.6 a. Repeat steps 3 and 4.
The first controller must have already completed
its reboot.
b. Go to step 6.
6. Verify that the non-dedicated ports on both controller modules are configured for storage use:
storage port show
You can enter the command on either controller module.
If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display storage in the
Mode column.
If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the
Is Dedicated? column, also display enabled in the State column.
1.3.2. Prepare a DM7100F or DG7000 HA pair to hot-add a second shelf
If you have a DM7100F or DG7000 HA pair with one DM240N drive shelf that is cabled to one set of
RoCE-capable ports on each controller, you must recable the shelf (after you have installed the
additional RoCE-capable PCIe cards or I/O modules) across both sets of ports on each controller,
before hot-adding the second shelf.
Before you begin
•You must have met the system requirements.
Requirements for a hot-add
•You must have enabled the ports on the RoCE-capable PCIe cards or I/O modules you
installed.
Prepare non-dedicated RoCE-capable ports for a hot-add
4

About this task
•Recabling port connections is a nondisruptive procedure when your shelf has multipath-HA
connectivity.
You recable the first shelf across both sets of ports on each controller so that when you hot-
add the second shelf, both shelves have more resilient connectivity.
•You move one cable at a time to maintain connectivity to the shelf at all times during this
procedure.
Steps
1. Recable the existing shelf’s connections across both sets of ports on each controller, as
applicable to your system.
Moving a cable does not require any wait time between unplugging the cable
from one port and plugging it into another port.
If you have an… Then…
DM7100F HA pair

If needed, you can reference cabling illustrations
showing an existing single shelf and the recabled
shelf, in a two shelf configuration.
Cable a hot-add shelf for a DM7100F HA pair
a. On controller A, move the cable from port e0d to slot 5 Port b
(e5b).
b. Repeat the same cable move on controller B.
DG7000 HA pair

If needed, you can reference cabling illustrations
showing an existing single shelf and the recabled
shelf, in a two shelf configuration.
Cable a hot-add shelf for a DG7000 HA pair
a. On controller A, move the cable from slot 4 port a (e4a) to slot 5
port b (e5b).
b. Repeat the same cable move on controller B.
2. Verify that the recabled shelf is cabled correctly.
1.3.3. Prepare to manually assign drive ownership for a hot-add
If you are manually assigning drive ownership for the DM240N drive shelf you are hot-adding, then
you need to disable automatic drive assignment if it is enabled.
5

Before you begin
You must have met the system requirements.
Requirements for a hot-add
About this task
You need to manually assign drive ownership if drives in the shelf will be owned by both controller
modules in the HA pair.
Steps
1. Verify whether automatic drive assignment is enabled: storage disk option show
You can enter the command on either controller module.
If automatic drive assignment is enabled, the output shows on in the Auto Assign column (for
each controller module).
2. If automatic drive assignment is enabled, disable it: storage disk option modify -node
node_name -autoassign off
You must disable automatic drive assignment on both controller modules.
1.4. Install a drive shelf for a hot-add
Installing a new DM240N drive shelf involves installing the shelf into a rack or cabinet, connecting
the power cords (which automatically powers on the shelf), and then setting the shelf ID.
Before you begin
•You must have met the system requirements.
Requirements for a hot-add
•You must have completed the applicable preparation procedures.
Prepare for a hot-add
Steps
1. Install the rail-mount kit that came with your shelf by using the installation flyer that came in the
kit box.
Do not flange-mount the shelf.
2. Install and secure the shelf onto the support brackets and rack or cabinet by using the
installation flyer.
6


A fully loaded DM240N shelf can weigh up to 66.78 lbs (30.29 kg) and
requires two people to lift or use of a hydraulic lift. Avoid removing shelf
components (from the front or rear of the shelf) to reduce the shelf weight,
because shelf weight will become unbalanced.
3. Connect the power cords to the shelf, secure them in place with the power cord retainer if they
are AC power supplies, or the two thumb screws if they are DC power supplies, and then
connect the power cords to different power sources for resiliency.
A shelf powers up when connected to a power source; it does not have power switches. When
functioning correctly, a power supply’s bicolored LED illuminates green.
4. Set the shelf ID to a number that is unique within the HA pair:
More detailed instructions are available:
Change a shelf ID - DM240N shelves
a. Remove the left end cap and locate the small hole to the right of the LEDs.
b. Insert the end of a paper clip or similar tool into the small hole to reach the shelf ID button.
c. Press and hold the button (for up to 15 seconds) until the first number on the digital display
blinks, and then release the button.
If the ID takes longer than 15 seconds to blink, press and hold the button
again, making sure to press it in all the way.
d. Press and release the button to advance the number until you reach the desired number
from 0 to 9.
e. Repeat substeps 4c and 4d to set the second number of the shelf ID.
It can take up to three seconds (instead of 15 seconds) for the number to blink.
f. Press and hold the button until the second number stops blinking.
After about five seconds, both numbers start blinking and the amber LED on the ODP
illuminates.
g. Power-cycle the shelf to make the shelf ID take effect.
You must unplug both power cords from the shelf, wait 10 seconds, and then plug them
back in.
When power is restored to the power supplies, their bicolored LEDs illuminate green.
7