Lenovo ThinkSystem DM240N User manual

Hot-add a shelf - DM240N shelves
(support for DG5000 and DG7000)
DM240N

First Edition (July 2023)
© Copyright Lenovo 2023.
LIMIT D AND R STRICT D RIGHTS NOTIC : If data or software is delivered pursuant to a General Services
Administration (GSA) contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-
05925.

Contents
1. Hot-add a shelf - DM240N shelves 1
1.1. Requirements for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê1
1.2. Considerations for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê1
1.3. Prepare for a hot-add. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê2
1.3.1. Prepare non-dedicated RoCE-capable ports for a hot-add. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê2
1.3.2. Prepare a DM7100F or DG7000 HA pair to hot-add a second shelf . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê4
1.3.3. Prepare to manually assign drive ownership for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê5
1.4. Install a drive shelf for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê6
1.5. Cable a drive shelf for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê8
1.5.1. Considerations when cabling for a hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê8
1.5.2. Cable a hot-add shelf for a DM5100F or DG5000 HA pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê8
1.5.3. Cable a hot-add shelf for a DM7100F HA pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê10
1.5.4. Cable a hot-add shelf for a DG7000 HA pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê12
1.6. Complete the hot-add . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê14
2. Appendix 16
2.1. Contacting support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê16
2.2. Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê16
2.3. Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ê17

Chapter 1. Hot-add a shelf - DM240N shelves
You can hot-add a DM240N drive shelf after your HA pair meets certain
requirements, and after the preparation tasks applicable to your HA pair are
completed.
1.1. Requirements for a hot-add
Your HA pair must meet certain requirements before hot-adding a DM240N drive shelf.
•Your system and version of ONTAP must support the DM240N shelf and drives you are hot-
adding.
•You must have the correct number and type of cables to connect the shelf.
•Your HA pair must have enough available RoCE-capable ports to support the number of
shelves you are hot-adding.
For each shelf you are hot-adding, you need a minimum of two RoCE capable ports on each
controller. These ports can be on board the controllers, on RoCE-capable PCIe cards, a
combination of both, or on RoCE-capable I/O modules, as supported by your system.
If your HA pair does not have enough available RoCE-capable ports, and your system supports
the use of RoCE-capable PCIe cards or I/O modules, you must have installed the additional
cards or I/O modules into the correct controller slots, as supported by your system.

Non-dedicated RoCE-capable ports must be configured for storage use (not
networking use).
Prepare non-dedicated RoCE-capable ports for a hot-add
•Your HA pair must have less than the maximum number of shelves supported, by at least the
number of shelves you plan to hot-add.
You cannot have exceeded the maximum number of shelves supported by your HA pair after
hot-adding shelves.
•If you are hot-adding a shelf to an HA pair that already has a DM240N shelf, your HA pair
cannot have any storage cabling error messages, and it must be cabled as multipath HA.
•To change the DM240N shelf ID, you can use a paper clip or ballpoint pen to access the shelf
ID button behind the Operator Display Panel (ODP).
1.2. Considerations for a hot-add
You should familiarize yourself with best practices and aspects about this procedure before hot-
adding a DM240N drive shelf.
1

•Best practice: The best practice is to have the current version of ONTAP software installed
before hot-adding a shelf.
Having the most current version of ONTAP software also will install the latest Disk Qualification
Package (DQP) and NVMe shelf module (NSM) firmware. The DQP allows your system to
recognize and use newly qualified drives. This avoids system event messages about having
noncurrent drive information and prevention of drive partitioning because drives are not
recognized. The DQP also notifies you of noncurrent drive firmware.
Do not revert firmware to a version that does not support your shelf and its
components.
•After you have cabled a hot-added shelf, ONTAP recognizes the shelf:
◦Drive ownership is assigned if automatic drive assignment is enabled.
◦NSM shelf firmware and drive firmware should be updated automatically, if needed.
Firmware updates can take up to 30 minutes.
1.3. Prepare for a hot-add
You must complete the preparation tasks applicable to your HA pair before hot-adding a DM240N
drive shelf.
1.3.1. Prepare non-dedicated RoCE-capable ports for a hot-add
If your HA pair has non-dedicated RoCE-capable ports that you are using to hot-add a DM240N
drive shelf, you must make sure the ports are configured for storage use (not networking use).
Depending on your system, the RoCE-capable ports are on board the controllers, on RoCE-capable
PCIe cards, a combination of both, or on RoCE-capable I/O modules.
Before you begin
You must have met the system requirements.
Requirements for a hot-add
About this task
•For some systems, when a RoCE-capable PCIe card or I/O module is installed in a supported
slot on a controller, the ports automatically default to storage use (instead of networking);
however, it is recommended that you complete this procedure to verify the RoCE-capable ports
are configured for storage use.
•If you determine that the non-dedicated RoCE-capable ports in your HA pair are not configured
for storage use, it is a nondisruptive procedure to configure them.
2

If your HA pair is running a version of ONTAP 9.6, you need to reboot the
controllers, one at a time.
If your HA pair is running ONTAP 9.7 or later, you do not need to reboot the
controllers, unless one or both controllers are in maintenance mode. This
procedure assumes that neither controller is in maintenance mode.
Steps
1. Verify if the non-dedicated ports in the HA pair are configured for storage use: storage port
show
You can enter the command on either controller module.
If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display storage in the
Mode column.
If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the
Is Dedicated? column, also display enabled in the State column.
2. If the non-dedicated ports are configured for storage use, you are done with this procedure.
Otherwise, you need to configure the ports by completing steps 3 through 6.

When non-dedicated ports are not configured for storage use, the command
output displays the following:
If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display
network in the Mode column.
If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which
display false in the Is Dedicated?` column, also display disabled in the
State column.
3. Configure the non-dedicated ports for storage use, on one of the controller modules:
You must repeat the applicable command for each port you are configuring.
If your HA pair is
running…
Then…
ONTAP 9.8 or later storage port modify -node node name -port port name -mode
storage
ONTAP 9.7 or 9.6 storage port enable -node node name -port port name
4. If your HA pair is running ONTAP 9.6, reboot the controller module so that the port changes
take effect: system node reboot -node node name -reason reason for the reboot
3

Otherwise, go to the next step.
The reboot can take up to 15 minutes.
5. Repeat steps for the second controller module:
If your HA pair is
running…
Then…
ONTAP 9.7 or later a. Repeat step 3.
b. Go to step 6.
ONTAP 9.6 a. Repeat steps 3 and 4.
The first controller must have already completed
its reboot.
b. Go to step 6.
6. Verify that the non-dedicated ports on both controller modules are configured for storage use:
storage port show
You can enter the command on either controller module.
If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display storage in the
Mode column.
If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the
Is Dedicated? column, also display enabled in the State column.
1.3.2. Prepare a DM7100F or DG7000 HA pair to hot-add a second shelf
If you have a DM7100F or DG7000 HA pair with one DM240N drive shelf that is cabled to one set of
RoCE-capable ports on each controller, you must recable the shelf (after you have installed the
additional RoCE-capable PCIe cards or I/O modules) across both sets of ports on each controller,
before hot-adding the second shelf.
Before you begin
•You must have met the system requirements.
Requirements for a hot-add
•You must have enabled the ports on the RoCE-capable PCIe cards or I/O modules you
installed.
Prepare non-dedicated RoCE-capable ports for a hot-add
4

About this task
•Recabling port connections is a nondisruptive procedure when your shelf has multipath-HA
connectivity.
You recable the first shelf across both sets of ports on each controller so that when you hot-
add the second shelf, both shelves have more resilient connectivity.
•You move one cable at a time to maintain connectivity to the shelf at all times during this
procedure.
Steps
1. Recable the existing shelf’s connections across both sets of ports on each controller, as
applicable to your system.
Moving a cable does not require any wait time between unplugging the cable
from one port and plugging it into another port.
If you have an… Then…
DM7100F HA pair

If needed, you can reference cabling illustrations
showing an existing single shelf and the recabled
shelf, in a two shelf configuration.
Cable a hot-add shelf for a DM7100F HA pair
a. On controller A, move the cable from port e0d to slot 5 Port b
(e5b).
b. Repeat the same cable move on controller B.
DG7000 HA pair

If needed, you can reference cabling illustrations
showing an existing single shelf and the recabled
shelf, in a two shelf configuration.
Cable a hot-add shelf for a DG7000 HA pair
a. On controller A, move the cable from slot 4 port a (e4a) to slot 5
port b (e5b).
b. Repeat the same cable move on controller B.
2. Verify that the recabled shelf is cabled correctly.
1.3.3. Prepare to manually assign drive ownership for a hot-add
If you are manually assigning drive ownership for the DM240N drive shelf you are hot-adding, then
you need to disable automatic drive assignment if it is enabled.
5

Before you begin
You must have met the system requirements.
Requirements for a hot-add
About this task
You need to manually assign drive ownership if drives in the shelf will be owned by both controller
modules in the HA pair.
Steps
1. Verify whether automatic drive assignment is enabled: storage disk option show
You can enter the command on either controller module.
If automatic drive assignment is enabled, the output shows on in the Auto Assign column (for
each controller module).
2. If automatic drive assignment is enabled, disable it: storage disk option modify -node
node_name -autoassign off
You must disable automatic drive assignment on both controller modules.
1.4. Install a drive shelf for a hot-add
Installing a new DM240N drive shelf involves installing the shelf into a rack or cabinet, connecting
the power cords (which automatically powers on the shelf), and then setting the shelf ID.
Before you begin
•You must have met the system requirements.
Requirements for a hot-add
•You must have completed the applicable preparation procedures.
Prepare for a hot-add
Steps
1. Install the rail-mount kit that came with your shelf by using the installation flyer that came in the
kit box.
Do not flange-mount the shelf.
2. Install and secure the shelf onto the support brackets and rack or cabinet by using the
installation flyer.
6


A fully loaded DM240N shelf can weigh up to 66.78 lbs (30.29 kg) and
requires two people to lift or use of a hydraulic lift. Avoid removing shelf
components (from the front or rear of the shelf) to reduce the shelf weight,
because shelf weight will become unbalanced.
3. Connect the power cords to the shelf, secure them in place with the power cord retainer if they
are AC power supplies, or the two thumb screws if they are DC power supplies, and then
connect the power cords to different power sources for resiliency.
A shelf powers up when connected to a power source; it does not have power switches. When
functioning correctly, a power supply’s bicolored LED illuminates green.
4. Set the shelf ID to a number that is unique within the HA pair:
More detailed instructions are available:
Change a shelf ID - DM240N shelves
a. Remove the left end cap and locate the small hole to the right of the LEDs.
b. Insert the end of a paper clip or similar tool into the small hole to reach the shelf ID button.
c. Press and hold the button (for up to 15 seconds) until the first number on the digital display
blinks, and then release the button.
If the ID takes longer than 15 seconds to blink, press and hold the button
again, making sure to press it in all the way.
d. Press and release the button to advance the number until you reach the desired number
from 0 to 9.
e. Repeat substeps 4c and 4d to set the second number of the shelf ID.
It can take up to three seconds (instead of 15 seconds) for the number to blink.
f. Press and hold the button until the second number stops blinking.
After about five seconds, both numbers start blinking and the amber LED on the ODP
illuminates.
g. Power-cycle the shelf to make the shelf ID take effect.
You must unplug both power cords from the shelf, wait 10 seconds, and then plug them
back in.
When power is restored to the power supplies, their bicolored LEDs illuminate green.
7

1.5. Cable a drive shelf for a hot-add
You cable each DM240N drive shelf you are hot-adding so that each shelf has two connections to
each controller module in the HA pair. Depending on the number of shelves you are hot-adding and
your system, you use RoCE-capable ports on board the controllers, on RoCE-capable PCIe cards,
a combination of both, or on RoCE-capable I/O modules.
1.5.1. Considerations when cabling for a hot-add
Familiarizing yourself with proper cable connector orientation, and the location and labeling of ports
on the DM240N NSM drive shelf modules can be helpful before cabling your hot-added shelf.
•Cables are inserted with the connector pull-tab facing up.
When a cable is inserted correctly, it clicks into place.
After you connect both ends of the cable, the shelf and controller port LNK (green) LEDs
illuminate. If a port LNK LED does not illuminate, reseat the cable.
•You can use the following illustration to help you physically identify the shelf NSM ports, e0a
and e0b:
1.5.2. Cable a hot-add shelf for a DM5100F or DG5000 HA pair
When additional storage is needed, you can hot-add a DM240N drive shelf to a DM5100F HA pair.
Before you begin
•You must have met the system requirements.
8

Requirements for a hot-add
•You must have completed the applicable preparation procedures.
Prepare for a hot-add
•You must have installed the shelves, powered them on, and set the shelf IDs.
Install a drive shelf for a hot-add
About this task
When viewed from the rear of the chassis, the RoCE-capable card port on the left is port "a" (e1a)
and the port on the right is port "b" (e1b).
Steps
1. Cable the shelf connections:
a. Cable shelf NSM A port e0a to controller A slot 1 port a (e1a).
b. Cable shelf NSM A port e0b to controller B slot 1 port b (e1b).
c. Cable shelf NSM B port e0a to controller B slot 1 port a (e1a).
d. Cable shelf NSM B port e0b to controller A slot 1 port b (e1b).
The following illustration shows the shelf cabling when completed.
2. Verify that the hot-added shelf is cabled correctly.
3. If you disabled automatic drive assignment as part of the preparation for this procedure, you
need to manually assign drive ownership and then reenable automatic drive assignment, if
needed.
9

Otherwise, you are done with this procedure.
Complete the hot-add
1.5.3. Cable a hot-add shelf for a DM7100F HA pair
How you cable a DM240N drive shelf in a DM7100F HA pair depends on the number of shelves you
are hot-adding and the number of RoCE-capable port sets (one or two) you are using on the
controller modules.
Before you begin
•You must have met the system requirements.
Requirements for a hot-add
•You must have completed the applicable preparation procedures.
Prepare for a hot-add
•You must have installed the shelves, powered them on, and set the shelf IDs.
Install a drive shelf for a hot-add
Steps
1. If you are hot-adding one shelf using one set of RoCE-capable ports (onboard RoCE-capable
ports) on each controller module, and this is the only DM240N shelf in your HA pair, complete
the following substeps.
Otherwise, go to the next step.
a. Cable shelf NSM A port e0a to controller A port e0c.
b. Cable shelf NSM A port e0b to controller B port e0d.
c. Cable shelf NSM B port e0a to controller B port e0c.
d. Cable shelf NSM B port e0b to controller A port e0d.
The following illustration shows cabling for one hot-added shelf using one set of RoCE-
capable ports on each controller module:
10

2. If you are hot-adding one or two shelves using two sets of RoCE-capable ports (on board and
PCIe card RoCE-capable ports) on each controller module, complete the following substeps.
Shelves Cabling
Shelf 1 a. Cable NSM A port e0a to controller A port e0c.
b. Cable NSM A port e0b to controller B slot 5 port 2 (e5b).
c. Cable NSM B port e0a to controller B port e0c.
d. Cable NSM B port e0b to controller A slot 5 port 2 (e5b).
e. If you are hot-adding a second shelf, complete the “Shelf 2”
substeps; otherwise, go to step 3.
Shelf 2 a. Cable NSM A port e0a to controller A slot 5 port 1 (e5a).
b. Cable NSM A port e0b to controller B port e0d.
c. Cable NSM B port e0a to controller B slot 5 port 1 (e5a).
d. Cable NSM B port e0b to controller A port e0d.
e. Go to step 3.
The following illustration shows cabling for two hot-added shelves:
11

3. Verify that the hot-added shelf is cabled correctly.
4. If you disabled automatic drive assignment as part of the preparation for this procedure, you
need to manually assign drive ownership and then re enable automatic drive assignment, if
needed.
Otherwise, you are done with this procedure.
Complete the hot-add
1.5.4. Cable a hot-add shelf for a DG7000 HA pair
How you cable a DM240N drive shelf in a DG7000 HA pair depends on the number of shelves you
are hot-adding and the number of RoCE-capable port sets (one or two) you are using on the
controller modules.
Before you begin
•You must have met the system requirements.
Requirements for a hot-add
•You must have completed the applicable preparation procedures.
Prepare for a hot-add
•You must have installed the shelves, powered them on, and set the shelf IDs.
Install a drive shelf for a hot-add
12

Steps
1. If you are hot-adding one shelf using one set of RoCE-capable ports on each controller module,
and this is the only DM240N shelf in your HA pair, complete the following substeps.
Otherwise, go to the next step.
a. Cable shelf NSM A port e0a to controller A slot 4 port 1 (e4a).
b. Cable shelf NSM A port e0b to controller B slot 4 port 2 (e4b).
c. Cable shelf NSM B port e0a to controller B slot 4 port 1 (e4a).
d. Cable shelf NSM B port e0b to controller A slot 4 port 2 (e4b).
The following illustration shows cabling for one hot-added shelf using one set of RoCE-
capable ports on each controller module:
2. If you are hot-adding one or two shelves using two sets of RoCE-capable ports on each
controller module, complete the following substeps.
Shelves Cabling
Shelf 1 a. Cable NSM A port e0a to controller A slot 4 port 1 (e4a).
b. Cable NSM A port e0b to controller B slot 5 port 2 (e5b).
c. Cable NSM B port e0a to controller B port slot 4 port 1 (e4a).
d. Cable NSM B port e0b to controller A slot 5 port 2 (e5b).
e. If you are hot-adding a second shelf, complete the “Shelf 2”
substeps; otherwise, go to step 3.
13

Shelves Cabling
Shelf 2 a. Cable NSM A port e0a to controller A slot 5 port 1 (e5a).
b. Cable NSM A port e0b to controller B slot 4 port 2 (e4b).
c. Cable NSM B port e0a to controller B slot 5 port 1 (e5a).
d. Cable NSM B port e0b to controller A slot 4 port 2 (e4b).
e. Go to step 3.
The following illustration shows cabling for two hot-added shelves:
3. Verify that the hot-added shelf is cabled correctly.
4. If you disabled automatic drive assignment as part of the preparation for this procedure, you
need to manually assign drive ownership and then re enable automatic drive assignment, if
needed.
Otherwise, you are done with this procedure.
Complete the hot-add
1.6. Complete the hot-add
If you disabled automatic drive assignment as part of the preparation for the DM240N drive shelf
hot-add, you need to manually assign drive ownership and then reenable automatic drive
assignment if needed.
14

Before you begin
You must have already cabled your shelf as instructed for your HA pair.
Cable a drive shelf for a hot-add
Steps
1. Display all unowned drives: storage disk show -container-type unassigned
You can enter the command on either controller module.
2. Assign each drive: storage disk assign -disk disk_name -owner owner_name
You can enter the command on either controller module.
You can use the wild card character to assign more than one drive at once.
3. Reenable automatic drive assignment if needed: storage disk option modify -node node_name
-autoassign on
You must reenable automatic drive assignment on both controller modules.
15

Chapter 2. Appendix
2.1. Contacting support
You can contact Support to obtain help for your issue.
You can receive hardware service through a Lenovo Authorized Service Provider. To locate a
service provider authorized by Lenovo to provide warranty service, go to Lenovo Authorized
Service Providers Web site and use filter searching for different countries. For Lenovo support
telephone numbers, see Support Phone List for your region support details.
2.2. Notices
Lenovo may not offer the products, services, or features discussed in this
document in all countries. Consult your local Lenovo representative for
information on the products and services currently available in your area.
Any reference to a Lenovo product, program, or service is not intended to state or imply that only
that Lenovo product, program, or service may be used. Any functionally equivalent product,
program, or service that does not infringe any Lenovo intellectual property right may be used
instead. However, it is the user’s responsibility to evaluate and verify the operation of any other
product, program, or service.
Lenovo may have patents or pending patent applications covering subject matter described in this
document. The furnishing of this document is not an offer and does not provide a license under any
patents or patent applications. You can send inquiries in writing to the following:
Lenovo (United States), Inc.
8001 Development Drive
Morrisville, NC 27560
U.S.A.
Attention: Lenovo Director of Licensing
LENOVO PROVIDES THIS PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER
EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some
jurisdictions do not allow disclaimer of express or implied warranties in certain transactions,
therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are
periodically made to the information herein; these changes will be incorporated in new editions of
the publication. Lenovo may make improvements and/or changes in the product(s) and/or the
program(s) described in this publication at any time without notice.
The products described in this document are not intended for use in implantation or other life
support applications where malfunction may result in injury or death to persons. The information
contained in this document does not affect or change Lenovo product specifications or warranties.
16

Nothing in this document shall operate as an express or implied license or indemnity under the
intellectual property rights of Lenovo or third parties. All information contained in this document
was obtained in specific environments and is presented as an illustration. The result obtained in
other operating environments may vary.
Lenovo may use or distribute any of the information you supply in any way it believes appropriate
without incurring any obligation to you.
Any references in this publication to non-Lenovo Web sites are provided for convenience only and
do not in any manner serve as an endorsement of those Web sites. The materials at those Web
sites are not part of the materials for this Lenovo product, and use of those Web sites is at your
own risk.
Any performance data contained herein was determined in a controlled environment. Therefore, the
result obtained in other operating environments may vary significantly. Some measurements may
have been made on development-level systems and there is no guarantee that these
measurements will be the same on generally available systems. Furthermore, some measurements
may have been estimated through extrapolation. Actual results may vary. Users of this document
should verify the applicable data for their specific environment.
2.3. Trademarks
LENOVO, LENOVO logo, and THINKSYSTEM are trademarks of Lenovo. All
other trademarks are the property of their respective owners. © 2023 Lenovo.
17