Western Digital OpenFlex Data24 3200 User manual

User Guide
OpenFlex™ Data24 3200
FW Version 1.0.0
Regulatory Model: DCS0010
D018-000572-000
Doc. Version 01
September 2023

User Guide Table of Contents
Table of Contents
Revision History............................................................................................................................................................................................... v
Notices................................................................................................................................................................................................................... vi
Points of Contact.........................................................................................................................................................................................vii
Chapter 1. Overview.............................................................................................................. 1
OpenFlex™ Data24 3200 Overview..............................................................................................................................................2
Design Details.................................................................................................................................................................................................3
LEDs.............................................................................................................................................................................................................6
Cables.........................................................................................................................................................................................................9
Servicing Features.......................................................................................................................................................................... 10
List of Compatible Devices..................................................................................................................................................................11
Electrical Specifications.........................................................................................................................................................................13
Environmental Specifications............................................................................................................................................................ 13
Mechanical Specifications...................................................................................................................................................................14
System Level Block Diagram............................................................................................................................................................15
Best Practices...............................................................................................................................................................................................16
Limitations & Restrictions....................................................................................................................................................................18
Rack Requirements............................................................................................................................................................................... 20
Space Requirements................................................................................................................................................................................21
Supported Operating Systems........................................................................................................................................................ 21
Supported SKUs........................................................................................................................................................................................22
List of CRUs................................................................................................................................................................................................. 23
Third Party Licenses.............................................................................................................................................................................. 24
Chapter 2. Components................................................................................................... 25
Chassis..............................................................................................................................................................................................................26
Chassis Specifications................................................................................................................................................................26
IO Module (IOM) w/ Single AIC.....................................................................................................................................................27
i

User Guide Table of Contents
IOM Specifications w/ Single AIC.....................................................................................................................................27
IO Module (IOM) w/ Two AICs.......................................................................................................................................................28
IOM Specifications w/ Two AICs.......................................................................................................................................28
IO Module (IOM) w/ Three AICs...................................................................................................................................................29
IOM Specifications w/ Three AICs................................................................................................................................... 29
Drive Assembly...........................................................................................................................................................................................30
Drive Assembly Specifications.............................................................................................................................................30
System Fan.....................................................................................................................................................................................................31
System Fan Specifications.......................................................................................................................................................31
Gospower Power Supply Unit (PSU)......................................................................................................................................... 32
Gospower PSU Specifications..............................................................................................................................................32
Rails......................................................................................................................................................................................................................33
Rails Specification..........................................................................................................................................................................33
Cable Management Arm (CMA) Assembly.......................................................................................................................... 34
Cable Management Arm (CMA) Assembly Specifications.............................................................................34
Chapter 3. Support............................................................................................................ 35
Cable Management.................................................................................................................................................................................36
Standard OpenFlex Data24 3200 Cable Management...................................................................................36
OpenFlex Data24 3200 Cable Management Arm (CMA) Assembly Cable
Management...................................................................................................................................................................................... 36
Drive Assembly Replacement..........................................................................................................................................................38
System Fan Replacement................................................................................................................................................................... 41
IO Module (IOM) Replacement......................................................................................................................................................48
Power Supply Unit (PSU) Replacement..................................................................................................................................55
Chassis Replacement............................................................................................................................................................................60
Rails Replacement.....................................................................................................................................................................................81
Cable Management Arm (CMA) Assembly Replacement.........................................................................................94
Chapter 4. Management.................................................................................................103
Open Composable API.......................................................................................................................................................................104
ii

User Guide Table of Contents
Accessing the API.......................................................................................................................................................................104
RESTful API...................................................................................................................................................................................... 104
Discovering and Connecting to NVMe Devices using the Open Composable API....................104
Open Composable GUI...................................................................................................................................................................... 107
Compatible Browsers.................................................................................................................................................................107
Login Page........................................................................................................................................................................................ 108
Dashboard...........................................................................................................................................................................................110
Storage Device Page..................................................................................................................................................................116
Basic Operational Functions................................................................................................................................................122
Maintenance...................................................................................................................................................................................... 141
Firmware Upgrade..................................................................................................................................................................................150
Downloading Firmware from the Support Portal................................................................................................. 150
Upgrading Firmware................................................................................................................................................................... 153
Drive Firmware Upgrade.........................................................................................................................................................159
Platform Details Pullout Tab...........................................................................................................................................................160
In-band Enclosure Management..................................................................................................................................................161
NVMe-CLI.......................................................................................................................................................................................................161
Supported NVMe-CLI Commands..................................................................................................................................162
Unsupported NVMe Drive Level Commands..........................................................................................................162
Discovering and Connecting to ™ Devices on OpenFlex Data24 3200............................................162
Chapter 5. Configuration................................................................................................ 165
Device Installation Order...................................................................................................................................................................166
System Topology.....................................................................................................................................................................................169
Installing Standalone OpenFlex-api for In-Band Management............................................................................173
Initial Network Configuration Setup.......................................................................................................................................... 173
Initial Network Configuration..........................................................................................................................................................184
Setting Static IPs on Data Ports................................................................................................................................................ 184
In-Band Management Setup......................................................................................................................................................... 193
iii

User Guide Table of Contents
Installing Standalone OpenFlex-api for In-Band Management.................................................................193
Target IP Address Discovery Methods........................................................................................................................194
In-Band Management Usage.......................................................................................................................................................203
In-Band Management Path Connectivity.................................................................................................................204
Chapter 6. Safety.............................................................................................................220
Electrostatic Discharge.......................................................................................................................................................................221
Optimizing Location...............................................................................................................................................................................221
Power Connections................................................................................................................................................................................221
Power Cords................................................................................................................................................................................................221
Rack-Mountable Systems...............................................................................................................................................................222
Safety and Service................................................................................................................................................................................222
Safety Warnings and Cautions................................................................................................................................................... 223
Chapter 7. Regulatory.....................................................................................................224
Country Certifications......................................................................................................................................................................... 225
Electromagnetic Compatibility (EMC) Class A Compliance..................................................................................225
Restricted Access Location........................................................................................................................................................... 225
Regulatory Statement of Compliance....................................................................................................................................225
Europe (CE Declaration of Conformity)................................................................................................................................226
FCC Class A Notice.............................................................................................................................................................................226
ICES-003 Class A Notice—Avis NMB-003, Classe A...............................................................................................227
Japanese Compliance Statement, Class A ITE..............................................................................................................227
South Korea Warning Label Statement, Class A ITE.................................................................................................227
Taiwan Warning Label Statement, Class A ITE..............................................................................................................228
iv

User Guide Revision History
Revision History
Date Revision Comment
September
2023 01 Initial release for OpenFlex™ Data24 3200
v

User Guide Notices
Notices
Western Digital Technologies, Inc. or its affiliates' (collectively “Western Digital”) general policy does not
recommend the use of its products in life support applications wherein a failure or malfunction of the product
may directly threaten life or injury. Per Western Digital Terms and Conditions of Sale, the user of Western
Digital products in life support applications assumes all risk of such use and indemnifies Western Digital
against all damages.
This document is for information use only and is subject to change without prior notice. Western Digital
assumes no responsibility for any errors that may appear in this document, nor for incidental or consequential
damages resulting from the furnishing, performance or use of this material.
Absent a written agreement signed by Western Digital or its authorized representative to the contrary,
Western Digital explicitly disclaims any express and implied warranties and indemnities of any kind that may,
or could, be associated with this document and related material, and any user of this document or related
material agrees to such disclaimer as a precondition to receipt and usage hereof.
Each user of this document or any product referred to herein expressly waives all guaranties and warranties
of any kind associated with this document any related materials or such product, whether expressed or
implied, including without limitation, any implied warranty of merchantability or fitness for a particular purpose
or non-infringement. Each user of this document or any product referred to herein also expressly agrees
Western Digital shall not be liable for any incidental, punitive, indirect, special, or consequential damages,
including without limitation physical injury or death, property damage, lost data, loss of profits or costs of
procurement of substitute goods, technology, or services, arising out of or related to this document, any
related materials or any product referred to herein, regardless of whether such damages are based on tort,
warranty, contract, or any other legal theory, even if advised of the possibility of such damages.
This document and its contents, including diagrams, schematics, methodology, work product, and intellectual
property rights described in, associated with, or implied by this document, are the sole and exclusive
property of Western Digital. No intellectual property license, express or implied, is granted by Western Digital
associated with the document recipient's receipt, access and/or use of this document or the products
referred to herein; Western Digital retains all rights hereto.
Western Digital, the Western Digital design, the Western Digital logo, Ultrastar, and OpenFlex are registered
trademarks or trademarks of Western Digital Corporation or its affiliates in the US and/or other countries.
Linux® is the registered trademark of Linus Torvalds in the U.S. and other countries. Mellanox is a registered
trademark of NVIDIA Corporation. Microsoft is a trademark of the Microsoft group of companies. Mozilla
and Firefox are trademarks of the Mozilla Foundation in the US and other countries The NVMe word mark
is a trademark of NVM Express, Inc. All other marks are the property of their respective owners. Product
specifications subject to change without notice. Pictures shown may vary from actual products. Not all
products are available in all regions of the world.
Western Digital
5601 Great Oaks Parkway
San Jose, CA 95119
© 2023 Western Digital Corporation or its affiliates. All Rights Reserved.
vi

User Guide Points of Contact
Points of Contact
For further assistance with a Western Digital product, contact Western Digital Datacenter Platforms technical
support. Please be prepared to provide the following information, as applicable: part number (P/N), serial
number (S/N), product name and/or model number, software version, and a brief description of the issue.
Email:
[email protected]
Website:
https://portal.wdc.com/Support/s/
UK Import Representation Contact
Western Digital UK Limited
PO Box 471
Leatherhead KT22 2LU
UK
Telephone: [phone]
EU Import Representation Contact
Western Digital EU Limited
PO Box 13379
Swords, Co
Dublin, Ireland
vii

1
Overview
In This Chapter:
- OpenFlex Data24 3200 Overview............................................................................. 2
- Design Details....................................................................................................................3
- List of Compatible Devices......................................................................................... 11
- Electrical Specifications.............................................................................................. 13
- Environmental Specifications.................................................................................... 13
- Mechanical Specifications..........................................................................................14
- System Level Block Diagram.....................................................................................15
- Best Practices..................................................................................................................16
- Limitations & Restrictions...........................................................................................18
- Rack Requirements...................................................................................................... 20
- Space Requirements..................................................................................................... 21
- Supported Operating Systems................................................................................. 21
- Supported SKUs............................................................................................................ 22
- List of CRUs.................................................................................................................... 23
- Third Party Licenses.................................................................................................... 24

User Guide 1. Overview
1.1 OpenFlex ™ Data24 3200 Overview
1.1 OpenFlex™ Data24 3200 Overview
The OpenFlex™ Data24 3200 is a 2U rack mounted
data storage enclosure built on the OpenFlex
platform. OpenFlex Data24 3200 utilizes two IOMs to
provide data connectivity using QSFP28 connections
through Western Digital's RapidFlex add-in cards.
OpenFlex is Western Digital’s architecture that
supports Open Composable Infrastructure (OCI).
The OpenFlex Data24 3200 is a Just-a-Bunch-
Of-Flash (JBOF) platform that leverages this OCI
approach in the form of disagreggated data storage
using NVMe-over-Fabrics (NVMe-oF™). NVMe-oF
is a networked storage protocol that allows storage to be disaggregated from compute to make that storage
widely available to multiple applications and hosts. By enabling applications to share a common pool of
storage capacity, data can be easily shared between applications, or needed capacity can be allocated to
an application regardless of location. Utilizing NVMe™ device-level performance, NVMe-oF promises to
deliver the lowest end-to-end latency from application to shared storage. NVMe-oF enables composable
infrastructures to deliver the data locality benefits of NVMe (low latency, high performance) while providing
the agility and flexibility of sharing storage and compute.
OpenFlex
OpenFlex is Western Digital’s
architecture that supports Open
Composable Infrastructure
through storage disaggregation
– both disk and flash natively
attached to a scalable fabric.
OpenFlex does not rule out
multiple fabrics, but whenever
possible, Ethernet will be used
as a unifying connection for both
flash and disk because of its
broad applicability and availability.
Composable Infrastructure
An emerging category of
datacenter infrastructure that
seeks to disaggregate compute,
storage, and networking fabric
resources into shared resource
pools that can be available
for on-demand allocation (i.e.,
“composable”). Composability
occurs at the software level,
disaggregation occurs at the
hardware level using NVMe-
over-Fabric—will vastly improve
compute and storage utilization,
performance, and agility in the
data center.
Open Composable API
Western Digital's Open
Composable API is a REST
interface designed for data
center composability. It builds
upon existing industry standards
utilizing the best features of those
standards as well as practices
from proprietary management
protocols.1
Features
• 368TB Max Storage Capacity2 • 200 - 240Vac Input Voltages • Dual 2000W PSUs
• 100Gbps NVMe-oF • 2U Form Factor • Operational Temperature: 10°C to
35°C
• 29.7 kg / 65.5 lbs.
2

User Guide 1. Overview
1.2 Design Details
1.2 Design Details
On the front of the OpenFlex Data24 3200 there are the 24 Small Form Factor (SFF) drive slots, and the
enclosure status LEDs. Each drive is individually removable/serviceable. Below each drive slot is a status
and activity LED embedded in the chassis. For more details, see the LEDs (page 6) section.
The rear of the platform contains the Power Supply Units (PSUs) and IO Modules (IOMs). The System Fans
are accessible from the top of the unit via a latch cover, which can be accessed by extending the unit out of
the rack. All of these components are hot-swappable and do not require tools to replace.
Note: The right port in the add-in card(s) is populated with a plug and is disabled. The left port
on the add-in card(s) port is enabled for QSFP28 connection.
Figure 3: Single AIC Configuration
3

User Guide 1. Overview
1.2 Design Details
Figure 4: Two AIC Configuration
Figure 5: Three AIC Configuration
Each IOM contains a Reset Pinhole that will factory reset the enclosure if it is pressed for more than three
seconds. The enclosure automatically restarts when the reset completes. Use of the Reset Pinhole is not
recommended in Low Power Mode. Both of the systems IOMs will be factory reset when initiating the reset
using the Reset Pinhole on a single IOM.
4

User Guide 1. Overview
1.2 Design Details
The enclosure measures 450 mm/17.72 in. wide by 711.2 mm/28 in. long. The height is 90 mm/3.54 in. or 2U.
5

User Guide 1. Overview
1.2 Design Details
1.2.1 LEDs
The OpenFlex Data24 3200 contains LEDs on the enclosure, PSU, system fans, drive slots, and the IOMs.
This section defines the LED name, corresponding color, and the behavior of each of the LEDs on the
system.
Enclosure LEDs
Figure 6: Enclosure LEDs (displaying three AIC configuration)
Table 2: Enclosure LED Flash Patterns
LED Name LED Icon Color Behavior
Identification White
Blink @ 1 Hz: Blinks only when
Identification has been activated.
Off: Enclosure not being identified/
located
Service Blue No LED behaviour (unused)
Fault Amber Solid: Enclosure has a fault
Off: Enclosure has no fault
Power Green
Blink @ 1Hz: Enclosure is booting
3Hz Quick Flash: Enclosure is in low-
power mode.
Solid: Enclosure is powered on
Off: Enclosure is in a degraded or
warning state
6

User Guide 1. Overview
1.2 Design Details
Power Supply Unit (PSU) LED
Figure 7: Power Supply Unit (PSU) LED
Table 3: Power Supply Unit (PSU) LED Flash Patterns
LED Name Color Behavior
Green
Solid: PSU is on and reporting no faults
Blinking @ 2Hz: PSU in firmware update mode
Blinking @ 3Hz: PSU is in Low Power Mode
Off: PSU is disconnected from power
Multi-function LED
Amber
Solid: PSU is disconnected from power or critical
fault causing a shutdown failure
Blinking @ 0.5Hz: PSU reporting warnings
Off: PSU is reporting no faults
System Fan LED
Figure 8: System Fan LED
7

User Guide 1. Overview
1.2 Design Details
Table 4: System Fan LED Flash Patterns
LED Name Color Behavior
LED Amber
Solid: Critical Failure
Blinking @ 2 Hz: Fan is reporting a fault
Off: Fan is on and reporting no faults
Drive Assembly LED
Figure 9: Drive Assembly LED
Table 5: Drive Assembly LED Flash Patterns
LED Name Color Behavior
Status Green/Amber
Green: Device is Powered On
Flashing Green: Activity
Amber: Device has fault
Off: Device is Powered Down
8

User Guide 1. Overview
1.2 Design Details
IO Module (IOM) LEDs
Figure 10: IO Module (IOM) LEDs
Table 6: IOM LEDs Flash Patterns
LED Name Color/Number Behavior
RJ45 Management Port
Ethernet Link/Activity Green
Off: No Connection
Solid: Connected
Blink: Activity
RJ45 Management
Port Ethernet Speed
Bi-color
Green/Amber
Off: Operating at 10 Mbps
Solid Green: Operating at 100Mbps
Solid Amber: Operating at 1000Mbps
1 - QSFP28
(left port)
2 - QSFP28 (right
port - unused)
Green Blinking:Activity
Off:No Activity
3 - Firmware
State
Amber: Boot Sequence Started or Action
Required
Green: Firmware Up with No Errors
QSFP28
4 - Hardware and
Management
State
Green: Operational
Off: Off
Power Green Solid: IOM is powered on
Off: IOM is powered off
Service State (unused) Blue N/A
Fault Amber Solid: Enclosure has a fault
Off: IOM has no fault
9

User Guide 1. Overview
1.2 Design Details
1.2.2 Cables
The following table displays the CRU power cables available from Western Digital:
Table 7: Available CRU Power Cables
Type Part Number Length
IEC C13 to IEC C14 Heavy
Duty 15A Power Cable
1EX1530 (Provided
in Accessory Kit) 3m
The following table displays the CRU Ethernet cables available from Western Digital:
Table 8: Available CRU Ethernet Cables
Vendor Active/Passive Vendor Model Number Western Digital
Part Number
Mellanox® Ethernet
100GbE,
100Gb/s, QSFP,
PVC, 3m 28AWG
Passive MCP1600-C003 1EX2705
The following table displays additional Ethernet cables qualified by Western Digital:
Table 9: Qualified Direct Attached Cables
Vendor Active/
Passive Vendor Model Number
Mellanox QSFP28 to QSFP28 Cable, 1m 30AWG Passive MCP1600-C001E30N
Mellanox QSFP28 to QSFP28 Cable, 2m 30AWG Passive MCP1600-C002E30N
Mellanox QSFP28 to QSFP28 Cable, 3m 30AWG Passive MCP1600-C003E30L
Mellanox QSFP28 to QSFP28 Cable, 5m 26AWG Passive MCP1600-C005E26L
Mellanox QSFP28 to QSFP28 Cable, 5m 26AWG Active MFA1A00-C005
Mellanox QSFP28 to QSFP28 Cable, 10m, AOC Active MFA1A00-C010-AO
Amphenol 100G/200G, QSFP28Gb 30AWG, 1m Passive NDAAFF-0001
Amphenol 100G/200G, QSFP28Gb 30AWG, 1.5m Passive NDAAFF-0006
Amphenol 100G/200G, QSFP28Gb 30AWG, 2m Passive NDAAFF-0002
Amphenol 100G/200G, QSFP28Gb 30AWG, 3m Passive NDAAFF-0003
Amphenol QSFP28Gb 26AWG, 5m Passive NDAAFJ-0004
1.2.3 Servicing Features
Toolless Servicing
All internal system components can be serviced without any additional tools.
10

User Guide 1. Overview
1.3 List of Compatible Devices
All System Fans can be removed via an access panel on the top of the system. Each fan has a housing
that can be used to safely remove it during servicing.
Power Supply Units (PSUs) and IO Modules (IOMs) can be accessed from the rear, and have toolless
latching mechanisms.
All Drive Assemblies can be hot swapped from the cold-aisle using built-in drive carrier latches.
1.3 List of Compatible Devices
Table 10: Western Digital Device List
Device Volume3Max
Bandwidth4Drive Writes Encryption Drive Firmware
Part
Number
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
1.6 TB 3.3GB/s RI-3DW/D SE R2210801 1EX2708
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
1.92 TB 3.3GB/s RI-1DW/D SE R2210801 1EX2753
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.2 TB 3.3GB/s RI-3DW/D SE R2210801 1EX2754
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.2 TB 3.3GB/s RI-3DW/D ISE R2210801 1EX2924
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.2 TB 3.3GB/s RI-3DW/D TCG R2210400 1EX2832
Western® Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.84 TB 3.3GB/s RI-1DW/D SE R2210801 1EX2706
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.84 TB 3.3GB/s RI-1DW/D ISE R2210801 1EX2925
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.84 TB 3.3GB/s RI-1DW/D TCG R2210400 1EX2829
3. One terabyte (TB) is equal to one trillion bytes. Actual user capacity may be less due to operating environment.
4. Sequential read bandwidth, 64KiB block size. Based on internal testing. Performance will vary by capacity point, or with
changes in useable capacity. All measurements are in full sustained mode and are peak values. Subject to change.
11

User Guide 1. Overview
1.3 List of Compatible Devices
Device Volume3Max
Bandwidth4Drive Writes Encryption Drive Firmware
Part
Number
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
3.84 TB 3.3GB/s RI-1DW/D TCG-
FIPS R2210400 1EX2968
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
6.4 TB 3.3GB/s RI-3DW/D SE R2210801 1EX2794
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
6.4 TB 3.3GB/s RI-3DW/D ISE R2210801 1EX2926
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
6.4 TB 3.3GB/s RI-3DW/D TCG R2210400 1EX2833
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
7.68 TB 3.3 GB/s RI-1DW/D SE R2210801 1EX2707
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
7.68 TB 3.3 GB/s RI-1DW/D ISE R2210801 1EX2927
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
7.68 TB 3.3 GB/s RI-1DW/D TCG R2210400 1EX2830
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
7.68 TB 3.3 GB/s RI-1DW/D TCG-
FIPS R2210400 1EX2923
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
15.36 TB 3.3 GB/s RI-1DW/D SE R2210801 1EX2709
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
15.36 TB 3.3 GB/s RI-1DW/D ISE R2210801 1EX2928
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
15.36 TB 3.3 GB/s RI-1DW/D TCG R2210400 1EX2831
Western Digital
Ultrastar DC
SN840 SSD w/ Carrier
15.36 TB 3.3 GB/s RI-1DW/D TCG-
FIPS R2210400 1EX2852
3. One terabyte (TB) is equal to one trillion bytes. Actual user capacity may be less due to operating environment.
4. Sequential read bandwidth, 64KiB block size. Based on internal testing. Performance will vary by capacity point, or with
changes in useable capacity. All measurements are in full sustained mode and are peak values. Subject to change.
12