HGST Ultrastar Data102 User manual

User Guide
Ultrastar® Data102
Regulatory Model: H4102-J
June 2019
Rev. 1.11
1ET1094
Long Live Data ™ | www.hgst.com

User Guide Table of Contents
Table of Contents
Revision History.......................................................................................vii
Copyright...................................................................................................ix
Chapter 1 Overview.............................................................................1
1.1 Ultrastar® Data102 Description.........................................................1
1.2 System Architecture Overview............................................................2
1.3 System Level Block Diagram..............................................................2
1.4 Ultrastar Data102 Specification Summary..........................................3
1.5 Ultrastar Data102 Layout....................................................................5
1.6 List of Customer Replaceable Units (CRUs)...................................... 7
1.7 LEDs................................................................................................... 8
1.7.1 Front and Rear IO LEDs.............................................................8
1.7.2 IOM LEDs..................................................................................11
1.7.3 IOM Fan LED............................................................................ 12
1.7.4 PSU LED...................................................................................13
1.7.5 Rear Fan LED........................................................................... 14
1.7.6 Drive Assembly LED................................................................. 15
1.8 Supported SKUs............................................................................... 16
1.9 List of Compatible Drives................................................................. 17
Chapter 2 System Management Overview...................................... 27
2.1 Firmware Features Overview.......................................................... 27
2.2 OOBM Management Overview.........................................................28
2.3 SCSI Enclosure Services Page 02...................................................28
i

User Guide Table of Contents
Chapter 3 Component Overviews....................................................29
3.1 Chassis Description.......................................................................... 29
3.1.1 Chassis Specifications.............................................................. 30
3.1.2 Chassis Layout..........................................................................30
3.2 IOM Description................................................................................ 32
3.2.1 IOM Specifications.................................................................... 33
3.2.2 IOM Layout................................................................................34
3.2.3 IOM Blank Description.............................................................. 36
3.3 PSU Description................................................................................37
3.3.1 PSU Specifications....................................................................37
3.3.2 PSU Layout............................................................................... 38
3.4 Rear Fan Description........................................................................40
3.4.1 Rear Fan Specifications............................................................40
3.4.2 Rear Fan Layout....................................................................... 40
3.5 IOM Fan Description.........................................................................41
3.5.1 IOM Fan Specifications.............................................................42
3.5.2 IOM Fan Layout........................................................................ 43
3.6 Rails Description...............................................................................43
3.6.1 Rails Specifications................................................................... 44
3.6.2 Rails Layout.............................................................................. 45
3.6.3 Rear Cover Alignment Bracket Description...............................46
3.7 CMA Description...............................................................................46
3.7.1 CMA Specifications................................................................... 47
3.7.2 CMA Layout.............................................................................. 48
ii

User Guide Table of Contents
3.7.3 CMA Cable Tray........................................................................50
3.8 Drive Assembly Description..............................................................50
3.8.1 Drive Assembly Specifications.................................................. 51
3.8.2 Drive Assembly Layout............................................................. 51
3.8.3 2.5" Drive Carrier Description................................................... 53
3.8.4 Drive Blank Description.............................................................56
Chapter 4 Part Replacement............................................................ 58
4.1 Part Replacement Service Window.................................................. 58
4.2 IOM Replacement.............................................................................58
4.3 PSU Replacement............................................................................ 64
4.4 Rear Fan Replacement.................................................................... 70
4.5 IOM Fan Replacement..................................................................... 74
4.6 Drive Assembly Replacement...........................................................77
4.7 CMA Standard Replacement............................................................ 83
4.8 CMA Lite Replacement.....................................................................98
4.9 Rails Replacement..........................................................................111
4.10 Chassis Replacement................................................................... 150
4.11 Special Considerations for Cable Routing.................................... 201
Chapter 5 System Management..................................................... 205
5.1 Firmware Upgrade.......................................................................... 205
5.1.1 Downloading Firmware from the Support Portal..................... 205
5.1.2 Linux Upgrade Preparation..................................................... 207
5.1.3 Linux Upgrade to New Firmware............................................ 210
5.1.4 Non-Automatic Firmware Activation in Linux.......................... 212
iii

User Guide Table of Contents
5.1.5 Windows Upgrade Preparation............................................... 213
5.1.6 Windows Upgrade to New Firmware...................................... 216
5.1.7 Non-Automatic Firmware Activation in Windows.....................218
5.1.8 Upgrading Firmware with OOBM............................................ 222
5.2 Configuring OOBM Network Settings............................................. 224
5.2.1 Configuring OOBM Network Settings Using SES................... 224
5.3 Zoning............................................................................................. 227
5.3.1 Before Zoning..........................................................................227
5.3.2 Predefined Zoning Configurations...........................................227
5.3.3 sg_senddiag Command.......................................................... 234
5.3.4 Enabling Zoning using Linux...................................................236
5.3.5 Disabling Zoning using Linux.................................................. 239
5.3.6 Enabling Zoning using Windows.............................................243
5.3.7 Disabling Zoning using Windows............................................ 247
5.4 Partially Populated Enclosures....................................................... 251
5.4.1 Partial Population Configurations............................................251
5.4.2 Installing Drives....................................................................... 254
5.5 Daisy Chaining................................................................................258
5.5.1 Daisy Chaining Configurations................................................258
5.5.2 One Host Cable Configurations.............................................. 261
5.5.3 Two Host Cable Configurations.............................................. 267
5.5.4 Cabling for Daisy Chaining..................................................... 274
6.1 Drives missing in the system management.................................... 281
Chapter 7 Safety.................................................................................. 1
iv

User Guide Table of Contents
7.1 Electrostatic Discharge....................................................................... 1
7.2 Optimizing Location............................................................................ 1
7.3 Power Connections.............................................................................1
7.4 Power Cords....................................................................................... 2
7.5 Rackmountable Systems.................................................................... 2
7.6 Safety and Service............................................................................. 3
7.7 Safety Warnings and Cautions........................................................... 3
Chapter 8 Disclaimers.........................................................................5
8.1 Restricted Access Location................................................................ 5
8.2 Safety Compliance..............................................................................5
8.3 Electromagnetic Compatibility (EMC) Class A Compliance................5
8.4 Country Certifications..........................................................................6
Chapter 9 Regulatory Statements......................................................7
9.1 Europe (CE Declaration of Conformity).............................................. 7
9.2 FCC Class A Notice........................................................................... 7
9.3 ICES-003 Class A Notice—Avis NMB-003, Classe A.........................7
9.4 Japanese Compliance Statement, Class A ITE..................................8
9.5 Taiwan Warning Label Statement, Class A ITE..................................8
Chapter 10 Points of Contact.............................................................9
11.1 Site and System Operation Requirements......................................10
11.1.1 Power Requirements............................................................... 10
11.1.2 Supported Operating Systems................................................ 10
11.1.3 Ultrastar Data102 Rack Requirements....................................11
11.1.4 ESD......................................................................................... 14
v

User Guide Table of Contents
11.1.5 Enclosure Cooling................................................................... 14
11.1.6 Host Connectivity.....................................................................15
vi

User Guide Revision History
Revision History
Date Revision Comment
November
2017
Revision 1.0 Initial Release
November
2017
Revision 1.1 •The crossbar on the CMA was changed. See CMA
Description (page 46).
•Removed Lowline power specs from Power Requirements
(page 10).
•Changed required rack depth, see Required Rack Depth
(page 5).
•Changed typical power consumption, see Typical Power
Consumption (page 4).
•Updated LED Flash Patterns, see LEDs (page 8).
December
2017
Revision 1.2 •Added active cable support
•Added firmware upgrade section. See Firmware Upgrade
(page 205).
•Updated the Non-Op altitude specification. See Non-
Operational Altitude (page 3).
January 2018 Revision 1.21 Updated the product name
January 2018 Revision 1.3 •Updated information on the 2.5" drive carrier option. See 2.5"
Drive Carrier Description (page 53).
•Added torque requirements for all screws used in the
enclosure.
•Updated the IOM replacement section to account for the
possibility of a firmware mismatch. See IOM Replacement
(page 58).
•Updated the drive assembly installation instructions to clarify
the orientation of the drive assemblies. Drive Assembly
Replacement (page 77).
April 2018 Revision 1.4 •Updated Compatible Drives List. See List of Compatible
Drives (page 17).
•Updated the Rack Requirements. See Ultrastar Data102
Rack Requirements (page 11).
•Updated the Firmware Upgrades. See: Firmware Upgrade
(page 205)
May 2018 Revision 1.5 Added the Part Replacement Service Window. See: Part
Replacement Service Window (page 58)
vii

User Guide Revision History
Date Revision Comment
June 2018 Revision 1.6 •Updated Compatible Drives List. See List of Compatible
Drives (page 17)
•Updated the Firmware Upgrade section. See Firmware
Upgrade (page 205)
•Updated the Firmware Download section. See Downloading
Firmware from the Support Portal (page 205)
•Updated the System Architecture Overview section. See
System Architecture Overview (page 2)
•Updated the Daisy Chaining section. See Daisy Chaining
(page 258)
•Added the Rear Cover Alignment Bracket Description. See
Rear Cover Alignment Bracket Description (page 46)
November
2018
Revision 1.7 •Updated the images in the Daisy Chaining section. See Daisy
Chaining (page 258)
•Updated List of CRUs. See List of Customer Replaceable
Units (CRUs) (page 7)
•Updated Compatible Drives List. See List of Compatible
Drives (page 17)
•Updated the Host Connectivity section. See: Host
Connectivity (page 15)
May 2019 Revision 1.8 •Changed senddiag commands from images to codeblocks.
See sg_senddiag Command (page 234).
•Updated daisy-chaining tables to match diagrams. See Two
Host Cable Configurations (page 267).
•Corrected OOBM zoning configuration instructions. See
Predefined Zoning Configurations (page 227).
•Added Configuring OOBM Network Settings (page 224).
May 2019 Revision 1.9 •Corrected explanation of SATA configuration in Firmware
Upgrade (page 205) section.
June 2019 Revision 1.10 •Updated the Host Connectivity section. See: Host
Connectivity (page 15)
•
•Added Windows syntax examples and reorganized the
Upgrading Firmware with OOBM (page 222) section
June 2019 Revision 1.11 Updated the Host Connectivity section. See: Host Connectivity
(page 15)
viii

User Guide Copyright
Copyright
The following paragraph does not apply to the United Kingdom or any country where such
provisions are inconsistent with local law: HGST a Western Digital company PROVIDES THIS
PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED,
INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY OR
FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer or express or
implied warranties in certain transactions, therefore, this statement may not apply to you.
This publication could include technical inaccuracies or typographical errors. Changes are periodically
made to the information herein; these changes will be incorporated in new editions of the publication.
HGST may make improvements or changes in any products or programs described in this publication
at any time.
It is possible that this publication may contain reference to, or information about, HGST products
(machines and programs), programming, or services that are not announced in your country. Such
references or information must not be construed to mean that HGST intends to announce such HGST
products, programming, or services in your country.
Technical information about this product is available by contacting your local HGST representative or
on the Internet at: [email protected]
HGST may have patents or pending patent applications covering subject matter in this document. The
furnishing of this document does not give you any license to these patents.
Copyright © 2017-2019 Western Digital Corporation or its affiliates.
Western Digital
5601 Great Oaks Parkway
San Jose, CA 95119
Long Live Data™ is a trademark of HGST, Inc. and its affiliates in the United States and/or other
countries.
HGST trademarks are authorized for use in countries and jurisdictions in which HGST has the right to
use, market and advertise the brands.
Other product names are trademarks or registered trademarks of their respective owners.
One MB is equal to one million bytes, one GB is equal to one billion bytes, one TB equals 1,000GB
(one trillion bytes) and one PB equals 1,000TB when referring to storage capacity. Usable capacity
will vary from the raw capacity due to object storage methodologies and other factors.
References in this publication to HGST products, programs or services do not imply that HGST
intends to make these available in all countries in which HGST operates.
Product information is provided for information purposes only and does not constitute a warranty.
Information is true as of the date of publication and is subject to change. Actual results may vary. This
publication is for general guidance only. Photographs may show design models.
ix

User Guide
1. Overview
1.1 Ultrastar® Data102 Description
1 Overview
This section provides a high level overview of the features of the Ultrastar Data102.
1.1 Ultrastar® Data102 Description
Figure 1: Ultrastar Data102
The Ultrastar® Data102 is a 4U form factor, high availability, high density, rack-mounted storage
enclosure that is capable of hosting up to 102 SAS or SATA drives. The maximum data storage
capacity of the Ultrastar Data102 is 1.428 PB using 14TB HGST Ultrastar® HC530 drives . (For a
full list of compatible drives and total storage capacities, see the List of Compatible Drives (page
17).) The enclosure runs on an input voltage of 200 - 240 VAC and consumes ~1300W of power
under typical conditions. It requires a maximum of ~1600W at full load.
Note: Max and typical power consumption values represent the output power to the system.
Input power will vary depending on the PSU efficiency and load sharing between PSUs
It is designed to fit within a 4U rack space and requires 1181-1197 mm (46.5in. - 47.13in.) of usable
rack space, frame to frame. A fully loaded system will add 118.8 kg / 262 lbs. of static load when fully
loaded with drives.
•4U Storage Enclosure
•Supports up to 102 Drives
•Can support 3.5” drives and 2.5” SSD drives (2.5" requires an adapter) in the 102 available drive
bays.
•Up to 12W per drive slot for the 102 data storage drives (Cannot exceed 85A on the 5V rail)
•House and control four (4) N+1 redundant 80mm rear fans
•House and control a dual rotor 40mm internal IOM Fan
1

User Guide
1. Overview
1.2 System Architecture Overview
•Controlled by two (2) redundant I/O Modules *
•Powered by two (2) redundant 1600W PSUs
•Full high availability with independent dual paths to all HDDs
•Toolless replacement of all Customer Replaceable Units (CRUs)
•Fits within a standard EIA-310 rack including all necessary cable management (see:
Compatible Rack Hardware Configuration (page 12))
•Supports up to 3m passive SAS cables (limited to 3m or less) or active cables (any length)
•Supports High line (220-240 VAC) Input Power
1.2 System Architecture Overview
The Ultrastar Data102 IOM uses a cascaded expander design to allow for connection to all 102
drives. A 48-port primary expander connects with the six host ports, has a x3 link to the other IOM
for IOM-IOM communication and syncing, and also has a x10 SAS link to each secondary expander.
Each secondary expander then connects with fifty-one (51) drives.
The out-of-band management microprocessor provides an Ethernet connection using a Redfish/
RESTful API to access the various enclosure services. All the SES enclosure information can
be obtained through the out-of-band management port. Major use cases for this feature include
obtaining storage subsystem health information, locating enclosure components using the IDENT
LEDs, and updating firmware.
The system FPGAs control and report the states of the system fans, enclosure LEDs, connector
LEDs, drive LEDs, and T10 drive power disable signals on the 102 data storage drives.
Note: To use T10 power disable, the drives installed must also support this feature.
The I2C architecture is designed to support only one single master on any given bus. The primary
expander will be the master on each I2C bus. There are eight I2C buses used in the Ultrastar
Data102 enclosure. The number of devices on each bus are balanced to allow communication to
peripheral devices and not overload any one bus. The devices connected on the I2C buses include
the enclosure VPDs, temp sensors, baseboard FPGAs, and SAS connectors among others.
1.3 System Level Block Diagram
The following image shows the system block diagram for the Ultrastar Data102. .
* SATA based models will only include 1 IOM
2

User Guide
1. Overview
1.4 Ultrastar Data102 Specification Summary
Figure 2: System Block Diagram
1.4 Ultrastar Data102 Specification Summary
Table 1: Environmental Specification
Specification Non-Operational Operational
Temperature -40°C to 70°C 5°C to 35°C
Temperature Gradient 30°C per hour max 20°C per hour max
Temperature De-rating 1°C per 300m above 3000m 1°C per 300m above 900m
Relative Humidity 8-90% Non-Condensing 8-90% Non-Condensing
Relative Humidity
Gradient
30% per hour maximum 30% per hour maximum
Altitude -300m to 12,000m / -984 ft. to
39,370 ft
-300m to 3048m / -984 ft. to
10,000 ft.
3

User Guide
1. Overview
1.4 Ultrastar Data102 Specification Summary
Table 2: Electrical Specifications
Specification Value
Max Power Consumption ~1600W
Typical Power Consumption
Note: Max and typical power consumption
values represent the output power to the
system. Input power will vary depending
on the PSU efficiency and load sharing
between PSUs
~1300W
Input Voltage 200 - 240 VAC
PSU Connector Type C14
Inrush Current Maximum (per PSU) AC line inrush current shall not exceed 40A
peak, for up to one-quarter of the AC cycle after
which, the input current should be no more than
the specified maximum input current.
PSU Efficiency 80 PLUS Platinum
Caution: The Ultrastar Data102 can only be plugged into highline. If the unit is plugged into
lowline, the PSU will report a "Critical" state when status pages are queried using SES. In this
case, the enclosure will power up, but the drives will not. The enclosure will remain in low-
power mode.
Table 3: Mechanical Specifications
Specification Non-Operational Operational
Shock 10G, 0 - peak,11ms half sine; 3
positive and 3 negative pulses
in each axis Shock
5G, 0 - peak, 11ms half sine;
3 positive and 3 negative
pulses in each axis- minimum
6 seconds between shocks to
allow for write/read recovery
Vibration 0.75G, 0 - peak swept sine; 5
-500Hz; 1 complete sweep @
1/2 octave per minute
0.10G,0 - peak swept sine; 5
-500Hz; 1 complete sweep @
1/2octave per minute
Weight 118.8 kg / 262 lbs.
Dimensions with CMA W: 447mm x L: 1197 mm x H: 175mm / W: 17.6in. x L: 47.13in. x
H: 6.89in.
Length without CMA 1026 mm / 40.39in.
Required Rack Width 450mm with (17.72in.) with 465mm (18.31in.) ± 1.5mm nominal
hole spacing. See EIA-310 Rack Standard
4

User Guide
1. Overview
1.5 Ultrastar Data102 Layout
Specification Non-Operational Operational
Required Rack Depth 1181-1197 mm (46.5in. - 47.13in.) of usable rack space, frame to
frame
Rack Units (U) 4U
Vertical Rack Rail Spacing 812.8mm - 914.4mm / 32 in. - 36 in.
Table 4: Performance Specifications
Specification Value
Number of Drive Slots 102
Data Transfer Rates 12GBps SAS / 6Gbps SATA
Max Raw Data Storage Capacity 1.428 PB using 14TB HGST Ultrastar® HC530
drives
SAS Ports 12 x Mini-SAS HD ( 6 per IOM)
2 x 10/100/1G Ethernet
1.5 Ultrastar Data102 Layout
5

User Guide
1. Overview
1.5 Ultrastar Data102 Layout
Figure 3: Front and Rear Product Layout
1
1
5
4
6
8
2
3
7
FRONT
REAR
Table 5: Front and Rear Component Identification
Number Component
1 Enclosure Handles
2 CMAs
3 CMA Tray
4 Rear Fans
5 PSUs
6

User Guide
1. Overview
1.6 List of Customer Replaceable Units (CRUs)
Number Component
6 Chassis Cover
7 Rear Cover Alignment Brackets
8 Rails
The following is an image of the layout of the major system components inside the Ultrastar Data102.
Figure 4: Component Layout
1.6 List of Customer Replaceable Units (CRUs)
The following table lists the replaceable components and their part numbers.
Table 6: List of Replaceable Components
Component Part Number
Ultrastar Data102 Chassis with a single IOM and PSU 1EX0440
Ultrastar Data102 Chassis with IOMs and PSUs 1EX0441
IOM 1EX0430
IOM Blank 1EX0431
PSU 1600W 1EX0434
Rear Fan 1EX0433
7

User Guide
1. Overview
1.7 LEDs
Component Part Number
IOM Fan 1EX0432
Rails (CMA Standard) 1EX0435
Rails (CMA Lite) 1EX1601
CMA Standard 1EX0437
CMA Lite Kit (w/ rails, spacer brackets, and CMA) 1EX1825
CMA Lite Arm 1EX1834
CMA Lite Tray 1EX1603
CMA Cable Tray 1EX1119
3.5 in. Drive Carrier, Qty=1 1EX0438
3.5 in. to 2.5 in. conversion Drive Carrier, Qty=1 1EX0439
3.5 in. Drive Blank, Qty=1 1EX0429
Power Cable for PDU, C13-C14, 18AWG, 3m, Qty=1 1EX1158
HD Mini-SAS to HD Mini-SAS, 3m, Qty=2 1EX1533
1.7 LEDs
1.7.1 Front and Rear IO LEDs
The Ultrastar Data102 has a number of LEDs on the exterior of the enclosure that display various
system statuses. There are three on the front and three on the rear that mirror each other and
provide general status. This allows the status of the enclosure to be visible from either side of the
rack.
8

User Guide
1. Overview
1.7 LEDs
Figure 5: Front LEDs
1
2
3
From the rear there are the three enclosure status LEDs and LEDs on the Ethernet and SAS ports.
Table 7: Front LED Identification
Number LED Name Color Behavior
1 Identify Blue Blink @ 1 Hz – Blinks only when Identification has
been activated. Will blink when any component is
identified.
2 Fault Amber Blink @ 1 Hz –Enclosure has a fault
9

User Guide
1. Overview
1.7 LEDs
Number LED Name Color Behavior
Off – Enclosure has no fault
3 Power Green Solid - Powered On
Figure 6: Rear IO LEDs
Table 8: Rear LED Identification
Number LED Name Color Behavior
1 SAS Link
Status
Green Solid – SAS Cable Connected
Off – SAS Cable Not Connected
2 SAS Fault
Status
Amber Blink @ 1 Hz – SAS connection fault
Off – No SAS connection fault
3 Identification Blue Blink @ 1 Hz – Blinks only when Identification has
been activated. Will blink when any component is
identified.
4 Fault Amber Blink @ 1 Hz –Enclosure has a fault
Off – Enclosure has no fault
5 Power Green Solid - Powered On
6 Ethernet
Connectors
Link/Activity
Green/
Amber
Off - Operating at 10 Mbps
Green Solid - Operating at 100 Mbps
Amber Solid - Operating at 1Gpbs
10