NetApp StorageGRID Webscale SG6000 Series Operating manual

StorageGRID®11.3
Hardware Installation and
Maintenance Guide
For StorageGRID SG6000 Series Appliances
May 2020 | 215-14204_2020-05_en-us
docc[email protected]

Contents
SG6000 appliances overview ....................................................................... 5
SG6060 overview ........................................................................................................ 5
SGF6024 overview ...................................................................................................... 9
Controllers in the SG6000 appliances ....................................................................... 11
Installation and deployment overview ...................................................... 15
Preparing for installation ........................................................................... 17
Preparing the site ....................................................................................................... 17
Unpacking the boxes ................................................................................................. 18
Obtaining additional equipment and tools ................................................................ 21
Web browser requirements ........................................................................................ 22
Reviewing appliance network connections ............................................................... 22
Port bond modes for the SG6000-CN controller ........................................... 23
Gathering installation information ............................................................................ 25
Installing the hardware .............................................................................. 31
Registering the hardware ........................................................................................... 31
SG6060: Installing 60-drive shelves into a cabinet or rack ....................................... 32
SG6060: Installing the drives .................................................................................... 34
SGF6024: Installing 24-drive shelves into a cabinet or rack .................................... 35
SG6000-CN: Installing into a cabinet or rack ........................................................... 36
Cabling the appliance ................................................................................................ 38
SG6060: Cabling the optional expansion shelves ..................................................... 40
Connecting power cords and applying power ........................................................... 42
Viewing status indicators and buttons on the SG6000-CN controller ....................... 43
Viewing boot-up status codes for the storage controllers .......................................... 44
Configuring the hardware ......................................................................... 45
Configuring StorageGRID connections .................................................................... 45
Accessing the StorageGRID Appliance Installer .......................................... 45
Configuring network links ............................................................................. 48
Configuring StorageGRID IP addresses ........................................................ 53
Verifying network connections ...................................................................... 56
Verifying port-level network connections ..................................................... 57
Configuring SANtricity System Manager ................................................................. 58
Setting the IP addresses for the storage controllers ....................................... 58
Accessing SANtricity System Manager ........................................................ 60
Setting up SANtricity System Manager ........................................................ 61
Reviewing the hardware status in SANtricity System Manager ................... 62
Configuring the BMC interface ................................................................................. 64
Changing the root password for the BMC interface ...................................... 64
Setting the IP address for the BMC management port .................................. 65
Accessing the BMC interface ........................................................................ 67
Configuring SNMP settings for the SG6000-CN controller ......................... 68
Table of Contents | 3

Optional: Changing the RAID mode ......................................................................... 69
Optional: Remapping network ports for the appliance ............................................. 70
Deploying an appliance Storage Node ...................................................... 71
Monitoring StorageGRID appliance installation .................................... 74
Troubleshooting the hardware installation .............................................. 76
Viewing boot-up codes for the SG6000-CN controller ............................................. 76
Viewing error codes for the SG6000-CN controller ................................................. 78
Hardware setup appears to hang ................................................................................ 79
Troubleshooting connection issues ........................................................................... 80
Unable to connect to the appliance ............................................................... 80
Expansion shelves do not appear in Appliance Installer ............................... 81
Rebooting the SG6000-CN controller while the StorageGRID Appliance
Installer is running ............................................................................................... 82
Maintaining the SG6000 appliance ........................................................... 83
Upgrading SANtricity OS Software on the storage controllers ................................ 83
Replacing a storage controller ................................................................................... 87
Replacing hardware components in the storage controller shelf ............................... 92
Replacing hardware components in the optional 60-drive expansion shelf .............. 93
Replacing the SG6000-CN controller ....................................................................... 93
Replacing a power supply in the SG6000-CN controller .......................................... 95
Changing the link configuration of the SG6000-CN controller ................................ 97
Copyright .................................................................................................. 102
Trademark ................................................................................................ 103
How to send comments about documentation and receive update
notifications .......................................................................................... 104
4| Hardware Installation and Maintenance Guide for SG6000 Appliances

SG6000 appliances overview
The StorageGRID SG6000 appliances are integrated storage and computing platforms that operate as
Storage Nodes in a StorageGRID system. These appliances can be used in a hybrid grid environment
that combines appliance Storage Nodes and virtual (software-based) Storage Nodes.
The SG6000 appliances provide the following features:
• Available in two models:
◦SG6060, which includes 60 drives and supports expansion shelves.
◦SGF6024, which offers 24 solid state drives (SSDs).
• Integrate the storage and computing elements for a StorageGRID Storage Node.
• Include the StorageGRID Appliance Installer to simplify Storage Node deployment and
configuration.
• Include SANtricity System Manager for managing and monitoring the storage controllers and
drives.
• Include a baseboard management controller (BMC) for monitoring and diagnosing the hardware
in the compute controller.
• Support up to four 10-GbE or 25-GbE connections to the StorageGRID Grid Network and Client
Network.
• Support Federal Information Processing Standard (FIPS) drives. When these drives are used with
the Drive Security feature in SANtricity System Manager, unauthorized access to data is
prevented.
SG6060 overview
The StorageGRID SG6060 appliance includes a compute controller and a storage controller shelf that
contains two storage controllers and 60 drives. Optionally, 60-drive expansion shelves can be added
to the appliance.
SG6060 components
The SG6060 appliance includes the following components:
Component Description
Compute controller SG6000-CN controller, a one-rack unit (1U) server that
includes:
• 40 cores (80 threads)
• 192 GB RAM
• Up to 4 × 25 Gbps aggregate Ethernet bandwidth
• 4 × 16 Gbps Fibre Channel (FC) interconnect
• Baseboard management controller (BMC) that
simplifies hardware management
• Redundant power supplies
5

Component Description
Storage controller shelf E-Series E2860 controller shelf (storage array), a 4U shelf
that includes:
• Two E-Series E2800 controllers (duplex configuration)
to provide storage controller failover support
• Five-drawer drive shelf that holds sixty 3.5-inch drives
(2 solid-state drives, or SSDs, and 58 NL-SAS drives)
• Redundant power supplies and fans
Optional: Storage expansion shelves
Attention: Expansion shelves must
be installed during initial
deployment. They cannot be added
later.
E-Series DE460C enclosure, a 4U shelf that includes:
• Two input/output modules (IOMs)
• Five drawers, each holding 12 NL-SAS drives, for a
total of 60 drives
• Redundant power supplies and fans
Each SG6060 appliance can have one or two expansion
shelves for a total of 180 drives.
SG6060 diagrams
This figure shows the front of the SG6060, which includes a 1U compute controller and a 4U shelf
containing two storage controllers and 60 drives in five drive drawers.
6| Hardware Installation and Maintenance Guide for SG6000 Appliances

1SG6000-CN compute controller with front bezel
2 E2860 controller shelf with front bezel (optional expansion shelf looks identical)
3 SG6000-CN compute controller with front bezel removed
4 E2860 controller shelf with front bezel removed (optional expansion shelf looks identical)
This figure shows the back of the SG6060, including the compute and storage controllers, fans, and
power supplies.
SG6000 appliances overview | 7

1Power supply (1 of 2) for SG6000-CN compute controller
2 Connectors for SG6000-CN compute controller
3 Fan (1 of 2) for E2860 controller shelf
4 E-Series E2800 storage controller (1 of 2) and connectors
5 Power supply (1 of 2) for E2860 controller shelf
This figure shows the back of the optional expansion shelf for the SG6060, including the input/output
modules (IOMs), fans, and power supplies. As an option, each SG6060 can be installed with one or
two expansion shelves.
1Fan (1 of 2) for expansion shelf
2 IOM (1 of 2) for expansion shelf
3 Power supply (1 of 2) for expansion shelf
8| Hardware Installation and Maintenance Guide for SG6000 Appliances

SGF6024 overview
The StorageGRID SGF6024 includes a compute controller and a storage controller shelf that holds
24 solid state drives.
SGF6024 components
The SGF6024 appliance includes the following components:
Component Description
Compute controller SG6000-CN controller, a one-rack unit (1U) server that
includes:
• 40 cores (80 threads)
• 192 GB RAM
• Up to 4 × 25 Gbps aggregate Ethernet bandwidth
• 4 × 16 Gbps Fibre Channel (FC) interconnect
• Baseboard management controller (BMC) that
simplifies hardware management
• Redundant power supplies
Flash array (controller shelf) E-Series EF570 flash array (also known as a controller
shelf), a 2U shelf that includes:
• Two E-Series EF570 controllers (duplex
configuration) to provide storage controller failover
support
• 24 solid state drives (also known as SSDs or flash
drives)
• Redundant power supplies and fans
SGF6024 diagrams
This figure shows the front of the SGF6024, which includes a 1U compute controller and a 2U
enclosure containing two storage controllers and 24 flash drives.
SG6000 appliances overview | 9

1SG6000-CN compute controller with front bezel
2 EF570 flash array with front bezel
3 SG6000-CN compute controller with front bezel removed
4 EF570 flash array with front bezel removed
This figure shows the back of the SGF6024, including the compute and storage controllers, fans, and
power supplies.
1Power supply (1 of 2) for SG6000-CN compute controller
2 Connectors for SG6000-CN compute controller
3 Power supply (1 of 2) for EF570 flash array
4 E-Series EF570 storage controller (1 of 2) and connectors
10 | Hardware Installation and Maintenance Guide for SG6000 Appliances

Controllers in the SG6000 appliances
Each model of the StorageGRID SG6000 appliance includes an SG6000-CN compute controller in a
1U enclosure and duplex E-Series storage controllers in a 2U or 4U enclosure, depending on the
model. Review the diagrams to learn more about each type of controller.
All appliances: SG6000-CN compute controller
• Provides compute resources for the appliance.
• Includes the StorageGRID Appliance Installer.
Note: StorageGRID software is not preinstalled on the appliance. This software is retrieved
from the Admin Node when you deploy the appliance.
• Can connect to all three StorageGRID networks, including the Grid Network, the Admin
Network, and the Client Network.
• Connects to the E-Series storage controllers and operates as the initiator.
This figure shows the connectors on the back of the SG6000-CN.
Port Type Use
1 Interconnect
ports 1-4 16-Gb/s Fibre Channel (FC), with integrated optics Connect the SG6000-CN controller to the E2800 controllers (two connections to
each E2800).
2 Network ports
1-4 10-GbE or 25-GbE, based on cable or SFP transceiver
type, switch speed, and
configured link speed
Connect to the Grid Network and the
Client Network for StorageGRID.
3 BMC
management
port
1-GbE (RJ-45) Connect to the SG6000-CN baseboard
management controller.
4 Diagnostic and
support ports • VGA
• Serial, 115200 8-N-1
• USB
Reserved for technical support use.
5 Admin Network
port 1 1-GbE (RJ-45) Connect the SG6000-CN to the Admin Network for StorageGRID.
SG6000 appliances overview | 11

Port Type Use
6 Admin Network
port 2 1-GbE (RJ-45) Options:
• Bond with management port 1 for a
redundant connection to the Admin
Network for StorageGRID.
• Leave unwired and available for
temporary local access (IP
169.254.0.1).
• During installation, use port 2 for IP
configuration if DHCP-assigned IP
addresses are not available.
SG6060: E2800 storage controllers
• Two controllers for failover support.
• Manage the storage of data on the drives.
• Function as standard E-Series controllers in a duplex configuration.
• Include SANtricity OS Software (controller firmware).
• Include SANtricity System Manager for monitoring storage hardware and for managing alerts,
the AutoSupport feature, and the Drive Security feature.
• Connect to the SG6000-CN controller and provide access to the storage.
This figure shows the connectors on the back of each of the E2800 controllers.
Port Type Use
1 Interconnect
ports 1 and 2 16-Gb/s FC optical SFP+ Connect each of the E2800 controllers to the SG6000-CN controller.
There are four connections to the SG6000-
CN controller (two from each E2800).
2 Management
ports 1 and 2 1-Gb (RJ-45) Ethernet • Port 1 connects to the network where
you access SANtricity System Manager
on a browser.
• Port 2 is reserved for technical support
use.
12 | Hardware Installation and Maintenance Guide for SG6000 Appliances

Port Type Use
3 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial port
• USB port
Reserved for technical support use.
4 Drive expansion
ports 1 and 2 12Gb/s SAS Connect the ports to the drive expansion ports on the IOMs in the expansion shelf.
SGF6024: EF570 storage controllers
• Two controllers for failover support.
• Manage the storage of data on the drives.
• Function as standard E-Series controllers in a duplex configuration.
• Include SANtricity OS Software (controller firmware).
• Include SANtricity System Manager for monitoring storage hardware and for managing alerts,
the AutoSupport feature, and the Drive Security feature.
• Connect to the SG6000-CN controller and provide access to the flash storage.
This figure shows the connectors on the back of each of the EF570 controllers.
Port Type Use
1 Interconnect
ports 1 and 2 16-Gb/s FC optical SFP+ Connect each of the EF570 controllers to the SG6000-CN controller.
There are four connections to the SG6000-
CN controller (two from each EF570).
2 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial port
• USB port
Reserved for technical support use.
3 Drive expansion
ports 12Gb/s SAS Not used. The SGF6024 appliance does not support expansion drive shelves.
SG6000 appliances overview | 13

Port Type Use
4 Management
ports 1 and 2 1-Gb (RJ-45) Ethernet • Port 1 connects to the network where
you access SANtricity System Manager
on a browser.
• Port 2 is reserved for technical support
use.
SG6060: Input/output modules for optional expansion shelves
The expansion shelf contains two input/output modules (IOMs) that connect to the storage controllers
or to other expansion shelves.
Port Type Use
1 Drive expansion
ports 1-4 12Gb/s SAS Connect each port to the storage controllers or additional expansion shelf (if any).
14 | Hardware Installation and Maintenance Guide for SG6000 Appliances

Installation and deployment overview
You can install one or more StorageGRID storage appliances when you first deploy StorageGRID, or
you can add appliance Storage Nodes later as part of an expansion. You might also need to install an
appliance Storage Node as part of a recovery operation.
Before you begin
Your StorageGRID system is using the required version of StorageGRID software.
Appliance Required StorageGRID version
SG6060 with no expansion shelves 11.1.1 or later
SG6060 with expansion shelves (one or two) 11.3 or later
SGF6024
Installation and deployment tasks
Adding a StorageGRID storage appliance to a StorageGRID system includes four primary steps:
1. Preparing for installation:
• Preparing the installation site
• Unpacking the boxes and checking the contents
• Obtaining additional equipment and tools
• Gathering IP addresses and network information
2. Installing the hardware:
• Registering the hardware
• Installing the appliance into a cabinet or rack
• Installing the drives
• Installing optional expansion shelves (model SG6060 only; maximum of two expansion
shelves)
• Cabling the appliance
• Connecting the power cords and applying power
• Viewing boot-up status codes
3. Configuring the hardware:
• Accessing SANtricity System Manager to configure SANtricity System Manager settings
• Accessing StorageGRID Appliance Installer, setting a static IP address for management port 1
on the storage controller, and configuring the link and network IP settings required to connect
to StorageGRID networks
• Accessing the baseboard management controller (BMC) interface on the SG6000-CN
controller
4. Deploying the appliance as a Storage Node:
15

Task Instructions
Deploying an appliance Storage Node in a
new StorageGRID system
Deploying an appliance Storage Node on page
71
Adding an appliance Storage Node to an
existing StorageGRID system Instructions for expanding a StorageGRID system
Deploying an appliance Storage Node as part
of a Storage Node recovery operation Instructions for recovery and maintenance
Related tasks
Preparing for installation on page 17
Installing the hardware on page 31
Configuring the hardware on page 45
Related information
Expanding a StorageGRID system
Recovery and maintenance
16 | Hardware Installation and Maintenance Guide for SG6000 Appliances

Preparing for installation
Preparing to install a StorageGRID appliance entails preparing the site and obtaining all required
hardware, cables, and tools. You should also gather IP addresses and network information.
Steps
1. Preparing the site on page 17
2. Unpacking the boxes on page 18
3. Obtaining additional equipment and tools on page 21
4. Web browser requirements on page 22
5. Reviewing appliance network connections on page 22
6. Gathering installation information on page 25
Preparing the site
Before installing the appliance, you must make sure that the site and the cabinet or rack you plan to
use meet the specifications for a StorageGRID appliance.
Steps
1. Confirm that the site meets the requirements for temperature, humidity, altitude range, airflow,
heat dissipation, wiring, power, and grounding. See the NetApp Hardware Universe for more
information.
2. Confirm that your location provides 240-volt AC power for the SG6060 or 120-volt AC power for
the SGF6024.
3. Obtain a 19-inch (48.3-cm) cabinet or rack to fit shelves of this size (without cables):
Type of shelf Height Width Depth Maximum
weight
E2860
controller shelf
for SG6060
6.87 in.
(17.46 cm)
17.66 in.
(44.86 cm)
38.25 in.
(97.16 cm)
250 lb.
(113 kg)
Optional
expansion shelf
for SG6060 (one
or two)
6.87 in.
(17.46 cm)
17.66 in.
(44.86 cm)
38.25 in.
(97.16 cm)
250 lb.
(113 kg)
EF570
controller shelf
for SGF6024
3.35 in.
(8.50 cm)
17.66 in.
(44.86 cm)
19.00 in.
(48.26 cm)
51.74 lb.
(23.47 kg)
SG6000-CN
controller for
each appliance
1.70 in.
(4.32 cm)
17.32 in.
(44.0 cm)
32.0 in.
(81.3 cm)
39 lb.
(17.7 kg)
4. Decide where you are going to install the appliance.
Caution: When installing the E2860 controller shelf or optional expansion shelves, install
hardware from the bottom to the top of the rack or cabinet to prevent the equipment from
17

tipping over. To ensure that the heaviest equipment is at the bottom of the cabinet or rack,
install the SG6000-CN controller above the E2860 controller shelf and expansion shelves.
Attention: Before committing to the installation, verify that the 0.5m optic cables shipped with
the appliance, or cables that you supply, are long enough for the planned layout.
Related information
NetApp Hardware Universe
NetApp Interoperability Matrix Tool
Unpacking the boxes
Before installing the StorageGRID appliance, unpack all boxes and compare the contents to the items
on the packing slip.
SG6060
SG6000-CN controller
E2860 controller shelf with no drives installed
Two front bezels
Two rail kits with instructions
60 drives (2 SSD and 58 NL-SAS)
Four handles
18 | Hardware Installation and Maintenance Guide for SG6000 Appliances

Back brackets and cage nuts for square-hole
rack installation
SG6060 expansion shelf
Expansion shelf with no drives installed Front bezel
60 NL-SAS drives
One rail kit with instructions
Four handles
Back brackets and cage nuts for square-hole
rack installation
Preparing for installation | 19

SGF6024
SG6000-CN controller
EF570 flash array with 24 solid state (flash)
drives installed
Two front bezels
Two rail kits with instructions
Shelf endcaps
Cables and connectors
The shipment for the StorageGRID appliance includes the following cables and connectors:
Four power cords for your country
Your cabinet might have special power cords
that you use instead of the power cords that ship
with the appliance.
Four optical cables for the FC interconnect ports
Four SFP+ transceivers, which support 16-Gb/s
FC
Optional: Two SAS cables for connecting each
SG6060 expansion shelf
20 | Hardware Installation and Maintenance Guide for SG6000 Appliances