NetApp StorageGRID SG5600 Series Operating manual

StorageGRID®11.2
Hardware Installation and
Maintenance Guide
For StorageGRID SG5600 Series Appliances
February 2019 | 215-13576_A0
docc[email protected]

Contents
StorageGRID appliance overview ............................................................... 5
StorageGRID appliance features ................................................................................. 6
Hardware diagrams ..................................................................................................... 6
Installation overview .................................................................................... 9
Preparing for installation ........................................................................... 11
Preparing the site ....................................................................................................... 11
Unpacking the boxes ................................................................................................. 11
Obtaining additional equipment and tools ................................................................ 13
Service laptop requirements ...................................................................................... 14
Web browser requirements ........................................................................................ 14
Reviewing appliance network connections ............................................................... 14
Port bond modes for the E5600SG controller ports ...................................... 16
Gathering installation information ............................................................................ 18
Installing the hardware .............................................................................. 23
Registering the hardware ........................................................................................... 23
Installing the appliance in a cabinet or rack .............................................................. 24
Cabling the appliance ................................................................................................ 25
Connecting the AC power cords ................................................................................ 28
Turning power on ...................................................................................................... 29
Viewing boot-up status and reviewing error codes on the controllers ...................... 29
E5600SG controller seven-segment display codes ........................................ 30
Configuring the hardware ......................................................................... 33
Configuring StorageGRID connections .................................................................... 33
Accessing the StorageGRID Appliance Installer .......................................... 33
Configuring network links ............................................................................. 35
Setting the IP configuration ........................................................................... 40
Verifying network connections ...................................................................... 43
Verifying port-level network connections ..................................................... 44
Configuring SANtricity Storage Manager ................................................................ 45
Setting the IP address for the E2700 controller ............................................. 45
Adding the appliance to SANtricity Storage Manager .................................. 47
Setting up SANtricity Storage Manager ........................................................ 48
Optional: Changing to RAID6 mode (SG5660 only) ................................................ 50
Optional: Remapping network ports for the appliance ............................................. 51
Where to go next ......................................................................................... 52
Troubleshooting the hardware installation .............................................. 53
Hardware setup appears to hang ................................................................................ 53
HE error: Error synchronizing with SANtricity OS Software ...................... 54
Troubleshooting connection issues ........................................................................... 54
Unable to connect to StorageGRID appliance over the network .................. 54
Rebooting the controller while the StorageGRID Appliance Installer is running .... 55
Table of Contents | 3

Maintaining the SG5600 appliance ........................................................... 56
Upgrading SANtricity OS Software on the E2700 controller ................................... 56
Replacing the E2700 controller ................................................................................. 59
Replacing the E5600SG controller ............................................................................ 62
Replacing other hardware components ..................................................................... 64
Changing the link configuration of the E5600SG controller .................................... 64
Copyright .................................................................................................... 68
Trademark .................................................................................................. 69
How to send comments about documentation and receive update
notifications ............................................................................................ 70
Index ............................................................................................................. 71
4| Hardware Installation and Maintenance Guide for SG5600 Appliances

StorageGRID appliance overview
The StorageGRID SG5600 appliance is an integrated storage and computing platform that operates
as a Storage Node in a StorageGRID grid.
The StorageGRID SG5600 appliance includes the following components:
Component Description
E5600SG controller Compute server
The E5600SG controller runs the Linux operating system and the
StorageGRID software.
This controller connects to the following:
• The Admin, Grid, and Client Networks for the StorageGRID system
• The E2700 controller, using dual SAS paths (active/active) with the
E5600SG controller operating as the initiator
E2700 controller Storage controller
The E2700 controller operates as a standard E-Series storage array in
simplex mode, and runs the SANtricity operating system (controller
firmware).
This controller connects to the following:
• The management network where SANtricity Storage Manager is
installed
• The E5600SG controller, using dual SAS paths (active/active) with the
E2700 controller operating as the target
The SG5600 appliance also includes the following components, depending on the model:
Component Model SG5612 Model SG5660
Drives 12 NL-SAS drives 60 NL-SAS drives
Enclosure DE1600 enclosure, a two rack-unit
(2U) chassis that houses the drives
and the controllers
DE6600 enclosure, a four rack-unit
(4U) chassis that houses the drives
and the controllers
Power supplies and
fans Two power-fan canisters Two power supplies and two fans
Note: The E5600SG controller controller is highly customized for use in the StorageGRID
appliance. All other components operate as described in E-Series documentation, except as
indicated in these instructions.
The maximum raw storage available on each StorageGRID appliance Storage Node is fixed, based on
the appliance model and configuration. You cannot expand the available storage by adding a shelf
with additional drives.
5

StorageGRID appliance features
The StorageGRID SG5600 appliance provides an integrated storage solution for creating a new
StorageGRID system or for expanding the capacity of an existing system.
The StorageGRID appliance provides the following features:
• Combines the StorageGRID Storage Node computing and storage elements into a single,
efficient, integrated solution
• Simplifies the installation and configuration of a Storage Node, automating most of the process
required
• Provides a high-density storage solution with two enclosure options: one that is 2U and one that is
4U
• Uses 10-GbE IP interfaces directly to the Storage Node, without the need for intermediate storage
interfaces such as FC or iSCSI
• Can be used in a hybrid grid environment that uses StorageGRID appliances and virtual
(software-based) Storage Nodes
• Includes preconfigured storage and comes preloaded with the StorageGRID Appliance Installer
(on the E5600SG controller) for field-ready software deployment and integration
Hardware diagrams
The SG5612 and SG5660 models of the StorageGRID appliance both include an E2700 controller
and an E5600SG controller. You should review the diagrams to learn the differences between the
models and the controllers.
Model SG5612 2U: Rear view of the E2700 controller and E5600SG controller
1E2700 controller
2 E5600SG controller
6| Hardware Installation and Maintenance Guide for SG5600 Appliances

Model SG5660 4U: Rear view of the E2700 controller and E5600SG controller
The E2700 controller is above the E5600SG controller.
1E2700 controller
2 E5600SG controller
Rear view of the E2700 controller
1Management port 1 (Connect to the network where SANtricity Storage Manager is installed.)
2 Management port 2 (Use during installation to connect to a laptop.)
3 SAS interconnect port 1
4 SAS interconnect port 2
5 Serial connection port
6 Seven-segment display
Note: The two SAS ports labeled Drive Expansion (green) on the rear of the E2700 controller are
not used. The StorageGRID appliance does not support expansion drive shelves.
Rear view of the E5600SG controller
StorageGRID appliance overview | 7

1 Management port 1
Connect to the Admin network for StorageGRID.
2 Management port 2
Options:
• Bond with management port 1 for a redundant connection to the Admin Network for
StorageGRID.
• Leave unwired and available for temporary local access (IP 169.254.0.1).
• During installation, use for IP configuration if DHCP-assigned IP addresses are not
available.
3 SAS interconnect port 1
4 SAS interconnect port 2
5 Fault and Active LEDs for 10-GbE network port 1
6 Fault and Active LEDs for 10-GbE network port 2
7 Fault and Active LEDs for 10-GbE network port 3
8 Fault and Active LEDs for 10-GbE network port 4
9 Needs Attention LED
10 Seven-segment display
11 10-GbE network port 1
12 10-GbE network port 2
13 10-GbE network port 3
14 10-GbE network port 4
Note: The host interface card (HIC) on the StorageGRID appliance E5600SG controller supports
only 10-Gb Ethernet connections. It cannot be used for iSCSI connections.
8| Hardware Installation and Maintenance Guide for SG5600 Appliances

Installation overview
You can install one or more StorageGRID appliances when you first deploy StorageGRID, or you can
add appliance Storage Nodes later as part of an expansion. You might also need to install an
appliance Storage Node as part of a recovery operation.
Installing a StorageGRID appliance includes two primary phases.
1. Installing and configuring appliance hardware
The first phase of installing a StorageGRID appliance includes these steps:
1. Preparing for installation:
• Preparing the installation site
• Unpacking the boxes and checking the contents
• Obtaining additional equipment and tools
• Gathering IP addresses and network information
2. Installing the hardware:
• Registering the hardware
• Installing the appliance into a cabinet or rack
• Installing the drives (SG5660 only)
• Cabling the appliance
• Connecting the power cords and applying power
• Viewing boot-up status codes
3. Configuring the hardware:
• Accessing SANtricity Storage Manager, setting a static IP address for management port 1 on
the E2700 controller, and configuring SANtricity Storage Manager settings
• Accessing StorageGRID Appliance Installer and configuring the link and network IP settings
required to connect to StorageGRID networks
2. Deploying an appliance Storage Node
After the appliance hardware has been installed and configured using these instructions, you can
deploy the appliance as a Storage Node in a StorageGRID grid.
Task Refer to
Deploying an appliance Storage Node in a new
StorageGRID grid StorageGRID installation instructions for your platform
Adding an appliance Storage Node to an
existing StorageGRID grid Instructions for expanding a StorageGRID grid
Deploying an appliance Storage Node as part of
a Storage Node recovery operation Instructions for recovery and maintenance
9

Related tasks
Preparing for installation on page 11
Installing the hardware on page 23
Configuring the hardware on page 33
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
Expanding a StorageGRID system
Recovery and maintenance
10 | Hardware Installation and Maintenance Guide for SG5600 Appliances

Preparing for installation
Preparing to install a StorageGRID appliance entails preparing the site and obtaining all required
hardware, cables, and tools. You should also gather IP addresses and network information.
Steps
1. Preparing the site on page 11
2. Unpacking the boxes on page 11
3. Obtaining additional equipment and tools on page 13
4. Service laptop requirements on page 14
5. Web browser requirements on page 14
6. Reviewing appliance network connections on page 14
7. Gathering installation information on page 18
Preparing the site
Before installing the appliance, you must make sure that the site and the cabinet or rack you plan to
use meet the specifications for a StorageGRID appliance.
Steps
1. Confirm that the site meets the requirements for temperature, humidity, altitude range, airflow,
heat dissipation, wiring, power, and grounding. See the NetApp Hardware Universe for more
information.
2. Obtain a 19-inch (48.3-cm) cabinet or rack to fit shelves of this size (without cables):
Appliance
model Height Width Depth Maximum weight
SG5612
(12 drives)
3.40 in.
(8.64 cm)
19.0 in.
(48.26 cm)
21.75 in.
(55.25 cm)
59.5 lb
(27 kg)
SG5660
(60 drives)
7.00 in.
(17.78 cm)
17.75 in.
(45.08 cm)
32.50 in.
(82.55 cm)
236.2 lb.
(107.1 kg)
3. Install any required network switches. See the NetApp Interoperability Matrix Tool for
compatibility information.
Related information
NetApp Hardware Universe
NetApp Interoperability
Unpacking the boxes
Before installing the StorageGRID appliance, unpack all boxes and compare the contents to the items
on the packing slip.
11

SG5660 enclosure, a 4U chassis with 60 drives
SG5612 enclosure, a 2U chassis with 12 drives
4U bezel or 2U endcaps
NL-SAS drives. Drives are preinstalled in the
2U SG5612, but not in the 4U SG5660 for
shipment safety.
E5600SG controller E2700 controller
Mounting rails and screws
Enclosure handles (4U enclosures only)
Cables and connectors
The shipment for the StorageGRID appliance includes the following cables and connectors:
12 | Hardware Installation and Maintenance Guide for SG5600 Appliances

The appliance ships with two AC power cords
for connecting to an external power source, such
as a wall plug. Your cabinet might have special
power cords that you use instead of the power
cords that ship with the appliance.
Two 0.5-meter SAS interconnect cables with
mini-SAS-HD and mini-SAS connectors.
The square connector plugs into the E2700
controller, and the rectangular connector plugs
into the E5600SG controller.
Obtaining additional equipment and tools
Before installing the SG5600 appliance, confirm you have all of the additional equipment and tools
that you need.
Phillips No. 2 screwdriver
Medium flat-blade screwdrivers
ESD wrist strap
Ethernet cables
Ethernet switch
Management station service laptop
Preparing for installation | 13

Service laptop requirements
Before you install the StorageGRID appliance hardware, you should check to see if the service laptop
has the minimum required resources.
The service laptop, which is needed for the hardware installation, must meet the following
requirements:
• Microsoft Windows operating system
• Network port
• Supported web browser
• NetApp SANtricity Storage Manager version 11.40 or later
• SSH client (for example, PuTTY)
Related references
Web browser requirements on page 14
Related information
NetApp Documentation: SANtricity Storage Manager
Web browser requirements
You must use a supported web browser.
Web browser Minimum supported version
Google Chrome 70
Microsoft Internet Explorer 11 (Native Mode)
Mozilla Firefox 63
You should set the browser window to a recommended width.
Browser width Pixels
Minimum 1024
Optimum 1280
Reviewing appliance network connections
Before installing the StorageGRID appliance, you should understand which networks can be
connected to the appliance and how the ports on each controller are used.
StorageGRID appliance networks
When you deploy a StorageGRID appliance as a Storage Node, you can connect it to the following
networks:
•Grid Network for StorageGRID: The Grid Network is used for all internal StorageGRID traffic.
It provides connectivity between all nodes in the grid, across all sites and subnets. The Grid
Network is required.
14 | Hardware Installation and Maintenance Guide for SG5600 Appliances

•Admin Network for StorageGRID: The Admin Network is a closed network used for system
administration and maintenance. The Admin Network is typically a private network and does not
need to be routable between sites. The Admin Network is optional.
•Client Network forStorageGRID: The Client Network is an open network used to provide
access to client applications, including S3 and Swift. The Client Network provides client protocol
access to the grid, so the Grid Network can be isolated and secured. The Client Network is
optional.
•Management network for SANtricity Storage Manager: The E2700 controller connects to the
management network where SANtricity Storage Manager is installed, allowing you to monitor
and manage the hardware components in the appliance. This management network can be the
same as the Admin Network for StorageGRID, or it can be an independent management network.
Note: For detailed information about StorageGRID networks, see the instructions for installing
StorageGRID for your platform.
StorageGRID appliance connections
When you install a StorageGRID appliance, you must connect the two controllers to each other and
to the required networks. The figure shows the two controllers in the SG5660, with the E2700
controller on the top and the E5600SG controller on the bottom. In the SG5612, the E2700 controller
is to the left of the E5600SG controller.
Item Port Type of port Function
1 Management port 1 on
the E2700 controller 1-Gb (RJ-45) Ethernet Connects the E2700 controller to the network where SANtricity Storage
Manager is installed.
2 Management port 2 on
the E2700 controller 1-Gb (RJ-45) Ethernet Connects the E2700 controller to a service laptop during installation.
3 Two SAS interconnect
ports on each
controller, labelled Ch
1 and Ch 2
E2700 controller:
mini-SAS-HD
E5600SG controller:
mini-SAS
Connect the two controllers to each
other.
4 Management port 1 on
the E5600SG
controller
1-Gb (RJ-45) Ethernet Connects the E5600SG controller to the
Admin Network for StorageGRID.
Preparing for installation | 15

Item Port Type of port Function
5 Management port 2 on
the E5600SG
controller
1-Gb (RJ-45) Ethernet • Can be bonded with management
port 1 if you want a redundant
connection to the Admin Network.
• Can be left unwired and available
for temporary local access (IP
169.254.0.1).
• Can be used to connect the
E5600SG controller to a service
laptop during installation, if a
DHCP-assigned IP address is not
available.
6Four network ports on
the E5600SG
controller
10-GbE (optical) Connect to the Grid Network and the
Client Network for StorageGRID. See
“10-GbE port connections for the
E5600SG controller.”
Related concepts
Port bond modes for the E5600SG controller ports on page 16
Related tasks
Gathering installation information on page 18
Cabling the appliance on page 25
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
Port bond modes for the E5600SG controller ports
When configuring network links for the E5600SG controller ports, you can use port bonding for the
10-GbE ports that connect to the Grid Network and optional Client Network, and the 1-GbE
management ports that connect to the optional Admin Network. Port bonding helps protect your data
by providing redundant paths between StorageGRID networks and the appliance.
Related tasks
Configuring network links on page 35
Network bond modes for the 10-GbE ports
The 10-GbE networking ports on the E5600SG controller support Fixed port bond mode or
Aggregate port bond mode for the Grid Network and Client Network connections.
Fixed port bond mode
Fixed mode is the default configuration for the 10-GbE networking ports.
16 | Hardware Installation and Maintenance Guide for SG5600 Appliances

Callout Which ports are bonded
C Ports 1 and 3 are bonded together for the Client Network, if this network is used.
G Ports 2 and 4 are bonded together for the Grid Network.
When using Fixed port bond mode, the ports can be bonded using active-backup mode or Link
Aggregation Control Protocol mode (LACP 802.3ad).
• In active-backup mode (default), only one port is active at a time. If the active port fails, its
backup port automatically provides a failover connection. Port 4 provides a backup path for port 2
(Grid Network), and port 3 provides a backup path for port 1 (Client Network).
• In LACP mode, each pair of ports forms a logical channel between the controller and the network,
allowing for higher throughput. If one port fails, the other port provides a failover connection.
Throughput is reduced, but connectivity is not impacted.
Note: If you do not need redundant connections, you can use only one port for each network.
However, be aware that an alarm will be raised in the Grid Manager after StorageGRID is
installed, indicating that a cable is unplugged. You can safely acknowledge this alarm to clear it.
Aggregate port bond mode
Aggregate port bond mode significantly increases the throughout for each StorageGRID network and
provides additional failover paths.
Callout Which ports are bonded
1 All connected ports are grouped in a single LACP bond, allowing all ports to be used
for Grid Network and Client Network traffic.
If you plan to use Aggregate port bond mode:
• You must use LACP network bond mode.
• You must specify a unique VLAN tag for each network. This VLAN tag will be added to each
network packet to ensure that network traffic is routed to the correct network.
• The ports must be connected to switches that can support VLAN and LACP. If multiple switches
are participating in the LACP bond, the switches must support multi-chassis link aggregation
groups (MLAG), or equivalent.
Preparing for installation | 17

• You must understand how to configure the switches to use VLAN, LACP, and MLAG, or
equivalent.
If you do not want to use all four 10-GbE ports, you can use one, two, or three ports. Using more
than one port maximizes the chance that some network connectivity will remain available if one of
the 10-GbE ports fails.
Note: If you choose to use fewer than four ports, be aware that one or more alarms will be raised
in the Grid Manager after StorageGRID is installed, indicating that cables are unplugged. You can
safely acknowledge the alarms to clear them.
Network bond modes for the 1-GbE management ports
For the two 1-GbE management ports on the E5600SG controller, you can choose Independent
network bond mode or Active-Backup network bond mode to connect to the optional Admin
Network.
In Independent mode, only management port 1 is connected to the Admin Network. This mode does
not provide a redundant path. Management port 2 is left unwired and available for temporary local
connections (use IP address 169.254.0.1)
In Active-Backup mode, both management ports 1 and 2 are connected to the Admin Network. Only
one port is active at a time. If the active port fails, its backup port automatically provides a failover
connection. Bonding these two physical ports into one logical management port provides a redundant
path to the Admin Network.
Note: If you need to make a temporary local connection to the E5600SG controller when the 1-
GbE management ports are configured for Active-Backup mode, remove the cables from both
management ports, plug your temporary cable into management port 2, and access the appliance
using IP address 169.254.0.1.
Gathering installation information
As you install and configure the StorageGRID appliance, you must make decisions and gather
information about Ethernet switch ports, IP addresses, and port and network bond modes.
About this task
You can use the following tables to record information for each network you connect to the
appliance. These values are required to install and configure the hardware.
Table 1: Information needed to connect the E2700 controller to SANtricity Storage
Manager
You must connect the E2700 controller to the management network you will use for SANtricity
Storage Manager.
Information needed Your value
Ethernet switch port you will connect to
management port 1
18 | Hardware Installation and Maintenance Guide for SG5600 Appliances

Information needed Your value
MAC address for management port 1 (printed
on a label near port P1)
DHCP-assigned IP address for management
port 1, if available after power on
Note: If the network you will connect to the
E2700 controller includes a DHCP server, the
network administrator can use the MAC
address to determine the IP address that was
assigned by the DHCP server.
Speed and duplex mode
Note: You must make sure the Ethernet
switch for the SANtricity Storage Manager
management network is set to autonegotiate.
Must be:
• Autonegotiate (default)
IP address format Choose one:
• IPv4
• IPv6
Static IP address you plan to use for the
appliance on the management network For IPv4:
• IPv4 address:
• Subnet mask:
• Gateway:
For IPv6:
• IPv6 address:
• Routable IP address:
• E2700 controller router IP address:
Table 2: Information needed to connect the E5600SG controller to the Admin Network
The Admin Network for StorageGRID is an optional network, used for system administration and
maintenance. The appliance connects to the Admin Network using the 1-GbE management ports on
the E5600SG controller.
Information needed Your value
Admin Network enabled Choose one:
• No
• Yes (default)
Network bond mode Choose one:
• Independent
• Active-Backup
Switch port for management port 1 (P1)
Preparing for installation | 19

Information needed Your value
Switch port for management port 2 (P2; Active-
Backup network bond mode only)
MAC address for management port 1 (printed
on a label near port P1)
DHCP-assigned IP address for management
port 1, if available after power on
Note: If the Admin Network includes a
DHCP server, the E5600SG controller
displays the DHCP-assigned IP address on its
seven-segment display after it boots up. You
can also determine the DHCP-assigned IP
address by using the MAC address to look up
the assigned IP.
• IPv4 address (CIDR):
• Gateway:
Static IP address you plan to use for the
appliance Storage Node on the Admin Network
Note: If your network does not have a
gateway, specify the same static IPv4 address
for the gateway.
• IPv4 address (CIDR):
• Gateway:
Admin Network subnets (CIDR)
Table 3: Information needed to connect and configure the 10-GbE ports on the
E5600SG controller
The four 10-GbE ports on the E5600SG controller connect to the StorageGRID Grid Network and
Client Network.
Note: See “10-GbE port connections for the E5600SG controller” for more information about the
options for these ports.
Information needed Your value
Port bond mode Choose one:
• Fixed (default)
• Aggregate
Switch port for port 1 (Client Network for Fixed
mode)
Switch port for port 2 (Grid Network for Fixed
mode)
Switch port for port 3 (Client Network for Fixed
mode)
Switch port for port 4 (Grid Network for Fixed
mode)
Table 4: Information needed to connect the E5600SG controller to the Grid Network
The Grid Network for StorageGRID is a required network, used for all internal StorageGRID traffic.
The appliance connects to the Grid Network using the 10-GbE ports on the E5600SG controller.
20 | Hardware Installation and Maintenance Guide for SG5600 Appliances