NetApp StorageGRID Webscale SG5700 Series Operating manual

StorageGRID®11.2
Hardware Installation and
Maintenance Guide
For StorageGRID SG5700 Series Appliances
February 2019 | 215-13575_A0
docc[email protected]

Contents
StorageGRID appliance overview ............................................................... 5
Controllers in the StorageGRID appliance .................................................................. 7
Installation overview .................................................................................. 10
Preparing for installation ........................................................................... 12
Preparing the site ....................................................................................................... 12
Unpacking the boxes ................................................................................................. 13
Obtaining additional equipment and tools ................................................................ 14
Web browser requirements ........................................................................................ 15
Reviewing appliance network connections ............................................................... 15
Port bond modes for E5700SG controller ports ............................................ 17
Gathering installation information ............................................................................ 19
Installing the hardware .............................................................................. 24
Registering the hardware ........................................................................................... 24
Installing the appliance in a cabinet or rack .............................................................. 25
Cabling the appliance ................................................................................................ 26
Connecting power cords and applying power ........................................................... 29
Viewing boot-up status codes .................................................................................... 29
Status indicators on the E5700SG controller ................................................ 31
Configuring the hardware ......................................................................... 34
Configuring StorageGRID connections .................................................................... 34
Accessing the StorageGRID Appliance Installer .......................................... 34
Configuring network links ............................................................................. 36
Setting the IP configuration ........................................................................... 42
Verifying network connections ...................................................................... 44
Verifying port-level network connections ..................................................... 45
Accessing and configuring SANtricity System Manager .......................................... 46
Setting the IP address for the E2800 management port ................................ 47
Accessing SANtricity System Manager ........................................................ 48
Setting up SANtricity System Manager ........................................................ 49
Reviewing the hardware status in SANtricity System Manager ................... 51
Optional: Changing the RAID mode (SG5760 only) ................................................ 52
Optional: Remapping network ports for the appliance ............................................. 53
Where to go next ......................................................................................... 55
Troubleshooting the hardware installation .............................................. 56
Hardware setup appears to hang ................................................................................ 56
HE error: Error synchronizing with SANtricity OS Software ...................... 57
Troubleshooting connection issues ........................................................................... 57
Unable to connect to the appliance ............................................................... 57
Rebooting the controller while the StorageGRID Appliance Installer is running .... 58
Maintaining the SG5700 appliance ........................................................... 59
Upgrading SANtricity OS Software on the E2800 controller ................................... 59
Table of Contents | 3

Replacing the E2800 controller ................................................................................. 62
Replacing the E5700SG controller ............................................................................ 68
Replacing other hardware components ..................................................................... 70
Changing the link configuration of the E5700SG controller .................................... 71
Copyright .................................................................................................... 75
Trademark .................................................................................................. 76
How to send comments about documentation and receive update
notifications ............................................................................................ 77
Index ............................................................................................................. 78
4| Hardware Installation and Maintenance Guide for SG5700 Appliances

StorageGRID appliance overview
The SG5700 StorageGRID appliance is an integrated storage and computing platform that operates
as a Storage Node in a StorageGRID grid. The appliance can be used in a hybrid grid environment
that combines appliance Storage Nodes and virtual (software-based) Storage Nodes.
The StorageGRID SG5700 appliance provides the following features:
• Integrates the storage and computing elements for a StorageGRID Storage Node.
• Includes the StorageGRID Appliance Installer to simplify Storage Node deployment and
configuration.
• Includes E-Series SANtricity System Manager for hardware management and monitoring.
• Supports up to four 10-GbE or 25-GbE connections to the StorageGRID Grid Network and Client
Network.
• Supports Full Disk Encryption (FDE) drives or Federal Information Processing Standard (FIPS)
drives. When these drives are used with the Drive Security feature in SANtricity System
Manager, unauthorized access to data is prevented.
The SG5700 appliance is available in two models: the SG5712 and the SG5760. Both models include
the following components:
Component SG5712 SG5760
Compute controller E5700SG controller E5700SG controller
Storage controller E-Series E2800 controller E-Series E2800 controller
Chassis E-Series DE212C enclosure, a two
rack-unit (2U) enclosure E-Series DE460C enclosure, a four rack-unit (4U) enclosure
Drives 12 NL-SAS drives (3.5-inch) 60 NL-SAS drives (3.5-inch)
Redundant power
supplies and fans Two power-fan canisters Two power canisters and two fan canisters
The maximum raw storage available in the StorageGRID appliance is fixed, based on the number of
drives in each enclosure. You cannot expand the available storage by adding a shelf with additional
drives.
Model SG5712
This figure shows the front and back of the SG5712 model, a 2U enclosure that holds 12 drives.
The SG5712 includes two controllers and two power-fan canisters.
5

1 E2800 controller (storage controller)
2 E5700SG controller (compute controller)
3 Power-fan canisters
Model SG5760
This figure shows the front and back of the SG5760 model, a 4U enclosure that holds 60 drives in 5
drive drawers.
6| Hardware Installation and Maintenance Guide for SG5700 Appliances

The SG5760 includes two controllers, two fan canisters, and two power canisters.
1E2800 controller (storage controller)
2 E5700SG controller (compute controller)
3 Fan canister (1 of 2)
4 Power canister (1 of 2)
Related information
NetApp E-Series Systems Documentation Center
Controllers in the StorageGRID appliance
Both the SG5712 and SG5760 models of the StorageGRID appliance include an E5700SG controller
and an E2800 controller. You should review the diagrams to learn the differences between the
controllers.
E5700SG controller
• Operates as the compute server for the appliance.
• Includes the StorageGRID Appliance Installer.
Note: StorageGRID software is not preinstalled on the appliance. This software is accessed
from the Admin Node when you deploy the appliance.
• Can connect to all three StorageGRID networks, including the Grid Network, the Admin
Network, and the Client Network.
• Connects to the E2800 controller and operates as the initiator.
This figure shows the connectors on the back of the E5700SG controller.
StorageGRID appliance overview | 7

Port Type Use
1 Interconnect
ports 1 and 2 16Gb/s Fibre Channel (FC), optical SFP+ Connect the E5700SG controller to the E2800 controller.
2 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial port
• USB port
Reserved for technical support.
3 Drive expansion
ports 12Gb/s SAS Not used. StorageGRID appliances do not support expansion drive shelves.
4 Network ports
1-4 10-GbE or 25-GbE, based on SFP transceiver type,
switch speed, and
configured link speed
Connect to the Grid Network and the Client
Network for StorageGRID.
5 Management
port 1 1-Gb (RJ-45) Ethernet Connect to the Admin Network for StorageGRID.
6 Management
port 2 1-Gb (RJ-45) Ethernet Options:
• Bond with management port 1 for a
redundant connection to the Admin
Network for StorageGRID.
• Leave unwired and available for
temporary local access (IP 169.254.0.1).
• During installation, use port 2 for IP
configuration if DHCP-assigned IP
addresses are not available.
E2800 controller
• Operates as the storage controller for the appliance.
• Manages the storage of data on the drives.
• Functions as a standard E-Series controller in simplex mode.
• Includes SANtricity OS Software (controller firmware).
• Includes SANtricity System Manager for monitoring appliance hardware and for managing alerts,
the AutoSupport feature, and the Drive Security feature.
• Connects to the E5700SG controller and operates as the target.
8| Hardware Installation and Maintenance Guide for SG5700 Appliances

This figure shows the connectors on the back of the E2800 controller.
Port Type Use
1 Interconnect
ports 1 and 2 16Gb/s FC optical SFP+ Connect the E2800 controller to the E5700SG controller.
2 Management
ports 1 and 2 1-Gb (RJ-45) Ethernet • Port 1 connects to the network where you
access SANtricity System Manager on a
browser.
• Port 2 is reserved for technical support
use.
3 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial
port
• USB port
Reserved for technical support use.
4 Drive expansion
ports. 12Gb/s SAS Not used. StorageGRID appliances do not support expansion drive shelves.
StorageGRID appliance overview | 9

Installation overview
You can install one or more StorageGRID appliances when you first deploy StorageGRID, or you can
add appliance Storage Nodes later as part of an expansion. You might also need to install an
appliance Storage Node as part of a recovery operation.
Installing a StorageGRID appliance includes two primary phases.
1. Installing and configuring appliance hardware
The first phase of installing a StorageGRID appliance includes these steps:
1. Preparing for installation:
• Preparing the installation site
• Unpacking the boxes and checking the contents
• Obtaining additional equipment and tools
• Gathering IP addresses and network information
2. Installing the hardware:
• Registering the hardware
• Installing the appliance into a cabinet or rack
• Installing the drives (SG5760 only)
• Cabling the appliance
• Connecting the power cords and applying power
• Viewing boot-up status codes
3. Configuring the hardware:
• Accessing SANtricity System Manager, setting a static IP address for management port 1 on
the E2800 controller, and configuring SANtricity System Manager settings
• Accessing StorageGRID Appliance Installer and configuring the link and network IP settings
required to connect to StorageGRID networks
2. Deploying an appliance Storage Node
After the appliance hardware has been installed and configured using these instructions, you can
deploy the appliance as a Storage Node in a StorageGRID grid.
Task Instructions
Deploying an appliance Storage Node in a new
StorageGRID grid StorageGRID installation instructions for your platform
Adding an appliance Storage Node to an
existing StorageGRID grid Instructions for expanding a StorageGRID grid
Deploying an appliance Storage Node as part of
a Storage Node recovery operation Instructions for recovery and maintenance
10

Related tasks
Preparing for installation on page 12
Installing the hardware on page 24
Configuring the hardware on page 34
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
Expanding a StorageGRID system
Recovery and maintenance
Installation overview | 11

Preparing for installation
Preparing to install a StorageGRID appliance entails preparing the site and obtaining all required
hardware, cables, and tools. You should also gather IP addresses and network information.
Steps
1. Preparing the site on page 12
2. Unpacking the boxes on page 13
3. Obtaining additional equipment and tools on page 14
4. Web browser requirements on page 15
5. Reviewing appliance network connections on page 15
6. Gathering installation information on page 19
Preparing the site
Before installing the appliance, you must make sure that the site and the cabinet or rack you plan to
use meet the specifications for a StorageGRID appliance.
Steps
1. Confirm that the site meets the requirements for temperature, humidity, altitude range, airflow,
heat dissipation, wiring, power, and grounding. See the NetApp Hardware Universe for more
information.
2. If you are installing the SG5760 model, confirm that your location provides 240-volt AC power.
3. Obtain a 19-inch (48.3-cm) cabinet or rack to fit shelves of this size (without cables):
Appliance
model Height Width Depth Maximum weight
SG5712
(12 drives)
3.41 in.
(8.68 cm)
17.6 in.
(44.7 cm)
21.1 in.
(53.6 cm)
63.9 lb
(29.0 kg)
SG5760
(60 drives)
6.87 in.
(17.46 cm)
17.66 in.
(44.86 cm)
38.25 in.
(97.16 cm)
250 lb.
(113 kg)
4. Install any required network switches. See the NetApp Interoperability Matrix Tool for
compatibility information.
Related information
NetApp Hardware Universe
NetApp Interoperability Matrix Tool
12

Unpacking the boxes
Before installing the StorageGRID appliance, unpack all boxes and compare the contents to the items
on the packing slip.
SG5712 appliance with 12 drives installed
SG5760 appliance with no drives installed
Front bezel for the appliance
Rail kit with instructions
SG5760: Sixty drives
SG5760: Handles
SG5760: Back brackets and cage nuts for
square-hole rack installation
Cables and connectors
The shipment for the StorageGRID appliance includes the following cables and connectors:
Preparing for installation | 13

Two power cords for your country.
Your cabinet might have special power cords
that you use instead of the power cords that ship
with the appliance.
Two optical cables for the FC interconnect ports
Eight SFP+ transceivers, compatible with both
the four 16Gb/s FC interconnect ports and the
four 10-GbE network ports
Obtaining additional equipment and tools
Before installing the StorageGRID appliance, confirm you have all of the additional equipment and
tools that you need.
You need the following additional equipment to install and configure the hardware:
Phillips No. 2 screwdriver
Medium flat-blade screwdriver
ESD wrist strap
Optical cables for the 10/25-GbE ports you plan
to use
Optional: SFP28 transceivers if you want to use
25-GbE link speed
Ethernet cables
14 | Hardware Installation and Maintenance Guide for SG5700 Appliances

Service laptop
Supported web browser
SSH client, such as PuTTY
1-Gb (RJ-45) Ethernet port
Optional tools
Power drill with Phillips head bit
Flashlight
Mechanized lift for SG5760
Web browser requirements
You must use a supported web browser.
Web browser Minimum supported version
Google Chrome 70
Microsoft Internet Explorer 11 (Native Mode)
Mozilla Firefox 63
You should set the browser window to a recommended width.
Browser width Pixels
Minimum 1024
Optimum 1280
Reviewing appliance network connections
Before installing the StorageGRID appliance, you should understand which networks can be
connected to the appliance and how the ports on each controller are used.
StorageGRID appliance networks
When you deploy a StorageGRID appliance as a Storage Node in a StorageGRID grid, you can
connect it to the following networks:
•Grid Network for StorageGRID: The Grid Network is used for all internal StorageGRID traffic.
It provides connectivity between all nodes in the grid, across all sites and subnets. The Grid
Network is required.
•Admin Network for StorageGRID: The Admin Network is a closed network used for system
administration and maintenance. The Admin Network is typically a private network and does not
need to be routable between sites. The Admin Network is optional.
•Client Network for StorageGRID: The Client Network is an open network used to provide
access to client applications, including S3 and Swift. The Client Network provides client protocol
Preparing for installation | 15

access to the grid, so the Grid Network can be isolated and secured. The Client Network is
optional.
•Management network for SANtricity System Manager: This network provides access to
SANtricity System Manager on the E2800 controller, allowing you to monitor and manage the
hardware components in the appliance. This management network can be the same as the Admin
Network for StorageGRID, or it can be an independent management network.
Note: For detailed information about StorageGRID networks, see the installation instructions for
your platform.
StorageGRID appliance connections
When you install a StorageGRID appliance, you must connect the two controllers to each other and
to the required networks. The figure shows the two controllers in the SG5760, with the E2800
controller on the top and the E5700SG controller on the bottom. In the SG5712, the E2800 controller
is to the left of the E5700SG controller.
Port Type of port Function
1 Two interconnect ports
on each controller 16Gb/s FC optical SFP+ Connect the two controllers to each other.
2 Management port 1 on
the E2800 controller 1-GbE (RJ-45) Connects to the network where you access SANtricity System Manager.
You can use the Admin Network for
StorageGRID or an independent
management network.
Management port 2 on
the E2800 controller 1-GbE (RJ-45) Reserved for technical support.
16 | Hardware Installation and Maintenance Guide for SG5700 Appliances

Port Type of port Function
3 Management port 1 on
the E5700SG
controller
1-GbE (RJ-45) Connects the E5700SG controller to the
Admin Network for StorageGRID.
Management port 2 on
the E5700SG
controller
1-GbE (RJ-45) • Can be bonded with management
port 1 if you want a redundant
connection to the Admin Network.
• Can be left unwired and available
for temporary local access (IP
169.254.0.1).
• During installation, can be used to
connect the E5700SG controller to a
service laptop if DHCP-assigned IP
addresses are not available.
410/25-GbE ports 1-4
on the E5700SG
controller
10-GbE or 25-GbE
Note: The SFP+
transceivers
included with the
appliance support
10-GbE link speeds.
If you want to use
25-GbE link speeds
for the four network
ports, you must
provide SFP28
transceivers.
Connect to the Grid Network and the
Client Network for StorageGRID. See
“10/25-GbE port connections for the
E5700SG controller.”
Related concepts
Port bond modes for E5700SG controller ports on page 17
Related tasks
Gathering installation information on page 19
Cabling the appliance on page 26
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
Port bond modes for E5700SG controller ports
When configuring network links for the E5700SG controller ports, you can use port bonding for the
10/25-GbE ports that connect to the Grid Network and optional Client Network, and the 1-GbE
management ports that connect to the optional Admin Network. Port bonding helps protect your data
by providing redundant paths between StorageGRID networks and the appliance.
Related tasks
Configuring network links on page 36
Preparing for installation | 17

Network bond modes for the 10/25-GbE ports
The 10/25-GbE networking ports on the E5700SG controller controller support Fixed port bond
mode or Aggregate port bond mode for the Grid Network and Client Network connections.
Fixed port bond mode
Fixed mode is the default configuration for the 10/25-GbE networking ports.
Callout Which ports are bonded
C Ports 1 and 3 are bonded together for the Client Network, if this network is used.
G Ports 2 and 4 are bonded together for the Grid Network.
When using Fixed port bond mode, you can use one of two network bond modes: Active-Backup or
Link Aggregation Control Protocol (LACP).
• In Active-Backup mode (default), only one port is active at a time. If the active port fails, its
backup port automatically provides a failover connection. Port 4 provides a backup path for port 2
(Grid Network), and port 3 provides a backup path for port 1 (Client Network).
• In LACP mode, each pair of ports forms a logical channel between the controller and the network,
allowing for higher throughput. If one port fails, the other port provides a failover connection.
Throughput is reduced, but connectivity is not impacted.
Note: If you do not need redundant connections, you can use only one port for each network.
However, be aware that an alarm will be raised in the Grid Manager after StorageGRID is
installed, indicating that a cable is unplugged. You can safely acknowledge this alarm to clear it.
Aggregate port bond mode
Aggregate port bond mode significantly increases the throughout for each StorageGRID network and
provides additional failover paths.
Callout Which ports are bonded
1 All connected ports are grouped in a single LACP bond, allowing all ports to be used
for Grid Network and Client Network traffic.
18 | Hardware Installation and Maintenance Guide for SG5700 Appliances

If you plan to use Aggregate port bond mode:
• You must use LACP network bond mode.
• You must specify a unique VLAN tag for each network. This VLAN tag will be added to each
network packet to ensure that network traffic is routed to the correct network.
• The ports must be connected to switches that can support VLAN and LACP. If multiple switches
are participating in the LACP bond, the switches must support multi-chassis link aggregation
groups (MLAG), or equivalent.
• You must understand how to configure the switches to use VLAN, LACP, and MLAG, or
equivalent.
If you do not want to use all four 10/25-GbE ports, you can use one, two, or three ports. Using more
than one port maximizes the chance that some network connectivity will remain available if one of
the 10/25-GbE ports fails.
Note: If you choose to use fewer than four ports, be aware that one or more alarms will be raised
in the Grid Manager after StorageGRID is installed, indicating that cables are unplugged. You can
safely acknowledge the alarms to clear them.
Network bond modes for the 1-GbE management ports
For the two 1-GbE management ports on the E5700SG controller, you can choose Independent
network bond mode or Active-Backup network bond mode to connect to the optional Admin
Network.
In Independent mode, only management port 1 is connected to the Admin Network. This mode does
not provide a redundant path. Management port 2 is left unwired and available for temporary local
connections (use IP address 169.254.0.1)
In Active-Backup mode, both management ports 1 and 2 are connected to the Admin Network. Only
one port is active at a time. If the active port fails, its backup port automatically provides a failover
connection. Bonding these two physical ports into one logical management port provides a redundant
path to the Admin Network.
Note: If you need to make a temporary local connection to the E5700SG controller when the 1-
GbE management ports are configured for Active-Backup mode, remove the cables from both
management ports, plug your temporary cable into management port 2, and access the appliance
using IP address 169.254.0.1.
Gathering installation information
As you install and configure the StorageGRID appliance, you must make decisions and gather
information about Ethernet switch ports, IP addresses, and port and network bond modes.
About this task
You can use the following tables to record the required information for each network you connect to
the appliance. These values are required to install and configure the hardware.
Preparing for installation | 19

Table 1: Information needed to connect to SANtricity System Manager on the E2800
controller
You must connect the E2800 controller to the management network you will use for SANtricity
System Manager.
Information needed Your value
Ethernet switch port you will connect to
management port 1
MAC address for management port 1 (printed
on a label near port P1)
DHCP-assigned IP address for management
port 1, if available after power on
Note: If the network you will connect to the
E2800 controller includes a DHCP server, the
network administrator can use the MAC
address to determine the IP address that was
assigned by the DHCP server.
Speed and duplex mode
Note: You must make sure the Ethernet
switch for the SANtricity System Manager
management network is set to autonegotiate.
Must be:
• Autonegotiate (default)
IP address format Choose one:
• IPv4
• IPv6
Static IP address you plan to use for the
appliance on the management network For IPv4:
• IPv4 address:
• Subnet mask:
• Gateway:
For IPv6:
• IPv6 address:
• Routable IP address:
• E2800 controller router IP address:
Table 2: Information needed to connect the E5700SG controller to the Admin Network
The Admin Network for StorageGRID is an optional network, used for system administration and
maintenance. The appliance connects to the Admin Network using the 1-GbE management ports on
the E5700SG controller.
20 | Hardware Installation and Maintenance Guide for SG5700 Appliances