NetApp StorageGRID Webscale SG5700 Series Operating manual

StorageGRID®Webscale 11.0
Hardware Installation and
Maintenance Guide
For StorageGRID Webscale SG5700 Series Appliances
January 2018 | 215-12407_B0
docc[email protected]

Contents
StorageGRID Webscale appliance overview .............................................. 5
Controllers in the StorageGRID Webscale appliance ................................................. 7
Installation overview .................................................................................. 10
Preparing for installation ........................................................................... 12
Preparing the site ....................................................................................................... 12
Unpacking the boxes ................................................................................................. 13
Obtaining additional equipment and tools ................................................................ 14
Web browser requirements ........................................................................................ 15
Reviewing appliance network connections ............................................................... 15
10/25-GbE port connections for the E5700SG controller ............................. 17
Gathering installation information ............................................................................ 19
Installing the hardware .............................................................................. 24
Registering the hardware ........................................................................................... 24
Installing the appliance in a cabinet or rack .............................................................. 25
Cabling the appliance ................................................................................................ 26
Connecting power cords and applying power ........................................................... 28
Viewing boot-up status codes .................................................................................... 29
Status indicators on the E5700SG controller ................................................ 30
Configuring the hardware ......................................................................... 33
Configuring SANtricity System Manager ................................................................. 33
Accessing SANtricity System Manager ........................................................ 33
Setting the IP address for the E2800 management port ................................ 35
Setting up SANtricity System Manager ........................................................ 38
Reviewing the hardware status in SANtricity System Manager ................... 39
Configuring StorageGRID Webscale connections .................................................... 41
Accessing the StorageGRID Webscale Appliance Installer .......................... 41
Configuring network links ............................................................................. 43
Setting the IP configuration ........................................................................... 47
Verifying network connections ...................................................................... 50
Optional: Changing to RAID6 mode (SG5760 only) ................................................ 51
Optional: Remapping network ports for the appliance ............................................. 52
Where to go next ......................................................................................... 53
Troubleshooting the hardware installation .............................................. 54
Hardware setup appears to hang ................................................................................ 54
HE error: Error synchronizing with SANtricity OS Software ...................... 55
Troubleshooting connection issues ........................................................................... 55
Unable to connect to the appliance ............................................................... 55
Rebooting the E5700SG controller while the StorageGRID Webscale Appliance
Installer is running ............................................................................................... 56
Maintaining a StorageGRID Webscale appliance ................................... 57
Upgrading SANtricity OS Software for the E2800 controller .................................. 57
Table of Contents | 3

Replacing the E2800 controller ................................................................................. 58
Replacing the E5700SG controller ............................................................................ 61
Replacing other hardware components ..................................................................... 63
Copyright information ............................................................................... 64
Trademark information ............................................................................. 65
How to send comments about documentation and receive update
notifications ............................................................................................ 66
Index ............................................................................................................. 67
4| Hardware Installation and Maintenance Guide for SG5700 Appliances

StorageGRID Webscale appliance overview
The SG5700 StorageGRID Webscale appliance is an integrated storage and computing platform that
operates as a Storage Node in a StorageGRID Webscale grid. The appliance can be used in a hybrid
grid environment that combines appliance Storage Nodes and virtual (software-based) Storage
Nodes.
The StorageGRID Webscale SG5700 appliance provides the following features:
• Integrates the storage and computing elements for a StorageGRID Webscale Storage Node.
• Includes the StorageGRID Webscale Appliance Installer to simplify Storage Node deployment
and configuration.
• Includes E-Series SANtricity System Manager for hardware management and monitoring.
• Supports up to four 10-GbE or 25-GbE connections to the StorageGRID Webscale Grid Network
and Client Network.
• Supports Full Disk Encryption (FDE) drives or Federal Information Processing Standard (FIPS)
drives. When these drives are used with the Drive Security feature in SANtricity System
Manager, unauthorized access to data is prevented.
The SG5700 appliance is available in two models: the SG5712 and the SG5760. Both models include
the following components:
Component SG5712 SG5760
Compute controller E5700SG controller E5700SG controller
Storage controller E-Series E2800 controller E-Series E2800 controller
Chassis E-Series DE212C enclosure, a two
rack-unit (2U) enclosure E-Series DE460C enclosure, a four rack-unit (4U) enclosure
Drives 12 NL-SAS drives (3.5-inch) 60 NL-SAS drives (3.5-inch)
Redundant power
supplies and fans Two power-fan canisters Two power canisters and two fan canisters
Note: The E5700SG controller is highly customized for use in the StorageGRID Webscale
appliance. All other components operate as described in E-Series documentation, except as
indicated in this guide.
The maximum raw storage available in the StorageGRID Webscale appliance is fixed, based on the
number of drives in each enclosure. You cannot expand the available storage by adding a shelf with
additional drives.
Model SG5712
This figure shows the front and back of the SG5712 model, a 2U enclosure that holds 12 drives.
5

The SG5712 includes two controllers and two power-fan canisters.
1E2800 controller (storage controller)
2 E5700SG controller (compute controller)
3 Power-fan canisters
Model SG5760
This figure shows the front and back of the SG5760 model, a 4U enclosure that holds 60 drives in 5
drive drawers.
6| Hardware Installation and Maintenance Guide for SG5700 Appliances

The SG5760 includes two controllers, two fan canisters, and two power canisters.
1E2800 controller (storage controller)
2 E5700SG controller (compute controller)
3 Fan canister (1 of 2)
4 Power canister (1 of 2)
Related information
NetApp E-Series Systems Documentation Center
Controllers in the StorageGRID Webscale appliance
Both the SG5712 and SG5760 models of the StorageGRID Webscale appliance include an E5700SG
controller and an E2800 controller. You should review the diagrams to learn the differences between
the controllers.
E5700SG controller
• Operates as the compute server for the appliance.
• Includes the StorageGRID Webscale Appliance Installer.
Note: StorageGRID Webscale software is not preinstalled on the appliance. This software is
accessed from the Admin Node when you deploy the appliance.
• Can connect to all three StorageGRID Webscale networks, including the Grid Network, the
Admin Network, and the Client Network.
• Connects to the E2800 controller and operates as the initiator.
Note: The E5700SG controller is highly customized for use in a StorageGRID Webscale system.
Do not use E-Series procedures for this controller unless instructed otherwise. For more
information, see “Maintaining your StorageGRID Webscale appliance” in this guide.
This figure shows the connectors on the back of the E5700SG controller.
StorageGRID Webscale appliance overview | 7

Port Type Use
1 Interconnect
ports 1 and 2 16Gb/s Fibre Channel (FC), optical SFP+ Connect the E5700SG controller to the E2800 controller.
2 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial port
• USB port
Reserved for technical support use.
3 Drive expansion
ports 12Gb/s SAS Not used. StorageGRID Webscale appliances do not support expansion drive
shelves.
4 Network ports
1-4 10-GbE or 25-GbE, based on SFP transceiver type,
switch speed, and
configured link speed
Connect to the Grid Network and the Client
Network for StorageGRID Webscale.
5 Management
ports 1 and 2 1-Gb (RJ-45) Ethernet • Port 1 connects to the Admin Network
for StorageGRID Webscale.
• Port 2 is used during installation if
DHCP-assigned IP addresses are not
available.
E2800 controller
• Operates as the storage controller for the appliance.
• Manages the storage of data on the drives.
• Functions as a standard E-Series controller in simplex mode.
• Includes SANtricity OS Software (controller firmware).
• Includes SANtricity System Manager for monitoring appliance hardware and for managing alerts,
the AutoSupport feature, and the Drive Security feature.
• Connects to the E5700SG controller and operates as the target.
This figure shows the connectors on the back of the E2800 controller.
8| Hardware Installation and Maintenance Guide for SG5700 Appliances

Port Type Use
1 Interconnect
ports 1 and 2 16Gb/s FC optical SFP+ Connect the E2800 controller to the E5700SG controller.
2 Management
ports 1 and 2 1-Gb (RJ-45) Ethernet • Port 1 connects to the network where you
access SANtricity System Manager on a
browser.
• Port 2 is reserved for technical support
use.
3 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial
port
• USB port
Reserved for technical support use.
4 Drive expansion
ports. 12Gb/s SAS Not used. StorageGRID Webscale appliances do not support expansion drive shelves.
StorageGRID Webscale appliance overview | 9

Installation overview
You can install one or more StorageGRID Webscale appliances when you first deploy StorageGRID
Webscale, or you can add appliance Storage Nodes later as part of an expansion. You might also need
to install an appliance Storage Node as part of a recovery operation.
Installing a StorageGRID Webscale appliance includes two primary phases.
1. Installing and configuring appliance hardware
This guide describes the first phase of installing a StorageGRID Webscale appliance, which includes
these steps:
1. Preparing for installation:
• Preparing the installation site
• Unpacking the boxes and checking the contents
• Obtaining additional equipment and tools
• Gathering IP addresses and network information
2. Installing the hardware:
• Registering the hardware
• Installing the appliance into a cabinet or rack
• Installing the drives (SG5760 only)
• Cabling the appliance
• Connecting the power cords and applying power
• Viewing boot-up status codes
3. Configuring the hardware:
• Accessing SANtricity System Manager, setting a static IP address for management port 1 on
the E2800 controller, and configuring SANtricity System Manager settings
• Accessing StorageGRID Webscale Appliance Installer and configuring the link and network
IP settings required to connect to StorageGRID Webscale networks
2. Deploying an appliance Storage Node
After the appliance hardware has been installed and configured using the instructions in this guide,
you can deploy the appliance as a Storage Node in a StorageGRID Webscale grid.
Task Instructions
Deploying an appliance Storage Node in a new
StorageGRID Webscale grid
StorageGRID Webscale Installation Guide for
your platform
Adding an appliance Storage Node to an
existing StorageGRID Webscale grid
StorageGRID Webscale Expansion Guide
Deploying an appliance Storage Node as part of
a Storage Node recovery operation
StorageGRID Webscale Recovery and
Maintenance Guide
10

Related tasks
Preparing for installation on page 12
Installing the hardware on page 24
Configuring the hardware on page 33
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
Expanding a StorageGRID Webscale grid
Recovery and maintenance
Installation overview | 11

Preparing for installation
Preparing to install a StorageGRID Webscale appliance entails preparing the site and obtaining all
required hardware, cables, and tools. You should also gather IP addresses and network information.
Steps
1. Preparing the site on page 12
2. Unpacking the boxes on page 13
3. Obtaining additional equipment and tools on page 14
4. Web browser requirements on page 15
5. Reviewing appliance network connections on page 15
6. Gathering installation information on page 19
Preparing the site
Before installing the appliance, you must make sure that the site and the cabinet or rack you plan to
use meet the specifications for a StorageGRID Webscale appliance.
Steps
1. Confirm that the site meets the requirements for temperature, humidity, altitude range, airflow,
heat dissipation, wiring, power, and grounding. See the NetApp Hardware Universe for more
information.
2. If you are installing the SG5760 model, confirm that your location provides 240-volt AC power.
3. Obtain a 19-inch (48.3-cm) cabinet or rack to fit shelves of this size (without cables):
Appliance
model Height Width Depth Maximum weight
SG5712
(12 drives)
3.41 in.
(8.68 cm)
17.6 in.
(44.7 cm)
21.1 in.
(53.6 cm)
63.9 lb
(29.0 kg)
SG5760
(60 drives)
6.87 in.
(17.46 cm)
17.66 in.
(44.86 cm)
38.25 in.
(97.16 cm)
250 lb.
(113 kg)
4. Install any required network switches. See the NetApp Interoperability Matrix Tool for
compatibility information.
Related information
NetApp Hardware Universe
NetApp Interoperability Matrix Tool
12

Unpacking the boxes
Before installing the StorageGRID Webscale appliance, unpack all boxes and compare the contents
to the items on the packing slip.
SG5712 appliance with 12 drives installed
SG5760 appliance with no drives installed
Front bezel for the appliance
Rail kit with instructions
SG5760: Sixty drives
SG5760: Handles
SG5760: Back brackets and cage nuts for
square-hole rack installation
Preparing for installation | 13

Cables and connectors
The shipment for the StorageGRID Webscale appliance includes the following cables and
connectors:
Two power cords for your country.
Your cabinet might have special power cords
that you use instead of the power cords that ship
with the appliance.
Two optical cables for the FC interconnect ports
Eight SFP+ transceivers, compatible with both
the four 16Gb/s FC interconnect ports and the
four 10-GbE network ports
Obtaining additional equipment and tools
Before installing the StorageGRID Webscale appliance, confirm you have all of the additional
equipment and tools that you need.
You need the following additional equipment to install and configure the hardware:
Phillips No. 2 screwdriver
Medium flat-blade screwdriver
ESD wrist strap
Optical cables for the 10/25-GbE ports you plan
to use
Optional: SFP28 transceivers if you want to use
25-GbE link speed
Ethernet cables
14 | Hardware Installation and Maintenance Guide for SG5700 Appliances

Service laptop
Supported web browser
SSH client, such as PuTTY
1-Gb (RJ-45) Ethernet port
Optional tools
Power drill with Phillips head bit
Flashlight
Mechanized lift for SG5760
Web browser requirements
You must use a supported web browser.
Web browser Minimum supported version
Google Chrome 54
Microsoft Internet Explorer 11 (Native Mode)
Mozilla Firefox 50
You should set the browser window to a recommended width.
Browser width Pixels
Minimum 1024
Optimum 1280
Reviewing appliance network connections
Before installing the StorageGRID Webscale appliance, you should understand which networks can
be connected to the appliance and how the ports on each controller are used.
StorageGRID Webscale appliance networks
When you deploy a StorageGRID Webscale appliance as a Storage Node in a StorageGRID
Webscale grid, you can connect it to the following networks:
•Grid Network for StorageGRID Webscale: The Grid Network is used for all internal
StorageGRID Webscale traffic. It provides connectivity between all nodes in the grid, across all
sites and subnets. The Grid Network is required.
•Admin Network for StorageGRID Webscale: The Admin Network is a closed network used for
system administration and maintenance. The Admin Network is typically a private network and
does not need to be routable between sites. The Admin Network is optional.
•Client Network for StorageGRID Webscale: The Client Network is an open network used to
provide access to client applications, including S3 and Swift. The Client Network provides client
Preparing for installation | 15

protocol access to the grid, so the Grid Network can be isolated and secured. The Client Network
is optional.
•Management network for SANtricity System Manager: This network provides access to
SANtricity System Manager on the E2800 controller, allowing you to monitor and manage the
hardware components in the appliance. This management network can be the same as the Admin
Network for StorageGRID Webscale, or it can be an independent management network.
Note: For detailed information about StorageGRID Webscale networks, see the appropriate
StorageGRID Webscale Installation Guide .
StorageGRID Webscale appliance connections
When you install a StorageGRID Webscale appliance, you must connect the two controllers to each
other and to the required networks. The figure shows the two controllers in the SG5760, with the
E2800 controller on the top and the E5700SG controller on the bottom. In the SG5712, the E2800
controller is to the left of the E5700SG controller.
Port Type of port Function
1 Two interconnect ports
on each controller 16Gb/s FC optical SFP+ Connect the two controllers to each other.
2 Management port 1 on
the E2800 controller 1-Gb (RJ-45) Ethernet Connects to the network where you access SANtricity System Manager.
You can use the Admin Network for
StorageGRID Webscale or an
independent management network.
Management port 2 on
the E2800 controller 1-Gb (RJ-45) Ethernet Reserved for technical support.
3 Management port 1 on
the E5700SG
controller
1-Gb (RJ-45) Ethernet Connects the E5700SG controller to the
Admin Network for StorageGRID
Webscale.
Management port 2 on
the E5700SG
controller
1-Gb (RJ-45) Ethernet Can be used to connect the E5700SG
controller to a service laptop during
installation, if a DHCP-assigned IP
address is not available.
16 | Hardware Installation and Maintenance Guide for SG5700 Appliances

Port Type of port Function
4 10/25-GbE ports 1-4
on the E5700SG
controller
10-GbE or 25-GbE
Note: The SFP+
transceivers
included with the
appliance support
10-GbE link speeds.
If you want to use
25-GbE link speeds
for the four network
ports, you must
provide SFP28
transceivers.
Connect to the Grid Network and the
Client Network for StorageGRID
Webscale. See “10/25-GbE port
connections for the E5700SG
controller.”
Related concepts
10/25-GbE port connections for the E5700SG controller on page 17
Related tasks
Gathering installation information on page 19
Cabling the appliance on page 26
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
10/25-GbE port connections for the E5700SG controller
When connecting the 10/25-GbE ports on the E5700SG controller to the StorageGRID Webscale
Grid Network and Client Network, you can use fixed port bond mode or aggregate port bond mode.
The port bond modes help protect your data by providing redundant paths between StorageGRID
Webscale networks and the appliance.
Related tasks
Configuring network links on page 43
Fixed port bond mode
Fixed port bond mode is the default configuration for the 10/25-GbE ports.
Callout Which ports are bonded
C Ports 1 and 3 are bonded together for the Client Network, if this network is used.
Preparing for installation | 17

Callout Which ports are bonded
G Ports 2 and 4 are bonded together for the Grid Network.
When using Fixed port bond mode, the ports can be bonded using active-backup mode or Link
Aggregation Control Protocol mode (LACP 802.3ad).
• In active-backup mode (default), only one port is active at a time. If the active port fails, its
backup port automatically provides a failover connection. Port 4 provides a backup path for port 2
(Grid Network), and port 3 provides a backup path for port 1 (Client Network).
• In LACP mode, each pair of ports forms a logical channel between the controller and the network,
allowing for higher throughput. If one port fails, the other port provides a failover connection.
Throughput is reduced, but connectivity is not impacted.
Note: If you do not need redundant connections, you can use only one port for each network.
However, be aware that an alarm will be raised in the Grid Management Interface after
StorageGRID Webscale is installed, indicating that a cable is unplugged. You can safely
acknowledge this alarm to clear it.
Aggregate port bond mode
Aggregate port bond mode significantly increases the throughout for each StorageGRID Webscale
network and provides additional failover paths.
Callout Which ports are bonded
1 All connected ports are grouped in a single LACP bond, allowing all ports to be used
for Grid Network and Client Network traffic.
If you plan to use aggregate port bond mode:
• You must specify a unique VLAN tag for each network. This VLAN tag will be added to each
network packet to ensure that network traffic is routed to the correct network.
• The ports must be connected to switches that can support VLAN and LACP. If multiple switches
are participating in the LACP bond, the switches must support multi-chassis link aggregation
groups (MLAG), or equivalent.
• You must understand how to configure the switches to use VLAN, LACP, and MLAG, or
equivalent.
If you do not want to use all four 10/25-GbE ports, you can use one, two, or three ports. Using more
than one port maximizes the chance that some network connectivity will remain available if one of
the 10/25-GbE ports fails.
Note: If you choose to use fewer than four ports, be aware that one or more alarms will be raised
in the Grid Management Interface after StorageGRID Webscale is installed, indicating that cables
are unplugged. You can safely acknowledge the alarms to clear them.
18 | Hardware Installation and Maintenance Guide for SG5700 Appliances

Gathering installation information
As you install and configure the StorageGRID Webscale appliance, you must make decisions and
gather information about Ethernet switch ports, IP addresses, and port and network bond modes. You
can use the following tables to record the required information for each network you connect to the
appliance.
About this task
The following values will be required when you install and configure the hardware.
Table 1: Information needed to connect to SANtricity System Manager on the E2800
controller
You must connect the E2800 controller to the management network you will use for SANtricity
System Manager.
Information needed Your value
Ethernet switch port you will connect to
management port 1
MAC address for management port 1 (printed
on a label near port P1)
DHCP-assigned IP address for management
port 1, if available after power on
Note: If the network you will connect to the
E2800 controller includes a DHCP server, the
network administrator can use the MAC
address to determine the IP address that was
assigned by the DHCP server.
Speed and duplex mode
Note: You must make sure the Ethernet
switch for the SANtricity System Manager
management network is set to autonegotiate.
Must be:
• Autonegotiate (default)
IP address format Choose one:
• IPv4
• IPv6
Static IP address you plan to use for the
appliance on the management network For IPv4:
• IPv4 address:
• Subnet mask:
• Gateway:
For IPv6:
• IPv6 address:
• Routable IP address:
• E2800 controller router IP address:
Preparing for installation | 19

Table 2: Information needed to connect the E5700SG controller to the Admin Network
The Admin Network for StorageGRID Webscale is an optional network, used for system
administration and maintenance. The appliance connects to the Admin Network using the 1-GbE
management port 1 on the E5700SG controller.
Information needed Your value
Admin Network enabled Choose one:
• No
• Yes (default)
Ethernet switch port you will connect to
management port 1 (P1)
MAC address for management port 1 (printed
on a label near port P1)
DHCP-assigned IP address for management
port 1, if available after power on
Note: If the Admin Network includes a
DHCP server, the E5700SG controller
displays the DHCP-assigned IP address on its
seven-segment display after it boots up. You
can also determine the DHCP-assigned IP
address by using the MAC address to look up
the assigned IP.
• IPv4 address (CIDR):
• Gateway:
Static IP address you plan to use for the
appliance Storage Node on the Admin Network
Note: If your network does not have a
gateway, specify the same static IPv4 address
for the gateway.
• IPv4 address (CIDR):
• Gateway:
Admin Network subnets (CIDR)
Table 3: Information needed to connect and configure the 10/25-GbE ports on the
E5700SG controller
The four 10/25-GbE ports on the E5700SG controller connect to the StorageGRID Webscale Grid
Network and Client Network.
Note: See “10/25-GbE port connections for the E5700SG controller” for more information about
the options for these ports.
Information needed Your value
Link speed
Note: If you select 25 GbE, you must install
SPF28 transceivers. Auto-negotiation is not
supported, so you must also configure the
ports and the connected switches for 25GbE.
Choose one:
• 10 GbE (default)
• 25 GbE
20 | Hardware Installation and Maintenance Guide for SG5700 Appliances