NetApp StorageGRID Webscale SG6000 Series Product manual

StorageGRID®Webscale 11.1
Hardware Installation and
Maintenance Guide
For StorageGRID Webscale SG6000 Series Appliances
December 2018 | 215-13530_B0
docc[email protected]

Contents
StorageGRID Webscale appliance overview .............................................. 5
Controllers in the SG6000 appliance .......................................................................... 7
Installation overview .................................................................................. 10
Preparing for installation ........................................................................... 12
Preparing the site ....................................................................................................... 12
Unpacking the boxes ................................................................................................. 13
Obtaining additional equipment and tools ................................................................ 14
Web browser requirements ........................................................................................ 15
Reviewing appliance network connections ............................................................... 16
10/25-GbE port connections for the SG6000-CN controller ........................ 16
Gathering installation information ............................................................................ 18
Installing the hardware .............................................................................. 24
Registering the hardware ........................................................................................... 24
Installing the E2860 controller shelf in a cabinet or rack ......................................... 25
Installing drives in the E2860 controller shelf .......................................................... 27
Installing the SG6000-CN controller in a cabinet or rack ......................................... 28
Cabling the appliance ................................................................................................ 29
Connecting power cords and applying power ........................................................... 31
Viewing boot-up status codes for the E2800 controllers ........................................... 32
Viewing status indicators and buttons on the SG6000-CN controller ....................... 33
Configuring the hardware ......................................................................... 35
Configuring SANtricity System Manager ................................................................. 35
Accessing SANtricity System Manager ........................................................ 35
Setting the IP addresses for the E2800 controllers ........................................ 37
Setting up SANtricity System Manager ........................................................ 40
Reviewing the hardware status in SANtricity System Manager ................... 41
Configuring StorageGRID Webscale connections .................................................... 42
Accessing the StorageGRID Appliance Installer .......................................... 43
Configuring network links ............................................................................. 44
Configuring StorageGRID Webscale IP addresses ....................................... 48
Verifying network connections ...................................................................... 51
Configuring the BMC interface ................................................................................. 52
Setting the IP address for the BMC management port .................................. 52
Accessing the BMC interface and changing the root password .................... 54
Configuring SNMP settings for the SG6000-CN controller ......................... 55
Optional: Changing to RAID6 mode ........................................................................ 56
Optional: Remapping network ports for the appliance ............................................. 57
Where to go next ......................................................................................... 58
Troubleshooting the hardware installation .............................................. 59
Viewing boot-up codes for the SG6000-CN controller ............................................. 59
Viewing error codes for the SG6000-CN controller ................................................. 60
Table of Contents | 3

Hardware setup appears to hang ................................................................................ 62
Troubleshooting connection issues ........................................................................... 62
Unable to connect to the appliance ............................................................... 62
Rebooting the SG6000-CN controller while the StorageGRID Appliance
Installer is running ............................................................................................... 63
Maintaining the SG6000 appliance ........................................................... 65
Upgrading SANtricity OS Software on the E2800 controllers ................................. 65
Replacing an E2800 controller .................................................................................. 67
Replacing hardware components in the E2860 controller shelf ................................ 72
Replacing the SG6000-CN controller ....................................................................... 73
Replacing a power supply in the SG6000-CN controller .......................................... 74
Changing the link configuration of the SG6000-CN controller ................................ 76
Copyright information ............................................................................... 79
Trademark .................................................................................................. 80
How to send comments about documentation and receive update
notifications ............................................................................................ 81
Index ............................................................................................................. 82
4| Hardware Installation and Maintenance Guide for SG6000 Appliances

StorageGRID Webscale appliance overview
The StorageGRID Webscale SG6000 appliance is an integrated storage and computing platform that
operates as a Storage Node in a StorageGRID Webscale grid. The appliance can be used in a hybrid
grid environment that combines appliance Storage Nodes and virtual (software-based) Storage
Nodes.
The SG6000 appliance provides the following features:
• Integrates the storage and computing elements for a StorageGRID Webscale Storage Node.
• Includes the StorageGRID Appliance Installer to simplify Storage Node deployment and
configuration.
• Includes SANtricity System Manager for managing and monitoring the storage controllers and
drives.
• Includes a baseboard management controller (BMC) for monitoring and diagnosing the hardware
in the compute controller.
• Supports up to four 10-GbE or 25-GbE connections to the StorageGRID Webscale Grid Network
and Client Network.
• Supports Federal Information Processing Standard (FIPS) drives. When these drives are used with
the Drive Security feature in SANtricity System Manager, unauthorized access to data is
prevented.
Model SG6060 components
The SG6000 appliance is available in the SG6060 model, which includes the following components:
Component Description
Compute controller SG6000-CN controller, a one-rack unit (1U) server, which
includes:
• 40 cores (80 threads)
• 192 GB RAM
• Up to 4 x 25 Gbps aggregate Ethernet bandwidth
• 4 x 16 Gbps Fibre Channel (FC) interconnect
• Baseboard management controller (BMC) that
simplifies hardware management
• Redundant power supplies
Storage controller shelf E-Series E2860 controller shelf (storage array), a 4U shelf
which includes:
• Two E-Series E2800 controllers (duplex configuration)
to provide storage controller failover support
• Five-drawer drive shelf that holds sixty 3.5-inch drives
(2 SSD and 58 NL-SAS)
• Redundant power supplies and fans
5

The maximum raw storage available in the StorageGRID Webscale appliance is limited to drives
within the single storage controller shelf. You cannot expand the available storage by adding a shelf
with additional drives.
Model SG6060 diagrams
This figure shows the front of the SG6060 model, which includes a 1U compute controller, and a 4U
enclosure containing the storage controllers and 60 drives in five drive drawers.
1SG6000-CN compute controller with front bezel
2 E2860 controller shelf with front bezel
3 SG6000-CN compute controller with front bezel removed
4 E2860 controller shelf with front bezel removed
This figure shows the back of the SG6060 model, including the compute and storage controllers,
fans, and power supplies.
6| Hardware Installation and Maintenance Guide for SG6000 Appliances

1Power supply (1 of 2) for SG6000-CN compute controller
2 Connectors for SG6000-CN compute controller
3 Fan (1 of 2) for E2860 controller shelf
4 E-Series E2800 storage controller (1 of 2) and connectors
5 Power supply (1 of 2) for E2860 controller shelf
Controllers in the SG6000 appliance
The SG6060 model of the StorageGRID Webscale SG6000 appliance includes an SG6000-CN
compute controller in a 1U enclosure and two E2800 storage controllers in a 4U, 60-drive controller
shelf. Review the diagrams to learn more about each type of controller.
SG6000-CN compute controller
• Provides compute resources for the appliance.
• Includes the StorageGRID Appliance Installer.
Note: StorageGRID Webscale software is not preinstalled on the appliance. This software is
retrieved from the Admin Node when you deploy the appliance.
• Can connect to all three StorageGRID Webscale networks, including the Grid Network, the
Admin Network, and the Client Network.
• Connects to the two E2800 controllers and operates as the initiator.
This figure shows the connectors on the back of the SG6000-CN.
StorageGRID Webscale appliance overview | 7

Port Type Use
1 Interconnect
ports 1-4 16-Gb/s Fibre Channel (FC), with integrated optics Connect the SG6000-CN controller to the E2800 controllers (two connections to
each E2800).
2 Network ports
1-4 10-GbE or 25-GbE, based on cable or SFP transceiver
type, switch speed, and
configured link speed
Connect to the Grid Network and the
Client Network for StorageGRID
Webscale.
3 BMC
management
port
1-GbE (RJ-45) Connects to the SG6000-CN baseboard
management controller.
4 Diagnostic and
support ports • VGA
• Serial, 115200 8-N-1
• USB
Reserved for technical support use.
5 Admin Network
ports 1 and 2 1-GbE (RJ-45) • The left (primary) port connects the
SG6000-CN to the Admin Network for
StorageGRID Webscale.
• The right port can be used to connect
the SG6000-CN to a service laptop
during installation, if a DHCP assigned
IP address is not available for the
primary Admin Network port.
E2800 storage controllers
• Two controllers for failover support.
• Manage the storage of data on the drives.
• Function as standard E-Series controllers in a duplex configuration.
• Include SANtricity OS Software (controller firmware).
• Include SANtricity System Manager for monitoring storage hardware and for managing alerts,
the AutoSupport feature, and the Drive Security feature.
• Connect to the SG6000-CN controller and provide access to the storage.
This figure shows the connectors on the back of each of the E2800 controllers.
8| Hardware Installation and Maintenance Guide for SG6000 Appliances

Port Type Use
1 Interconnect
ports 1 and 2 16-Gb/s FC optical SFP+ Connect each of the E2800 controllers to the SG6000-CN controller.
There are four connections to the SG6000-
CN controller (two from each E2800).
2 Management
ports 1 and 2 1-Gb (RJ-45) Ethernet • Port 1 connects to the network where
you access SANtricity System Manager
on a browser.
• Port 2 is reserved for technical support
use.
3 Diagnostic and
support ports • RJ-45 serial port
• Micro USB serial port
• USB port
Reserved for technical support use.
4 Drive expansion
ports 12Gb/s SAS Not used. StorageGRID Webscale appliances do not support expansion drive
shelves.
StorageGRID Webscale appliance overview | 9

Installation overview
You can install one or more StorageGRID Webscale appliances when you first deploy StorageGRID
Webscale, or you can add appliance Storage Nodes later as part of an expansion. You might also need
to install an appliance Storage Node as part of a recovery operation.
Installing a StorageGRID Webscale appliance includes two primary phases.
Attention: Before you can use the SG6000 appliance as a Storage Node, you must install or
upgrade to StorageGRID Webscale 11.1.1 or later.
1. Installing and configuring appliance hardware
The first phase of installing a StorageGRID Webscale appliance includes these steps:
1. Preparing for installation:
• Preparing the installation site
• Unpacking the boxes and checking the contents
• Obtaining additional equipment and tools
• Gathering IP addresses and network information
2. Installing the hardware:
• Registering the hardware
• Installing the appliance into a cabinet or rack
• Installing the drives
• Cabling the appliance
• Connecting the power cords and applying power
• Viewing boot-up status codes
3. Configuring the hardware:
• Accessing SANtricity System Manager, setting a static IP address for management port 1 on
the E2800 controller, and configuring SANtricity System Manager settings
• Accessing StorageGRID Appliance Installer and configuring the link and network IP settings
required to connect to StorageGRID Webscale networks
• Accessing the baseboard management controller (BMC) interface on the SG6000-CN
controller
2. Deploying an appliance Storage Node
After the appliance hardware has been installed and configured using these instructions, you can
deploy the appliance as a Storage Node in a StorageGRID Webscale grid.
Task Instructions
Deploying an appliance Storage Node in a new
StorageGRID Webscale grid StorageGRID Webscale installation instructions for your platform
Adding an appliance Storage Node to an
existing StorageGRID Webscale grid Instructions for expanding a StorageGRID Webscale grid
10

Task Instructions
Deploying an appliance Storage Node as part of
a Storage Node recovery operation Instructions for recovery and maintenance
Related tasks
Preparing for installation on page 12
Installing the hardware on page 24
Configuring the hardware on page 35
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
Expanding a StorageGRID Webscale grid
Recovery and maintenance
Installation overview | 11

Preparing for installation
Preparing to install a StorageGRID Webscale appliance entails preparing the site and obtaining all
required hardware, cables, and tools. You should also gather IP addresses and network information.
Steps
1. Preparing the site on page 12
2. Unpacking the boxes on page 13
3. Obtaining additional equipment and tools on page 14
4. Web browser requirements on page 15
5. Reviewing appliance network connections on page 16
6. Gathering installation information on page 18
Preparing the site
Before installing the appliance, you must make sure that the site and the cabinet or rack you plan to
use meet the specifications for a StorageGRID Webscale appliance.
Steps
1. Confirm that the site meets the requirements for temperature, humidity, altitude range, airflow,
heat dissipation, wiring, power, and grounding. See the NetApp Hardware Universe for more
information.
2. Confirm that your location provides 240-volt AC power.
3. Obtain a 19-inch (48.3-cm) cabinet or rack to fit shelves of this size (without cables):
Controller Height Width Depth Maximum
weight
E2860 controller
shelf, including:
• Bezel
• 60 drives
• 2 power
canisters
• 2 controllers
• 2 fan
canisters
6.87 in.
(17.46 cm)
17.66 in.
(44.86 cm)
38.25 in.
(97.16 cm)
250 lb.
(113 kg)
SG6000-CN
controller
• Bezel
• 2 power
supplies
1.70 in.
(4.32 cm)
17.32 in.
(44.0 cm)
32.0 in.
(81.3 cm)
39 lb.
(17.7 kg)
4. Decide where you are going to install the appliance.
12

Caution: Install hardware from the bottom to the top of the rack or cabinet to prevent the
equipment from tipping over. To ensure that the heaviest equipment is at the bottom of the
cabinet or rack, install the SG6000-CN controller above the E2860 controller shelf.
Attention: If you are installing multiple SG6060 appliances in the same rack, consider
installing all the E2860 controller shelves toward the bottom, and the SG6000-CN controllers
toward the top. Before committing to the installation, verify that the 0.5m optic cables shipped
with the SG6060 appliance, or cables that you supply, are long enough for the planned layout.
Related information
NetApp Hardware Universe
NetApp Interoperability Matrix Tool
Unpacking the boxes
Before installing the StorageGRID Webscale appliance, unpack all boxes and compare the contents
to the items on the packing slip.
SG6000-CN controller
E2860 controller shelf with no drives installed
Two front bezels
Two rail kits with instructions
60 drives (2 SSD and 58 NL-SAS)
Four handles
Preparing for installation | 13

Back brackets and cage nuts for square-hole
rack installation
Cables and connectors
The shipment for the StorageGRID Webscale appliance includes the following cables and
connectors:
Four power cords for your country
Your cabinet might have special power cords
that you use instead of the power cords that ship
with the appliance.
Four optical cables for the FC interconnect ports
Four SFP+ transceivers, which support 16-Gb/s
FC
Obtaining additional equipment and tools
Before installing the StorageGRID Webscale appliance, confirm you have all of the additional
equipment and tools that you need.
You need the following additional equipment to install and configure the hardware:
Phillips No. 2 screwdriver
Medium flat-blade screwdriver
ESD wrist strap
14 | Hardware Installation and Maintenance Guide for SG6000 Appliances

You need one of the following options:
• One to four TwinAx cables or optical cables
for the 10/25-GbE ports you plan to use on
the SG6000-CN controller
• One to four SFP+ transceivers for the 10/25-
GbE ports if you will use optical cables and
10-GbE link speed
• One to four SFP28 transceivers for the
10/25-GbE ports if you will use optical
cables and 25-GbE link speed
RJ-45 (Cat5/Cat5e/Cat6) Ethernet cables
(four minimum)
Service laptop
Supported web browser
1-GbE (RJ-45) port
Optional tools
Power drill with Phillips head bit
Flashlight
Mechanized lift for E2860 controller shelf
Web browser requirements
You must use a supported web browser.
Web browser Minimum supported version
Google Chrome 54
Microsoft Internet Explorer 11 (Native Mode)
Mozilla Firefox 50
You should set the browser window to a recommended width.
Browser width Pixels
Minimum 1024
Optimum 1280
Preparing for installation | 15

Reviewing appliance network connections
Before installing the StorageGRID Webscale appliance, you should understand which networks can
be connected to the appliance.
When you deploy a StorageGRID Webscale appliance as a Storage Node in a StorageGRID
Webscale grid, you can connect it to the following networks:
•Grid Network for StorageGRID Webscale: The Grid Network is used for all internal
StorageGRID Webscale traffic. It provides connectivity between all nodes in the grid, across all
sites and subnets. The Grid Network is required.
•Admin Network for StorageGRID Webscale: The Admin Network is a closed network used for
system administration and maintenance. The Admin Network is typically a private network and
does not need to be routable between sites. The Admin Network is optional.
•Client Network for StorageGRID Webscale: The Client Network is an open network used to
provide access to client applications, including S3 and Swift. The Client Network provides client
protocol access to the grid, so the Grid Network can be isolated and secured. The Client Network
is optional.
•Management network for SANtricity System Manager: This network provides access to
SANtricity System Manager on the E2800 controller, allowing you to monitor and manage the
hardware components in the E2860 controller shelf. This management network can be the same
as the Admin Network for StorageGRID Webscale, or it can be an independent management
network.
•BMC management network for the SG6000-CN controller: This network provides access to
the baseboard management controller in the SG6000-CN, allowing you to monitor and manage
the hardware components in the SG6000-CN controller. This management network can be the
same as the Admin Network for StorageGRID Webscale, or it can be an independent management
network.
Note: For detailed information about StorageGRID Webscale networks, see the installation
instructions for your platform.
Related concepts
10/25-GbE port connections for the SG6000-CN controller on page 16
Related tasks
Gathering installation information on page 18
Cabling the appliance on page 29
Related information
VMware installation
Red Hat Enterprise Linux or CentOS installation
Ubuntu or Debian installation
10/25-GbE port connections for the SG6000-CN controller
When connecting the 10/25-GbE ports on the SG6000-CN controller to the StorageGRID Webscale
Grid Network and Client Network, you can use fixed port bond mode or aggregate port bond mode.
16 | Hardware Installation and Maintenance Guide for SG6000 Appliances

The port bond modes help protect your data by providing redundant paths between StorageGRID
Webscale networks and the appliance.
Related tasks
Configuring network links on page 44
Fixed port bond mode
Fixed port bond mode is the default configuration for the 10/25-GbE ports.
Callout Which ports are bonded
C Ports 1 and 3 are bonded together for the Client Network, if this network is used.
G Ports 2 and 4 are bonded together for the Grid Network.
When using Fixed port bond mode, the ports can be bonded using active-backup mode or Link
Aggregation Control Protocol mode (LACP 802.3ad).
• In active-backup mode (default), only one port is active at a time. If the active port fails, its
backup port automatically provides a failover connection. Port 4 provides a backup path for port 2
(Grid Network), and port 3 provides a backup path for port 1 (Client Network).
• In LACP mode, each pair of ports forms a logical channel between the controller and the network,
allowing for higher throughput. If one port fails, the other port provides a failover connection.
Throughput is reduced, but connectivity is not impacted.
Note: If you do not need redundant connections, you can use only one port for each network.
However, be aware that an alarm will be raised in the Grid Manager after StorageGRID Webscale
is installed, indicating that a cable is unplugged. You can safely acknowledge this alarm to clear it.
Aggregate port bond mode
Aggregate port bond mode significantly increases the throughout for each StorageGRID Webscale
network and provides additional failover paths.
Callout Which ports are bonded
1 All connected ports are grouped in a single LACP bond, allowing all ports to be used
for Grid Network and Client Network traffic.
Preparing for installation | 17

If you plan to use aggregate port bond mode:
• You must specify a unique VLAN tag for each network. This VLAN tag will be added to each
network packet to ensure that network traffic is routed to the correct network.
• The ports must be connected to switches that can support VLAN and LACP. If multiple switches
are participating in the LACP bond, the switches must support multi-chassis link aggregation
groups (MLAG), or equivalent.
• You must understand how to configure the switches to use VLAN, LACP, and MLAG, or
equivalent.
If you do not want to use all four 10/25-GbE ports, you can use one, two, or three ports. Using more
than one port maximizes the chance that some network connectivity will remain available if one of
the 10/25-GbE ports fails.
Note: If you choose to use fewer than four ports, be aware that one or more alarms will be raised
in the Grid Manager after StorageGRID Webscale is installed, indicating that cables are
unplugged. You can safely acknowledge the alarms to clear them.
Gathering installation information
As you install and configure the StorageGRID Webscale appliance, you must make decisions and
gather information about Ethernet switch ports, IP addresses, and port and network bond modes.
About this task
You can use the following tables to record the required information for each network you connect to
the appliance. These values are required to install and configure the hardware.
Table 1: Information needed to connect to SANtricity System Manager on the E2800
controllers
You must connect both E2800 controllers to the management network you will use for SANtricity
System Manager.
Information needed Your value for controller
AYour value for controller B
Ethernet switch port you will
connect to management port 1
(labeled as P1 on the controller)
MAC address for management port
1 (printed on a label near port P1)
DHCP-assigned IP address for
management port 1, if available after
power on
Note: If the network you will
connect to the E2800 controller
includes a DHCP server, the
network administrator can use the
MAC address to determine the IP
address that was assigned by the
DHCP server.
18 | Hardware Installation and Maintenance Guide for SG6000 Appliances

Information needed Your value for controller
AYour value for controller B
Static IP address you plan to use for
the appliance on the management
network
For IPv4:
• IPv4 address:
• Subnet mask:
• Gateway:
For IPv6:
• IPv6 address:
• Routable IP address:
• E2800 controller router
IP address:
For IPv4:
• IPv4 address:
• Subnet mask:
• Gateway:
For IPv6:
• IPv6 address:
• Routable IP address:
• E2800 controller router
IP address:
IP address format Choose one:
• IPv4
• IPv6
Speed and duplex mode
Note: You must make sure the
Ethernet switch for the SANtricity
System Manager management
network is set to autonegotiate.
Must be:
• Autonegotiate (default)
Table 2: Information needed to connect the SG6000-CN controller to the Admin
Network
The Admin Network for StorageGRID Webscale is an optional network, used for system
administration and maintenance. The appliance connects to the Admin Network using the following
1-GbE management port on the SG6000-CN controller.
Information needed Your value
Admin Network enabled Choose one:
• No
• Yes (default)
Ethernet switch port you will connect to the
Admin Network port (circled in the diagram)
Preparing for installation | 19

Information needed Your value
MAC address for the Admin Network port
Note: The MAC address label on the front of
the SG6000-CN controller lists the MAC
address for the BMC management port. To
determine the MAC address for the Admin
Network port, you must add 2to the
hexadecimal number on the label. For
example, if the MAC address on the label
ends in 09, the MAC address for the Admin
Port would end in 0B. If the MAC address on
the label ends in (y)FF, the MAC address for
the Admin Port would end in (y+1)01. You
can easily make this calculation by opening
Calculator in Windows, setting it to
Programmer mode, selecting Hex, typing the
MAC address, then typing + 2 =.
DHCP-assigned IP address for the Admin
Network port, if available after power on
Note: You can determine the DHCP-assigned
IP address by using the MAC address to look
up the assigned IP.
• IPv4 address (CIDR):
• Gateway:
Static IP address you plan to use for the
appliance Storage Node on the Admin Network
Note: If your network does not have a
gateway, specify the same static IPv4 address
for the gateway.
• IPv4 address (CIDR):
• Gateway:
Admin Network subnets (CIDR)
Table 3: Information needed to connect and configure the 10/25-GbE ports on the
SG6000-CN controller
The four 10/25-GbE ports on the SG6000-CN controller connect to the StorageGRID Webscale Grid
Network and the optional Client Network.
Information needed Your value
Link speed Choose one:
• 10 GbE (default)
• 25 GbE
Port bond mode Choose one:
• Fixed (default)
• Aggregate
Switch port for port 1 (Client Network for Fixed
mode)
Switch port for port 2 (Grid Network for Fixed
mode)
20 | Hardware Installation and Maintenance Guide for SG6000 Appliances