NetApp EF550 User manual

NetApp® EF550 Flash Array
Installation Guide
NetApp, Inc.
495 East Java Drive
Sunnyvale, CA 94089
U.S.
Telephone: [phone]
Fax: [phone]
Support telephone: [phone]
Web: http://www.netapp.com
Feedback: [email protected]
Part number: 215-08288_A0
Release date: December 2013

Table of Contents - i
Table of Contents
About This Guide.......................................................................................................................................................... 1
Registering your EF550 Flash Array...........................................................................................................................2
Step 1 – Preparing for an EF550 Flash Array Installation........................................................................................ 3
Key Terms.................................................................................................................................................................3
storage array.......................................................................................................................................................3
controller..............................................................................................................................................................4
Gathering Items.........................................................................................................................................................4
Basic Hardware...................................................................................................................................................5
EF550 Configuration Cables and Connectors....................................................................................................5
Tools and Other Items........................................................................................................................................7
Things to Know – Cables, SFPs, and QSFPs......................................................................................................... 8
Things to Know – Taking a Quick Glance at the Hardware in a EF550 Flash Array Configuration..........................9
Step 2 – Installing and Configuring the Switches...................................................................................................14
Things to Know – Switches and Routers...............................................................................................................14
Procedure – Installing and Configuring Switches...................................................................................................15
Step 3 – Installing the Host Bus Adapters for the EF550 Flash Array.................................................................. 17
Key Terms...............................................................................................................................................................17
host channel adapter........................................................................................................................................17
HBA host port...................................................................................................................................................17
HCA host port...................................................................................................................................................18
HCA host port Global Unique Identifier (GUID)...............................................................................................18
Things to Know – Host Bus Adapters, Host Channel Adapters, and Ethernet Network Interface Cards................18
Procedure – Installing Host Bus Adapters..............................................................................................................18
Procedure – Installing Host Channel Adapters...................................................................................................... 19
Step 4 – Installing the EF550 Flash Array................................................................................................................20
Things to Know – General Installation................................................................................................................... 20
Procedure – Installing the the EF550 Flash Array.................................................................................................20
Procedure – Installing Drives in the EF550 Flash Array........................................................................................25
Step 5 – Connecting the EF550 Flash Array to the Hosts......................................................................................27
Key Terms...............................................................................................................................................................27
switch or fabric topology...................................................................................................................................27
Things to Know – Storage Array Configuration Specifications for the EF550 Flash Array.....................................27
Things to Know – Host Channels...........................................................................................................................28
Procedure – Connecting Host Cables on a EF550 Flash Array.............................................................................29
Step 6 – Installing the Drive Trays for the EF550 Flash Array Configurations.....................................................34
Things to Know – General Installation of Drive Trays with the EF550 Flash Array................................................34
Procedure – Installing the Drive Trays...................................................................................................................34
Procedure – Installing Drives in the Drive Trays....................................................................................................39

ii - Table of Contents
Things to Know – Connecting the Power Cords....................................................................................................40
Procedure – Connecting the Power Cords.............................................................................................................41
Step 7 – Connecting the EF550 Flash Array to the Drive Trays............................................................................ 42
Key Terms...............................................................................................................................................................42
Things to Know – EF550 Flash Array....................................................................................................................42
Things to Know – Drive Trays................................................................................................................................43
Things to Know – Drive Tray Cabling Configurations for the EF550 Flash Array.................................................. 44
Procedure – Connecting the Drive Trays to the EF550 Flash Array......................................................................45
Step 8 – Connecting the Ethernet Cables................................................................................................................48
Key Terms...............................................................................................................................................................48
Things to Know – Connecting Ethernet Cables..................................................................................................... 48
Procedure – Connecting Ethernet Cables..............................................................................................................49
Step 9 – Connecting the Power Cords..................................................................................................................... 50
Things to Know – AC Power Cords....................................................................................................................... 50
Procedure – Connecting AC Power Cords.............................................................................................................50
Step 10 – Turning on the Power and Checking for Problems in an EF550 Flash Array Configuration...............51
Procedure –Turning On the Power to the Storage Array and Checking for Problems in a EF550 Flash Array
Configuration........................................................................................................................................................... 51
Things to Know – LEDs on the EF550 Flash Array or the EF550 Flash Array......................................................52
Things to Know – General Behavior of the LEDs on the Flash Array....................................................................58
Things to Know – Service Action Allowed LEDs....................................................................................................60
Things to Know – LEDs on the Drive Tray............................................................................................................ 61
General Behavior of the LEDs on the Drive Trays.................................................................................................65
Things to Know – Seven Segment Display Sequence Code Definitions on the EF550 Flash Array...................... 66
Things to Know – Seven-Segment Component Failure Identifications for the EF550 Flash Array.........................67
Things to Know – Lock-Down Codes for the Flash Array......................................................................................68
Things to Know – Seven-Segment Display Use Cases.........................................................................................70
Things to Know – Seven-Segment Display for the ESMs on the Drive Trays....................................................... 71
Regulatory Compliance Statements..........................................................................................................................73
Copyright information.................................................................................................................................................75
Trademark information................................................................................................................................................76
How to send your comments.....................................................................................................................................77

215-08288_A0_EF550 Flash Array Installation Guide - 1
About This Guide
Use this document to install the EF550 flash array and all attached drive trays for your configuration. To access these
products, go to the NetApp Support Site at support.netapp.com

2 - 215-08288_A0_EF550 Flash Array Installation Guide
Registering your EF550 Flash Array
Before you begin the installation, register your EF550 Flash Array at support.netapp.com using the serial number for
the integrated flash array. Use of any other component serial numbers (such as those for individual controllers or drive
trays) will not enable correct registration for the flash array. The integrated flash array serial number is located on two
places on each flash array: the large UL label attached to the top of an enclosure, and a silver label attached to the
front of the enclosure, either on the bottom lip or the right ear. In both of these places, the integrated flash array serial
number is identified by the text "Serial" or "S/N."
Record the integrated flash array serial number for later use. This serial number is required to initiated any support
request for your system.
If your storage array includes drive trays as well, you must verify that you install the controllers in the integrated flash
array, and not in any of the expansion drive tray enclosures. Integrated flash arrays and expansion drive trays look
similar, so you must refer to the integrated flash array part numbers in your Sales Order to identify the integrated flash
array. (Integrated flash arrays do not include a "QS" designator in their part numbers. Drive tray part numbers do
include a "QS" designator. To enable proper support registration, do not install controllers in drive trays.)

215-08288_A0_EF550 Flash Array Installation Guide - 3
Step 1 – Preparing for an EF550 Flash Array Installation
Storage arrays for 6-Gb/s SAS drives consist of a EF550 flash array model and can have one or more drive trays in a
cabinet:
Use this document to install the following EF550 flash array and all necessary drive trays for your configuration:
The following table shows the various configuration options.
Table 1. EF550 Flash Array Options
EF550 Configurations Options
Duplex EF550 flash array
with a host interface card Any combination of EF550 flash arrays attached to drive trays, not to exceed a maximum of 120 drive slots.
One of the following host interface cards (per controller):
Two 40-Gb/s IB ports
Four 6-Gb/s mini-SAS SFF-8088 ports
Four 16-Gb/s Fibre Channel ports
Four 10-Gb/s iSCSI ports
Three 4-GB DIMM memory for 12-GB capacity per controller.
ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper
antistatic protection when handling tray components.
Key Terms
Gathering Items
Things to Know – Cables, SFPs, and QSFPs
Things to Know – Taking a Quick Glance at the Hardware in a EF550 Flash Array Configuration
Key Terms
storage array
flash array
controller
drive tray
environmental services module (ESM)
storage array
A collection of both physical components and logical components for storing data. Physical components include solid
state drives (SSDs), controllers, ESMs, fans, and power supplies. Logical components include disk pools, volume
groups, and volumes. These components are managed by the storage management software.

4 - 215-08288_A0_EF550 Flash Array Installation Guide
flash array
One tray with drives, one or two controllers, fans, and power supplies. The flash array provides the interface between
a host and a storage array.
controller
A circuit board and firmware that is located within a flash array. A controller manages the input/output (I/O) between
the host system and data volumes.
drive tray
One tray with drives, one or two environmental services modules (ESMs), power supplies, and fans. A drive tray does
not contain controllers.
environmental services module (ESM)
A canister in the drive tray that monitors the status of the components. An ESM also serves as the connection point to
transfer data between the drive tray and the controller.
Gathering Items
Before you start installing the flash array, you must have installed the cabinet in which the flash array will be mounted.
Use the tables in this section to verify that you have all of the necessary items to install the flash array.
ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper
antistatic protection when handling tray components.
Basic Hardware
EF550 Configuration Cables and Connectors
Tools and Other Items

215-08288_A0_EF550 Flash Array Installation Guide - 5
Basic Hardware
Table 2. Basic Hardware
Item
Cabinet
Make sure that your cabinet meets the installation site
specifications of the various EF550 storage array components.
Refer to the Storage System Site Preparation Guide for more
information.
Depending on the power supply limitations of your cabinet, you
might need to install more than one cabinet to accommodate the
different components of the EF550 storage array. Refer to the
installation guide for your cabinet for instructions on installing the
cabinet.
Drive Trays with end caps that are packaged separately. This drive
tray can be used with all three variations of the EF550 flash array.
Mounting rails and screws
The mounting rails that are available with the drive tray are designed
for an industry-standard cabinet.
InfiniBand switch (optional)
Gigabit Ethernet switch for Management (optional)
Host with InfiniBand host channel adapters (HBAs) (optional)
Host with SAS HBAs (optional)
Host with Fibre Channel HBAs (optional)
Host with iSCSI HBAs (optional)
EF550 Configuration Cables and Connectors
Table 3. Cables and Connectors
Item Included with the
Flash Array or Drive
Trays
AC power cords.
The flash array and the drive trays ship with power cords for
connecting to an external power source, such as a wall plug.
Your cabinet might have special power cords that you use
instead of the power cords that ship with the flash array and
the drive trays.

6 - 215-08288_A0_EF550 Flash Array Installation Guide
Item Included with the
Flash Array or Drive
Trays
Ethernet cable
For information about out-of-band storage array
management, see the description for “Deciding on the
Management Method” in the Initial Configuration and
Software Installation Guide.
SAS host cables
1m-to-10m passive SAS cables
25m active cables
1m-to2m fan-out single x4 port to 4-single port passive
cables
Both controllers must be individually connected to the drive
tray.
SAS expansion cables
1-5 m passive cables for Mini SAS 8088 host ports.
InfiniBand cables
Use these cables for InfiniBand connections to hosts with
the host interface card.
7m Cu, 15m Active Cu, and 300m Optical cables used to
connect the InfiniBand HIC to the host.
Optical Fibre Channel with SFP transceivers
SFP transceivers are only included with the flash array when
a fibre channel HIC is ordered.
2, 3, 5, 10 or 25m OM2 cables
50 to 100m OM3 cables
300m OS1 or OS2 cables
iSCSI with SFP+ transceivers
Up to 7m twin-ax passive copper cables
2, 3, 5, 10 or 25m OM2 cables
25 to 300m OM3 cables
Serial cable
This cable is used for support only. You do not need to
connect it during initial installation.

215-08288_A0_EF550 Flash Array Installation Guide - 7
Item Included with the
Flash Array or Drive
Trays
DB9-to-PS2 adapter cable
This cable adapts the DB9 connector on commercially
available serial cables to the PS2 connector on the ESM
for drive trays in the storage array. This cable is used
for support only. You do not need to connect it during
installation.
Serial Port cable
This 2-meter cable adapts the DB9 connector on
commercially available serial cables to the mini-USB port on
the controller.
Tools and Other Items
Table 4. Tools and Other Items
Item
Labels
Help you to identify cable connections and lets you more easily
trace cables from one tray to another
A cart
Holds the tray and components
A mechanical lift (optional)
A Phillips screwdriver
A flat-blade screwdriver
Anti-static protection
A flashlight

8 - 215-08288_A0_EF550 Flash Array Installation Guide
Things to Know – Cables, SFPs, and QSFPs
The figures in this topic display the SAS copper cables and SAS cables with a SFF-8088 Connector, QSFPs for IB
connections using copper cables, QSFP transceiver connectors for IB connections using optical cables, an SFP
transceiver with a Fibre-Optic cable, a passive SFP transceiver with a copper cable for 10Gb/s iSCSI connections,
and an iSCSI cable with an RJ-45 connector. The table references the SFP transceivers that apply if you are using
Fibre Channel host connections.
The flash array supports SAS drive connections and SAS, InfiniBand, Fibre Channel, or iSCSI host connections.
Figure 1. SAS Cable Connection
1. SAS Cable
2. SFF-8088 Connector
Figure 2. InfiniBand QSFP Connection With Copper Cables
Figure 3. InfiniBand QSFP Transceiver For Use With Optical Cables
Figure 4. SFP Transceiver and Fibre Optic Cable
1. SFP Transceiver
2. Fibre Optic Cable

215-08288_A0_EF550 Flash Array Installation Guide - 9
Figure 5. iSCSI Cable with an RJ-45 Connector
1. RJ-45 Connector
2. iSCSI Cable
Table 5. Supported SFP Transceivers*
Vendor Model Version/Data Rate*
AFBR-57D7APZ 8 Gb/s
AFBR-57D9AMZ 8 Gb/s
AFBR-703SDZ 10 Gb/s
AFBR-709SMZ SFP+ 10 GbE/s for iSCSI
Avago
AFBR-57F5MZ-NA2 16 Gb/s for FC
FTLF 8521-3 1 Gb/s
FTLF8528P2BCV-LS 8 Gb/s
FTLX8571D3BCL-LS 10 Gb/s
Finisar
FTLF142P3BNV 16 Gb/s for FC
PLRXPL-VC-SH4-23-N 8 Gb/s
PLRXPL-VC-SH4-NA 8 Gb/s
PLRXPL-SC-S43-22-N 10 Gb/s
JDSU
PLRXPL-SC-S43-NAe 10 GbE/s
Molex 74741-0005 1 Gb/s
Opnext TRS2001EN-0001 10 Gb/s
*All SFP Transceivers can connect and run at lower speeds, even though this is not optimal.
Things to Know – Taking a Quick Glance at the Hardware in a
EF550 Flash Array Configuration
Each drive tray in a storage array must have a minimum of two drives for proper operation.
This section provides an overview of hardware described in this document. For specific details about how LEDs
operate, see “Step 10 – Turning on the Power and Checking for Problems in an EF550 Flash Array Configuration" on
page 51.
The top of the flash array is the side with labels.
The configuration of the host ports might appear different on your system depending on which host interface card
configuration is installed.

10 - 215-08288_A0_EF550 Flash Array Installation Guide
Figure 6. EF550 Flash Array – Front View
1. End Cap Standby Power LED
2. End Cap Power LED
3. End Cap Over-Temperature LED
4. End Cap Service Action Required LED
5. End Cap Locate LED
6. Drive Canister
Figure 7. EF550 Controller with a SAS HIC – Rear View
1. USB Connector
2. 1GbE Management Connector 1
3. 1GbE Link 1 Fault LED
4. 1GbE Link 1 Up LED
5. 1GbE Link 2 Fault LED
6. 1GbE Link 2 Up LED
7. 1GbE Management Connector 2
8. SAS Expansion Link 1 Fault LED
9. SAS Expansion Link 1 Up LED
10. SFF-8088 SAS Connector 1 (Expansion)
11. SAS Expansion Link 2 Fault LED
12. SAS Expansion Link 2 Up LED
13. SFF-8088 SAS Connector 2 (Expansion)
14. Standby Power LED
15. Power-Fan DC Power LED
16. Power-Fan Service Action Allowed LED
17. Power-Fan Service Action Required LED
18. Power-Fan AC Power LED
19. Seven-Segment Display
20. mini USB Port

215-08288_A0_EF550 Flash Array Installation Guide - 11
Figure 8. EF550 Right-Rear Subplate with a SAS Host Interface Card
1. SFF-8088 Host Interface Card Channel 1
2. Host Interface Card Link 1 Fault LED
3. Host Interface Card Link 1 Active LED
4. SFF-8088 Host Interface Card Channel 2
5. Host Interface Card Link 2 Fault LED
6. Host Interface Card Link 2 Active LED
7. mini USB Port
8. SFF-8088 Host Interface Card Channel 3
9. Host Interface Card Link 3 Fault LED
10. Host Interface Card Link 3Active LED
11. SFF-8088 Host Interface Card Channel 4
12. Host Interface Card Link 4 Fault LED
13. Host Interface Card Link 4 Active LED
Figure 9. EF550 Right-Rear Subplate with a 40-Gb InfiniBand Host Interface Card
1. Host Interface Card QSFP Channel 1
2. Host Interface Card Logical Link 1Active LED
3. Host Interface Card Physical Link 1 Active LED
4. mini USB Port
5. Host Interface Card Logical Link2 Active LED
6. Host Interface Card Physical Link 2 Active LED
7. Host Interface Card QSFP Channel 2

12 - 215-08288_A0_EF550 Flash Array Installation Guide
Figure 10. EF550 Right-Rear Subplate with a 16-Gb FC or a 10-Gb iSCSI Host Interface Card
1. SFP+ Host Interface Card Channel 1
2. Host Interface Card Link 1Fault LED
3. Host Interface Card Link 1 Active LED
4. SFP+ Host Interface Card Channel 2
5. Host Interface Card Link 2 Fault LED
6. Host Interface Card Link 2 Active LED
7. SFP+ Host Interface Card Channel 3
8. Host Interface Card Link 3 Fault LED
9. Host Interface Card Link 3 Active LED
10. Mini USB Port
11. Host Interface Card Link 4 Fault LED
12. Host Interface Card Link 4 Active LED
13. SFP+ Host Interface Card Channel 4
ATTENTION Possible equipment damage – You must use the supported drives in the drive tray to ensure proper
operation. For information about supported drives, contact a Customer and Technical Support representative.
ATTENTION Risk of equipment malfunction – To avoid exceeding the functional and environmental limits, install
only drives that have been provided or approved by the original manufacturer. Not all flash arrays are shipped with
pre-populated drives. System integrators, resellers, system administrators, or users of the flash array can install the
drives.
Figure 11. Drive Tray – Front View
1. Left End Cap (Has the Drive Tray LEDs)
2. Drives
3. Right End Cap

215-08288_A0_EF550 Flash Array Installation Guide - 13
Figure 12. D Drive Tray with AC Power Option – Rear View
1. ESM A Canister
2. Expansion Port SFF-8088 Connector 1 (IN)
3. Expansion Port SFF-8088 Connector 2 (IN)
4. Seven-Segment Display Indicators
5. Serial Port
6. RJ-45 Ethernet Connector
7. Expansion Port SFF-8088 Connector (OUT)
8. Power-Fan Canister
9. Power Connector
10. Power Switch
11. ESM B Canister
Refer to the Storage System Site Preparation Guide for information about the installation requirements of the various
EF550 flash array storage array components.

14 - 215-08288_A0_EF550 Flash Array Installation Guide
Step 2 – Installing and Configuring the Switches
Things to Know – Switches and Routers
Procedure – Installing and Configuring Switches
Things to Know – Switches and Routers
NOTE Most of the switches and routers, as shipped from the vendor, require an update to either their firmware or
their settings to work correctly with the storage array.
Depending on the configuration of your storage array, you might use either Fibre Channel switches, iSCSI switches,
or InfiniBand switches.
The switches and routers in the following tables are certified for use with an EF550 storage array, an EF550 storage
array, and an EF550 storage array using SANtricity Storage Manager Version 11.10.
If required, make the appropriate configuration changes for each switch or router that is connected to the storage
array.
Refer to the switch’s documentation for information about how to install the switch or router and how to use the
configuration utilities that are supplied with the switch or router.
Table 6. Supported FC Switches
Vendor Model Version/Data Rate
300 8 Gb/s
5100 8 Gb/s
5300 8 Gb/s
8000 8 Gb/s
DCX 8 Gb/s
DCX-4S 8 Gb/s
48000 8 Gb/s
6505 16 Gb/s
6510 16 Gb/s
6520 16 Gb/s
Brocade
DCX8510-x 16 Gb/s
3800 8 Gb/s
5800 8 Gb/s
Qlogic SANbox
9000 8 Gb/s
9148 8 Gb/s
9506 8 Gb/s
9509 8 Gb/s
9513 8 Gb/s
Cisco
B-Series 8/24c for HP Blade
Center AJ821B 8 Gb/s

215-08288_A0_EF550 Flash Array Installation Guide - 15
Vendor Model Version/Data Rate
MDS for HP Blade Center
AW564A 8 Gb/s
9710 16 Gb/s
5010 8 Gb/sCisco Nexus 5020 8 Gb/s
Table 7. Supported InfiniBand Switches
Vendor Model Speed
Mellanox SX6012 Edge Switch 56 Gb/s (FDR)
SX6018 Edge Switch 56 Gb/s (FDR)
SX6036 Edge Switch 56 Gb/s (FDR)
IS5030 Edge Switch 40 Gb/s (QDR)
IS5035 Edge Switch 40 Gb/s (QDR)
4036 Edge Switch 40 Gb/s (QDR)
4036E Edge Switch 40 Gb/s (QDR)
IS5100 Director Switch 40 Gb/s (QDR)
IS5200 Director Switch 40 Gb/s (QDR)
IS5300 Director Switch 40 Gb/s (QDR)
IS5600 Director Switch 40 Gb/s (QDR)
4200 Director Switch 40 Gb/s (QDR)
4700 Director Switch 40 Gb/s (QDR)
SX6506 Director Switch 56 Gb/s (FDR)
SX6512 Director Switch 56 Gb/s (FDR)
SX6518 Director Switch 56 Gb/s (FDR)
SX6536 Director Switch 56 Gb/s (FDR)
Table 8. Supported Routers
Vendor Model Speed
Cisco 9222i 8 Gb/s
Brocade 7800 8 Gb/s
6240 8 Gb/s FC
10 Gb/s iSCSI
6250 8 Gb/s FC
10 Gb/s iSCSI
Qlogic
6260 8 Gb/s FC
Refer to your Technical Support Representative for the latest information about new switches that are tested and
certified to work with various hardware and software combinations.
Procedure – Installing and Configuring Switches
1. Install your switch according to the vendor’s documentation.

16 - 215-08288_A0_EF550 Flash Array Installation Guide
2. Contact your Technical Support Representative to obtain this information:
The latest hardware compatibility information
The models of the switches that are supported
The firmware requirements and the software requirements for the switches
3. Update the switch’s firmware by accessing it from the applicable switch vendor’s website.
This update might require that you cycle power to the switch.
4. Find your switch in the following table to see whether you need to make further configuration changes. Use your
switch’s configuration utility to make the changes.
Table 9. Supported Switch Vendors and Required Configuration Changes
Switch Vendor Configuration Changes Required? Next Step
Brocade Yes
Change the In-Order Delivery (IOD) option
to ON.
Make the change, and go to “Step 3 --
Installing the Host Bus Adapters for the
EF550 Flash Array" on page 17.
Cisco Yes
Change the In-Order Delivery (IOD) option
to ON.
Make the change, and go to “Step 3 --
Installing the Host Bus Adapters for the
EF550 Flash Array” on page 17.
Mellanox No
PowerConnect No Go to "Step 3 -- Installing the Host Bus
Adapters for the EF550 Flash Array" on
page 17.