NetApp E Series User manual

E-Series
Adding, Upgrading, or Replacing Host Interface Cards in E5700
Controller Shelves
You can add host interface cards (HICs) to E5700 controller shelves that only have baseboard host ports. Adding HICs allows
you to increase the number of host ports in your storage array and can provide additional host protocols. When you add HICs,
you must power off the storage array, install the HIC, and reapply power.
Before you begin
• The HICs must be compatible with your controllers.
Attention: Possible loss of data access – Never install a HIC in an E5700 controller canister if that HIC was designed for
another E-Series controller. In addition, both controllers and both HICs must be identical. The presence of incompatible or
mismatched HICs will cause the controllers to lock down when you apply power.
• You have all cables, transceivers, switches, and host bus adapters (HBAs) needed to connect the new host ports.
Note: For information about compatible hardware, refer to the NetApp Interoperability Matrix Tool and the NetApp
Hardware Universe .
• You have an ESD wristband, or you have taken other antistatic precautions.
• You have a #1 Phillips screwdriver.
• You have labels to identify the new host cables.
• You have installed SANtricity Storage Manager on a management station, so you can use the storage array's command line
interface (CLI).
Note: If this software has not yet been installed, follow the instructions in the SANtricity Power Guide for Advanced Users
for your operating system to download and install it.
• You have scheduled a downtime maintenance window for this procedure. The power must be off when you install HICs, so
you will not be able to access data on the storage array until you have successfully completed this procedure.
About this procedure
Use this procedure to add a HIC to a controller canister that has baseboard ports only. This procedure applies to following
controller shelves:
• E5724 controller shelf
• E5760 controller shelf
1
215-11796_B0 April 2018 Copyright ©2018 NetApp, Inc. All rights reserved.
Web: www.netapp.com • Feedback: [email protected]

The following figures show an E5724 controller shelf with two controller canisters before and after installing a HIC into each
controller.
The following figures show an E5760 controller shelf with two controller canisters before and after installing a HIC into each
controller.
Note: The figures show example controller canisters with example HICs. You might have different types and numbers of
baseboard ports and HIC ports.
The following table shows which types of HICs you can add to each model of the E5700 controller.
2

E5700 controller has... You can install these HICs... Maximum data rate and protocol
Two SFP+ (optical) baseboard
ports Four-port SFP+ (optical) HIC 8/16/32 Gbps Fibre Channel (FC)
Four-port SFP28 HIC 10/25 Gbps iSCSI
Two-port QSFP28 HIC 56/100 Gbps Infiniband (iSER/SRP)
Four-port SAS HIC 6/12 Gbps SAS
Steps
1. Preparing to add host interface cards on page 3
2. Removing a controller canister on page 5
3. Installing a host interface card on page 6
4. Installing a controller canister on page 8
5. After adding a host interface card on page 10
Related information
SANtricity 11.40 Installing and Configuring for Linux Power Guide for Advanced Users
SANtricity 11.40 Installing and Configuring for VMware Power Guide for Advanced Users
SANtricity 11.40 Installing and Configuring for Windows Power Guide for Advanced Users
NetApp Interoperability Matrix Tool
NetApp Hardware Universe
Preparing to add host interface cards
Before adding HICs to E5700 controller shelves, you must perform a number of steps using SANtricity System Manager and
SANtricity Storage Manager to prepare your system. You must back up the storage array's configuration database, collect
support data, and stop host I/O operations. You must also power down the controller shelf.
Steps
1. From the home page of SANtricity System Manager, ensure that the storage array has Optimal status.
If the status is not Optimal, use the Recovery Guru or contact technical support to resolve the problem. Do not continue with
this procedure.
2. Back up the storage array's configuration database.
If a problem occurs when you remove a controller, you can use the saved file to restore your configuration.
a. Open the Enterprise Management Window (EMW) for SANtricity Storage Manager on your management station.
b. Select the storage array.
c. Select Tools > Execute Script.
d. Type the following command in the text box.
save storageArray dbmDatabase sourceLocation=onboard contentType=all file="filename";
In this command, filename is the file path and file name to which you want to save the database. Enclose the file name
in double quotation marks (" "). For example:
file="C:\Program Files\CLI\logs\dbmdata.zip"
Preparing to add host interface cards 3

This command does not automatically append a file extension to the saved file. You must specify a file extension when
entering the file name.
e. Select Tools > Verify and Execute.
3. Collect support data for your storage array.
Collecting support data before and after replacing a component ensures you can send a full set of logs to technical support in
case the replacement does not resolve the problem.
Option Description
SANtricity System Manager a. Select Support > Support Center > Diagnostics.
b. Select Collect Support Data.
c. Click Collect.
The file is saved in the Downloads folder for your browser with the name support-
data.7z.
Script editor in the EMW a. Open the Enterprise Management Window (EMW) in SANtricity Storage Manager on
your local host.
b. Select the storage array.
c. Select Tools > Execute Script.
d. Type the following command in the text box.
save storageArray supportData file="filename";
In this command, filename is the file path and the file name to which you want to save
the support data. Enclose the file path and the file name in double quotation marks (" ").
For example:
file="C:\Program Files\CLI\logs\support-data.7z"
e. Select Tools > Verify and Execute.
4. Ensure that no I/O operations are occurring between the storage array and all connected hosts. For example, you can perform
these steps:
• Stop all processes that involve the logical unit numbers (LUNs) mapped from the storage to the hosts.
• Ensure that no applications are writing data to any LUNs mapped from the storage to the hosts.
• Unmount all file systems associated with any LUNs mapped from the storage to the hosts.
Note: The exact steps to stop host I/O operations depend on the host operating system and the configuration, which are
beyond the scope of these instructions. If you are not sure how to stop host I/O operations in your environment, consider
shutting down the host.
Attention: Possible data loss – If you continue this procedure while I/O operations are occurring, the host application
might lose data because the storage array will not be accessible.
5. If the storage array participates in a mirroring relationship, stop all mirroring I/O operations between the primary and
secondary storage arrays.
6. Wait for any data in cache memory to be written to the drives.
4

The green Cache Active LED on the back of each controller is on when cached data needs to be written to the drives. You
must wait for this LED to turn off.
Callout Type of host ports
1
Cache Active LED
7. Wait for all operations to complete before continuing with the next step.
8. From the Home page of SANtricity System Manager, select View Operations in Progress.
9. Power down the controller shelf.
a. Turn off both power switches on the controller shelf.
b. Wait for all LEDs on the controller shelf to turn off.
Removing a controller canister
When you remove a controller canister, you must disconnect all cables. Then, you can slide the controller canister out of the
controller shelf.
Steps
1. Put on an ESD wristband or take other antistatic precautions.
2. Label each cable that is attached to the controller canister.
3. Disconnect all of the cables and remove SFPs from the controller canister.
Attention: To prevent degraded performance, do not twist, fold, pinch, or step on the cables.
4. Using two hands and the cam handle, slide the controller canister out of the shelf.
Attention: Always use two hands to support the weight of a controller canister.
If you are removing the controller canister from an E5724 controller shelf, a flap swings into place to block the empty bay,
helping to maintain air flow and cooling.
5. Turn the controller canister over, so that the removable cover faces up.
6. Place the controller canister on a flat, static-free surface.
Removing a controller canister 5

Installing a host interface card
After removing the controller canister and HIC faceplate, you can install a HIC and re-attach the HIC faceplate.
Steps
1. Unpack the new HIC and the new HIC faceplate.
2. Press the button on the cover of the controller canister, and slide the cover off.
3. Confirm that the green LED inside the controller (between the battery and the DIMMs) is off.
If this green LED is on, the controller is still using battery power. You must wait for this LED to go off before removing any
components.
Item Description
1
Internal Cache Active LED
2
Battery
4. Using a #1 Phillips screwdriver, remove the screws that attach the HIC faceplate to the controller canister.
There are four screws: one on the top, one on the side, and two on the front.
6

5. Remove the HIC faceplate.
6. Align the three thumbscrews on the HIC with the corresponding holes on the controller, and align the connector on the
bottom of the HIC with the HIC interface connector on the controller card.
Be careful not to scratch or bump the components on the bottom of the HIC or on the top of the controller card.
7. Carefully lower the HIC into place, and seat the HIC connector by pressing gently on the HIC.
Attention: Possible equipment damage – Be very careful not to pinch the gold ribbon connector for the controller LEDs
between the HIC and the thumbscrews.
Item Description
1
Host interface card (HIC)
Installing a host interface card 7

Item Description
2
Thumbscrews
8. Hand-tighten the HIC thumbscrews.
Do not use a screwdriver, or you might over tighten the screws.
9. Using a #1 Phillips screwdriver, attach the new HIC faceplate to the controller canister with four screws.
10. Reinstall the cover on the controller canister by sliding the cover from back to front until the button clicks.
11. Set the controller canister aside until you are ready to install it.
Installing a controller canister
After installing the new HIC, you can reinstall the controller canister into the controller shelf.
Steps
1. Turn the controller canister over, so that the removable cover faces down.
2. With the cam handle in the open position, slide the controller canister all the way into the controller shelf.
8

The following figure is an example of an E5724 controller shelf:
Item Description
1
Controller canister
2
Cam handle
The following figure is an example of an E5760 controller shelf:
Item Description
1
Controller canister
Installing a controller canister 9

Item Description
2
Cam handle
3. Move the cam handle to the left to lock the controller canister in place.
4. Install the SFPs in the host ports on the controller, and reconnect all of the cables.
If you are using more than one host protocol, be sure to install the SFPs in the correct host ports.
5. If you are adding HICs to a duplex configuration, repeat all steps to remove the second controller canister, install the second
HIC, and replace the second controller canister.
After adding a host interface card
After adding a HIC, you might need to perform additional steps before attaching data cables. For the additional steps you must
check the controller LEDs and seven-segment display and confirm that the controller's status is Optimal.
Before you begin
You have installed any new host hardware needed for the new host ports, such as switches or host bus adapters (HBAs).
Steps
1. Turn on the two power switches at the back of the controller shelf.
• Do not turn off the power switches during the power-on process, which typically takes 90 seconds or less to complete.
• The fans in each shelf are very loud when they first start up. The loud noise during start-up is normal.
2. As the controller boots, check the controller LEDs and seven-segment display.
• The seven-segment display shows the repeating sequence OS, Sd, blank to indicate that the controller is performing
Start-of-day (SOD) processing. After a controller has successfully booted up, its seven-segment display should show the
tray ID.
• The amber Attention LED on the controller turns on and then turns off, unless there is an error.
• The green Host Link LEDs remain off until you connect the host cables.
Note: The figure shows an example controller canister. Your controller might have a different number and a different type
of host ports.
Item Description
1
Host Link LEDs
10

Item Description
2
Attention LED (amber)
3
Seven-segment display
3. From SANtricity System Manager, confirm that the controller's status is Optimal.
If the status is not Optimal or if any of the Attention LEDs are on, confirm that all cables are correctly seated, and check that
the HIC and the controller canister are installed correctly. If necessary, remove and reinstall the controller canister and the
HIC.
Note: If you cannot resolve the problem, contact technical support.
4. If the new HIC ports require SFP+ transceivers, install these SFPs.
5. Connect the cables from the controller's host ports to the data hosts.
6. If you need instructions for configuring and using a new host protocol, download the SANtricity System Manager Express
Guide or SANtricity Power Guide for Advanced Users for your operating system.
7. Follow the instructions in that document to perform any additional steps, such as the following:
• Adding or updating the host mappings for the new host ports.
• Configuring the controller's settings.
Related information
SANtricity 11.40 Installing and Configuring for Linux Power Guide for Advanced Users
SANtricity 11.40 Installing and Configuring for VMware Power Guide for Advanced Users
SANtricity 11.40 Installing and Configuring for Windows Power Guide for Advanced Users
SANtricity System Manager 11.40 Installing and Configuring for Linux Express Guide
SANtricity System Manager 11.40 Installing and Configuring for VMware Express Guide
SANtricity System Manager 11.40 Installing and Configuring for Windows Express Guide
Upgrading Host Interface Cards in E5700 Controller Shelves
You can upgrade the host interface cards (HICs) in E5700 controller shelves to increase the number of host ports or to change
host protocols. When you upgrade the HICs, you must power off the storage array, remove the existing HIC from each
controller, install a new HIC, and reapply power.
Before you begin
• You have two HICs. The HICs must be compatible with your controllers.
Attention: Possible loss of data access – Never install a HIC in an E5700 controller canister if that HIC was designed for
another E-Series controller. In addition, if you have a duplex configuration, both HICs must be identical. The presence of
incompatible or mismatched HICs will cause both controllers to lock down when you apply power. You will lose access to
your data until the problem is corrected.
• You have all cables, transceivers, switches, and host bus adapters (HBAs) needed to connect the new host ports.
Upgrading Host Interface Cards in E5700 Controller Shelves 11

Note: For information about compatible hardware, refer to the NetApp Interoperability Matrix Tool and the NetApp
Hardware Universe .
• You have an ESD wristband, or you have taken other antistatic precautions.
• You have a #1 Phillips screwdriver.
• You have labels to identify the new host cables.
• You have installed SANtricity Storage Manager on a management station, so you can use the storage array's command line
interface (CLI).
Note: If this software has not yet been installed, follow the instructions in the SANtricity Storage Manager Express Guide
or the SANtricity Power Guide for Advanced Users for your operating system to download and install it.
• You have scheduled a downtime maintenance window for this procedure. The power must be off when you upgrade HICs, so
you will not be able to access data on the storage array until you have successfully completed this procedure.
About this procedure
Use this procedure to change the host protocol by replacing the HIC currently installed in an E5700 controller canister with a
different type of HIC. The table shows which types of HICs you can install in each E5700 controller model.
E5700 controller has... You can install these HICs... Maximum data rate and protocol
Two SFP+ (optical) baseboard
ports Four-port SFP+ (optical) HIC 8 Gb, 16 Gb, or 32 Gb Fibre Channel (FC)
Four-port SFP28 HIC 10 Gbps, 25 Gbps iSCSI
Two-port QSFP28 HIC 56 Gbps, 100 Gbps Infiniband (iSER/SRP)
Four-port SAS HIC 6 Gbps,12 Gbps SAS
The following figures show an E5724 controller shelf before and after a HIC upgrade. The two HICs in the first figure have four
SFP+ (optical) host ports, and the two HICs in the second figure have four SAS ports.
The following figures show an E5760 controller shelf before and after a HIC upgrade. The two HICs in the first figure have four
SFP+ (optical) host ports, and the two HICs in the second figure have four SAS ports.
12

Note: The figures show example controller canisters with example HICs. You might have different types and numbers of
baseboard ports and HIC ports.
Steps
1. Preparing to upgrade host interface cards on page 14
2. Removing a controller canister on page 17
3. Removing a host interface card on page 18
4. Installing a host interface card on page 20
5. Installing a controller canister on page 21
6. After upgrading a host interface card on page 21
Related information
SANtricity 11.40 Installing and Configuring for Linux Power Guide for Advanced Users
SANtricity 11.40 Installing and Configuring for VMware Power Guide for Advanced Users
SANtricity 11.40 Installing and Configuring for Windows Power Guide for Advanced Users
SANtricity Storage Manager 11.40 Installing and Configuring for Linux Express Guide
SANtricity Storage Manager 11.40 Installing and Configuring for VMware Express Guide
SANtricity Storage Manager 11.40 Installing and Configuring for Windows Express Guide
NetApp Interoperability Matrix Tool
NetApp Hardware Universe
Upgrading Host Interface Cards in E5700 Controller Shelves 13

Preparing to upgrade host interface cards
Before upgrading the HICs in E5700 controller shelves, you must perform a number of steps using SANtricity System Manager
and SANtricity Storage Manager to prepare your system.You must back up the storage array's configuration database, collect
support data, and stop host I/O operations. You also must power down the controller shelf.
Steps
1. From the home page of SANtricity System Manager, ensure that the storage array has Optimal status.
If the status is not Optimal, use the Recovery Guru or contact technical support to resolve the problem. Do not continue with
this procedure.
2. Back up the storage array's configuration database.
If a problem occurs when you remove a controller, you can use the saved file to restore your configuration.
a. Open the Enterprise Management Window (EMW) for SANtricity Storage Manager on your management station.
b. Select the storage array.
c. Select Tools > Execute Script.
d. Type the following command in the text box.
save storageArray dbmDatabase sourceLocation=onboard contentType=all file="filename";
In this command, filename is the file path and file name to which you want to save the database. Enclose the file name
in double quotation marks (" "). For example:
file="C:\Program Files\CLI\logs\dbmdata.zip"
This command does not automatically append a file extension to the saved file. You must specify a file extension when
entering the file name.
e. Select Tools > Verify and Execute.
3. Collect support data for your storage array.
Collecting support data before and after replacing a component ensures you can send a full set of logs to technical support in
case the replacement does not resolve the problem.
Option Description
SANtricity System Manager a. Select Support > Support Center > Diagnostics.
b. Select Collect Support Data.
c. Click Collect.
The file is saved in the Downloads folder for your browser with the name support-
data.7z.
14

Option Description
Script editor in the EMW a. Open the Enterprise Management Window (EMW) in SANtricity Storage Manager on
your local host.
b. Select the storage array.
c. Select Tools > Execute Script.
d. Type the following command in the text box.
save storageArray supportData file="filename";
In this command, filename is the file path and the file name to which you want to save
the support data. Enclose the file path and the file name in double quotation marks (" ").
For example:
file="C:\Program Files\CLI\logs\support-data.7z"
e. Select Tools > Verify and Execute.
4. Ensure that no I/O operations are occurring between the storage array and all connected hosts. For example, you can perform
these steps:
• Stop all processes that involve the logical unit numbers (LUNs) mapped from the storage to the hosts.
• Ensure that no applications are writing data to any LUNs mapped from the storage to the hosts.
• Unmount all file systems associated with any LUNs mapped from the storage to the hosts.
Note: The exact steps to stop host I/O operations depend on the host operating system and the configuration, which are
beyond the scope of these instructions. If you are not sure how to stop host I/O operations in your environment, consider
shutting down the host.
Attention: Possible data loss – If you continue this procedure while I/O operations are occurring, the host application
might lose data because the storage array will not be accessible.
5. If the storage array participates in a mirroring relationship, stop all mirroring I/O operations on the secondary storage array.
6. If you are using asynchronous mirroring or synchronous mirroring, perform the following to delete any mirrored pairs and
deactivate any mirroring relationships:
Preparing to upgrade host interface cards 15

Mirroring Relationship Steps
Synchronous Mirroring (supported for
Fibre Channel only)
Attention: If you do not deactivate
these relationships before upgrading
the HICs, your system loses data
access and data loss might occur.
a. In the Array Management Window, select Help > Contents, and search for the topics
related to Synchronous Mirroring.
b. Follow the guidelines and instructions in the online help to identify all synchronous
mirroring volumes that might exist.
c. In the Logical pane, right-click a synchronous mirroring volume, and select Copy
Services > Synchronous Mirroring > Remove Mirror Relationship.
d. Select all volumes, and click Remove.
e. After you delete all mirroring relationships, deactivate Synchronous Mirroring by
selecting Copy Services > Mirroring > Deactivate.
f. Select the synchronous mirroring check box from the pop-up window.
Attention: If you do not delete all mirroring relationships before deactivating mirroring,
you receive an error.
Asynchronous Mirroring (supported
for iSCSI and Fibre Channel only) a. In the Array Management Window, access the online help and search for the topics related
to Asynchronous Mirroring.
b. Follow the instructions in the online help to remove all asynchronous mirrored pairs from
the asynchronous mirror groups.
Note: When removing each pair, select the Delete all repositories associated with
this mirrored pair check box.
c. Follow the instructions in the online help to delete all asynchronous mirror groups.
7. Wait for any data in cache memory to be written to the drives.
The green Cache Active LED on the back of each controller is on when cached data needs to be written to the drives. You
must wait for this LED to turn off.
Callout Type of host ports
1
Cache Active LED
8. Wait for all operations to complete before continuing with the next step.
9. From the Home page of SANtricity System Manager, select View Operations in Progress.
10. Power down the controller shelf.
a. Turn off both power switches on the controller shelf.
b. Wait for all LEDs on the controller shelf to turn off.
16

Removing a controller canister
When you remove a controller canister, you must disconnect all cables. Then, you can slide the controller canister out of the
controller shelf.
Steps
1. Put on an ESD wristband or take other antistatic precautions.
2. Label each cable that is attached to the controller shelf.
3. Disconnect all of the cables and remove SFPs from the controller shelf.
Attention: To prevent degraded performance, do not twist, fold, pinch, or step on the cables.
4. If the HIC ports use SFP+ transceivers, remove them.
Depending on what type of HIC you are upgrading to, you might be able to reuse these SFPs.
5. If the baseboard host ports on the controller canister use SFP+ transceivers, leave them installed.
6. Confirm that the Cache Active LED on the back of the controller is off.
The green Cache Active LED on the back of the controller is on when cached data needs to be written to the drives. You
must wait for this LED to turn off before removing the controller shelf.
Note: The figure shows an example controller canister. Your controller might have a different number and a different type
of host ports.
Callout Type of host ports
1
Cache Active LED
7. Using two hands and the cam handle, slide the controller canister out of the shelf.
Attention: Always use two hands to support the weight of a controller canister.
If you are removing the controller canister from an E5724 controller shelf, a flap swings into place to block the empty bay,
helping to maintain air flow and cooling.
8. Turn the controller canister over, so that the removable cover faces up.
9. Place the controller canister on a flat, static-free surface.
Removing a controller canister 17

Removing a host interface card
When you upgrade a HIC, you must remove the original HIC from the controller canister.
Steps
1. Remove the controller canister's cover by pressing down on the button and sliding the cover off.
2. Confirm that the green LED inside the controller (between the battery and the DIMMs) is off.
If this green LED is on, the controller is still using battery power. You must wait for this LED to go off before removing any
components.
Item Description
1
Internal Cache Active LED
2
Battery
3. Using a #1 Phillips screwdriver, remove the screws that attach the HIC faceplate to the controller canister.
There are four screws: one on the top, one on the side, and two on the front.
18

4. Remove the HIC faceplate.
5. Using your fingers or a Phillips screwdriver, loosen the three thumbscrews that secure the HIC to the controller card.
6. Carefully detach the HIC from the controller card by lifting the card up and sliding it back.
Attention: Be careful not to scratch or bump the components on the bottom of the HIC or on the top of the controller card.
Item Description
1
Host interface card (HIC)
2
Thumbscrews
Removing a host interface card 19

7. Place the HIC on a static-free surface.
Installing a host interface card
After removing the original HIC, you can install the new HIC.
Steps
1. Unpack the new HIC and the new HIC faceplate.
2. Align the three thumbscrews on the HIC with the corresponding holes on the controller, and align the connector on the
bottom of the HIC with the HIC interface connector on the controller card.
Attention: Be careful not to scratch or bump the components on the bottom of the HIC or on the top of the controller card.
3. Carefully lower the HIC into place, and seat the HIC connector by pressing gently on the HIC.
Attention: Possible equipment damage – Be very careful not to pinch the gold ribbon connector for the controller LEDs
between the HIC and the thumbscrews.
Item Description
1
Host interface card (HIC)
2
Thumbscrews
4. Hand-tighten the HIC thumbscrews.
Do not use a screwdriver, or you might over tighten the screws.
5. Using a #1 Phillips screwdriver, attach the new HIC faceplate to the controller canister with four screws.
6. Upgrade the HIC on the other controller with an identical new HIC to avoid mismatch of HICs.
20