IBM N6000 Series Manual

IBM System Storage
N6000 Series Filer
Installation and Setup Instructions
Covering N6040, N6060, and N6070 models
GC53-1143-04


Notices
Mail comments to:
IBM Corporation
Attention Department GZW
9000 South Rita Road
Tucson, AZ 85744-0001
www.ibm.com/storage/support/nseries
References in this publication to IBM products or services do not imply that IBM intends to make them available in
every country or region.
IBM, the IBM logo, and ibm.com®are trademarks or registered trademarks of International Business Machines
Corporation in the United States, other countries, or both. A complete and current list of other IBM trademarks is
available on the web at .www.ibm.com/legal/copytrade.shtml
Data ONTAP, NetApp, and Network Appliance are trademarks and/or registered trademarks of NetApp, Inc in the
United States and other countries.
Other company, product, and service names may be trademarks or service marks of others.
© Copyright IBM Corporation 2008, 2011.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Before you begin ...........v
Installation and setup instructions . . . 1
Unpacking the N6000 series filer........1
Installing the rails in an IBM 19-inch rack ....3
Installing the system in the rack ........5
Setting storage expansion unit shelf IDs .....7
Setting EXN4000 or EXN1000 storage expansion
unit shelf IDs .............7
Setting SAS expansion unit shelf IDs .....7
Connecting the N6000 series filer to a network . . . 8
Connecting the system to expansion units ....10
Cabling a single-controller N6000 series filer . . 11
Cabling a high-availability (active/active)
dual-controller N6000 series filer ......12
Installing the power cables .........16
Setting up and booting the system.......17
Appendix. Troubleshooting and
additional resources .........19
Troubleshooting tips ...........19
Additional resources ...........20
© Copyright IBM Corp. 2008, 2011 iii

iv

Before you begin
Read this information before beginning your installation.
Before you begin your installation, print and complete a Configuration worksheet for your storage system
to gather the information that the software setup process requires. The configuration worksheet is
provided in the Data ONTAP Software Setup Guide for your version of Data ONTAP, which is available on
the IBM®System Storage®N series support website:
www.ibm.com/storage/support/nseries
If you are configuring a storage system as part of a high-availability (or active/active) configuration,
some information types must be unique for each storage system mode in the configuration, and some
information types must be identical on both storage system nodes. If you have a high-availability (or
active/active) configuration, IBM recommends that you print and complete two copies of the
configuration worksheet, one for each system node.
Note: In the Data ONTAP 7.2 and 7.3 release families, the term active/active configuration (or active/active
pair) refers to a pair of storage systems or gateways (sometimes called nodes or controller modules)
configured to serve data for each other if one of the two systems stops functioning. In the Data ONTAP
8.xrelease family, this functionality is referred to as a high-availability (HA) configuration or an HA pair.
About this document
This document provides installation and setup instructions for IBM System Storage N6040, N6060, and
N6070 filer storage systems. Additional information about these products can be found in the N6000
Series Hardware and Service Guide.
Additional information about the N series storage expansion units you connect to your N6000 series
system can be found in the Hardware and Service Guides and the Installation and Setup Instructions for your
storage expansion units.
Read the safety notices
Before continuing, make sure that you have reviewed the safety notices shipped with this product. Do
not plug any cables into the system, adapters, or any electrical outlets until you have reviewed the safety
information and followed the procedures in this document.
Need help?
If you encounter any difficulties while setting up your system, contact IBM service and support for
assistance. Information can also be found on the IBM System Storage N series support website:
www.ibm.com/storage/support/nseries
About the IBM N series support website
The IBM System Storage N series support website requires users to register in order to obtain access to N
series support content on the web. To understand how the N series support web content is organized and
navigated, and to access the N series support website, go to the following publicly accessible web page:
www.ibm.com/storage/support/nseries/
© Copyright IBM Corp. 2008, 2011 v

This web page also provides links to AutoSupport information as well as other important N series
product resources.
Items supplied by you for the installation
You need to supply the following items to complete the installation:
vEthernet LAN cables
vFibre Channel (FC) cables
vConsole (for example, a PC or laptop)
v#2 Phillips screwdriver and slotted screwdriver
Installing in a non-IBM rack
The rack installation instructions provided in this document apply specifically to the installation of the N
series product in an IBM 19-inch rack. IBM service personnel cannot install the N series product in a
non-IBM rack.
If the N series product is being installed in a non-IBM rack, the rails shipped with the N series product
may or may not work with the non-IBM rack. Physical installation of the N series product in a non-IBM
rack is the customer's responsibility.
vi

Installation and setup instructions
Use these instructions to install and set up your N6000 series filer.
Unpacking the N6000 series filer
Use these instructions to unpack the N6000 series filer.
Important: If your system was shipped already assembled and cabled in a rack, go directly to “Setting
up and booting the system” on page 17.
Your system is shipped with an accessories box containing documentation and hardware parts for
installing your system. See Figure 1. The quantity of hardware parts is determined by your system
configuration and requirements.
1 IBM rail kit
2 Software license
3 Installation and Setup Instructions
4 Console adapter, one per node
5 Serial null modem cable, one per node
6 Fibre Channel cables (quantity depends on the number of loops ordered)
7 Rear tie-down bracket
8 Bezel
9 Setup kit containing loopback plugs, grounding kit, and general information kit
10 Cable management tray, one per node
5
6
7
8
9
1
2
3
4
10
n600001
Figure 1. N6000 series filer accessories
© Copyright IBM Corp. 2008, 2011 1

Note: Four Small Form Factor Pluggable (SFP) modules per node will either be in the accessory box or
will be installed in the fiber ports of the storage system.
1. Verify that the shipping packages include the following items.
N6040 (2858-A10) / N6060 (2858-A12) / N6070 (2858-A11)
1 single-controller N6040/N6060/N6070
1 console adapter, RJ-45 to DB-9
1 cable management tray
1 serial null modem cable
1 electrostatic discharge (ESD) wrist strap
2 power cords
1 IBM rail kit
1 publications CD
1 or more envelopes with the software End User License Agreement (EULA) and license keys
N6040 (2858-A20) / N6060 (2858-A22) / N6070 (2858-A21)
1 dual-controller N6040/N6060/N6070
2 console adapters, RJ-45 to DB-9
2 cable management trays
2 serial null modem cables
1 ESD wrist strap
2 power cords
1 IBM rail kit
1 publications CD
1 or more envelopes with the software EULA and license keys
2. Remove the foam hardware protectors and the plastic surrounding the system.
svc00168
32-55 kg (70.5-121.2 lbs)
CAUTION:
The weight of this part or unit is between 46 and 55 kg (102 and 121 lb). It takes three
persons to safely lift this part or unit. (C010)
3. Remove the storage system using the integrated handles attached to the sides of the storage system.
Place the storage system on a table.
n600002
2

Installing the rails in an IBM 19-inch rack
Use these instructions to install the rails on which you will mount the N6000 series filer.
Attention: Read these instructions in their entirety before proceeding.
Observe the following rules and restrictions when installing an N series system in a standard IBM 19-inch
(48.26 cm) equipment rack with mounting rails:
DANGER
To avoid hazardous conditions due to uneven mechanical loading, always install the heaviest
devices in the bottom of the rack cabinet. Always install servers and optional devices starting from
the bottom of the rack cabinet. (R001 part 1 of 2)
vWhen installing storage expansion units in a rack, do not exceed the maximum storage limit for your
system.
vMake sure that the ID on the back panel of each storage expansion unit matches the ID specified on its
label.
vAlways install the storage expansion units fully loaded. Do not remove disk drives to reduce the
weight.
1. Loosen (but do not remove) the four rail adjustment screws on each rail. See Figure 2 on page 4.
Model A10/A11/A12 Model A20/A21/A22
(A10/A11/A12)
N6000 series
Expansion Unit 4
Expansion Unit 3
Expansion Unit 2
.
.
.
N6000 series
Node 2, Loop or SAS Stack 1
Node or SAS Stack2, Loop 1
(A20/A21/A22)
Node or SAS Stack1, Loop 1
Node 1, Loop 1or SAS Stack
Expansion Unit 1
Expansion Unit 2
Expansion Unit 1
Expansion Unit 2
.
.
.
.
.
.
n600003
Installation and setup instructions 3

2. Refer to Figure 3 on page 5. At the front of the rack, position the right-hand rail into the rack at the
appropriate EIA location. Make sure that the two locating pins seat properly. The bottom of the rail
should line up with the bottom EIA boundary.
Right rail
Left rail
Front of rack
Rear of rack
Rail adjustment
screws
Locating pins
n620007
Figure 2. Installing the rails
4

Note: When installed, each N6000 series filer enclosure will occupy a 6U space.
Using two silver pan head M5 screws, attach the rail to the front of the rack using holes H2 and H8.
Tighten these screws with a screwdriver.
3. At the rear of the rack, position the rail at the same EIA location used in step 2. Make sure that the
locating pins seat properly. Using two silver pan head M5 screws, attach the rail to the rack using
holes H2 and H8. Tighten these screws with a screwdriver.
4. Tighten the four rail adjustment screws on the installed rail.
5. Repeat steps 2 through 4 for the left-hand rail.
Installing the system in the rack
Use these instructions to install the N6000 series filer in the rack.
H1
H2
H3
H4
H5
H6
H7
H8
H9
H1
H2
H3
H4
H5
H6
H7
H8
H9
Bottom rail screws
Chassis attach screw
Locating pins
Locating pins
Chassis attach screw
1 EIA unit (1U)
Top rail screws
REAR
Left and Right
Rails
Section of rack EIA rail
FRONT
Left and Right
Rails
n600004
Figure 3. N6000 rail mounting template
Installation and setup instructions 5

svc00168
32-55 kg (70.5-121.2 lbs)
CAUTION:
The weight of this part or unit is between 46 and 55 kg (102 and 121 lb). It takes three
persons to safely lift this part or unit. (C010)
1. If attached, carefully remove the front bezel of the N6000 series filer with two hands by grasping the
openings on either side of the bezel.
2. From the front of the rack, place the storage system onto the rails and slide it in until the front
mounting bracket of the storage system is flush with the frame rails of the rack.
3. At the front of the rack, using four silver pan head M5 screws in the H3 and H7 holes, secure the
system unit to the rack by threading the screws through the system unit bracket and the rack frame
rail into the threaded rail nuts. Tighten the screws using a screwdriver.
4. Replace the front bezel of the N6000 series filer by snapping it back onto the storage system chassis.
5. From the rear of the rack, use four M5 flat head screws 1 to attach the rear tie-down bracket 2 to
the rails, as shown in Figure 4. The tie-down bracket should fit over the rear of the system unit.
6. Any storage expansion units should be installed in the rack. Refer to the Installation and Setup
Instructions for the N series storage expansion units to which you are connecting.
vVerify that all expansion unit IDs are correct and sequential in the individual loop(s) or stack(s), as
described in “Setting storage expansion unit shelf IDs” on page 7.
vVerify that the speed switches are set correctly, if applicable.
Note: SAS storage expansion units, such as the EXN3000 and EXN3500, do not have speed
switches.
If this system was configured by manufacturing, there are labels on the outside of the packaging
carton and on the side of the expansion unit chassis to indicate which loop (1-4) and on which node
(A or B) that expansion unit should be located. Make certain the expansion units are placed and
cabled according to these labels.
1
2
n600005
Figure 4. Attaching the rear tie-down bracket
6

Setting storage expansion unit shelf IDs
Use these instructions to set the storage expansion unit shelf IDs.
Setting EXN4000 or EXN1000 storage expansion unit shelf IDs
A unique shelf ID (from 1 to 7) is required for each EXN4000 or EXN1000 in a loop.
Shelf ID 1 is used for the first unit in a new loop. Shelf IDs for additional units are incremented
sequentially from the number of the first unit.
To adjust the storage expansion unit shelf ID, press the -or +buttons.
Note: This illustration shows a detailed view of the EXN4000. The shelf ID buttons on the EXN1000 are
in the same relative position.
Setting SAS expansion unit shelf IDs
A unique shelf ID (from 00 to 98) is required for each SAS storage expansion unit in a SAS stack.
2
1Gb 2Gb
Shelf ID
Gb switch
(set to 2 Gb)
Mute button
2
Shelf ID - close-up view
4Gb
2Gb4Gb 1Gb ELP
n620011
!
!
exn300007
1
Figure 5. Shelf ID tab on the EXN3000
Installation and setup instructions 7

Visually verify that the shelf ID for each SAS storage expansion unit is unique. If an ID is not unique, set
the ID:
1. Remove the front bezel if you have not already removed it.
2. Press and hold the shelf ID U-shaped tab (for EXN3000s) or button (for EXN3500s) 1 until the first
digit blinks.
3. Press the tab or button until the correct number is displayed.
4. Repeat steps 2 and 3 for the second digit.
5. Press and hold the tab or button until the second number stops blinking.
Result: Both numbers start blinking and the Fault LED on the operations panel illuminates after about
five seconds.
6. Power-cycle the SAS storage expansion unit to make the new expansion unit ID take effect.
7. Replace the front bezel.
Connecting the N6000 series filer to a network
Use these instructions to connect the N6000 series filer to a network.
Note: For a dual-controller N6000 series filer, perform the steps in this section for each controller node of
the N series system.
1. Refer to Figure 8 on page 9. Install the cable management tray 5 by pinching the arms of the tray
and fitting the holes in the arms over the retaining pins 1 under the controller cam handle 3.
Then release the tray arms.
When the system is cabled in later steps, push the onboard and adapter cables 2 through the tray
clips 4 and secure them at the end with the hook-and-loop fastener.
1
exn350006
Figure 6. Shelf ID button on the EXN3500
Fibre
Channel
Ethernet Console
Management
port
n600009
Figure 7. Port labels
8

Note: If you have any unused embedded Fibre Channel ports, you should set them offline by using
the following command:
fcadmin config -t unconfig <adapter_name>
2. Connect the RJ-45 to DB-9 adapter from the adapter kit to the console port on the system.
3. Connect one end of the serial null modem cable to your console, and then connect the other end to
the DB-9 end of the adapter.
5
1
2
3
4
n600007
Figure 8. Using the cable management tray
0c 0d0a 0be0be0a !
n600008
0c 0d0a 0be0be0a !
n600010
Installation and setup instructions 9

4. Connect your system to the network by plugging the network cables into the networking ports,
labeled e0a and e0b.
5. Connect the management port from the system to the network, using an Ethernet cable.
Note: The management port gives you the capability to remotely manage your system from anywhere
within a network connection. See Data ONTAP System Administration Guide for management
configuration information.
Important: The network for the management port must negotiate down to 10/100 or auto-negotiate.
6. Connect installed PCI cards as needed.
7. Prepare to connect the system to the expansion units.
vFor connections to EXN1000/EXN4000s: Make sure that SFPs are installed and firmly seated in the
Fibre Channel ports (0a through 0d) of the controller node and the In port of the first expansion
unit of the loop(s) before attaching a Fibre Channel cable.
vFor connections to SAS storage expansion units: Refer to the IBM System Storage N series Universal
SAS and ACP Cabling Guide for details about connecting your system to SAS storage expansion
units.
Connecting the system to expansion units
Use the cabling diagrams in this section to connect the N6000 series filer to the expansion units.
The following cabling instructions provide expansion unit cabling examples using the onboard Fibre
Channel ports on your N6000 series filer controller nodes. Review the following important notes about
using the onboard Fibre Channel ports on your N6000 series filer:
vWhen using onboard Fibre Channel ports to connect to storage expansion units, the onboard Fibre
Channel ports must be set to initiator mode. For more information, see "Configuring for initiator mode"
in the N6000 Series Hardware and Service Guide.
vSFPs must be used when connecting fiber cables.
vThe two ports in each pair of onboard Fibre Channel ports (ports 0a/0b and ports 0c/0d) are
controlled by the same chipset. The slots for add-on adapters are also controlled by specific chipsets on
the motherboard. (PCI slots 1 and 2 are paired; PCI slots 3 and 4 are paired.) To maintain
0c 0d0a 0be0be0a !
n600011
0c 0d0a 0be0be0a !
n600012
10

high-availability when cabling the filer to expansion units, do not connect the first expansion unit
(upper controller A and lower controller B) in a loop to two onboard Fibre Channel ports that are
controlled by the same chip set. Always cable your expansion units to ports or slots on different
chipsets. This is especially important when cabling your expansion units in dual-path configurations
for high availability.
vIf your system uses SyncMirror or MetroCluser, use Fibre Channel ports 0a and 0b for Pool 0 and ports
0c and 0d for Pool 1.
Important: If you are using optional adapter cards instead of the onboard Fibre Channel ports to connect
your system to expansion units, refer to the “Cabling your system using Fibre Channel expansion
adapters” section in the N6000 Series Hardware and Service Guide. See the appropriate "Optional adapter
cards" appendix in the N Series Introduction and Planning Guide for the required port usage and
specifications for the optional adapter cards supported by N6000 series systems.
The following cabling instructions show basic single-node and active/active cabling examples to
EXN1000, EXN2000 or EXN4000 storage expansion units.
N6000 series systems also support connections to SAS storage expansion units. For information about
cabling SAS storage expansion units, refer to the IBM System Storage N series Universal SAS and ACP
Cabling Guide.
Note: The SAS ports and Alternate Control Path (ACP) ports on SAS storage expansion unit
Input/Output modules (IOMs) are designated by square and circle symbols. All cabling is done in
reference to connecting to either square or circle ports. SAS connectivity does not use the concept of In
and Out ports.
The following cabling diagrams show two common multipath cabling configurations using the onboard
SAS ports on your N6000 series filer controller nodes. Multipath storage for high availability
(active/active) configurations provides redundancy for the path from each controller to every storage
expansion unit in the configuration.
Cabling a single-controller N6000 series filer
Use these instructions to connect a single-controller N6000 series filer (models A10, A11, A12) to the
storage expansion units.
Make sure that all expansion unit speed switches are set to the 2 Gb or 4 Gb (if supported) position. If
necessary, see the documents that came with the expansion unit for information about checking and/or
setting the switch.
Notes:
vSAS storage expansion units, such as the EXN3000 and EXN3500, do not have speed switches.
vFigure 9 on page 12 shows storage system connections to EXN2000/EXN4000 storage expansion units.
On EXN1000 expansion units, the positions of the In and Out ports are reversed from those of the
EXN2000/EXN4000.
vFigure 9 on page 12 shows only the first expansion unit in a loop. The number of expansion units per
loop might be different for your configuration.
Installation and setup instructions 11

1. Cable the controller port 0a to the expansion unit module A ESH4 or AT-FCX In port. See 1 in
Figure 9.
2. Cable the controller port 0c to the expansion unit module B ESH4 or AT-FCX In port. See 2 in
Figure 9.
3. For any additional expansion units in a loop, connect the expansion unit module A Out port to the
next expansion unit's module A In port. Repeat for module B.
Note: Both the AT-FCX and the ESH4 modules are self-terminating.
4. If you are cabling a second loop, repeat steps 1 to 3, using controller ports 0b and 0d. See 3 in
Figure 9.
Cabling a high-availability (active/active) dual-controller N6000 series
filer
Use these instructions to connect a high-availability (active/active) dual-controller N6000 series filer
(models A20, A21, A22) to the storage expansion units.
Make sure that all expansion unit speed switches are set to the 2 Gb or 4 Gb (if supported) position. If
necessary, see the documents that came with the expansion unit for information about checking and/or
setting the switch.
Notes:
vSAS storage expansion units, such as the EXN3000 and EXN3500, do not have speed switches.
vIllustrations in this procedure show storage system connections to EXN2000/EXN4000 storage
expansion units. On EXN1000 expansion units, the positions of the In and Out ports are reversed from
those of the EXN2000/EXN4000.
PSU
Controller
A0d0c0b0a
IN
OUT
IN OUT
IN
OUT
IN OUT
Module A
Module B
PSU
PSU
PSU
PSU
1
2
3
n600013
Figure 9. Cabling a single-controller configuration
12

1. Cable Controller A port 0a to the Controller A/Loop 1 expansion unit module A ESH4 or AT-FCX In
port. See 1 in Figure 10.
2. Cable Controller B port 0c to the Controller A/Loop 1 expansion unit module A ESH4 or AT-FCX In
port. See 2 in Figure 10.
6.4.2
PSU
Controller
A
Controller
B
PSU
0d
0c0b0a
0d0c0b0a
IN
OUT
IN OUT
IN
OUT
IN OUT
IN
OUT
IN OUT
IN
OUT
IN OUT
Module A
Module B
PSU
PSU
PSU
PSU
PSU
PSU
PSU
PSU
Controller A/Loop 1
Controller B/Loop 1
1
2
n600014
Figure 10. Cabling Channel A paths in high-availability (active/active) configuration
Installation and setup instructions 13

3. Cable Controller B port 0a to the Controller A/Loop 1 expansion unit module B ESH4 or AT-FCX In
port. See 3 in Figure 11.
4. Cable Controller A port 0c to the Controller B/Loop 1 expansion unit module B ESH4 or AT-FCX In
port. See 4 in Figure 11.
5. For any additional expansion units in a loop, connect the expansion unit module A Out port to the
next expansion unit's module A In port. Repeat for module B.
Dual-path Fibre Channel cabling
Use these instructions to implement dual-path Fibre Channel cabling in a high-availability (active/active)
configuration.
This step is optional. You must have ordered the "Dual-Path Fibre Channel Cabling" feature and/or
additional fiber cables and SFP Gigabit Interface Converters (GBICs) to implement this feature. Dual-path
Fibre Channel cabling only applies to high availability (active/active) A20/A21/A22 models. The purpose
of dual-path Fibre Channel cabling is to provide each controller node in a high availability (active/active)
configuration with redundant Fibre Channel paths (Loop A and Loop B) to each loop of disk storage
expansion units. It improves reliability and availability by providing redundant Fibre Channel paths from
each node of a high availability (active/active) configuration model to each loop of storage expansion
units.
Two additional SFP GBICs and two Fibre Channel cables are used to connect the last storage expansion
unit in a loop of storage expansion units to the other node of the high availability (active/active)
configuration.
6.5.1
6.5.2
PSU
A
BPSU
0d0c0b0a
0d0c0b0a
IN
OUT
IN OUT
IN
OUT
IN OUT
IN
OUT
IN OUT
IN
OUT
IN OUT
PSU
PSU
PSU
PSU
PSU
PSU
PSU
PSU
Controller
Controller
Module A
Module B
Controller A/Loop 1
Controller B/Loop 1
3
4
n600015
Figure 11. Cabling Channel B paths in high-availability (active/active) configuration
14