IBM N Series User manual

IBM System Storage N series
Clustered Data ONTAP Switch Setup and
Configuration Guide
SC27-6293-00


Contents
Overview of the cluster and management switches .................1
Setting up the cluster and management switches ..................3
Overview of the initial setup for the cluster and management switches ................3
Management and cluster switch configuration requirements overview ................4
Management switch option settings............................6
CN1610 switch option settings .............................6
Port assignments for the cluster and management switches .............9
Management switch port assignments ...........................9
CN1610 port assignments...............................10
Required CN1610 documentation ........................13
Using the cluster and management switch procedures ...............15
Installing the management switch ............................15
Installing the CN1610 cluster switch ...........................15
Upgrading images on a CN1610 switch ..........................19
Replacing a CN1610 switch ..............................22
Websites ...................................27
Notices ...................................29
Trademark information ...............................30
Important notes ..................................31
Electronic emission notices ..............................31
Federal Communications Commission Statement ......................31
Industry Canada Compliance Statement .........................32
Australia and New Zealand Class A Statement ......................32
European Union Electromagnetic Compatibility Directive ...................32
Germany Electromagnetic Compatibility Directive .....................33
People's Republic of China Class A Statement .......................34
Taiwan Class A Statement .............................34
Taiwan Contact Information .............................34
Japan Voluntary Control Council for Interference Class A Statement ...............34
Japan Electronics and Information Technology Industries Association Statement ...........34
Korean Communications Commission Class A Statement ...................35
Russia Electromagnetic Interference Class A Statement ....................35
Index ....................................37
© Copyright IBM Corp. 2013 iii

iv IBM System Storage N series: Clustered Data ONTAP Switch Setup and Configuration Guide

Overview of the cluster and management switches
IBM N series recommends using CN1610 as the cluster network switch. Refer to
the management network switch requirements in this section for selecting a
management network switch.
The CN1610 cluster switches are designed to work in clusters ranging in size from
two to twelve nodes in Cluster-Mode supported configurations.
vCN1610 cluster network switch
This is a managed Layer 2 switch that provides 16 10-Gb Small Form-Factor
Pluggable Plus (SFP+) ports and it features four ISL ports with an
inband/outband management port. You can install the CN1610 switch in an IBM
N series system cabinet with the rack-mount installation kit that comes with the
switch, or you can install it in a rack. For more information about the CN1610
switch, see CN1610 Installation Guide.
vManagement network switch
For the management switch, use a managed Layer 2 switch that provides
10/100/1000 Base-T ports. The management switch must support 802.1 link
aggregation, spanning tree protocol, and at least 2 inter switch links. You can
install the switch in an IBM N series system cabinet with the rack-mount
installation kit that comes with the switch, or you can install it in a rack. For
more information on installing the management switch, consult the
documentation for your switch. Port numbers may vary depending on how
many nodes you plan to have in your cluster. For more information, see
“Management switch port assignment table” on page 9.
The following table lists the feature codes and descriptions for the CN1610 switch
and related components:
Feature code Description
1001 CN1610 10-GbE cluster switch
1090 Twinax 0.5-meter copper cable for CN1610
1091 Twinax 2-meter copper cable for CN1610
1092 Twinax 5-meter copper cable for CN1610
2013 SFP+ 10-GbE module for CN1610
© Copyright IBM Corp. 2013 1

2IBM System Storage N series: Clustered Data ONTAP Switch Setup and Configuration Guide

Setting up the cluster and management switches
You can use the setup information to get your switches ready to configure and
customize them for your requirements.
Overview of the initial setup for the cluster and management switches
Follow the general summary of this process to install your switches and get them
ready to customize for your environment's needs.
Before you begin
vYou must have access to an FTP or a TFTP server at the installation site or it
must be installed on your laptop for the download of the applicable IBM N
series cluster network and management network software and configuration
files.
vYou must have the required cluster network and management network switch
documentation.
See Required CN1610 documentation for more information.
vYou must have the applicable controller and Cluster-Mode documentation.
vYou must have the applicable network and configuration information and cables.
vYou must have the recommended port assignments to set up the cluster.
About this task
All of your IBM N series cluster network switches should arrive with the standard
IBM N series factory default configuration installed on them. These switches
should also have the current version of the Cluster-Mode firmware and reference
configuration files (RCFs) loaded.
Note: If necessary, you can download the applicable IBM N series RCFs and
operating system software for your switches from the IBM N series support
website.
This procedure provides a general summary of the process to install your switches
and get them running:
Procedure
1. Rack the cluster network and management network switches and controllers as
shown in the switch installation guides for your switches. See the Required
CN1610 documentation for the appropriate guide.
2. Using the port installation table as a model, cable the cluster network and
management network switches to the controllers.
3. Power on the cluster network and management network switches and
controllers. See the Cluster switch procedures for more information about this
process.
4. Do the initial setup for the management switch. See the information provided
in the Cluster switch procedures for more information about this process. You
need to do this before setting up the cluster switches to ensure that the cluster
switches can connect to the management network.
5. Perform an initial configuration of the cluster switches.
© Copyright IBM Corp. 2013 3

Note: Your switch is shipped with the current versions of the RCF and
FASTPATH image. The RCF is loaded onto the switch but will still need to be
applied to create a working configuration. You do not need to change the RCF
if you are satisfied with the version on your switch.
See the information provided in the Cluster switch procedures for more
information about this task.
6. Verify the configuration choices you made in the display that appears at the
end of the setup, and ensure that you save the configuration.
7. Check the software version on the cluster network switches, and if necessary,
download the IBM N series-supported version of the software to the switches.
If you download the IBM N series-supported version of the software, then you
must also download the appropriate IBM N series Cluster Network Switch
Reference Configuration File and merge it with the configuration you saved in
Step 5. You can download the file and the instructions from IBM N series
support website.
8. Perform an initial configuration of the management network switches based on
information provided in the Cluster switch procedures section of this guide.
What to do next
Continue to customize the switch to meet your environment's requirements. It is
strongly recommended that you configure the date and time, DNS, SNTP, host
name, prompt, and administrator password.
For more information about the procedures to install the management or CN1610
switches, go to the Cluster switch procedures. For information about the
command-line interface (CLI) commands to help you customize the switch, see the
CLI reference manual for your switch.
Management and cluster switch configuration requirements overview
To configure your cluster, you need the appropriate number and type of cables and
cable connectors for your switches. Depending on the type of switch you are
initially configuring, you need to connect to the switch console port with the
included console cable and you need specific network information.
Supported platforms
You need the following network information for all switch and controller
configurations:
vTwo or more IP subnet addresses for cluster network and management network
traffic
vHost names and IP addresses for each of the switches and controllers
Figure 1 on page 5 shows the cabling connections for a two-node cluster using
CN1610 switches with N7550T and N7950T controllers. There is a single
management connection from each node to the management switch. The labeled
port connectors indicate the following connections:
ve0c, e0e: cluster switch connections
ve0M: management switch connections
ve0a: redundant management connections
4IBM System Storage N series: Clustered Data ONTAP Switch Setup and Configuration Guide

I 0
USB e0m e0p
e0a e0b e0c e0d e0e e0f
Slot 3
Slot 4
Slot 5
Slot 6
0a 0b 0c 0d
Slot 1
Slot 2
I 0
USB e0m e0p
e0a e0b e0c e0d e0e e0f
Slot 3
Slot 4
Slot 5
Slot 6
0a 0b 0c 0d
Slot 1
Slot 2
12345678910 11 12 13 14 15 16
I0I0I
12345678910 11 12 13 14 15 16
I0I0I
I0I0I
1357 9
11 13 15
2 4 6 8 10 12 14 16
I0I0I
1357 9
11 13 15
2 4 6 8 10 12 14 16
18
15
13
12
11
10
9
8
65
4
3
2
1
4 6
14
17
15
13
12 14
6
20
6
cdot0003
22
21
19
16
7
7
Figure 1. Cabling connections for a two-node cluster using CN1610 switches
Setting up the cluster and management switches 5

1 Management switch A 12 Nodes to cluster
2 To node 1 13 10 Gb SFP+
3 To cluster switch A 14 Nodes to cluster
4 RJ-45 10/100/1000 Mbps 15 ISL
5 Inter switch link 16 To management switch A port 13
6 Console 17 Cluster switch B
7 Customer network 18 Node 1
8 Management switch B 19 To management switch B port 13
9 To node 2 20 Node 2
10 To cluster switch B 21 To management switch A port 1
11 Cluster switch A 22 To management switch B port 2
Required network information for management switches
Port e0M is allocated as the management port on supported platforms. The
management port assignments for the various controllers are:
vPort e0f and the remote LAN module (RLM) on N7600, N7700, N7800, and
N7900 systems
vPort e0d and the RLM on N5300 and N5600 systems
vPort e0M or the service port (wrench icon) on N32xx, N60xx, N62xx, N7550T,
and N7950T systems
Note: The node management logical interface (LIF) resides on a single port on a
node and uses a single port on a switch by default. The node management LIF
does not fail over to other ports on the node in the same manner that the data and
cluster LIFS do. For more information about how to configure the node
management LIF for failover, see Network Management Guide and the Data ONTAP
8.2 Clustered Data ONTAP Release Notes.
Management switch option settings
This table shows the management switch settings that can be modified and set on
your management switch on site.
Management switch option settings
Option Setting configuration
Link aggregation on for inter-switch links
MTU MTU for management switch on all ports to
1518
MSTP on
CN1610 switch option settings
The CN1610 switch ships with settings that were made by IBM, including the
FASTPATH software default values.
This table shows the CN1610 switch settings as set by IBM, the FASTPATH default
settings, and option settings that can be modified on site. Some of the settings are
6IBM System Storage N series: Clustered Data ONTAP Switch Setup and Configuration Guide