Dell PowerEdge FX2 User manual

A Dell EMC Deployment and Configuration Guide
PowerEdge FX2 - Upgrading from 10GbE
Pass-through Modules to FN410S I/O Modules
Dell Networking Solutions Engineering
June 2016

2 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
Revisions
Date
Revision
Description
Authors
June 2016
1.0
Initial Release
Jim Slaughter, Mark Fisher, Shree Rathinasamy
Copyright © 2016 Dell Inc. or its subsidiaries. All Rights Reserved.
Except as stated below, no part of this document may be reproduced, distributed or transmitted in any form or by any
means, without express permission of Dell.
You may distribute this document within your company or organization only, without alteration of its contents.
THIS DOCUMENT IS PROVIDED “AS-IS”, AND WITHOUT ANY WARRANTY, EXPRESS OR IMPLIED. IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE SPECIFICALLY
DISCLAIMED. PRODUCT WARRANTIES APPLICABLE TO THE DELL PRODUCTS DESCRIBED IN THIS DOCUMENT
MAY BE FOUND AT: http://www.dell.com/learn/us/en/vn/terms-of-sale-commercial-and-public-sector-warranties
Performance of network reference architectures discussed in this document may vary with differing deployment
conditions, network loads, and the like. Third party products may be included in reference architectures for the
convenience of the reader. Inclusion of such third party products does not necessarily constitute Dell’s recommendation of
those products. Please consult your Dell representative for additional information.
Trademarks used in this text:
Dell™, the Dell logo, PowerEdge™ and Force10™ are trademarks of Dell Inc. Other Dell trademarks may be used in this
document. Other trademarks and trade names may be used in this document to refer to either the entities claiming the
marks and/or names or their products and are the property of their respective owners. Dell disclaims proprietary interest in
the marks and names of others. Other trademarks and trade names may be used in this document to refer to either the
entities claiming the marks and/or names or their products and are the property of their respective owners. Dell disclaims
proprietary interest in the marks and names of others.

3 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
Table of contents
Revisions.............................................................................................................................................................................2
1Introduction...................................................................................................................................................................4
1.1 Typographical conventions.................................................................................................................................4
1.2 Before upgrading................................................................................................................................................4
2Hardware......................................................................................................................................................................5
2.1 The Dell PowerEdge FX2/FX2s and supported modules...................................................................................5
2.2 Dell 10GbE Pass-through Module......................................................................................................................7
2.3 PowerEdge FN410S I/O Module........................................................................................................................7
3Upgrade........................................................................................................................................................................8
3.1 Overview.............................................................................................................................................................8
3.2 Step-by-step example.........................................................................................................................................9
3.2.1 Part 1 - Configure the ToR switch ....................................................................................................................11
3.2.2 Part 2 –Replace the PTM in Slot A1 with an FN410S.....................................................................................12
3.2.3 Part 3 –Replace the PTM in Slot A2 with an FN410S.....................................................................................14
AReferences and additional resources.........................................................................................................................16
BComponents used in this guide..................................................................................................................................17
CTerminology................................................................................................................................................................18
DFN IOM internal port mapping....................................................................................................................................19
D.1 Quarter-width servers with dual-port CNAs......................................................................................................19
D.2 Half-width servers with dual-port CNAs............................................................................................................20
D.3 Half-width servers with quad-port CNAs...........................................................................................................21
D.4 Full-width servers with dual-port CNAs ............................................................................................................22
D.5 Full-width Servers with quad-port CNAs...........................................................................................................23
ESupport and feedback ................................................................................................................................................24

4 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
1Introduction
This deployment guide covers a step-by-step procedure to minimize network downtime when upgrading from
Dell 10 Gigabit Ethernet (10GbE) Pass-through Modules (PTMs) to PowerEdge FN410S Input/Output
Modules (IOMs) in a PowerEdge FX2 chassis.
When upgrading, all servers in the chassis may remain up throughout the process. In the scenario covered in
this guide, the PTMs are hot-swapped one at a time so that no more than half of the server network ports are
down at any point in the upgrade.
Upgrading from PTMs to FN410S IOMs provides the following benefits:
Adds multilayer switching capability to the chassis
Adds redundancy to links going to the top-of-rack (ToR) switch
Optimizes east-west traffic by allowing server-to-server communication within the chassis
Can significantly reduce cabling at the back of the chassis
Additional configuration is not required on the FN410S for many common deployments
Note: If FX2 server network adapters are configured such that a single LACP NIC team spans both PTMs,
and therefore will span both FN410S IOMs upon replacement, the FN410S IOMs will need to be configured
as Virtual Link Trunking (VLT) peers. This will bring all network ports in the FX2 chassis down during
configuration. Use the PowerEdge FX2 –FN I/O Module –VLT Deployment Guide for this scenario.
1.1 Typographical conventions
This document uses the following typographical conventions:
Monospace text CLI examples
Bold monospace text Commands entered at the CLI prompt
Underlined monospace text CLI examples that word wrap (text is entered as a single command)
Italic monospace text Variables in CLI examples
1.2 Before upgrading
Dell EMC recommends reviewing the Dell PowerEdge FN I/O Module (FN IOM) - Easy Deployment Guide
before upgrading to FN410S IOMs. The Easy Deployment Guide covers basic FN IOM tasks such as the
following:
Resetting to factory defaults
Establishing a remote or serial connection to the management interface
Disabling and re-enabling Uplink Failure Detection (UFD)

5 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
2Hardware
This section briefly describes the hardware used in this guide.
2.1 The Dell PowerEdge FX2/FX2s and supported modules
The PowerEdge FX2 and FX2s enclosures are 2U, hybrid, rack-based computing platforms. They combine
the density and efficiencies of blades with the simplicity and cost benefits of rack-based systems.
Dell PowerEdge FX2s (front) with one PowerEdge FC630 server installed
Dell PowerEdge FX2s (back) with two PowerEdge FN410S IOMs installed
Note: This guide applies to either the PowerEdge FX2 or FX2s chassis. The FX2 does not offer PCIe
expansion slots. The FX2s includes eight PCIe expansion slots, as Figure 2 shows.

6 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
FX2 with server and networking modules
FX2 module descriptions

7 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
2.2 Dell 10GbE Pass-through Module
The Dell 10GbE PTM provides one-to-one connectivity from blade server network adapter ports to ToR switch
ports. It has eight internal ports and eight external SFP+ ports. The pass-through module does not do any
switching.
2.3 PowerEdge FN410S I/O Module
The PowerEdge FN410S IOM is a Layer 2 and 3 switch with eight internal ports and four external SFP+ ports.
In addition to full switching and routing features, it supports FCoE, iSCSI with data center bridging (DCB),
stacking, and VLT. It comes preconfigured for many common deployments.

8 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
3Upgrade
3.1 Overview
Figure 5 shows a fully loaded FX2 chassis configured with two 10GbE PTMs. Four FC630 servers reside in
the front slots, each containing a quad-port converged network adapter (CNA). The PTMs reside in slots A1
and A2 in the back of the chassis.
This configuration requires eight uplinks from each PTM to the ToR switch, one for each server CNA port. If
an uplink fails, the corresponding CNA port goes down until the link is restored.
ToR Switch
FX2 Chassis
FC630 Slot 2
FC630 Slot 3
FC630 Slot 4
FC630 Slot 1
PTM-A2
PTM-A1
Eight 10GbE Uplinks
from each PTM
Before Upgrade
Fully loaded FX2 chassis before upgrade
The same FX2 chassis with the two PTMs replaced by two FN410S IOMs is shown in Figure 6.
The four external ports on each FN410S are configured in a 40GbE LACP port channel connected to the ToR
switch. Anywhere from one to four uplinks can be used from each FN410S. The bandwidth of each LACP port
channel will equal the sum of the connected links.
Dell EMC recommends a minimum of two uplinks from each FN410S for redundancy. If an uplink fails, traffic
continues to flow on the remaining uplink(s) in the port channel without affecting connectivity of the server
CNAs.

9 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
ToR Switch
FX2 Chassis
FC630 Slot 2
FN410S-A1
FC630 Slot 3
FC630 Slot 4
FC630 Slot 1
FN410S-A2
40GbE LACP Port
Channels
After Upgrade
Fully loaded FX2 chassis after upgrade
3.2 Step-by-step example
This section provides steps to replace each PTM with an FN410S in a sequence that minimizes network
downtime on the servers inside the FX2 chassis. The chassis and servers remain up and running throughout
the upgrade.
For clarity in the diagrams, this step-by-step example uses a reduced number of connections as shown in
Figure 7 and Figure 8.
In this example, there are two FC630 servers in the chassis, and each FC630 server has a dual-port CNA. On
each server, one CNA port is untagged in the default vlan and the other port is tagged in VLAN 6. A Dell
Networking S4048-ON functions as the ToR switch.
Notes:
Any Dell or third-party switch that supports 10GbE SFP+ links and LACP may be used as the ToR
switch in place of the S4048-ON. See the Dell PowerEdge FN I/O Module (FN IOM) - Easy Deployment
Guide for LACP configuration commands on common third-party switches.
The FN410S IOMs are at their factory default settings throughout the upgrade. See the Dell PowerEdge
FN I/O Module (FN IOM) - Easy Deployment Guide for steps to reset FN IOMs to factory defaults if
needed.
Replace the VLANs and port numbers in this example with those in your configuration.

10 PowerEdge FX2 - Upgrading from 10GbE Pass-through Modules to FN410S I/O Modules | version 1.0
S4048-ON
FX2 Chassis
Upstream
Server
PTM-A2
FC630
Slot 3
CNA port 1
10.0.0.1
FC630
Slot 1
CNA port 1
10.0.0.3
CNA port 2
192.168.1.1
CNA port 2
192.168.1.3
port 1
port 1
port 5
port 5 te 1/1
te 1/2
te 1/3
te 1/4
te 1/9
te 1/10
port 1
10.0.0.6
port 2
192.168.1.6
port 1
port 1
port 5
port 5
ToR
Switch
PTM-A1
Step-by-Step Example: Before Upgrade
default VLAN
VLAN 6
Step-by-step example - before upgrade with PTMs installed
S4048-ON
FX2 Chassis
Upstream
Server
FC630
Slot 3
CNA port 1
10.0.0.1
FC630
Slot 1
CNA port 1
10.0.0.3
CNA port 2
192.168.1.1
CNA port 2
192.168.1.3
te 0/9
te 0/9
te 0/10
te 0/10 te 1/5
te 1/6
te 1/7
te 1/8
te 1/9
te 1/10
port 1
10.0.0.6
port 2
192.168.1.6
te 0/1
te 0/1
te 0/5
te 0/5
ToR
Switch
Po 128
FN410S-A1
FN410S-A2
Po 10
Po 128
Po 11default VLAN
VLAN 6
Step-by-Step Example: After Upgrade
Step-by-step example - after upgrade with FN410S IOMs installed