Dell Networking S4810 User manual

Dell Force10 S4810
Switch Configuration Guide
Dell Product Group
January 2013
[e-mail]

2 SCG1000 Force10 S4810 Configuration Guide
© 2012 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express
written permission of Dell Inc. is strictly forbidden. For more information, contact Dell.
Dell, the Dell logo, and the Dell badge, PowerConnect, EqualLogic, and Force10 are trademarks of Dell Inc.

3 SCG1000 Force10 S4810 Configuration Guide
Table of contents
1Introduction................................................................................................................................................................................ 5
1.1 Audience........................................................................................................................................................................... 5
1.2 Switch details ................................................................................................................................................................... 5
1.3 Cabling diagram .............................................................................................................................................................. 6
2Dell recommended switch configuration ............................................................................................................................. 7
2.1 Hardware configuration................................................................................................................................................. 7
2.2 Delete startup configuration......................................................................................................................................... 7
2.3 Configure out of band (OOB) management port ..................................................................................................... 7
2.4 Configure route for OOB management port (optional) ..........................................................................................8
2.5 Configure login credentials........................................................................................................................................... 8
2.6 Enable iSCSI optimization feature................................................................................................................................8
2.7 Enable switch ports ........................................................................................................................................................ 8
2.8 Spanning tree...................................................................................................................................................................9
2.9 Configure port channel for LAG...................................................................................................................................9
2.10 Configure QSFP ports for LAG......................................................................................................................................9
2.11 Save configuration ........................................................................................................................................................ 10
2.12 Configure additional switch ........................................................................................................................................ 10
3Configure Data Center Bridging (DCB) (Optional).............................................................................................................11
3.1 Disable 802.3x flowcontrol on SFP+ ports................................................................................................................11
3.2 Disable 802.3x flowcontrol on QSFP ports...............................................................................................................11
3.3 Create tagged VLAN for all ports and port-channels..............................................................................................11
3.4 Configure priority groups and policies ......................................................................................................................11
3.5 Apply policies to switch ports..................................................................................................................................... 12
3.6 Configure ETS values.................................................................................................................................................... 13
3.7 Enable DCB .................................................................................................................................................................... 13
3.8 Reload ............................................................................................................................................................................. 13
3.9 Save configuration ........................................................................................................................................................ 13
3.10 Configure additional switches .................................................................................................................................... 13
4Reverting from DCB to non-DCB configuration (Optional) ............................................................................................ 14
4.1 Disable DCB ................................................................................................................................................................... 14
4.2 Remove DCB policies and apply standard flow control ........................................................................................ 14

4 SCG1000 Force10 S4810 Configuration Guide
4.3 Revert to default VLAN ID on switch and arrays ..................................................................................................... 15
4.4 Save configuration ........................................................................................................................................................ 15
4.5 Reload ............................................................................................................................................................................. 15
4.6 Verify DCB status........................................................................................................................................................... 15
4.7 Configure additional switch ........................................................................................................................................ 15
Additional resources....................................................................................................................................................................... 16

5 SCG1000 Force10 S4810 Configuration Guide
1Introduction
This document illustrates how to configure Dell™ Force10™ S4810 switches for use with EqualLogic™ PS
Series storage using Dell best practices. The recommended configuration uses link aggregation groups
(LAGs) for inter-switch connections. Optional steps are provided in section 3 to enable Data Center
Bridging (DCB).
For more information on EqualLogic SAN design recommendations, see the EqualLogic Configuration
Guide at: www.delltechcenter.com/page/equallogic+configuration+guide.
1.1 Audience
This switch configuration guide describes an optimal configuration following Dell best practices for an
EqualLogic iSCSI SAN and is intended for storage or network administrators and deployment personnel.
1.2 Switch details
The table below provides an overview of the switch configuration.
Table 1 Switch specifications
Dell Force10 S4810
Switch vendor Dell Force10
Switch model S4810
Switch firmware 8.3.12.0 or later
The latest firmware updates and documentation can be found at: www.force10networks.com. This site
requires a login.

6 SCG1000 Force10 S4810 Configuration Guide
1.3 Cabling diagram
The cabling diagram shown below represents the Dell recommend method for deploying your servers and
EqualLogic arrays.
Figure 1 Cabling diagram

7 SCG1000 Force10 S4810 Configuration Guide
2Dell recommended switch configuration
These steps show you how to configure two Force10 S4810 switches with a LAG. The switches are
interconnected using two of the 40 GbE Quad Small Form-factor Pluggable (QSFP) uplink ports, and the
LAG is configured for Dynamic Link Aggregation Control Protocol (LACP).
2.1 Hardware configuration
1. Power on the two switches.
2. Connect a serial cable to the serial port of the first switch.
3. Using Putty or another terminal utility, open a serial connection session to the switch.
4. Open your terminal emulator and configure it to use the serial port (usually COM1 but this may vary
depending on your system). Configure serial communications for 9600,N,8,1 and no flow control.
5. Connect the (QSFP) LAG cables between the switches, by connecting port 48 on switch 1 to port 48
on switch2 and port 52 on switch 1 to port 52 on switch 2. See this configuration in Figure 1.
2.2 Delete startup configuration
FTOS>enable
FTOS#delete startup-config
Proceed to delete startup-config [confirm yes/no]yes
FTOS#reload
System configuration has been modified. Save? [yes/no]no
Proceed with reload [confirm yes/no]yes
Note: The switch will reboot.
2.3 Configure out of band (OOB) management port
FTOS>enable
FTOS>#config
FTOS(conf)#interface ManagementEthernet 0/0
FTOS(conf-if-ma-0/0)#no shutdown
FTOS(conf-if-ma-0/0)#ip address ipaddress mask
FTOS(conf-if-ma-0/0)#exit

8 SCG1000 Force10 S4810 Configuration Guide
2.4 Configure route for OOB management port (optional)
Force10(conf)#management route X.Y.Z.0 /24 A.B.C.1
Note: X.Y.Z.0 is the network your management system is connecting from and A.B.C.1 is the gateway for
the switch. If your management system is on the same subnet as the switch, the previous step may be
omitted. The example above assumes a class C subnet mask.
2.5 Configure login credentials
FTOS(conf)#username admin privilege 15 password 0 yourpassword
FTOS(conf)#enable password level 15 0 yourpassword
2.6 Enable iSCSI optimization feature
This feature is enabled when EqualLogic arrays are connected. It automatically performs the following:
•Configures jumbo frames to 12k on all ports.
•Disables unicast storm.
•Enables spanning tree portfast on ports connected to EqualLogic arrays.
•Configures flowcontrol on all ports (rx on tx off).
Note: Spanning tree portfast must be manually configured for host facing ports. Refer to section 2.8.
FTOS#configure
FTOS(conf)#iscsi enable
FTOS(conf)#exit
2.7 Enable switch ports
Option 1: You can enable the array or host facing ports individually.
Note: This method is more secure than Option 2.
FTOS#configure
FTOS(conf)#interface tengigabitethernet 0/0
FTOS(conf-if-te-0/0)#switchport
FTOS(conf-if-te-0/0)#no shutdown
FTOS(conf-if-te-0/0)#exit
FTOS(conf)#exit

9 SCG1000 Force10 S4810 Configuration Guide
Option 2: You can enable all ports at once.
FTOS#configure
FTOS(conf)#interface range tengigabitethernet 0/0 – 47
FTOS(conf -if-range-te-0/0-47)#switchport
FTOS(conf -if-range-te-0/0-47)#no shutdown
FTOS(conf -if-range-te-0/0-47)#exit
FTOS(conf)#exit
2.8 Spanning tree
Manually configure spanning tree if the iSCSI optimization feature is not being used.
FTOS#configure
FTOS(conf)#interface range tengigabitethernet 0/0 - 47
FTOS(conf-if-range-te-0/0-47)#spanning-tree rstp edge-port
FTOS(conf-if-range-te-0/0-47)#exit
FTOS(conf)#exit
2.9 Configure port channel for LAG
These commands configure the switch interconnect as a LAG.
FTOS#configure
FTOS(conf)#interface Port-channel 1
FTOS(conf-if-po-1)#no ip address
FTOS(conf-if-po-1)#mtu 12000
FTOS(conf-if-po-1)#switchport
FTOS(conf-if-po-1)#no shutdown
FTOS(conf-if-po-1)#exit
2.10 Configure QSFP ports for LAG
FTOS(conf)#interface range fortyGigE 0/48 , fortyGigE 0/52

10 SCG1000 Force10 S4810 Configuration Guide
FTOS(conf-if-range-fo-0/48-52)#no ip address
FTOS(conf-if-range-fo-0/48-52)#mtu 12000
FTOS(conf-if-range-te-0/48-52)#no shutdown
FTOS(conf-if-range-fo-0/48-52)#flowcontrol rx on tx off
FTOS(conf-if-range-fo-0/48-52)#port-channel-protocol lacp
FTOS(conf-if-range-fo-0/48-52-lacp)#port-channel 1 mode active
FTOS(conf-if-range-fo-0/48-52-lacp)#exit
FTOS(conf-if-range-fo-0/48-52)#exit
FTOS(conf)#exit
2.11 Save configuration
FTOS#copy run start
2.12 Configure additional switch
Repeat the commands from section 2 to configure the second switch.

11 SCG1000 Force10 S4810 Configuration Guide
3Configure Data Center Bridging (DCB) (Optional)
To enable DCB mode on the switch, use the following commands.
Note: You must complete the Dell recommended switch configuration steps in sections 2.1 to 2.12
before configuring the switch for DCB mode.
3.1 Disable 802.3x flowcontrol on SFP+ ports
FTOS#configure
FTOS(conf)#interface range tengigabitethernet 0/0 - 47
FTOS(conf-if-range-te-0/0-47)#no flowcontrol rx on tx off
3.2 Disable 802.3x flowcontrol on QSFP ports
FTOS#configure
FTOS(conf)#interface range fortyGigE 0/48 – 60
FTOS(conf-if-range-fo-0/48-52)#no flowcontrol rx on tx off
3.3 Create tagged VLAN for all ports and port-channels
FTOS#configure
FTOS(conf)#interface vlan vlan-id
Note: You must supply a VLAN id. The valid range is 2-4093.
FTOS (conf-if-vl-vlan-id*)#tagged tengigabitethernet 0/0-47
FTOS (conf-if-vl-vlan-id*)#tagged port-channel 1
3.4 Configure priority groups and policies
FTOS#configure
FTOS(conf)#dcb-input pfc
FTOS(conf-dcb-in)#pfc priority 4
FTOS(conf-dcb-in)#exit
FTOS(conf)#priority-group iSCSI

12 SCG1000 Force10 S4810 Configuration Guide
FTOS(conf-pg)#priority-list 4
FTOS(conf-pg)#set-pgid 1
FTOS(conf-pg)#exit
FTOS(conf)#priority-group OTHER
FTOS(conf-pg)#priority-list 0-3,5-7
FTOS(conf-pg)#set-pgid 2
FTOS(conf-pg)#exit
FTOS(conf)#dcb-output ets
FTOS(conf-dcb-out)#priority-group iSCSI qos-policy iSCSI
FTOS(conf-dcb-out)#priority-group OTHER qos-policy OTHER
FTOS(conf-dcb-out)#exit
FTOS (conf)#service-class dynamic dot1p
3.5 Apply policies to switch ports
FTOS(conf)#interface range ten 0/0 – 47
FTOS(conf-if-range-te-0/0-47)#dcb-policy input pfc
FTOS(conf-if-range-te-0/0-47)#dcb-policy output ets
FTOS(conf-if-range-te-0/0-47)#protocol lldp
FTOS(conf-if-range-te-0/0-47-lldp)#exit
FTOS(conf-if-range-te-0/0-47)#exit
FTOS(conf)#interface range fortyGigE 0/48 - 60
FTOS(conf-if-range-fo-0/48-60)#dcb-policy input pfc
FTOS(conf-if-range-fo-0/48-60)#dcb-policy output ets
FTOS(conf-if-range-fo-0/48-60)#exit

13 SCG1000 Force10 S4810 Configuration Guide
3.6 Configure ETS values
FTOS#configure
FTOS(conf)#qos-policy-output iSCSI ets
FTOS(conf-qos-policy-out-ets)#bandwidth-percentage ##
FTOS(conf-qos-policy-out-ets)#exit
FTOS(conf)#qos-policy-output OTHER ets
FTOS(conf-qos-policy-out-ets)#bandwidth-percentage ##
FTOS(conf-qos-policy-out-ets)#exit
Note: The sum of the bandwidth-percentages must be equal to 100.
3.7 Enable DCB
FTOS#configure
FTOS(conf)#dcb enable
FTOS(conf)#dcb stack-unit all pfc-buffering pfc-ports 56 pfc-queues 2
3.8 Reload
FTOS#reload
System configuration has been modified. Save? [yes/no]yes
Proceed with reload [confirm yes/no]yes
Note: The switch will reboot.
3.9 Save configuration
FTOS#copy run start
3.10 Configure additional switches
Repeat the commands from section 3 to configure DCB on additional switches.

14 SCG1000 Force10 S4810 Configuration Guide
4Reverting from DCB to non-DCB configuration (Optional)
One method to revert from a DCB configured switch to a non-DCB configured switch is to delete the
current configuration (startup-config) and follow the steps in Section 2. If deleting the current
configuration is not an option, then use the following procedure to unconfigure DCB and enable standard
flow control.
Note: This is a disruptive operation that will require down time. The arrays will temporarily lose
communication with each other. Power off all arrays and hosts connected to the SAN before proceeding
with these steps.
4.1 Disable DCB
FTOS#configure
FTOS(conf)#no dcb enable
FTOS(conf)#no dcb stack-unit all pfc-buffering pfc-ports 56 pfc-queues 2
FTOS(conf)#exit
4.2 Remove DCB policies and apply standard flow control
FTOS#configure
FTOS(conf)#interface range tengigabitethernet 0/0 - 47
FTOS(conf-if-range-te-0/0-47)#no dcb-policy input pfc
FTOS(conf-if-range-te-0/0-47)#no dcb-policy output ets
FTOS(conf-if-range-te-0/0-47)#flowcontrol rx on tx off
FTOS(conf-if-range-te-0/0-47)#exit
FTOS(conf)#interface range fortyGigE 0/48 - 60
FTOS(conf-if-range-fo-0/48-60)#no dcb-policy input pfc
FTOS(conf-if-range-fo-0/48-60)#no dcb-policy output ets
FTOS(conf-if-range-fo-0/48-60)#flowcontrol rx on tx off
FTOS(conf-if-range-fo-0/48-60)#exit

15 SCG1000 Force10 S4810 Configuration Guide
4.3 Revert to default VLAN ID on switch and arrays
Once DCB is disabled on the switch, the EqualLogic arrays will no longer use the VLAN ID that was
configured when DCB was enabled. The arrays will revert to the default or native VLAN. Therefore, a valid
VLAN must be configured for all host servers, switches, and EqualLogic array members. A valid VLAN can
use the default or native VLAN ID (typically 0 or 1) or a specific VLAN can be configured (for example,
VLAN 100). If a non-default VLAN is configured, then any ports connected to the arrays must be
configured as “untagged”.
Use the steps below to configure the native VLAN on the switch.
FTOS#configure
FTOS(conf)#no interface vlan vlan-id
4.4 Save configuration
FTOS#copy running-config startup-config
4.5 Reload
FTOS#reload
System configuration has been modified. Save? [yes/no]yes
Proceed with reload [confirm yes/no]yes
Note: The switch will reboot.
4.6 Verify DCB status
FTOS#show dcb
Figure 2 Screen shot of show DCB
4.7 Configure additional switch
Repeat the commands from section 4 to disable DCB on any additional switches.

16 SCG1000 Force10 S4810 Configuration Guide
Additional resources
Support.dell.com is focused on meeting your needs with proven services and support.
DellTechCenter.com is an IT Community where you can connect with Dell Customers and Dell employees
for the purpose of sharing knowledge, best practices, and information about Dell products and your
installations.
Referenced or recommended Dell publications:
•Dell EqualLogic Configuration Guide:
http://en.community.dell.com/techcenter/storage/w/wiki/equallogic-configuration-guide.aspx
•Dell EqualLogic Compatibility Matrix
http://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-
matrix.aspx
For EqualLogic best practices white papers, reference architectures, and sizing guidelines for enterprise
applications and SANs, refer to Storage Infrastructure and Solutions Team Publications at:
•http://dell.to/sM4hJT

This white paper is for informational purposes only. The content is provided as is, without express or implied
warranties of any kind.