Lenovo Flex System EN4023 User manual

Lenovo Flex System EN4023 10Gb Scalable
Switch
User’s Guide

Lenovo Flex System EN4023 10Gb Scalable Switch
User’s Guide

Note: Before using this information and the product it supports, read the general information in Appendix B, “Notices,” the Safety
Information and Environmental Notices and User Guide documents on the Lenovo Notices for Network Devices CD, and the Warranty
Information document that comes with the product.
Sixth Edition (April 2015)
© Copyright Lenovo 2015.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide iii
Contents
Safety statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .ix
UL Regulatory Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Chapter 1 Lenovo Flex System EN4023 10Gb Scalable Switch
Related documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Brocade documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Notices and statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Features and specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Model options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
License options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Dynamic Ports on Demand . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
FlexPort. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Switch specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Memory and processor specifications . . . . . . . . . . . . . . . . . . . . . 6
Environmental conditions and specifications . . . . . . . . . . . . . . . 6
Switch components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Product name and serial number . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Chapter 2 Installing the Switch
Installation guidelines. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
System reliability guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Handling static-sensitive devices . . . . . . . . . . . . . . . . . . . . . . . . 10
Installing the switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Installing and removing an SFP+ or QSFP transceiver . . . . . . . . . . . 13
Installing a FC SFP+. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Handling an SFP+ or QSFP transceiver . . . . . . . . . . . . . . . . . . . 15
Inserting an SFP+ or QSFP transceiver . . . . . . . . . . . . . . . . . . . 16
Removing or replacing an SFP+ or QSFP transceiver . . . . . . . . 18
Cabling the switch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Connecting and disconnecting the USB console cable. . . . . . .18
Connecting the RJ-45 Ethernet cable. . . . . . . . . . . . . . . . . . . . .19
Locating the information panel, LEDs, and external ports. . . . . . . .20
Information LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Port mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

iv Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
Configuring the switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Configuring an IP address on the switch using the CLI. . . . . . .26
Configuring an IP address on the switch using the CMM GUI .28
Connecting to the switch over SSH. . . . . . . . . . . . . . . . . . . . . . .30
Connecting to the switch using the serial console port . . . . . . 31
Connecting to the switch using the RJ-45 Ethernet port. . . . . . 31
FlexPort configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Initial configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Logging in to the switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Managing the switch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
SNMP v3 authentication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Backing up the configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Resetting the switch to factory defaults. . . . . . . . . . . . . . . . . . .34
Removing or replacing the switch. . . . . . . . . . . . . . . . . . . . . . . .35
Chapter 3 Updating the Firmware
Determining the switch firmware level . . . . . . . . . . . . . . . . . . . . . . . 37
Determining firmware from the CMM . . . . . . . . . . . . . . . . . . . . . 37
Determining firmware from the switch using the CLI . . . . . . . . 37
Upgrading the switch firmware. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Chapter 4 Solving Problems
Running POST . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
POST errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Parts listing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Appendix A Getting Help and Technical Assistance
Before you call. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Using the documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Getting help and information from the World Wide Web . . . . . . . . .45
Software service and support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Hardware service and support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
IBM Taiwan product service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Appendix B Notices
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
Important notes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Electronic emission notices. . . . . . . . . . . . . . . . . . . . . . . . . . . . .52

©Copyright Lenovo 2015vii
Safety

viii Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide

ix
Safety statements
Safety statements

xLenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
Safety statements

xi
Safety statements
Class 1 Laser Product
Laser Klasse 1
Laser Klass 1
Luokan 1 Laserlaite
Appareil A` Laser de Classe 1

xii Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
UL Regulatory Information
UL Regulatory Information
This device is for use only with Listed Lenovo Flex System Enterprise Chassis.

©Copyright Lenovo 2015 1
Chapter
1
Lenovo Flex System EN4023 10Gb Scalable Switch
The Lenovo Flex System EN4023 10Gb Scalable Switch is a high-density, 64-port, 10-Gbps
Ethernet switch that is used in the Lenovo Flex System chassis. The switch provides 42 internal
ports to compute nodes by way of the midplane, and 14 external SFP+ ports that are capable of
running 10-Gbps Ethernet and 4-Gbps, 8-Gbps, and 16-Gbps Fibre Channel. Also included are two
external Quad SFP (QSFP) ports that can support 40-Gbps Ethernet or 4x10-Gbps Ethernet in
breakout mode.
This User’s Guide contains information and instructions for installing the switch and getting the
switch up-and-running as quickly as possible. See the Lenovo Flex System Installation and Service
Guide that comes with your Lenovo Flex System chassis to install the switch in the chassis; then,
return to this User’s Guide for the information and instructions needed to complete the installation.
For information about the types of compatible devices available for Lenovo products, contact your
Lenovo marketing representative or authorized reseller. For a list of supported optional devices,
see http://www.ibm.com/servers/eserver/serverproven/compat/us/
For the most up-to-date product documentation for all of your Lenovo Flex System products, go to
the Lenovo Flex System Information Center at:
http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp
NOTES:
•The Lenovo Flex System EN4023 10Gb Scalable Switch is also referred to as “the switch”
throughout this document.
•Changes are made periodically to the Lenovo®website. Procedures for locating firmware and
documentation might vary slightly from what is described in this document.
•The illustrations in this document might differ slightly from your hardware.
•The screens that are described or referenced in this document might differ slightly from the
screens that are displayed by your system. Screen content varies according to the type of
Lenovo Flex System chassis, and the firmware versions and options that are installed.
Related documentation
This User’s Guide contains setup and installation instructions for the Lenovo Flex System EN4023
10Gb Scalable Switch and general information about the switch, including how to configure,
update, and troubleshoot the switch, as well as how to get help. For the most up-to-date product
documentation for all of your Lenovo Flex System products, go to the Lenovo Flex System
Information Center at the following location:
http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp

2Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
Related documentation
1
The following Lenovo Flex System documentation is available:
•Lenovo Flex System Chassis Management Module Command-Line Interface Reference Guide
This document explains how to use the Chassis Management Module command-line interface
(CLI) to directly access management functions. The command-line interface also provides
access to the text-console command prompt on each compute node through a Serial over LAN
(SOL) connection.
•Lenovo Flex System Chassis Management Module User’s Guide
This document explains how to use the Chassis Management Module (CMM) user interface to
manage chassis components.
•Lenovo Flex System Enterprise Chassis Installation and Service Guide
This document contains hardware installation instructions for the switches and pass-through
switches that install in the Lenovo Flex System chassis.
•Lenovo Flex System Manager System Management Guide
This document explains how to use the Lenovo Flex System Manager user interface to manage
chassis components.
•Lenovo Flex System network device User’s Guides
These documents contain detailed information about installing, configuring, updating, and
troubleshooting specific Lenovo Flex System network devices, which include network switches,
pass-thru switches, and adapters.
•Environmental Notices and User Guide
This document is provided on the Lenovo Notices for Network Devices CD, and it contains
translated environmental notices.
•Safety Information
This document is provided on the Lenovo Notices for Network Devices CD, and it contains
translated caution and danger statements. Each caution and danger statement that appears
in the documentation has a number that you can use to locate the corresponding statement in
your language in the Safety Information document.
•Warranty Information
This document comes with the network device, and it contains information about the terms of
the warranty.
Brocade documentation
Download the following Brocade Network Operating System publications referenced in this User’s
Guide through http://ibm.brocadeassist.com/public/NetworkOSv4xRelease
On this website, select the Documentation tab, select Network Operating System (NOS) from the
Download by list box, then select the appropriate version for your product.
•Network OS Administrator’s Guide
•Network OS Command Reference
•Network OS MIB Reference
•Network OS System Error Message Reference
•Network OS YANG Reference Manual

Introduction 3
Notices and statements 1
•Network OS NETCONF Operations Guide
Notices and statements
Features and specifications
The Lenovo Flex System EN4023 10Gb Scalable Switch supports the following features and
specifications.
Features
•Maximum up to 64 ports
•Upgrade 3 license key enables FCoE and Flex Port capabilities for storage and SAN
connectivity.
•All 64 ports can operate at 1-Gbps or 10-Gbps Ethernet including up to 14 External Flex Ports
that can operate at 8-Gbps and 16-Gbps Fibre Channel .
•Up to 42 internal ports connected up to 28 compute nodes at the midplane auto-negotiating to
10-Gbps Ethernet (available through Ports-On-Demand activation), or 16-Gbps and 8-Gbps
Fibre Channel using 8-Gbps or 16-Gbps transceivers.
•Up to 14 External Ports capable of supporting 1-Gbps Ethernet or 10-Gbps Ethernet through
10-Gbps SFP+ transceivers (available through Ports-On-Demand activation)
•2 Quad SFP (QSFP) ports that can support 40-Gbps Ethernet or 4x10-Gbps Ethernet in
breakout mode (available through Ports-On-Demand activation)

4Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
Features and specifications
1
•Inter-Switch Link (ISL) Trunking, which allows up to eight ports (at 40-Gbps or 10-Gbps speeds)
to combine to form a single, logical ISL with a speed of up to 128 Gbps (256-Gbps full-duplex)
for optimal bandwidth utilization, automatic path failover, and load balancing
•Internal 1-Gbps full-duplex Ethernet port to connect to the redundant Lenovo Chassis
Management Modules (CMMs)
•Supports up to 724-Gbps I/O bandwidth
•Supports Felxports, up to 42 10 Gbps for internal ports and 22 16 Gbps for external ports
•One external RS-232 console port with a mini-USB interface for serial console management
and diagnostics
•One external 10/100/1000Base-T RJ-45 Ethernet port with integral LEDs for link/activity and
speed for debugging and field support
•LEDs noting external port status and switch module status
•Up to four hot-pluggable switches per Lenovo Flex System chassis
•Brocade Network OS (NOS), which delivers distributed intelligence throughout the network and
enables a wide range of value-added applications, for example, virtualization features that are
distributed throughout a fabric, and multitenancy features. Requires Network OS version
4.0.0_bbd or later.
•Supports Lenovo Features on Demand
•Supports Ports on Demand (POD)
•SNMP v1, v2, and v3 support
•SSH v2 support
•NTP client support (NTP V3)
•SCP and SFTP support for firmware upgrades
•SNMP/MIB monitoring functionality contained within the Ethernet Control MIB-II
(RFC1213-MIB)
•Traps identify cold start, warm start, link up/link down and authentication failure events
•Support for IPv4 and IPv6 on the management ports
Model options
•Base model: Includes 24 ports (24x10-Gbps capacity). The VCS license is enabled by default.
•POD1 license: Adds 16 ports (10-Gbps capacity) plus 2x40-Gbps capacity, for a total of
48 10-Gbps ports.
The additional eight 10-Gbps ports that result when the two 40-Gbps Ethernet ports are
configured in breakout mode cannot be moved to different internal ports.
•POD2 license: Adds an additional 16 ports (10-Gbps capacity), for a total of 56x10-Gbps ports
plus 2x40-Gbps ports that can each support 4x10-Gbps Ethernet in breakout mode.
NOTE
The 10 GbE ports are added in increments of 16 ports (16 and 32) and 40 GbE ports are added in
increments of 2 ports.

Introduction 5
Features and specifications 1
License options
Table 1 lists optional licenses.
NOTE
To activate POD licenses upon installation, you need to remove all port assignments and
reservations for the license.
Dynamic Ports on Demand
With Dynamic Ports on Demand (DPOD), physical ports are licensed as they come online. In the
Base model port set, the first 24 ports reporting (on a first-come, first-served basis) on boot-up are
assigned licenses. These ports may be any combination of external or internal Ethernet ports. After
all licenses have been assigned, you can manually move those licenses from one port to another,
except for the eight 10-Gbps ports that result when the two 40-Gbps Ethernet ports are configured
in breakout mode.
FlexPort
The FlexPort feature is supported only on the Lenovo Flex System EN4023 10Gb Scalable Switch
by Network OS 5.0.0 and later. This feature allows you to configure the external SFP+ ports as
Ethernet ports or as Fibre Channel (FC) ports. Qualified 10 GbE SFP+ transceivers, 8 Gbps FC
transceivers, or 16 Gbps FC transceivers must be installed in ports to allow Ethernet or FC
configuration. When configuring a mixture of Ethernet and FC ports in a port group, you can
configure mixtures of speeds and protocols as follows:
•2 Gbps, 4 Gbps, and 8 Gbps FC and 1/10 Gbps Ethernet
•16 Gbps FC and 10 Gbps Ethernet only
•2 Gbps, 4 Gbps, 8 Gbps, and 16 Gbps FC (no Ethernet)
This feature allows you to attach FC devices to run encapsulated FC over Ethernet (FCOE) traffic
through the switch. For details on this feature, including configuration procedures, refer to the
Brocade Network OS Layer 2 Switching Configuration Guide.
NOTE
16 Gbps FC transceivers operate at 4 Gbps, 8 Gbps, and 16 Gbps while 8 Gbps FC transceivers
operate at 2 Gbps, 4 Gbps, and 8 Gbps.
NOTE
The FC/FCoE Upgrade License is required to enable the FlexPort feature.
TABLE 1 Licenses
License Part number
16x10 GbE plus 2x40GB capacity license (POD1) 94Y5158
16x10 GbE capacity license (POD2) 94Y5159
FC/FCoE Upgrade License 47C9993

6Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
Features and specifications
1
Switch specifications
Table 2 lists the physical characteristics of the switch.
Memory and processor specifications
Table 3 lists the memory that is installed in the switch.
Environmental conditions and specifications
See the documentation that comes with your Lenovo Flex System chassis for information about the
environmental conditions and specifications that are supported by the system.
TABLE 2 Switch specifications
Characteristic Description
Height 30.7 mm (1.21 inches)
Width 299.3 mm (11.78 inches)
Depth (including ejectors) 310.6 mm (12.23 inches)
Weight 3.59 Kg (7.91 pounds)
TABLE 3 Memory and processor specifications
Memory type Value
P3041 Quad core CPU Onboard, 4 e500mc cores (up to 1.5 GHz)
DDR3 SDRAM Bus 8 GB running at 266 MHz with optional ECC support
Boot Flash 4 MB
eUSB Flash module 8 GB eUSB Compact Flash module supported to USB
interface of P3041
Boot ROM 32 MB (2 MB x 16, or 4 MB); also supports 8 MB
devices of boot memory

Introduction 7
Switch components 1
Switch components
Figure 1 shows the components of the Lenovo Flex System EN4023 10Gb Scalable Switch when
viewed from the port side.
The FlexPort feature allows configuration of specific Lenovo Flex System EN4023 10Gb Scalable Switch ports as
1/10 GbE or 2, 4, 8, or 16 Gbps FC ports. FlexPort is supported by Network OS 5.0.0 and later.
FIGURE 1 Components of the Lenovo Flex System EN4023 10Gb Scalable Switch
1 Release levers (x2) 5 RJ-45 Ethernet port (Mgmt)
2 Port LEDs (Fault and activity for each port) 6 System LEDs
3 QSFP ports 7 Ethernet Mgmt port LEDs
4 Mini-USB console port 8 14 external 10-Gbps Ethernet ports*

8Lenovo Flex System EN4023 10Gb Scalable Switch User’s Guide
Product name and serial number
1
NOTE
The illustrations in this document might differ slightly from your hardware, and your switch might
have labels that are not shown in the captured illustrations.
You can manage and configure the switch through the following interfaces:
•An SSH connection to the command-line interface (CLI)
•A terminal emulation program connection to the mini-USB serial port interface
•The Lenovo Chassis Management Module (CMM)
For more information, see Chapter 2 “Installing the Switch”.
Product name and serial number
Record information about the switch in Table 4. The product name and serial number are on the
identification label on the bottom cover of the switch. The Media Access Control (MAC) address is
on a label located on the top handle of the switch. You will need this information when you register
the switch with Lenovo. You can register the switch at http://www.ibm.com/support/mysupport/.
TABLE 4 Lenovo Flex System solution product information
Product name Lenovo Flex System EN4023 10Gb Scalable Switch
Model number
Serial number
Part number
Media Access Control (MAC) address
MAC address for other components