IBM FC5022 User manual

IBM Flex System FC5022 2-Port 16Gb FC Adapter
User’s Guide

IBM Flex System FC5022 2-Port 16Gb FC Adapter
User’s Guide

Note: Before using this information and the product it supports, read the general information in Appendix C, “Notices,” the Safety
Information and Environmental Notices and User Guide documents on the IBM Documentation CD, and the Warranty Information
document that comes with the product.
Second Edition (May 2012)
© Copyright IBM Corporation 2012.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Contents iii
Contents
Safety
Safety statements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vi
Chapter 1 IBM Flex System FC5022 2-Port 16Gb FC Adapter
Related documentation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Notices and statements in this document . . . . . . . . . . . . . . . . . . . . . . . 4
Features and specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
General features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Fibre Channel features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
I/O virtualization features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Adapter specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Chapter 2 Installing the adapter
Installing the device drivers, utilities, and HCM . . . . . . . . . . . . . . . . . 11
Installing software on Windows and Linux systems. . . . . . . . . . . 11
Installing software on VMware systems. . . . . . . . . . . . . . . . . . . . 16
Configuring the adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Brocade BIOS Configuration Utility . . . . . . . . . . . . . . . . . . . . . . 16
Configuring storage drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Managing the adapter. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Using HCM and BCU. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Chapter 3 Updating drivers, firmware, and boot code
Drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Updating drivers with HCM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Firmware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Determining firmware level . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Boot code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Determining boot code level. . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Updating boot code using BCU commands . . . . . . . . . . . . . . . . . 23
Updating boot code using HCM . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Updating firmware and device drivers through IBM . . . . . . . . . . . . . . 25
Chapter 4 Solving problems
Basic troubleshooting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Detailed troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

iv IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Parts listing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Appendix A Using the BIOS Configuration Utility
Appendix B Getting help and technical assistance
Before you call . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Using the documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Getting help and information from the World Wide Web . . . . . . . . . . 36
Software service and support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Hardware service and support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
IBM Taiwan product service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Appendix C Notices
Trademarks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Important notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Documentation format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Electronic emission notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Australia and New Zealand Class A statement. . . . . . . . . . . . . . . 42
European Union EMC Directive conformance statement. . . . . . .42
Index

©Copyright IBM Corp. 2012 v
Safety

vi IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Safety statements

Safety vii

viii IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide

©Copyright IBM Corp. 2012 1
Chapter
1
IBM Flex System FC5022 2-Port 16Gb FC Adapter
The IBM Flex System™ FC5022 2-Port 16Gb FC Adapter provides two Fibre Channel connections
capable of providing 16 Gbps or 8 Gbps to devices on Fibre Channel (FC) SANs. FC communications
are routed through the adapter ports to the system chassis midplane and onto Fibre Channel switches
installed in the chassis. Depending on the system configuration, the adapter provides up to 16 Gbps of
full-duplex line-rate bandwidth per port.
This User's Guide contains information and instructions for installing the adapter, updating the
firmware, configuring the adapter, and solving problems. See the IBM Flex System Installation and
Service Guide that comes with the compute node to install the adapter; then, return to this User's Guide
for the information and instructions needed to complete the installation.
This User’s Guide contains the following instructions and information for the adapter:
•Adapter features and specifications.
•Installing the adapter.
•Installing and updating the adapter boot code, device drivers, utilities, and management software.
•Using the Brocade BIOS Configuration utility, the Host Connectivity Manager (HCM), and
Brocade Command Line Utility (BCU) to configure the adapter.
•Performing basic troubleshooting tasks and resolving problems.
•Important notices and safety statements.
•Getting help, service, and technical assistance.
(For information about the types of compatible devices available for IBM products, contact your IBM
marketing representative or authorized reseller. For a list of supported optional devices, see
http://www.ibm.com/servers/eserver/serverproven/compat/us/.)
Notes:
1. Unless otherwise stated, references to the IBM Flex System FC5022 2-Port 16Gb FC Adapter is
also referred to as “the adapter” throughout this document.
2. Changes are made periodically to the IBM® website. Procedures for locating firmware and
documentation might vary slightly from what is described in this document.
3. The illustrations in this document might differ slightly from your hardware.
4. The screens that are described or referenced in this document might differ slightly from the screens
that are displayed by your system. Screen content varies according to the type of IBM Flex System
chassis and the firmware versions and options that are installed.

2IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Related documentation
1
Related documentation
This User's Guide contains setup and installation instructions for the adapter and general information
about the adapter, including how to configure, update, and troubleshoot the adapter, and how to get help.
For the most up-to-date product documentation for all of your IBM Flex System products, go to the
IBM Flex System Information Center at the following location:
http://publib.boulder.ibm.com/infocenter/flexsys/information/index.jsp.
The following IBM Flex System documentation is available:
•IBM Flex System network device User's Guides
These documents contain detailed information about installing, configuring, updating, and
troubleshooting specific IBM Flex System network devices, which include network switches and
adapters.
•IBM Flex System Chassis Management Module Command-Line Interface Reference Guide
This document explains how to use the Chassis Management Module command-line interface
(CLI) to directly access management functions. The command-line interface also provides access
to the text-console command prompt on each compute node through a Serial over LAN (SOL)
connection.
•IBM Flex System Enterprise Chassis Installation and Service Guide
This document contains hardware installation instructions for the switches and other components
that install in the IBM Flex System chassis.
•IBM Flex System Chassis Management Module User's Guide
This document explains how to use the Chassis Management Module user interface to manage
chassis components.
•IBM Flex System Manager System Management Guide
This document explains how to use the IBM Flex System Manager user interface to manage chassis
components.
•Environmental Notices and User Guide
This document is provided on the IBM Notices for Network Devices CD, and it contains translated
environmental notices.
•Safety Information
This document is provided on the IBM Notices for Network Devices CD, and it contains translated
caution and danger statements. Each caution and danger statement that appears in the
documentation has a number that you can use to locate the corresponding statement in your
language in the Safety Information document.
•Warranty Information
This ships with your product provides specific warranty information.
For instructions to install the IBM Flex System FC5022 2-Port 16Gb FC Adapter on the compute node,
see the IBM Flex System Installation and Service Guide that comes with the compute node.

Introduction 3
Related documentation 1
For other information on the IBM Flex System FC5022 2-Port 16Gb FC Adapter, refer to sections on
the Brocade 1867 adapter in documentation located at www.brocade.com/adapters-ibm-flex. The
following publications are available:
•Brocade Adapters Installation and Reference Manual. See the following chapters and information:
-Product Overview chapter
This chapter provides detailed information on hardware and software features, driver packages,
boot installation packages, and operating system support.
-Specifications chapter
This chapter provides complete hardware specifications, including environmental and power
information.
-Boot Code chapter
This chapter describes host boot support available on the adapter and provides an introduction
to boot over SAN. It also includes procedures to update adapter boot code, configure boot over
SAN, and configure fabric-based boot over SAN. Use this chapter when configuring a host to
boot its operating system from a boot device located somewhere on the SAN instead of the
host’s local disk or direct-attached storage.
-Adapter Configuration appendix.
This appendix is optional for expert network administrators, who need to modify values for
adapter instance-specific persistent and driver-level configuration parameters.
•Brocade Adapters Administrator’s Guide. Refer to this guide for details on the Brocade Command
Line Utility (BCU) commands and the Host Connectivity Manager (HCM) application.
•Brocade Adapters Troubleshooting Guide. This guide contains complete information on
troubleshooting problems for all Brocade adapter models.
Download the following Brocade publications referenced in this User’s Guide through
http://ibm.brocadeassist.com/public/FabricOSv7xRelease. On this website, select the Documentation
tab, then select Download by Fabric Operating System 7.0.0. Note that Fabric OS is the operating
system for the Fibre Channel switch.
•Brocade Fabric OS Administrator’s Guide
•Brocade Network Advisor SAN User Manual

4IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Notices and statements in this document
1
Notices and statements in this document
Features and specifications
The IBM Flex System FC5022 2-Port 16Gb FC Adapter supports the following features for enhanced
performance and connectivity in the SAN networks.
General features
•BIOS support:
-x86 and x64 Basic Input/Output System (BIOS)
-Unified Extensible Firmware Interface (UEFI)
-UEFI Human Interface Infrastructure (HII)
-PCI BIOS 3.1 or later
-SMBIOS specification version 2.4 or later
-Fabric-based boot LUN discovery
•Human Interface Infrastructure (HII) menu support. These menus are integrated into the UEFI
configuration browser. Options in these menus allow you to enable, disable, and set port speed for
adapter ports.
•Host Connectivity Manager (HCM) device management and Brocade Command Line Utility
(BCU) tools for comprehensive adapter management.
•Hyper-V. This consolidates multiple server roles as separate virtual machines (VMs) using the
Windows Server 2008 operating system and provides integrated management tools to manage both
physical and virtual resources.
Notices for Network Device

Introduction 5
Features and specifications 1
•Management APIs for integration with a management application, such as IBM System Storage®
Network Advisor, and other management frameworks.
•Plug-n-play and power management for all supported operating systems.
•RoHS-6. Certification by the European Union Restriction of Hazardous Substances Directive
(RoHS) that adapter hardware components do not contain any of the six restricted materials. These
are mercury, chromium VI, cadmium, polybrominated biphenyl ether, lead, and polybrominated
biphenyl.
•Storage Management Initiative Specification (SMI-S).
Specification supporting the Common Information Model (CIM) Provider, which allows any
standard Common Information Model (CIM) and SMI-S-based management software to manage
installed Brocade adapters.
NOTE
Although SMI-S Provider and CIM Provider may be used interchangeably, CIM is the more
generic term, while SMI-S is storage-specific.
•Open Fabric Manager (OFM) based WWN provisioning.
•Windows Management Implementation (WMI).
•Windows Server 2008, RedHat Enterprise Linux (RHEL), SUSE Linux Enterprise (SLES), and
VMware ESX Server.
•Windows Server Core, a minimal server option for Windows Server 2008 operating systems that
provides a low-maintenance server environment with limited functionality. All configuration and
maintenance is done through command line interface windows or by connecting to a system
remotely through a management application.
•Windows 7. Windows 7 x86 is supported by Windows 2008 x86 drivers. Windows 7 x64 is
supported by Windows 2008 R2 X64 drivers.
Fibre Channel features
The IBM Flex System FC5022 2-Port 16Gb FC Adapter supports the following Fibre Channel features
for enhanced performance and connectivity in the SAN:
•Over 500,000 input/output operations per second (IOPS) per port for maximum I/O transfer rates.
•Up to 1,600 Mbps throughput per port full duplex.
•Host Connectivity Manager (HCM) device management and Brocade Command Line Utility
(BCU) tools.
•Management APIs for integration with a Management application, such as Network Advisor, and
other management frameworks.
•Quality of Service (QoS) feature working in conjunction with the Advanced SAN Fabric QoS
feature on Brocade switches to assign high, medium (default), or low traffic priority to a given
source or destination traffic flow.
The following licenses must be installed on the switch connected to each adapter port:
-Adaptive Networking (AN) license
-Server Application Optimization (SAO) license
To determine if these licenses are installed on a connected Brocade switch, execute the Fabric OS
licenseshow command. For more information about Fabric OS commands and QoS support, refer
to the Brocade Fabric OS Administrator’s Guide.

6IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Features and specifications
1
•FCP-IM I/O Profiling
This feature, available through HCM, can be enabled or disabled on a physical port. When enabled,
the driver firmware categorizes I/O latency data into average, minimum, and maximum categories.
Use this feature to analyze traffic patterns and help tune Fibre Channel adapter ports, fabrics, and
targets for better performance. Note that enabling this feature impacts I/O performance.
•Interrupt Coalescing
This feature provides a method to delay generation of host interrupts and thereby combines
(coalesce) processing of multiple events. This reduces the interrupt processing rate and reduces the
time that the CPU spends on context switching. You can configure the following parameters per
port to adjust interrupt coalescing:
-Interrupt time delay. There is a time delay during which the host generates interrupts. You can
increase this delay time and thereby coalesce multiple interrupt events into one. This results in
fewer interrupts for interrupt events.
-Interrupt latency timer. An interrupt is generated when no new reply message requests occur
after a specific time period. You can adjust this time period and thereby minimize I/O latency.
•16 Virtual Channels (VCs) per port. VC-RDY flow control can use these multiple channels for
Quality of Service (QoS) and traffic prioritization in physical and virtualized network
environments.
•Target rate limiting.
You can enable or disable this feature on specific ports. Target rate limiting relies on the storage
driver to determine the speed capability of discovered remote ports, then uses this information to
throttle FCP traffic rates to slow-draining targets. This reduces or eliminates network congestion
and alleviates I/O slowdowns at faster targets.
Target rate limiting is enforced on all targets that are operating at a speed lower than that of the
target with the highest speed. If the driver is unable to determine a remote port’s speed, 1 Gbps is
assumed. You can change the default speed using BCU commands. Target rate limiting protects
only FCP write traffic.
•N_Port ID Virtualization (NPIV)
Allows multiple N_Ports to share a single physical N_Port. Multiple Fibre Channel initiators can
share this single physical port and reduce SAN hardware requirements.
•Server Application Optimization (SAO). When used with Brocade storage fabrics with enabled
SAO licensing, Fibre Channel ports can use advanced Adaptive Networking features, such as QoS,
designed to ensure Service Level Agreements (SLAs) in dynamic or unpredictable enterprise-class
virtual server environments with mixed-SLA workloads.
•End-to-end link beaconing between an adapter port and a switch port to which it connects. (The
switch requires Brocade Fabric OS 6.3x or later.)
•Boot over SAN. This feature provides the ability to boot the host operating system from a boot
device located somewhere on the SAN instead of the host’s local disk or direct-attached Fibre
Channel storage. Specifically, this “boot device” is a logical unit number (LUN) located on a
storage device. Booting from direct-attached Fibre Channel storage is also supported.
•Fabric-based boot LUN discovery, a feature that allows the host to obtain boot LUN information
from the fabric zone database.
NOTE
This feature is not available for direct-attached targets.

Introduction 7
Features and specifications 1
•LUN masking:
LUN masking establishes access control to shared storage to isolate traffic between different
initiators that are zoned in with the same storage target. LUN masking is similar to zoning, where a
device in a specific zone can communicate only with other devices connected to the fabric within
the same zone. With LUN masking, an initiator port is allowed to only access those LUNs
identified for a specific target. Plus, the LUN masking configuration is stored persistently across
driver loads and system reboots.
Enable LUN masking on an adapter physical port through the HCM Basic Port Configuration
dialog box and the BCU fcpim –lunmaskadd command to identify the logical port (initiator) and
remote WWN (target) for the LUN number. Refer to the Brocade Adapter Administrator’s Guide
for more information on configuration.
This feature has following limitations:
-Only 16 LUN masking entries are allowed per physical port.
-Multiple BCU instances for adding and deleting LUN masking are not supported.
You can configure LUN masking for a particular target even without the actual devices being
present in the network.
When configuring boot over SAN, mask the boot LUN so that the initiator has exclusive access to
the boot LUN. Refer to the Brocade Adapters Administrator’s Guide for more information.
•Support for Hyper-V. Hyper-V consolidates multiple server roles as separate virtual machines
(VMs) using the Windows Server 2008 operating system and provides integrated management tools
to manage both physical and virtual resources.
•Support for Windows Server Core, a minimal server option for Windows Server 2008 operating
systems that provides a low-maintenance server environment with limited functionality. All
configuration and maintenance is done through command line interface windows or by connecting
to a system remotely through a management application. Windows Server Core is supported by
Windows Server 2008 adapter drivers.
•Support for MSI-X, an extended version of Message Signaled Interrupts (MSI), defined in the PCI
3.0 specification. MSI-X helps improve overall system performance by contributing to lower
interrupt latency and improved utilization of the host CPU. MSI-X is supported by Linux RHEL 5,
RHEL 6, SLES 10, SLES 11, Windows 2008, and ESX Server 4.0, 4.1, and 5.0.
•Point-to-point topology.
•Management support for Storage Management Initiative Specification (SMI-S).
•Fibre Channel-Security Protocol (FC-SP) providing device authentication through key
management.
•Internet Protocol over Fibre Channel (IPFC) driver
This supports transmission of IP traffic over Fibre Channel links. This driver is only included in the
Linux “noarch” RPM package (brocade_driver_linux_<version>.tar.gz).

8IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Features and specifications
1
I/O virtualization features
The IBM Flex System FC5022 2-Port 16Gb FC Adapter supports physical function-based I/O
virtualization to provide data isolation and sharing of the bandwidth resources. For adapter ports, each
port has one Fibre Channel (FC) function as the factory default.
Virtual HBAs (vHBAs) are virtual port partitions that appear as virtual or logical HBAs to the host
operating system. vHBAs are supported on adapter Fibre Channel ports. Multiple vHBAs are not yet
supported, so you cannot create them or delete them from an adapter. The default physical function (PF)
associated with HBA ports is vHBA. HCM discovers and displays all vHBAs as “FC.”
The following are limitations of vHBAs:
•Multiple vHBAs per port are not supported (planned for future software release).
•Target rate limiting (TRL) and Quality of Service (QoS) are not supported at the vHBA level (only
at the physical port level).
•Boot over SAN is not supported at the vHBA level (only at the physical port level).
Adapter specifications
Table 1 contains additional specifications for the IBM Flex System FC5022 2-Port 16Gb FC
Adapter.
TABLE 1 Adapter specifications
Feature Description
Adapters per
compute node
One or two two-port 16 Gbps FC Adapters per IBM Flex System FC5022
compute node
Port speeds 16 Gbps or 8 Gbps speed per Fibre Channel port
System board
connectors
Copper high-speed SERDES
ASIC •Provides the Fibre Channel functionality for the adapter.
•Two on-board processors, each operating at 400 MHz, which coordinate
and process data in both directions.
External serial
FLASH memory
•Stores firmware and adapter BIOS code
•4 MB capacity
Data transfer rate 16 or 8 Gbps full-duplex
Fibre Channel
performance
Over 500,000 IOPs (maximum) per port
Over 1,000,000 IOPS per dual-port adapter
Data rate •16 Gbps Fibre Channel: 14.025 Gbps (1600 MB/sec) full duplex
•8 Gbps Fibre Channel: 8.5 Gbps (800 MB/sec) full duplex
Topology Fibre Channel - Point-to-Point (N_Port)
Airflow Provided by IBM Flex System chassis.
Altitude Operating - 3,050 meters (10,000 ft.)
Nonoperating - 3,050 meters (10,000 ft.)
Operating
temperature
10 to 35°C (50 to 95°F)
Nonoperating
temperature
Maximum: 45°C (113°F)
Minimum: 5°C (41°F)

Introduction 9
Features and specifications 1
NOTE
The IBM Flex System FC5022 2-Port 16Gb FC Adapter conforms to environmental and power
specifications for the supported compute nodes and IBM Flex System chassis in which they are installed.
Refer to the documentation provided for these products for more information.
Operating humidity 20% to 80%
Nonoperating
Humidity
8% to 80%
Power dissipation 8.5 W maximum
8 W nominal
Operating voltage Per PCIe 2.0 specifications
Dimensions 4.19 in. (106.5 mm) depth
3.34 in. (84.9 mm) width
1.64 in. (41.5 mm) height
Weight .31 pounds (140 grams)
Topology Switched
Point-to-Point (N_Port)
Data protection Cyclic redundancy check (CRC) on PCIE and line-side links
ECC within the ASIC memory blocks (2-bit detection and 1-bit correction)
Error correction code (ECC) and parity through the ASIC
Supported Fibre
Channel features and
protocols
•SCSI over FC (FCP)
•FCP2
•FCP3
•FC-SP Authentication
•NPIV
•Quality of Service (QoS)
•Target rate limiting
•Boot over SAN
•Fabric-Based Boot LUN Discovery
•I/O Interrupt Coalescing
•T10 Data CRC
•Multiple Priority (VC_RDY)
•Frame-Level Load Balancing
•Persistent Binding
•Fabric-Based Configuration
•vHBA
Other features •ASIC Flip-flops Parity Protected
•T10 Data CRC
•ECC Memory Parity Protected
TABLE 1 Adapter specifications (Continued)
Feature Description

10 IBM Flex System FC5022 2-Port 16Gb FC Adapter User’s Guide
Features and specifications
1