IBM CFFh User manual

2/4 Port Ethernet Expansion Card (CFFh) for IBM
BladeCenter
Installation and User's Guide


2/4 Port Ethernet Expansion Card (CFFh) for IBM
BladeCenter
Installation and User's Guide


Note: Before using this information and the product it supports, read the general information in Appendix B, “Warranty,” on page 17
and Appendix C, “Notices,” on page 35.
Second Edition (September 2008)
©Copyright International Business Machines Corporation 2008.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Safety ............................v
Chapter 1. Introduction ......................1
Features and specifications .....................1
Supported operating systems ....................2
Option package contents......................2
Related documentation ......................2
The IBM Documentation CD ....................3
Hardware and software requirements ................3
Using the Documentation Browser .................3
Notices and statements in this document ................4
Chapter 2. Installing an expansion card ...............5
Installation guidelines .......................5
Media Access Control (MAC) addresses ................7
Handling static-sensitive devices ...................7
Installing the expansion card ....................8
Installing device drivers and firmware .................9
Device drivers.........................9
Firmware ..........................10
Replacing an expansion card....................11
Chapter 3. Solving problems ...................13
Appendix A. Getting help and technical assistance ..........15
Before you call .........................15
Using the documentation .....................15
Getting help and information from the World Wide Web ..........15
Software service and support ...................16
Hardware service and support ...................16
IBM Taiwan product service ....................16
Appendix B. Warranty ......................17
IBM Statement of Limited Warranty Z125-4753-09 08/2006 ........17
Part 1-General Terms .....................17
Part 2-Country-unique Terms ..................21
Part 3-Warranty Information ..................31
Appendix C. Notices ......................35
Trademarks ..........................35
Important notes.........................36
Product recycling and disposal ...................37
Battery return program ......................38
Electronic emission notices ....................39
Federal Communications Commission (FCC) statement .........39
Industry Canada Class Aemission compliance statement ........40
Avis de conformité àla réglementation d’Industrie Canada ........40
Australia and New Zealand Class Astatement ............40
United Kingdom telecommunications safety requirement.........40
European Union EMC Directive conformance statement .........40
Taiwanese Class Awarning statement ...............41
Chinese Class Awarning statement ................41
Japanese Voluntary Control Council for Interference (VCCI) statement ...41
©Copyright IBM Corp. 2008 iii

Korean Class Awarning statement ................41
Index ............................43
iv 2/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

Safety
Before installing this product, read the Safety Information.
Antes de instalar este produto, leia as Informações de Segurança.
Pred instalací tohoto produktu si prectete prírucku bezpecnostních instrukcí.
Læs sikkerhedsforskrifterne, før du installerer dette produkt.
Lees voordat udit product installeert eerst de veiligheidsvoorschriften.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.
Avant d’installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.
Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.
Antes de instalar este produto, leia as Informações sobre Segurança.
©Copyright IBM Corp. 2008 v

Antes de instalar este producto, lea la información de seguridad.
Läs säkerhetsinformationen innan du installerar den här produkten.
Important:
Each caution and danger statement in this document is labeled with a
number. This number is used to cross reference an English-language
caution or danger statement with translated versions of the caution or
danger statement in the IBM Safety Information document.
For example, if acaution statement is labeled “Statement 1,”
translations for that caution statement are in the IBM Safety Information
document under “Statement 1.”
Be sure to read all caution and danger statements in this document
before you perform the procedures. Read any additional safety
information that comes with the server or optional device before you
install the device.
vi 2/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

Statement 1:
DANGER
Electrical current from power, telephone, and communication cables is
hazardous.
To avoid ashock hazard:
vDo not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
vConnect all power cords to aproperly wired and grounded electrical
outlet.
vConnect to properly wired outlets any equipment that will be attached to
this product.
vWhen possible, use one hand only to connect or disconnect signal
cables.
vNever turn on any equipment when there is evidence of fire, water, or
structural damage.
vDisconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
Class 1 Laser Product
Laser Klasse 1
Laser Klass 1
Luokan 1 Laserlaite
Appareil A Laser de Classe 1
`
Statement 21:
CAUTION:
Hazardous energy is present when the blade server is connected to the power
source. Always replace the blade server-cover before installing the blade
server.
Safety vii

viii 2/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

Chapter 1. Introduction
This Installation and User's Guide contains instructions for installing a2/4 Port
Ethernet Expansion Card (CFFh) for IBM®BladeCenter®in an IBM BladeCenter
blade server.
Notes:
1. The 2/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter is referred
to throughout this document as the expansion card.
2. The two Broadcom BCM5709s communication modules are referred to
throughout this document as the communication modules.
3. The communication module is part of the NetXtreme II family.
The expansion card provides additional 1Gb per second, full duplex, Ethernet links
between ablade server and Ethernet switch modules in the BladeCenter I/O switch
module bays. The expansion card interfaces to the blade server using the PCI
Express bus. The expansion card functions as a4-port card when it is installed into
aBladeCenter Hunit and a2-port card when installed into aBladeCenter Sunit.
For information about teaming and failover options for the expansion card blade
server connections, see the Broadcom NetXtreme II Gigabit Ethernet Software CD.
See “Device drivers” on page 9for instructions for locating the CD on the IBM
Support Web site.
This document provides the following information about the expansion card:
vInstallation procedure
vProcedures for determining and updating the firmware and device drivers
vTroubleshooting information
The expansion card comes with aone-year limited warranty. For information about
your warranty, see Appendix B, “Warranty,” on page 17. You can obtain up-to-date
information about the expansion card and other IBM server products at
http://www.ibm.com/systems/x/.
This Installation and User's Guide and the most recent versions of other documents
that provide detailed information about the BladeCenter unit, blade server, and
available optional devices are provided in Portable Document Format (PDF) at
http://www.ibm.com/systems/support/.
For service or assistance, see Appendix A, “Getting help and technical assistance,”
on page 15.
Features and specifications
The expansion card has the following features:
vConnection to 1000BASE-X environments using BladeCenter Ethernet switches
vCompliance with U.S. and international safety and emissions standards
vFull-duplex (FDX) capability, enabling simultaneous transmission and reception of
data on the Ethernet local area network (LAN)
vFailover support
vPreboot Execution Environment (PXE) support
vSupport for direct memory access (DMA)
vSupport for bus mastering
©Copyright IBM Corp. 2008 1

The expansion card has the following specifications.
Table 1. Expansion-card specifications
Type Specification
Host data transfer PCI Express
NVRAM Two programmable, 4Mb flash modules
Dimensions Approximately 15.9 cm x12.5 cm (6.26 in. x4.92 in.)
Operating power Approximately 6.5 watts
Communication module Two Broadcom BCM5709s communication modules
Supported operating systems
The following operating systems support the expansion card:
vMicrosoft®Windows®2000 Server
vMicrosoft Windows 2003 Server
vMicrosoft Windows 2008 Server
vRed Hat Advanced Server
vSUSE Linux Enterprise Server (SLES)
vNetware
vUnixware
Option package contents
The expansion-card option package includes the following items:
v2/4 Port Ethernet Expansion Card
vDocumentation CD
Related documentation
The following documentation is provided on the 2/4 Port Ethernet Expansion Card
(CFFh) for IBM BladeCenter Documentation CD:
vThis Installation and User's Guide
vSafety Information
This PDF document contains translated versions of the caution and danger
statements that appear in the documentation for your server. Each caution and
danger statement has anumber that you can use to locate the corresponding
statement in your language in the Safety Information document.
In addition to this Installation and User's Guide,the following related documentation
is available from http://www.ibm.com/systems/support/:
vIBM BladeCenter blade server Installation and User’s Guide
This document provides information about your blade server and BladeCenter
unit.
vProblem Determination and Service Guide
This PDF document contains information to help you solve problems yourself,
and it contains information for service technicians.
vIBM BladeCenter Interoperability Guide
22/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

This document provides instructions to install the blade server in the interconnect
module. For the latest version of this document, go to http://www.ibm.com/
systems/support/ and search for “BladeCenter Interoperability Guide”.
The most recent versions of all BladeCenter documents are available at
http://www.ibm.com/systems/bladecenter/.
The IBM Documentation CD
The IBM Documentation CD contains documentation for the expansion card in
Portable Document Format (PDF) and includes the IBM Documentation Browser to
help you find information quickly.
Hardware and software requirements
The IBM Documentation CD requires the following minimum hardware and
software:
vMicrosoft Windows XP, Windows 2000, or Red Hat Linux®
v100 MHz microprocessor
v32 MB of RAM
vAdobe®Acrobat Reader 3.0 (or later) or xpdf, which comes with Linux operating
systems
Using the Documentation Browser
Use the Documentation Browser to browse the contents of the CD, read brief
descriptions of the documents, and view documents, using Adobe Acrobat Reader
or xpdf. The Documentation Browser automatically detects the regional settings in
your system and displays the documents in the language for that region (if
available). If adocument is not available in the language for that region, the
English-language version is displayed.
Use one of the following procedures to start the Documentation Browser:
vIf Autostart is enabled, insert the CD into the CD or DVD drive. The
Documentation Browser starts automatically.
vIf Autostart is disabled or is not enabled for all users, use one of the following
procedures:
–If you are using aWindows operating system, insert the CD into the CD or
DVD drive and click Start --> Run.In the Open field, type
e:\win32.bat
where eis the drive letter of the CD or DVD drive, and click OK.
–If you are using aLinux operating system, insert the CD into the CD or DVD
drive; then, run the following command from the /mnt/cdrom directory:
sh runlinux.sh
Select the expansion card from the Product menu. The Available Topics list
displays all the documents for your expansion card. Some documents might be in
folders. Aplus sign (+) indicates each folder or document that has additional
documents under it. Click the plus sign to display the additional documents.
When you select adocument, adescription of the document is displayed under
Topic Description.To select more than one document, press and hold the Ctrl key
while you select the documents. Click View Book to view the selected document or
Chapter 1. Introduction 3

documents in Acrobat Reader or xpdf. If you selected more than one document, all
the selected documents are opened in Acrobat Reader or xpdf.
To search all the documents, type aword or word string in the Search field and
click Search.The documents in which the word or word string appears are listed in
order of the most occurrences. Click adocument to view it, and press Crtl+F to use
the Acrobat search function, or press Alt+F to use the xpdf search function within
the document.
Click Help for detailed information about using the Documentation Browser.
Notices and statements in this document
The caution and danger statements in this document are also in the multilingual
Safety Information document, which is on the IBM Support CD. Each caution and
danger statement is numbered for reference to the corresponding statement in your
language in the Safety Information document.
The following notices and statements are used in this document:
vNote: These notices provide important tips, guidance, or advice.
vImportant: These notices provide information or advice that might help you avoid
inconvenient or problem situations.
vAttention: These notices indicate possible damage to programs, devices, or
data. An attention notice is placed just before the instruction or situation in which
damage might occur.
vCaution: These statements indicate situations that can be potentially hazardous
to you. Acaution statement is placed just before the description of apotentially
hazardous procedure step or situation.
vDanger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. Adanger statement is placed just before the
description of apotentially lethal or extremely hazardous procedure step or
situation.
42/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

Chapter 2. Installing an expansion card
This chapter provides instructions for installing an expansion card in your blade
server or expansion unit. The following documents provide related information:
vThe Installation and User's Guide for your blade server or expansion unit
provides server-specific expansion-card installation requirements.
vThe Installation and User's Guide for your BladeCenter unit shows I/O-module
bay locations.
vThe Installation and User's Guide for your I/O module has installation and
configuration instructions for the I/O module.
Installation guidelines
Before you install the expansion card, read the safety information and the
guidelines in “Handling static-sensitive devices” on page 7. This information will help
you work safely.
Make sure that you are using the latest versions of device drivers and firmware for
your blade server, management module, and I/O modules that are used by the
expansion card. Go to http://www.ibm.com/systems/support/ for the latest
information about upgrading the device drivers and firmware for BladeCenter
components. See the latest instructions in the documentation that comes with the
updates.
Before you install an expansion card into ablade server or expansion unit, consider
the following BladeCenter I/O-module information.
Table 2. Expansion-card connections to expansion-card ports
BladeCenter Unit I/O module bays
Expansion-card
ports Module ports
BladeCenter H7(upper left
interconnect-module bay)
1Module 1: port 1,
MAC 1
8(upper right
interconnect-module bay)
2Module 2: port 1,
MAC 3
9(lower left
interconnect-module bay)
3Module 1: port 2,
MAC 2
10 (lower right
interconnect-module bay)
4Module 2: port 2,
MAC 4
BladeCenter S2(lower left) 1Module 1: port 1,
MAC 1
2(lower left) 3Module 1: port 2,
MAC 2
Notes:
1. If ablade server with an expansion card is installed in aBladeCenter Hunit, I/O
module bays 7, 8, 9, and 10 must either contain an Ethernet switch module or
be empty. Installing asecond I/O module in the BladeCenter unit provides a
backup I/O module in case one I/O module fails.
2. If ablade server with an expansion card is installed in aBladeCenter Sunit, I/O
module bay 2must contain an Ethernet switch module or be empty.
©Copyright IBM Corp. 2008 5

The following diagrams show the Ethernet connectivity paths, port names, and MAC
address assignments for BladeCenter chassis.
Figure 1. Expansion card in BladeCenter Hunit
62/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

Media Access Control (MAC) addresses
Media Access Control (MAC) addresses have been assigned and installed on the
expansion card. Each port has two MAC addresses: the first address is the
Ethernet address, and the second MAC address is for the iSCSI function. Port 1of
the first communication module is assigned the base MAC address. Port 2of the
first communication module receives the next MAC address assignment, followed
by like assignments on the second communication module. The Ethernet MAC
assignments for all ports are even-numbered addresses. The odd-numbered MAC
addresses are iSCSI assignments.
Note: The iSCSI and RDMA offload functions of the communication module are not
supported for this release of the expansion card. Firmware updates for the
iSCSI function of the expansion card might fail during asuccessful
firmware-update operation.
Handling static-sensitive devices
Attention: Static electricity can damage the blade server and other electronic
devices. To avoid damage, keep static-sensitive devices in their static-protective
packages until you are ready to install them.
Figure 2. Expansion card in BladeCenter Sunit
Chapter 2. Installing an expansion card 7

To reduce the possibility of damage from electrostatic discharge, observe the
following precautions:
vWhen you work on aBladeCenter unit that has an electrostatic discharge (ESD)
connector, use awrist strap when you handle modules, optional devices, or blade
servers. To work correctly, the wrist strap must have agood contact at both ends
(touching your skin at one end and firmly connected to the ESD connector on the
front or back of the BladeCenter unit).
vLimit your movement. Movement can cause static electricity to build up around
you.
vHandle the device carefully, holding it by its edges or its frame.
vDo not touch solder joints, pins, or exposed circuitry.
vDo not leave the device where others can handle and damage it.
vWhile the device is still in its static-protective package, touch it to any unpainted
metal surface of the BladeCenter unit or any unpainted metal surface on any
other grounded component in the rack you are installing the device in for at least
2seconds. (This drains static electricity from the package and from your body.)
vRemove the device from its package and install it directly into the blade server
without setting down the device. If it is necessary to set down the device, put it
back into its static-protective package. Do not put the device on the blade server
cover or on ametal surface.
vTake additional care when handling devices during cold weather. Heating reduces
indoor humidity and increases static electricity.
Installing the expansion card
Figure 3on page 9shows installation of the expansion card in atypical blade
server system board; the procedure for installing the card in an expansion unit is
similar. The appearance of your blade server or expansion unit might be different.
See the documentation that came with your blade server or expansion unit for more
information.
To install the expansion card, complete the following steps:
1. Read the safety information in “Handling static-sensitive devices” on page 7.
2. If the blade server is installed in the BladeCenter unit, remove it (see the
documentation that came with your BladeCenter unit for instructions).
3. Carefully lay the blade server on aflat, static-protective surface.
4. Open the blade server cover or expansion-unit cover (see the documentation
that came with your BladeCenter unit for instructions).
5. Touch the static-protective package that contains the expansion card to any
unpainted metal surface on the BladeCenter unit or any unpainted metal
surface on any other grounded rack component; then, remove the expansion
card from the package.
6. If present, remove the black protective cover from the connector on the
expansion card.
7. If present, remove the black protective cover from the blade server
expansion-card connector.
8. Hold the expansion card at an approximate 30 degree angle and slide it into
the two mounting posts, making sure that the card-guide holes are aligned;
then, gently pivot the card into the expansion-card connector. Press firmly on
the Press to Install label to seat the expansion card.
82/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter

9. Replace the blade server cover or expansion-unit cover. See the
documentation that came with your BladeCenter unit for instructions.
10. Install the blade server into the BladeCenter unit or expansion unit and turn on
the blade server.
11. Install the expansion card device driver. See “Installing device drivers and
firmware” for more information.
12. Verify that the latest-level firmware is installed. See “Installing device drivers
and firmware” for more information
Installing device drivers and firmware
After you install the expansion card you must install the device drivers. You can
also verify that the latest firmware is installed if desired. The expansion card comes
with the latest level of firmware. However, periodic updates are made available.
Note: Before you install the device driver and firmware, make sure that the
following firmware are at the latest level:
vAdvanced Management Module
vBlade server BIOS and Baseboard Management Controller
Device drivers
After you install the expansion card, you must install the device driver for your
operating system. See “Supported operating systems” on page 2for alist of
supported operating systems.
Notes:
1. Windows users are encouraged to install the Broadcom Advanced Control Suite,
which is included on the Broadcom NetXtreme II Gigabit Ethernet Software CD.
Figure 3. Installing the expansion card into ablade server
Chapter 2. Installing an expansion card 9

2. Note that this procedure is often similar or identical to the device-driver
installation procedure for the blade server integrated Ethernet communications
controllers.
To find the latest device driver, complete the following steps:
1. Go to http://www.ibm.com/systems/support.
2. Under Select product or service type for support,click the down arrow,
select BladeCenter ,and click Go.
3. Under Product family,select HS21 or any other server blade that supports the
expansion card and click Go.
4. From the Refine results menu, select Networking and click Go.The following
are the pertinent items are among those that are displayed:
vBroadcom NetXtreme II Gigabit Ethernet Software CD
vBroadcom (bnx2) NetXtreme II driver for Red Hat Enterprise Linux 5Servers
vBroadcom (bnx2) NetXtreme II driver for SUSE Linux Enterprise Servers
vBroadcom NetXtreme II device driver for Microsoft Windows and Windows
Server
Note: See the Broadcom NetXtreme II Gigabit Ethernet Software CD for a
complete selection of drivers and instructions for installing the drivers.
5. Install the device driver using the instructions that are provided.
Firmware
The expansion card is shipped with the latest level of firmware that was available at
the time of manufacture. You can verify that the latest firmware is installed if
desired. The change history file that is posted with the firmware update utility
provides the latest firmware level that is available.
Notes:
1. For Windows operating systems, use the Broadcom Advanced Control Suite to
identify the level of firmware and device driver that is installed on the expansion
card. Select aBCM5709S NetXtreme II GigE device from the System devices
(VBD) menu on the left side of the screen. The Information pane on the right
side displays the device-driver and firmware level.
2. For Linux operating systems, use acommand like ethtool -i DEVNAME to
display the firmware levels. DEVNAME is the name of the device.
Use the following procedure to find the latest firmware update utility:
1. Go to http://www.ibm.com/systems/support.
2. Under Select product or service type for support,click the down arrow,
select BladeCenter and click Go.
3. Under Product family,select HS21 or any other server blade that supports the
expansion card.
4. From the Refine results menu, select Networking and click Go.The following
firmware update utilities are among the items that are displayed:
vBroadcom NetXtreme II firmware update utility (DOS bootable) -Server
vBroadcom NetXtreme and NetXtreme II firmware update utility for Linux -
Server
vBroadcom NetXtreme and NetXtreme II firmware update utility for Microsoft
Windows -Server
5. Install the firmware using the tool for your operating system. Instructions are
provided with the firmware update utility.
10 2/4 Port Ethernet Expansion Card (CFFh) for IBM BladeCenter