Sun Microsystems 5945532 User manual

Sun Microsystems, Inc.
www.sun.com
Submit comments about this document at: http://www.sun.com/hwdocs/feedback
Sun™Dual 10GbE SFP+ PCIe
ExpressModule User’s Guide
Part No. 820-4979-10
August 2008, Revision A

Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.
This distribution may include materials developed by third parties.
Sun, Sun Microsystems, the Sun logo, SunSolve, Sun Fire, and Solaris are trademarks or registered trademarks of Sun Microsystems, Inc., or its
subsidiaries, in the U.S. and other countries.
UNIX is a registered trademark in the U.S. and other countries, exclusively licensed through X/Open Company, Ltd.
Intel is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Intel Xeon is a
trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. The Adobe logo is a
registered trademark of Adobe Systems, Incorporated.
Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S.
export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright © 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés.
Cette distribution peut comprendre des composants développés par des tierces parties.
Sun, Sun Microsystems, le logo Sun, SunSolve, Sun Fire, et Solaris sont des marques de fabrique ou des marques déposées de Sun Microsystems,
Inc., ou ses filiales, aux Etats-Unis et dans d’autres pays.
UNIX est une marque déposée aux Etats-Unis et dans d’autres pays et licenciée exlusivement par X/Open Company, Ltd.
Intel est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d’autres pays. Intel Xeon
est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d’autres pays. Le logo Adobe
est une marque déposée de Adobe Systems, Incorporated.
L’utilisation de pieces detachees ou d’unites centrales de remplacement est limitee aux reparations ou a l’echange standard d’unites centrales
pour les produits exportes, conformement a la legislation americaine en matiere d’exportation. Sauf autorisation par les autorites des Etats-
Unis, l’utilisation d’unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L’ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A
L’ABSENCE DE CONTREFACON.

iii
Contents
Preface xv
1. Sun Dual 10GbE SFP+ PCIe ExpressModule Overview 1
Shipping Kit Contents 1
ExpressModule Hardware Overview 1
ExpressModule Features 2
Indicator Lights on the ExpressModule 3
Hardware and Software Requirements 5
Patch Requirements 5
Patches and Updates 6
2. Installing and Setting Up the Device Driver Software 7
Downloading and Installing the Driver on a Linux Platform 7
▼To Download the Driver for a Linux Platform 7
▼To Install the Driver for a Linux Platform 8
▼To Remove the Driver From a Linux Platform 9
Downloading and Installing the Driver on a Microsoft Windows Platform 10
▼To Download and Install the Driver on a Microsoft Windows Platform 10
▼To Remove the Driver From a Microsoft Windows Platform 11
3. Installing the ExpressModule 13

iv Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
Installing an Optical Transceiver 13
▼To Install an Optical Transceiver 13
Installing the ExpressModule 16
▼To Install the ExpressModule With the Power Off 16
Verifying the Installation 19
▼To Verify the Installation in a Linux System 19
▼To Verify the Installation in a Microsoft Windows System 19
4. Network Configuration 21
Configuring the Network Host Files for Booting Over the Gigabit Ethernet
Network for Linux Systems 21
▼To Boot Over the Network on Linux Systems 21
5. Configuring the Driver Parameters 23
Driver Overview 23
Driver Parameters for Linux Systems 24
Setting ixgbe Driver Parameters in Linux Systems 25
▼To Configure Jumbo Frames 25
6. Configuring VLANs 27
VLAN Overview 27
Configuring VLANs 30
▼To Configure VLANs in a Linux Environment 30
▼To Configure VLANs in a Microsoft Windows 2003 Environment 31
Configuring Bonding for Multiple Interfaces 32
▼To Configure Bonding for Multiple ixgbe Interfaces 32
▼To Remove Bonding 33
A. Sun Dual 10GbE SFP+ PCIe ExpressModule Specifications 35
Connectors 36
Technical Features 37

Contents v
Physical Characteristics 37
Power and Environmental Requirements 38
Index 39

vi Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008

vii
Regulatory Compliance Statements
Your Sun product is marked to indicate its compliance class:
•Federal Communications Commission (FCC) — USA
•Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada
•Voluntary Control Council for Interference (VCCI) — Japan
•Bureau of Standards Metrology and Inspection (BSMI) — Taiwan
Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the
product.
FCC Class A Notice
This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This device may not cause harmful interference.
2. This device must accept any interference received, including interference that may cause undesired operation.
Note: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of
the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment
is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy, and if it is
not installed and used in accordance with the instruction manual, it may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference, in which case the user will be required
to correct the interference at his own expense.
Modifications: Any modifications made to this device that are not approved by Sun Microsystems, Inc. may void the authority
granted to the user by the FCC to operate this equipment.
ICES-003 Class A Notice - Avis NMB-003, Classe A
This Class A digital apparatus complies with Canadian ICES-003.
Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada.

viii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
BSMI Class A Notice
The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance
label.
CCC Class A Notice
The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance
label.
GOST-R Certification Mark
T33012

ix
Safety Agency Compliance
Statements
Read this section before beginning any procedure. The
following text provides safety precautions to follow when
installing a Sun Microsystems product.
Safety Precautions
For your protection, observe the following safety
precautions when setting up your equipment:
■Follow all cautions and instructions marked on the
equipment.
■Ensure that the voltage and frequency of your power
source match the voltage and frequency inscribed on
the equipment’s electrical rating label.
■Never push objects of any kind through openings in
the equipment. Dangerous voltages may be present.
Conductive foreign objects could produce a short
circuit that could cause fire, electric shock, or damage
to your equipment.
Symbols
The following symbols may appear in this book:
Caution – There is a risk of personal injury
and equipment damage. Follow the
instructions.
Caution – Hot surface. Avoid contact.
Surfaces are hot and may cause personal
injury if touched.
Caution – Hazardous voltages are present. To
reduce the risk of electric shock and danger to
personal health, follow the instructions.
Depending on the type of power switch your device has,
one of the following symbols may be used:
On – Applies AC power to the system.
Off – Removes AC power from the system.
Standby – The On/Standby switch is in the
standby position.
Modifications to Equipment
Do not make mechanical or electrical modifications to the
equipment. Sun Microsystems is not responsible for
regulatory compliance of a modified Sun product.
Placement of a Sun Product
Caution – Do not block or cover the openings
of your Sun product. Never place a Sun
product near a radiator or heat register.
Failure to follow these guidelines can cause
overheating and affect the reliability of your
Sun product.
System Unit Cover
You must remove the cover of your Sun computer system
unit to add cards, memory, or internal storage devices. Be
sure to replace the cover before powering on your computer
system.
Caution – Do not operate Sun products
without the cover in place. Failure to take this
precaution may result in personal injury and
system damage.

xSun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
Conformité aux normes de sécurité
Veuillez lire attentivement cette section avant de
commencer. Ce texte traite des mesures de sécurité qu’il
convient de prendre pour l’installation d’un produit Sun
Microsystems.
Mesures de sécurité
Pour votre sécurité, nous vous recommandons de suivre
scrupuleusement les mesures de sécurité ci-dessous lorsque
vous installez votre matériel:
■Suivez tous les avertissements et toutes les
instructions inscrites sur le matériel.
■Assurez-vous que la tension et la fréquence de votre
source d'alimentation correspondent à la tension et à
la fréquence indiquées sur l'étiquette de la tension
électrique nominale du matériel
■N'introduisez jamais d'objets quels qu'ils soient dans
les ouvertures de l'équipement. Vous pourriez vous
trouver en présence de hautes tensions dangereuses.
Tout objet étranger conducteur risque de produire un
court-circuit pouvant présenter un risque d'incendie
ou de décharge électrique, ou susceptible
d'endommager le matériel.
Symboles
Vous trouverez ci-dessous la signification des différents
symboles utilisés:
Attention – Vous risquez d'endommager le
matériel ou de vous blesser. Veuillez suivre les
instructions.
Attention – Surfaces brûlantes. Evitez tout
contact. Les surfaces sont brûlantes. Vous
risquez de vous blesser si vous les touchez.
Attention – Tensions dangereuses. Pour
réduire les risques de décharge électrique et
de danger physique, observez les consignes
indiquées.
Selon le type d'interrupteur marche/arrêt dont votre
appareil est équipé, l'un des symboles suivants sera utilisé:
Marche – Met le système sous tension
alternative.
Arret – Met le système hors tension
alternative.
Veilleuse – L'interrupteur Marche/Veille est
sur la position de veille.
Modification du matériel
N'apportez aucune modification mécanique ou électrique
au matériel. Sun Microsystems décline toute responsabilité
quant à la non-conformité éventuelle d'un produit Sun
modifié.
Positionnement d’un produit Sun
Attention – Evitez d'obstruer ou de recouvrir
les orifices de votre produit Sun. N'installez
jamais un produit Sun près d'un radiateur ou
d'une source de chaleur. Si vous ne respectez
pas ces consignes, votre produit Sun risque de
surchauffer et son fonctionnement en sera
altéré.
Couvercle de l'unité
Pour ajouter des cartes, de la mémoire ou des périphériques
de stockage internes, vous devez retirer le couvercle de
votre système Sun. Remettez le couvercle supérieur en
place avant de mettre votre système sous tension.
Attention – Ne mettez jamais des produits
Sun sous tension si leur couvercle supérieur
n'est pas mis en place. Si vous ne prenez pas
ces précautions, vous risquez de vous blesser
ou d'endommager le système.

Safety Agency Compliance Statements xi
Einhaltung sicherheitsbehördlicher
Vorschriften
Lesen Sie vor dem Ausführen von Arbeiten diesen
Abschnitt. Im folgenden Text werden Sicherheitsvor-
kehrungen beschrieben, die Sie bei der Installation eines
Sun Microsystems-Produkts beachten müssen.
Sicherheitsvorkehrungen
Treffen Sie zu Ihrem eigenen Schutz bei der Installation des
Geräts die folgenden Sicherheitsvorkehrungen:
■Beachten Sie alle auf den Geräten angebrachten
Warnhinweise und Anweisungen.
■Stellen Sie sicher, dass Spannung und Frequenz der
Stromversorgung den Nennleistungen auf dem am
Gerät angebrachten Etikett entsprechen.
■Führen Sie niemals Fremdobjekte in die Öffnungen
am Gerät ein. Es können gefährliche Spannungen
anliegen. Leitfähige Fremdobjekte können einen
Kurzschluss verursachen, der einen Brand, Strom-
schlag oder Geräteschaden herbeiführen kann.
Symbole
Die Symbole in diesem Handbuch haben folgende
Bedeutung:
Achtung – Gefahr von Verletzung und
Geräteschaden. Befolgen Sie die Anwei-
sungen.
Achtung – Heiße Oberfläche. Nicht berühren,
da Verletzungsgefahr durch heiße Oberfläche
besteht.
Achtung – Gefährliche Spannungen.
Befolgen Sie die Anweisungen, um
Stromschläge und Verletzungen zu vermeiden.
Je nach Netzschaltertyp an Ihrem Gerät kann eines der
folgenden Symbole verwendet werden:
Ein – Versorgt das System mit Wechselstrom.
Aus– Unterbricht die Wechselstromzufuhr
zum Gerät.
Wartezustand – Der Ein-/Standby-Netz-
schalter befindet sich in der Standby-Position.
Modifikationen des Geräts
Nehmen Sie keine elektrischen oder mechanischen
Gerätemodifikationen vor. Sun Microsystems ist für die
Einhaltung der Sicherheitsvorschriften von modifizierten
Sun-Produkten nicht haftbar.
Gehäuseabdeckung
Sie müssen die Abdeckung Ihres Sun-Computersystems
entfernen, um Karten, Speicher oder interne Speichergeräte
hinzuzufügen. Bringen Sie vor dem Einschalten des
Systems die Gehäuseabdeckung wieder an.
Achtung – Nehmen Sie Sun-Geräte nicht
ohne Abdeckung in Betrieb. Die
Nichtbeachtung dieses Warnhinweises kann
Verletzungen oder Geräteschaden zur Folge
haben.

xii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
Normativas de seguridad
Lea esta sección antes de realizar cualquier operación. En
ella se explican las medidas de seguridad que debe tomar al
instalar un producto de Sun Microsystems.
Medidas de seguridad
Para su protección, tome las medidas de seguridad
siguientes durante la instalación del equipo:
■Siga todos los avisos e instrucciones indicados en el
equipo.
■Asegúrese de que el voltaje y frecuencia de la fuente
de alimentación coincidan con el voltaje y frecuencia
indicados en la etiqueta de clasificación eléctrica del
equipo.
■No introduzca objetos de ningún tipo por las rejillas
del equipo, ya que puede quedar expuesto a voltajes
peligrosos. Los objetos conductores extraños pueden
producir cortocircuitos y, en consecuencia, incendios,
descargas eléctricas o daños en el equipo.
Símbolos
En este documento aparecen los siguientes símbolos:
Precaución – Existe el riesgo de que se
produzcan lesiones personales y daños en el
equipo. Siga las instrucciones.
Precaución – Superficie caliente. Evite todo
contacto. Las superficies están calientes y
pueden causar lesiones personales si se tocan.
Precaución – Voltaje peligroso. Para reducir
el riesgo de descargas eléctricas y lesiones
personales, siga las instrucciones.
En función del tipo de interruptor de alimentación del que
disponga el dispositivo, se utilizará uno de los símbolos
siguientes:
Encendido – Suministra alimentación de CA
al sistema.
Apagado – Corta la alimentación de CA del
sistema.
Espera – El interruptor de encendido/espera
está en la posición de espera.
Modificaciones en el equipo
No realice modificaciones de tipo mecánico ni eléctrico en el
equipo. Sun Microsystems no se hace responsable del
cumplimiento de normativas en caso de que un producto
Sun se haya modificado.
Colocación de un producto Sun
Precaución – No obstruya ni tape las rejillas
del producto Sun. Nunca coloque un producto
Sun cerca de radiadores ni fuentes de calor. Si
no sigue estas indicaciones, el producto Sun
podría sobrecalentarse y la fiabilidad de su
funcionamiento se vería afectada.

xiii
Declaration of Conformity
EMC
USA—FCC Class A
This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This equipment may not cause harmful interference.
2. This equipment must accept any interference that may cause undesired operation.
Canada
This Class A digital apparatus complies with Canadian ICES-003.
European Union
This equipment complies with the following requirements of the EMC Directive 2004/108/EC:
Safety
This equipment complies with the following requirements of the Low Voltage Directive2006/95/EC:
Supplementary Information
This equipment was tested and complies with all the requirements for the CE Mark.
This equipment complies with the Restriction of Hazardous Substances (RoHS) directive 2002/95/EC.
.
Compliance Model Number: 5945532
Product Family Name: Sun Dual 10GbE SFP+ PCIe ExpressModule
As Information Technology Equipment (ITE) Class Aper (as applicable):
EN 55022:2006 Class A
EN 61000-3-2:2000 +A2:2005 Pass
EN 61000-3-3:1995 +A1:2001 Pass
EN 55024:1998 +A1:2001 +A2:2003 Required Limits:
IEC61000-4-2 4 kV (Direct), 8 kV (Air)
IEC61000-4-3 3 V/m
IEC61000-4-4 1 kV AC Power Lines, 0.5 kV Signal and DC Power Lines
IEC61000-4-5 1 kV AC Line-Line and Outdoor Signal Lines, 2 kV AC Line-Gnd, 0.5 kV DC Power Lines
IEC61000-4-6 3 V
IEC61000-4-8 1 A/m
IEC61000-4-11 Pass
EC Type Examination Certificates:
EN 60950-1:2001, 1st Edition
IEC 60950-1:2001, 1st Edition CB Scheme Certificate No. NO47596
Evaluated to all CB Countries
UL 60950-1:2003, CSA C22.2 No. 60950-03 File: E139761 Vol. 7
/S/
Dennis P. Symanski DATE
Worldwide Compliance Office
Sun Microsystems, Inc.
4150 Network Circle, MPK15-102
Santa Clara, CA 95054 U.S.A.
Tel: [phone] Fax: [phone]

xiv Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008

xv
Preface
This user’s guide provides hardware and software installation instructions for the
Sun™ Dual 10GbE SFP+ PCIe Express Module. This document also describes how to
configure the driver software for the ixgbe driver for Linux operating systems and
Microsoft Windows Server 2003.
These instructions are designed for enterprise system administrators with experience
installing network hardware and software.
Note – In this document the term x86 refers to 64-bit and 32-bit systems
manufactured using processors compatible with the AMD64, Intel® Xeon®, or Intel
Pentium product families.
How This Document Is Organized
Chapter 1 describes the Sun 10GbE XFP SR PCI Express Card hardware and
software.
Chapter 2 explains how to download, install, and verify the ixgbe device driver
software on Linux and Microsoft Windows systems.
Chapter 3 describes how to install the Ethernet adapter in your system and verify
that it has been installed correctly.
Chapter 4 describes how to edit the network host files after the Ethernet adapter has
been installed on your system.
Chapter 5 describes how to configure the ixgbe driver parameters.

xvi Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
Chapter 6 explains virtual local area networks (VLANs), and provides configuration
instructions and examples.
Appendix A lists the specifications for the Sun 10GbE XFP SR PCI Express Card.
Typographic Conventions
Shell Prompts
Typeface*
* The settings on your browser might differ from these settings.
Meaning Examples
AaBbCc123 The names of commands, files,
and directories; on-screen
computer output
Edit your.login file.
Use ls -a to list all files.
% You have mail.
AaBbCc123 What you type, when contrasted
with on-screen computer output
%su
Password:
AaBbCc123 Book titles, new words or terms,
words to be emphasized.
Replace command-line variables
with real names or values.
Read Chapter 6 in the User’s Guide.
These are called class options.
You must be superuser to do this.
To delete a file, type rm filename.
Shell Prompt
C shell machine-name%
C shell superuser machine-name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #

Preface xvii
Related Documentation
The documents listed as online are available at:
http://docs.sun.com/app/docs/prod/dual.sfp.pcie
Documentation, Support, and Training
Third-Party Web Sites
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites
or resources. Sun will not be responsible or liable for any actual or alleged damage
or loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
Application Title Part Number Format Location
Release Notes Sun 10GbE XFP SR PCI Express Card, Sun Dual
10GbE XFP 2 SR PCI Express Card, and Sun Dual
10GbE SFP+ PCIe ExpressModule Release Notes
820-4505 PDF
HTML
Online
Getting Started Sun Dual 10GbE SFP+ PCIe ExpressModule Getting
Started Guide
820-4981 Hardcopy Ship kit
Safety and
compliance
Safety and Compliance Manual 816-7190 Hardcopy Ship kit
Sun Function URL
Documentation http://www.sun.com/documentation/
Support http://www.sun.com/support/
Training http://www.sun.com/training/

xviii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide, part number 820-4979-10

1
CHAPTER 1
Sun Dual 10GbE SFP+ PCIe
ExpressModule Overview
This chapter describes the Sun 10GbE XFP SR PCI Express Card hardware and
software, and includes the following sections:
■“Shipping Kit Contents” on page 1
■“ExpressModule Hardware Overview” on page 1
■“Hardware and Software Requirements” on page 5
■“Patch Requirements” on page 5
■“Patches and Updates” on page 6
Shipping Kit Contents
The carton in which your Sun 10GbE XFP SR PCI Express Card was shipped should
contain the following items:
■Sun 10GbE XFP SR PCI Express Card
■Sun Dual 10GbE SFP+ PCIe ExpressModule Getting Started Guide
■Safety and Compliance Manual
ExpressModule Hardware Overview
The Sun 10GbE XFP SR PCI Express Card is a 10 Gigabit Ethernet (10GbE) fiber
network interface card (NIC) for PCI Express systems. The ExpressModule is based
on the dual-port Intel 82598EB 10GbE controller.

2Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
The ExpressModule is optimized for Intel I/O Acceleration Technology (I/OAT),
which is designed to optimize network I/O. The ExpressModule is a high-
performance, highly integrated 10 Gigabit Ethernet LAN card with PCIe host
interface and fiber LAN connectors on the optical modules.
The product conforms to the IEEE 802.3 standard and supports standards for system
manageability and power management.
FIGURE 1-1 Sun Dual 10GbE SFP+ PCIe ExpressModule
ExpressModule Features
The Sun 10GbE XFP SR PCI Express Card provides the following features and
benefits:
■Intel 82598EB 10 Gigabit Ethernet controller
■Load balancing on multiple CPUs
■Intel I/O Acceleration Technology (I/OAT)
■iSCSI remote boot support
■MSI-X support
■Virtual Machine Device queues (VMDq)
■Low latency
■Optimized queues – 32 transmit (Tx) and 64 receive (Rx) per port