Supermicro SuperBlade SBM-GEM-X2C User manual

SuperBlade®
Network Modules
User’s Manual
Revison 1.0
4x DDR InfiniBand Module
SBM-XEM-002 10Gps
Ethernet Pass-Through Module
SBM-GEM-X2C 1/10 Gbps
Ethernet Switch Module SBM-GEM-001 Gbps
Ethernet Switch Module
SBM-GEM-002 Gbps
Ethernet Pass-Through Module

Superblade Network Modules User’s Manual
ii
The information in this User’s Manual has been carefully reviewed and is believed to be accurate. The
vendor assumes no responsibility for any inaccuracies that may be contained in this document, makes no
commitment to update or to keep current the information in this manual, or to notify any person or
organization of the updates. Please Note: For the most up-to-date version of this manual, please see
our web site at www.supermicro.com.
Super Micro Computer, Inc. (“Supermicro”) reserves the right to make changes to the product described
in this manual at any time and without notice. This product, including software, if any, and documentation
may not, in whole or in part, be copied, photocopied, reproduced, translated or reduced to any medium or
machine without prior written consent.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE
THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY HARDWARE,
SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF
REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE,
SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara
County in the State of California, USA.. The State of California, County of Santa Clara shall be the
exclusive venue for the resolution of any such disputes. Super Micro's total liability for all claims will not
exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A digital
device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection
against harmful interference when the equipment is operated in a commercial environment. This
equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in
accordance with the manufacturer’s instruction manual, may cause harmful interference with radio
communications. Operation of this equipment in a residential area is likely to cause harmful interference,
in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning
applies only to products containing CR (Manganese Dioxide) Lithium coin cells. Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate for further
details.
Manual Revison 1.0
Release Date: February 18, 2009
Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy
any part of this document.
Information in this document is subject to change without notice. Other products and companies referred
to herein are trademarks or registered trademarks of their respective companies or mark holders.
Copyright © 2009 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America
WARNING: HANDLING OF LEAD SOLDER MATERIALS USED IN THIS
PRODUCT MAY EXPOSE YOU TO LEAD, A CHEMICAL KNOWN TO THE
STATE OF CALIFORNIA TO CAUSE BIRTH DEFECTS AND OTHER
REPRODUCTIVE HARM.

iii
Preface
About this Manual
This manual is written for professional system integrators, Information Technology
professionals, service personnel and technicians. It provides information for the
installation and use of Supermicro's network modules. Installation and maintenance
should be performed by experienced professionals only.
Manual Organization
Chapter 1: Introduction
The first chapter provides an overview of this manual.
Chapter 2: System Safety
You should familiarize yourself with this chapter for a general overview of safety
precautions that should be followed when installing and servicing Superblade Network
Modules.
Chapter 3: Setup and Installation
Refer here for details on installing the modules into a SuperBlade enclosure and for their
setup and configuration.
Chapter 4: InfiniBand Module
This chapter details the InfiniBand module and its features.
Chapter 5: Ethernet Switches Modules
This chapter details all switches and pass-through modules for the SuperBlade system.
Chapter 6: 1-Gb Ethernet Switch Firmware
This chapter details 1-Gb switch firmware menus and screens and how to use them.
Chapter 7: 10-Gb Ethernet Switch Firmware
This chapter details 1/10-Gb switch firmware menus and screens and how to use them.
Appendix A: HCA Mezzanine Cards
This appendix details the HCA mezzanine cards that can be installed in blade modules
for use with the InfiniBandInfiniBand or 1/10-Gb switch modules.
Appendix B: LED Descriptions
LED descriptions are summarized here in this appendix for quick reference.

Superblade Network Modules User’s Manual
iv
Notes

v
:
Table of Contents
Chapter 1 Introduction........................................................................1-i
1-1 Overview..............................................................................................1-i
1-2 Product Checklist of Typical Components......................................1-i
1-3 Features...............................................................................................1-i
1-4 Contacting Supermicro..................................................................... 1-ii
Chapter 2 System Safety..................................................................2-1
2-1 Electrical Safety Precautions...........................................................2-1
2-2 General Safety Precautions.............................................................2-2
2-3 Electrostatic Discharge Precautions ..............................................2-2
2-4 Operating Precautions......................................................................2-2
Chapter 3 Setup and Installation.................................................3-1
3-1 Installing/Removing a Switch Module............................................3-1
Installing a Switch Module ......................................................................3-1
Removing a Switch Module ....................................................................3-3
3-2 Configuring the Switch Module.......................................................3-4
Web-based Management Utility/IPMI .....................................................3-5
Network Connection.............................................................................3-5
Address Defaults..................................................................................3-7
Command Line........................................................................................3-8
3-3 1/10 Gigabit Ethernet Switch Firmware.........................................3-9
Firmware Upgrading Procedures............................................................3-9
Firmware Failure Recovery Steps.........................................................3-12
Chapter 4 InfiniBand Module.........................................................4-1
4-1 Overview.............................................................................................4-1
4-2 InfiniBand Module .............................................................................4-1
Installing/Removing the InfiniBand Module.............................................4-2
InfiniBand Switch LEDs...........................................................................4-3
Chapter 5 Ethernet Switches Modules....................................5-1
5-1 SBM-GEM-001 Gigabit Ethernet Switch Module.........................5-1
LED Indicators ........................................................................................5-2
Ports........................................................................................................5-2
5-2 SBM-GEM-X2C 1/10 Gb Ethernet Switch Module.......................5-3

Superblade Network Modules User’s Manual
vi
LED Indicators ........................................................................................5-4
Ports........................................................................................................5-4
5-3 GEM-002 Gb Ethernet Pass-through Module...............................5-5
5-4 SBM-XEM-002 1/10 Gb Ethernet Pass-through Module............5-6
Chapter 6 1-Gb Ethernet Switch Firmware ...........................6-1
6-1 SBM-GEM-001 Firmware Features and Functions .....................6-1
6-1 Port Status..........................................................................................6-3
Port VLAN ID (PVID)...............................................................................6-4
Jumbo Frames Support ..........................................................................6-4
Port Configuration...................................................................................6-4
6-2 Statistics..............................................................................................6-6
Port Statistics ..........................................................................................6-6
6-3 VLAN...................................................................................................6-9
6-4 Configuring a Static VLAN.............................................................6-11
6-5 Trunking............................................................................................6-12
6-6 Mirroring............................................................................................6-14
6-7 Quality of Service............................................................................6-15
Priority Queues.....................................................................................6-15
6-8 Rate Control.....................................................................................6-17
6-9 L2 Management...............................................................................6-18
6-10 Spanning Tree ...............................................................................6-20
Bridge Protocol Data Unit (BPDU)........................................................6-20
Port Transition State..............................................................................6-21
RSTP Port Roles................................................................................6-21
Root Status.........................................................................................6-23
Bridge Setting.....................................................................................6-23
RSTP Port Settings............................................................................6-24
6-11 IEEE 802.1x...................................................................................6-25
Wiring for 802.1x...................................................................................6-25
802.1x Configuration.............................................................................6-26
6-12 IGMP Snooping.............................................................................6-27
6-13 SNMP..............................................................................................6-29
6-14 UpLink Failure Tracking (ULFT) .................................................6-30
Chapter 7 10-Gb Ethernet Switch Firmware.........................7-1
7-1 Overview.............................................................................................7-1
Nomenclature..........................................................................................7-1

vii
Table of Contents
7-2 Login....................................................................................................7-2
7-3 Home Page........................................................................................7-3
Page Header Links .................................................................................7-4
Navigation Bar ........................................................................................7-4
Control Pane...........................................................................................7-4
System Acknowledgement Page............................................................7-5
7-4 System Management Page.............................................................7-6
System Information.................................................................................7-7
Save and Restore...................................................................................7-9
Save.....................................................................................................7-9
Restore...............................................................................................7-10
Erase..................................................................................................7-11
System Settings....................................................................................7-12
SNMP....................................................................................................7-13
Community.........................................................................................7-15
Group.................................................................................................7-16
Group Access.....................................................................................7-17
View ...................................................................................................7-18
Target Address...................................................................................7-20
Target Parameter ...............................................................................7-21
User....................................................................................................7-22
Trap Manager.....................................................................................7-24
RMON...................................................................................................7-25
Basic Settings ....................................................................................7-25
Alarms................................................................................................7-26
Ethernet Statistics ..............................................................................7-27
Events................................................................................................7-28
History................................................................................................7-29
TACACS+ Server..................................................................................7-30
Server Config.....................................................................................7-31
Global Settings...................................................................................7-32
Syslog...................................................................................................7-32
Logging ..............................................................................................7-33
Mail.....................................................................................................7-34
IP Authorized Manager.........................................................................7-35
ACL.......................................................................................................7-36
MAC ACL...........................................................................................7-36
IP Standard ACL ................................................................................7-38
IP Extended ACL................................................................................7-39
QoS.......................................................................................................7-40

Superblade Network Modules User’s Manual
viii
Basic Settings ....................................................................................7-41
Classmap...........................................................................................7-42
Policymap...........................................................................................7-43
COSQ Algorithm ................................................................................7-44
Cosq Traffic Class..............................................................................7-45
7-5 Layer2 Management Page ............................................................7-46
Port Manager........................................................................................7-47
Basic Settings ....................................................................................7-48
Port Monitoring...................................................................................7-49
Traffic Class .......................................................................................7-50
Port Control........................................................................................7-51
Rate Limiting......................................................................................7-52
VLAN.....................................................................................................7-53
Basic Settings ....................................................................................7-53
Port Settings.......................................................................................7-55
Static VLANs......................................................................................7-56
Protocol Group...................................................................................7-57
Port Protocol ......................................................................................7-58
Port MAC Map....................................................................................7-59
UnicastMAC.......................................................................................7-60
Wildcard.............................................................................................7-61
Switch Port Filtering...........................................................................7-62
Dynamic VLAN......................................................................................7-63
Dynamic VLAN...................................................................................7-63
Port Settings.......................................................................................7-64
Garp Timers .......................................................................................7-65
RSTP ....................................................................................................7-66
Global Settings...................................................................................7-66
Basic Settings ....................................................................................7-67
Port Settings.......................................................................................7-68
Port Status..........................................................................................7-70
MSTP....................................................................................................7-71
Basic Settings ....................................................................................7-71
Timers................................................................................................7-73
Port Configuration..............................................................................7-74
VLAN Mapping...................................................................................7-76
Port Settings.......................................................................................7-77
CIST Port Status ................................................................................7-78
LA..........................................................................................................7-79
Basic Settings ....................................................................................7-80

ix
Table of Contents
Interface Settings...............................................................................7-81
Port Channel Settings........................................................................7-82
Port Settings.......................................................................................7-84
Port State Info ....................................................................................7-86
Load Balancing ..................................................................................7-87
802.1x...................................................................................................7-87
Basic Settings ....................................................................................7-88
Port Settings.......................................................................................7-89
Timers................................................................................................7-91
Local AS.............................................................................................7-93
Radius Settings..................................................................................7-94
MAC Session Info ..............................................................................7-95
Filters....................................................................................................7-96
Unicast Filters ....................................................................................7-97
Multicast Filters..................................................................................7-98
Multicast Forwarding........................................................................7-100
7-6 Layer3 Management Page ..........................................................7-101
IP.........................................................................................................7-102
VLAN Interface.................................................................................7-103
IPv4 AddrConf..................................................................................7-104
IP Route...........................................................................................7-105
LoopBack Settings...........................................................................7-106
IPv6.....................................................................................................7-107
IPv6 Route .......................................................................................7-107
IPv6 Interface...................................................................................7-108
ND Cache.........................................................................................7-110
Address Settings..............................................................................7-112
Address Profile.................................................................................7-113
Prefix Settings..................................................................................7-114
DHCP Server......................................................................................7-115
Basic Settings ..................................................................................7-115
Pool Settings....................................................................................7-116
DHCP Relay........................................................................................7-117
Basic Settings ..................................................................................7-118
Interface Conf...................................................................................7-119
RIP......................................................................................................7-120
Basic Settings ..................................................................................7-120
Interface...........................................................................................7-121
Neighbors.........................................................................................7-123
Security............................................................................................7-124

Superblade Network Modules User’s Manual
x
Summarization.................................................................................7-125
RIPng..................................................................................................7-126
RIP6 Interface..................................................................................7-126
Filters ...............................................................................................7-128
OSPF..................................................................................................7-129
Basic Settings ..................................................................................7-129
Area..................................................................................................7-131
Interface...........................................................................................7-132
Virtual Interface................................................................................7-134
Neighbor...........................................................................................7-135
RRD Route.......................................................................................7-136
Aggregation......................................................................................7-137
AsExtAggregation ............................................................................7-138
OSPFv3 ..............................................................................................7-139
Basic Settings ..................................................................................7-140
Interface...........................................................................................7-141
Area..................................................................................................7-143
BGP ....................................................................................................7-144
Basic Settings ..................................................................................7-145
Neighbors.........................................................................................7-146
Multi-Exit Discriminators...................................................................7-148
Local Preference..............................................................................7-149
Filters ...............................................................................................7-150
Route Aggregation...........................................................................7-152
RRD....................................................................................................7-153
Basic Settings ..................................................................................7-153
BGP..................................................................................................7-154
RIP...................................................................................................7-155
OSPF ...............................................................................................7-156
RRDv6 ................................................................................................7-157
Filters ...............................................................................................7-158
OSPFv3............................................................................................7-159
RIP6.................................................................................................7-160
VRRP..................................................................................................7-161
Basic Settings ..................................................................................7-161
VRRP Settings.................................................................................7-162
Layer 3 Tunnel....................................................................................7-163
7-7 Multicast Page...............................................................................7-164
IGMP Snooping Configuration............................................................7-165
Basic Settings ..................................................................................7-166