Supermicro AOC-URG4N4-b2XT User manual

User's Guide
Revision 1.0
AOC-URG4N4-b2XT

User's Guide Revision 1.0
Release Date: September 2, 2022
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2022 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America
The information in this user's guide has been carefully reviewed and is believed to be accurate.
The manufacturer's assumes no responsibility for any inaccuracies that may be contained in this
document, and makes no commitment to update or to keep current the information in this user's
guide, or to notify any person or organization of the updates. Please Note: For the most up-to-date
version of this user's guide, please see our Website at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in an industrial environment.
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and
used in accordance with the manufacturer’s instruction manual, may cause harmful interference with
radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
WARNING: This product can expose you to chemicals including
lead, known to the State of California to cause cancer and birth
defects or other reproduc�veharm. Formore informa�on, go
to www.P65Warnings.ca.gov.
!

Preface
About this User's Guide
This user's guide is written for system integrators, PC technicians, and
knowledgeable PC users. It provides information for the installation and use of the
AOC-URG4N4-b2XT add-on card.
About this Add-on Card
Ultra Riser Cards are the most advanced Riser Cards in the market. They provide
PCI-E 4.0 expansion slots for the latest Gen. 4 PCI-E add-in cards while function-
ing as networking devices with various LAN controllers. The AOC-URG4N4-b2XT
provides two ports 10GbE networking solution based on Broadcom®BCM57416,
an internal PCI-E 4.0 x16 slot, and four NVMe ports to provide the exibility of
conguring Supermicro Ultra systems.
An Important Note to the User
All images and layouts shown in this user's guide are based upon the latest PCB
Revision available at the time of publishing. The card you have received may or
may not look exactly the same as the graphics shown in this user's guide.
Returning Merchandise for Service
A receipt or copy of your invoice marked with the date of purchase is required before
any warranty service will be rendered. You can obtain service by calling your ven-
dor for a Returned Merchandise Authorization (RMA) number. When returning the
motherboard to the manufacturer, the RMA number should be prominently displayed
on the outside of the shipping carton, and the shipping package is mailed prepaid
or hand-carried. Shipping and handling charges will be applied for all orders that
must be mailed when service is complete. For faster service, You can also request
a RMA authorization online (http://www.supermicro.com/RmaForm/).
This warranty only covers normal consumer use and does not cover damages in-
curred in shipping or from failure due to the alternation, misuse, abuse, or improper
maintenance of products.
During the warranty period, contact your distributor rst for any product problems.
Preface
iii

iv
Super AOC-URG4N4-b2XT Add-on Card User's Guide
Conventions Used in the User's Guide
Pay special attention to the following symbols for proper system installation and to
prevent damage to the system or injury to yourself:
Warning: Important information is given to ensure proper system installa-
tion or to prevent damage to the components or injury to yourself.
Note: Additional information is given to di󰀨erentiate between various mod-
els or provides information for the correct system setup.
Naming Convention

v
Preface
Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Sales Inquiries)
[email protected] (Gov. Sales
Inquiries)
[email protected] (Technical Support)
[email protected] (RMA Support)
[email protected] (Webmaster)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (Sales Inquiries)
Support_Europe@supermicro (Technical Support)
RMA_Europe@supermicro (RMA Support)
Website: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]

Super AOC-URG4N4-b2XT Add-on Card User's Guide
Asia-Pacic
Email: [email protected] (Sales Inquiries)
[email protected] (Technical Support)
[email protected] (RMA Support)
Website: www.supermicro.com.tw

vi
Table of Contents
Preface
Chapter 1 Overview
1-1 Overview ......................................................................................................... 1-1
1-2 Key Features................................................................................................... 1-1
1-3 Specications .................................................................................................. 1-2
1-4 Available SKUs ............................................................................................... 1-5
Chapter 2 Hardware Components
2-1 Add-On Card Image and Layout..................................................................... 2-1
2-2 Major Components.......................................................................................... 2-2
2-3 Ports................................................................................................................ 2-3
2-4 Connectors ...................................................................................................... 2-3
2-5 Jumpers........................................................................................................... 2-4
Installation
3-1 Static-Sensitive Devices.................................................................................. 3-1
3-2 Before Installation ........................................................................................... 3-2
3-3 Installing the Add-on Card .............................................................................. 3-2
3-4 Installing Drivers for Windows ........................................................................ 3-3
3-5 Installing Drivers (for Broadcom®BCM57416)................................................ 3-4
Preface

Chapter 1: Overview
1-1
Chapter 1
Overview
1-1 Overview
Congratulations on purchasing your add-on card from an acknowledged leader in
the industry. Supermicro products are designed with the utmost attention to detail
to provide you with the highest standards in quality and performance. For product
support and updates, please refer to our website at http://www.supermicro.com/
products/nfo/networking.cfm#adapter.
1-2 Key Features
The key features of this add-on card include the following:
• 1U Networking Ultra Riser card for 1U Ultra systems
• Dual 10GbE RJ45 ports
• Broadcom®BCM57416 Ethernet Controller
• One internal PCI-E 4.0 x16 slot
• Four NVMe ports (two Slim SAS x8)
• Low latency RDMA over Converged Ethernet (RoCE)
• Thermal sensor support
• NC-SI for Remote Management
• Supports RJ45 Category 6 and 6A cables

1-2
Super AOC-URG4N4-b2XT Add-on Card User's Guide
1-3 Specications
General
• Broadcom®BCM57416 dual-port 10Gbps controller
• PCI-E 3.0 x8 (8GT/s) interface
• Dual RJ45 connectors
• One internal PCI-E 4.0 x16 slot
• Four NVMe ports (two Slim SAS x8)
Networking Features
• Jumbo Frames (up to 9600-byte)
• 802.3x ow control
• Link Aggregation (802.3ad)
• Virtual LANs 802.1q VLAN tagging
• Congurable Flow Acceleration (CFA)
• IEEE 1588 and Time Sync
• RDMA over Converged Ethernet (RoCE)
• TruFlow Technology
Stateless O󰀪oad Features
• TCP, UDP, IPv4, IPv6 checksum o󰀪oad
• Large Send O󰀪oad (LSO)
• Receive Segment Coalescing (RSC)
• TCP Segmentation O󰀪oad (TSO)

Chapter 1: Overview
1-3
• Large Receive O󰀪oad (LRO)
• Receive Side Scaling (RSS)
• Transmit Side Scaling (TSS)
NIC Partitioning (NPAR)
• 16 Physical Functions
Virtualization Features
• NetQueue, VMQueue, and Multiqueue
• Support for 128 Virtual Functions
• VXLAN
• NVGRE
• Geneve
• Edge Virtual Bridging (EVB)
Flow Processing
• Exact/Wildcard Match Flow Lookup
• VLAN insertion/deletion
Data Center Bridging
• Priority-based Flow Control (PFC; IEEE 802.1Qbb)
• Enhanced Transmission Selection (ETS; IEEE802.1Qau)
• Quantized Congestion Notication (QCN; IEEE802.1Qau)
• Data Center Bridging Capability eXchange (DCBX; IEEE802.1Qaz)
• Eight tra󰀩c classes per port; fully DCB compliant per 802.1Qbb

1-4
Super AOC-URG4N4-b2XT Add-on Card User's Guide
Manageability
• Network Controller Sideband Interface (NC-SI)
• PXE boot
• Asset Management with thermal sensors
Power Savings
• ACPI compliant power management
• PCI Express Active State Power Management (ASPM)
• Ultra low-power mode
• Pass-through Energy E󰀩cient Ethernet (IEEE802.3az-2010)
Power Consumption
• Maximum power consumption: 16W
Operating Conditions
• Storage temperature: -40°C to 70°C (-40°F to 158°F)
• Storage humidity: 90% non-condensing relative humidity at 35°C
Supported Platforms
• Supermicro®Ultra systems

Chapter 1: Overview
1-5
Add-on Cards Controller Network
Ports
Supported
Speeds
Connector
Types
PCI-E Slot NVMe
Ports
AOC-URG4N4-b2XT
Broadcom®
BCM57416
210GbE 2x RJ45 One PCI-E
4.0 x16
(internal)
4 (2x Slim
SAS x8)
1-4 Available SKUs

Chapter 2: Hardware Components
2-1
REV:1.01
AOC-URG4N4-b2XT
DESIGNED IN USA
MAC CODE
BAR CODE
JP3
SLOT1: PCI-E Gen4 x16
SXB3_3
Broadcom®
BCM57416
Controller
JRJ45
Chapter 2
Hardware Components
2-1 Add-On Card Image and Layout
AOC-URG4N4-b2XT Image
AOC-URG4N4-b2XT Top Layout
3
1
2
4
REV:1.01
AOC-URG4N4-b2XT
DESIGNED IN USA
SLIMSAS2
SLIMSAS1
SXB3_2
SXB3_1
AOC-URG4N4-b2XT Bottom Layout
6
5

2-2
Super AOC-URG4N4-b2XT Add-on Card User's Guide
2-2 Major Components
The following major components are installed on AOC-URG4N4-b2XT:
AOC-URG4N4-b2XT Major Components
No Component Name Denition
1Broadcom®BCM57416 Ethernet LAN controllers
2JP3 Jumper Setting 1-2: 3.3V Standby On
3-4: 3.3V Standby O󰀨 (Default)
3JRJ45 Dual RJ45 Ports
4SlimSAS1 NVMe Cable Connector
5SlimSAS2 NVMe Cable Connector
6Slot 1 PCI-E Gen4 x16

Chapter 2: Hardware Components
2-3
2-3 Ports
There are two RJ45 and four NVMe ports located on the add-on card. For this add-on
card, when SlimSAS1 is used for NVMe1 and NVMe2, each NVMe is PCI-E Gen4
x4. When SlimSAS2 is used for NVMe3 and NVMe4, each NVMe is PCI-E Gen4
x4. Connect a Category 6 or 6A RJ45 cable to provide Gigabit Ethernet communi-
cation. Refer to the add-on card layout on page 2-1 for the locations of the ports.
Note: For further explanation on how to connect SlimSAS cables from
the card to the backplane, please refer to the section of the correspond-
ing motherboard/system's user manual that details the complete system
conguration. If the system user manual does not mention them, then that
system does not use SlimSAS1 and SlimSAS2.
2-4 Connectors
RJ45 Port LEDs
For more information about the LED signals, see the table below.
Port LEDs
Port LED Color Denition
RJ45 Link Solid Green 10Gbps Link Speed
Solid Amber 1Gbps Link Speed
Activity Blink Yellow Activity

2-4
Super AOC-URG4N4-b2XT Add-on Card User's Guide
2-5 Jumpers
Explanation of Jumpers
To modify the operation of the add-on card, a jumper can be used to choose between
optional settings. A jumper creates shorts between two pins to change the function
of the connector. See the add-on card layouts on page 2-1 for the jumper locations.
Note: On two-pin jumpers, "Closed" means the jumper is on and "Open"
means the jumper is o󰀨 the pins.
3.3V Standby Power Enable
The 3.3V Standby Power Enable jumper is located at JP3 on the add-on card. Refer
to the layouts on page 2-1 for the locations of the jumper. To turn 3.3V Standby on,
connect pins 1-2 to enable the NC-SI/BMC management-shared LAN as well as the
WoL during standby. Switch to pins 3-4 to disable those functions when you want
to turn 3.3V Standby o󰀨. The default setting is 3.3V Standby O󰀨.

3-1
Chapter 3: Installation
Chapter 3
Installation
3-1 Static-Sensitive Devices
Electrostatic Discharge (ESD) can damage electronic components. To avoid dam-
aging your add-on card, it is important to handle it very carefully. The following
measures are generally su󰀩cient to protect your equipment from ESD.
Precautions
• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing the add-on card from the
antistatic bag.
• Handle the add-on card by its edges only; do not touch its components or
peripheral chips.
• Put the add-on card back into the antistatic bags when not in use.
• For grounding purposes, make sure that your system chassis provides excel-
lent conductivity between the power supply, the case, the mounting fasteners,
and the add-on card.
Unpacking
The add-on card is shipped in antistatic packaging to avoid static damage. When
unpacking your component or your system, make sure that the person handling it
is static protected.
Warning: To avoid damaging your components and to ensure proper
installation, be sure to always connect the power cord last, and always
remove it before adding, removing, or changing any hardware components.

3-2
Super AOC-URG4N4-b2XT Add-on Card User's Guide
3-2 Before Installation
To install the add-on card properly, be sure to follow the instructions below.
1. Power down the system.
2. Remove the power cord from the wall socket.
3. Use industry standard anti-static equipment (such as gloves or wrist strap)
and follow the instructions listed on page 3-1 to avoid damage caused by
ESD.
4. Familiarize yourself with the server, motherboard, and/or chassis documenta-
tion.
5. Conrm that your operating system includes the latest updates and hotxes.
3-3 Installing the Add-on Card
Follow the steps below to install the add-on card into your system.
1. Remove the server cover and, if necessary, set aside any screws for later
use.
2. Remove the add-on card slot cover. If the case requires a screw, place the
screw aside for later use.
3. Position the add-on card in the slot directly over the connector, and gently
push down on both sides of the card until it slides into the PCI connector.
4. Secure the add-on card to the chassis. If required, use the screw that you
previously removed.
5. Attach any necessary external cables to the add-on card.
6. Replace the chassis cover.
7. Plug the power cord into the wall socket, and power up the system.

3-3
Chapter 3: Installation
3-4 Installing Drivers for Windows
Follow the steps below to install the drivers needed for your Windows OS support.
The controller comes with a driver on the CD-ROM CDR-NIC.
1. Run the CDR-NIC. (If you do not have a product CD-ROM, download drivers
from the Supermicro Support Website and then transfer them to your system.)
2. When the SUPERMICRO window appears, click on the computer icon next to
the product model.
Note: If the FOUND NEW HARDWARE WIZARD screen displays on your
system, click CANCEL.
3. Click on INSTALL DRIVERS AND SOFTWARE.
4. Follow the prompts to complete the installation.

3-4
Super AOC-URG4N4-b2XT Add-on Card User's Guide
3-5 Installing Drivers (for Broadcom®BCM57416)
Use the procedures below to install both drivers and rmware for the AOC-URG4N4-
b2XT add-on card for both Linux and Windows.
Linux Drivers
Use the following procedures to install drivers on the Linux operating system.
Download the drivers from ftp://ftp.supermicro/Networking_Drivers/.
Installing 10G Drivers for the Linux Operating System
1. Prerequisites: Install the following:
yum –y install libibverbs* inniband-diags perftest
qperf librdmacm-utils
yum –y install groupinstall “InniBand Support”
2. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Broadcom > 10G > Linux_Driver.
3. Download the Linux driver package le netxtreme-bnxt_en-<ver>.tar.gz.
4. Install the driver by entering the following commands:
tar xzvf nextreme-bnxt_en–<ver>.tar.gz
cd nextreme-bnxt_en–<ver>
make build
make install
5. You will need to install RoCE library if you want to use RoCE.
6. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Broadcom > 10G > Linux_RoCE_Lib.
7. Download libbnxtre-<ver>.tar.gz.
8. Install the library by entering the following commands:
tar xvzf libbnxtre-<ver>.tar.gz