Supermicro AOC-AH25G-m2S2TM User manual

User's Guide
Revision 1.0
AOC-AH25G-m2S2TM

User's Guide Revision 1.0
Release Date: December 8, 2020
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2020 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America
The information in this user's guide has been carefully reviewed and is believed to be accurate. The
manufacturer assumes no responsibility for any inaccuracies that may be contained in this document,
and makes no commitment to update or to keep current the information in this user's guide, or to
notify any person or organization of the updates. Please Note: For the most up-to-date version
of this user's guide, please see our Website at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in an industrial environment.
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and
used in accordance with the manufacturer’s instruction manual, may cause harmful interference with
radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”.
WARNING: This product can expose you to chemicals including
lead, known to the State of California to cause cancer and birth
defects or other reproduc�veharm. Formore informa�on, go
to www.P65Warnings.ca.gov.
!

Preface
About this User's Guide
This user's guide is written for system integrators, PC technicians, and
knowledgeable PC users. It provides information for the installation and use of the
AOC-AH25G-m2S2TM add-on card.
About this Add-on Card
The Supermicro AOC-AH25G-m2S2TM is one of the most feature rich 25GbE
controllers in the market. Based on the Mellanox®ConnectX-4 Lx EN with features
such as VXLAN and NVGRE, it provides exible connectivity for different networking
platforms. It is compatible with 10GbE networks and offers the most cost effective
upgrades from 10GbE to 25GbE for Data Center and Cloud deployments. The AOC-
AH25G-m2S2TM also supports an additional 2-ports of 10GbE RJ45 connectivity,
based on the Intel®X550 controller, providing NC-SI for Remote Management. this
versatile 25GbE controller is an excellent choice to enhance data center network
connectivity when high speed throughput is required.
An Important Note to the User
All images and layouts shown in this user's guide are based upon the latest PCB
Revision available at the time of publishing. The add-on card you have received
may or may not look exactly the same as the graphics shown in this user's guide.
Returning Merchandise for Service
A receipt or copy of your invoice marked with the date of purchase is required before
any warranty service will be rendered. You can obtain service by calling your ven-
dor for a Returned Merchandise Authorization (RMA) number. When returning the
motherboard to the manufacturer, the RMA number should be prominently displayed
on the outside of the shipping carton, and the shipping package is mailed prepaid
or hand-carried. Shipping and handling charges will be applied for all orders that
must be mailed when service is complete. For faster service, You can also request
a RMA authorization online (http://www.supermicro.com).
This warranty only covers normal consumer use and does not cover damages in-
curred in shipping or from failure due to the alternation, misuse, abuse or improper
maintenance of products.
During the warranty period, contact your distributor rst for any product problems.
Preface
iii

iv
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
Conventions Used in the User's Guide
Pay special attention to the following symbols for proper system installation and to
prevent damage to the system or injury to yourself:
Warning: Important information given to ensure proper system installation
or to prevent damage to the components or injury to yourself.
Note: Additional information given to differentiate between various models
or provides information for correct system setup.
Naming Convention for Standard Network Adaptors
Networking Adapter List

v
Preface

vi
Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Asia-Pacic
Address: Super Micro Computer, Inc.
4F, No. 232-1, Liancheng Rd.
Chung-Ho Dist., New Taipei City 235
Taiwan, R.O.C.
Tel: [phone]
Fax: [phone]
Website: www.supermicro.com.tw
Email: [email protected] (Technical Support)
Tel: [phone] (Technical Support)
Super AOC-AH25G-m2S2TM Add-on Card User's Guide

Table of Contents
Preface
Chapter 1 Overview
1-1 Overview ......................................................................................................... 1-1
1-2 Key Features................................................................................................... 1-1
1-3 Specications .................................................................................................. 1-2
1-4 Available SKUs ............................................................................................... 1-6
Chapter 2 Hardware Components
2-1 Add-On Card Image and Layout..................................................................... 2-1
2-2 Major Components.......................................................................................... 2-3
2-3 SFP28 & RJ45 Ethernet Connections ............................................................ 2-4
2-4 Jumper Settings .............................................................................................. 2-5
Chapter 3 Installation
3-1 Static-Sensitive Devices.................................................................................. 3-1
3-2 Before Installation ........................................................................................... 3-2
3-3 Installing the Add-on Card AOC-AH25G-m2S2TM (with 0.5U bracket) ......... 3-3
3-4 Installing Drivers on Windows (for Intel®X550).............................................. 3-6
3-5 Installing Drivers on Linux (for Intel®X550).................................................... 3-7
3-6 Installing Drivers on FreeBSD (for Intel®X550).............................................. 3-8
3-7 Installing Drivers (for Mellanox®ConnectX®-4 Lx EN)...................................3-11
vii
Preface

Chapter 1: Overview
1-1
Chapter 1
Overview
1-1 Overview
Congratulations on purchasing your add-on card from an acknowledged leader in
the industry. Supermicro products are designed with the utmost attention to detail
to provide you with the highest standards in quality and performance. For product
support and updates, please refer to our website at http://www.supermicro.com/
products/nfo/networking.cfm#adapter.
1-2 Key Features
• Advance I/O Module (AIOM) form factor
• Mellanox®ConnectX-4 Lx EN 25GbE controller, dual SFP28 (Small Form Factor
Pluggable) connectors
• Intel®X550-AT2 10GbE controller, dual RJ45 connectors
• Hardware ofoads for NVGRE, VXLAN, and GENEVE encapsulated trafc
• SR-IOV for virtualization
• Low latency RDMA over Converged Ethernet (RoCE) (25GbE controller only)
• Jumbo frames support
• NC-SI for Remote Management (10GbE controller only)
• BMC Thermal reading support
• RoHS compliant 6/6

1-2
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
1-3 Specications
General
• Advanced I/O Module (AIOM) form factor
• Mellanox®ConnectX-4 Lx EN 25GbE controller
• Dual SFP28 connectors with speed up to 25Gbps per port
• Intel®X550-AT2 10GbE 10GBase-T controller
• Dual RJ45 connectors with speed up to 10Gbps per port
Cables Support
• 25GbE SFP28: Direct-attached copper cables and ber-optic cables (with re-
quired optional transceivers)
• 10GbE RJ45: RJ-45 Category-6 up to 55m; Category-6A up to 100m
Power Consumption
• Maximum power consumption: 25W
Operating Condition
• Storage condition: -40°C to 70°C (-40°F to 158°F)
• Storage humidity: 90% non-condensing relative humidity at 35°C
Physical Dimensions
• Card PCB dimensions: 115mm (4.528in) x 76mm (2.992in) (WxD)
Note: Please note that this product is sold only as part of an integrated
solution with Supermicro server systems.

Chapter 1: Overview
1-3
25GbE SFP28 Specications
Networking Features
• 25GbE/10GbE/1GbE
• IEEE 802.3ad, 802.1AX Link Aggregation
• IEEE 802.1Q, 802.1P VLAN tags and priority
• IEEE 1588v2
• Jumbo frame support (9.6KB)
Enhanced Features
• Hardware-based reliable transport
• Collective operations ofoads
• Vector collective operations ofoads
• 64/66 encoding
• Dynamically Connected Transport (DCT)
• Enhanced atomic operations
• Support for MSI/MSI-X mechanisms
Storage Ofoads
• RAID ofoad – erasure coding (Reed-Solomon) ofoad
Overlay Networks
• Stateless ofoads for overlay networks and tunneling protocols
• Hardware ofoad of encapsulation of NVGRE and VXLAN overlay networks

1-4
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
Hardware-based I/O Virtualization
• Single Root IOV
• Multi-function per port
• Multiple queues per virtual machine
• VMware NetQueue support
Virtualization
• SR-IOV: Up to 256 Virtual Functions
• SR-IOV: Up to 16 Physical Functions per port
CPU Ofoads
• RDMA over Converged Ethernet (RoCE)
• TCP/UDP/IP stateless ofoad
• LSO, LRO, checksum ofoad
• RSS (can be done on encapsulated packet), TSS, HDS, VLAN insertion/strip-
ping, receive ow steering
• Intelligent interrupt coalescence
Management Features
• Remote boot over iSCSI
• PXE and UEFI
OS Support
• RHEL/CentOS
• Windows
• FreeBSD

Chapter 1: Overview
1-5
• VMware
10GbE RJ45 Specications
I/O Features
• MXI-X Support
• Intel®Flow Director
• Low latency
• Multiple Queues – 64 Tx and Rx per port
• Tx/Rx IP, SCTP, TCP, and UDP Checksum Ofoading (IPv4, IPv6) capabilities
• Tx TCP Segmentation Ofoad (IPv4, IPv6)
Network Features
• Jumbo frames up to 15.5KB
• IEEE 802.3az Energy Efcient Ethernet (EEE)
Virtualization Features
• Multi-mode I/O Virtualization Operations
• VXLAN Stateless Ofoads
• NVGRE Stateless Ofoads
• Virtual Machine Device Queues (VMDq)
• 64 Transmit (Tx) and Receive (Rx) Queue Pairs per port
• FPP – 64 VFs per port
• Support for PCI-SIG SR-IOV Specication
• IEEE 802.1Q VLAN Support

1-6
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
SKUs Bracket Included Description
AOC-AH25G-m2S2TM BKT-0176L 2-port 25 Gigabit and 2-port 10
Gigabit Ethernet Adapter with a 0.5
height bracket
Management Features
• Preboot eXecution Environment (PXE) support
• iSCSI Remote Boot Support and FCoE
• NC-SI for remote management
OS Support
• Linux RHEL, Linux SLES
• Windows
• FreeBSD
• VMware
1-4 Available SKUs

Chapter 2: Hardware Components
2-1
Chapter 2
Hardware Components
2-1 Add-On Card Image and Layout
AOC-AH25G-m2S2TM Image

2-2
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
AOC-AH25G-m2S2TM Layout
LAN3
LAN4
LAN1LAN2
JLAN1
JPAUX1
REV:1.01
AOC-AH25G-m2S2T
DESIGNED IN USA
3
2
4
5
6
1
7

Chapter 2: Hardware Components
2-3
2-2 Major Components
The following major components are installed on the AOC-AH25G-m2S2TM:
AOC-AH25G-m2S2TM Major Components
No Component Name Denition
1Intel®X550-AT2 Ethernet LAN controllers
2Mellanox®
ConnectX®-4 Lx EN
Network connector
3LAN1 RJ45 Port1
4LAN2 RJ45 Port2
5LAN3 SFP28 Port1
6LAN4 SFP28 Port2
7JPAUX1 1-3 and 2-4: Enable AUX Power in S5
3-5 and 4-6: Disable AUX Power in S5

2-4
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
2-3 SFP28 & RJ45 Ethernet Connections
1. RJ45 LAN Port1
2. RJ45 LAN Port2
3. SFP28 Port1
4. SFP28 Port2
SFP28 & RJ45 Ethernet Connectors
There are a total of four ports located on AOC-AH25G-m2S2TM. Two of the ports
are SFP28 (LAN3/ LAN4), which provide network speed up to 25GbE. The other
two ports (LAN1/ LAN2) are based on RJ45 connection type and support the
speed up to 10GbE. See the layout below for the locations.
Link/Activity LED Indicators
10G LAN has one bi-colored LED per port (RJ45 – Link/Activity) and 25G LAN
has two bi-colored LED per port (SFP28 – Link and Activity) at the bottom of PCB.
Please refer to the table below for LED color denition.
LAN3
LAN4
LAN1LAN2
JLAN1
JPAUX1
REV:1.01
AOC-AH25G-m2S2T
DESIGNED IN USA
1
2
3
4
LAN Port Activity LED Indicators Assignment/State
RJ45 Ports LAN Port Speed (L) and Activity (A)
10G LAN 1
10G LAN2
10Gbps Green and Blink
1Gbps Amber and Blink
100Mbps Off
SFP28 Ports LAN Port Speed Link (L) Activity (A)
25G LAN 3
25G LAN 4
25 Gbps Green Blink
10 Gbps Amber Blink
100Mbps Off Off

Chapter 2: Hardware Components
2-5
2-4 Jumper Settings
Explanation of Jumpers
To modify the operation of the motherboard, jumpers can be used to choose between
optional settings. Jumpers create shorts between two pins to change the function
of the connector. Pin 1 is identied with a square solder pad on the printed circuit
board. See the motherboard layout pages for jumper locations.
JPAUX1 for
Standby Power
IPMI Support FailOver Support WoL Support
Disable = No
standby power to
AOC NIC
Yes Yes No
Enable = Standby
power to AOC NIC
Yes Yes Yes
JPAUX1 for
Standby
Power
Function Notes
Disable = No
standby power
to AOC NIC
Disable jumper
to disconnect the
standby power
Default
Enable =
Standby power
to AOC NIC
Enable jumper to
connect standby
power to AOC NIC
WoL is supported but limited to plat-
forms with sufcient airow when it is
in standby mode (S5 state). Please
consult Supermicro before enabling it.

3-1
Chapter 3: Installation
Chapter 3
Installation
3-1 Static-Sensitive Devices
Electrostatic Discharge (ESD) can damage electronic components. To avoid dam-
aging your add-on card, it is important to handle it very carefully. The following
measures are generally sufcient to protect your equipment from ESD.
Precautions
• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing the add-on card from the
antistatic bag.
• Handle the add-on card by its edges only; do not touch its components.
• Put the add-on card back into the antistatic bags when not in use.
• For grounding purposes, make sure that your system chassis provides excellent
conductivity between the power supply, the case, the mounting fasteners and
the add-on card.
Unpacking
The add-on card is shipped in antistatic packaging to avoid static damage. When
unpacking your component or system, make sure you are static protected.
Note: To avoid damaging your components and to ensure proper instal-
lation, always connect the power cord last, and always unplug it before
adding, removing, or changing any hardware components.

3-2
Super AOC-AH25G-m2S2TM Add-on Card User's Guide
3-2 Before Installation
Before you install the add-on card, follow the instructions below.
1. Power down the system.
2. Unplug the power cord.
3. Use industry-standard anti-static equipment such as gloves or a wrist strap
and follow the precautions on page 3-1 to avoid damage caused by ESD.
4. Familiarize yourself with the server, motherboard, and/or chassis documenta-
tion.
5. Conrm that your operating system includes the latest updates and hotxes.
Note: This add-on card does not support hot plug. Please turn off the AC
power and remove the power cord from the wall socket before you install
or remove the add-on card.