Supermicro AOM-C25G-i2SM-12 User manual

User's Guide
Revision 1.0
AOM-C25G-i2SM-12

User's Guide Revision 1.0
Release Date: April 26, 2022
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2022 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America
The information in this user's guide has been carefully reviewed and is believed to be accurate. The
vendor assumes no responsibility for any inaccuracies that may be contained in this document, and
makes no commitment to update or to keep current the information in this user's guide, or to notify
any person or organization of the updates. Please Note: For the most up-to-date version of this
user's guide, please see our Website at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in an industrial environment.
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and
used in accordance with the manufacturer’s instruction manual, may cause harmful interference with
radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”.
WARNING: This product can expose you to chemicals including
lead, known to the State of California to cause cancer and birth
defects or other reproduc�veharm. Formore informa�on, go
to www.P65Warnings.ca.gov.
!

Preface
About this User's Guide
This user's guide is written for system integrators, IT technicians, and
knowledgeable end users. It provides information for the installation and use of the
AOM-C25G-i2SM-12 package.
About this Adapter
The AOM-C25G-i2SM-12 25 Gigabit Ethernet Adapter is one of the most compact
and scalable 25GbE Ethernet adapters for today’s demanding data center environ-
ments. Based on the latest Intel®network controller E810-XXVAM2 and with NC-SI
built-in, this adapter addresses the demanding needs of the next-generation data
center by providing the connection for both data and remote management to simplify
cabling needs. It is designed in a proprietary and small MicroLP form factor to t
Supermicro MicroCloud 12-node systems.
An Important Note to the User
All images and layouts shown in this user's guide are based upon the latest PCB
Revision available at the time of publishing. The adapter you have received may or
may not look exactly the same as the graphics shown in this user's guide.
Returning Merchandise for Service
A receipt or copy of your invoice marked with the date of purchase is required before
any warranty service will be rendered. You can obtain service by calling your ven-
dor for a Returned Merchandise Authorization (RMA) number. When returning the
motherboard to the manufacturer, the RMA number should be prominently displayed
on the outside of the shipping carton, and the shipping package is mailed prepaid
or hand-carried. Shipping and handling charges will be applied for all orders that
must be mailed when service is complete. For faster service, you can also request
a RMA authorization online (http://www.supermicro.com/RmaForm/).
This warranty only covers normal consumer use and does not cover damages in-
curred in shipping or from failure due to the alternation, misuse, abuse or improper
maintenance of products.
During the warranty period, contact your distributor rst for any product problems.
Preface
iii

iv
Super AOM-C25G-i2SM-12 Adapter User's Guide
Conventions Used in the User's Guide
Pay special attention to the following symbols for proper system installation and to
prevent damage to the system or injury to yourself:
Warning: Important information given to ensure proper system installation
or to prevent damage to the components or injury to yourself.
Note: Additional information given to di󰀨erentiate between various models
or provides information for correct system setup.
Naming Convention

Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Asia-Pacic
Address: Super Micro Computer, Inc.
4F, No. 232-1, Liancheng Rd.
Chung-Ho Dist., New Taipei City 235
Taiwan, R.O.C.
Tel: [phone]
Fax: [phone]
Website: www.supermicro.com.tw
Email: [email protected] (Technical Support)
Tel: [phone] (Technical Support)
vi
Preface

Table of Contents
Preface
Chapter 1 Overview
1-1 Overview ......................................................................................................... 1-1
1-2 Key Features................................................................................................... 1-1
1-3 Specications .................................................................................................. 1-1
1-4 Parts List ......................................................................................................... 1-5
Chapter 2 Hardware Components
2-1 Adapter Image and Layout ............................................................................. 2-1
2-2 Major Components.......................................................................................... 2-2
2-3 Connectors ...................................................................................................... 2-3
Chapter 3 Installation
3-1 Static-Sensitive Devices.................................................................................. 3-1
3-2 Before Installation ........................................................................................... 3-2
3-3 Installing the Adapter ...................................................................................... 3-2
3-4 Installing Drivers (for Intel®E810-XXVAM2) .................................................... 3-3
v
Super AOM-C25G-i2SM-12 Adapter User's Guide

Chapter 1: Overview
1-1
Chapter 1
Overview
1-1 Overview
Congratulations on purchasing your adapter from an acknowledged leader in the
industry. Supermicro products are designed with the utmost attention to detail to
provide you with the highest standards in quality and performance. For product
support and updates, please refer to our website at http://www.supermicro.com/
products/nfo/networking.cfm#adapter.
1-2 Key Features
The key features of this adapter include the following:
• Dual 25GbE SFP28 connectors
• MicroLP form factor
• PCIe 4.0 x8, backward compatible with PCIe 3.0 x8
• Intel®E810-XXVAM2 ethernet controller
• NC-SI for remote management
• RoHS compliant 6/6
1-3 Specications
General
• Intel®E810-XXVAM2 ethernet controller
• MicroLP form factor
• Dual SFP28 ports
• PCIe 4.0

1-2
Super AOM-C25G-i2SM-12 Adapter User's Guide
• Application Device Queues (ADQ)
• Dynamic Device Personalization (DDP)
Host Interface
• PCIe v4.0
• Backward compatible with PCIe v3.0
• Message Signal Interrupt (MSI-X)
Networking Features
• Jumbo Packet (9K max)
• Teaming
• Virtual LANs 802.1q VLAN tagging
StatelessO󰀪oadFeatures
• TCP, UDP, IPv4, IPv6 checksum o󰀪oad
• Large Send O󰀪oad (LSO)
• Receive Segment Coalescing (RSC)
• TCP segmentation O󰀪oad (TSO)
• UDP Segment O󰀪oad (USO)
• Large Segment O󰀪oad (LSO)
• Receive Side Scaling (RSS)
Virtualization Features
• VXLAN
• NVGRE

Chapter 1: Overview
1-3
• Geneve
• SR-IOV
• 768 Virtual Station Interface (VSI)
• Eight Physical Functions (PF)
• Microsoft VM queue
• VMWare NetQueue
• DPDK support
• QoS: Priority-based ow control (802.1Qbb)
• Enhanced Transmission Selection (ETS) (802.1Qaz)
Manageability
• Network Controller Sideband Interface (NC-SI)
• Asset management with thermal sensors
RDMA over Converged Ethernet (iWARP and RoCE)
• iWARP
• RoCEv2
• Data Center Bridging
Remote Boot
• UEFI PXE Boot
Data Center Bridging
• Enhanced transmission – IEEE 802.1Qaz
• Priority-based ow control – IEEE 802.1Qbbb

1-4
Super AOM-C25G-i2SM-12 Adapter User's Guide
• Edge Virtual Bridging - IEEE 802.Qbg
Power Saving
• ACPI-compliant power management
• Pass through Energy E󰀩cient Ethernet (IEEE802.3az-2010)
Cables Support
• SFP28 Direct Attach Copper (DAC) cables
• Fiber-optic cables (with required optional SFP28 transceivers)
Power Consumption
• Maximum power consumption: 10.5W
Operating Conditions
• Storage temperature: -40°C to 70°C (-40°F to 158°F)
• Storage humidity: 90% non-condensing relative humidity at 35°C
Physical Dimensions
• Card PCB dimensions: 113mm (4.463in) x 49mm (1.929in)
Supported Platforms
• MicroCloud 12-node systems
• SYS-530MT-H12TRF (X12STE-F)
• SYS-5039MC-H12TRF (X11SCE-F)
• SYS-5039MS-H12TRF (X11SSE-F)

Chapter 1: Overview
1-5
Adapter Part Number Description
Adapter AOM-C25G-i2SM MicroLP 2-Port 25GbE SFP28 adapter
Riser Card AOM-RSC-E8R MicroLP Riser Card for MicroCloud 12 node
Bracket MCP-240-93913-0N MicroLP bracket for MicroCloud 12 node
1-4 Parts List

Chapter 2: Hardware Components
2-1
Chapter 2
Hardware Components
2-1 Adapter Image and Layout
AOM-C25G-i2SM-12 Image

2-2
Super AOM-C25G-i2SM-12 Adapter User's Guide
SFP2
JSFP1
SFP1
JPAUX1
Intel®
E810-XXVAM2
Controller
REV:1.01
AOM-C25G-i2SM
DESIGNED IN USA
AOM-C25G-i2SM-12 Layout
3
1
2
4
2-2 Major Components
The following major components are installed on the AOM-C25G-i2SM-12.
AOM-C25G-i2SM-12 Major Components
No Component Name Denition
1Intel®E810-XXVAM2 Ethernet 25GbE LAN controller
2JPAUX1 1-2: Enable AUX Power
3-4: Disable AUX Power (default)
3JSFP1 SFP28 Port 1
4JSFP2 SFP28 Port 2

Chapter 2: Hardware Components
2-3
2-3 Connectors
SFP28 Ports
Two SFP28 25GbE adapter ports are located on the adapter. Connect a Direct
Attach Copper cable or an LC Fiber-Optic cable to these ports to provide Gigabit
Ethernet communication. Refer to the adapter layout on Page 2-2 for the locations
of the SFP28 ports.
Port 2 LED
SFP28 Port LEDs
LED Color Denition
Activity Blinking Green 25GbE Activity
Link Solid Green 25GbE Link Speed
Solid Yellow 10GbE Link Speed
Port 1 LED
Port 1 Port 2
Port 1 Port 2
SFP28 Port LEDs
There are four LEDs located below the dual SFP28 ports to indicate link speed
and activity of each port. The LED marked with "L" represents the link speed LED,
while the LED marked with "A" represents the activity LED. A 25GbE connection
is indicated by a solid or blinking green LED. A 10GbE connection is indicated by
a solid or blinking yellow LED. See the table below for more information.

3-1
Chapter 3: Installation
Chapter 3
Installation
3-1 Static-Sensitive Devices
Electrostatic Discharge (ESD) can damage electronic components. To avoid damag-
ing your adapter, it is important to handle it very carefully. The following measures
are generally su󰀩cient to protect your equipment from ESD.
Precautions
• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing the adapter from the antistatic
bag.
• Handle the adapter by its edges only; do not touch its components, or periph-
eral chips.
• Put the adapter back into the antistatic bags when not in use.
• For grounding purposes, make sure that your system chassis provides excel-
lent conductivity between the power supply, the case, the mounting fasteners
and the adapter.
Unpacking
The adapter is shipped in antistatic packaging to avoid static damage. When un-
packing your component or your system, make sure that you are static protected.
Note: To avoid damaging your components and to ensure proper installa-
tion, be sure to always connect the power cord last, and always remove it
before adding, removing or changing any hardware components.

3-2
Super AOM-C25G-i2SM-12 Adapter User's Guide
3-2 Before Installation
To install the adapter properly, be sure to follow the instructions below.
1. Power down the system.
2. Remove the power cord from the wall socket.
3. Use industry-standard anti-static equipment (such as gloves or wrist strap)
and follow the instructions listed on Page 3-1 to avoid damage caused by
ESD.
4. Familiarize yourself with the server, motherboard, and/or chassis documenta-
tion.
5. Conrm that your operating system includes the latest updates and hotxes.
3-3 Installing the Adapter
Follow the steps below to install the adapter into your system.
1. Remove the server cover and, if necessary, set aside any screws for later
use.
2. Remove the adapter slot cover. If the case requires a screw, place the screw
aside for later use.
3. Position the adapter in the slot directly over the connector, and gently push
down on both sides of the card until it slides into the PCI connector.
4. Secure the adapter to the chassis. If required, use the screw that you previ-
ously removed.
5. Attach any necessary external cables to the adapter.
6. Replace the chassis cover.
7. Plug the power cord into the wall socket, and power up the system.

3-3
Chapter 3: Installation
Building Driver RPM Package
Please follow the steps below to build a binary RPM package for this driver.
Note: RPM functionality has only been tested in Red Hat distributions.
1. Run the following command, where <x.x.x> is the version number for the
driver tar le.
# rpmbuild -tb ice-<x.x.x>.tar.gz
3-4 Installing Drivers (for Intel®E810-XXVAM2)
To install both drivers and rmware for the AOC-C25G-i2SM-12 adapter card for
either Linux or Windows, please follow the instructions below.

3-4
Super AOM-C25G-i2SM-12 Adapter User's Guide
Note: For the build to work properly, the kernel currently running MUST
match the version and conguration of the installed kernel sources. If you
have just recompiled the kernel, reboot the system before building.
2. After building the RPM, the last few lines of the tool output contain the loca-
tion of the RPM le that was built. Install the RPM with one of the following
commands where <RPM> is the location of the RPM le:
# rpm -Uvh <RPM>
or
# dnf/yum localinstall <RPM>
Note 1: To compile the driver on some kernel/arch combinations, you
may need to install a package with the development version of libelf (e.g.
libelf-dev, libelf-devel, elfutils-libelf-devel).
Note 2: When compiling an out-of-tree driver, users will nd that details
may vary by distribution. However, you will usually need a kernel-devel
RPM or some RPM that provides the kernel headers at a minimum. The
RPM kernel-devel will usually ll in the link at /lib/modules/'uname -r'/build.
Manually Building Driver
Please follow the steps below to manually build the driver.
1. Move the base driver tar le to the directory of your choice. For example, use
'/home/username/ice' or '/usr/local/src/ice'.
2. Untar/unzip the archive where <x.x.x> is the version number for the driver tar
le:
# tar zxf ice-<x.x.x>.tar.gz
3. Change to the driver src directory where <x.x.x> is the version number for the
driver tar:
# cd ice-<x.x.x>/src

3-5
Chapter 3: Installation
4. Compile the driver module:
# make install
The binary will be installed as:
/lib/modules/<KERNEL VER>/updates/drivers/net/ethernet/
intelice/ice.ko
The installation location listed above is the default location. This may di󰀨er for
various Linux distributions.
Note: To compile the driver with ADQ (Application Device Queues) ags
set, use the following command where <nproc> is the number of logical
cores:
# make -j<nproc> CFLAGS_EXTRA='-DADQ_PERF -DADQ_PERF_COUN-
TERS' install
This will also apply the above 'make install' command.
5. Load the module using the modprobe command. To check the version of the
driver and then load it, enter the following commands:
# modinfo ice
# modprobe ice
Alternately, make sure that any older ice drivers are removed from the kernel before
loading the new module:
# rmmod ice; modprobe ice
Note: To enable verbose debug messages in the kernel log, use the
dynamic debug feature (dyndbg). See "Dynamic Debug" later in this
README for more information.
6. Assign an IP address to the interface by entering the following where <ethX>
is the interface name that was shown in dmesg after modprobe:
# ip address add <IP_address>/<netmask bits> dev <ethX>

3-6
Super AOM-C25G-i2SM-12 Adapter User's Guide
7. After verifying that the interface works, enter the following commands where
the IP_address is for another machine on the same subnet. Do so when the
interface is being tested:
# ping <IP_address>