Supermicro AOC-A100G-m2CG User manual

User's Guide
Revision 1.0b
AOC-A100G-m2CM
AOC-A100G-m2CG

User's Guide Revision 1.0a
Release Date: December 5, 2022
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2022 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America
The information in this user's guide has been carefully reviewed and is believed to be accurate. The
manufacturer assumes no responsibility for any inaccuracies that may be contained in this document,
and makes no commitment to update or to keep current the information in this user's guide, or to
notify any person or organization of the updates. Please Note: For the most up-to-date version
of this user's guide, please see our Website at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in an industrial environment.
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and
used in accordance with the manufacturer’s instruction manual, may cause harmful interference with
radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”.
WARNING: This product can expose you to chemicals including
lead, known to the State of California to cause cancer and birth
defects or other reproduc�veharm. Formore informa�on, go
to www.P65Warnings.ca.gov.
!

Preface
About this User's Guide
This user's guide is written for system integrators, IT professionals, and
knowledgeable end users. It provides information for the installation and use of the
AOC-A100G-m2CM/G add-on card.
About this Add-on Card
Supermicro®Advanced I/O Modules (AIOM) are the latest form factor designed
to provide a wide range of networking options to support the most advanced I/O
technologies. The AOC-A100G-m2CM/G is one of the most feature-rich and low-
power consumption 100GbE controllers in the market. Based on the Mellanox
ConnectX-6 Dx controller with features such as VXLAN, NVGRE, and RDMA, it
provides unparalleled density, performance, and functionality. The Supermicro®
AOC-A100G-m2CM/G is the industry’s most secure and advanced cloud network
interface card to accelerate mission-critical datacenter applications, such as security,
virtualization, SDN/NFV, big data, machine learning, and storage.
An Important Note to the User
All graphic images and layout drawings shown in this user's guide are based upon
the latest PCB revision available at the time of publishing of this user's guide. The
add-on card you have received may or may not look exactly the same as the graph-
ics shown in this user's guide.
Returning Merchandise for Service
A receipt or copy of your invoice marked with the date of purchase is required be-
fore any warranty service will be rendered. You can obtain service by calling your
vendor for a Returned Merchandise Authorization (RMA) number. When returning to
the manufacturer, the RMA number should be prominently displayed on the outside
of the shipping carton and mailed prepaid or hand-carried. Shipping and handling
charges will be applied for all orders that must be mailed when service is complete.
For faster service, RMA authorizations may be requested online (http://www.super-
micro.com/support/rma/).
This warranty only covers normal consumer use and does not cover damages in-
curred in shipping or from failure due to the alteration, misuse, abuse or improper
maintenance of products.
During the warranty period, contact your distributor rst for any product problems.
Preface
iii

iv
Super AOC-A100G-m2CM/G Add-On Card User's Guide
Important Links
For your system to work properly, please follow the links below to download all
necessary drivers/utilities and the user’s manual for your server.
• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: http://www.supermicro.com/wftp
• Product safety info: http://www.supermicro.com/about/policies/safety_informa-
tion.cfm
• If you have any questions, please contact our support team at: support@
supermicro.com
This manual may be periodically updated without notice. Please check the
Supermicro website for possible updates to the manual revision level.

v
Preface
Conventions Used in the User's Guide
Pay special attention to the following symbols for proper system installation and to
prevent damage to the system or injury to yourself:
Warning: Important information given to ensure proper system installation
or to prevent damage to the components or injury to yourself.
Note: Additional information given to di󰀨erentiate between various models
or provides information for correct system setup.
Naming Convention for Standard Network Adaptors

Super AOC-A100G-m2CM/G Add-On Card User's Guide
vi
Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Sales Inquiries)
[email protected] (Gov. Sales
Inquiries)
[email protected] (Technical Support)
[email protected] (RMA Support)
[email protected] (Webmaster)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (Sales Inquiries)
Support_Europe@supermicro (Technical Support)
RMA_Europe@supermicro (RMA Support)
Website: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]

vii
Preface
Asia-Pacic
Email: [email protected] (Sales Inquiries)
[email protected] (Technical Support)
[email protected] (RMA Support)
Website: www.supermicro.com.tw

Table of Contents
Preface
Chapter 1 Introduction
1-1 Overview ......................................................................................................... 1-1
1-2 Key Features................................................................................................... 1-1
1-3 Additional Features ......................................................................................... 1-2
1-4 Available SKUs ............................................................................................... 1-4
Chapter 2 Hardware Components
2-1 Add-On Card Image and Layout..................................................................... 2-1
2-2 Major Onboard Components........................................................................... 2-3
2-3 QSFP28 Ethernet Connections....................................................................... 2-4
2-4 Ports and Port LEDs ....................................................................................... 2-5
2-5 Jumper Settings .............................................................................................. 2-6
2-6 PCIe 4.0 AIOM Form Factor Connector ......................................................... 2-7
Chapter 3 Installation
3-1 Static-Sensitive Devices.................................................................................. 3-1
3-2 Before Installation ........................................................................................... 3-2
3-3 Installing the Add-on Card .............................................................................. 3-3
3-4 Installing Drivers (for Mellanox®ConnectX-6 Dx) ........................................... 3-6
Super AOC-A100G-m2CM/G Add-On Card User's Guide
viii

Chapter 1: Overview
1-1
Chapter 1
Introduction
1-1 Overview
Congratulations on purchasing your add-on card from an acknowledged leader in
the industry. Supermicro products are designed with the utmost attention to detail
to provide you with the highest standards in quality and performance.
1-2 Key Features
The key features of this add-on card include the following:
• Advanced I/O Module (AIOM) Form Factor
• Mellanox®ConnectX-6 Dx 100GbE controller
• Dual QSFP28 connectors
• PCIe Gen 4.0
• RDMA over Converged Ethernet (RoCE)
• VXLAN, NVGRE, and Geneve
• Asset Management Features with thermal sensor
• Network Controller Sideband Interface (NC-SI) for remote management

1-2
Super AOC-A100G-m2CM/G Add-On Card User's Guide
1-3 Additional Features
General
• Advanced I/O Module (AIOM) form factor
• Mellanox®ConnectX-6 Dx 100GbE controller
• Dual QSFP28 ports
Storage Accelerations
• NVMe over Fabric o󰀪oads for target
• Storage protocols: iSER, NFSoRDMA
• SMB Direct, NVMe-oF, and more
• T-10 Dif/Signature Handover
RDMA over Converging Ethernet (RoCE)
• RoCE v1/v2
• Zero-Touch RoCE: no ECN, no PFC
• RoCE over overlay networks
• IPsec over RoCE
• Selective repeat
• Programmable congestion control interface
• GPUDirect®
• Dynamically Connected Transport (DCT)
• Burst bu󰀨er o󰀪oad

Chapter 1: Overview
1-3
Management and Control
• NC-SI, MCTP over SMBus, and MCTP over PCIe – Baseboard Management
Controller interface
• PLDM for Monitor and Control DSP0248
• PLDM for Firmware Update DSP026
• I2C interface for device control and conguration
Remote Boot
• Remote boot over Ethernet
• Remote boot over iSCSI
• UEFI support for x86 and Arm servers
• PXE boot
Standards
• IEEE 802.3bs, 200 Gigabit Ethernet
• IEEE 802.3cd, 50, 100 and 200 Gigabit Ethernet
• IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet
• IEEE 802.3by, 25, 50 Gigabit Ethernet supporting all FEC modes
• IEEE 802.3ba 40 Gigabit Ethernet
• IEEE 802.3ae 10 Gigabit Ethernet
• IEEE 802.3az Energy E󰀩cient Ethernet (supports only “FastWake” mode)
• IEEE 802.3ap based autonegotiation and KR startup
• IEEE 802.3ad, 802.1AX Link Aggregation
• IEEE 802.1Q, 802.1P VLAN tags and priority

1-4
Super AOC-A100G-m2CM/G Add-On Card User's Guide
Note: This product is sold only as part of an integrated solution with
Supermicro server systems.
• IEEE 802.1Qaz (ETS)
• IEEE 802.1Qbb (PFC)
• IEEE 802.1Qbg
• 25/50 Ethernet Consortium “Low Latency FEC” for50GE/100GE/200GE PAM4
links
• PCI Express Gen 3.0 and 4.0
Power Consumption
• Maximum 23.7W
Operating Conditions
• Storage temperature: -40°C to 70°C (-40°F to 158°F)
• Storage humidity: 90% non-condensing relative humidity at 35°C
Physical Dimensions
• Card PCB dimensions: 76mm x 115mm (W x D)
1-4 Available SKUs
• This List is for Reference only
Product Part
Number
Bracket
Included
Description
AOC-A100G-m2CM BKT-0170L 2-port 100 Gigabit Ethernet Adapter with
a 0.5U height bracket.
AOC-A100G-m2CG BKT-0205L 2-port 100 Gigabit Ethernet Adapter with
a 0.5U height narrow bracket for Grand
Twin FIO systems.

Chapter 2: Hardware Components
2-1
Chapter 2
Hardware Components
2-1 Add-On Card Image and Layout
AOC-A100G-m2CM Image
AOC-A100G-m2CG Image

2-2
Super AOC-A100G-m2CM/G Add-On Card User's Guide
1
5
1
41
3
1
2
1
1
1
61
7
1
8
1
9
REV:1.00
AOC-A100G-m2CM
DESIGNED IN USA
PRESS FIT
PRESS FIT
C
J1 J1A1
J2 J1A2
JPAUX1
JP1
J3
MH2
MH1
LED2 LED4 LED1 LED3
GF1
AOC-A100G-m2CM/G Layout

Chapter 2: Hardware Components
2-3
2-2 Major Onboard Components
AOC-A100G-m2CM/G Major Components
No Component Name Denition
1Mellanox ConnectX-6 Dx 100GbE controller
2JPAUX1 1-2: Enable AUX Power
2-3: Disable AUX Power
3J1/J1A1 Quad Small Form-Factor Pluggable 28
Port 1
4J2/J1A2 Quad Small Form-Factor Pluggable 28
Port 2
5LED1 QSFP28 Port 1 Link LED
6LED2 QSFP28 Port 2 Link LED
7LED3 QSFP28 Port 1 Active LED
8LED4 QSFP28 Port 2 Active LED
9GF1 PCIe 4.0 AIOM form factor

2-4
Super AOC-A100G-m2CM/G Add-On Card User's Guide
1
1
REV:1.00
AOC-A100G-m2CM
DESIGNED IN USA
PRESS FIT
PRESS FIT
C
J1 J1A1
J2 J1A2
JPAUX1
JP1
J3
MH2
MH1
LED2 LED4 LED1 LED3
GF1
1
2
2-3 QSFP28 Ethernet Connections
Two Quad-Small-Form-Factor-Pluggable 28 (QSFP28) connectors are located on
the add-on card. The QSFP28 ports operate at up to 100GbE. Plug the Direct At-
tached Copper (DAC) cable into the QSFP28 ports for network connections. See
the layout below for the location.
1. QSFP28 Port 1
2. QSFP28 Port 2

Chapter 2: Hardware Components
2-5
2-4 Ports and Port LEDs
QSFP28 Ports
Two QSFP28 adapter ports are located on the AIOM Form factor card. Connect a
Direct Attach Copper cable or an LC Fiber-Optic cable to the ports to provide 100
Gigabit Ethernet communication. Refer to the AIOM Form factor card layout on page
2-2 for the location of the QSFP28 port.
QSFP28 Port LEDs
There are two LEDs per port located on the card to indicate the link speed and
activity status of each port. See the table below for more information.
QSFP28 Port LEDs
LED Color Denition
Activity Blinking Green Activity
Link Amber < 100 Gbps Link Speed
Green 100 Gbps Link Speed

2-6
Super AOC-A100G-m2CM/G Add-On Card User's Guide
2-5 Jumper Settings
Explanation of Jumpers
To modify the operation of the add-on card,
jumpers can be used to choose between
optional settings. Jumpers create shorts
between two pins to change the function
of the connector. Pin 1 is identied with a
square solder pad on the printed circuit
board. See the motherboard layout pages
for jumper locations.
Note: JPAUX1 is for production
use only.
Connector
Pins
Jumper
Cap
Setting
Pin 1-2 (Short)
1 2 3
1 2 3
JPAUX1 for
Standby Power
IPMI Support FailOver Support WoL Support
Disable = No
standby power to
AOC NIC
Yes Yes No
Enable = Standby
power to AOC NIC
Yes Yes Yes
JPAUX1 for
Standby
Power
Function Notes
Disable = No
standby power
to AOC NIC
Disable jumper
to disconnect the
standby power
Default
Enable =
Standby power
to AOC NIC
Enable jumper to
connect standby
power to AOC NIC
WoL is supported but limited to plat-
forms with su󰀩cient airow when it is
in standby mode (S5 state). Please
consult Supermicro before enabling it.

Chapter 2: Hardware Components
2-7
1
1
REV:1.00
AOC-A100G-m2CM
DESIGNED IN USA
PRESS FIT
PRESS FIT
C
J1 J1A1
J2 J1A2
JPAUX1
JP1
J3
MH2
MH1
LED2 LED4 LED1 LED3
GF1
2-6 PCIe 4.0 AIOM Form Factor Connector
Insert the PCI-E 4.0 AIOM form factor connector into a PCIe 4.0 AIOM form factor
slot on a motherboard to use this AIOM Form factor card. See the layout below
for the location.
1. PCIe 4.0 AIOM Form factor
connector

3-1
Chapter 3: Installation
Chapter 3
Installation
3-1 Static-Sensitive Devices
Electrostatic Discharge (ESD) can damage electronic components. To avoid dam-
aging your add-on card, it is important to handle it very carefully. The following
measures are generally su󰀩cient to protect your equipment from ESD.
Precautions
• Use a grounded wrist strap designed to prevent static discharge.
• Touch a grounded metal object before removing the add-on card from the
antistatic bag.
• Handle the add-on card by its edges only; do not touch its components or
peripheral chips.
• Put the add-on card back into the antistatic bags when not in use.
• For grounding purposes, make sure that your system chassis provides excel-
lent conductivity between the power supply, the case, the mounting fasteners,
and the add-on card.