Nvidia BlueField-2 BF2500 User manual

Exported on Oct/31/2023 10:43 AM
NVIDIA BlueField-2 BF2500 InfiniBand/Ethernet DPU Controller
User Manual

2
Table of Contents
Introduction........................................................................................................................................... 10
System Requirements Overview ..............................................................................................................................10
Package Contents ...............................................................................................................................................10
Card Package ................................................................................................................................................ 11
Accessories Kit .............................................................................................................................................. 11
Ideal Solution for JBOF and JBOD Systems..................................................................................................................12
Features and Benefits ..........................................................................................................................................13
Supported Interfaces ................................................................................................................................ 16
Layout and Connector Information...........................................................................................................................16
BF2500 DPU Controller - Component Side .............................................................................................................. 16
BF2500 DPU Controller - Print Side....................................................................................................................... 17
Interfaces Detailed Description...............................................................................................................................19
BlueField-2 Data Processing Unit (DPU) ................................................................................................................. 19
Encryption ............................................................................................................................................... 19
InfiniBand QSFP56 Interface............................................................................................................................... 19
Ethernet QSFP56 Interfaces ............................................................................................................................... 20
QSFP56 Port Over-current Protection................................................................................................................ 20
PCI Express Interfaces...................................................................................................................................... 20
DDR4 Memory................................................................................................................................................ 20

3
GbE OOB Management ..................................................................................................................................... 21
1GbE OOB Management LEDs Interface.............................................................................................................. 21
NC-SI Management Interface .............................................................................................................................. 22
UART Interface Connectivity .......................................................................................................................... 22
Mini USB Type B Connector ................................................................................................................................ 23
External PCIe Power Supply Interfaces .................................................................................................................. 23
eMMC Interface.............................................................................................................................................. 24
Networking LED Interfaces ................................................................................................................................ 24
RTC Battery .................................................................................................................................................. 25
eMMC Interface..................................................................................................................................................26
Pin Description ....................................................................................................................................... 27
PCI Express Interface...........................................................................................................................................27
PCIe x16 Gen 4.0 Edge Connector........................................................................................................................ 27
Side A ..................................................................................................................................................... 27
Side B ..................................................................................................................................................... 33
Power Sequencing....................................................................................................................................... 38
NC-SI Management Interface .............................................................................................................................. 38
External Power Supply Interfaces ........................................................................................................................ 46
External +12V Mechanical Pinout Diagram .......................................................................................................... 47
UART Interface .............................................................................................................................................. 47
Mini USB Interface .......................................................................................................................................... 48

4
Cables and Cabling Configurations ................................................................................................................ 49
RJ45 Cable for the 1GbE OOB Management Interface.....................................................................................................49
USB Interface Cabling ..........................................................................................................................................49
Thermal Sensors...................................................................................................................................... 51
Hardware Installation ............................................................................................................................... 52
Safety Warnings .................................................................................................................................................52
Installation Procedure Overview..............................................................................................................................52
System Requirements ..........................................................................................................................................53
Hardware Requirements ................................................................................................................................... 53
Airflow Requirements ...................................................................................................................................... 53
Software Requirements .................................................................................................................................... 54
Safety Precautions ..............................................................................................................................................54
Pre-Installation Checklist ......................................................................................................................................54
Installation Instructions........................................................................................................................................55
Cables and Modules.............................................................................................................................................55
Networking Cables .......................................................................................................................................... 55
Bring-Up and Driver Installation ................................................................................................................... 57
BlueField Software..............................................................................................................................................57
Software On eMMC..............................................................................................................................................58
Yocto Distribution Installation ............................................................................................................................ 58
PXE Server Configuration on Host Side ......................................................................................................................59

5
Installing Linux on BlueField Controller Card...............................................................................................................59
Software Requirements .................................................................................................................................... 60
Preparing Host-Side Environment .................................................................................................................... 60
Setup Procedure With Installation Script............................................................................................................ 61
Setup Procedure Without Installation Script........................................................................................................ 61
Flashing BlueField Controller Card Bootloader Code .................................................................................................. 65
Opening Terminal Connection to BlueField Controller Card...................................................................................... 66
Using Initial Install Bootstream ....................................................................................................................... 66
Installing CentOS 7.4 on BlueField Controller Card.................................................................................................... 68
Full PXE Boot Installation.............................................................................................................................. 68
Non-PXE Boot Installation ............................................................................................................................. 75
MLNX_OFED Installation........................................................................................................................................75
Installing MLNX_OFED on Arm Cores ..................................................................................................................... 76
Prerequisite Packages for Installing MLNX_OFED................................................................................................... 76
Removing Pre-installed Kernel Module .............................................................................................................. 77
Installing MLNX_OFED on the BlueField Controller Card.......................................................................................... 77
Updating BlueField Controller Card Firmware ..................................................................................................... 79
Troubleshooting ...................................................................................................................................... 81
General Troubleshooting .......................................................................................................................................81
Specifications......................................................................................................................................... 82
MBF2H516B-EE[N/E]OT Specifications .......................................................................................................................82

6
MBF2H515B-HE[N/E]OT Specifications.......................................................................................................................83
BlueField-2 BF2500 Mechanical Drawing and Dimensions.................................................................................................84
Bracket Mechanical Drawing and Dimensions........................................................................................................... 85
Finding the GUID/MAC and Serial Number on the Card ........................................................................................ 86
Document Revision History ......................................................................................................................... 87



7
About This Manual
This User Manual describes NVIDIA® BlueField®-2BF2500 DPU Controller card. It provides details as to the interfaces of the board, specifications, required
software and firmware for operating the card, hardware installation, driver installation and bring-up instructions.
EOL'ed (End of Life) Ordering Part Numbers
NVIDIA SKU Legacy OPN New Description
900-9D205-0056-
ST0
MBF2H516B-
EENOT
NVIDIA® BlueField®-2 P-Series BF2500 DPU Controller, 100GbE/EDR/HDR100 InfiniBand/Ethernet Dual-Port QSFP56, PCIe Gen4 x16, Crypto Disabled, 16GB
on-board DDR, 1GbE OOB management, Tall Bracket, FHHL
900-9D205-0066-
ST0
MBF2H516B-
EEEOT
NVIDIA® BlueField®-2 P-Series BF2500 DPU Controller, 100GbE/EDR/HDR100 InfiniBand/Ethernet Dual-Port QSFP56, PCIe Gen4 x16, Crypto Enabled, 16GB
on-board DDR, 1GbE OOB management, Tall Bracket, FHHL
900-9D205-0058-
ST0
MBF2H515B-
HENOT
NVIDIA® BlueField®-2 P-Series BF2500 DPU Controller, 200GbE/HDR InfiniBand/Ethernet Single-Port QSFP56, PCIe Gen4 x16, Crypto Disabled, 16GB on-
board DDR, 1GbE OOB Management, Tall Bracket, FHHL
900-9D205-0068-
ST0
MBF2H515B-
HEEOT
NVIDIA® BlueField®-2 P-Series BF2500 DPU Controller, 200GbE/HDR InfiniBand/Ethernet Single-Port QSFP56, PCIe Gen4 x16, Crypto Enabled, 16GB on-
board DDR, 1GbE OOB Management, Tall Bracket, FHHL
Overview of Document Content
Section Section Description
Introduction Provides a general overview of the BlueField-2 BF2500 DPU Controller Cards and discusses its benefits and
features.
Supported Interfaces Provides descriptions of all supported interfaces.
Pin Description Provides interfaces’ Pinouts description.
Cables and Cabling Configurations Describes the required cables and cabling configurations.
Thermal Sensors Describes the available thermal sensors on the BlueField-2 IPU
Hardware Installation Describes the procedures for installing and uninstalling the Controller Card.
Bring-Up and Driver Installation Describes driver installation and bring-up instructions

8
•
•
Troubleshooting Describes potential system problems - you can use this troubleshooting information to identify and resolve
the problem.
Specifications Lists the physical, electrical, operational and regulatory specifications of the BlueField-2
Intended Audience
This manual is intended for the installer and user of these cards.The manual assumes basic familiarity with Ethernet network and architecture
specifications.
Technical Support
Customers who purchased NVIDIAproducts directly from NVIDIA are invited to contact usthrough the following methods:
URL:https://www.nvidia.com> Support
E-mail:[email protected]
Related Documentation
Related Documentation
InfiniBand Architecture Specification InfiniBand Trade Association (IBTA) InfiniBand® specification Release 1.3.1, November 2, 2016 and Vol. 2, Release 1.4 ,
and Vol 2 - Release 1.5.
IEEE Std 802.3 Specification IEEE Ethernet specification.
PCI Express Specifications Industry Standard PCI Express Base and Card Electromechanical Specifications.
NVIDIA LinkX Interconnect Solutions The NVIDIA® LinkX® product family of cables and transceivers provide the industry’s broadest portfolio of QDR/FDR10
(40Gb/s), FDR (56Gb/s), EDR/HDR100 (100Gb/s), HDR (200Gb/s) and NDR (400Gb/s) cables, including Direct Attach
Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs) and transceivers in a wide range of lengths
from 0.5m to 10km. In addition to meeting IBTA standards, NVIDIA tests every product in an end-to-end environment
ensuring a Bit Error Rate of less than 1E-15.
BlueField DPU Platform BSP Documentation This guide provides product release notes as well as information on the BSP and how to develop and/or customize
applications, system software, and file system images for the BlueField platform.

9
InfiniBand Architecture Specification InfiniBand Trade Association (IBTA) InfiniBand® specification Release 1.3.1, November 2, 2016 and Vol. 2, Release 1.4 ,
and Vol 2 - Release 1.5.
DOCA SDK Software Documentation NVIDIA DOCA SDK software.
Document Conventions
When discussing memory sizes, MB and MBytes are used in this document to mean size in mega Bytes. The use of Mb or Mbits (small b) indicates size in
mega bits. In this document PCIe is used to mean PCI Express.
Revision History
A list of the changes made to this document are provided inDocument Revision History.

10
•
•
•
•
•
Introduction
This is the User Manual for Technologies BlueField®-2 BF2500 DPU Controller. This document provides details as to the interfaces of the card,
specifications, required software and firmware for operating the board, and a step-by-step plan of how to bring up the BlueField-2 BF2500 DPU Controller.
System Requirements Overview
Motherboard PCI Express 3.0/4.0-compliant motherboard withx16interface
System Power Supply Minimum 75W or greater system power supply through the PCIe x16 interface
P-Series DPU controllers with PCIe Gen 4.0 x16 require additional 75W through a supplementary 6-pin ATX power
supply connector.
NOTE: The power cable is not included in the package. It should be part of system wiring or it can be ordered
separately as a system accessory.
Operating System BlueField-2 DPU Controller can be shipped with Ubuntu – a Linux commercial operating system – which includes the OFED
stack, and is capable of running all customer-based Linux applications seamlessly. The cards also support CentOS and have an
out-of-band 1GbE management interface.For more information, please refer to the BlueField-2 Software User Manual.
Connectivity Interoperable with up to 200Gb/s InfiniBand and Ethernet switches
Passive copper cable with ESD protection
Powered connectors for optical and active cable support
Package Contents
Before installing your new system, unpack it and check against the below tables that all the parts have been sent. Check the parts for visible damage that
may have occurred during shipping.
If anything is damaged or missing, contact your sales representative at [email protected].


11
Card Package
FHHLDPUs
Cards 1x BlueField-2 DPU
Accessories 1x tall bracket (shipped assembled on the card)
Accessories Kit
The accessories kit should be ordered separately. OPN:MBF20-DKIT.
FHHLDPUs
Cables 1x USB 2.0 Type A to Mini USB Type B cable
1x USB 2.0 Type A to 30pin Flat Socket
Product Overview
BlueField-2 BF2500 DPU Controllerfeatures the second generation BlueField-2 I/O Processing Unit (IPU) – aninnovative and high-performance
programmable networking engine. The IPU integrates an array ofeight powerful 64-bit Armv8 A72 cores interconnected by a coherent mesh with a DDR4
memorycontroller and a dual-port Ethernet network controller.Providing unmatched scalability and efficiency, the BF2500 DPU Controlleris the ideal
adapter to accelerate the most demanding workloads in datacenter, cloud, service provider and storage environments.
For FHHL 100Gb/s P-Series DPUs, you need a 6-pin PCIe external power cable to activate the card. The cable is not included in the package. For
further details, please refer toExternal PCIe Power Supply Connector.


12
Ideal Solution for JBOF and JBOD Systems
BlueField-2 I/O Processing Unit (IPU) is a highly integrated and efficient controller, optimized for NVMe storage systems, Network Functions Virtualization
(NFV), Cloud, and Machine Learning workloads. BlueField-2 integrates all the discrete components of a storage system appliance into a single chip,
including Arm core CPUs, PCIe switch, and a network controller, making it the premier solution for building Just-a-Bunch-Of-Flash (JBOF) systems, All-
Flash-Array, and storage appliances for NVMe over Fabrics. With an integrated NVMe-oF offload accelerator, the BF2500 DPU Controller has a superior
performance advantage over existing JBOF systems, significantly reducing storage transaction latency, while increasing IOPs (I/O operations per second).
BlueField-2 DPU Controllers
Part Number MBF2H516B-EEEOT MBF2H516B-EENOT MBF2H515B-HEEOT MBF2H515B-HENOT
Data Rate InfiniBand: SDR/DDR/QDR/FDR/EDR/HDR100
Ethernet:1/10/25/40/50/100 Gb/s
InfiniBand: SDR/DDR/QDR/FDR/EDR/HDR100/HDR
Ethernet:1/10/25/40/50/100/200 Gb/s
Network Connector Type Dual-port QSFP56 Single-port QSFP56
Form Factor PCIe Full Height, Half Length
Dimensions: 168mm x 111mm (6.61in x 4.37in)
Heatsink Height Single Slot
Height: 14.91mm (from PCB surface)
PCIe Support(a) PCIe Gen 3.0 / 4.0 SERDES @ 8.0GT/s / 16.0GT/s PCIe Gen 4.0 SERDES @ 16.0GT/s
On-board DDR4 Memory Single-channel with 8 DDR4 8 bit + ECC (64bit + 8bit ECC)
16GB @ 3200MT/s
Single-channel with 8 DDR4 8 bit + ECC (64bit + 8bit ECC)
16GB @ 3200MT/s
1GbE OOB Management √ √ √ √
Crypto Enabled Disabled Enabled Disabled
The BlueField BF2500 DPU Controller should be installed only in a JBOF and JBOD Systems as it functions as a PCIe root-complex (RC) initiating
PCIe bus operations. Installing it in a regular host system may damage the card.


13
Part Number MBF2H516B-EEEOT MBF2H516B-EENOT MBF2H515B-HEEOT MBF2H515B-HENOT
RoHS RoHS Compliant
BlueField SoC BlueField-2 P-Series 8 cores (high-bin)
a.Note: Refer to BlueField-2 Software and Firmware release notes for the availability of PCIe Gen 4.0 capabilities.
For more detailed information seeSpecifications.
Features and Benefits
This section describes hardware features and capabilities. Please refer to the software release notes for feature availability.
Feature Description
PCI Express
(PCIe)a
PCIe Gen 3.0 (8GT/s) and Gen 4.0 (16GT/s) through an x16 edge connector. Gen 1.1 and 2.0 compatible
200Gb/s DPU
Controller
BlueField-2 offers the highest throughput DPU Controller, supporting HDR 200b/s InfiniBand and 200Gb/s Ethernet and enabling any standard networking, clustering, or
storage to operate seamlessly over any converged network leveraging a consolidated software stack.
InfiniBand
Architecture
Specification
v1.3 compliant
BlueField-2 DPU Controller delivers low latency, high bandwidth, and computing efficiency for performance-driven server and storage clustering applications. BlueField-2
DPU Controller is InfiniBand Architecture Specification v1.3 compliant.
Up to 200
Gigabit Ethernet
DPU Controllers comply with the following IEEE 802.3 standards:
200GbE / 100GbE / 50GbE
- IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet
- IEEE 802.3by, Ethernet Consortium25, 50 Gigabit Ethernet, supporting all FEC modes
It is recommended to upgrade your BlueField product to the latest software and firmware versions available in order to enjoy the latest features
and bug fixes.


14
Feature Description
- IEEE 802.3ba 40 Gigabit Ethernet
- IEEE 802.3by 25 Gigabit Ethernet
- IEEE 802.3ae 10 Gigabit Ethernet
- IEEE 802.3ap based auto-negotiation and KR startup
- IEEE 802.3ad, 802.1AX Link Aggregation
- IEEE 802.1Q, 802.1P VLAN tags and priority
- IEEE 802.1Qau (QCN)
- Congestion Notification
- IEEE 802.1Qaz (ETS)
- IEEE 802.1Qbb (PFC)
- IEEE 802.1Qbg
- IEEE 1588v2
- Jumbo frame support (9.6KB)
On-board
Memory
• DDR4 16GB on-board, 3200Mt/s
• 16GB eMMC NAND flash memory for software
• SPI Flash for NIC firmware
BlueField-2 IPU The BlueField-2 IPU integrates eight 64-bit Armv8 A72 cores interconnected by a coherent mesh network, one DRAM controller, an RDMA intelligent network adapter
supporting up to 200Gb/s, an embedded PCIe switch with endpoint and root complex functionality, and up to 16 lanes of PCIe Gen 3.0/4.0.
Overlay
Networks
In order to better scale their networks, data center operators often create overlay networks that carry traffic from individual virtual machines over logical tunnels in
encapsulated formats such as NVGRE and VXLAN. While this solves network scalability issues, it hides the TCP packet from the hardware offloading engines, placing higher
loads on the host CPU. BlueField BF2500 DPU Controller effectively addresses this by providing advanced NVGRE and VXLAN hardware offloading engines that encapsulate
and de-capsulate the overlay protocol.
RDMA and RDMA
overConverged
Ethernet (RoCE)
BF2500 card, utilizing RDMA (Remote Data Memory Access) and RoCE (RDMA over Converged Ethernet) technology, delivers low-latency and high-performance over Ethernet
networks. Leveraging data center bridging (DCB) capabilities as well as advanced congestion control hardware mechanisms, RoCE provides efficient low-latency RDMA
services over Layer 2 and Layer 3 networks.
PeerDirect® PeerDirect communication provides high-efficiency RDMA access by eliminating unnecessary internal data copies between components on the PCIe bus (for example, from
GPU to CPU), and therefore significantly reduces application run time. BlueField BF2500 DPU Controller advanced acceleration technology enables higher cluster efficiency
and scalability to tens of thousands of nodes.
Quality of
Service (QoS)
Support for port-based Quality of Service enabling various application requirements for latency and SLA.

15
•
•
•
Feature Description
Storage
Acceleration
A consolidated compute and storage network achieves significant cost-performance advantages over multi-fabric networks. Standard block and file access protocols can
leverage RDMA for high-performance storage access.
• NVMe over Fabric offloads for the target machine
• T10-DIF Signature Handover
BlueField-2 SmartNIC may operate as a co-processor offloading specific storage tasks from the host, isolating part of the storage media from the host, or enabling
abstraction of software-defined storage logic
using the BlueField-2 Arm cores. On the storage initiator side, BlueField-2 SmartNIC can prove an efficient solution for hyper-converged systems to enable the host CPU to
focuson computing while all the storage interface is handled through the Arm cores.
NVMe-oF Nonvolatile Memory Express (NVMe) over Fabrics is a protocol for communicating block storage IO requests over RDMA to transfer data between a host computer and a
target solid-state storage device or system over a network. BlueField-2 DPU Controller may operate as a co-processor offloading specific storage tasks from the host using its
powerful NVMe over Fabrics Offload accelerator.
SR-IOV DPU Controller SR-IOV technology provides dedicated adapter resources and guaranteed isolation and protection for virtual machines (VM) within the server.
High-
PerformanceAcc
elerations
Tag Matching and Rendezvous Offloads
Adaptive Routing on Reliable Transport
Burst Buffer Offloads for Background Checkpointing
GPU Direct The latest advancement in GPU-GPU communications is GPUDirect RDMA. This new technology provides a direct P2P (Peer-to-Peer) data path between the GPU Memory
directly to/from the HCA devices. This provides a significant decrease in GPU-GPU communication latency and completely offloads the CPU, removing it from all GPU-GPU
communications across the network. BlueField BF2500 DPU Controller uses high-speed DMA transfers to copy data between P2P devices resulting in more efficient system
applications.
Crypto The BlueField-2 DPU Controller crypto enabled versions include a BlueField-2 IC which supports accelerated cryptographic operations. In addition to specialized instructions
for bulk cryptographic processing in the Arm cores, an offload hardware engine accelerates public-key cryptography and random number generation are enabled.
Security
Accelerators
A consolidated compute and network solution based on BlueField DPU Controller achieves significant advantages over a centralized security server solution. Standard
encryption protocols and security applications can leverage BlueField-2 compute capabilities and network offloads for security application solutions such as:
• Connection Tracking
• Statefull firewall
Out-of-Band
Management
The BlueField-2 DPU Controller incorporates a 1GbE RJ45 out-of-band port that allows the network operator to establish trust boundaries in accessing the management
function to apply it to network resources. It can also be used to ensure management connectivity (including the ability to determine the status of any network component)
independent of the status of other in-band network components.
a. Refer to BlueField Software and Firmware release notes for the availability of PCIe Gen 4.0 capabilities

16
Supported Interfaces
Layout and Connector Information
The BF2500 DPU Controller is aFHHLcard. The component height on the top and bottom of the card complies with the PCIe specification. The below
figures show the connector and LED designations.
The below figures are for illustration purposes only and might not reflect the current revision of the BF2500 card.
BF2500 DPU Controller - Component Side

17
BF2500 DPU Controller - Print Side

18
Callou
t
Interface Description
1BlueField-2 Data Processing Unit (DPU) BlueField-2 DPU with heatsink
2PCIe x16 Gen 3.0/4.0 Edge Connector The interface between the BlueField-2 Controller and the JBOF system.
3
InfiniBand QSFP56 Interfaces The network ports of the ConnectX®-6 adapter cards are compliant with the InfiniBand Architecture Specification, Release 1.3.
InfiniBand traffic is transmitted through the cards' QSFP56 connectors.
Ethernet QSFP56 Interfaces Ethernet traffic is transmitted through the controller’s QSFP56 connectors. The QSFP56 connectors allow for the use of Optical
modules and cable interconnect solutions.
4DDR4 SODIMM Memory Single-channel with 8 DDR4 8 bit + ECC (64bit + 8bit ECC) 16GB @ 3200MT/s
5NC-SI Management Interface Connectivity channel between the BMC CPU and the BlueField-2 Arm Array
6USB Connector USB Type-B Bracket mounted on card
71GbE OOB Management Interface 1GbE BASE-T OOB management interface.
8External PCIe Power Supply Interfaces Along with the PCIe interface, this connector provides power to the board.
9Networking LED Interfaces One bi-color LED per port.
10 RTC Battery Battery for RTC.
11 eMMC Interface 16GbE x8 NAND flash10

19
Interfaces Detailed Description
BlueField-2 Data Processing Unit (DPU)
BlueField-2 is a family of advanced DPU solutions that integrate a coherent mesh of 64-bit Arm v8 A72 cores, a ConnectX network adapter front-end and a
PCI Express switch into a single chip. The powerful DPUarchitecture includes an Armv8 multicore processor array and enables customers to develop
sophisticated applications and highly differentiated feature sets. BlueField-2 leverages the rich Arm software ecosystem and introduces the ability to
offload the host serversoftware stack.
At the heart of BlueField-2 is the ConnectX-6 Dx network offload controller with RDMA and RDMA over Converged Ethernet (RoCE) technology, delivering
cutting-edge performance for networking and storage applications such as NVMe over Fabrics. Advanced features include an embedded virtual switch with
programmable access lists (ACLs), transport offloads and stateless encaps/decaps of NVGRE, VXLAN, and MPLS overlay.
Encryption
BlueField-2 BF2500 DPU Controller addresses the concerns of modern data centers by combining hardware encryption accelerators with embedded
software and fully integrated advanced network capabilities, making it an ideal platform for developing proprietary security applications. It enables a
distributed security architecture by isolating and protecting each individual workload and providing flexible control and visibility at the server and
workload level, controlling risk at the server access layer. BlueField-2 builds security into the DNA of the data center and enables prevention, detection,
and response to potential threats in real-time. BlueField-2 DPU Controller can deliver powerful functionality, including encryption of data-in-motion, and
data-at-rest (AES-XTS) bare-metal provisioning, stateful L4 firewall and more.
InfiniBand QSFP56 Interface
The network ports of the BlueField-2 DPU Controllers are compliant with theInfiniBand Architecture Specification, Release 1.3.InfiniBand traffic is
transmitted through the cards' QSFP56 connectors.
Applies to Crypto enabled OPNs.


20
•
•
•
•
Ethernet QSFP56 Interfaces
The network ports of the BlueField-2 BF2500 DPU Controller are compliant with the IEEE 802.3 Ethernet standards listed in Ethernet traffic is transmitted
through the cards' QSFP56 connectors.
QSFP56 Port Over-current Protection
The power consumption for each QSFP56 module is controlled by a 5W current limiting power distribution switch. Every power limiting switch is controlled
by a signal, which is enabled by default. This signal is originated from the thermal shutdown mechanism. When the output load exceeds the current limit
threshold, the power switch limits the current to a safe level.
PCI Express Interfaces
The PCI Express bus is a high-speed interface used to connect the DPU Controller to other peripheral devices (the BMC, PCIe switch or directly to the NVMe
SSDs backplane), and operates as a Root-Complex (RC) initiating PCIe bus operations. The BlueField-2 BF2500 DPU Controller supports PCI Express Gen
3.0/4.0 (1.1 and 2.0 compatible) throughx16 edge connector whichserves as the main interface of the card. This connector enables the connectivity of
the system to the BlueField-2 PCIe interface.
The following lists PCIe interface features:
PCIe Gen 4.0 and 3.0 compliant, 2.0 and 1.1 compatible
2.5, 5.0, or 8.0, or 16.0 GT/s link rate x16
Auto-negotiates to x8, x4, x2, or x1
Support for MSI/MSI-X mechanisms
DDR4 Memory
The BlueField-2 BF2500 DPU Controller incorporates one on-board DDR4 memory sized 16GB, 64-bit data and 8-bit Error Correcting Code (ECC) memory.
The following lists the supported DDR4 data rates: