Mellanox Technologies MHRH29B-XTR User manual

www.mellanox.com
ConnectX®-2 VPI Single and Dual Port QSFP
InfiniBand and Ethernet Adapter Card User
Manual
P/N:
MHRH29B-XTR, MHRH29B-XSR, MHQH29B-XTR, MHQH29B-XSR, MHQH29C-XTR, MHQH29C-
XSR, MHRH19C-XTR, MHRH19C-XSR, MHQH19C-XTR, MHQH19C-XSR, MHQH19B-XSR,
MHQH19B-XTR, MHRH19B-XSR, MHRH19B-XTR
Rev 1.6

Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: [phone]
Fax: [phone]
Mellanox Technologies, Ltd.
PO Box 586 Hermon Building
Yokneam 20692
Israel
Tel: [phone]
Fax: [phone]
© Copyright 2011. Mellanox Technologies. All rights reserved.
Mellanox®, BridgeX®, ConnectX®, InfiniBlast®, InfiniBridge®, InfiniHost®, InfiniRISC®, InfiniScale®, InfiniPCI®, PhyX® CORE-
Direct®, and Virtual Protocol Interconnect® are registered trademarks of Mellanox Technologies, Ltd. FabricIT™ and SwitchX™ are
trademarks of Mellanox Technologies, Ltd. All other marks and names mentioned herein may be trademarks of their respective companies.
Document Number: 3156
ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User ManualRev 1.6
Mellanox Technologies
2
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE
PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE
OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE
CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX
TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX
TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE
HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE
DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT,
INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO,
PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANYWAY FROM THE USE OF THE PRODUCT(S) AND
RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 3
Table of Contents
Table of Contents 3
List of Figures 5
List of Tables 6
Revision History 7
About this Manual 8
Intended Audience 8
Related Documentation 8
Online Resources 8
Document Conventions 8
Technical Support 8
Firmware and Software Updates 9
Chapter 1 Overview 10
1.1 Adapter Cards Covered in this Manual 11
1.2 Mellanox Part Numbering Legend 13
1.3 Finding the GUID/ MAC and Serial Number on the Adapter Cards 14
1.4 Safety Warnings 14
Chapter 2 Adapter Card Interfaces 16
2.1 I/O Interfaces 16
2.1.1 InfiniBand Interface 16
2.1.2 Ethernet Interface 17
2.1.3 VPI Port Configuration 17
2.1.4 PCI Express Interface 17
2.1.5 LED Assignment 18
2.1.6 I2C-compatible Interface 18
2.2 Power 19
2.3 QSFP Power Level 19
2.4 Memory 19
2.4.1 System Memory 19
2.4.2 SPI (Flash) 19
2.4.3 EEPROM 19
Chapter 3 VPI Adapter Card Installation 27
3.1 Hardware Requirements 27
3.2 Installation Instructions 27
3.3 Identify the Card in Your System 27
3.3.1 On Windows 27
3.3.1.1 Linux 29
3.4 Cables and Modules 29
3.4.1 Optical Modules for QSFP 29
3.4.2 Modules for QSFP to SFP+ 29
3.4.3 Cable Installation 29
3.4.3.1 Inserting a Cable into the Adapter Card 30
3.4.3.2 Removing a Cable from the Adapter Card 31
Chapter 4 Driver Software and Firmware 32
4.1 Driver Software 32
4.1.1 Linux 32
4.1.2 Windows 35
4.2 Port Type Management Via Driver SW 36
4.2.1 Linux 36
4.2.2 Windows 37

Rev 0.10
Mellanox Technologies
4
4.3 FlexBoot 38
4.4 NVIDIA GPUDirect Support 39
4.4.1 Hardware and Software Requirements 39
4.4.2 Installation 39
4.4.2.1 Kernel Installation: 39
4.4.2.2 MLNX OFED Drivers Installation: 39
4.4.2.3 NVIDIA Driver Installation: 40
4.5 CORE-Direct (Collectives Offload Resource Engine) 40
4.5.1 Hardware and Software Requirements 40
4.5.2 Installation 40
4.6 RDMA over Converged Ethernet (RoCE) 40
4.6.1 Hardware and Software Requirements 41
4.6.2 Installation 41
4.7 Updating Adapter Card Firmware 41
Appendix A Specifications 44
A.1 MHQH19C-X[TSR] Specifications 44
A.2 MHRH19B-X[ST]R Specifications 45
A.3 MHQH19B-X[ST]R Specifications 46
A.4 MHQH29C-X[ST]R Specifications 47
A.5 MHRH29B-X[ST]R Specifications 48
A.6 MHQH29B-X[ST]R Specifications 49
A.7 Board Mechanical Drawing and Dimensions 50
A.8 Regulatory Statements 52
Appendix B Interface Connectors Pinout 53
B.1 I2C-Compatible Connector Pinout 53
B.2 PCI Express x8 Connector Pinout 53
B.3 QSFP Connector Pinout 54
Appendix C Replacing a Tall Bracket With a Short Bracket 56
C.1 Remove the Existing Bracket from the Adapter Card 57
C.2 Installing the New Bracket 57
Appendix D Avertissements de sécurité d’installation (Warnings in French) 60
Appendix E Installation - Sicherheitshinweise (German) 62
Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) 63

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 5
List of Figures
Figure 1: Single Port Card Component Side 11
Figure 2: Dual Port Card Component Side 12
Figure 3: Card Product Label 14
Figure 4: Dual Port Numbering 16
Figure 5: LED - Port Association 18
Figure 6: I2C Connector 18
Figure 7: Flash Jumper 19
Figure 8: PCI Device 28
Figure 9: Connector Orientation (example) 31
Figure 10: Device Manager 36
Figure 11: Support Download Assistant 42
Figure 12: Schematic of the Dual Port Adapter Card MHQH29C 50
Figure 13: Schematic of the Dual Port Adapter Card MH[RQ]H29B-X[ST]R 51
Figure 14: Schematic of the Single Port Adapter Card MH[QR]H19[BC]-X[ST]R 51
Figure 15: Compatible Connector Plug and Pinout 53
Figure 16: Connector and Cage Views 54
Figure 17: Remove the Bracket 57
Figure 18: Gasket Installation 58
Figure 19: Placing the Bracket on the Card 59

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual
Rev 1.6
Mellanox Technologies
6
List of Tables
Table 1: Revision History Table 7
Table 2: Documents List 8
Table 3: Single Port Cards List 11
Table 4: Dual Port Cards List 12
Table 5: Mellanox Cards Part Numbering Key 13
Table 6: Supported Port Configurations 17
Table 7: Unsupported Port Configurations 17
Table 8: Physical and Logical Link Indications 18
Table 9: Jumper Configuration 19
Table 10: MHQH[12]9B-XTR 20
Table 11: MHRH[12]9B-XT[CR] 21
Table 12: MH[QR]H19C-X[STN]R VPD 22
Table 13: MHRH19B-X[ST]R 23
Table 14: MHQH19B-X[ST]R 24
Table 15: MHQH29B-X[ST]R VPD 25
Table 16: MHQH29C-X[ST]R VPD 26
Table 17: Hardware Requirements 27
Table 18: Specifications for MHQH19C-X[ST]R 44
Table 19: Specifications for MHRH19B-X[ST]R 45
Table 20: Specifications for MHQH19B-X[ST]R 46
Table 21: Specifications for MHQH29C-X[ST]R 47
Table 22: Specifications for MHRH29B-X[ST]R 48
Table 23: Specifications for MHQH29B-X[ST]R 49
Table 24: I2C-Compatible Connector Pinout 53

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 7
Revision History
This document was printed on October 30, 2011.
Table 1 - Revision History Table
Date Rev Comments/Changes
Feb. 14th, 2010 1.6 Added MHRH19B-X[ST]R and MHQH19B-X[ST]R
Changed Air Flow to min. 200LFM
Made changes to the Set Up section
Minor fixes
Nov. 24th, 2010 1.5 Added MHRH19C-X[ST]R and MHQH19C-X[ST]R
Nov. 21st, 2010 1.4 Added MHQH29C-X[ST]R
Oct. 27th, 2010 1.3 Added Technical Support and Firmware and Software sections to the Preface
sections
Added KCC statement
Added GPUDirect
Added CORE-Direct
Added RoCE
Added Flexboot
Added Set Up section
Fixed card dimensions
Updated photographs
Updated Figure 11
Formatted EMC table
Changed EN 60950-1:2011 to EN 60950-1:2006
Added LED Port Association figure
Used graphics from media kit
Changed regulatory section on 2 products
Minor formatting
New overview
MAC is derived from GUID
New template
Apr. 2010 1.2 Updated power numbers
Added VPI
Feb. 2010 1.1 Combined singleand dual port cards
Jan. 2010 1.0 Initial Release

Rev 1.6
Mellanox Technologies
8
About this Manual
This User Manual describes Mellanox Technologies ConnectX®-2 Single and Dual Port VPI
InfiniBand and Ethernet PCI Express x8 adapter cards. It provides details as to the interfaces of the
board, specifications, required software and firmware for operating the board, and relevant docu-
mentation.
Intended Audience
This manual is intended for the installer and user of these cards.
The manual assumes basic familiarity with InfiniBand® and Ethernet networks and architecture
specifications.
Related Documentation
Table 2 -
Mellanox Firmware Tools (MFT) User Manual
Document no. 2204UG
User Manual describing the set of MFT firmware management tools for a
single node.
See http://www.mellanox.com => Firmware & Downloads => Download
Firmware Tools
Or
http://www.mellanox.com => Support => Download Firmware Tools
IBTA Specification Release 1.2.1 InfiniBand Architecture Specification
IEEE Std 802.3 Specification This is the IEEE Ethernet specification
http://standards.ieee.org/getieee802
PCI Express 2.0 Specifications Industry Standard PCI Express 2.0 Card Electromechanical Specification,
Rev 1.3.
Documents List
Online Resources
• Mellanox Technologies Web pages: http://www.mellanox.com
• Mellanox Technologies Firmware download Web page:
http://www.mellanox.com => Support => Download Center
Document Conventions
When discussing memory sizes, MB and MBytes are used in this document to mean size in mega
bytes. The use of Mb or Mbits (small b) indicates size in mega bits.
Technical Support
Customers who purchased Mellanox products directly from Mellanox are invited to contact us
through the following methods:

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 9
•URL:http://www.mellanox.com => Support
• E-mail: [e-mail]
• Tel: [phone]
Customers who purchased Mellanox M-1 Global Support Services, please see your contract for
details regarding Technical Support.
Customers who purchased Mellanox products through a Mellanox approved reseller should first
seek assistance through their reseller.
Firmware and Software Updates
The Mellanox support downloader contains software, firmware and knowledge database informa-
tion for Mellanox products. Access the data base from the Mellanox Support Web page,
http://www.mellanox.com => Support
or use the following link to go directly to the Mellanox Support Download Assistant page:
http://www.mellanox.com/supportdownloader/.

Overview
Rev 1.6
Mellanox Technologies
10
1 Overview
This document is a User Manual for Mellanox Technologies VPI adapter cards based on the Con-
nectX®-2 VPI integrated circuit device. The cards described in this manual have the following
main features:
• Virtual Protocol Interconnect
• InfiniBand Architecture Specification v1.2.1 compliant
• Compliant with QSFP MSA spec Rev. 1.0
• PCI Express 2.0 (1.1 compatible) through an x8 edge connector up to 5GT/s
• Single- and Dual-Port options available
• Compatible with copper cables and optical cables with the use of QSFP connectors. Support for
SFP+ cables is available through QSA (Quad to Serial) adapters.
• CPU offload of transport operations
• CORE-Direct® application offload
• GPU-Direct application offload
• RDMA over converged Ethernet (RoCE)
• End-to-end QoS and congestion control
• Hardware-based I/O virtualization
• TCP/UDP/IP stateless offload
• Fibre Channel encapsulation (FCoIB or FCoE)
•RoHS-R6
• Two bracket heights: short and tall

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 11
1.1 Adapter Cards Covered in this Manual
Table 3 lists the single VPI adapter cards described in this manual.
Table 4 lists the dual port VPI adapter cards described in this manual.
Table 3 - Single Port Cards List
Ordering Part Number
(OPN)
PCI Express
SERDES
Speed
Data Transmis-
sion Rate/
# of ports
Short / Tall
Bracket RoHS Adapter IC Part Number
MHRH19C-XSR PCIe Gen2
5.0 GT/s
40 Gb/s QDR
1 port
Short R-6 MT25414B0-FCCR-QI
MHRH19C-XTR PCIe Gen2
5.0 GT/s
40 Gb/s QDR
1 port
Tall R-6 MT25414B0-FCCR-QI
MHQH19C-XSR PCIe Gen2
5.0 GT/s
40 Gb/s QDR
1 port
Short R-6 MT25414B0-FCCR-QI
MHQH19C-XTR PCIe Gen2
5.0 GT/s
40 Gb/s QDR
1 port
Tall R-6 MT25414B0-FCCR-QI
MHRH19B-XSR PCIe Gen2
5.0 GT/s
20 Gb/s DDR
1 port
Short R-6 MT25408B0-FCCR-GI
MHRH19B-XTR PCIe Gen2
5.0 GT/s
20 Gb/s DDR
1 port
Tall R-6 MT25408B0-FCCR-GI
MHQH19B-XSR PCIe Gen2
5.0 GT/s
40 Gb/s QDR
1 port
Short R-6 MT25408B0-FCCR-QI
MHQH19B-XTR PCIe Gen2
5.0 GT/s
40 Gb/s QDR
1 port
Tall R-6 MT25408B0-FCCR-QI
Figure 1: Single Port Card Component Side

Table 4 - Dual Port Cards List
Ordering Part Number
(OPN)
PCI Express
SERDES Speed IB Port Speed
Short /
Tall
Bracket
RoHS
HCA IC
Part Number
MHRH29B-XSR PCIe Gen2
5.0 GT/s
20Gb/s (DDR)
Dual port
Short R-6 MT25408B0-FCCR-GI
MHRH29B-XTR PCIe Gen2
5.0 GT/s
20Gb/s (DDR)
Dual port
Tall R-6 MT25408B0-FCCR-GI
MHQH29B-XSR PCIe Gen2
5.0 GT/s
40Gb/s (QDR)
Dual port
Short R-6 MT25408B0-FCCR-QI
MHQH29B-XTR PCIe Gen2
5.0 GT/s
40Gb/s (QDR)
Dual port
Tall R-6 MT25408B0-FCCR-QI
MHQH29C-XSR PCIe Gen2
5.0 GT/s
40Gb/s (QDR)
Dual port
Short R-6 MT25408B0-FCCR-QI
MHQH29C-XTR PCIe Gen2
5.0 GT/s
40Gb/s (QDR)
Dual port
Tall R-6 MT25408B0-FCCR-QI
Overview
Rev 1.6
Mellanox Technologies
12
Figure 2: Dual Port Card Component Side
MH[QR]H29B
MHQH29C

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 13
1.2 Mellanox Part Numbering Legend
Table 5 describes the Mellanox Technologies adapter cards part numbering legend.
Table 5 - Mellanox Cards Part Numbering Key
Adapter Card
OPN
MHTS#I-XBR
Field Decoder
MMellanox
Technologies
HAdapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card
TMedia Q = QSFP QDR, R = QSFP DDR,
SAdapter
Architecture
H = ConnectX® or ConnectX-2
## ports 1 = 1, 2 = 2
IHost Interface X = PCI-X, 4 = PCIe x4, 8 = PCIe Gen1 x8, 9 = PCIe (Gen2 x8),
GGeneration <blank> = Initial product generation, B= generation B, C= generation C
-Separator
XMemory Size X = MemFree, 1=128MB, 2=256MB, 3=512MB
BBracket S = Short, T = Tall, N = None
RRoHS <blank> = non RoHS, C = RoHS R-5 w/ Exemption, R = RoHS R-6 Lead-Free
For example, the part number MHQH19B-XTR describes Mellanox Technologies’ ConnectX®-2
VPI card with 1 QSFP port, a PCIe2.0 x8 5.0GT/s interface, no on-board memory (mem-free), a
tall PCI bracket, and RoHS R6 compliance. Using the legend,
• field M = M to indicate a Mellanox Technologies product,
• field H = H to indicate an InfiniBand Adapter Card,
• field T = Q to indicate QSFP QDR,
• field S = H to indicate ConnectX®-2
• field # = 1 to indicate one port,
• field I = 9 to indicate PCI Express 2.0 x8 running at 5.0GT/s,
• field G = B to indicate Generation B
• field X = X to indicate no on-board memory,
• field B = T to indicate a tall bracket, and
• field R = R to indicate RoHS R6 (with no exemptions) compliance

Overview
Rev 1.6
Mellanox Technologies
14
1.3 Finding the GUID/ MAC and Serial Number on the Adapter Cards
Each Mellanox adapter card has a label on the print side that shows the card serial number, the card
MAC for Ethernet protocol, and the card GUID for InfiniBand protocol. VPI cards have both a
GUID and a MAC (derived from the GUID).
Figure 3: Card Product Label
Port 1 uses the GUID or MAC ID described on the label. For Port 2 GUID or MAC
add 1 to Port 1's respective values.
1.4 Safety Warnings
For safety warnings in French see “Avertissements de sécurité d’installation (Warnings in French)”
on page 60. For safety warnings in German see “Installation - Sicherheitshinweise (German)” on
page 62. For safety warnings in Spanish see “Advertencias de seguridad para la instalación (Warn-
ings in Spanish)” on page 63.
1. Installation Instructions
Read all installation instructions before connecting the equipment to the power source.

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 15
2. Over-temperature
This equipment should not be operated in an area with an ambient temperature exceed-
ing the maximum recommended: 55°C (131°F).
To guarantee proper air flow, allow at least 8cm (3 inches) of clearance around the ven-
tilation openings.
3. During Lightning - Electrical Hazard
During periods of lightning activity, do not work on the equipment or connect or dis-
connect cables.
4. Copper Cable Connecting/Disconnecting
Some copper cables are heavy and not flexible, as such they should be carefully
attached to or detached from the connectors. Refer to the cable manufacturer for spe-
cial warnings and instructions.
5. Equipment Installation
This equipment should be installed, replaced, or serviced only by trained and qualified
personnel.
6.
Disposal of this equipment should be in accordance to all national laws and regula-
tions.
Equipment Disposal
7.
This equipment should be installed in compliance with local and national electrical
codes.
Local and National Electrical Codes

Adapter Card Interfaces
Rev 1.6
Mellanox Technologies
16
2 Adapter Card Interfaces
2.1 I/O Interfaces
Each adapter card includes the following interfaces:
• QSFP ports
• PCI Express x8 edge connector
• I/O panel LEDs
•I
2C-compatible connector (for debug)
For dual port cards, port 1 connects to connector 1 of the device, while port 2 connects to connec-
tor 2 of the device.
Figure 4:
Port 2
Port 1
Dual Port Numbering
2.1.1 InfiniBand Interface
The ConnectX®-2 adapter card is compliant with the InfiniBand Architecture Specification, Release
1.2.1. VPI adapter cards listed above, based on this device, provide access to its network ports by
means of QSFP connectors.

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 17
2.1.2 Ethernet Interface
The ConnectX-2 adapter card is compliant with the IEEE Std 802.3. The VPI adapter cards listed
above, based on this device, provide access to the Ethernet ports by means of QSFP connec-
tors.The Mellanox QSA (QSFP to SFP+) adapter modules can be ordered through Mellanox Tech-
nologies authorized dealers.
2.1.3 VPI Port Configuration
VPI ports are auto-sensing but can be manually configured using a script.
Table 6 lists the configurations supported by dual-port VPI adapter cards.
Table 6 - Supported Port Configurations
Port 1 Port 2
Ethernet Ethernet
IB IB
auto-sensing auto-sensing
IB Ethernet
IB auto-sensing
auto-sensing Ethernet
Table 7 lists the configurations not supported by dual-port VPI adapter cards.
Table 7 - Unsupported Port Configurations
Port 1 Port 2
Ethernet IB
Ethernet auto-sensing
auto-sensing IB
For port type configuration instructions please refer to Section 4.2, “Port Type Management Via
Driver SW,” on page 36.
2.1.4 PCI Express Interface
The ConnectX®-2 adapter cards support PCI Express 2.0 (1.1 compatible) through an x8 edge
connector. The device can be either a master initiating the PCI Express bus operations or a slave
responding to PCI bus operations.

Adapter Card Interfaces
Rev 1.6
Mellanox Technologies
18
2.1.5 LED Assignment
There are two I/O LEDs per port, green and yellow, located on the I/O panel. Table 8 outlines the
different LED functions.
Figure 5: LED - Port Association
Table 8 - Physical and Logical Link Indications
LED Function
Green - Physical link • Constant on indicates a good physical link
• Blinking indicates a problem with the physical link
• If neither LED is lit, then the physical link has not been established
Yellow -
Logical (data activity) link
• A constant yellow indicates a valid logical (data activity) link without
data transfer.
• A blinking yellow indicates a valid logical link with data transfer
• If only the green LED is lit and the yellow LED is off, then the logical
link has not been established.
The short bracket has the same port and LED footprints as the tall bracket.
2.1.6 I2C-compatible Interface
A three-pin header on the adapter card is provided as the I2C-compatible interface. See
Appendix A,“Specifications,” on page 44 for the location on the board.
Figure 6: I2C Connector

ConnectX®-2 VPI Single and Dual Port QSFP InfiniBand and Ethernet Adapter Card User Manual Rev 1.6
Mellanox Technologies 19
2.2 Power
All adapter cards receive 12V and 3.3V power from the PCI Express Edge connector. All other
required power voltages are generated by on-board switch mode regulators. See “Specifications”
on page 44.
2.3 QSFP Power Level
The card supports power level 3, according to SFF Committee SFF-8436 Specification for QSFP
(Quad Small Form-factor Pluggable) Transceiver.
2.4 Memory
The adapter cards support multiple memory devices through the PCI, SPI (Flash) and I2C inter-
faces.
2.4.1 System Memory
The adapter cards utilize the PCI Express interface to store and access IB fabric and/or Ethernet
fabric connection information and packet data on the system memory.
2.4.2 SPI (Flash)
Each of the adapter cards includes one 16MB SPI Flash device (M25P16-VME6G device by ST
Microelectronics) accessible via the Flash interface of the ConnectX®-2 VPI adapter card.
There is a jumper on each adapter card that indicates to the device whether an on-board Flash
device is to be used or not. Table 9 provides information on this jumper. See the appropriate sche-
matic in Appendix A,“Specifications,” on page 44 for the jumper location.
Table 9 - Jumper Configuration
Description Option Card Default
Configuration Comments
Flash present/
not present
connection open – Flash present
connection shorted – Flash not present
Figure 7: Flash Jumper
connection open –
Flash present
Header 1x2
2.4.3 EEPROM
Each board incorporates an EEPROM that is accessible through the I2C-compatible interface. The
EEPROM capacity is 4Kb. The EEPROM is used for storing the Vital Product Data (VPD).

Adapter Card Interfaces
Rev 1.6
Mellanox Technologies
20
The PCI VPD (Vital Product Data) layout, for each of the adapter cards complies with the format
defined in the PCI 2.3 Specification, Appendix I.
Table 10 - MHQH[12]9B-XTR
Offset
(Decimal) Item Value Format Description
0Large Resource Type ID String Tag
(0x02)
0x82
1Length [7:0] LSB 0xA
2Length [15:8] MSB 0x0
3Data FALCON QDR STR
13 Large Resource Type VPD-R Tag
(0x10)
0x90
14 Length [7:0] LSB 0x4F
15 Length [15:8] MSB 0x00
16 VPD Keyword PN STR Add in Card Part Number
18 Length 0x15
19 PN PN %STR_SPC
40 VPD Keyword EC STR Engineering Change Level of the card
(rev)
42 Length 0x2
43 Revision RV %STR PCB revision
45 VPD Keyword SN STR Serial Number
47 Length 0x18
48 SerialNumber %STR_SPC “00..00XXXX..XX”
72 VPD Keyword V0 STR Misc Information
74 Length 0x10
75 Data PCIe Gen2 x8 STR_SPC
91 VPD Keyword RV STR
93 Length 0x1
94 Data 0,93 %CS0
95 Large Resource Type VPD-W Tag
(0x11)
0x91
96 Length [7:0] LSB 0x9D
97 Length [15:8] MSB 0x00
98 VPD Keyword V1 STR EFI Driver version
100 Length 0x6
101 Data N/A STR_SPC
107 VPD Keyword YA STR Asset Tag
109 Length 0x20
110 Data N/A STR_SPC “N/A”
142 VPD Keyword RW STR Remaining read/write area
144 Length 0x6E
145 Data STR_ZERO Reserved (0x00)
255 Small Resource Type END Tag
(0x11)
0x78