HP 4X - DDR InfiniBand Mezzanine HCA Instruction sheet

1
HP InfiniBand Mezzanine HCA Cards and
Mellanox InfiniBand PCI HCA Cards
Read This First: Documentation Roadmap
This roadmap describes how to access the documentation providing information about the Mellanox and HP
InfiniBand host channel adapters (HCAs) and mezzanine cards that are used in some HP InfiniBand fabrics.
Part number: AM-HCARM-1A
First Edition: September 2008

2
This document provides links to the Mellanox data sheets describing various Mellanox InfiniBand host
channel adapter cards (HCAs) and HP mezzanine cards. You can link directly to any of the
documentation here to provide you with more information about your product.
Mellanox InfiniBand HCA Overview................................................................................................................3
HP 4X DDR InfiniBand Mezzanine HCAs (448262-B21 and 410533-B21) ....................................................4
Mellanox ConnectX IB InfiniBand HCAs (448397-B21 and 483514-B21) ......................................................5
Mellanox InfiniHost III Ex Dual-Port InfiniBand HCAs with PCI Express x8 (483513-B21, 409376-B21,
380298-B21)...................................................................................................................................................6
Mellanox InfiniHost Dual-Port 10 Gb/sec InfiniBand HCAs with PCI-X (380299-B21)....................................7
Mellanox InfiniHost III Lx Single-Port InfiniBand HCAs with PCI Express (431038-B21 and 431039-B21)....8
HP InfiniBand Information...............................................................................................................................9
Cluster Platform InfiniBand Information..........................................................................................................9
Revision History
Revision Date Changes
September 2008 First edition

3
Mellanox InfiniBand HCA Overview
One of the features of an InfiniBand fabric is that individual components can contain an InfiniBand
host channel adapter (HCA) or a mezzanine HCA. The components that contain HCAs are visible
and manageable parts of your InfiniBand fabric. The HCA may be an integrated circuit embedded
on the circuit board of a component (such as a storage array controller) or it can be a PCI card that
is installed in a server. In an HP Cluster Platform configuration, the HCA can be a single-port or
dual-port InfiniBand PCI card.
These Mellanox HCAs were installed by HP, but it is assumed that you are familiar with the
Mellanox HCAs and have the knowledge necessary to maintain and troubleshoot the HCA and
mezzanine card technology. This document contains links to the documentation that describe the
various Mellanox and HP HCAs.
All of the documentation referenced in this document is currently available on the docs.hp.com and
Mellanox websites. If you have any comments about this document, please send them to:
http://docs.hp.com/en/feedback.html
NOTE: For technical support and updates, contact your HP representative.

4
HP 4X DDR InfiniBand Mezzanine HCAs (448262-B21 and
410533-B21)
The HP 4X DDR InfiniBand mezzanine host channel adapters (HCAs) for HP BladeSystem c-Class
is based on the ConnectX technology developed by Mellanox. These HCAs are only supported by
HP in HP Cluster Platform configurations.
The features for the HP 4X DDR InfiniBand dual-port mezzanine HCA include:
•Low latency and high bandwidth
•PCI Express revision 2.0x8 support
•20 Gb/sec InfiniBand port
•IBTA version 1.2 compatible
•Quality of Service (QoS) support
•RDMA support
•Supported protocols include MPI, SDP, IPoIB, and iSER
The features for the HP 4X DDR InfiniBand single-port mezzanine HCA include:
•Low latency and high bandwidth
•PCI Express revision 1.0a support
•20 Gb/sec InfiniBand port
•IBTA version 1.2 compatible
•Quality of Service (QoS) support
•RDMA support
•Supported protocols include MPI, SDP, IPoIB, and iSER
The following table provides links to the documentation and firmware for these HCAs.
HCA Documentation HP Part Number/
Firmware Downloads
HP 4X DDR InfiniBand Single-Port Mezzanine HCA for HP BladeSystem
c-Class 448262-B21
HP 4X DDR InfiniBand Dual-Port Mezzanine HCA for HP BladeSystem
c-Class 410533-B21
NOTE: For technical support and updates, contact your HP representative.

5
Mellanox ConnectX IB InfiniBand HCAs (448397-B21 and
483514-B21)
The Mellanox ConnectX IB InfiniBand host channel adapters (HCAs) provide low-latency and high-
bandwidth for server and storage clustering applications.
The ConnectX IB InfiniBand HCA features include:
•1.2 us MPI ping latency
•10 Gb/sec, 20 Gb/sec, or 40 Gb/sec InfiniBand ports
•CPU offload of transport operations
•End-to-end QoS and congestion control
•Hardware-based I/O virtualization
•TCP/UDP/IP stateless offload
The following table provides links to the documentation and firmware for these HCAs.
HCA Documentation HP Part Number/
Firmware Downloads
HP InfiniBand 4X DDR ConnectX PCI-E Dual-Port HCA 448397-B21
HP InfiniBand 4X DDR ConnectX PCI-E Gen2 Dual-Port HCA 483514-B21
NOTE: For technical support and updates, contact your HP representative.

6
Mellanox InfiniHost III Ex Dual-Port InfiniBand HCAs with
PCI Express x8 (483513-B21, 409376-B21, 380298-B21)
The Mellanox InfiniHost III Ex Dual-Port 4X InfiniBand host channel adapters (HCAs) connect to the
host system through a PCI Express x8 interface. Single-data rate (SDR) InfiniHost III Ex cards
support dual 10Gb/sec InfiniBand connections. Double-data rate (DDR) versions support dual 20
Gb/sec InfiniBand connections.
The InfiniHost III Ex Dual-Port InfiniBand HCAs with PCI Express x8 features include:
•Dual 10 Gb/sec or 20 Gb/sec 4X InfiniBand ports
•IBTA version 1.2 compatible
•Copper InfiniBand connectors (MicroGigaCN) with media detect circuit for optional fiber media
adapter
•Linux and Windows drivers
•InfiniBand Compatible Verbs API
•Linux management and applications package available
•Various upper layer protocols
•ROHS-R5 compliant
The following table provides links to the documentation and firmware for these HCAs.
HCA Documentation HP Part Number/
Firmware Downloads
HP InfiniBand 4X DDR PCI-E 0 Memory Dual Port HCA 483513-B21
HP InfiniBand 4X DDR PCI-E Dual-Port HCA 409376-B21
HP InfiniBand 4X PCI-E Dual-Port HCA 380298-B21
NOTE: For technical support and updates, contact your HP representative.

7
Mellanox InfiniHost Dual-Port 10 Gb/sec InfiniBand HCAs
with PCI-X (380299-B21)
The Mellanox InfiniHost Dual-Port 10 Gb/sec InfiniBand HCAs with PCI-X are dual-port 10 Gb/sec
PCI-X HCAs designed for full performance on high-speed InfiniBand fabrics. Their design allows for
10 Gb/sec database or HPC clustering, and provide the high throughput and low CPU utilization
required by those applications.
The Mellanox InfiniHost Dual-Port 10 Gb/sec InfiniBand HCAs with PCI-X features include:
•Dual 10 Gb/sec 4X InfiniBand ports
•Support for millions of queue pairs
•Memory options of 128 or 256 MB of DDR memory
•Support for 8 data VLs plus the VL15 Management Lane
•Sophisticated Quality of Service (QoS) features
•Multicast, atomic, and large message support
•Hardware support for UC, UD, RC, and RAW mechanisms
The following table provides links to the documentation and firmware for this HCA.
HCA Documentation HP Part Number/
Firmware Download
InfiniBand 4X PCI-X Dual-Port HCA 380299-B21
NOTE: For technical support and updates, contact your HP representative.

8
Mellanox InfiniHost III Lx Single-Port InfiniBand HCAs with
PCI Express (431038-B21 and 431039-B21)
The Mellanox InfiniHost III Lx single-port InfiniBand host channel adapters (HCAs) with PCI Express
connect to the host system through a PCI Express interface. The single-data rate (SDR) cards
support 10 Gb/sec InfiniBand connections. The double-data rate (DDR) cards support 20 Gb/sec
connections. These cards also feature remote direct memory access (RDMA), hardware transport,
and advanced per queue pair (QP) QoS services.
Additional Mellanox InfiniHost III Lx single-port InfiniBand HCA with PCI Express features include:
•10 Gb/sec or 20 Gb/sec 4X InfiniBand port
•Integrated Serializer/Deserializer (SerDes)
•InfiniRISC embedded RISC processors
•PCI Express revision 1.0a compatible card
•PCI Express x4 (10 + 10 Gb/sec full duplex) interface (431038-B21)
•PCI Express x8 (20 + 20 Gb/sec full duplex) interface (431039-B21)
•IBTA version 1.2 compatible
•Copper InfiniBand connectors (MicroGigaCN) with media detect circuit for optional fiber media
adapter
•Linux and Windows drivers
•InfiniBand Compatible Verbs API
•Linux management and applications package available
•Various upper layer protocols
•ROHS-R5 compliant
The following table provides links to the documentation and firmware for these HCAs.
HCA Documentation HP Part Number/
Firmware Downloads
HP InfiniBand 4X SDR PCI-E Single-Port HCA 431038-B21
HP InfiniBand 4X DDR PCI-E Single-Port HCA 431039-B21
NOTE: For technical support and updates, contact your HP representative.

9
HP InfiniBand Information
The following websites provide more information on HP InfiniBand products:
Link/Description
Mellanox website
Check the Mellanox website for potential updates between releases of this document.
HP BladeSystem Adapters and Mezzanines
This site provides information on the full range of BladeSystem adapters and mezzanines
available from HP for BladeSystem configurations.
High Performance Computing - Cluster Platform website
HP website providing the latest documentation for High Performance Computing hardware and
software products (Cluster Platform products, cabling tables, interconnect and firmware
information, cable management guides, and SVA).
Cisco website
See the Cisco website for more information Cisco InfiniBand products.
Voltaire website
See the Voltaire website for information about Voltaire InfiniBand products.
Cluster Platform InfiniBand Information
The following websites provide more information about HP Cluster Platform InfiniBand products:
Link/Description
InfiniBand Support for HP ProLiant and HP Integrity Servers
Provides information on the complete line of InfiniBand products supported by HP.
HP Cluster Platform products
Provides the latest information on the HP clustering technology and available configurations.
HP BladeSystem Adapters and Mezzanines
Provides information on the full range of BladeSystem adapters and mezzanines available from
HP for BladeSystem configurations.
High Performance Computing - Cluster Platform Documentation
Provides links to the Cluster Platform documentation set.
Contact your local HP sales or support representative if you need additional information.

10
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change
without notice. The only warranties for HP products and services are set forth in the express warranty
statements accompanying such products and services. Nothing herein should be construed as constituting
an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Mellanox, ConnectX, InfiniHost, and InfiniRISC are trademarks of Mellanox Technologies, Ltd.
InfiniBand™ is a trademark of the InfiniBand® Trade Association.