Dolphin MXH932 User manual

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 1
Dolphin PCI Express MXH932 Adapter
MXH932 Transparent Adapter Users Guide
Version 1.0
Date: 6th October 2020

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 2

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 3
Table of Contents
DISCLAIMER................................................................................................................................................................ 4
TERMS AND ACRONYMS............................................................................................................................................. 5
MXH932 HIGH LEVEL SPECIFICATION.......................................................................................................................... 6
PACKAGING................................................................................................................................................................ 7
PRE-INSTALLATION QUESTIONS.................................................................................................................................. 7
PCIE SLOT DETERMINATION............................................................................................................................................ 7
MXH932 HOST /TARGET CONFIGURATION ....................................................................................................................... 7
AIRFLOW -OPERATING ENVIRONMENT .............................................................................................................................. 7
CABLE CONNECTIONS .................................................................................................................................................... 7
PCI Express 4.0 Cables........................................................................................................................................... 7
Active Optical PCIe Cables (AOC)........................................................................................................................... 7
CMI FUNCTIONALITY..................................................................................................................................................... 8
INSTALLATION ............................................................................................................................................................ 9
STEP 1-UNPACK BOARD................................................................................................................................................ 9
STEP 2-CHANGE PCIE BRACKET IF NECESSARY .................................................................................................................... 9
STEP 3-CONFIGURE THE BOARD FOR PROPER OPERATION ..................................................................................................... 9
STEP 4-ENSURE PROPER AIRFLOW................................................................................................................................... 9
STEP 5-INSTALL THE ADAPTER CARD ................................................................................................................................ 9
STEP 6-INSTALLING AND REMOVING THE CABLE.................................................................................................................. 9
Connecting the Cable............................................................................................................................................ 9
Cable stain relief..................................................................................................................................................10
Supported cable lengths ......................................................................................................................................10
Disconnecting the Cable ......................................................................................................................................10
STEP 7-VERIFY INSTALLATION &LEDS............................................................................................................................10
OPERATION ...............................................................................................................................................................11
CONFIGURATION AND DIP SWITCHES ...............................................................................................................................11
DIP Switches........................................................................................................................................................11
Target Card Clocking Option ................................................................................................................................11
DIP Switch settings for MXH932 Host operation ...................................................................................................12
DIP Switch settings for MXH932 Target operation................................................................................................12
TRANSPARENT USE CASES .............................................................................................................................................13
Use Case A - 1 Host –Single Expansion Configuration PCIe x16.............................................................................13
Use Case B –1 Host –Single or Dual Expansion Configuration –PCIe x8 ...............................................................13
Use Case C –1 Host - Quad Expansion Configuration –PCIe x4.............................................................................14
Use Case D –1 Host –Transparent fan-out using MXS924 - PCIe x16....................................................................14
Use Case E –Multi Host –Transparent fan-out using MXS924 - PCIe x16..............................................................14
EEPROM AND FIRMWARE UPGRADE...............................................................................................................................15
IDENTIFYING THE CARD .................................................................................................................................................15
SUPPORT...................................................................................................................................................................16
TECHNICAL INFORMATION ........................................................................................................................................17
BOARD REVISION HISTORY..............................................................................................................................................17
SIMPLIFIED SCHEMATICS................................................................................................................................................17
PCIE CABLE PORT SIGNALS ............................................................................................................................................18
EXTERNAL PCIE X4CABLE CONNECTOR PIN-OUT ................................................................................................................18
PCIE CABLE PORT MAPPING ..........................................................................................................................................18

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 4
MXH932 PCIE X16 EDGE CONNECTOR PIN-OUT ...............................................................................................................19
COMPLIANCE AND REGULATORY TESTING.................................................................................................................20
LIMITED WARRANTY..................................................................................................................................................21
WARRANTY PERIOD .....................................................................................................................................................21
COVERAGE.................................................................................................................................................................21
SERVICE PROCEDURE ....................................................................................................................................................21
DISCLAIMER
DOLPHIN INTERCONNECT SOLUTIONS RESERVES THE RIGHT TO MAKE CHANGES WITHOUT FURTHER NOTICE TO ANY OF ITS
PRODUCTS TO IMPROVE RELIABILITY, FUNCTION, OR DESIGN.
DO NOT USE INFORMATION IN THIS GUIDE TO DESIGN YOUR OWN PCI-SIG COMPLIANT PRODUCT, ALWAYS REFERENCE THE
ORIGINAL PCI-SIG SPECIFICAITON FOR DETAILS.
TO THE FULLEST EXTENT PERMITTED BY LAW, DOLPHIN WILL NOT BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL OR
CONSEQUENTIAL DAMAGES (INCLUDING LOST PROFITS, LOST DATA, OR LOSS OF USE) ARISING OUT OF ANY USE OF DOLPHIN’S
PRODUCTS, SOFTWARE OR SERVICE PROVIDED. DOLPHIN’S MAXIMUM LIABILITY WILL NOT EXCEED THE TOTAL AMOUNT PAID FOR
THE PRODUCT BY THE PURCHASER.
PCI Express External Cabling specification 3.0 is, as of the release of MXH932, not completed and ratified by the PCI-SIG. The
MXH932 is designed to the new specification, but Dolphin cannot guarantee the card will be compliant to the final 3.0 version.
Dolphin firmware tools can update the CMI implementation.
LIFE SUPPORT POLICY
DOLPHIN INTERCONNECT SOLUTIONS’ PRODUCTS ARE NOT AUTHORIZED FOR USE AS CRITICAL COMPONENTS IN LIFE SUPPORT
DEVICES.
ENVIRONMENTAL POLICY
Dolphin is minimizing the amount of printed documentation and software CDs in its shipments; please download additional
documentation and software from www.dolphinics.com.
Scope
This version of the MXH932 Users Guide is valid for firmware version 12.

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 5
Terms and Acronyms
Important terms and acronyms used in this manual
AOC Active Optical Cable. PCIe fiber cable assembly available from Dolphin.
CMI Cable Management Interface. The 2-wire management interface for communication between subsystems
connected by a PCIe 4.0 cable. Details can be found in the PCI-SIG External Cabling Specification 4.0 (draft).
CMI Controller Microcontroller on the MXH932 used to manage and implement the CMI communications.
eXpressWare Dolphin’s software stack for PCIe clustering and IO. Please visit www.dolphinics.com for more information.
Host mode The card is installed in a root complex / Host PC.
Lane One PCI Express Lane contains a differential pair for transmission and a differential pair for reception.
Link A collection of one or more PCI Express Lanes providing the communication path between an Upstream and
Downstream Port.
PCIe 4.0 cable Cable compliant to the preliminary PCI-SIG External Cabling Specification 4.0. Support for CMI.
Port PCIe Cable port. The MXH932 has four x4 ports, named P1, P2, P3, P4. These ports can be merged to two x8
ports, or one x16 port. The physical ports are identified by text on the PCIe brackets.
Target mode The card is installed in an expansion chassis
Wake A mechanism used by a downstream device to request the reapplication of main power when in the L2 Link
state.

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 6
MXH932 High Level Specification
The MXH932 is a low profile, half-length PCIe adapter that can be configured as a Transparent Host Adapter card or a Target
adapter card. Once installed in any server’s or PC’s PCI Express compliant slot, a MXH932 can connect to another MXH932
configured for Transparent Target operation or any target device compliant to the PCI Express External Cabling Specification 4.0.
The MXH932 configured as a Transparent Target card can be installed in a PCI Express compliant expansion upstream slot. Please
contact Dolphin for a list of compliant expansion chassis. The MXH932 supports PCIe Gen1, Gen2, Gen3 and Gen4 speeds and x1,
x2, x4, x8 and x16 link-widths. The card will operate at the highest common speed shared between the slot and the card (Gen4)
and the widest common link-width (x16).
•PCI Express Base Specification, Rev. 4.0.
•PCI Express CEM Specification, Rev. 4.0.
•PCI Express External Cabling specification 4.0 (draft)
•PCI Express Gen4 16.0 GT/s per lane signaling –256 GT/s total signaling.
•PCI Express Gen4 x16 edge connector. The card installs in any PCI Express slot that has a physical x16
connector.
•Compliant with PCI Express Gen1 through Gen3 computers and IO systems, auto detection.
•The MXH932 supports transparent connections to IO systems (Host and Target operation).
•Quad SFF-8644 cable connector
oDurability max total 250 mating cycles
•Cable port configurations, up to
oOne x16
oTwo x8
oFour x4
•Microsemi Switchtec PM40036 PFX PCI Express Gen4 chipset.
•100 nanosecond cut-through latency port to port.
•Support for PCIe 3.0 and PCIe 4.0 SFF-8644 copper cables with CMI and PCIe Active Optical cables.
•Support for active optical fibers up to 100 meters (being qualified, contact Dolphin).
•Low profile, Half-length - PCI Express Electromechanical Specification, Rev 4.0.
•Dimensions are 167.65mm (6.600 inches) x 68.90 mm (2.731 inches)
•Comes with both a low profile and a standard profile PCI Express bracket.
•Host clock isolation. Automatic support for host running CFC or SSC mode.
•Prepared for SRIS clocking.
•VAUX powered board management controllers for flexible configuration and cable management.
•Flash recovery option. PFX Multi configuration support.
•Maximum power ratings:
o12 Volt: 1.66 A (no port power) 2.66 A (max port power)
o+3.3 Volt: Not connected
o+3.3 Vaux: 100 mA
•Typical power ratings:
o12 Volt: 1.5 A (no port power)
o+3.3 Volt: Not connected
o+3.3 Vaux: 100 mA
•Port power supply (per cable port):
oVPWR: 3.2V - 3.4V, 0.86 A
oVMGTPWR: 3.2V - 3.4V, 89 mA
•Operating Temperature: 0°C - 55°C (32°F - 131°F), Airflow: 350 LFM (Preliminary)
•Operating Temperature with AOC: TBD
•Relative Humidity: 5% - 95% (non- condensing)
•CE and FCC markings

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 7
Packaging
The MXH932 includes the following components.
•MXH932 Adapter Board with full height profile PCIe bracket mounted
•Low profile PCIe bracket
•Anti-static bag
•Getting started guide
Pre-Installation Questions
Certain steps should be taken prior to installing the MXH932. You should determine the following configuration requirements.
•Which PCIe slot and system will the card be installed in?
•Will the board act as a host adapter or target adapter?
•What is the speed and link width of the slot that the card will be installed in?
•What is the operating environment in which the card will be installed?
•What type and length of cables will be used?
•How to establish proper operational conditions, temperature, and airflow.
PCIe Slot Determination
The MXH932 supports PCIe Gen1, Gen2, Gen3 and Gen4 speeds and x1, x2, x4, x8 and x16 link-widths. The slot width and speed
will affect the performance of the card. The card can be physically installed in a x4, x8 or x16 connector. The card will auto
configure to the slot speed and width.
MXH932 Host / Target Configuration
The MXH932 can act as either a host adapter or target adapter. The MXH932 has a DIP switch bank to control these functions. The
DIP switch labeled SW1 can be found close to the upper edge of the board. The main configuration options are host or target
operations . The default DIP switch setting is transparent host x16 operations. Additional settings are target operations, two x8
links, four x4 links, alternativce edge clock routing and quad edge target.
Airflow - Operating Environment
To maximize lifetime for the product and maintain the warranty, please honor the specified operating temperature and make sure
the specified air flow is present. Special care should be considered when the MXH932 is used in office type cabinets in combination
with other high energy consuming PCIe devices, e.g. not active-cooled GPUs:
Operating Temperature: 0°C - 55°C (32°F - 131°F), Airflow: 350 LFM (Preliminary)
Operating Temperature with AOC: TBD
TIP: After installing the Dolphin eXpressWare board management software, you can use the tool dis_diag to determine the actual
board temperatures.
Cable Connections
The MXH932 is designed to support both long and short PCIe copper cables as well as PCIe active optical cables (AOC).
The MXH930 cable ports are compliant to the SFF-8644 industry specification and supports PCIe cables compliant to the PCIe
External Cabling Specification 4.0. Four x4 cables are needed for full PCIe x16 connectivity.
PCI Express 4.0 Cables
When used with cables compliant to the new PCIe External Cable standard 4.0, the MXH932 card will transmit a CMI Reset message
downstream. The card can be connected to a MXH932 in Target mode or any PCIe device compliant to the new cable standard.
Support for additional CMI messages are being implemented and will be available with the next firmware maintenance release,
please contact Dolphin for details.
Active Optical PCIe Cables (AOC)
Dolphin offers active optical PCIe fiber cables up to 100 meters for the MXH932 cards. Please contact Dolphin for more information
on long distance fiber optic performance and availability. CWAKE and CPOWERON is not supported using standard AOC cables.

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 8
CMI Functionality
The MXH932 firmware release 2 supports the following CMI operations:
•Publishes card and CMI status information in readable memory map
•Supports sending and receiving CMI reset, wake and power status messages
•Supports receiving indicators (LED/messages).

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 9
Installation
Step 1 - Unpack board
The MXH932 card is shipped in an anti-static bag to prevent static electricity damage. The card should only be removed from the
bag after ensuring that anti-static precautions are taken. Static electricity from your clothes or work environment can
damage your PCI Express adapter card or your PC. Always wear a grounded anti-static wrist strap while opening the
PC and when the MXH932 is removed from the anti-static bag.
Unpack the MXH932 from the anti-static bag using proper anti-static procedures.
Step 2 - Change PCIe Bracket if necessary
The MXH932 package includes a standard and low-profile PCI Express bracket. By default, the standard height bracket is installed
on the board. If you need to replace the mounted bracket with a low-profile bracket, carefully unscrew the two mounting screws to
remove the full height bracket. Save the two mounting screws and replace the bracket with the low-profile bracket. Use the two
mounting screws to install the low-profile bracket. The screws should be carefully tightened, but be careful not to over-tighten.
Make sure you are properly grounded to avoid static discharges that may destroy the adapter card before performing this
procedure.
Step 3 - Configure the Board for Proper Operation
Set the DIP switch settings for proper operation depends on the firmware. Please refer to the section Configuration and DIP
Switches on page 11 for details.
Step 4 - Ensure proper Airflow
Please pay proper attention to ensure the selected server / slot position provides the minimum required airflow.
TIP: Immediately after software installation, please use the dis_diag tool to verify the temperature. If the chip temperature
reported by dis_diag exceeds 95°C, it is strongly recommended to improve the airflow.
Step 5 - Install the Adapter Card
Before installing the adapter card, make sure you are properly grounded to avoid static discharges that may
destroy your computer or the adapter card. Ensure you are properly grounded before opening
your computer or the anti-static bag containing the MXH932. Please follow your computer’s or
expansion chassis manual on how to install a PCI Express card.
The MXH932 Adapter card can be installed into any PCI Express x16 slot. The MXH932 supports PCI Express
Gen1, Gen2, Gen3 and Gen4 signaling. NOTE: A Gen3 slot is recommended as it typically doubles the
performance compared to a Gen2 slot. The MXH932 is an x16 card, so maximum performance will only be
attained if the slot provides full electrical x16 signaling.
The MXH932 supports hosts using either spread spectrum or constant frequency clocking. The card
implements clock isolation.
Step 6 - Installing and Removing the Cable
Installing and removing cables should be done with both host and expansion system powered off. Please
contact your Dolphin representative if you intend to continuously connect and disconnect the PCI Express
cables.
Connecting the Cable
Please carefully install the cable connector into the connector housing on the MXH932 adapter card. Cable
port 1 is located at the top of the PCIe bracket, ref Figure 1 PCIe Bracket to the right. To install the cable,
match the cable house with the connector on the MXH932 adapter card. Use even pressure to insert the
connector until it is secure. Adhere to ESD guidelines when installing the cables to ensure you don’t damage
the board. Computer cables should always use strain relief to protect the connected equipment from
excessive force on the cable. This is especially important for cables between racks. Note that for wider than x4
Figure 1 PCIe
Bracket

MXH932 User’s Guide – Dolphin Interconnect Solutions Page 10
connections, the same cable-ports (i.e. port 1 to port 1, port 2 to port 2 through port 4) should be used on both host and target for
each individual cable, to ensure that the cards properly link up as x8 or x16.
Cable stain relief
Strain-relief on the PCIe cables are important to protect the PCIe card from fatigue loading and damages. The cable should be
mechanically connected to the rack or cabinet. This is especially important for long heavy cables and cables going between cabinets
and racks.
Supported cable lengths
The MXH932 supports both copper and active optical PCIe cables (AOC). Maximum lengths between two MXH932 cards can be
found in Table 1 below. The maximum distance may change when connecting to other PCIe products.
Cable
Speed
Max Distance
Copper PCIe 4.0 cables
Gen4
4 meters (5 meters being qualified)
Copper PCIe 3.0 cable
Gen4
3 meters
PCIe Active Optical cables (AOC)
Gen3/Gen4
TBD (Contact Dolphin)
Table 1: Cable Specifications
Disconnecting the Cable
Please carefully pull the release tab to release the cable from the locking latches and gently pull the cable out of the connector
guides.
Step 7 - Verify Installation & LEDs
The MXH932 comes with 4 bi-color LEDs which show the corresponding cable port status according to Table 2: LED below.
The LEDs are visible through cut-outs in the PCIe bracket on each side of the cable connector block.
LED color
Function
Off
No cable installed
Yellow
Cable installed, no link
Green
Cable installed, link operational
Table 2: LED behavior