Dolphin MXP909 User manual

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 1
PXIe x8 Transparent Cable Module MXP909
MXP909 - PXIe PCIe x8 Gen4 Transparent Peripheral Module Users Guide
Version 1.1
Date: 6th May 2022

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 2

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 3
Table of Contents
DISCLAIMER................................................................................................................................................................ 4
TERMS AND ACRONYMS............................................................................................................................................. 5
MXP909 PXIE MODULE HIGH LEVEL SPECIFICATION ................................................................................................... 6
PACKAGING ................................................................................................................................................................ 6
PXIE SLOT ..........................................................................................................................................................................6
MXP909 MODULE CONFIGURATION....................................................................................................................................... 6
Thermal Shutdown....................................................................................................................................................... 6
AIRFLOW -OPERATING ENVIRONMENT ....................................................................................................................................7
CABLE CONNECTIONS............................................................................................................................................................ 7
PCI Express 4.0 Cables.................................................................................................................................................. 7
Active Optical PCIe Cables (AOC) ................................................................................................................................. 7
INSTALLATION ............................................................................................................................................................ 8
STEP 1-UNPACK BOARD .......................................................................................................................................................8
STEP 2-CONFIGURE THE BOARD FOR PROPER OPERATION ..........................................................................................................8
STEP 3-ENSURE PROPER AIRFLOW .........................................................................................................................................8
STEP 4-INSTALL THE MXP909 MODULE..................................................................................................................................8
STEP 5-INSTALLING AND REMOVING THE CABLE........................................................................................................................8
Connecting the Cable................................................................................................................................................... 8
Cable stain relief .......................................................................................................................................................... 8
Supported cable lengths .............................................................................................................................................. 8
Disconnecting the Cable .............................................................................................................................................. 9
STEP 7-VERIFY INSTALLATION &LEDS.................................................................................................................................... 9
OPERATION ...............................................................................................................................................................10
CONFIGURATION AND DIP SWITCHES.....................................................................................................................................10
DIP Switches............................................................................................................................................................... 10
DIP-Switch SW1 settings............................................................................................................................................ 10
DIP-Switch SW2 settings............................................................................................................................................ 10
DIP Switch settings for MXP909 PXIe module operation –DIP-Switch-1................................................................... 11
USE CASES........................................................................................................................................................................12
Use Case A - Connecting two PXIe chassis –PCIe Gen 4.0 x8 .................................................................................... 12
Use Case B –Connecting tree PXIe chassis –PCIe Gen 4.0 x4 ................................................................................... 12
FIRMWARE UPGRADE.......................................................................................................................................................... 13
IDENTIFYING THE PXIE MODULE ............................................................................................................................................13
SUPPORT..........................................................................................................................................................................14
TECHNICAL INFORMATION ........................................................................................................................................14
BOARD REVISION HISTORY....................................................................................................................................................14
PCIE CABLE PORT SIGNALS ..................................................................................................................................................14
EXTERNAL PCIE X4CABLE CONNECTOR PIN-OUT .....................................................................................................................14
PCIE CABLE PORT MAPPING ................................................................................................................................................14
COMPLIANCE AND REGULATORY TESTING.................................................................................................................15
LIMITED WARRANTY..................................................................................................................................................16
WARRANTY PERIOD............................................................................................................................................................ 16
COVERAGE........................................................................................................................................................................16
SERVICE PROCEDURE ..........................................................................................................................................................16

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 4
DISCLAIMER
DOLPHIN INTERCONNECT SOLUTIONS RESERVES THE RIGHT TO MAKE CHANGES WITHOUT FURTHER NOTICE TO ANY OF ITS
PRODUCTS TO IMPROVE RELIABILITY, FUNCTION, OR DESIGN.
DO NOT USE INFORMATION IN THIS GUIDE TO DESIGN YOUR OWN PCI-SIG COMPLIANT PRODUCT, ALWAYS REFERENCE THE
ORIGINAL PCI-SIG SPECIFICAITON FOR DETAILS.
TO THE FULLEST EXTENT PERMITTED BY LAW, DOLPHIN WILL NOT BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL OR
CONSEQUENTIAL DAMAGES (INCLUDING LOST PROFITS, LOST DATA, OR LOSS OF USE) ARISING OUT OF ANY USE OF DOLPHIN’S
PRODUCTS, SOFTWARE OR SERVICE PROVIDED. DOLPHIN’S MAXIMUM LIABILITY WILL NOT EXCEED THE TOTAL AMOUNT PAID FOR
THE PRODUCT BY THE PURCHASER.
PCI Express External Cabling specification 4.0 is, as of the release of MXP909 PXIe module, not completed and ratified by the PCI-
SIG. The MXP909 PXIe x8 cable module is designed to the new specification, but Dolphin cannot guarantee the card will be
compliant to the final 3.0 version. Dolphin firmware tools can update the CMI implementation.
LIFE SUPPORT POLICY
DOLPHIN INTERCONNECT SOLUTIONS’ PRODUCTS ARE NOT AUTHORIZED FOR USE AS CRITICAL COMPONENTS IN LIFE SUPPORT
DEVICES.
ENVIRONMENTAL POLICY
Dolphin is minimizing the amount of printed documentation and software CDs in its shipments; please download additional
documentation and software from www.dolphinics.com.
Scope
This version of the MXP909 PXIe module Users Guide is valid for BMC firmware version 2.4 and newer.

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 5
Terms and Acronyms
Important terms and acronyms used in this manual
AOC Active Optical Cable. PCIe fiber cable assembly available from Dolphin.
CMI Cable Management Interface. The 2-wire management interface for communication between subsystems
connected by a PCIe 4.0 cable. Details can be found in the PCI-SIG External Cabling Specification 4.0 (draft).
BMC Board Management Controller - Microcontroller on the MXP909 PXIe module used to manage and implement
the CMI communications.
eXpressWare Dolphin’s software stack for PCIe clustering and IO. Please visit http://www.dolphinics.com/software for more
information.
Lane One PCI Express Lane contains a differential pair for transmission and a differential pair for reception.
Link A collection of one or more PCI Express Lanes providing the communication path between an Upstream and
Downstream Port.
PCIe 4.0 cable Cable compliant to the preliminary PCI-SIG External Cabling Specification 4.0. Support for CMI.
Port PCIe Cable port. The MXP909 PXIe module has four x4 ports, named P1, P2, P3, P4. Ports P1 and P2 can be
merged to one x8 port. Ports P3 and P4 are unused. The physical ports are identified by text on the PCIe
brackets.
Wake A mechanism used by a downstream device to request the reapplication of PC main power when in the L2 Link
state / Power mode.

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 6
MXP909 PXIe Module High Level Specification
The MXP909 is a PXIe peripheral Transparent PCIe x8 Gen4 cable module and supports PCIe downlink connections to other PXIe
chassis with a MXP924 or any other compliant PCIe transparent target device. The MXP909 supports PCIe Gen1, Gen2, Gen3 and
Gen4 speeds and x1, x2, x4 and x8 link-widths. The module will operate at the highest common speed shared between the slot and
the card (Gen4) and the widest common link-width up to x8.
•PCI Express Base Specification, Rev. 4.0
•PCI Express External Cabling specification 4.0 (draft)
•PCI Express Gen4 16.0 GT/s per lane signaling –128 GT/s total signaling.
•Compliant with PCI Express Gen1 through Gen4 IO systems, auto detection
•The MXP909 supports transparent connections to IO systems (Host operation)
•Quad SFF-8644 cable connector
oTwo upper ports enabled for PCIe connectivity
oTwo lower ports reserved for future use
oDurability max total 250 mating cycles
•Support for two PCIe 4.0 SFF-8644 cables.
•Microchip Switchtec PM40028 PFX PCI Express Gen4 chipset
•100 nanosecond cut-through latency port to port.
•Automatic Thermal Shutdown to avoid hardware damages (can be disabled)
•Support for active optical PCIe complaint fibers (AOC)
•Single Peripheral Slot 3U PXI Express, compliant to PXI -5 PXI Express Hardware Specification rev 1.1
•SRNS clocking, Prepared for SRIS clocking
•VAUX powered board management controllers for flexible configuration and cable management
•Flash recovery option. PFX Multi configuration support
•Relative Humidity: 5% - 95% (non- condensing)
•CE and FCC markings
•Made in Norway
Packaging
The MXP909 product is delivered in a retail box includes the following components.
•MXP909 module
•Anti-static bag
•Getting started guide
PXIe Slot
The MXP909 module can be placed in any compliant PXIe slots. The MXP909 supports PCIe Gen1, Gen2, Gen3 and Gen4 speeds.
The default PXIe backplane configuration is x8. The module will auto configure to the slot speed and width.
MXP909 Module Configuration
The MXP909 cable ports can either be used as a single x4 / x8 or dual x4 port configuration.
The default DIP switch setting is transparent single x4 or single x8 operations. The lower two connectors marked P3 an P4 is not in
use.
Thermal Shutdown
The MXP909 module includes an overtemperature overheat protection. The BMC will automatically shut down the MXP909 module
if a PCIe switch temperature beyond 105°C (221°F) is detected. Similar, if an AOC is plugged in, the MXP990 module will
automatically shut down if the max operating temperature announced by the connected AOC is violated by 15°C (59°F). Please
consult the AOC data sheet for details. Please consult the AOC data sheet for details.
NOTE: The MXP909 module link LEDs will start flashing yellow when a PCIe switch temperature of 95°C (203°F) is reached or when
the AOC reports a temperature 5°C (41°F) lower than the max operating temperature.
NOTE: The automatic shutdown can be disabled by setting DIP switch SW2-4. Prior to disabling the automatic shutdown, please
ensure you have established proper airflow.

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 7
Airflow - Operating Environment
To maximize lifetime for the product and maintain the warranty, please honor the specified operating temperature, and make sure
the specified air flow is present.
TIP: After installing the Dolphin eXpressWare board management software, you can use the tool dis_diag to determine the actual
board temperatures.
Cable Connections
The MXP909 module is designed to support both long and short PCIe copper cables as well as PCIe active optical cables (AOC).
The MXP924 cable ports are compliant to the SFF-8644 industry specification and supports PCIe cables compliant to the PCIe
External Cabling Specification 4.0. Two x4 cables are needed for full PCIe x8 connectivity. (Ports P3 and P4 are unused)
PCI Express 4.0 Cables
When used with cables compliant to the new PCIe External Cable standard 4.0, the MXP909 module will transmit a CMI Reset
message downstream. The module can be connected to a MXP924 module in Target mode or any PCIe device compliant to the new
cable standard.
CMI Functionality
The MXP909 module BMC firmware release 2.4 and newer supports the following CMI operations when used with PCIe 4.0 cables:
•Publishes card and CMI status information in readable memory map
•Supports sending CMI reset, wake and power status messages
•Supports receiving indicators (LED/messages).
Active Optical PCIe Cables (AOC)
Dolphin offers active optical PCIe fiber cables up to 100 meters for the MXP909. CWAKE and CPOWERON is not supported using
standard PCIe AOC cables.

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 8
Installation
Step 1 - Unpack board
The MXP909 module module is shipped in an anti-static bag to prevent static electricity damage. The module should only be
removed from the bag after ensuring that anti-static precautions are taken. Static electricity from your clothes or
work environment can damage your MXP909 module or other PXIe components. Always wear a grounded anti-static
wrist strap while the MXP909 module is removed from the anti-static bag until it is properly installed in the PXIe
chassis.
Unpack the MXP909 module from the anti-static bag using proper anti-static procedures.
Step 2 - Configure the Board for Proper Operation
Set the DIP switch settings for proper operation depends on the firmware. Please refer to the section Configuration and DIP
Switches on page 10 for details.
Step 3 - Ensure proper Airflow
Please pay proper attention to ensure the selected server / slot position provides the minimum required airflow.
TIP: Immediately after software installation, please use the dis_diag tool to verify the temperature. If the chip temperature
reported by dis_diag exceeds 95°C, it is strongly recommended to improve the airflow.
Step 4 - Install the MXP909 module
Before installing the module, make sure you are properly grounded to avoid static discharges that may destroy your computer or
the PXIe module. Ensure you are properly grounded before opening your PXIe chassis or the anti-static bag
containing the MXP909 module. Please follow your PXIe chassis manual on how to install a PXIe System switch
module.
The MXP909 PXIe module supports PCI Express Gen1, Gen2, Gen3 and Gen4 backplanes. Please review the list of supported and
approved PXIe chassis
Step 5 - Installing and Removing the Cable
Installing and removing cables should be done with the PXIe chassis powered off.
Connecting the Cable
Please carefully install the cable connector into the connector housing on the MXP909 module. Cable port 1 is located at the top of
the face plate bracket. To install the cable, match the cable house with the connector on the MXP909 module. Use even pressure
to insert the connector until it is secure. Adhere to ESD guidelines when installing the cables to ensure you don’t damage the board.
Computer cables should always use strain relief to protect the connected equipment from excessive force on the cable. This is
especially important for cables between racks.
Cable stain relief
Strain-relief on the PCIe cables are important to protect the PCIe card from fatigue loading and damages. The cable should be
mechanically connected to the rack or cabinet. This is especially important for long heavy cables and cables going between cabinets
and racks.
Supported cable lengths
The MXP909 module supports both copper and active optical PCIe cables (AOC). Maximum lengths between two modules can be
found in Table 1 below. The maximum distance may change when connecting to other PCIe products.
Cable
Speed
Max Distance
Copper PCIe 4.0 cables
Gen4
3 meters (4-5 meters being qualified)
PCIe Active Optical cables (AOC)
Gen4
100 meters
Table 1: Cable Specifications

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 9
Disconnecting the Cable
Please carefully pull the release tab to release the cable from the locking latches and gently pull the cable out of the connector
guides.
Step 7 - Verify Installation & LEDs
The MXP909 PXIe module comes with 4 RGB LEDs which show the corresponding cable port status according to Table 2: LED
below. The LEDs are visible through cut-outs in the front panel below each port.
LED color
Function
Off
No cable installed, or PXIe not powered
Yellow
Cable installed, no link
Yellow blinking
Temperature overheat warning, please immediately improve cooling to
avoid thermal damages or system shutdown.
White
Cable installed, link operational Gen1 speed
Blue
Cable installed, link operational Gen2 speed
Green blinking
Cable installed, link operational Gen3 speed
Green
Cable installed, link operational Gen4 speed
Red blink
Link Reset
Table 2: LED behavior

MXP909 PXIe module User’s Guide – Dolphin Interconnect Solutions Page 10
Operation
Configuration and DIP Switches
The MXP909 module has two banks of 8 DIP switches. The default factory setting for the MXP909 module is Transparent Host
mode, single (up to x8) link connection.
The MXP909 module has DIP switches for setting special modes or operations, the meaning of each DIP switch depends on the
loaded firmware. Please carefully read the documentation shipped with the module before modifying any DIP switch settings.
Please pay close attention to ON and OFF positions written on the DIP switch.
DIP Switches
Please leave all undocumented DIP switches in the default position. Table 3: DIP SW1 settings and Table 4: DIP-SW2 settings below
shows all the various DIP switch settings for the MXP909 module.
Note: DIP switch configuration options may be changed in the future versions. Please always consult the latest user guide
for details. The table above is valid for version 1.5.
DIP-Switch SW1 settings
SW1 DIP
no.
Description
ON
OFF
Default
1-8
Configuration selector, details
below
OFF
Table 3: DIP SW1 settings
DIP-Switch SW2 settings
SW2 DIP
no.
Description
ON
OFF
Default
1
Reserved, leave in Default OFF
OFF
2
Enable Wake
Enable PCIe WAKE
PCIe Wake Disabled
OFF
3
Reserved, leave in Default OFF
OFF
4
Disable thermal shutdown
Thermal shutdown
disabled
Shut down the switch if
critical temperature
reached.
OFF
5-8
Reserved, leave in Default OFF
OFF
Table 4: DIP-SW2 settings