OSS OSS-KIT-EXP-61611-xM User manual

PCIe x16 Gen4 Host to Target Kit (61611)
Model: OSS-KIT-EXP-61611-xM
www.onestopsystems.com
PCIe x16 Gen4 Host to Target Kit- Installation Manual
SKU: OSS-KIT-EXP-61611-XM

One Stop Systems
OSS-KIT-EXP-61611-XM | 2
Table of Contents
Preface 4
Advisories 4
Safety Instructions 5
1 Introduction 7
1.1 Specifications 7
1.2 Parts of HIB616-x16 8
1.2.1 x4 cable Ports 8
1.2.2 HIB card seated flat (horizontal position) 9
1.2.3 HIB card seated in a vertical position 9
1.2.4 HIB Block Diagrams 10
1.2.5 Pin out assignments of the SFF-8644 PCB Connectors 11
1.2.6 Signal Descriptions 12
1.3 Features 12
1.3.1 Host Interface Board 12
1.4 SFF-8644 PCIe cable 13
2 Hardware Requirements 14
2.1 OSS-PCIe-HIB616-x16 card 14
2.2 SFF-8644 Gen4 x4 Cable 14
2.3 Expansion Chassis / Gen4 Backplane 14
2.4 Host Card Mode Configuration 15
2.5 Target Card Mode Configuration 16
2.5.1 Target mode switch settings - OSS-Backplane 16
2.5.2 Target mode switch settings - Magma-Backplane 16
2.6 Supported Setup 17
2.7 Use Cases / Configurations 17
2.7.1 Host-to-Host 17
2.7.2 Using 3rd Party Target Backplane 18
2.7.3 Connecting to 3rd Party backplane via on-board SFF-8644 connector 18
3 Installation Procedures 19
3.1 Tools Required for Installation 19
3.2 Configure Card to Host and Target modes 19
3.3 Install the Target card 19
3.4 Install the Host card 21
3.5 Connecting the Link Cables 22
3.5.1 x16 configuration: FOUR cables 22
3.5.2 x8 configuration: TWO cables 22
3.5.3 x4 Configuration: ONE cable 23
3.5.4 Disconnecting the cable 25

One Stop Systems
OSS-KIT-EXP-61611-XM | 3
3.6 Turn ON the Expansion system / unit 25
3.7 Turn ON the Host computer 26
3.8 Verify LINK 26
3.9 LED Indicators per Configuration 26
3.9.1 x16 Configuration LEDs 26
3.9.2 x8 Configuration LEDs (Two Cables) 27
3.9.3 x4 Configuration LEDs (One Cable) 29
4 Hardware & Technical Info 31
4.1 LED Definitions 31
4.2 Dipswitch Settings 31
4.3 Standard & Bifurcated Configurations 32
4.3.1 Standard Configurations 32
4.3.2 Bifurcated configurations 33
5 Identify HIB Device 36
5.1 Linux OS 36
5.2 Windows 10 / Server 39
6 Software Installation 41
7 Troubleshooting 42
7.1 Device is not detected or recognized 42
7.2 Broken OSS-518 Board 42
7.3 Intermittent start up issue and PCIe cards are not getting recognized 42
7.4 Third Party Hardware and Software Support 43
7.5 There is no LINK between Host and Target 43
7.6 Does the OSS-518 board (Gen4 PCIe x16 Adapter card) support CMI Operation (Remote Power Power ON)? 43
8 How to Get More Help 44
8.1 Contacting Technical Support 44
8.2 Returning Merchandise 44
8.3 Third Party Hardware & Software Support Policy 44
8.4 Online Support Resources 45

One Stop Systems
OSS-KIT-EXP-61611-XM | 4
Preface
Advisories
Five types of advisories are used throughout this manual to provide helpful information, or to alert you to the potential for hardware damage
or personal injury.
NOTE
Used to amplify or explain a comment related to procedural steps or text.
IMPORTANT
Used to indicate an important piece of information or special “tip” to help you
CAUTION
Used to indicate and prevent the following procedure or step from causing damage to the equipment.
WARNING
Used to indicate and prevent the following step from causing injury.
DANGER or STOP
Used to indicate and prevent the following step from causing serious injury or significant data loss
Disclaimer: We have attempted to identify most situations that may pose a danger, warning, or caution condition in this manual. However, the
company does not claim to have covered all situations that might require the use of a Caution, Warning, or Danger indicator.

One Stop Systems
OSS-KIT-EXP-61611-XM | 5
Safety Instructions
Always use caution when servicing any electrical component. Before handling the expansion chassis, read the following instructions and safety
guidelines to prevent damage to the product and to ensure your own personal safety. Refer to the “Advisories” section for advisory
conventions used in this manual, including the distinction between Danger, Warning, Caution, Important, and Note.
Always use caution when handling/operating the computer. Only qualified, experienced, authorized electronics personnel should
access the interior of the computer and expansion chassis per UL and IEC 60950-1
The power supplies produce high voltages and energy hazards, which can cause bodily harm.
Use extreme caution when installing or removing components. Refer to the installation instructions in this manual for precautions
and procedures. If you have any questions, please contact Technical Support.
WARNING
Never modify or remove the radio frequency interference shielding from your workstation or expansion unit. To do so may
cause your installation to produce emissions that could interfere with other electronic equipment in the area of your
system.
When Working Inside a Computer
1. Before taking covers off a computer, perform the following steps:
2. Turn off the computer and any peripheral devices.
3. Disconnect the computer and peripheral power cords from their AC outlets or inlets in order to prevent electric shock or system
board damage.
In addition, take note of these safety guidelines when appropriate:
To help avoid possible damage to systems boards, wait five seconds after turning off the computer before removing a component,
removing a system board, or disconnecting a peripheral device from the computer.
When you disconnect a cable, pull on its connector or on its strain-relief loop, not on the cable itself. Some cables have a connector
with locking tabs. If you are disconnecting this type of cable, press in on the locking tabs before disconnecting the cable. As you pull
connectors apart, keep them evenly aligned to avoid bending any connector pins. Also, before connecting a cable, make sure both
connectors are correctly oriented and aligned.
CAUTION
Do not attempt to service the system yourself except as explained in this manual. Follow installation
instructions closely.

One Stop Systems
OSS-KIT-EXP-61611-XM | 6
Protecting Against Electrostatic Discharge
Electrostatic Discharge (ESD) Warning
Electrostatic Discharge (ESD) is the enemy of semiconductor devices. You should always take precautions to eliminate any
electrostatic charge from your body and clothing before touching any semiconductor device or card by using an
electrostatic wrist strap and/or rubber mat.
Static electricity can harm system boards. Perform service at an ESD workstation and follow proper ESD procedures to reduce the risk of
damage to components. We strongly encourage you to follow proper ESD procedures, which can include wrist straps and smocks, when
servicing equipment.
You can also take the following steps to prevent damage from electrostatic discharge (ESD):
When unpacking a static-sensitive component from its shipping carton, do not remove the component’s anti-static packaging
material until you are ready to install the component in a computer. Just before unwrapping the anti-static packaging, be sure you
are at an ESD workstation or are grounded.
When transporting a sensitive component, first place it in an anti-static container or packaging.
Handle all sensitive components at an ESD workstation. If possible, use anti-static floor pads and workbench pads.
Handle components and boards with care. Do not touch the components or contacts on a board. Hold a board by its edges or by its
metal mounting bracket.

One Stop Systems
OSS-KIT-EXP-61611-XM | 7
1 Introduction
The PCIe x16 Gen 4 expansion kit connects a server to an OSS Expansion Backplane.
It is composed of a “Gen4 Mini-HD SFF-8644 PCIe cable (SKU# OSS-mSAS-CBL-x4-C-XM)” and two “PCIe x16 Gen 4 Cable Adapter (SKU: OSS-
PCIe-HIB616-x16)”.
The PCIe x16 Gen 4 host cable adapter plugs into a server and cables to a PCIe x16 Gen 4 switch-based target cable adapter. The expansion kit
connects with up to (4) x4, 1 meter SFF-8644 PCIe Gen 4 compliant cables.
1.1 Specifications
Item
Description
Form Factor
PCIe 4.0 x16 half-height, half-length
Adapter Card Dimensions
6.6 x 2.65" (16.76 x 6.73 cm) at 0.063" (1.6mm) thickness
Bandwidth
256Gb/s
Connectors
• PCIe x16 card edge connector
• Quad SFF-8644 connectors on the bracket
• Compliant to PCI-SIG PCI Express External Cable Specification 3.0
Bracket
Standard and low profile brackets available
PCIe Switch
Broadcom PEX88032
16 GT/s /32-Lane PCI Express Gen 4 Switch
DMA Controller
SSC Isolation
Switch Latency
150ns
Cable Types
Supports the following cable types:
SFF-8644 PCIe CMI copper cables
Mini-SAS-HD copper cables
Cable Connection Modes
One x16 host connection via edge card to:
One x16 cable connection
Up to two x8 cable connections
Up to four x4 cable connections
Power
60W max
1.5A @3.3V
3A @12V
250mA @ 3.3V aux
Operating Temperature
0˚C to +50˚C
Storage Temperature
-40˚C to 85˚C
Operating Humidity
10% to 90% relative humidity non-condensing
Storage Humidity
5% to 95% relative humidity non-condensing
Agency Compliance
Designed to meet the following agency standards:
FCC - Part 15 Class A, 47CFR; Canada ICES-003, issue 4, Class A; Japan: VCCI, Class A; CE
Emissions 2004-108EC
UL/IEC 60950-1; Canada: CSA C22.2 No. 60950-1; Argentina: IEC60950-z; IEC 60950-1 (CB
Certificate and CB Test Report)
CE Mark (EN55022 Class A, EN60950-1, EN55024, EN61000-3-2, EN61000-3-3)
CISPR 22, CISPR 24, Class A: Australia/New Zealand AS/NZS CISPR 22, ClassA
RoHS 6 of 6 compliance (Directive 2011/95/EC)
Operating System
Supports the following OS
Windows 7, 10, Windows Server 2012 R2
Linux Based OS

One Stop Systems
OSS-KIT-EXP-61611-XM | 8
When ordering the Gen4 x16 PCIe HIB card and Gen4 SFF-8644 PCIe cable, use the following part numbers:
Part Numbers
Description
OSS-PCIe-HIB616-x16 ( main part#)
HIB616-x16 Host Configuration with Full-height bracket
OSS-PCIe-HIB616-x16-Half
HIB616-x16 Host Configuration with Half-height bracket
OSS-PCIe-HIB616-x16-T
HIB616-x16 Target configuration with Full-height bracket
OSS-PCIe-HIB616-x16-T-Half
HIB616-x16 Target configuration with Half-height bracket
OSS-mSAS4-CBL-x4-C-XM
Mini HD SaS Cable
OSS-mSAS4-CBL-x4-C-1M
1 meter Gen4 Cable
OSS-mSAS4-CBL-x4-C-2M
2 meter Gen4 Cable
OSS-mSAS4-CBL-x4-C-3M
3 meter Gen4 Cable
1.2 Parts of HIB616-x16
1.2.1 x4 cable Ports
There are four x4 cable ports available on the HIB card. It is very important to know where port#0 is when connecting a single x4 PCIe SFF-8644
cable. Port #0 is the connector nearest the Link LEDs. A single x4 SFF-8644 cable must be inserted into port#0 of the Target card all the time.
For the Host card, you can plug in a single x4 cable to any port as long as the Host card switch is set to operate in a x4 mode.
When using two x4 SFF-8644 cables, it must be connected to port#0 and port#1 of the Target card only. For the Host card, you can plug-in the
two cables to port#0 and portt#1 OR port#2 and port#3.
Below are photos of the HIB cards in a different position when plugged into a PCIe slot. This will serve as a guide in determining where port#0
is located.

One Stop Systems
OSS-KIT-EXP-61611-XM | 9
1.2.2 HIB card seated flat (horizontal position)
1.2.3 HIB card seated in a vertical position

One Stop Systems
OSS-KIT-EXP-61611-XM | 10
1.2.4 HIB Block Diagrams
Target Card
Host card

One Stop Systems
OSS-KIT-EXP-61611-XM | 11
1.2.5 Pin out assignments of the SFF-8644 PCB Connectors
Connector 0 and 1
Connector 2 and 3

One Stop Systems
OSS-KIT-EXP-61611-XM | 12
1.2.6 Signal Descriptions
PETpN/PETnN: PCI Express Transmitter pairs, labeled where N is the Lane number (starting with 0); “p” is the true signal while “n” is the
complement signal.
PERpN/PERnN: PCI Express Receiver pairs, labeled where N is the Lane number (starting with 0); “p” is the true signal while “n” is the
complement signal
PWR: Power provisioning to the connector backshell is provided to allow for signal conditioning components within the cable assembly. A wire
must not be provided within the cable. 345
MGTPWR: Power supplied to the connector backshell for cable management components that are needed while the link is not active. This
needs to be active if the Subsystem has power. A wire must not be provided within the cable.
CBLPRSNT#: Cable present detect, an active-low signal pulled-down by the Free-Side when it is inserted into the Fixed-Side Connector. A wire
must not be provided within the cable. 350
CADDR: This signal is used to configure the Upstream cable management device address. A wire must not be provided within the cable.
CINT#: This signal is asserted by the cable assembly to indicate a need for service via the Cable Management Interface controller. A wire must
not be provided within the cable.
CMISDA: Management interface data line. Used for both initial link setup and sideband 355 messages when used with proper cables.
CMISCL: Management interface clock line. Used for both initial link setup and sideband messages when used with proper cables
CMICLK: same as CMISCL
CMIDAT: same as CMISDA
GND (Ground): Shield for differential pairs
1.3 Features
1.3.1 Host Interface Board
The HIB is provided with either a standard or low profile PCIe bracket type and has the following features:
PCI Express interface that is compatible with the PCI Express Specification, revision 4.0.
PCI Express 4.0 compliant x16 host and target interfaces.
Compatibility with the PCIe Low Profile standards and PCIe 4.0 CEM standard.
Operates at up to 256Gb/s at PCIe Gen4 speeds.
No driver required.
Uses mini-SAS HD or PCIe SFF-8644 cables.
Simplified cabling with a point-to-point, serial architecture.
Operates in Host and Target modes
Support PCIe Bifurcation

One Stop Systems
OSS-KIT-EXP-61611-XM | 13
1.4 SFF-8644 PCIe cable
Gen4 High speed signaling cable up to 3m in length. This passive copper cable mates to the SFF-8644 connectors on the HIB6xx family of OSS
host interface boards and includes the CMI (cable management interface) and serialized EEPROMs in the cable backshell.
x4, one cable
x8, two cables
x16, 4 cables
Allows transfers to and from the host up to 6GB/s
*Gen 4 cables are REQUIRED to support Gen 4 bandwidth and OSS Gen 4 products.
Specifications
Cable Lengths
1m, 2m, 3m
Cable Options
x4 (1 cable)
x8 (2 cables)
x16 (4 cables)
Wire Size AWG
28-30
Bend Radius
4.0" cable bend radius
Agency Compliance
CE, WEEE, RoHS2

One Stop Systems
OSS-KIT-EXP-61611-XM | 14
2 Hardware Requirements
1. OSS-PCIe-HIB616-x16 card configured as a Host
2. OSS-PCIe-HIB616-x16 card configured as a Target
3. SFF-8644 Gen 4 PCIe x4 cable
a. x16 Configuration: Four PCIe Gen4 cables
b. X8 Configuration: Two PCIe Gen4 cables
c. X4 Configuration: One PCIe Gen4 cable
4. Gen4 x16 PCIe slot (computer motherboard)
5. OSS Expansion Chassis / OSS Gen4 Backplane
2.1 OSS-PCIe-HIB616-x16 card
A pair of HIB616-x16 card, one is configured as a host card and the other is configured as a target card.
2.2 SFF-8644 Gen4 x4 Cable
This passive copper cable mates to the SFF-8644 connectors on the HIB6xx family of OSS host interface board.
Tested and validated with 1m, 2m and 3m lengths
Single or multiple cables can form larger PCIe links
ox4 (1 cable)
ox8 (2 cables)
oX16 (4 cables)
The cable that we qualified is the PCIe Gen 4 x4 (with GREEN tab), see photo below. The FPGA in the HIB616-x16 card does not support CMI
operations.
2.3 Expansion Chassis / Gen4 Backplane

One Stop Systems
OSS-KIT-EXP-61611-XM | 15
2.4 Host Card Mode Configuration
x16 Dip switch Settings:
SW1 #2 = ON; #5 =ON.
SW2 #1 = ON; #2 = ON
x8 Dip switch Settings:
SW1 #2 = ON; #5 = ON
SW2 #1 = OFF; #2 = ON or #2 = OFF and #1 = ON
x4 Dip switch Settings:
SW1 #2 = ON; #5 = ON
SW2 = All OFF

One Stop Systems
OSS-KIT-EXP-61611-XM | 16
2.5 Target Card Mode Configuration
SW1 #1 = ON; #2= ON
SW2 = All OFF
2.5.1 Target mode switch settings - OSS-Backplane
Use the switch settings below when using the OSS backplane.
2.5.2 Target mode switch settings - Magma-Backplane
When using the legacy or Magma backplane, use the switch settings below for Target mode
If Target card is not linking up, you can set SW1-5 to ON position, see photo below.

One Stop Systems
OSS-KIT-EXP-61611-XM | 17
2.6 Configuration / Setup
The diagram or drawing below shows how to setup and use the hardware kit.
2.7 Supported Setup
Using a set of OSS-PCIe-HIB616-x16 card (Target and Host cards), OSS Gen4 backplane and PCIe Gen4 cables.
2.8 Use Cases / Configurations
2.8.1 Host-to-Host
This configuration is NOT supported. The OSS-518 board (HIB616-x16 card) is not programmed for this option nor will it work from hardware
standpoint.

One Stop Systems
OSS-KIT-EXP-61611-XM | 18
2.8.2 Using 3rd Party Target Backplane
This configuration can be supported with appropriate switch confirmation. The OSS- 518 card typically outputs REFCLK on pins A6 and A7
which is not PCI standard. This can be changed by using the OSS switch (SW1-4). The OSS-518 outputs POWER_ON signal on a Reserved PCI
pin. If customer expects remote turn ON, then they need to add that to their backplane, otherwise, they need to turn on the backplane power
(not just AUX) before powering on host.
.
2.8.3 Connecting to 3rd Party backplane via on-board SFF-8644 connector
This should work as long as the 3rd party backplane creates its own REFCLK, Reset and is powered on first. If issue arises, we do not provide
support on the 3rd party backplane.
Note: The customer or the end-user is solely responsible for troubleshooting their 3rd party backplane.

One Stop Systems
OSS-KIT-EXP-61611-XM | 19
3 Installation Procedures
The following steps will guide you through the installation of your OSS HIB616-x16 card.
3.1 Tools Required for Installation
To complete the installation of the OSS product you will need a Phillips-head screwdriver and ESD wrist strap to prevent electrostatic discharge.
3.2 Configure Card to Host and Target modes
Set the switches on the card for the desired operating mode. See Host and Target cards configuration section for more details.
Photos below are Host and Target mode settings
The Host card is installed in the host computer.
The Target card is installed in the expansion OSS backplane. The card is must be installed in a target slot.
3.3 Install the Target card
In this example, a Gen4 backplane is used with this setup.

One Stop Systems
OSS-KIT-EXP-61611-XM | 20
Do not plug in the Target card while the board or the unit is ON or has power. Disconnect the power first prior to installing the
card.
Install the Target card in the x16 PCIe upstream slot / target slot on the expansion board.
Note: Do not plug a Target-configured card in a downstream slot. The Target card will not function in a downstream slot and
may cause damage.
Secure the card by screwing the card-bracket to the chassis.