OSS 4UP 16-SLOT GEN4 User manual

INSTALLATION GUIDE
4UP 16-SLOT GEN4
4UP 16-SLOT Gen4
www.onestopsystems.com

One Stop Systems
4U Pro 16 Slot 2
Table of Contents
1General Specifications.................................................................................................................................................... 5
1.1 Features ....................................................................................................................................................................................................6
1.2 4UP Architecture (16 Slot).........................................................................................................................................................................6
1.3 PCIe Slots ..................................................................................................................................................................................................7
1.4 Backplane Block Diagram..........................................................................................................................................................................7
1.5 Dimensions................................................................................................................................................................................................8
1.6 Parts Overview.......................................................................................................................................................................................... 9
1.7 HIB x16 Gen 4 Card ................................................................................................................................................................................. 11
1.8 Backplane................................................................................................................................................................................................12
1.9 Slot Configurations..................................................................................................................................................................................13
1.10 Use Case Diagrams ............................................................................................................................................................................15
2Getting Started .............................................................................................................................................................17
3Installation Overview....................................................................................................................................................17
4Remove Top Cover ........................................................................................................................................................18
5Target Card Installation.................................................................................................................................................18
5.1 Target Card Configuration .................................................................................................................................................................19
6Host Card Installation....................................................................................................................................................20
6.1 Host Card Configuration..........................................................................................................................................................................20
6.2 Switch Settings........................................................................................................................................................................................22
7GPU / PCIe Cards Installation ........................................................................................................................................23
7.1 Install PCIe card / GPUs...........................................................................................................................................................................24
7.2 Connect Aux Power Cables......................................................................................................................................................................24
7.3 Auxiliary Cable Management ..................................................................................................................................................................25
8Connect Link Cables ......................................................................................................................................................26
8.1 Mini-SAS HD SFF-8644 Cable Installation ................................................................................................................................................26
8.1.1 x16 Configuration: FOUR cables ...................................................................................................................................................26
8.1.2 x8 Configuration: TWO cables ......................................................................................................................................................27
8.1.3 x4 Configuration: ONE cable.........................................................................................................................................................28
8.2 Disconnecting Mini-SAS HD SFF-8644 Cable............................................................................................................................................29
9Applying Power Correctly..............................................................................................................................................30
9.1 Connecting to electrical outlet................................................................................................................................................................30
9.2 Connect Power Cords..............................................................................................................................................................................30
10 Powering UP the Computer...........................................................................................................................................32
11 Hardware Check............................................................................................................................................................33
11.1 Verify Board LEDs ..............................................................................................................................................................................33
11.2 Fault LEDs (RED).................................................................................................................................................................................34

One Stop Systems
4U Pro 16 Slot 3
11.3 Verify Adapter Card LEDs...................................................................................................................................................................35
11.4 Adapter Card LED Definitions ............................................................................................................................................................36
11.5 Slot LEDs ............................................................................................................................................................................................36
11.6 Power Distribution Board LED ...........................................................................................................................................................37
11.7 Front LED ...........................................................................................................................................................................................37
11.8 Power Supply LED Indicator...............................................................................................................................................................38
12 Software Installation.....................................................................................................................................................39
12.1 Software Driver Installation...............................................................................................................................................................39
13 Verify HIB Device ..........................................................................................................................................................40
13.1 Linux OS.............................................................................................................................................................................................40
13.2 Windows 10 / Server .........................................................................................................................................................................42
14 Verify PCIe cards ...........................................................................................................................................................44
14.1 Linux ..................................................................................................................................................................................................44
14.2 Windows............................................................................................................................................................................................45
15 IPMI ..............................................................................................................................................................................47
15.1 Connect Ethernet Cables ...................................................................................................................................................................47
15.2 Locate Mac Address & IP Address......................................................................................................................................................48
15.3 Start Internet browser .......................................................................................................................................................................49
16 Important Technical Information...................................................................................................................................50
16.1 Upstream and Downstream Slots ......................................................................................................................................................50
16.2 Slot LEDs ............................................................................................................................................................................................50
16.3 Board LEDs.........................................................................................................................................................................................51
16.4 Slot Type............................................................................................................................................................................................51
16.5 PS_ON................................................................................................................................................................................................51
16.6 ARF6 Connector.................................................................................................................................................................................52
16.7 Slot Number and Port Mapping.........................................................................................................................................................53
16.8 Power Cords ......................................................................................................................................................................................54
16.8.1 Specifications ...............................................................................................................................................................................54
16.8.2 Power cord socket and voltage tables world standards ...............................................................................................................54
16.9 Power Supply.....................................................................................................................................................................................55
16.9.1 Removing AC Power Supply..........................................................................................................................................................56
16.9.2 Specifications ...............................................................................................................................................................................57
16.9.3 LED Indicator ................................................................................................................................................................................58
16.10 Fan .........................................................................................................................................................................................................59
16.10.1 Fan Specifications ...........................................................................................................................................................................59
16.10.2 How to remove Fan........................................................................................................................................................................60
16.11 Fan Foam Air Filter...........................................................................................................................................................................60
16.12 Auxiliary power cables.......................................................................................................................................................................61
16.12.1 Aux power cable installation...........................................................................................................................................................62

One Stop Systems
4U Pro 16 Slot 4
16.12.2 Pin Outs..........................................................................................................................................................................................63
16.12.3 Using the Auxiliary Power Cable ....................................................................................................................................................65
16.13 Expansion Unit Power Consumption .................................................................................................................................................67
16.14 Power consumption breakdown per hardware .................................................................................................................................67
17 Troubleshooting............................................................................................................................................................68
17.1 Device is not detected or recognized.................................................................................................................................................68
17.2 My PCIe devices are showing UP with a Yellow Exclamation mark....................................................................................................68
17.3 No link between host and target cards..............................................................................................................................................68
17.4 Broken OSS-Backplane.......................................................................................................................................................................69
17.5 My PCIe cards are not detected.........................................................................................................................................................69
18 How to Get More Help ..................................................................................................................................................69
18.1 Contacting Technical Support............................................................................................................................................................69
18.2 Returning Merchandise .....................................................................................................................................................................69
18.3 Third Party Hardware & Software Support Policy..............................................................................................................................70
18.4 Online Support Resources .................................................................................................................................................................70

One Stop Systems
4U Pro 16 Slot 5
1 General Specifications
Item Description
Enclosure Dimensions: 17.2” x 7” x 18.5” (4U)
Net weight 38 lbs
Host Options 1x PCIe x4 x16 Host-to-Target uplink (32GB/s)
2x PCIe x4 x16 Host-to-Target uplinks (64GB/s)
4x PCIex4 x16 Host-to-Target uplinks (128 GB/s)
SmartNIC Host
Backplane Options Single OSS-521:
• 1x single-width PCIe 4.0 x 16 FHFL upstream slot
• 6x single-width PCIe 4.0 x16 FHFL downstream slots
• 1x dual-width PCIe 4.0 x16 FHFL downstream slot
Dual OSS-521:
• 2x single-width PCIe 4.0 x 16 FHFL upstream slot
• 12x single-width PCIe 4.0 x16 FHFL downstream slots (6x per upstream)
• 2x dual-width PCIe 4.0 x16 FHFL downstream slot (1x per upstream)
Additional Slot Options Standard
• Modifies one dual-width PCIe 4.0 x16 FHFL downstream slot to two single-width PCIe 4.0 x16 FHFL downstream
slots per backplane
Riser
• Adds and additional single-width PCIe 4.0 PCIe 4.0 FHFL downstream slot per backplane
Linked
• Links two backplanes together so all slots are downstream to a single upstream
Cooling Operational Temperature: 0-35°C
Operational Humidity: 10-90% relative humidity
Operational Altitude: 0-10,000 feet above sea level
Storage Temperature: -40°C - 71°C
Fans:
•3x 180CFM 120mm fans
•Default PWM controlled based on built-in temperature sensors
•Optional IPMI system monitoring and control
Power Options Single/ Dual AC 1600W
Single/Dual DC 1600W
System Monitoring Default - automatic dynamic temperature based fan speed control
Optional—IPMI system monitoring with power, temperature, and fan speed control and monitoring
Fan Filters Optional Quadra foam 45 PPI Replaceable Fan Filters
PCIe 4.0 Cable Lengths 1m
2m
3m
Power Cords 6’ US 110V
6’ US 240V
6’ UK
2’ IEC
6’ IEC
Agency Compliance Agency Certifications (testing pending):
• FCC Class A
• CE Safety & Emissions
• UL, cUL
• RoHS3
Warranty 1 Year Return to Factory. Extended Warranty is available and sold separately. Upon purchased of a new unit you can
buy an extended warranty.
Operating System Supported Windows 10, Windows Server and Linux based OS

One Stop Systems
4U Pro 16 Slot 6
1.1 Features
- PCIe Gen4 architecture
- Semi-rugged frame design
- Dynamic fan speed control
- Configurable slot and host uplinks to optimize throughput
- Integrated IPMI based system monitoring
- AC and DC power inlet options
1.2 4UP Architecture (16 Slot)

One Stop Systems
4U Pro 16 Slot 7
1.3 PCIe Slots
Slot Type: Closed-ended PCIe slot / connector, all the slots are x16 mechanical.
•Six x8 electrical slots (slots 1, 2, 3, 4, 5 and 6)
•Three x16 electrical slots(slots 0, 7 and 8)
1.4 Backplane Block Diagram

One Stop Systems
4U Pro 16 Slot 8
1.5 Dimensions

Description
Description
Description
11
10
15
16
5 4
7
14
13
12
6
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
ass LOGO - LED
Standby/ Main Power LED
IPMI LED
RJ45 Port-Access to IPMI
Front Panel
F
ron t Handl es
Removable Fans
ARC Connectors & Cabl es
Target Cards
Power Supplies
Au
xi iiary Power Connectors
IPMI Module/ Board
Fan Power Connectors
Power Supply Housing
Backplane&PCle Sl
ot (OSS -521 board)
Pass ive Heat sink/ PC le Swi tch
Number
Number
Number
One Stop Systems
4U Pro 16 Slot 9
1.6 Parts Overview

Description
18 12V Input PowerConnectors
19 Upstream
Slots/ TargetSlots
20
Downstream Sl ots/ PC le Card Slots
Options Slots
19 19 {Operates
as either Downstream slot or
Upstream slot depending on the slot-
21 configuration)
20 20
Number
One Stop Systems
4U Pro 16 Slot 10

One Stop Systems
4U Pro 16 Slot 11
1.7 HIB x16 Gen 4 Card
x4 cable Ports
There are four x4 cable ports /connectors available on the HIB Gen4 card. Port #0 is located nearest to the Link LED.
•A single x4 SFF-8644 cable must be inserted into port#0 of the Target card.
•On the Host card side, you can plug in a single x4 cable to any port as long as the Host card switch is set to x4 mode.
When using two x4 SFF-8644 cables, it must be connected to port#0 and port#1 of the Target card only.
•On the Host card side, plug-in the two cables to port#0 and portt#1 OR port#2 and port#3.

One Stop Systems
4U Pro 16 Slot 12
1.8 Backplane
Item Name Description
1 12V Input Power 12V input power for the 538 board. Not to be used for external GPU aux
2 ARF 6 Top Connectors For connecting ARC 6 cables between ”Option slot” and PEX switch
3 I2C and temp sensors interface Connector for I2C and temp sensors interface to the power backplane
4 Ethernet port Not used
5 Passive Heat sink Moves heat away from the PCIe chip
6 PCIe Downstream Slots / Port PCIe card slot for 3rd Party PCIe cards
7 Option Slot Configurable card slot to operate either as an Upstream or Downstream modes
8 Card Slot LED LED status indicator when slot is populated or not. Solid green when card is present. Off, when no
card
9 Target Slot LED LED status indicator for Target card. Solid green when Gen 4 adapter card is installed
10 Upstream Port / Target Slot Designated slot for Target card only
11 Dip Switches For slot configuration
12 Board LEDs LED status indicator for the board
13 FPGA Connector FPGA Programming connector
14 PS_ON Enable to force power ON the backplane by placing a jumper on the connector
15 Temperature Sensor Sensor for detecting temperature on the board
16 24-pin ATX Power Connector For connecting ATX Power Supply
17 PCIe Switch Port PCIe switch management port, optional
18 ARF 6 Bottom Connectors For connecting ARC 6 cables between ”Option slot” and PEX switch
19 Screw-Mounting Holes For securing the board on to an enclosure

1 Upstream Slot (SLOT 0)
- One partition
8 Downstream Slots
- Slots #1, 2, 3, , 5, 6, 7 and 8
2 Upstream Slots (SLOT 0 and SLOT 8)
- Two partitions
7 Downstream Slots
- 4 Downstream slots for partition group 1
-Slots #1, 2, 3 and
- 3 Downstream slots for partition group 2
-Slots
#5, 6 and 7
One Stop Systems
4U Pro 16 Slot 13
1.9 Slot Configurations
Configuration# 1: Default slot configuration. One Upstream slot and eight Downstream slots.
ARC6 cables are required and must be attached between the edge of the board and the slot connectors under the backplane. Without those
ARC6 cables nothing will work in SLOT 8.
Configuration# 2: Two Upstream slots (Slot 0 and SLOT 8) with two partitions.
•Slot 0: Partition #1 with four Downstream slots
•Slot 8: Partition #2 with three Downstream slots

1 Upstream Slot
15 Downstream slots
2 Non-operational slots
One Stop Systems
4U Pro 16 Slot 14
Configuration# 3: Two backplanes are daisy chained together.
•One Upstream slot and 15 Downstream slots.

One Stop Systems
4U Pro 16 Slot 15
1.10 Use Case Diagrams
Configuration 1
OSS-521 backplane is linked to a single host computer.
•Four x4 link cables are connected between OSS Gen4 Host card and Target card.
8 Downstream slots
•6 x8 slots (Slot 1, 2, 3, 4, 5 and 6)
•2 x16 slots (Slot 7 and 8)
Configuration 2
OSS-521 backplane is linked to two host computers, see diagram below.
Two partitions / two Upstream slots (Slot 0 and SLOT 8) with a total of 7 downstream slots.
•Slot 0: Partition #1 with four Downstream slots
o4 x8 slots (Slot 1, 2, 3 and 4)
•Slot 8: Partition #2 with three Downstream slots
o2 x8 slots (Slot 5 and 6)
o1 x16 slot (Slot 7)

One Stop Systems
4U Pro 16 Slot 16
Configuration 3
Two OSS-521 backplane are daisy chained together and it is linked to a single host computer.
•With a total of 15 Downstream slots
1st backplane: 7 downstream slots
•6 x8 slots (slot 1, 2, 3, 4, 5 and 6)
•1 x16 slot (slot 7)
•One non-operational slot (slot 8)
2nd backplane: 8 downstream slots
•6 x8 slots (slot 1, 2, 3, 4, 5 and 6)
•2 x16 slots (slot 0 and 7)
•One non-operational slot (slot 8)

One Stop Systems
4U Pro 16 Slot 17
2 Getting Started
Steps on how to setup and use the 4UP expansion unit. You will find instructions for the following procedures:
•How to Remove Top Cover
•Target Card Installation
•Host Card Installation
•GPU / PCIe Cards Installation
•Mini-SAS Cable Installation
•Powering Up the unit / system
•Hardware LED Check
•Device Verification via OS
3 Installation Overview
1. Remove the top cover.
a. Check inside the unit for loose components or damaged parts.
2. Check the Target card, make sure it is firmly installed and secured.
a. By default, the Target is already installed in the unit.
b. If the Target card is not installed or missing, please go to section on how to install the target card.
3. Install the Host card.
a. You should have another card that is configured as host card.
b. Check the dipswitches make sure it is set to host mode prior to installing the card.
4. Install PCIe / GPU cards.
a. Plug in your PCIe or GPU cards in the expansion unit.
5. Connect the external link cables.
a. Plug in the Mini-SAS HD SFF-8644 cables between Target and Host cards.
6. Plug in the power cords.
a. The unit is supplied power cord(s). You should have either one or two, depending on the number of power supplies
installed in the unit.
b. The standard unit is assembled with an AC power supplies installed.
7. Power ON the host computer.
8. Check the hardware by verifying all LED status indicators.
a. Boards LED
b. Target & Host cards
c. Unit front power LED
d. Power supplies LED
9. Check the OSS devices via operating system, verifying all OSS devices are properly recognized.
a. For Windows, go to section on how to verify device on Windows OS
b. For Linux, go to section on how to verify device on Linux

One Stop Systems
4U Pro 16 Slot 18
4 Remove Top Cover
1. Remove the two (2) mounting screws on top of the chassis.
2. Slide the enclosure cover towards the back of the unit to disengage it from the guides until it clears the back, and then lift the cover
off.
5 Target Card Installation
By default, the Target cards are already in the unit. See photos below for the correct slot location where the Target cards are installed.

One Stop Systems
4U Pro 16 Slot 19
If the Target card is missing, follow the next steps below for Target card installation.
5.1 Target Card Configuration
•Configure the card first, make sure to set the card switches to Target mode.
•Find the SW1 on the card and set the switches to target mode, see diagram / photo below.
•Move SW1 #1 and SW #2 to ON position
Once the card is configured, install Target card in the designated target slot (upstream slot). Photo below shows the default location of the
Upstream slots.
Make sure the card is firmly seated in the card slot and secured.

One Stop Systems
4U Pro 16 Slot 20
6 Host Card Installation
•Before installation, you must check the switches on the Host card.
•By default, all the switches on the Host card are set to OFF position (“Auto-Negotiation” mode).
•You can leave the switches to default or you can set the switches (SW1 and SW2) on the card for the desired Host operating mode.
See “Host Card Configuration” section for more details.
6.1 Host Card Configuration
The following diagrams / photos are the three switch settings for the Host card.
x16 Dip switch Settings:
•SW1 #2 = ON; #5 =ON.
•SW2 #1 = ON; #2 = ON
x8 Dip switch Settings:
•SW1 #2 = ON; #5 = ON
•SW2 #1 = OFF; #2 = ON or #2 = OFF and #1 = ON