One Stop Systems Superswitch OSS-PCIe-HIB5-x8 User manual

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A
One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A
OSS-PCIe-HIB5-x8
Host Cable Adapter
User Manual
2235 Enterprise Street, Suite 110
Escondido, CA 92029
Phone: [phone]
Fax: [phone]
www.onestopsystems.com

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 2
verview of SuperSwitch™
SuperSwitch is an extension of the Max Expr s Expansion System to allow communication between processors over the PCI
Express bus at speeds of 10Gb/s. SuperSwit offers several significant advantages over other high speed networking technologies
such as 10Gb Ethernet:
•Lower cost
•Higher performance
•Available in more form factors
SuperSwitch configurations allow for communication to a combination external stand-alone PCI Express
devices or expansion systems. SuperSwitch also provides a simple wa rious computer architectures such as
CPCI, laptops, desktop systems or PICMG passive backplane architec
SuperSwitch Technology
SuperSwitch consists of two or more host interface boards (HIBs) and a software driver package called ExpressNet. Each system
uses a HIB, which is connected by cables either to another HIB or through a PCI Express switch to several HIBs. The HIBs use a
PCIe non-transparent bridge to map the memory on each system into the memory space of the others. This allows high speed
direct memory access between the systems.
The ExpressNet software sets up one CPU as the root complex, which initializes the ExpressNet network and handles the fabric
management. It provides standard network services like TCP/IP between the connected systems and also Direct Data Transfer
(DDT) between user level applications. DDT implements a high speed, low latency shared memory that can be used in a
customized communications scheme appropriate to the application.
SuperSwitch Configurations
SuperSwitch is available in three base configurations:
SuperSwitch 1 (2 ports)
Communication between 2 Host Interface Boards
SuperSwitch 2 (3-5 ports)
These ports can all be processors, or they can be any combination of processors, or end points such as a PCIe device,
SHB-ELB, Host Cable Adapter, ECA, CPCI HEB or CPCIe ELB.
SuperSwitch 3 (6-8 ports)
A HIB in the host system communicates through an external 1U 8 port PCI Express switch to be any combination of
processors, or end points such as a PCIe device, SHB-ELB, Host Cable Adapter, ECA, CPCI HEB or CPCIe ELB
O
es
ch
of processors as well as
vay to network between
tures.

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 3
escriptio or 4 (with optional mezzanine card)
downstream PC
ation. The four port version of the HIB5
Unpacking Instructions ct
nt.
r shipping damage.
Installation and Removal
1. Power down the system.
2. Open the chassis according to your system documentation.
3. Let the power supply cool down, if necessary.
4. Remove the Host Cable Adapter from the protective bag, observing proper ESD safety procedures.
D
The Host Cable Adapter (Part # OSS-PCIe-HIB5
n -x8) is a PCIe x8 board that provides 2
SuperSwitch 2 configurations using ExpressNet software.
PCIe x4 cable connectors are available depending on the configur
slots.
Ie x4 links for
It can also be used as a standalone PCI Express expansion board to connect to 4 downstream PCIe devices with no software
required.
Front bezels with 2 or 4
requires two physical PCI Express
1. If the carton is damaged when you receive it, request that the carrier's agent be present when you unpack and inspe
the equipment.
2. After unpacking, verify that all items listed in the packing list are prese
3. Inspect the equipment fo
4. Save all packing material for storage or return shipment of the equipment.
5. For repairs or replacement of equipment damaged during shipment, contact One Stop Systems, Inc. to obtain a
Return Materials Authorization (RMA) number and further shipping instructions.
PCIe x4 Edge
Connector
Slot Cover
Cable port
Good LEDs
PEX
8525
PCIe x4
Cable Port
Connectors
Internal
LEDs

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 4
Installing the Host Ca
Host Cabl sure that the card is well seated, and
t aligned with the key ridge of the Host
Cable Adapter nnector on the board until the cable locks in
. The connectors on either e nector is equipped with a retractor to allow
the connector to be locked into place.
tor on Cable Connector
4. Attach the other end of the cable to the cable port connector of the HIB2, HIB4, or PCI Express switch depending on
your SuperSwitch configuration.
Removing the Host Cable Adapter:
1. pulling on the green retractor ring which releases the locking mechanism.
2. e screw before removing the Host Cable Adapter from the card slot.
pecifications
ble Adapter:
e Adapter into a PCIe x8 or x16 add-in card slot. Make
slot cover, insert the cable connector into the cable port co
nd of the PCIe x4 cable are identical. Each con
1. Insert the
tighten the screw.
2. Attach the cable by first pulling back on the retractor ring. With the keyed slo
place.
3
Retrac
Retractor ring
Remove the cable by
Loosen and remove th
S
Electrical/Mechanical Specifications
Form Factor: PCIe x8 add-in card
Dimensions (H x L): 4.3773 x 5.135 inches (101.6 x 130.4 mm)
Front Panel Connectors: Two or four PCIe x4 cable connectors
Front Panel Indicators: Cable Port Status LEDs (one for each connector)
Power Consumption (designed to meet the following conditions
6.5W maximum (3.2W @ 3.3V, 3.3W @ 12V)
Operating Environment (designed to meet the following conditions)
Temperature Range: 0° to 50°C (32° to 122°F)
Relative Humidity: 10 to 90% non-condensing
Shock: 30g acceleration peak (11ms pulse)
Vibration: 5-17 Hz 0.5” double amplitude displacement; 7-2000Hz, 1.5g acceleration.
PCI Express Switches
PLX PEX8525
Agency Compliance Designed to meet, but not tested
UL60950, FCC Class B, CE safety and emissions
Alignment grooves

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 5
nce Clock
Distribution
Dimensions
Block Diagram
LEDs
LANES (3:0)
Refere
PEX8525
SWITCH
LANES (3:0)
LANES (7:0)
X4 PCI Express Card Edge
X4 Cable
nnectorCo
1.0V
1.5V
12V
3.3V
X4
C
X4
C
Cab
onnector
le
Cable
onnector
LANES (3:0)
MAIN
CARD
PORTS
X4 Cable
Connector
LANES (3:0)
PLL CLK
erBuff
MEZZ
CARD
PORTS
Switches
The Host Cable Adapter conta x y configured to the “ON” position for proper operation.
These switches should not be chang
ins one
ed. .
2 dip switch. Both switches are factor

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 6
EDs
d” LED for each downstream cable connector located on the front panel. When lit, this LED indicates that the
perly. Status LEDs for individual lanes on each port are not provided on this board.
There are 5 surface mounted LEDs. See the below table for their designation, description and function. Note that these LEDs are
not visible from outside the chassis when the board is installed. See picture in the description section for location.
LED # PCB Label Function Description
L
There is one “port goo
port is functioning pro
LED1 CE_PORTGD Card Edge Port Status When lit, indicates that the PCIe x8 Port on the card edge is functioning
properly
LED2 ERROR PLX PEX8525 Status When lit, indicates an error in the 8525 chip (reboot host)
D5 PWRGD Power Good indicator for the
board
D4 CE_RST Card Edge PCIe reset
D3 RST Board Reset
Connectors
The Host Cable Adapter has two connectors on it:
1. PCIe X8 Card Edge Connector per PCI Express Card Electromechanical Specification Revision 1.1 (March 28, 2005)
2. PCIe X4 Cable connector per PCI Express External Cabling Specification Revision 1.0 (January 4, 2007)

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 7
ddendum A - ExpressNet Linux Driver1
em rformance te m
These are all supplied as source files written in C and packaged in a compressed tar file expressnettar.bz2, provided on a CD with
s .
ments -bit MD or Intel
CPU. How ssN with earlier versions and/or 32-bit versions of Linux. Kernel module
dependencies are docum the html/readme.html file contained on the CD.
Extraction
The files in the expressnettar.bz2 file all untar into the opt/ossi/expressnet directory tree. For most Linux system, to untar it into
the standard location, /, you must log in as root and execute:
cd /; tar xvfj directory_path/expressnettar.bz2
ssi/expressnet directory you will find:
he directory containing the ExpressNet demonstration program.
ents not found in the html or manpages directory.
lelist A list of all ExpressNet files installed in the system that is used to uninstall ExpressNet.
include The directory containing the ExpressNet include files.
init.d The directory containing the script which enables the system to control the loading of the driver.
lib The directory containing the ExpressNet library files.
manpages The directory containing ExpressNet documentation in manpage format.
pexload The directory containing the ExpressNet EEPROM programming utility.
INSTALL A shell script that compiles and installs the driver and library and compiles the demonstration program.
UNINSTALL A perl script that removes all ExpressNet files on the system.
Driver Installation
Follow the explanations and instructions in the README documentation in the HTML directory.
Licensing Agreement
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License version 3,
or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied
warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for
more details. A copy of this license can be found in documentation/gpl.txt on the CD.
A
Description
The ExpressNet software package for Linux consists of three major components and their associated include and make files.
- The kernel driver
- A user library
- A d onstration/pe sting progra
your Ho t Cable Adapter
Require
The diver requires a64 version of Linux, with Linux kernel version 2.6.20 or greater running on a 64-bit A
ever, Expre et may work in simple configurat
ented in ions
In the resulting /opt/o
applications T
documentation The directory containing docum
driver The directory containing the ExpressNet Linux driver.
fi
html The directory containing ExpressNet documentation in web format.
1The following information was correct at the time this manual was published. Please read the readme.html on the CD for the most up to date
requirements and installation procedures.

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 8
rations
art #: OSS-SS3-X-XM
SuperSwitch 1
PCI Express-over-cable solutions for point-to-point communications
cable to a CPCI Express x4 cable adapter,
•PCIe x4 cable adapter or Express Card and ExpressNet software suite.
ngths.
Addendum B – SuperSwitch Configu
•Data transfers between two systems occur at 20Gb/s.
•ExpressNet software supports 64 bit CPUs as well as multithreaded
environments.
•PCIe cables in 1m, 2m, 3m, 5m and 7m le
•SuperSwitch 1 includes one PCIe x4 host adapter attached via a PCIe x4
Part #: OSS-SS1-X-XM
SuperSwitch 2
PCI Express-ove
•SuperSwitch 2
r-cable networking for 3 to 5 PCs
includes connecting up to five processors using one
p to four PCIe x4 cable adapters,
re suite.
ltithreaded
7m lengths.
to 8 PCs
devices, using one 8-port 1U switch, one
PCIe x4 host adapter, Express Card or CPCIe host adapter, up to 7
PCIe host cable adapters, up to 8 e.
•Enables data transfers at speeds up to 20Gb/s.
•
PCIe x4 mezzanine cable adapter, u
PCIe cables up to 7 meters and ExpressNet softwa
•Enables data transfers at speeds up to 20Gb/s.
•ExpressNet software supports 64 bit CPUs as well as mu
environments.
•PCIe cables in 1m, 2m, 3m, 5m and
Part # X-XM: OSS-SS2-
SuperSwitch 3
PCI Express-over-cable networking for 6
•SuperSwitch 3 includes connecting up to eight CPUs or any
combination of CPUs and I/O
•PCIe cables and ExpressNet software suit
ExpressNet software supports 64 bit CPUs as well as multithreaded
environments.
P

One Stop Systems, Inc. Host Cable Adapter User Manual
Rev. A 9
Limited Warranty
One Stop Systems warrants this product to b material and workmanship for an initial period of two years from
date of delivery to the original purchaser from
During this period, One Stop Systems will, a ts o ion
except as set forth in this warranty agreement.
One Stop Systems will, at its option, repair or replace ed to
the One Stop Systems manufactured product, su a or CPUs. One Stop
Systems is not liable for any defects in material o o ems
oes not design or manufacture. However, One Stop nor the original manufacturer’s warranty on these products.
ne Stop Systems will analyze the defective om n ng instances:
$75 (U.S. dollars).
labor at $75 per hour with a $100 minimum charge (U.S. dollars). Receipt of damaged goods voids the
One Stop Systems warranty.
Repair parts and replacement products wil r reconditioned. All
replacement parts and products shall beco under this
warranty agreement. In the event a defect is no el s shall
repair or replace the defective parts at the purchase
This limited warranty shall not apply if the prod h odified or altered, or if
unauthorized repairs have been attempted by er stems and
is in lieu of any implied warranties, including implied rchantability and fitness for a particular purpose. In no event will
ystems be liable for any such dama a or delay, labor, repair or
aterial cost, injury to person or property or any similar or dissimilar consequential loss or damage incurred by the purchaser, even
One Stop Systems has been advised of the possibility of such losses or damages.
ervice, the product must be delivered to the One Stop Systems facility, or to an authorized One Stop
ystems service representative, with all included parts and accessories as originally shipped, along with the proof of purchase and
Returned Merchandise Authorization (RMA
The RMA number is obtained, in advance, fr 0 days. The
RMA number must be clearly marked on th sible
and liable for any missing or damaged parts. Purchas
product or assume the liability for loss or da
One Stop Systems
ATTENTION: RMA REPAIR DEPARTMENT
RMA ####
2235 Enterprise Street, Suite 110
www.onestopsystems.com
e free of defects in
One Stop Systems.
t i pt , repair or replace this product at no additional charge to the purchaser,
this product at no additional charge to the purchaser, if the defect is relat
ch s a power supply, backplane, other chassis components
r w rkmanship of any peripherals, products or parts, which One Stop Syst
Systems will hod
O c po ent and the customer will be charged in the followi
•No problem found:
•Damage: Parts and
l be furnished on an exchange basis and will be either new o
me the property of One Stop Systems, if such parts or products are provided
t r ated to the One Stop Systems manufactured product, One Stop System
r’s cost and deliver the defective parts to the purchaser.
uct as been misused, carelessly handled, defaced, m
oth s. The above warranty is the only warranty authorized by One Stop Sy
warranty of me
One Stop S ge s lost business, lost profits, lost savings, downtime
m
if
In order to obtain warranty s
S
a ) number.
om One Stop Systems Customer Service Department and is valid for 3
e exterior of the original shipping container or equivalent. Purchaser will be respon
er agrees to pay for shipping charges one way, and to either insure the
mage during transit. Ship to:
Escondido, CA 92029
235 Enterprise Street, Suite 110 yEscondido, CA 92029 yTel [phone] yFax [phone] 2