Plexxi 3eq User manual

®
!
Plexxi&HCN™&&
Plexxi&Switch&3eq&
with&Switch-Control&Software&3.0.0-3.2.x&
Hardware&and&Installation&Guide&
December&5,&2017&
!
100!Innovative!Way!-!Suite!3322!
Nashua,!NH!03062!
Tel.!+1.888.630.PLEX!(7539)!
www.plexxi.com!

2! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Legal!Notices!
The information contained herein is subject to change without notice. Plexxi®, the Plexxi logo, and
LightRail®are registered trademarks, and Plexxi HCN™, Plexxi Control™and Plexxi Connect™are
trademarks of Plexxi, Inc. in the United States and other countries. Other product or service name may be
trademarks or service marks of others. No part of this documentation may be reproduced in any form or
by any means or used to make any derivative work (such as translation, transformation, or adaptation)
without written permission from Plexxi, Inc. Plexxi, Inc. reserves all rights of copyright in this
documentation. PLEXXI, INC. PROVIDES THIS DOCUMENTATION “AS IS,” WITHOUT
WARRANTY, TERM, OR CONDITION OF ANY KIND, EITHER IMPLIED OR EXPRESSED,
INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES, TERMS, OR CONDITIONS
OF MERCHANTABILITY, SATISFACTORY QUALITY, NON-INFRINGEMENT AND FITNESS
FOR A PARTICULAR PURPOSE. Plexxi, Inc. reserves the right to make changes to equipment design
or program components described in this documentation, as progress in engineering, manufacturing
methods, or other circumstances may warrant. No responsibility is assumed for the use of Plexxi, Inc.
software or hardware, all rights, obligations and remedies related to which are as set forth in the
applicable sales and license agreements.
Plexxi,Inc.
100 Innovative Way - Suite 3322
Nashua, NH03062
Tel:[phone].PLEX(7539)
www.plexxi.com
Published December 5, 2017
Printed in United States of America. Copyright © 2017 Plexxi, Inc. All rights reserved.
The Plexxi Switch system is classified as a class 1 telecommunications laser product employing embedded
class 1 lasers and complies with the following:
THIS PRODUCT COMPLIES WITH FDA RULE 21 CFR SUBCHAPTER J IN EFFECT AT DATE OF
MANUFACTURE. PRODUCT COMPLIES WITH 21 CFR 1040.10 AND 1040.11
PRODUIT CONFORME SELON LE SOUS CHAPITRE J DU DOCUMENT FDA RÈGLE 21 CFR EN
VIGUEUR LORS DE LA DATE DE FABRICATION. PRODUIT CONFORME SELON 21CFR 1040.10
ET 1040.11.
ElectrotechnicalCommission(IEC)60825-1,60825-2
This product is classified as a: CLASS 1 LASER PRODUCT
APPAREIL À LASER DE CLASSE 1
This unit is intended to be installed in a Restricted Access Location only with access only by trained
personnel.

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 3!
Table&of&Contents&
Legal&Notices&.........................................................................................................................................................&2!
Welcome &.............................................................................................................................................................&5!
Related&Documentation&....................................................................................................................................&5!
Contacting&Plexxi&Support&................................................................................................................................&5!
Safety&Notes&...........................................................................................................................................................&6!
Electrostatic&Discharge&Precautions&.............................................................................................................&6!
ESD&Guidelines &................................................................................................................................................................&6!
Regulatory&Compliance&......................................................................................................................................&7!
FCC&Notice&..............................................................................................................................................................&7!
Industry&Canada&Notice&.....................................................................................................................................&8!
ICES-003&Class&A&...............................................................................................................................................................&8!
EN&55022&Class&A&Warning&...........................................................................................................................................&8!
1!Checklist&..........................................................................................................................................................&9!
2!Pre-Installation&...........................................................................................................................................&10!
Verify&Site&Requirements&...........................................................................................................................................&10!
Altitude!................................................................................................................................................................................................!10!
Temperature!.....................................................................................................................................................................................!10!
Ventilation!..........................................................................................................................................................................................!10!
Circuit!Overloading!........................................................................................................................................................................!10!
Reliable!Earthing/Grounding!....................................................................................................................................................!10!
Mechanical!Loading!.......................................................................................................................................................................!10!
Equipment!Protection!...................................................................................................................................................................!10!
UPS!........................................................................................................................................................................................................!11!
Cabling!.................................................................................................................................................................................................!11!
Unpack&the&Switches&....................................................................................................................................................&11!
Verify&Equipment&Delivered&.....................................................................................................................................&11!
Switch&Part&Numbers&and&Options&..........................................................................................................................&11!
Power!Supplies!and!Power!Supply!Cooling!.........................................................................................................................!12!
Fans!and!Cooling!.............................................................................................................................................................................!12!
Switch!Product!Codes!....................................................................................................................................................................!12!
Cables&and&Transceivers&............................................................................................................................................&12!
Record&the&MAC&Address&............................................................................................................................................&12!
Installation&Considerations&.......................................................................................................................................&13!
Power!...................................................................................................................................................................................................!13!
Working!with!Optical!Cables!......................................................................................................................................................!13!
3!Installing&Plexxi&Switch&3eq&....................................................................................................................&14!
Rack&Mounting&Plexxi&Switch&3eq&...........................................................................................................................&14!
Powering&Up&Plexxi&Switch&3eq&...............................................................................................................................&15!
Performing&the&Initial&Switch&Configuration&.......................................................................................................&15!
Connecting&LightRails&.................................................................................................................................................&15!
Configuring&the&LightRails&.........................................................................................................................................&15!
Powering&Down&Plexxi&Switch&3eq&.........................................................................................................................&15!
4!Creating&the&Plexxi&Fabric&Network&.....................................................................................................&16!
1-LightRail&or&2-LightRail&Fabric&.............................................................................................................................&16!

4! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
LightRail&Ports&...............................................................................................................................................................&16!
Fabric&Deployments&.....................................................................................................................................................&17!
PSI!interconnect!..............................................................................................................................................................................!17!
Direct!Connect!..................................................................................................................................................................................!17!
5!Creating&a&Plexxi&PSI&Network&...............................................................................................................&18!
Plexxi&PSI&.........................................................................................................................................................................&18!
Connecting&the&PSI&.......................................................................................................................................................&18!
Connecting&Multiple&PSI&Devices&.............................................................................................................................&18!
Cables&for&PSI&.................................................................................................................................................................&18!
Looping&Back&Unused&PSI&Ports&...............................................................................................................................&18!
PSI&Network&Example&..................................................................................................................................................&19!
Connecting&Multiple&PSI&Devices&.............................................................................................................................&19!
6!Creating&a&Direct&Connect&Network&.....................................................................................................&20!
Connection&Guidelines&................................................................................................................................................&20!
Two-Switch&Fabric&........................................................................................................................................................&20!
Three-Switch&Fabric&....................................................................................................................................................&21!
Four&Switch&Fabric&.......................................................................................................................................................&22!
Five-Switch&Fabric&........................................................................................................................................................&23!
Six-Switch&Fabric&..........................................................................................................................................................&24!
Seven&Switch&Fabric&.....................................................................................................................................................&25!
7!Adding&a&Switch&to&an&Existing&Fabric&.................................................................................................&26!
Adding&Switch&#7&to&a&Six-Switch&Fabric&...............................................................................................................&26!
Adding&Switch&#6&to&a&Five-Switch&Fabric&............................................................................................................&27!
Adding&Switch&#5&to&a&Four-Switch&Fabric&...........................................................................................................&28!
Adding&Switch&#4&to&a&Three-Switch&Fabric&.........................................................................................................&29!
Adding&Switch&#3&to&a&Two-Switch&Fabric&............................................................................................................&30!
8 ! Installing& Transceivers &and&Cables &.............................................................................................&31!
Installing&Transceivers&...............................................................................................................................................&31!
QSFP28!................................................................................................................................................................................................!31!
Inserting!Transceivers!..................................................................................................................................................................!31!
Connecting&QSFP28&Cables&........................................................................................................................................&31!
QSFP28&Breakout&Cables&............................................................................................................................................&31!
9!Ports&and&LEDs&............................................................................................................................................&32!
I/O&Panel&Ports&..............................................................................................................................................................&32!
QSFP28&Ports&and&LightRails&....................................................................................................................................&33!
QSFP28&LEDs&..................................................................................................................................................................&33!
Management,&Console&and&USB&Ports&and&Management&LED&........................................................................&34!
S1&Port&and&LED&.............................................................................................................................................................&34!
Power&(P-1&and&P-2)&and&Status&(STAT)&LEDs&.....................................................................................................&35!
Power&Supply&LEDs&......................................................................................................................................................&36!
Fan&LEDs&..........................................................................................................................................................................&36!
10!Customer&Replaceable&Units&................................................................................................................&37!
Replacing&a&Power&Supply&Module&.........................................................................................................................&37!
Replacing&a&Fan&Module&.............................................................................................................................................&37!
11!Switch&3eq&Specifications&.....................................................................................................................&38!
!

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 5!
Welcome !
Plexxi Switch 3eq is an Entry Series Plexxi switch that supports scale-out applications with high
performance East-West traffic needs. It does not contain Plexxi LightRail™interfaces. Instead, it uses
10Gbit or 25Gbit parallel optics through the six QSFP28 interfaces to create a LightRail interface.
Each of the 32 QSFP28 interfaces supports 4x25GbE. Each port supports 1x10GbE, 4x10GbE, 1x40GbE,
4x25GbE, 2x50GbE or 1x100GbE. You can configure one or two LightRail interfaces using six or twelve
QSFP28 ports, starting from the right-most ports. This makes the total LightRail bandwidth identical to
the LightRail interfaces on other Plexxi Switches having one or two actual LightRail interfaces.
Switch 3eq I/O panel view
Switch 3eq power panel view
Related!Documentation!
In addition to this document, refer to the following documentation:
•Plexxi Compatibility Matrix, Rev 8, which identifies compatibility between the versions of Plexxi software
and identifies software upgrade paths/compatibility.
•Plexxi Switch Administrator Guide using Linux and Plexxi CLI, Releases 3.0.0 -3.2.x.
This documentation is available on the Plexxi Resources > Technical Documentation page:
http://www.plexxi.com/technical-documentation/
Contacting!Plexxi!Support!
Plexxi Technical Support services are available to answer your questions and to make sure that your
software and hardware continue to operate properly.
You can contact Plexxi Support at:
[email protected]
1.888.415.9809 (US/Canada toll-free)
[phone] (US/International)
http://support.plexxi.com

6! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Safety!Notes!
Warning: The primary hazards of exposure to invisible laser radiation from an optical fiber
communications system are:
ï Damage to the eye by viewing an unterminated optical fiber or fiber optic connector.
ï Damage to the eye from invisible laser radiation from viewing a cut fiber or a broken fiber.
Never attempt to view optical connectors that may be emitting laser energy and always avoid possible exposure to
invisible optical laser radiation. Using optical fiber scopes or magnifying lenses may increase the possibility for an
eye hazard. It is recommended that you use an optical power meter to determine if there is optical laser radiation
present or use a remote video display inspection tool to inspect connectors.
WARNING To avoid possible eye injury, use an optical power meter to ensure there is no
optical power in a cable connected to any Plexxi switch. Even if a switch is
powered off, passive optics in a Plexxi fabric may transmit eye-damaging
optical signals from neighboring switches.
! No user serviceable parts are inside the chassis other than the power supplies and
fan assemblies. Contact Plexxi for all repairs .
!Only qualified personnel should service or replace Plexxi Switches.
! The Plexxi Switch contains multiple separate power sources. Always make certain
that all power sources are disconnected before servicing the unit.
Electrostatic!Discharge!Precautions&
Use Electrostatic Discharge (ESD) precautions when handling a Plexxi Switch outside a data center rack.
Once the switch is installed in a rack, the mounting hardware provides grounding through the rack.
ESD!Guidelines &
Observe the following guidelines to avoid electrostatic discharge (ESD) damage when installing or
servicing the Plexxi Switch.
•Minimize handling of assemblies and components.
•Assemble or remove equipment only in a static-free work area.
•Use conductive work surfaces (such as an antistatic mat) to dissipate static charge and wear a
conductive wrist strap to dissipate the accumulation of static charge accumulation.
•Keep replacement parts in their original static-free packaging.
•Remove all plastic, foam, vinyl, paper, and other static-generating materials from the work area.
•Whenever possible, use tools that do not create electrostatic discharge.
!

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 7!
Regulatory!Compliance&
Switch 3eq complies with the following regulatory certificates:
CCC
CE
EN 55022:2010/AC:2011
EN 61000-3-2:2014
EN 61000-3-3:2013
EN 55024:2010
IEC 61000-4-2 ed2.0 (2008-12)
IEC 61000-4-3 ed3.2 Consol with am1&2 (2010-04)
IEC 61000-4-4 ed3.0 (20012-04)
IEC 61000-4-5 ed3.0 (2014-05)
IEC 61000-4-6 ed4.0 (2013-10)
IEC 61000-4-8 ed2.0 (2009-09)
IEC 61000-4-11 ed2.0 (2004-03)
FCC
NOM
RCM
UL
EN 60950-1:2006/ A11:2009/ A1:2010/ A12:2011/ A2:2013
IEC 60950-1(ed.2), IEC 60950-1(ed.2);am1,
IEC 60950-1(ed.2);am2
VCCI Class A
FCC!Notice!
NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device,
pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against
harmful interference when the equipment is operated in a commercial environment. This equipment
generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with
the instruction manual, may cause harmful interference to radio communications. Operation of this
equipment in a residential area is likely to cause harmful interference in which case the user will be
required to correct the interference at his own expense.
!

8! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Industry!Canada!Notice!
ICES-003!Class!A!
This Class A digital apparatus complies with Industry Canada Standard ICES-003.
Cet appareil numérique de la classe A est conforme à la norme NMB-003 d'Industrie Canada.
EN!55022!Class!A!Warning!
Warning: This is a class A product. In a domestic environment this product may cause
radio interference in which case the user may be required to take adequate measures.

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 9!
1Checklist!
Pre-staging
!Verify site requirements, including:
!Verify that redundant site power is available
!Verify rack air flow
!Unpack the switches
!Verify equipment delivered
!Record the MAC address of the switch
! Determine the type of LightRail you will install
! LightRail 3 (100 Gb/s per link)
! LightRail 2 (25 Gb/s per link)
!Form a cabling plan and verify cable lengths
Installation
!Install the switches in racks
!Install power cables. The switch automatically powers up and boots. Verify green LEDs.
! Connect a console system to the CONSOLE port of the switch.
!Install the LightRail™ fabric cables and b uild the Plexxi fabric using either:
!PSI interconnect, or
!Direct connect
!Configure the LightRail as described in the appropriate release of the document, Plexxi Switch
Administrator Guide using Linux and Plexxi CLI
!Perform the initial switch configuration as described in the appropriate release of the document,
Plexxi Switch Administrator Guide using Linux and Plexxi CLI
!Connect servers to access ports

10!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
2Pre-Installation!
Verify!Site!Requirements!
Observe the following requirements when selecting a site to install the Plexxi Switch.
Altitude&
The Plexxi Switch is designed to operate at an altitude ranging from -60 to 2000 meters (-196 to 6562
feet).
Temperature!
The operating ambient temperature of a closed or multi-unit rack environment could be greater than room
ambient temperature. Ensure that you install the equipment in an environment compatible with the
maximum ambient temperature (Tma) specified by the manufacturer.
The switch must be used in a non-condensing environment, within a temperature range of 0° C - 40°
C (32° F - 104° F).
Ventilation!
To ensure proper ventilation, allow ample airflow to the switch I/O panel and power panel. The
cooling fans and the power supplies are oriented to support the airflow configuration ordered.
Circuit!Overloading&
The Plexxi kit contains two power supplies, which should be connected to separate circuits for
redundancy protection. Unless specified, the shipping container includes two power cables, each 2.5
meters in length, which comply with appropriate country standards.
When you connect the equipment to the supply circuit, do not overload the circuits. You need to consider
the overcurrent protection and supply wiring. Review the equipment nameplate ratings before you start
making connections.
Make certain that all input connections are accessible at all times, and disconnect all power plugs before
servicing or moving the unit.
Reliable!Earthing/Grounding&
Maintain reliable earthing/grounding of the rack-mounted equipment. Pay attention to any supply
connections other than direct connections to the branch circuit (for example, the use of power strips).
Verify that the AC power cords can easily reach from the AC power outlet to the connection on the
power supply panel of the switch.
Mechanical!Loading&
Ensure there is no uneven mechanical loading for the equipment in the rack to avoid a potentially
hazardous condition.
Equipment!Protection&
Choose an area where liquids or other foreign objects cannot fall onto the equipment or be drawn into
ventilation holes.

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)!11!
UPS&
For any UPS (Uninterruptible Power Supply) providing power to a Plexxi 3eq switch, Plexxi
recommends the following:
•The UPS must have enough capacity to power the switch plus any other equipment that is connected
to the UPS.
•The UPS must be a double-conversion on-line sine-wave UPS.
Cabling&
Ensure there is ample clearance at the power panel and I/O panel to allow unrestricted cabling. Also
ensure the AC power cords can easily reach from the AC power outlet to the connection on the power
supply panel of the switch.
Unpack!the!Switches!
Unpack all switch components and inspect for shipping damage.
Verify!Equipment!Delivered!
Review the components to ensure that you received what your ordered.
Equipment
Description
Five hot swappable fans
Installed in chassis. A red tab indicates airflow from the
I/O panel to the power panel. A blue tab indicates
airflow from the power panel to the I/O panel.
Two power supplies
Installed in chassis.
Two power cables
For AC connections: 2.5 meter cables which comply
with appropriate country standards.
For DC connections: DC cables.
For redundancy: Connect the power cables to separate
site power circuits.
Cables
Verify that you have all cables ordered for your
installation. For valid cables and part numbers, refer to
the Plexxi Compatibility Matrix.
Rack mount kit
Rack mount for the switch.
Switch!Part!Numbers!and!Options!
Switch 3eq is available with the following power supply and cooling options:
-F = I/O to power panel air flow direction (red, Normal air flow)
-R = Power panel to I/O air flow direction (blue, Reverse air flow)

12!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Power!Supplies!and!Power!Supply!Cooling!
Switch 3eq is available with either two AC power supplies or two DC power supplies.
The power supplies can be ordered to exhaust out the power panel (-F) or out the I/O panel (-R).
Fans!and!Cooling!
Switch 3eq is available with hot-swappable fans that either exhaust out the power panel (-F, red) or out
the I/O panel (-R, blue).
Switch!Product!Codes!
AC Input
PX-S3EQ-F Ethernet Switch 32 100Gps, Air flow I/O to PSU, AC input
PX-S3EQ-R Ethernet Switch 32 100Gps, Air flow PSU to I/O, AC input
DC Input
PX-S3EQ-F-D Ethernet Switch 32 100Gps, Air flow I/O to PSU, DC input
PX-S3EQ-R-D Ethernet Switch 32 100Gps, Air flow PSU to I/O, DC input
Spares
PX-S3EQ-AC-PWR AC Power Supply Spare
PX-S3EQ-DC-PWR DC Power Supply Spare
PX-S3EQ-FAN-F Fan I/O to PSU Spare
PX-S3EQ-FAN-R Fan PSU to I/O Spare
Cables!and!Transceivers!
For supported cables and transceivers, including part numbers, refer to the following document:
•Plexxi Compatibility Matrix, Rev 8.
Record!the!MAC!Address!
Record the switch MAC address. The MAC address is on a label located on the top of the chassis. You
will need it for switch setup.
!

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)!13!
Installation!Considerations!
Keep the following considerations in mind when installing and cabling switches.
Power!
•Verify that power cords easily reach from the power outlets to the switch power supply modules.
•Ensure that appropriate grounding and current surge protection are in place before connecting the
switch to a power source.
•All input connections must be accessible (not blocked) at all times.
•Note that single power supplies and fan modules can be hot-swapped with power connected. Also,
I/O cables can be plugged and unplugged with the switch power connected and the switch powered
up.
•Invasive switch servicing requiring that the case be opened, must be accomplished by qualified
Plexxi support personnel. In this case, all power must be disconnected before servicing the switch.
Working!with!Optical!Cables!
•Avoid excessive bending which can damage optical cables.
•Verify that ample clearance exists to allow unrestricted cabling.

14!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
3Installing!Plexxi!Switch!3eq!
Rack!Mounting!Plexxi!Switch!3eq!
You need the following to install the switch in a telco rack:
•Two rails (provided in switch kit)
•Two brackets (provided in switch kit)
•Eight #10-32 x ¾inch screws
•Eight #10-32 nut plates
•Six #6-32 x ¼flat head machine screws (provided in switch kit) to mount the brackets to the switch.
The switch can be installed in the telco rack with the switch I/O panel either facing the front of the rack or the
rear of the rack. Therefore, the switch should have been ordered with the appropriate airflow option to match the
rack installation.
To install Switch 3eq in a rack:
1. Find a 1-U slot position in the rack and install the nut plates in the appropriate mounting holes. You
can use two per rail and two per bracket.
2. Install the two rails (2 screws for each rail).
3. Mount the I/O-side brackets to the switch (three #6-32 x ¼flat head machine screws each).
4. Position the switch in the rack slot. Support the bottom of the switch and slide the switch in to align
the mounting pins with the rail guides, then. slide the switch fully into the slot.
5. Install two #10-32 x ¾screws in each bracket to fasten the I/O end of the switch to the rack.

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)!15!
6. The switch is shipped with AC or DC power supplies installed as ordered. For AC power supplies,
plug the power cables into separate circuits on the rack. For DC power supplies, hard-wire each
power cable to a separate site DC power source.
Note: For redundancy, connect the two power supplies to separate power sources.
7. For each AC or DC power supply, plug a power cord into the power supply port. The following
image shows the left AC power cord installed.
Powering!Up!Plexxi!Switch!3eq!
When you connect one or both power supplies and provide site power to the switch, it automatically
powers up. There is no power switch.
Performing!the!Initial!Switch!Configuration!
Perform the initial switch configuration as described in the appropriate release of the document, Plexxi
Switch Administrator Guide using Linux and Plexxi CLI.
Connecting!LightRails!
Install transceivers and cables to connect the LightRails as described in the following chapters in this
document:
•4: Creating the Plexxi Fabric Network
•5: Creating a Plexxi PSI LightRail Network
•6: Creating a Direct Connect Network
•8: Installing Transceivers and Cables
Configuring!the!LightRails!
Connect to the switch and configure the LightRails using the Plexxi CLI as described in the document,
Plexxi Switch Administrator Guide using Linux and Plexxi CLI.
Powering!Down!Plexxi!Switch!3eq!
Disconnect power to both power supplies to power the switch Off. Note that there are two power supplies
which should be connected to separate site power sources for redundancy.

16!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
4Creating!the!Plexxi!Fabric!Network!
The following can be configured from Plexxi 3eq switches:
•Plexxi fabrics which are configured from the right-most QSFP28 ports on the I/O panel. QSFP28
ports 27-32 form Fabric 1. QSFP28 ports 21-26 form Fabric 2.
•Device connections
1-LightRail!or!2-LightRail!Fabric!
Switch 3eq can be configured on either 1 fabric or 2 fabrics:
•LightRail 1 uses QSFP28 ports 27-32.
•LightRail 2 uses QSFP28 ports 21-26.
IMPORTANT: Never connect LightRail 1 to LightRail 2.
When designing multiple LightRails:
•The first LightRail must connect all of the switches in the fabric together.
•The second lightrail can be used to increase the bandwidth and connectivity between those switches.
LightRail!Ports!
MTP Connector
QSFP28 Port
Direction
LightRail 1
LightRail 2
1
27
28
21
22
West (W1)
East (E1)
2
29
30
23
24
West (W2)
East (E2)
3
31
32
25
26
West (W3)
East (E3)

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)!17!
Fabric!Deployments!
Plexxi Switch 3eq fabrics can be deployed using either PSI (Pod Switch Interconnect) devices or by
directly connecting switches (direct connect).
PSI!interconnect!
For configurations requiring four switches or more, you can use PSI devices to expand the network.
Connect all Plexxi 3eq switches to a Plexxi PSI. Connect each Switch 3eq to the PSI using Plexxi-
supplied MTP cables. The PSI device creates the fabric structure of a Plexxi network. Switch 3eq can be
deployed with any other Plexxi switch having LightRail connectivity.
Direct!Connect!
You can deploy a fabric of seven switches or less using Direct Connect; directly connecting the switches.
Directly connect Plexxi 3eq switches together using a QSFP28-to-QSFP28 cable such as a Direct Attach
Cable (DAC) or Active Optical Cable (AOC).
Switch 3eq can be direct connected with Switch 2e in a fabric operating at 10Gbps (40Gbps for each
QSFP28, or 4x10Gb/s).
Note: Switch 3eq cannot connect with Switch 2p or 2sp using direct connect; it must connect to
these switches on a fabric using PSI interconnect.
Note: A single direct-connect LightRail cannot exceed 7 switches.

18!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
5Creating!a!Plexxi!PSI!Network!
You can create a network of four switches or more by connecting 3eq switches to a Plexxi Pod Switch
Interconnect (PSI) device.
Plexxi!PSI!
PSI is a passive optical component that uses Plexxi’s optical LightRail interface to connect Plexxi
switches in a meshed network.
Connecting!the!PSI!
Connect Plexxi PSI Interconnect LightRail ports to the Plexxi Switch 3eq QSFP28 ports following the
West-to-East convention. Plug the 24-fiber connector into the Plexxi PSI Interconnect port and the three
12-fiber connectors of the MTP cable to transceivers installed in the QSFP28 ports on the Plexxi Switch
3eq.
You need to match the label number (1, 2, and 3) on the 12-fiber side of the MTP connectors with a
specific port number on Plexxi Switch 3eq. Connect to the appropriate QSFP28 port in the appropriate
direction, West or East.
Connecting!Multiple!PSI!Devices!
PSI devices can be connected to scale out the Plexxi fabric. Three 24-fiber MTP cables are used to
connect to a PSI device to the next (East) PSI device, and an additional three cables are used to connect
to the previous (West) PSI device.
Cables!for!PSI!
The following cable types are used to connect a PSI network:
•24-fiber MTP to 3x12-fiber MTP Breakout cables for PSI interconnect (3, 5, 10, 15 and 20M). These
connect to the QSFP28 ports on a single Switch 3eq.
•10 inch 24-fiber LightRail cables for single PSI loopback. This cable is used to loop back ports that
are not connected to a switch or PSI device.
•24 fiber LightRail cables to be used to connect PSI devices together or to connect 3eq switches to a
PSI device. Available in 1, 3, 5, 10, 20 and 100M lengths. You need six cables to connect PSIs.
For information on supported cables, refer to the document, Plexxi Support Matrix, Version 3 or greater.
Looping!Back!Unused!PSI!Ports!
You need to loopback any unused PSI ports, including the extender ports, using 10-inch MTP cables.
The next section illustrates looped back ports in 4-switch PSI configuration.
!

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)!19!
PSI!Network!Example!
Using the PSI, you can create a network topology that includes Switch 3eq, Switch 2e, and a Switch 2p,
or Switch 2sp. The switch 3eq optics used in the QSFP28 LightRail ports use 10Gbit or 25Gbit parallel
optics, which makes Switch 3eq LightRail compatible with the pod versions of Plexxi Switches (Switch
2p, 2sp).
IMPORTANT: If any Switch 1 or 2 models (10Gb/s ports) are in the fabric, the Switch 3eq must use 10
Gb/s parallel optics.
The following illustration shows a network topology that includes three Plexxi 3eq switches and a Plexxi
Switch 2sp connected to Plexxi PSI Interconnect device.
As shown, all unused PSI ports are looped back using loopback cables.
Note: The QSFP28 ports in the diagram include a label indicating direction: W1 through W3 and E1
through E3. These labels are informational and are not found on the Plexxi Switch chassis.
Connecting!Multiple!PSI!Devices!
PSI devices can be connected to scale out the Plexxi fabric. Three 24-fiber MTP cables are used to
connect to a PSI device to the next (East) PSI device, and an additional three cables are used to connect
to the previous (West) PSI device.
To connect PSI devices together, use 24 fiber MTP to MTP LightRail cables available in varying lengths
(1, 3, 5, 10, 20 and 100M). You need six cables to connect a PSI device East and West to other PSI
devices. For part numbers and descriptions of supported cables, refer to the document, Plexxi Support
Matrix.
!

20!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
6Creating!a!Direct!Connect!Network!
You can directly connect Plexxi 3eq switches using a QSFP28-to-QSFP28 cable such as DAC or AOC.
You cannot directly connect Plexxi 3eq switches in a network that contains Plexxi switches with Plexxi
LightRail connectors and cabling, including Switch 2p or 2sp.
You should not directly connect Plexxi 3eq switches in a network if the deployment is expected to grow
beyond seven switches.
Connection!Guidelines!
NOTE: For information on 3eq LightRail ports, refer to the section, I/O Panel Ports.
•Three connection types are allowed between two Plexxi 3eq switches:
W1-E1, W2-E2, W3-E3
QSFP28 DAC or AOC cables connect from the top ports (W1, W2, W3) of one switch to the bottom
ports (E1, E2, E3), East and West ports of the same number are allowed to connect.
•Number the 3eq switches you want to connect starting with 1. For example, if you are connecting
five 3eq switches, number them 1, 2, 3, 4, 5. You can affix a label to the switch for identification.
•Start the connection from Switch 3eq 1, go on to Switch 3eq 2 next, through to the last Switch 3eq in
the Plexxi fabric.
•Start connections from W1, then W2, then W3 for each Switch 3eq.
•Connect W1 to E1, W2 to E2, and W3 to E3. For each switch, connect W1 to the next numbered
switch E1, W2 to the E2 port of the switch that comes next in order, and W3 to the E3 port of the
switch that comes next again in order. For example, you plug one end of the DAC or AOC cable in
W1 on Switch 3eq 1 and the other end in E1 on the Switch 3eq 2.
Two-Switch!Fabric!
These are the connections to create a 2-switch Plexxi fabric.
From
To
From
To
Switch 1
Switch 2
W1
Switch 2 E1
W1
Switch 1 E1
W2
Switch 2 E2
W2
Switch 1 E2
W3
Switch 2 E3
W3
Switch 1 E3