Plexxi 3eq User manual

®
!
Plexxi&HCN™&&
Plexxi&Switch&3eq&
with&Switch-Control&Software&3.0.0-3.2.x&
Hardware&and&Installation&Guide&
December&5,&2017&
!
100!Innovative!Way!-!Suite!3322!
Nashua,!NH!03062!
Tel.!+1.888.630.PLEX!(7539)!
www.plexxi.com!

2! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Legal!Notices!
The information contained herein is subject to change without notice. Plexxi®, the Plexxi logo, and
LightRail®are registered trademarks, and Plexxi HCN™, Plexxi Control™and Plexxi Connect™are
trademarks of Plexxi, Inc. in the United States and other countries. Other product or service name may be
trademarks or service marks of others. No part of this documentation may be reproduced in any form or
by any means or used to make any derivative work (such as translation, transformation, or adaptation)
without written permission from Plexxi, Inc. Plexxi, Inc. reserves all rights of copyright in this
documentation. PLEXXI, INC. PROVIDES THIS DOCUMENTATION “AS IS,” WITHOUT
WARRANTY, TERM, OR CONDITION OF ANY KIND, EITHER IMPLIED OR EXPRESSED,
INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES, TERMS, OR CONDITIONS
OF MERCHANTABILITY, SATISFACTORY QUALITY, NON-INFRINGEMENT AND FITNESS
FOR A PARTICULAR PURPOSE. Plexxi, Inc. reserves the right to make changes to equipment design
or program components described in this documentation, as progress in engineering, manufacturing
methods, or other circumstances may warrant. No responsibility is assumed for the use of Plexxi, Inc.
software or hardware, all rights, obligations and remedies related to which are as set forth in the
applicable sales and license agreements.
Plexxi,Inc.
100 Innovative Way - Suite 3322
Nashua, NH03062
Tel:[phone].PLEX(7539)
www.plexxi.com
Published December 5, 2017
Printed in United States of America. Copyright © 2017 Plexxi, Inc. All rights reserved.
The Plexxi Switch system is classified as a class 1 telecommunications laser product employing embedded
class 1 lasers and complies with the following:
THIS PRODUCT COMPLIES WITH FDA RULE 21 CFR SUBCHAPTER J IN EFFECT AT DATE OF
MANUFACTURE. PRODUCT COMPLIES WITH 21 CFR 1040.10 AND 1040.11
PRODUIT CONFORME SELON LE SOUS CHAPITRE J DU DOCUMENT FDA RÈGLE 21 CFR EN
VIGUEUR LORS DE LA DATE DE FABRICATION. PRODUIT CONFORME SELON 21CFR 1040.10
ET 1040.11.
ElectrotechnicalCommission(IEC)60825-1,60825-2
This product is classified as a: CLASS 1 LASER PRODUCT
APPAREIL À LASER DE CLASSE 1
This unit is intended to be installed in a Restricted Access Location only with access only by trained
personnel.

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 3!
Table&of&Contents&
Legal&Notices&.........................................................................................................................................................&2!
Welcome &.............................................................................................................................................................&5!
Related&Documentation&....................................................................................................................................&5!
Contacting&Plexxi&Support&................................................................................................................................&5!
Safety&Notes&...........................................................................................................................................................&6!
Electrostatic&Discharge&Precautions&.............................................................................................................&6!
ESD&Guidelines &................................................................................................................................................................&6!
Regulatory&Compliance&......................................................................................................................................&7!
FCC&Notice&..............................................................................................................................................................&7!
Industry&Canada&Notice&.....................................................................................................................................&8!
ICES-003&Class&A&...............................................................................................................................................................&8!
EN&55022&Class&A&Warning&...........................................................................................................................................&8!
1!Checklist&..........................................................................................................................................................&9!
2!Pre-Installation&...........................................................................................................................................&10!
Verify&Site&Requirements&...........................................................................................................................................&10!
Altitude!................................................................................................................................................................................................!10!
Temperature!.....................................................................................................................................................................................!10!
Ventilation!..........................................................................................................................................................................................!10!
Circuit!Overloading!........................................................................................................................................................................!10!
Reliable!Earthing/Grounding!....................................................................................................................................................!10!
Mechanical!Loading!.......................................................................................................................................................................!10!
Equipment!Protection!...................................................................................................................................................................!10!
UPS!........................................................................................................................................................................................................!11!
Cabling!.................................................................................................................................................................................................!11!
Unpack&the&Switches&....................................................................................................................................................&11!
Verify&Equipment&Delivered&.....................................................................................................................................&11!
Switch&Part&Numbers&and&Options&..........................................................................................................................&11!
Power!Supplies!and!Power!Supply!Cooling!.........................................................................................................................!12!
Fans!and!Cooling!.............................................................................................................................................................................!12!
Switch!Product!Codes!....................................................................................................................................................................!12!
Cables&and&Transceivers&............................................................................................................................................&12!
Record&the&MAC&Address&............................................................................................................................................&12!
Installation&Considerations&.......................................................................................................................................&13!
Power!...................................................................................................................................................................................................!13!
Working!with!Optical!Cables!......................................................................................................................................................!13!
3!Installing&Plexxi&Switch&3eq&....................................................................................................................&14!
Rack&Mounting&Plexxi&Switch&3eq&...........................................................................................................................&14!
Powering&Up&Plexxi&Switch&3eq&...............................................................................................................................&15!
Performing&the&Initial&Switch&Configuration&.......................................................................................................&15!
Connecting&LightRails&.................................................................................................................................................&15!
Configuring&the&LightRails&.........................................................................................................................................&15!
Powering&Down&Plexxi&Switch&3eq&.........................................................................................................................&15!
4!Creating&the&Plexxi&Fabric&Network&.....................................................................................................&16!
1-LightRail&or&2-LightRail&Fabric&.............................................................................................................................&16!

4! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
LightRail&Ports&...............................................................................................................................................................&16!
Fabric&Deployments&.....................................................................................................................................................&17!
PSI!interconnect!..............................................................................................................................................................................!17!
Direct!Connect!..................................................................................................................................................................................!17!
5!Creating&a&Plexxi&PSI&Network&...............................................................................................................&18!
Plexxi&PSI&.........................................................................................................................................................................&18!
Connecting&the&PSI&.......................................................................................................................................................&18!
Connecting&Multiple&PSI&Devices&.............................................................................................................................&18!
Cables&for&PSI&.................................................................................................................................................................&18!
Looping&Back&Unused&PSI&Ports&...............................................................................................................................&18!
PSI&Network&Example&..................................................................................................................................................&19!
Connecting&Multiple&PSI&Devices&.............................................................................................................................&19!
6!Creating&a&Direct&Connect&Network&.....................................................................................................&20!
Connection&Guidelines&................................................................................................................................................&20!
Two-Switch&Fabric&........................................................................................................................................................&20!
Three-Switch&Fabric&....................................................................................................................................................&21!
Four&Switch&Fabric&.......................................................................................................................................................&22!
Five-Switch&Fabric&........................................................................................................................................................&23!
Six-Switch&Fabric&..........................................................................................................................................................&24!
Seven&Switch&Fabric&.....................................................................................................................................................&25!
7!Adding&a&Switch&to&an&Existing&Fabric&.................................................................................................&26!
Adding&Switch&#7&to&a&Six-Switch&Fabric&...............................................................................................................&26!
Adding&Switch&#6&to&a&Five-Switch&Fabric&............................................................................................................&27!
Adding&Switch&#5&to&a&Four-Switch&Fabric&...........................................................................................................&28!
Adding&Switch&#4&to&a&Three-Switch&Fabric&.........................................................................................................&29!
Adding&Switch&#3&to&a&Two-Switch&Fabric&............................................................................................................&30!
8 ! Installing& Transceivers &and&Cables &.............................................................................................&31!
Installing&Transceivers&...............................................................................................................................................&31!
QSFP28!................................................................................................................................................................................................!31!
Inserting!Transceivers!..................................................................................................................................................................!31!
Connecting&QSFP28&Cables&........................................................................................................................................&31!
QSFP28&Breakout&Cables&............................................................................................................................................&31!
9!Ports&and&LEDs&............................................................................................................................................&32!
I/O&Panel&Ports&..............................................................................................................................................................&32!
QSFP28&Ports&and&LightRails&....................................................................................................................................&33!
QSFP28&LEDs&..................................................................................................................................................................&33!
Management,&Console&and&USB&Ports&and&Management&LED&........................................................................&34!
S1&Port&and&LED&.............................................................................................................................................................&34!
Power&(P-1&and&P-2)&and&Status&(STAT)&LEDs&.....................................................................................................&35!
Power&Supply&LEDs&......................................................................................................................................................&36!
Fan&LEDs&..........................................................................................................................................................................&36!
10!Customer&Replaceable&Units&................................................................................................................&37!
Replacing&a&Power&Supply&Module&.........................................................................................................................&37!
Replacing&a&Fan&Module&.............................................................................................................................................&37!
11!Switch&3eq&Specifications&.....................................................................................................................&38!
!

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 5!
Welcome !
Plexxi Switch 3eq is an Entry Series Plexxi switch that supports scale-out applications with high
performance East-West traffic needs. It does not contain Plexxi LightRail™interfaces. Instead, it uses
10Gbit or 25Gbit parallel optics through the six QSFP28 interfaces to create a LightRail interface.
Each of the 32 QSFP28 interfaces supports 4x25GbE. Each port supports 1x10GbE, 4x10GbE, 1x40GbE,
4x25GbE, 2x50GbE or 1x100GbE. You can configure one or two LightRail interfaces using six or twelve
QSFP28 ports, starting from the right-most ports. This makes the total LightRail bandwidth identical to
the LightRail interfaces on other Plexxi Switches having one or two actual LightRail interfaces.
Switch 3eq I/O panel view
Switch 3eq power panel view
Related!Documentation!
In addition to this document, refer to the following documentation:
•Plexxi Compatibility Matrix, Rev 8, which identifies compatibility between the versions of Plexxi software
and identifies software upgrade paths/compatibility.
•Plexxi Switch Administrator Guide using Linux and Plexxi CLI, Releases 3.0.0 -3.2.x.
This documentation is available on the Plexxi Resources > Technical Documentation page:
http://www.plexxi.com/technical-documentation/
Contacting!Plexxi!Support!
Plexxi Technical Support services are available to answer your questions and to make sure that your
software and hardware continue to operate properly.
You can contact Plexxi Support at:
[email protected]
1.888.415.9809 (US/Canada toll-free)
[phone] (US/International)
http://support.plexxi.com

6! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Safety!Notes!
Warning: The primary hazards of exposure to invisible laser radiation from an optical fiber
communications system are:
ï Damage to the eye by viewing an unterminated optical fiber or fiber optic connector.
ï Damage to the eye from invisible laser radiation from viewing a cut fiber or a broken fiber.
Never attempt to view optical connectors that may be emitting laser energy and always avoid possible exposure to
invisible optical laser radiation. Using optical fiber scopes or magnifying lenses may increase the possibility for an
eye hazard. It is recommended that you use an optical power meter to determine if there is optical laser radiation
present or use a remote video display inspection tool to inspect connectors.
WARNING To avoid possible eye injury, use an optical power meter to ensure there is no
optical power in a cable connected to any Plexxi switch. Even if a switch is
powered off, passive optics in a Plexxi fabric may transmit eye-damaging
optical signals from neighboring switches.
! No user serviceable parts are inside the chassis other than the power supplies and
fan assemblies. Contact Plexxi for all repairs .
!Only qualified personnel should service or replace Plexxi Switches.
! The Plexxi Switch contains multiple separate power sources. Always make certain
that all power sources are disconnected before servicing the unit.
Electrostatic!Discharge!Precautions&
Use Electrostatic Discharge (ESD) precautions when handling a Plexxi Switch outside a data center rack.
Once the switch is installed in a rack, the mounting hardware provides grounding through the rack.
ESD!Guidelines &
Observe the following guidelines to avoid electrostatic discharge (ESD) damage when installing or
servicing the Plexxi Switch.
•Minimize handling of assemblies and components.
•Assemble or remove equipment only in a static-free work area.
•Use conductive work surfaces (such as an antistatic mat) to dissipate static charge and wear a
conductive wrist strap to dissipate the accumulation of static charge accumulation.
•Keep replacement parts in their original static-free packaging.
•Remove all plastic, foam, vinyl, paper, and other static-generating materials from the work area.
•Whenever possible, use tools that do not create electrostatic discharge.
!

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 7!
Regulatory!Compliance&
Switch 3eq complies with the following regulatory certificates:
CCC
CE
EN 55022:2010/AC:2011
EN 61000-3-2:2014
EN 61000-3-3:2013
EN 55024:2010
IEC 61000-4-2 ed2.0 (2008-12)
IEC 61000-4-3 ed3.2 Consol with am1&2 (2010-04)
IEC 61000-4-4 ed3.0 (20012-04)
IEC 61000-4-5 ed3.0 (2014-05)
IEC 61000-4-6 ed4.0 (2013-10)
IEC 61000-4-8 ed2.0 (2009-09)
IEC 61000-4-11 ed2.0 (2004-03)
FCC
NOM
RCM
UL
EN 60950-1:2006/ A11:2009/ A1:2010/ A12:2011/ A2:2013
IEC 60950-1(ed.2), IEC 60950-1(ed.2);am1,
IEC 60950-1(ed.2);am2
VCCI Class A
FCC!Notice!
NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device,
pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against
harmful interference when the equipment is operated in a commercial environment. This equipment
generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with
the instruction manual, may cause harmful interference to radio communications. Operation of this
equipment in a residential area is likely to cause harmful interference in which case the user will be
required to correct the interference at his own expense.
!

8! Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
Industry!Canada!Notice!
ICES-003!Class!A!
This Class A digital apparatus complies with Industry Canada Standard ICES-003.
Cet appareil numérique de la classe A est conforme à la norme NMB-003 d'Industrie Canada.
EN!55022!Class!A!Warning!
Warning: This is a class A product. In a domestic environment this product may cause
radio interference in which case the user may be required to take adequate measures.

!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! 9!
1Checklist!
Pre-staging
!Verify site requirements, including:
!Verify that redundant site power is available
!Verify rack air flow
!Unpack the switches
!Verify equipment delivered
!Record the MAC address of the switch
! Determine the type of LightRail you will install
! LightRail 3 (100 Gb/s per link)
! LightRail 2 (25 Gb/s per link)
!Form a cabling plan and verify cable lengths
Installation
!Install the switches in racks
!Install power cables. The switch automatically powers up and boots. Verify green LEDs.
! Connect a console system to the CONSOLE port of the switch.
!Install the LightRail™ fabric cables and b uild the Plexxi fabric using either:
!PSI interconnect, or
!Direct connect
!Configure the LightRail as described in the appropriate release of the document, Plexxi Switch
Administrator Guide using Linux and Plexxi CLI
!Perform the initial switch configuration as described in the appropriate release of the document,
Plexxi Switch Administrator Guide using Linux and Plexxi CLI
!Connect servers to access ports

10!Plexxi Switch 3eq Installation Guide (Switch-Control 3.0.0-3.2.x)! !
2Pre-Installation!
Verify!Site!Requirements!
Observe the following requirements when selecting a site to install the Plexxi Switch.
Altitude&
The Plexxi Switch is designed to operate at an altitude ranging from -60 to 2000 meters (-196 to 6562
feet).
Temperature!
The operating ambient temperature of a closed or multi-unit rack environment could be greater than room
ambient temperature. Ensure that you install the equipment in an environment compatible with the
maximum ambient temperature (Tma) specified by the manufacturer.
The switch must be used in a non-condensing environment, within a temperature range of 0° C - 40°
C (32° F - 104° F).
Ventilation!
To ensure proper ventilation, allow ample airflow to the switch I/O panel and power panel. The
cooling fans and the power supplies are oriented to support the airflow configuration ordered.
Circuit!Overloading&
The Plexxi kit contains two power supplies, which should be connected to separate circuits for
redundancy protection. Unless specified, the shipping container includes two power cables, each 2.5
meters in length, which comply with appropriate country standards.
When you connect the equipment to the supply circuit, do not overload the circuits. You need to consider
the overcurrent protection and supply wiring. Review the equipment nameplate ratings before you start
making connections.
Make certain that all input connections are accessible at all times, and disconnect all power plugs before
servicing or moving the unit.
Reliable!Earthing/Grounding&
Maintain reliable earthing/grounding of the rack-mounted equipment. Pay attention to any supply
connections other than direct connections to the branch circuit (for example, the use of power strips).
Verify that the AC power cords can easily reach from the AC power outlet to the connection on the
power supply panel of the switch.
Mechanical!Loading&
Ensure there is no uneven mechanical loading for the equipment in the rack to avoid a potentially
hazardous condition.
Equipment!Protection&
Choose an area where liquids or other foreign objects cannot fall onto the equipment or be drawn into
ventilation holes.