Mellanox Technologies Spectrum SN2100 Instructions for use

www.mellanox.com
Mellanox 1U Switch Systems Hardware User
Manual
Models: SN2700, SN2410 and SN2100
Rev 1.6

Document Number: MLNX-15-5439
Mellanox Technologies
2
Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: [phone]
Fax: [phone]
© Copyright 2016. Mellanox Technologies LTD. All Rights Reserved.
Mellanox®, Mellanox logo, BridgeX®, CloudX logo, Connect-IB®, ConnectX®, CoolBox®, CORE-Direct®, EZchip®,
EZchip logo, EZappliance®, EZdesign®, EZdriver®, EZsystem®, GPUDirect®, InfiniHost®, InfiniScale®, Kotura®, Kotura
logo, Mellanox Federal Systems®, Mellanox Open Ethernet®, Mellanox ScalableHPC®, Mellanox Connect Accelerate
Outperform logo, Mellanox Virtual Modular Switch®, MetroDX®, MetroX®, MLNX-OS®, NP-1c®, NP-2®, NP-3®, Open
Ethernet logo, PhyX®, SwitchX®, Tilera®, Tilera logo, TestX®, The Generation of Open Ethernet logo, UFM®, Virtual
Protocol Interconnect®, Voltaire® and Voltaire logo are registered trademarks of Mellanox Technologies, Ltd.
All other trademarks are property of their respective owners.
For the most updated list of Mellanox trademraks, visit http://www.mellanox.com/page/trademarks
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE
THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT
HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S)
AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT
GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY. ANY
EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED.
IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT,
INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT
LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA,
OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY,
WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED DOCUMENTATION EVEN IF
ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Mellanox Technologies 1
Table of Contents
Chapter 1 Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems . . 7
1.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.2 Speed and Switching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.3 Management Interfaces, PSUs and Fans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.4 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.5 Certifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.6 Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Chapter 2 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.1 Safety Warnings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.2 System Installation and Initialization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.3 Air Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.4 Package Contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
2.5 19” Systems Mounting Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.5.1 Static Rail Kit for SN2700 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.5.2 Telescopic Rail Kit for SN2700 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
2.5.3 Static Rail Kit for SN2410 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
2.5.4 Side by Side Mounting for SN2100 Rail Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
2.6 Cable Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
2.6.1 Breakout Cables and Adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
2.7 Initial Power On. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
2.8 System Bring-Up . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
2.8.1 Configuring Network Attributes Using MLNX-OS . . . . . . . . . . . . . . . . . . . . . . . 42
2.8.2 Configuring Network Attributes Using Cumulus Linux. . . . . . . . . . . . . . . . . . . . 46
2.9 FRU Replacements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.9.1 Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
2.9.2 Fans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Chapter 3 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.1 Supported Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.1.1 Data Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.1.2 Speed. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.1.3 RS232 (Console) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.1.4 Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.1.5 USB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
3.1.6 Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
3.1.7 Status and Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
3.2 LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
3.2.1 LED Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
3.3 Inventory Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Chapter 4 Software Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
4.1 Upgrading Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
4.1.1 MLNX-OS Software Upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

Mellanox Technologies
2
4.1.2 Switch Firmware Update. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
4.1.3 Cumulus Linux Software Upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Chapter 5 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
5.1 Troubleshooting Instructions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Chapter 6 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
6.1 SN2700 Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
6.2 SN2410 Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
6.3 SN2100 Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69

Mellanox Technologies 1
List of Figures
Table 1: Revision History Table 4
Table 2: References 5
Table 3: Speed and Switching Capabilities 8
Table 4: Management Interfaces, PSUs and Fans 9
Table 5: Ordering Part Numbers (OPNs) 10
Table 6: Air Flow Color Legend 15
Table 7: Installation Kit 17
Table 8: Installation Kit 22
Table 9: Installation Kit 27
Table 10: Installation Kit 31
Table 11: Serial Terminal Program Configuration 43
Table 12: Configuration Wizard Session 43
Table 13: Configuration Wizard Session - Static IP Configuration 44
Table 14: LEDs Symbols 53
Table 15: System Status LED Assignments 55
Table 16: Fan Status Front LED Assignments 56
Table 17: Fan Status Rear LED Assignments (One LED per Fan) 56
Table 18: Power Supply Unit Status Front LED Assignments for SN2700 and SN2410 57
Table 19: Power Supply Unit Status Front LED Assignments for SN2100 58
Table 20: Power Supply Unit Status Rear LED Assignments 58
Table 21: Bad Port LED Assignments 59
Table 22: Port LEDs in Ethernet System Mode 60
Table 23: Troubleshooting 65
Table 24: SN2700 Specifications 67
Table 25: SN2410 Specifications 68
Table 26: SN2100 Specifications 69
Table 27: OPNs for Replacement Parts 71

Mellanox Technologies 1
List of Figures
Figure 1: SN2700 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Figure 2: SN2410 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Figure 3: SN2100 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Figure 4: SN2700 and SN2410 Rear Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Figure 5: SN2100 Rear Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Figure 6: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet . . . . . . . . . . .16
Figure 7: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet . . . . . . . . . . .16
Figure 8: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Figure 9: Installation Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Figure 10: Attaching the Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Figure 11: Attaching the Brackets to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 12: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 13: Attaching the Brackets to the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Figure 14: Sliding the Blades in the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Figure 15: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Figure 16: Rails Separation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Figure 17: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
Figure 18: Mounting the Outer Rails into the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
Figure 19: Attaching the Inner Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 20: Securing the Chassis in the Inner Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 21: Sliding the Switch into the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Figure 22: Pulling the Unit Outwards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Figure 23: Locking Mechanism . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Figure 24: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
Figure 25: Installation Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
Figure 26: Attaching the Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
Figure 27: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Figure 28: Attaching the Rails to the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Figure 29: Sliding the Blades in the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Figure 30: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Figure 31: Coupling the Cables with Cable-ties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 32: Coupled Cables - Rear View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 33: Cables within the Rail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 34: Attach the Blades to the System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Figure 35: Attached Rail with Threaded Cables - Top View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34

Mellanox Technologies
2
Figure 36: Sliding the Frame Sliders into the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 37: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 38: Attaching the Frame to the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Figure 39: Sliding the System’s Blades in the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Figure 40: SN2700 and SN2100 Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Figure 41: SN2410 Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Figure 42: Breakout or Fanout Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39
Figure 43: SN2700 Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39
Figure 44: SN2410 Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40
Figure 45: SN2100 Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40
Figure 46: System Status LEDs 5 Minutes After Power On in SN2700 . . . . . . . . . . . . . . . . . . . . . .41
Figure 47: System Status LEDs 5 Minutes After Power On in SN 2410 . . . . . . . . . . . . . . . . . . . . .41
Figure 48: System Status LEDs 5 Minutes After Power On in SN 2100 . . . . . . . . . . . . . . . . . . . . .41
Figure 49: Two Power Inlets - Electric Caution Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
Figure 50: PS Unit Pulled Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Figure 51: Fan Module Latches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
Figure 52: System Status LEDs - Front and Rear Sides in SN2700 . . . . . . . . . . . . . . . . . . . . . . . . .54
Figure 53: System Status LEDs - Front and Rear Sides in SN2410 . . . . . . . . . . . . . . . . . . . . . . . . .54
Figure 54: System Status LED in SN2100 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
Figure 55: Fan Status LED in SN2700 - Front and Rear Sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
Figure 56: Fan Status LED in SN2410 - Front and Rear Sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
Figure 57: Fan Status LED in SN2100 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56
Figure 58: Power Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57
Figure 59: SN2700 and SN2410 Rear Side Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57
Figure 60: SN2700 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
Figure 61: SN2410 SFP28 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
Figure 62: SN2410 QSFP28 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
Figure 63: SN2100 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
Figure 64: SN2700 Pull-out Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
Figure 65: SN2410 Inventory Information Illustration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62
Figure 66: SN2100 Pull-out Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62
Figure 67: QSFP28 Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .74
Figure 68: Rear View of Module With Pin Placement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .75
Figure 69: RJ45 to DB9 Harness Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77

Rev 1.6
Mellanox Technologies
4
Revision History
Table 1 - Revision History Table
Date Revision Description
November 2016 1.6 Updated:
•“Specifications”
September 2016 1.5 Updated:
•“Reset Button”
•“Status and Port LEDs”
Added:
•“Noise Level” to “Specifications”
June 2016 1.4 Updated:
•“Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems”
•“Ordering Information”
•“Side by Side Mounting for SN2100 Rail Kit”
May 2016 1.3 Added SX1012 to the following sections:
•“Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems”
•“Installation”
•“Interfaces”
•“Specifications”
•“Accessory and Replacement Parts”
March 2016 1.2 Updated:
•“Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems”
•“Software Management”
•“Troubleshooting Instructions”
•“Specifications”
•“Accessory and Replacement Parts”
Added:
• Taiwan BSMI Class A Statement in Safety Warnings
December 2015 1.1 Added SN2410
August 2015 1.0 Initial revision

Rev 1.6
Mellanox Technologies 5
About this Manual
This manual describes the installation and basic use of the Mellanox Ethernet systems.
Intended Audience
This manual is intended for IT managers and system administrators.
References
Conventions
The following icons are used throughout this document to indicate information that is important
to the user.
Table 2 - References
Document Description
MLNX-OS® User Manual This document contains information regarding the configuration and man-
agement of the MLNX-OS software. See http://www.mellanox.com/page/
mlnx_os.
Cumulus Linux User Guide This document contains information regarding the configuration and man-
agement of the Cumulus® Linux® software. See https://docs.cumulusnet-
works.com/display/DOCS.
Open Network Install Envi-
ronment (ONIE) Quick
Start Guide
See https://github.com/opencomputeproject/onie/wiki/Quick-Start-Guide/.
This icon makes recommendations to the user.
This icon indicates information that is helpful to the user.

Rev 1.6
Mellanox Technologies
6
This icon indicates a situation that can potentially cause damage to hardware or
software.
This icon indicates a situation that can potentially cause personal injury.

Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems Rev 1.6
Mellanox Technologies 7
1 Introduction to Mellanox SN2000 Spectrum™ Ethernet
Switch Systems
1.1 Overview
Mellanox Spectrum™ based 1U switch systems are an ideal spine and Top of Rack (ToR) solu-
tion, allowing maximum flexibility, with port speeds spanning from 10Gb/s to 100Gb/s per port,
and port density that enables full rack connectivity to any server at any speed. The uplink ports
allow a variety of blocking ratios that suit any application requirement. Powered by the Spectrum
ASIC, the systems carry whopping switching and processing capacities in a compact 1U form
factor.
Keeping with the Mellanox tradition of setting performance record switch systems, the Spectrum
based systems introduce the world’s lowest latency for 100GbE switching and routing elements,
and do so while having the lowest power consumption in the market. They enable the use of 10,
25, 40, 50 and 100GbE in a large scale without changing power infrastructure facilities.
The Spectrum™ based 1U switch systems are a part of Mellanox’s complete end-to-end solution,
which provides 10GbE through 100GbE interconnectivity within the data center. Other devices
in this solution include ConnectX-4 based network interface cards, and LinkX copper or fiber
cabling. This end-to-end solution is topped with NEO, a management application that relieves
some of the major obstacles standing in the way when deploying a network. NEO enables a fully
certified and interoperable design, speeds up time to service and RoI. The systems introduce
hardware capabilities for multiple tunneling protocols that enable increased reachability and scal-
ability for today’s data centers. Implementing MPLS, NVGRE and VXLAN tunneling encapsu-
lations in the network layer of the data center allows more flexibility for terminating a tunnel by
the network, in addition to termination on the server endpoint.
While Spectrum provides the thrust and acceleration that powers the switch systems, they get yet
another angle of capabilities, running with a powerful x86-based processor, which allows them to
not only be the highest performing switch fabric elements, but also grants them the ability to
incorporate a Linux running server into the same device. This opens up multiple application
aspects of utilizing the high CPU processing power and the best switching fabric, to create a
powerful machine with unique appliance capabilities that can improve numerous network imple-
mentation paradigms.
The Spectrum™ based 1U switch systems support the Open Network Install Environment
(ONIE) for zero touch installations of network operating systems. While all Ethernet systems can
be purchased preloaded with MLNX-OS, the SN2700, SN2410 and SN2100 switches (in both
the 100GbE and the 40GbE versions) are offered, in addition, with Cumulus Linux support, as an
alternative operating system. For a full list of all available ordering options, see “Ordering Infor-
mation”.

Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems
Rev 1.6
Mellanox Technologies
8
Figure 1: SN2700 Front Side View
Figure 2: SN2410 Front Side View
Figure 3: SN2100 Front Side View
Figure 4: SN2700 and SN2410 Rear Side View
Figure 5: SN2100 Rear Side View
1.2 Speed and Switching
Table 3 describes maximum throughput and interface speed per system model.
Table 3 - Speed and Switching Capabilities
System Model 10/25GbE SFP28 Interfaces* 40/50/56/100GbE
QSFP28 Interfaces* Max Throughput
SN2700 64 (using QSFP to SFP breakout
cables)
32 6.4Tb/s
SN2410 Total 64, 48zSFP+ 16 (using
QSFP to SFP breakout cables)
84Tb/s

Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems Rev 1.6
Mellanox Technologies 9
*The system can support different interfaces and speed rates using QSFP to SFP adapters or
hybrid cables. For further information, see “Breakout Cables and Adapters”.
1.3 Management Interfaces, PSUs and Fans
Table 4 lists the various management interfaces, PSUs and fans per system model.
1.4 Features
For a full feature list, please refer to the system’s product brief. Go to http://www.mellanox.com.
In the main menu, click on Products--> Ethernet Switch Systems, and select the desired product
page.
1.5 Certifications
The list of certifications (such as EMC, Safety and others) per system for different regions of the
world is located on the Mellanox website at:
http://www.mellanox.com/page/environmental_compliance
SN2100 64 (using QSFP to SFP breakout
cables)
16 (or 32 50GbE
interfaces when
using QSFP to
2xQSFP breakout
cables).
3.2Tb/s
Table 4 - Management Interfaces, PSUs and Fans
System Model USB MGT Console PSU Fan
SN2700 Rear Rear (2 ports) Rear 2 units 4 units
SN2410 Rear Rear (2 ports) Rear 2 units 4 units
SN2100 Front (mini
USB)
Front (1 port) Front 2 units (non-
replaceable)
4 units (non-
replaceable)
Table 3 - Speed and Switching Capabilities
System Model 10/25GbE SFP28 Interfaces* 40/50/56/100GbE
QSFP28 Interfaces* Max Throughput

Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems
Rev 1.6
Mellanox Technologies
10
1.6 Ordering Information
The following table lists ordering information for the available systems. Please pay attention to
the airflow direction when ordering your system. For more details, see “Air Flow”.
Table 5 - Ordering Part Numbers (OPNs)
System
Model OPN Description
SN2700 MSN2700-CS2F Spectrum™ based 100GbE 1U Open Ethernet Switch with MLNX-
OS, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth, x86
CPU, P2C airflow, Rail Kit, RoHS6
MSN2700-BS2FO Spectrum™ based 40GbE, 1U Open Ethernet Switch with ONIE, 32
QSFP28 ports, 2 Power Supplies (AC), x86 CPU, Standard depth,
P2C airflow, Rail Kit, RoHS6
MSN2700-CS2R Spectrum™ based 100GbE 1U Open Ethernet Switch with MLNX-
OS, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth, x86
CPU, C2P airflow, Rail Kit, RoHS6
MSN2700-CS2FO Spectrum™ based 100GbE 1U Open Switch with ONIE, 32 QSFP28
ports, 2 Power Supplies (AC), Standard depth, x86 CPU, P2C air-
flow, Rail Kit, RoHS6
MSN2700-BS2F Spectrum™ based 40GbE, 1U Open Ethernet Switch with MLNX-
OS, 32 QSFP28 ports, 2 Power Supplies (AC), x86 CPU, Standard
depth, P2C airflow, Rail Kit, RoHS6
MSN2700-BS2FC Spectrum™ based 40GbE, 1U Open Ethernet Switch with Cumulus
Linux, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth,
x86 CPU, P2C airflow, Rail Kit, RoHS6
MSN2700-CS2FC Spectrum™ based 100GbE 1U Open Ethernet Switch with Cumulus
Linux, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth,
x86 CPU, P2C airflow, Rail Kit, RoHS6
MSN2700-CS2FE Spectrum™ based 100GbE 1U Development System with SDK, 32
QSFP28 ports, 2 Power Supplies (AC), Standard depth, x86 CPU,
P2C airflow, Rail Kit, RoHS6

Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems Rev 1.6
Mellanox Technologies 11
SN2410 MSN2410-CB2F Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
MLNX-OS, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies (AC),
x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-CB2R Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
MLNX-OS, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies (AC),
x86 dual core, Short depth, C2P airflow, Rail Kit, RoHS6
MSN2410-BB2F Spectrum™ based 10GbE/100GbE 1U Open Ethernet switch with
MLNX-OS, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies (AC),
x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-BB2FC Spectrum™ based 10GbE/100GbE 1U Open Ethernet switch with
Cumulus Linux, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-CB2FO Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
ONIE, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies (AC), x86
dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-BB2FO Spectrum™ based 10GbE/100GbE 1U Open Ethernet switch with
ONIE, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies (AC), x86
dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-CB2FC Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
Cumulus Linux, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-CB2FE Spectrum™ based 25GbE/100GbE 1U Development System with
SDK, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies (AC), x86
dual core, Short depth, P2C airflow, Rail Kit, RoHS6
Table 5 - Ordering Part Numbers (OPNs)
System
Model OPN Description

Introduction to Mellanox SN2000 Spectrum™ Ethernet Switch Systems
Rev 1.6
Mellanox Technologies
12
SN2100 MSN2100-CB2FO Spectrum™ based 100GbE 1U Open Switch with ONIE, 16 QSFP28
ports, 2 Power Supplies (AC), Short depth, Rangeley CPU, P2C air-
flow, Rail Kit must be purchased separately, RoHS6
MSN2100-BB2FO Spectrum™ based 40GbE 1U Open Ethernet switch with ONIE, 16
QSFP28 ports, 2 power supplies (AC), x86 dual core, Short depth,
P2C airflow, Rail Kit, RoHS6
MSN2100-BB2F Spectrum™ based 40GbE, 1U Open Ethernet Switch with MLNX-
OS, 16 QSFP28 ports, 2 Power Supplies (AC), short depth, Rangeley
CPU, P2C airflow, Rail Kit must be purchased separately, RoHS6
MSN2100-CB2F Spectrum™ based 100GbE, 1U Open Ethernet Switch with MLNX-
OS, 16 QSFP28 ports, 2 Power Supplies (AC), short depth, Rangeley
CPU, P2C airflow, Rail Kit must be purchased separately, RoHS6
MSN2100-CB2FC Spectrum™ based 100GbE, 1U Open Ethernet Switch with Cumulus,
16 QSFP28 ports, 2 Power Supplies (AC), short depth, Rangeley
CPU, P2C airflow, Rail Kit must be purchased separately, RoHS6
MSN2100-CB2FE Spectrum™ based 100GbE 1U Development System with SDK, 16
QSFP28 ports, 2 Power Supplies (AC), Short depth, Rangeley CPU,
P2C airflow, Rail Kit must be purchased separately, RoHS6
MSN2100-CB2R Spectrum™ based 100GbE, 1U Open Ethernet Switch with MLNX-
OS, 16 QSFP28 ports, 2 Power Supplies (AC), short depth, Rangeley
CPU, C2P airflow, Rail Kit must be purchased separately, RoHS6
MSN2100-BB2FC Spectrum™ based 40GbE, 1U Open Ethernet Switch with Cumulus,
16 QSFP28 ports, 2 Power Supplies (AC), short depth, Rangeley
CPU, P2C airflow, Rail Kit must be purchased separately, RoHS6
Table 5 - Ordering Part Numbers (OPNs)
System
Model OPN Description

Installation
Rev 1.6
Mellanox Technologies
14
2 Installation
2.1 Safety Warnings
Prior to the installation, please review the safety warnings as follows:
• For Nordic Countries Notices, see Section E.1, “Nordic Countries Notices,” on page 79.
• For Safety Warnings in English, see Section E.2, “Installation Safety Warnings
(English),” on page 79.
• For Safety Warnings in Hebrew, see Section E.3, “הנקתהב תוחיטב תורהזא (Hebrew),” on
page 82.
• For Safety Warnings in Chinese, see Section 1 on page 86.
• For Safety Warnings in French, see Section E.5, “Avertissements de sécurité pour
l'installation (French),” on page 91.
• For Safety Warnings in German, Section E.6, “Installation Sicherheitshinweise(Ger-
man),” on page 94.
• For Safety Warnings in Spanish, see Section E.7, “Advertencias de seguridad de insta-
lación (Spanish),” on page 98.
• For Safety Warnings in Russian, see Section E.8, “Предупреждения по технике
безопасности при установке (Russian),” on page 102.
• For Safety Warnings in Romanian, see Section E.9, “Avertismente privind siguranţa la
instalare (Romanian),” on page 105.
• For Safety Warnings in Croatian, see Section E.10, “Sigurnosna upozorenja za instali-
ranje (Croatian),” on page 109.
• For Safety Warnings in Italian, see Section E.11, “Avvertenze di sicurezza per
l’installazione (Italian),” on page 113.
• For Safety Warnings in Turkish see Section E.12, “Montaj Güvenlik Uyarıları(Turk-
ish),” on page 117.
2.2 System Installation and Initialization
Installation and initialization of the system require attention to the normal mechanical, power,
and thermal precautions for rack-mounted equipment.
The installation procedure for the system involves the following phases:
1. Follow the safety warnings in Section 2.1.
2. Pay attention to the air flow consideration within the system and rack - refer to “Air Flow” on
page 15.
3. Make sure that none of the package contents is missing or damaged - see “Package Contents”
on page 16.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take
precautions to guarantee proper ventilation in order to maintain good airflow at ambi-
ent temperature.

Installation Rev 1.6
Mellanox Technologies 15
4. Mount the system into a rack enclosure - see “19” Systems Mounting Options” on page 17.
5. Power on the system - refer to “Initial Power On” on page 40.
6. Perform system bring-up - see “System Bring-Up” on page 42.
7. [Optional]: FRU replacements are described in Section 2.9 on page 47.
2.3 Air Flow
Mellanox systems are offered with two air flow patterns:
• Power (rear) side inlet to connector side outlet - marked with blue power supplies/fans-
FRUs’ handles, as shown in Figure 6.
• Connector (front) side inlet to power side outlet - marked with red power supplies/fans
FRUs’ handles, as shown in Figure 7.
Table 6 provides an air flow color legend and respective OPN designation
The following information does not apply to SN2100. In the SN2100 systems, the fan
units are non-replaceable.
All servers and systems in the same rack should be planned with the same airflow
direction.
All FRU components need to have the same air flow direction. A mismatch in the air
flow will affect the heat dissipation.
Table 6 - Air Flow Color Legend
Direction OPN
Designation Description
Ending with
“-R”
Connector side inlet to power side outlet.
Red latches are placed on the power inlet
side.

Installation
Rev 1.6
Mellanox Technologies
16
Figure 6: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet
Figure 7: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet
2.4 Package Contents
Before installing your new system, unpack it and check against the parts list below that all the
parts have been sent. Check the parts for visible damage that may have occurred during shipping.
The SN2700 and SN2410 package content is as follows:
• 1 – System
• 1 – Rail kit
• 1 – Power cable for each power supply unit – Type C13-C14
• 1 – Cable retainer for each power supply unit
• 1 – DB9 to RJ-45 2m harness
The SN2100 package content is as follows:
• 1 – System
• 1 – Power cable for each power supply unit – Type C13-C14
Ending with
“-F”
Power side inlet to connector side outlet.
Blue latches are placed on the power inlet
side.
Table 6 - Air Flow Color Legend
Direction OPN
Designation Description

Installation Rev 1.6
Mellanox Technologies 17
• 1 – DB9 to RJ-451 2m harness
2.5 19” Systems Mounting Options
By default, the SN2700 system is sold with the static rail kit described in Section 2.5.1. The
SN2410 system is sold with the static rail kit described in Section 2.5.3. For the telescopic rail
kit installation instructions (can be used with SN2700 only), see Section 2.5.2.
The SN2100 system is sold without a rail kit. A designated rail kit can be purchased separately.
For installation instructions, see Section 2.5.4.
2.5.1 Static Rail Kit for SN2700
The following parts are included in the static rail kit (see Figure 8):
• 2x Rack mount rails (A)
• 2x Rack mount brackets (B)
• 2x Rack mount blades (C)
• 8x M6 Standard cage nuts¹ ² and 8x M6 Standard pan-head Phillips screws¹ (D)
• 4x Phillips100 DEG F.H TYPE-I ST.ST 6-32 X 1/4 screw with around patch (E)
¹ Other threads are available by special order: M5, 10-32, 12-24
² G-type cage-nut is available by special order.
A designated rail kit for the SN2100 systems can be purchased separately.
If anything is damaged or missing, contact your sales representative at support@mella-
nox.com.
At least two people are required to safely mount the system in the rack.
Table 7 - Installation Kit
Kit OPN Rack Size and Rack Depth Range
MTEF-KIT-A Short (17”-24”) or Standard (24”-34”)