Mellanox Technologies Spectrum SN2700 Instructions for use

www.mellanox.com
Mellanox 1U Switch Systems Hardware User
Manual
Models: SN2700 and SN2410
Rev 1.2

Document Number: MLNX-15-5439
Mellanox Technologies
2
Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: [phone]
Fax: [phone]
© Copyright 2016. Mellanox Technologies LTD. All Rights Reserved.
Mellanox®, Mellanox logo, BridgeX®, CloudX logo, Connect-IB®, ConnectX®, CoolBox®, CORE-Direct®, EZchip®,
EZchip logo, EZappliance®, EZdesign®, EZdriver®, EZsystem®, GPUDirect®, InfiniHost®, InfiniScale®, Kotura®, Kotura
logo, Mellanox Federal Systems®, Mellanox Open Ethernet®, Mellanox ScalableHPC®, Mellanox Connect Accelerate
Outperform logo, Mellanox Virtual Modular Switch®, MetroDX®, MetroX®, MLNX-OS®, NP-1c®, NP-2®, NP-3®, Open
Ethernet logo, PhyX®, SwitchX®, Tilera®, Tilera logo, TestX®, The Generation of Open Ethernet logo, UFM®, Virtual
Protocol Interconnect®, Voltaire® and Voltaire logo are registered trademarks of Mellanox Technologies, Ltd.
All other trademarks are property of their respective owners.
For the most updated list of Mellanox trademraks, visit http://www.mellanox.com/page/trademarks
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE
THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT
HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S)
AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT
GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY. ANY
EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE DISCLAIMED.
IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT,
INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT
LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA,
OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY,
WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED DOCUMENTATION EVEN IF
ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Rev 1.2
Mellanox Technologies 3
Table of Contents
Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Chapter 1 Introduction to Mellanox SN2XXX Spectrum™
Ethernet Switch Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
1.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
1.2 Speed and Switching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
1.3 Management Interfaces and FRUs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
1.4 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.5 Certifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.6 Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Chapter 2 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.1 Safety Warnings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.2 Air Flow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
2.3 Package Contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.4 Mounting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
2.4.1 19” Systems Mounting - Static Rail-Kit for SN2700 . . . . . . . . . . . . . . . . . . . . . . 18
2.4.2 19” Systems Mounting- Telescopic Rail-Kit for SN2700 . . . . . . . . . . . . . . . . . . 23
2.4.3 19” Systems Mounting - Static Rail-Kit for SN2410 . . . . . . . . . . . . . . . . . . . . . . 28
2.5 Cable Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.5.1 Breakout Cables and Adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.6 Initial Power On. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
2.7 System Bring-Up . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
2.7.1 Configuring Network Attributes Using MLNX-OS . . . . . . . . . . . . . . . . . . . . . . . 35
2.7.2 Configuring Network Attributes Using Cumulus Linux. . . . . . . . . . . . . . . . . . . . 40
2.8 FRU Replacements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
2.8.1 Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
2.8.2 Fans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Chapter 3 Software Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
3.1 Upgrading Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
3.1.1 MLNX-OS Software Upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
3.1.2 Cumulus Linux Software Upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Chapter 4 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1 Supported Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1.1 Data Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1.2 Speed. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1.3 RS232 (Console) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1.4 Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
4.1.5 USB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
4.1.6 Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
4.2 LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Mellanox Technologies
4
4.2.1 LED Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
4.3 Inventory Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Chapter 5 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
5.1 Troubleshooting Instructions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Chapter 6 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
6.1 SN2700 Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
6.2 SN2410 Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Appendix A Accessory and Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Appendix B Thermal Threshold Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Appendix C Interface Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
C.1 QSFP Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
C.2 SFP+ Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
C.3 RJ45 to DB9 Harness Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Appendix D Disassembly and Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
D.1 Disassembly Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
D.2 Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Appendix E Safety Warnings (Multiple Languages) . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
E.1 Nordic Countries Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
E.2 Installation Safety Warnings (English) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
E.3 הנקתהב תוחיטב תורהזא (Hebrew) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
E.4 安裝安全性警告 (Chinese) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
E.5 Avertissements de sécurité pour l'installation (French) . . . . . . . . . . . . . . . . . 79
E.6 Installation Sicherheitshinweise(German) . . . . . . . . . . . . . . . . . . . . . . . . . . . 82
E.7 Advertencias de seguridad de instalación (Spanish) . . . . . . . . . . . . . . . . . . . 86
E.8 Предупреждения по технике безопасности при установке (Russian) . . . 90
E.9 Avertismente privind siguranţa la instalare (Romanian) . . . . . . . . . . . . . . . . 93
E.10 Sigurnosna upozorenja za instaliranje (Croatian). . . . . . . . . . . . . . . . . . . . . . 97
E.11 Avvertenze di sicurezza per l’installazione (Italian) . . . . . . . . . . . . . . . . . . 101
E.12 Montaj Güvenlik Uyarıları(Turkish) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
E.13 Japan VCCI Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109

Rev 1.2
Mellanox Technologies 5
List of Figures
Figure 1: SN2700 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Figure 2: SN2410 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Figure 3: SN2700 and SN2410 Rear Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Figure 4: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet . . . . . . . . . . .17
Figure 5: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet . . . . . . . . . . .17
Figure 6: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Figure 7: Installation Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 8: Attaching the Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 9: Attaching the Brackets to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Figure 10: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Figure 11: Attaching the Brackets to the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Figure 12: Sliding the Blades in the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Figure 13: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
Figure 14: Rails Separation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
Figure 15: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 16: Mounting the Outer Rails into the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 17: Attaching the Inner Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Figure 18: Securing the Chassis in the Inner Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Figure 19: Sliding the Switch into the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Figure 20: Pulling the Unit Outwards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Figure 21: Locking Mechanism . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
Figure 22: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
Figure 23: Installation Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Figure 24: Attaching the Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Figure 25: Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Figure 26: Attaching the Rails to the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Figure 27: Sliding the Blades in the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Figure 28: Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Figure 29: Breakout or Fanout Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 30: SN2700 Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 31: SN2410 Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Figure 32: System Status LEDs 5 Minutes After Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 33: Two Power Inlets - Electric Caution Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 34: PS Unit Pulled Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
Figure 35: Fan Module Latches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42

Mellanox Technologies
6
Figure 36: System Status LEDs - Front and Rear Sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
Figure 37: Fan Status LED - Front and Rear Sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47
Figure 38: Power Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Figure 39: Rear Side Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
Figure 40: SN2700 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Figure 41: SN2410 SFP28 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Figure 42: SN2410 QSFP28 Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Figure 43: SN2700 Pull-out Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52
Figure 44: SN2410 Inventory Information Illustration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53
Figure 45: QSFP Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62
Figure 46: Rear View of Module With Pin Placement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63
Figure 47: RJ45 to DB9 Harness Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65

Rev 1.2
Mellanox Technologies 7
List of Tables
Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Table 2: References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9
Table 3: Speed and Switching Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Table 4: Management Interfaces and FRUs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Table 5: Ordering Part Numbers (OPNs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Table 6: Air Flow Color Legend . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Table 7: Installation Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Table 8: Installation Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Table 9: Installation Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
Table 10: Serial Terminal Program Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Table 11: Configuration Wizard Session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Table 12: Configuration Wizard Session - Static IP Configuration . . . . . . . . . . . . . . . . . . . . . . . . .38
Table 13: LEDs Symbols . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
Table 14: System Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47
Table 15: Fan Status Front LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Table 16: Fan Status Rear LED Assignments (One LED per Fan) . . . . . . . . . . . . . . . . . . . . . . . . .48
Table 17: Power Supply Unit Status Front LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
Table 18: Power Supply Unit Status Rear LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49
Table 19: Bad Port LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
Table 20: Port LEDs in Ethernet System Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Table 21: Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
Table 22: SN2700 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56
Table 23: SN2410 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58
Table 24: OPNs for Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59

Rev 1.2
Mellanox Technologies
8
Revision History
Table 1 - Revision History Table
Date Revision Description
March 2016 1.2 Updated:
•“Introduction to Mellanox SN2XXX Spectrum™ Ethernet Switch Systems”
•“Software Management”
•“Troubleshooting Instructions”
•“Specifications”
•“Accessory and Replacement Parts”
Added:
• Taiwan BSMI Class A Statement in “Safety Warnings (Multiple Languages)”
December 2015 1.1 Added SN2410
August 2015 1.0 Initial revision

Rev 1.2
Mellanox Technologies 9
About this Manual
This manual describes the installation and basic use of the Mellanox Ethernet systems.
Intended Audience
This manual is intended for IT managers and system administrators.
References
Conventions
The following icons are used throughout this document to indicate information that is important
to the user.
Table 2 - References
Document Description
MLNX-OS® User Manual This document contains information regarding the configuration and man-
agement of the MLNX-OS software. See http://www.mellanox.com/page/
mlnx_os.
Cumulus Linux User Guide This document contains information regarding the configuration and man-
agement of the Cumulus® Linux® software. See https://docs.cumulusnet-
works.com/display/DOCS.
Open Network Install Envi-
ronment (ONIE) Quick
Start Guide
See https://github.com/opencomputeproject/onie/wiki/Quick-Start-Guide/.
This icon makes recommendations to the user.
This icon indicates information that is helpful to the user.

Rev 1.2
Mellanox Technologies
10
This icon indicates a situation that can potentially cause damage to hardware or
software.
This icon indicates a situation that can potentially cause personal injury.

Introduction to Mellanox SN2XXX Spectrum™ Ethernet Switch Systems Rev 1.2
Mellanox Technologies 11
1 Introduction to Mellanox SN2XXX Spectrum™
Ethernet Switch Systems
1.1 Overview
Mellanox Spectrum™ based 1U switch systems are an ideal spine and Top of Rack (ToR) solu-
tion, allowing maximum flexibility, with port speeds spanning from 10Gb/s to 100Gb/s per port,
and port density that enables full rack connectivity to any server at any speed. The uplink ports
allow a variety of blocking ratios that suit any application requirement. Powered by the Spectrum
ASIC, the systems carry whopping switching and processing capacities in a compact 1U form
factor.
Keeping with the Mellanox tradition of setting performance record switch systems, the Spectrum
based systems introduce the world’s lowest latency for 100GbE switching and routing elements,
and do so while having the lowest power consumption in the market. They enable the use of 10,
25, 40, 50 and 100GbE in a large scale without changing power infrastructure facilities.
The Spectrum™ based 1U switch systems are a part of Mellanox’s complete end-to-end solution,
which provides 10GbE through 100GbE interconnectivity within the data center. Other devices
in this solution include ConnectX-4 based network interface cards, and LinkX copper or fiber
cabling. This end-to-end solution is topped with NEO, a management application that relieves
some of the major obstacles standing in the way when deploying a network. NEO enables a fully
certified and interoperable design, speeds up time to service and RoI. The systems introduce
hardware capabilities for multiple tunneling protocols that enable increased reachability and scal-
ability for today’s data centers. Implementing MPLS, NVGRE and VXLAN tunneling encapsu-
lations in the network layer of the data center allows more flexibility for terminating a tunnel by
the network, in addition to termination on the server endpoint.
While Spectrum provides the thrust and acceleration that powers the switch systems, they get yet
another angle of capabilities, running with a powerful x86-based processor, which allows them to
not only be the highest performing switch fabric elements, but also grants them the ability to
incorporate a Linux running server into the same device. This opens up multiple application
aspects of utilizing the high CPU processing power and the best switching fabric, to create a
powerful machine with unique appliance capabilities that can improve numerous network imple-
mentation paradigms.
The Spectrum™ based 1U switch systems support the Open Network Install Environment
(ONIE) for zero touch installations of network operating systems. While all Ethernet systems can
be purchased preloaded with Mellanox-OS, the SN2700 and SN2410 switches (in both the
100GbE and the 40GbE versions) are offered, in addition, with Cumulus Linux support, as an
alternative operating system. For a full list of all available ordering options, see “Ordering Infor-
mation”.

Introduction to Mellanox SN2XXX Spectrum™ Ethernet Switch Systems
Rev 1.2
Mellanox Technologies
12
Figure 1: SN2700 Front Side View
Figure 2: SN2410 Front Side View
Figure 3: SN2700 and SN2410 Rear Side View
1.2 Speed and Switching
Table 3 describes maximum throughput and interface speed per system model.
*The system can support different interfaces and speed rates using QSFP to SFP adapters or hybrid cables. For further information,
see “Breakout Cables and Adapters”.
1.3 Management Interfaces and FRUs
Table 4 lists the various management interfaces and available replacement parts per system
model.
Table 3 - Speed and Switching Capabilities
System Model 10/25GbE SFP28 Interfaces* 40/50/56/100GbE
QSFP28 Interfaces* Max Throughput
SN2700 64 (using QSFP to SFP breakout
cables)
32 6.4Tb/s
SN2410 Total 64, 48zSFP+ 16 (using
QSFP to SFP breakout cables)
84Tb/s
Table 4 - Management Interfaces and FRUs
System Model USB MGT Console Replaceable
PSU
Replaceable
Fan
SN2700 Rear Rear (2 ports) Rear 2 units 4 units
SN2410 Rear Rear (2 ports) Rear 2 units 4 units

Introduction to Mellanox SN2XXX Spectrum™ Ethernet Switch Systems Rev 1.2
Mellanox Technologies 13
1.4 Features
For a full feature list, please refer to the system’s product brief. Go to http://www.mellanox.com.
In the main menu, click on Products--> Ethernet Switch Systems, and select the desired product
page.
1.5 Certifications
The list of certifications (such as EMC, Safety and others) per system for different regions of the
world is located on the Mellanox website at:
http://www.mellanox.com/page/environmental_compliance.
1.6 Ordering Information
The following table lists ordering information for the available systems. Please pay attention to
the airflow direction when ordering your system. For more details, see “Air Flow”.
Table 5 - Ordering Part Numbers (OPNs)
System
Model OPN Description
SN2700 MSN2700-CS2F Spectrum™ based 100GbE 1U Open Ethernet Switch with MLNX-
OS, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth, x86
CPU, P2C airflow, Rail Kit, RoHS6
MSN2700-CS2R Spectrum™ based 100GbE 1U Open Ethernet Switch with MLNX-
OS, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth, x86
CPU, C2P airflow, Rail Kit, RoHS6
MSN2700-CS2FO Spectrum™ based 100GbE 1U Open Switch with ONIE, 32
QSFP28 ports, 2 Power Supplies (AC), Standard depth, x86 CPU,
P2C airflow, Rail Kit, RoHS6
MSN2700-BS2F Spectrum™ based 40GbE, 1U Open Ethernet Switch with MLNX-
OS, 32 QSFP28 ports, 2 Power Supplies (AC), x86 CPU, Standard
depth, P2C airflow, Rail Kit, RoHS6
MSN2700-BS2FC Spectrum™ based 40GbE, 1U Open Ethernet Switch with Cumulus
Linux, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth,
x86 CPU, P2C airflow, Rail Kit, RoHS6
MSN2700-BS2RC Spectrum™ based 40GbE, 1U Open Ethernet Switch with Cumulus
Linux, 32 QSFP28 ports, 2 Power Supplies (AC), Standard depth,
x86 CPU, C2P airflow, Rail Kit, RoHS6
MSN2700-CS2FC Spectrum™ based 100GbE 1U Open Ethernet Switch with Cumu-
lus Linux, 32 QSFP28 ports, 2 Power Supplies (AC), Standard
depth, x86 CPU, P2C airflow, Rail Kit, RoHS6
MSN2700-CS2RC Spectrum™ based 100GbE 1U Open Ethernet Switch with Cumu-
lus Linux, 32 QSFP28 ports, 2 Power Supplies (AC), Standard
depth, x86 CPU, C2P airflow, Rail Kit, RoHS6

Introduction to Mellanox SN2XXX Spectrum™ Ethernet Switch Systems
Rev 1.2
Mellanox Technologies
14
SN2410 MSN2410-CB2F Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
MLNX-OS, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-BB2F Spectrum™ based 10GbE/40GbE 1U Open Ethernet switch with
MLNX-OS, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-BB2FC Spectrum™ based 10GbE/40GbE 1U Open Ethernet switch with
Cumulus Linux, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-BB2RC Spectrum™ based 10GbE/40GbE 1U Open Ethernet switch with
Cumulus Linux, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, C2P airflow, Rail Kit, RoHS6
MSN2410-CB2FC Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
Cumulus Linux, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, P2C airflow, Rail Kit, RoHS6
MSN2410-CB2RC Spectrum™ based 25GbE/100GbE 1U Open Ethernet switch with
Cumulus Linux, 48 SFP28 ports, 8 QSFP28 ports, 2 power supplies
(AC), x86 dual core, Short depth, C2P airflow, Rail Kit, RoHS6
Table 5 - Ordering Part Numbers (OPNs)
System
Model OPN Description

Installation Rev 1.2
Mellanox Technologies 15
2 Installation
Installation and initialization of the system require attention to the normal mechanical, power,
and thermal precautions for rack-mounted equipment.
The installation procedure for the system involves the following phases:
1. Follow the safety warnings in Section 2.1.
2. Pay attention to the air flow consideration within the system and rack - refer to “Air Flow” on
page 16.
3. Make sure that none of the package contents is missing or damaged - see “Package Contents”
on page 17.
4. Mount the system into a rack enclosure - see “Mounting Options” on page 18.
5. Power on the system - refer to “Initial Power On” on page 34.
6. Perform system bring-up - see “System Bring-Up” on page 35.
FRU replacements are described in Section 2.8 on page 40.
2.1 Safety Warnings
Prior to the installation, please review the safety warnings as follows:
• For Nordic Countries Notices, see Section E.1, “Nordic Countries Notices,” on page 67.
• For Safety Warnings in English, see Section E.2, “Installation Safety Warnings
(English),” on page 67.
• For Safety Warnings in Hebrew, see Section E.3, “הנקתהב תוחיטב תורהזא (Hebrew),” on
page 70.
• For Safety Warnings in Chinese, see Section 1 on page 74.
• For Safety Warnings in French, see Section E.5, “Avertissements de sécurité pour
l'installation (French),” on page 79.
• For Safety Warnings in German, Section E.6, “Installation Sicherheitshinweise(Ger-
man),” on page 82.
• For Safety Warnings in Spanish, see Section E.7, “Advertencias de seguridad de insta-
lación (Spanish),” on page 86.
• For Safety Warnings in Russian, see Section E.8, “Предупреждения по технике
безопасности при установке (Russian),” on page 90.
• For Safety Warnings in Romanian, see Section E.9, “Avertismente privind siguranţa la
instalare (Romanian),” on page 93.
• For Safety Warnings in Croatian, see Section E.10, “Sigurnosna upozorenja za instali-
ranje (Croatian),” on page 97.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take
precautions to guarantee proper ventilation in order to maintain good airflow at ambi-
ent temperature.

Installation
Rev 1.2
Mellanox Technologies
16
• For Safety Warnings in Italian, see Section E.11, “Avvertenze di sicurezza per
l’installazione (Italian),” on page 101.
• For Safety Warnings in Turkish see Section E.12, “Montaj Güvenlik Uyarıları(Turk-
ish),” on page 105.
2.2 Air Flow
Mellanox systems are offered with two air flow patterns:
• Power (rear) side inlet to connector side outlet - marked with blue power supplies/fans-
FRUs’ handles, as shown in Figure 4.
• Connector (front) side inlet to power side outlet - marked with red power supplies/fans
FRUs’ handles, as shown in figure Figure 5.
Table 6 provides an air flow color legend and respective OPN designations.
All servers and systems in the same rack should be planned with the same airflow
direction.
All FRU components need to have the same air flow direction. A mismatch in the air
flow will affect the heat dissipation.
Table 6 - Air Flow Color Legend
Direction OPN
Designation Description
Ending with
“-R”
Connector side inlet to power side outlet.
Red latches are placed on the power inlet
side.
Ending with
“-F”
Power side inlet to connector side outlet.
Blue latches are placed on the power inlet
side.

Installation Rev 1.2
Mellanox Technologies 17
Figure 4: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet
Figure 5: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet
2.3 Package Contents
Before installing your new system, unpack it and check against the parts list below that all the
parts have been sent. Check the parts for visible damage that may have occurred during shipping.
The SN2700 and SN2410 package content is as follows:
• 1 – System
• 1 – Rail kit
• 1 – Power cable for each power supply unit – Type C13-C14
• 1 – Cable retainer for each power supply unit
• 1 – DB9 to RJ-451 2m harness

Installation
Rev 1.2
Mellanox Technologies
18
2.4 Mounting Options
By default, the SN2700 system is sold with the Static Rail-kit described in Section 2.4.1. The
SN2410 system is sold with the Static Rail-kit described in Section 2.4.3. For the Telescopic
Rail-kit installation instructions, (can be used with SN2700 only) see Section 2.4.2.
2.4.1 19” Systems Mounting - Static Rail-Kit for SN2700
The following parts are included in the Static Rail kit (see Figure 6):
• 2x Rack mount rails (A)
• 2x Rack mount brackets (B)
• 2x Rack mount blades (C)
• 8x M6 Standard cage nuts¹ ² and 8x M6 Standard pan-head Phillips screws¹ (D)
• 4x Phillips100 DEG F.H TYPE-I ST.ST 6-32 X 1/4 screw with around patch (E)
¹ Other threads are available by special order: M5, 10-32, 12-24
² G-type cage-nut is available by special order.
If anything is damaged or missing, contact your sales representative at support@mella-
nox.com.
At least two people are required to safely mount the system in the rack.
Table 7 - Installation Kit
Kit OPN Rack Size and Rack Depth Range
MTEF-KIT-A Short (17”-24”) or Standard (24”-34”)

Installation Rev 1.2
Mellanox Technologies 19
Figure 6: Rack Rail Kit Parts
To mount the system into the rack:
Before mounting the system to the rack, select the way you wish to place the system. Pay atten-
tion to the airflow within the rack cooling, connector and cabling options.
While planning how to place the system, consider the two installation options shown in Figure 7,
and review the following points:
• Make sure the system air flow is compatible with your installation selection. It is
important to keep the airflow within the rack in the same direction.
• Note that the part of the system to which you choose to attach the rails (the front panel
direction, as demonstrated in Option 1 or the FRUs direction, as demonstrated in Option
2) will determine the system’s adjustable side. The system’s part to which the brackets
are attached will be adjacent to the cabinet.
• The FRU side is extractable. Mounting the rack brackets inverted to the FRU side
(Option 2) will allow you to slide the FRUs, in and out.

Installation
Rev 1.2
Mellanox Technologies
20
Figure 7: Installation Options
Step 1. Attach the left and right rack mount rails (A) to the switch, by gently pushing the switch chas-
sis’ pins through the slider key holes, until locking occurs.
Step 2. Secure the chassis in the rails by screwing 2 flat head Phillips screws (E) in the designated
points with a torque of 1.5±0.2 Nm. See Figure 8.
Figure 8: Attaching the Rails to the Chassis
Step 3. Attach the left and right rack mount brackets (B) to the switch, by gently pushing the switch
chassis’ pins through the slider key holes, until locking occurs. Secure the system in the brack-
ets by screwing the remaining 2 flat head Phillips screws (E) in the designated points with a
torque of 1.5±0.2 Nm. See Figure 9.