Mellanox Technologies SX6710 Instructions for use

Mellanox SX67X0 1U Switch Systems Hardware
User Manual
Rev. 1.4
www.mellanox.com

Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: [phone]
Fax: [phone]
Mellanox Technologies, Ltd.
Beit Mellanox
PO Box 586 Yokneam 20692
Israel
www.mellanox.com
Tel: [phone]
Fax: [phone]
© Copyright 2015. Mellanox Technologies. All Rights Reserved.
Mellanox®, Mellanox logo, BridgeX®, ConnectX®, Connect-IB®, CoolBox®, CORE-Direct®, InfiniBridge®, InfiniHost®,
InfiniScale®, MetroX®, MLNX-OS®, TestX®, PhyX®, ScalableHPC®, SwitchX®, UFM®, Virtual Protocol Interconnect®
and Voltaire® are registered trademarks of Mellanox Technologies, Ltd.
ExtendX™, FabricIT™, HPC-X™, Mellanox Open Ethernet™, Mellanox PeerDirect ™, Mellanox Virtual Modular
Switch™, MetroDX™, Unbreakable-Link™ are trademarks of Mellanox Technologies, Ltd.
All other trademarks are property of their respective owners.
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE
THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT
HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE
PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND
DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST
QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT
ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES
FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND
(INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE
OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED
DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
Document Number: MLNX-15-4241
Mellanox Technologies
2

Mellanox Technologies 1
Table of Contents
Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 1 Introduction to Mellanox SX67X0 Systems. . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2 Speed and Switching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.3 Management Interfaces and FRUs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.5 Certifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.6 Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Chapter 2 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.1 Safety Warnings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.2 Air Flow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.3 Package Contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4 Mounting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.4.1 Battery Backup Unit (BBU) Installation for SX6720 . . . . . . . . . . . . . . . . . . . . . . 11
2.5 Mounting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.5.1 19” Systems Mounting - Static Rail-Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
2.5.2 19” Systems Mounting- Telescopic Rail-Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
2.6 Cable Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
2.6.1 Using a Breakout Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2.7 Initial Power On. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.8 Bring-Up of Managed Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.8.1 Configuring Network Attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.8.2 Remote Connection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.9 FRU Replacements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
2.9.1 Power Supply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
2.9.2 Fans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Chapter 3 Software Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
3.1 InfiniBand Subnet Manager. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
3.2 Fabric Inspector (Diagnostics). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
3.3 Upgrading Software (on Managed Systems). . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Chapter 4 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.1 Supported Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.1.1 Data Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.1.2 Speed. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.1.3 RS232 (Console) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
4.1.4 Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
4.1.5 USB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
4.1.6 Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
4.2 LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

Mellanox Technologies
2
4.2.1 LED Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
4.3 Inventory Pull-out Tab. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Chapter 5 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
5.1 Troubleshooting Instructions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Chapter 6 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
6.1 SX67X0 Series. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
Appendix A Accessory and Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Appendix B Thermal Threshold Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Appendix C Interface Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
C.1 QSFP Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
C.2 RJ-45 CONSOLE and I²C Interface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
C.3 RJ45 to DB9 Harness Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Appendix D Disassembly and Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
D.1 Disassembly Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
D.2 Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Appendix E Safety Warnings (Multiple Languages) . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
E.1 Nordic Countries Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
E.2 Installation Safety Warnings (English) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
E.3 (תירבע) הנקתהב תוחיטב תורהזא . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
E.4 安裝安全性警告 (Chinese) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
E.5 Avertissements de sécurité pour l'installation (French) . . . . . . . . . . . . . . . . . 71
E.6 Installation Sicherheitshinweise(German) . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
E.7 Advertencias de seguridad de instalación (Spanish) . . . . . . . . . . . . . . . . . . . 79
E.8 Предупреждения по технике безопасности при установке (Russian) . . . 84
E.9 Avertismente privind siguranţa la instalare (Romanian) . . . . . . . . . . . . . . . . 88
E.10 Sigurnosna upozorenja za instaliranje (Croatian). . . . . . . . . . . . . . . . . . . . . . 93
E.11 Avvertenze di sicurezza per l’installazione (italiano) . . . . . . . . . . . . . . . . . . 97
E.12 Montaj Güvenlik Uyarıları(Türkçe) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102

Mellanox Technologies 1
List of Figures
Figure 1: SX67X0 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
Figure 2: SX6710/SX6720 Rear Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Figure 3: SX6730 Rear Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
Figure 4: SX6790 Rear Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
Figure 5: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet . . . . . . . . . . . .9
Figure 6: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet . . . . . . . . . . . .9
Figure 7: SX6730 Air Flow Direction - Power Side Inlet to Connector Side Outlet . . . . . . . . . . . . .9
Figure 8: Unlocking the Latches and Extracting the PSU . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Figure 9: BBU Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Figure 10: BBU Insertion (Left) and Extraction (Right) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Figure 11: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Figure 12: Installation Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Figure 13: Attaching the Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Figure 14: Attaching the Brackets to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Figure 15: Attaching the Brackets to the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Figure 16: Sliding the Blades in the Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Figure 17: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 18: Rails Separation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 19: Mounting the Outer Rails into the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Figure 20: Attaching the Inner Rails to the Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Figure 21: Securing the Chassis in the Inner Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Figure 22: Sliding the Switch into the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Figure 23: Pulling the Unit Outwards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Figure 24: Locking Mechanism . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Figure 25: Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 26: Breakout or Fanout Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Figure 27: System Status LEDs 5 Minutes After Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
Figure 28: Two Power Inlets - Electric Caution Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
Figure 29: PS Unit Pulled Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 30: Fan Module Latches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Figure 31: System Status LEDs - Front and Rear sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Figure 32: Fan Status LED - Front and Rear Sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
Figure 33: Power Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
Figure 34: Rear Side Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Figure 35: Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46

Mellanox Technologies
2
Figure 36: Pull-out Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Figure 37: QSFP Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Figure 38: RJ45 to DB9 Harness Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55

Mellanox Technologies 1
List of Tables
Table 1: Revision History Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
Table 2: References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Table 3: Speed and Switching Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
Table 4: Management Interfaces and FRUs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
Table 5: Ordering Part Numbers (OPNs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6
Table 6: Air Flow Color Legend . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Table 7: Installation Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Table 8: Installation Kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Table 9: Port Splitting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Table 10: Serial Terminal Program Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
Table 11: Configuration Wizard Session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Table 12: Configuration Wizard Session - Static IP Configuration . . . . . . . . . . . . . . . . . . . . . . . . .32
Table 13: LEDs Symbols . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
Table 14: System Status LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
Table 15: Fan Status Front LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
Table 16: Fan Status Rear LED Assignments (One LED per Fan) . . . . . . . . . . . . . . . . . . . . . . . . .43
Table 17: Power Supply Unit Status Front LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
Table 18: Power Supply Unit Status Rear LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Table 19: Bad Port LED Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Table 20: Port LEDs in InfiniBand System Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
Table 21: Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Table 22: SX67X0 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
Table 23: OPNs for Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
Table 24: RJ-45 CONSOLE and I²C Pinout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55

2
Mellanox Technologies
Revision History
Table 1 - Revision History Table
Date
Revision
Description
August 2015
1.4
Ordering Information updated
May 2015
1.3
Added Hebrew safety warnings
Added BBU safety warnings in all languages
April 2015
1.2
Added “19”Systems Mounting- Telescopic Rail-Kit” on page 19.
January 2015
1.1
Minor formatting edits
January 2015
1.0
Initial release of the first edition

Mellanox Technologies 3
About this Manual
This manual describes the installation and basic use of the Mellanox InfiniBand systems.
Intended Audience
This manual is intended for IT managers and system administrators.
References
Table 2 - References
Document Description
InfiniBand Architecture Specifica-
tion, Volume 1, Release 1.2.1, and
Volume 2, Release 1.3
The InfiniBand Architecture Specification that is provided by IBTA
MLNX-OS® User Manual This document contains information regarding configuring and managing
MLNX-OS software- see http://www.mellanox.com/page/mlnx_os.
Conventions
The following icons are used throughout this document to indicate information that is important
to the user.
This icon makes recommendations to the user.
This icon indicates information that is helpful to the user.
This icon indicates a situation that can potentially cause damage to hardware or
software.
This icon indicates a situation that can potentially cause personal injury.

Introduction to Mellanox SX67X0 Systems
Mellanox Technologies
4
1 Introduction to Mellanox SX67X0 Systems
1.1 Overview
The SX67X0 systems provide the highest performing fabric solution in a 1U form factor by
delivering up to 4Tb/s of non-blocking bandwidth with 200ns port-to-port latency.
These systems are the industry's most cost-effective building blocks for embedded systems and
storage with a need for low port density systems. Whether looking at price-to-performance or
energy-to-performance, these systems offer superior performance, power and space, reducing
capital and operating expenses and providing the best return-on-investment. The systems are an
ideal choice for smaller departmental or back-end clustering uses with high-performance needs,
such as storage, data base and GPGPU clusters.
Powerful servers combined with high-performance storage and applications that use increasingly
complex computations are causing data bandwidth requirements to spiral upward. As servers are
deployed with next generation processors, High-Performance Computing (HPC) environments
and Enterprise Data Centers (EDC) need every last bit of bandwidth delivered with Mellanox’s
FDR InfiniBand systems.
Built with Mellanox’s sixth generation SwitchX®-2 InfiniBand FDR 56Gb/s system device,
these standalone systems are an ideal choice for top-of-rack leaf connectivity or for building
small to extremely large sized clusters.
These systems enable efficient computing with features such as static routing, adaptive routing,
and advanced congestion management. These features ensure the maximum effective fabric
bandwidth by eliminating congestion.
The managed systems comes with an onboard subnet manager, enabling simple, out-of-the-box
fabric bring-up for up to 648 nodes. MLNX-OS® software delivers complete chassis manage-
ment of firmware, power supplies, fans, ports and other interfaces.
Mellanox’s edge systems can also be coupled with Mellanox’s Unified Fabric Manager (UFM®)
software for managing scale-out InfiniBand computing environments. UFM enables data center
operators to efficiently provision, monitor and operate the modern data center fabric. UFM
boosts application performance and ensures that the fabric is up and running at all times.
InfiniBand systems come as internally or externally managed. Internally managed systems come
with a CPU that runs the management software (MLNX-OS®) and management ports which are
used to transfer management traffic into the system. Externally managed systems come without
the CPU and management ports and are managed using firmware tools.
Mellanox's InfiniBand to Ethernet gateway, built with Mellanox's SwitchX®-2 based systems,
provides the most cost-effective, high-performance solution for data center unified connectivity
solutions. Mellanox's gateways enable data centers to operate at up to 56Gb/s network speeds
while seamlessly connecting to 1, 10 and 40GbE networks with low latency (400ns). Existing
LAN infrastructures and management practices can be preserved, easing deployment and provid-
ing significant return-on-investment.
Figure 1: SX67X0 Front Side View

Mellanox Technologies
5
[Grab your reader’s attention with a great quote
from the document or use this space to emphasize
a key point. To place this text box anywhere on the
page, just drag it.]
1.2 Speed and Switching
Table 3 describes maximum throughput and interface speed per system model.
Table 3 - Speed and Switching Capabilities
System Model
10GbE* SFP+
Interfaces
40/56GbE QSFP+
Interfaces
Max Throughput
SX6710*
N/A
36**
4.032Tb/s
SX6720*
N/A
36**
4.032Tb/s
SX6730*
N/A
36**
4.032Tb/s
SX6790*
N/A
36**
4.032Tb/s
*The system can support 1Gb/s and 10Gb/s interfaces using QSFP to SFP adapters
**Up to 64x10GbE interfaces
1.3 Management Interfaces and FRUs
Table 4 lists the various management interfaces and available replacement parts per system
model.
Table 4 - Management Interfaces and FRUs
System
Model
USB
MGT (2
Ports)
I²C*
Console*
Replaceable
PSU
Replaceable
Fan
SX6710
Rear
Rear
Rear
Rear
Yes
Yes
SX6720
Rear
Rear
Rear
Rear
Yes
Yes
SX6730
Rear
Rear
Rear
Rear
Yes
Yes
SX6790
No
No
Rear
No
Yes
Yes
*The same connector is used for the I²C and the console interfaces.
Figure 2: SX6710/SX6720 Rear Side View
Figure 3: SX6730 Rear Side View
Figure 4: SX6790 Rear Side View

Introduction to Mellanox SX67X0 Systems
6
Mellanox Technologies
1.4 Features
For a full feature list, please refer to the system’s product brief:
http://www.mellanox.com/related-docs/prod_ib_switch_systems/PB_SX6710.pdf
1.5 Certifications
The list of certifications (such as EMC, Safety and others) per system for different regions of the
world is located on the Mellanox website at:
http://www.mellanox.com/page/environmental_compliance
1.6 Ordering Information
The following table lists ordering information for the available systems. Please pay attention to
the airflow direction when ordering your system. For more details, see “Air Flow” on page 8.
Table 5 - Ordering Part Numbers (OPNs)
System
Model
OPN
Description
SX6710
MSX6710-FB2F2
SwitchX®-2 based FDR InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies(AC), x86 dual core, short depth, rear to
front airflow, Rail Kit, RoHS6
MSX6710-FS2F2
SwitchX®-2 based FDR InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies(AC), x86 dual core, standard depth, rear
to front airflow, Rail Kit, RoHS6
MSX6710-FB2R2
SwitchX®-2 based FDR InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies (AC), x86 dual core, short depth, C2P
airflow, Rail Kit, RoHS6
MSX6710-FS2R2
SwitchX®-2 based FDR InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies (AC), x86 dual core, standard depth,
C2P airflow, Rail Kit, RoHS6
MSX6710-TB2F2
SwitchX®-2 based FDR10 InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies (AC), x86 dual core, short depth,
P2C airflow, Rail Kit, RoHS6
MSX6710-TB2R2
SwitchX®-2 based FDR10 InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies (AC), x86 dual core, short depth,
C2P airflow, Rail Kit, RoHS6
MSX6710-TS2F2
SwitchX®-2 based FDR10 InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies (AC), x86 dual core, standard
depth, P2C airflow, Rail Kit, RoHS6
MSX6710-TS2R2
SwitchX®-2 based FDR10 InfiniBand 1U Switch, 36 QSFP+ ports, 2 Power Supplies (AC), x86 dual core, standard
depth, C2P airflow, Rail Kit, RoHS6
SX6720
MSX6720-FS2F2
SwitchX®-2based FDR InfiniBand1U Switch BBU ready,36 QSFP+ ports, 2 PowerSupplies (AC), x86 dual core, standard
depth, rear to front airflow, Rail Kit, RoHS6
SX6730
MSX6730-FS2F2
SwitchX®-2 based FDR InfiniBand Switch NEBS certified, 36 QSFP+ ports, non- blocking switching capacity of 4Tbps, 2
Power Supplies (DC), Standard depth, Man- aged, rear to front airflow, Rail Kit must be purchased separately, RoHS6
SX6790
MSX6790-FB2F2
SwitchX®-2 based FDR InfiniBand Switch, 36 QSFP+ ports, 2 Power Supplies, Short depth, Unmanaged, P2C airflow,
with rack rails, RoHS6
MSX6790-FB2R2
SwitchX®-2 based FDR InfiniBand Switch, 36 QSFP+ ports, 2 Power Supplies, Short depth, Unmanaged, C2P airflow,
with rack rails, RoHS6
MSX6790-FS2F2
SwitchX®-2 based FDR InfiniBand Switch, 36 QSFP+ ports, 2 Power Supplies, Standard depth, Unmanaged, P2C
airflow, with rack rails, RoHS6
MSX6790-FS2R2
SwitchX®-2 based FDR InfiniBand Switch, 36 QSFP+ ports, 2 Power Supplies, Standard depth, Unmanaged, C2P
airflow, with rack rails, RoHS6
100-586-636-00
SwitchX®-2 based FDR InfiniBand Switch, 36 QSFP+ ports, 2 Power Supplies, Standard depth, Unmanaged, P2C
airflow, with rack rails, RoHS6
100-586-736-00
SwitchX®-2 based FDR InfiniBand Switch, 36 QSFP+ ports, 2 Power Supplies, Standard depth, Unmanaged, P2C
airflow, with rack rails, RoHS6

Mellanox Technologies 7
2Installation
Installation and initialization of the system require attention to the normal mechanical, power,
and thermal precautions for rack-mounted equipment.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take
precautions to guarantee proper ventilation in order to maintain good airflow at ambi-
ent temperature.

The installation procedure for the system involves the following phases:
1. Follow the safety warnings in Section 2.1.
2. Pay attention to the air flow consideration within the system and rack - refer to “Air Flow” on
page 8.
3. Make sure that none of the package contents is missing or damaged - see “Package Contents”
on page 9
4. Power on the system - refer to “Initial Power On” on page 28
5. Perform system bring-up - see “Bring-Up of Managed Systems” on page 29
FRU replacements are described in Section 2.9 on page 34.
2.1 Safety Warnings
Prior to the installation, please review the safety warnings as follows:
For Nordic Countries Notices, see Section E.1, “Nordic Countries Notices,” on page 57.
For Safety Warnings in English, see Section E.2, “Installation Safety Warnings (English),” on
page 57.
For Safety Warnings in Hebrew, see Section E.3, “(תירבע) הנקתהבתוחיטב תורהזא,” on page 61.
For Safety Warnings in Chinese, see “????” on page 65..
For Safety Warnings in French, see Section E.5, “Avertissements de sécurité pour l'installation
(French),” on page 71.
For Safety Warnings in German, Section E.6, “Installation Sicherheitshinweise(German),” on
page 75.
For Safety Warnings in Spanish, see Section E.7, “Advertencias de seguridad de instalación
(Spanish),” on page 79.
For Safety Warnings in Russian, see Section E.8, “Предупреждения по технике безопасности
при установке (Russian),” on page 84.
For Safety Warnings in Romanian, see Section E.9, “Avertismente privind siguranţa la instalare
(Romanian),” on page 88.
For Safety Warnings in Croatian, see Section E.10, “Sigurnosna upozorenja za instaliranje (Croa-
tian),” on page 93.
For Safety Warnings in Italian, see Section E.11, “Avvertenze di sicurezza per l’installazione
(italiano),” on page 97.

Installation
Mellanox Technologies
8
For Safety Warnings in Turkish see Section E.12, “Montaj Güvenlik Uyarıları(Türkçe),” on
page 102.
2.2 Air Flow
Mellanox systems are offered with two air flow patterns:
• Power (rear) side inlet to connector side outlet - marked with blue power supplies/fans-
FRUs’ handles, as shown in Figure 5.
• Connector (front) side inlet to power side outlet - marked with red power supplies/fans
FRUs’ handles, as shown in figure Figure 6.
All servers and systems in the same rack should be planned with the same airflow
direction.
All FRU components need to have the same air flow direction. A mismatch in the air
flow will affect the heat dissipation.
Table 6 provides an air flow color legend and respective OPN designations.
Table 6 - Air Flow Color Legend
Direction OPN
Designation Description
RConnector side inlet to power side outlet.
Red latches are placed on the power inlet
side.
FPower side inlet to connector side outlet.
Blue latches are placed on the power inlet
side.

Mellanox Technologies 9
Figure 5: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet
Figure 6: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet
Figure 7: SX6730 Air Flow Direction - Power Side Inlet to Connector Side Outlet
2.3 Package Contents
Before installing your new system, unpack it and check against the parts list below that all the
parts have been sent. Check the parts for visible damage that may have occurred during shipping.
The SX6710 package content is as follows:
• 1 – System
• 1 – Rail kit
• Power cables – Type C13 to C14, length 183cm
• 1 – Harness DB9 to RJ-45
• 1 – Quick Start Guide
The SX6720 package content is as follows:
• 1 – System
• 1 – Rail kit
• Power cables – Type C13 to C14, length 183cm
• 1 – Harness DB9 to RJ-45
• 1 – Quick Start Guide
The SX6730 package content is as follows:
• 1 – System
• 1 – Harness DB9 to RJ-45
• Quick Start Guide

For connection of the SX6730, a DC cable is required. Such a cable is not included in
the basic package and should be ordered separately.
If anything is damaged or missing, contact your sales representative at support@mella-
nox.com.
Installation
Mellanox Technologies
10

Mellanox Technologies 11
2.4 Mounting Options
2.4.1 Battery Backup Unit (BBU) Installation for SX6720
If the BBU is deformed, leaking, corroded or visually damaged, replace it immediately
Do not use a BBU that was not provided by Mellanox Technologies
• A BBU that has not been used for two years or longer past ts printed manufacturing
date is unusable.
• A BBU that is older than five years, according to the printed manufacturing date,
has reached its "end of life" state and may not provide enough energy to handle the
platform.
• In case the battery should be replaced, software notifications will appear on a
monthly basis, starting three months before EOL time.
A new Battery Back-up Unit (BBU) will be approximately 50% charged when you receive it. In
case of a power outage, only a fully charged BBU can supply power of up to 5 minutes to the sys-
tem.
2.4.1.1 Installing the Battery
Step 1. Extract the power FRU module from the chassis of the switch by unlocking all latches
Step 2. Insert the BBU into the empty slot in the module by sliding it in and pushing the top end of it
down until it snaps into place, as illustrated in the left image of Figure 10.
Step 3. Slide the module back into the chassis.
2.4.1.2 Extracting the Battery
Step 1. Extract the power FRU module from the chassis of the switch by unlocking all latches.
Step 2. Press both release buttons simultaneously and lift the battery up to remove it, as illustrated in
the right image of Figure 10.
Step 3. Slide the module back into the chassis.

Installation
Mellanox Technologies
12
Figure 8: Unlocking the Latches and Extracting the PSU
Figure 9: BBU Location

Mellanox Technologies 13
Figure 10: BBU Insertion (Left) and Extraction (Right)

Installation
Mellanox Technologies
14
2.5 Mounting Options
By default, the system is sold with the Static Rail-kit described in Section 2.5.1. A Telescopic
rail-kit can be purchased separately. For the Telescopic Rail-kit installation instructions, see Sec-
tion 2.5.2.
2.5.1 19” Systems Mounting - Static Rail-Kit
At least two people are required to safely mount the system in the rack.
Table 7 - Installation Kit
Kit OPN Rack Size and Rack Depth Range
MTEF-KIT-A Short (17”-24”) or Standard (24”-34”)
The following parts are included in the Static Rail kit (see Figure 11):
• 2x Rack mount rails (A)
• 2x Rack mount brackets (B)
• 2x Rack mount blades (C)
• 8x M6 Standard cage nuts and 8x M6 Standard pan-head Phillips screws (D)
• 4x Phillips100 DEG F.H TYPE-I ST.ST 6-32 X 1/4 screw with around patch (E).