Mellanox Technologies TX6000 Instructions for use

www.mellanox.com
Mellanox TX6000/TX6100 Long Haul Systems
Hardware User Manual
Rev. 1.0

Mellanox Technologies
350 Oakmead Parkway Suite 100
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: [phone]
Fax: [phone]
Mellanox Technologies, Ltd.
Beit Mellanox
PO Box 586 Yokneam 20692
Israel
www.mellanox.com
Tel: [phone]
Fax: [phone]
© Copyright 2014. Mellanox Technologies. All Rights Reserved.
Mellanox®, Mellanox logo, BridgeX®, ConnectX®, CORE-Direct®, InfiniBridge®, InfiniHost®, InfiniScale®,
MLNX-OS®, PhyX®, SwitchX®, UFM®, Virtual Protocol Interconnect® and Voltaire® are registered trademarks of
Mellanox Technologies, Ltd.
Connect-IB™, ExtendX™, FabricIT™, Mellanox Open Ethernet™, Mellanox Virtual Modular Switch™, MetroX™,
MetroDX™, ScalableHPC™, Unbreakable-Link™ are trademarks of Mellanox Technologies, Ltd.
All other trademarks are property of their respective owners.
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE
THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT
HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE
PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND
DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST
QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT
ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES
FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND
(INCLUDING, BUT NOT LIMITED TO, PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE
OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED
DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
Document Number: MLNX-15-4045
Mellanox Technologies
2

Mellanox Technologies 1
Table of Contents
Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 1 Introduction to Mellanox TX6000/TX6100 Long Haul Systems. . . . . . . . . . 4
1.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2 Speed and Switching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.3 Management Interfaces and FRUs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4.1 Network Management Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4.2 InfiniBand Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4.3 Long Haul Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.5 Certifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.6 Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Chapter 2 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.1 Safety Warnings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.2 Air Flow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.3 Package Contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
2.4 Mounting Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.4.1 19” Systems Mounting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
2.5 Grounding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
2.6 Cable Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.6.1 Using a Breakout Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2.7 Initial Power On. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
2.8 System Bring-Up . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
2.8.1 Configuring Network Attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
2.8.2 Remote Connection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
2.9 FRU Replacements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
2.9.1 Power Supply and Fans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Chapter 3 Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
3.1 Supported Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
3.1.1 Data Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
3.1.2 Speed. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
3.1.3 RS232 (Console) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
3.1.4 Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
3.1.5 USB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
3.1.6 I2C. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
3.1.7 Reset Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
3.2 LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
3.2.1 LED Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
3.2.2 Status LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
3.2.3 Port LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
3.3 Inventory Pull-out Tab. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

Mellanox Technologies
2
Chapter 4 Software Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
4.1 Upgrading Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Chapter 5 Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
5.1 Troubleshooting Instructions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Chapter 6 Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
6.1 TX6000 System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
6.2 TX6100 System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Appendix A Accessory and Replacement Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Appendix B Thermal Threshold Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Appendix C Interface Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
C.1 QSFP Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
C.2 RJ-45 CONSOLE and I2C Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Appendix D Disassembly and Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
D.1 Disassembly Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
D.2 Disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Appendix E Safety Warnings (Multiple Languages) . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
E.1 Nordic Countries Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
E.2 Installation Safety Warnings (English) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
E.3 安裝安全性警告 (Chinese) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
E.4 Avertissements de sécurité pour l'installation (French) . . . . . . . . . . . . . . . . . 56
E.5 Installation Sicherheitshinweise(German) . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
E.6 Advertencias de seguridad de instalación (Spanish) . . . . . . . . . . . . . . . . . . . 62
E.7 Предупреждения по технике безопасности при установке
(Russian) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66
E.8 Avertismente privind siguranţa la instalare (Romanian) . . . . . . . . . . . . . . . . 69
E.9 Sigurnosna upozorenja za instaliranje (Croatian). . . . . . . . . . . . . . . . . . . . . . 73
E.10 Avvertenze di sicurezza per l’installazione (italiano) . . . . . . . . . . . . . . . . . . 76
E.11 Montaj Güvenlik Uyarıları(Türkçe) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

Mellanox Technologies 1
List of Figures
Figure 1: Long Haul TX6000/TX6100 Front Side View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
Figure 2: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet . . . . . . . . . . . .9
Figure 3: Air Flow Direction Marketing - Power Side Inlet to Connector Side Outlet . . . . . . . . . . .9
Figure 4: Rack Rail Kit Parts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
Figure 5: Screwing on the Rail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
Figure 6: Inserting the Caged Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Figure 7: Slide the Rail into the Rail Slide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
Figure 8: Installing the Slides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Figure 9: System Placement in the Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Figure 10: Installation Completed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Figure 11: Cable Orientation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17
Figure 12: Breakout or Fanout Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Figure 13: System Status LEDs 5 Minutes After Power On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Figure 14: Two Power Inlets - Electric Caution Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Figure 15: Power Supply Unit Extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 16: PS Unit Pulled Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
Figure 17: Fan Module Latches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Figure 18: System Status LEDs - Front and Rear sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Figure 19: Fan Status LED - Front and Rear sides . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Figure 20: Power Status LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 21: Rear Side Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Figure 22: Port LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Figure 23: Pull-out Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Figure 24: QSFP Connector Male and Female Views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45

Mellanox Technologies
1
List of Tables
Table 1: Revision History Table 2
Table 2: References 3
Table 3: Speed and Switching Capabilities 5
Table 4: Management Interfaces and FRUs 5
Table 5: Ordering Part Numbers (OPNs) 6
Table 6: Air Flow Label Legend 8
Table 7: Installation Kit Options 11
Table 8: Serial Terminal Program Configuration 20
Table 9: Configuration Wizard Session - DHCP 21
Table 10: Configuration Wizard Session - Static IP Configuration 22
Table 11: Status LEDs 30
Table 12: System Status LED Assignments 31
Table 13: Fan Status LED Assignments 32
Table 14: Power Supply Unit Status LED Assignments 33
Table 15: Bad Port LED Assignments 34
Table 16: Port LEDs in InfiniBand System Mode 34
Table 17: Troubleshooting 38
Table 18: TX6000 Specifications 40
Table 19: TX6100 Specifications 41
Table 20: OPNs for Replacement Parts 42
Table 21: RJ-45 CONSOLE Pinout 46
Table 22: RJ-45 I2C Pinout 46

Mellanox Technologies 2
Revision History
Table 1 - Revision History Table
Date Revision Description
September 2014 1.0 First release

Mellanox Technologies
3
About this Manual
This manual describes the installation and basic use of the Mellanox Long Haul systems.
Intended Audience
This manual is intended for IT managers and system administrators.
References
Conventions
The following icons are used throughout this document to indicate information that is important
to the user.
Table 2 - References
Document Description
InfiniBand Architecture Specifica-
tion, Volume 1, Release 1.2.1 and
1.3
The InfiniBand Architecture Specification that is provided by IBTA
SwitchX® Switch System
Hardware Release Notes
For possible hardware issues see the switch support product page. This docu-
ment can be found on the support web page for this product.
MLNX-OS® User Manual This document contains information regarding configuring and managing
MLNX-OS software- see http://www.mellanox.com/page/mlnx_os.
This icon makes recommendations to the user.
This icon indicates information that is helpful to the user.
This icon indicates a situation that can potentially cause damage to hardware or soft-
ware.
BEWARE! This icon indicates a situation that can potentially cause personal injury or
damage to hardware or software.

Mellanox Technologies 4
1 Introduction to Mellanox TX6000/TX6100 Long Haul
Systems
1.1 Overview
Mellanox MetroX series extends Mellanox’s RDMA solutions for high-performance technology
to local, campus and metro applications. It enables data sharing and support for disaster recovery,
40Gb/s RDMA execution over distant sites - up to 10km using Mellanox LR4 modules.
While InfiniBand products have been traditionally deployed for their high-performance intercon-
nect benefits within the data center, Mellanox MetroX systems, implementing long-haul Infini-
Band, enable connecting between data centers deployed across multiple geographically
distributed sites, extending the same world-leading interconnect benefits of InfiniBand beyond
local data centers and storage clusters.
Mellanox’s MetroX is the perfect cost-effective, low power, easily managed and scalable solu-
tion that enables today’s data centers and storage to run over local and distributed InfiniBand fab-
rics, managed as a single unified network infrastructure. The TX6000 and TX6100 systems,
which implement long-haul InfiniBand, can transfer data up to distances of 1km and 10km,
respectively. The systems enable aggregate data and storage networking over a single, consoli-
dated InfiniBand fabric. The long-haul InfiniBand technology guarantees high-performance,
high-volume data sharing between distant sites, enabling existing data centers’ expansion, disas-
ter recovery, data mirroring and campus connectivity.
MetroX enables a campus network to assemble large aggregate clusters, all connected and easily
managed by an InfiniBand Subnet Manager - an embedded manager, OpenSM, or using Mella-
nox’s Unified Fabric Manager (UFM®).
Figure 1: Long Haul TX6000/TX6100 Front Side View

Introduction to Mellanox TX6000/TX6100 Long Haul Systems
Mellanox Technologies
5
1.2 Speed and Switching
Table 3 describes maximum throughput and interface speed per system model.
*The switches can support 10Gb/s interfaces using QSFP to SFP adapters
1.3 Management Interfaces and FRUs
Table 4 lists the various management interfaces and available replacement parts per system
model.
1.4 Features
1.4.1 Network Management Features
1.4.2 InfiniBand Features
• Compliant with IBTA 1.2.1 and IBTA 1.3
Table 3 - Speed and Switching Capabilities
System Model 10GbE* SFP+
Interfaces 40/56GbE QSFP+ Interfaces Throughput
TX6000 N/A 16 FDR10 QSFP+ uplink
16 FDR QSFP+ downlink
640Gb/s
TX6100 N/A 6 FDR10 QSFP+ uplink
6 FDR QSFP+ downlink
240Gb/s
Table 4 - Management Interfaces and FRUs
System
Model USB MGT I2CConsole Replaceable PSU
Replaceable
Fan
TX6000 Front Front (x2) Rear Front 2 FRUs 1 FRU
TX6100 Front Front (x2) Rear Front 2 FRUs 1 FRU
• 100/1000 MbE Management port
• In-Band Management
• Serial Console Port
• RADIUS
•TACACS+
• LDAP
•SSHv2
• DHCP/Zeroconf
• Industry Standard CLI
• Management over IPv4/IPv6
•Telnet
• File download via SCP, FTP & TFTP client
•DualSWImage
• Network Time Protocol (NTP)
•Syslog
• Auto Temperature Control
• System alarms
• Port Counters
• Event notification
• SNMP v1,v2,v3
•E-Mail
•WebUI
• Predefined scheduled scripts
• System health monitoring

Mellanox Technologies 6
• Fabric Inspector
• Embedded Subnet Manager (SM)
1.4.3 Long Haul Features
1.4.3.1 TX6000
• 16 Long haul (40Gb/s) ports in a 1U system
• Up to 640Gb/s long-haul aggregate data
• 16 Downlink (56Gb/s) VPI ports
• Compliant with Mellanox LR4 and SR4E QSFP+ 40Gb/s transceivers
1.4.3.2 TX6100
• 6 Long haul (40Gb/s) ports in a 1U system
• Up to 240Gb/s long-haul aggregate data
• 6 Downlink (56Gb/s) VPI ports
• Compliant with Mellanox LR4 QSFP+ 40Gb/s transceivers
1.5 Certifications
The list of certifications (such as EMC, Safety and others) per system for different regions of the
world is located on the Mellanox website at:
http://www.mellanox.com/page/environmental_compliance
1.6 Ordering Information
the following table lists ordering information for the available systems. Please pay attention to
the airflow direction when ordering your system. For more details, see “Air Flow” on page 8._
Table 5 - Ordering Part Numbers (OPNs)
System
Model OPN Description
TX6000 MTX6000-2SFS MetroDX™ 1km long haul FDR10 InfiniBand switch, 16 long haul QSFP+ ports, 2
Power Supplies, Standard depth, Managed, PSU side to Connector side airflow, Rail
Kit and RoHS6
TX6100 MTX6100-2SFS MetroX™ 10km long haul FDR10 InfiniBand switch, 6 long haul QSFP+ ports, 2
Power Supplies, Standard depth, Managed, PSU side to Connector side airflow, Rail
Kit and RoHS6
MTX6100-2SRS MetroX™ 10km long haul FDR10 InfiniBand switch, 6 long haul QSFP+ ports, 2
Power Supplies, Standard depth, Managed, Connector side to PSU side airflow, Rail
Kit and RoHS6

Installation
Mellanox Technologies
7
2Installation
Installation and initialization of the system require attention to the normal mechanical, power,
and thermal precautions for rack-mounted equipment.
The installation procedure for the Metrox system involves the following phases:
1. Follow the safety warnings in Section 2.1.
2. Pay attention to the air flow consideration within the system and rack - refer to “Air Flow” on
page 8.
3. Make sure that none of the package contents is missing or damaged - see “Package Contents”
on page 10
4. Mount the system to the rack - see “Mounting Options” on page 11.
5. Ground the system, refer to “Grounding” on page 16.
6. Connect the WDFM
7. Power on the system - refer to “Initial Power On” on page 18
8. Perform system bring-up - see “System Bring-Up” on page 20
FRU replacements are described in Section 2.9 on page 24.
2.1 Safety Warnings
Prior to the installation, please review the safety warnings as follows:
For Safety Warnings in English see Section E.1, “Nordic Countries Notices,” on page 48.
For Safety Warnings in Chinese see Section E.3 on page 51.
For Safety Warnings in French see Section E.4, “Avertissements de sécurité pour l'installation
(French),” on page 56.
For Safety Warnings in German Section E.5, “Installation Sicherheitshinweise(German),” on
page 59.
For Safety Warnings in Spanish see Section E.6, “Advertencias de seguridad de instalación
(Spanish),” on page 62.
For Safety Warnings in Russian see Section E.7, “Предупреждения по технике безопасности
при установке (Russian),” on page 66.
For Safety Warnings in Romanian see Section E.8, “Avertismente privind siguranţa la instalare
(Romanian),” on page 69.
For Safety Warnings in Croatian see Section E.9, “Sigurnosna upozorenja za instaliranje (Croa-
tian),” on page 73.
For Safety Warnings in Italian see Section E.10, “Avvertenze di sicurezza per l’installazione
(italiano),” on page 76.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take
precautions to guarantee proper ventilation in order to maintain good airflow at ambi-
ent temperature.

Mellanox Technologies 8
For Safety Warnings in Turkish see Section E.11, “Montaj Güvenlik Uyarıları(Türkçe),” on
page 81.
2.2 Air Flow
Mellanox systems are offered with two air flow patterns:
• Connector (front) side inlet to power side outlet - marked with red labels on the power
supply side as shown in Figure 2.
• Power (rear) side inlet to connector side outlet - marked with blue labels on the power
supply side as shown in Figure 3.
Table 6 provides an air flow label color legend and respective OPN designations,
All servers and systems in the same rack should be planned with the same air-
flow direction.
All FRU components need to have the same air flow direction. A mismatch in
the air flow will affect the heat dissipation.
Table 6 - Air Flow Label Legend
Direction Label OPN
Designation Description
RConnector side inlet to
power side outlet. Red
labels are placed on the
power inlet side.

Installation
Mellanox Technologies
9
Figure 2: Air Flow Direction Marking - Connector Side Inlet to Power Side Outlet
Figure 3: Air Flow Direction Marketing - Power Side Inlet to Connector Side Outlet
FPower side inlet to connec-
tor side outlet. Blue labels
are placed on the power
inlet side.
Table 6 - Air Flow Label Legend
Direction Label OPN
Designation Description
OK
!
!
OK
OK
!
!
OK
I2C
OK
!
!
OK
OK
!
!
OK
I2C

Mellanox Technologies 10
2.3 Package Contents
Before installing your new system, unpack the system, and check, against the parts list below,
that all the parts have been sent. Check the parts for visible damage that may have occurred dur-
ing shipping.
The TX6000/TX6100 package content is as follows:
• 1 – System
• 1 – Rail kit
• 1 or 2 (according to order)– Power cables – Type C13 to C14, length 183cm
• 1 – Harness DB9 to RJ-45
• 1 – Quick Start Guide
If anything is damaged or missing, contact your sales representative at support@mella-
nox.com.

Installation
Mellanox Technologies
11
2.4 Mounting Options
2.4.1 19” Systems Mounting
There are two installation kit options: standard and short. Standard depth systems should be
mounted using the standard rail kit; short systems can be mounted using either of the rail kits.
The following parts are included in the rail kit rack (see Figure 4):
• Two rails
• Two rail slides
• Two system slides
• 16 recessed flat head screws (with extras)
• 10 caged nuts
• 10 pan head screws (M6)
•
Figure 4: Rack Rail Kit Parts
Table 7 - Installation Kit Options
Kit OPN Rack Size
MSX60-BKIT 40-60 cm deep (Short)
MSX60-SKIT 60-80 cm deep (Standard)
System slide x2
Rail x2
Rail slide x2
Nuts and bolts
Screws

Mellanox Technologies 12
Planning the system’s placement in the rack
Before mounting the system to the rack, select theway you wish to place the system. Pay atten-
tion to the airflow within the rack cooling, connector and cabling options.
While planning how to place the system, review the following points:
• Make sure the system air flow is compatible with your installation selection. It is impor-
tant to keep the airflow within the rack in the same direction.
• In case there are cables that cannot bend within the rack or in case more space is needed
for cable bending radius, it is possible to recess the connector side or the FRU side by
2” (5.08cm) by optional placement of the system’s rails.
• The FRU side is extractable. Mounting the sliding rail inverted to the system will allow
you to slide the FRU side of the system, in and out.
Mounting the slides to the system
Step 1. The recession feature is bi-directional, meaning that you can recess the system either backward
or forward.
Step 2. Screw the system slides onto the system. Use 5 flat head screws for a short system and 7 screws
for a standard depth system to connect each system slide.
Figure 5: Screwing on the Rail
Step 3. Clip the caged nuts into the holes in the rack on the side of the rack you will be sliding the sys-
tem into.
5 screws per side are needed for the short system.
7 screws per side are needed for the standard system.
If using a torque screwdriver to tighten the screws, set it to 0.85Nm.

Installation
Mellanox Technologies
13
Figure 6: Inserting the Caged Nuts
Step 4. Slide the rail into the rail slide.
Step 5. Using two of the bolts for each corner, install the rails and rail slides in the rack. Do not tighten
the bolts yet.
Figure 7: Slide the Rail into the Rail Slide
Side you will slide
the system into
Second side
This side of the rail kit goes on the side of the rack you will
slide the system into. This is the same side of the system that
will be next to the vertical support.

Mellanox Technologies 14
Figure 8: Installing the Slides
Step 6. Slide the system into the rails.
Step 7. Place the system and screw the bolts into the nuts. Tighten the bolts to 9.2 Nm or 81.5 pound
inches.

Installation
Mellanox Technologies
15
Figure 9: System Placement in the Rack
Figure 10: Installation Completed