Mellanox Technologies InfiniScale MTS3600Q-1BNC User manual

Mellanox Technologies
InfiniScale®IV 36-Port QSFP
InfiniBand Switch User Manual
P/N: MTS3600Q-1BNC, MTS3600Q-2BNC,
MTS3600Q-1UNC, MTS3600Q-2UNC, MTS3600R-1BNC,
MTS3600R-2BNC, MTS3600R-1UNC, MTS3600R-2UNC
Rev 2.0.0

Rev 2.0.0 MellanoxTechnologies
2
Copyright 2009. Mellanox Technologies.
All rights reserved. Preliminary information. Subject to change without notice.
Mellanox Technologies ConnectX, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and
InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Interconnect is a trade-
mark of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.
InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
Document Number: 2983
Mellanox Technologies, Inc.
350 Oakmead Parkway
Sunnyvale, CA 94085
U.S.A.
www.mellanox.com
Tel: [phone]
Fax: [phone]
Mellanox Technologies Ltd
PO Box 586 Hermon Building
Yokneam 20692
Israel
Tel: [phone]
Fax: [phone]
NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED
DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL
FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TEST-
ING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUS-
TOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY
MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM
USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE
OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY. ANY
EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WAR-
RANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONIN-
FRINGEMENT ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO
CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR
CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO, PAYMENT
FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROF-
ITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY,
WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTH-
ERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED DOCU-
MENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
3
Table of Contents
Table of Contents 3
Revision History 4
About this Manual 5
Intended Audience 5
Related Documentation 5
Conventions 5
Switch Products Covered in this User’s Manual 6
Mellanox Part Numbering Legend 6
Chapter 1 Overview 7
1.1 Serial Number and Product Version Information 7
Chapter 2 Installation and Basic Operation 8
2.1 Switch Platform Hardware Overview 8
2.1.1 Status LEDs 8
2.1.2 I2C Connector 10
2.1.3 Internal Management 10
2.1.4 Interfaces 11
2.2 Switch Platform Installation and Operation 11
2.2.1 Installation Safety Warnings 11
2.2.2 Mechanical Installation 13
2.2.3 Power Connections and Initial Power On 16
2.2.4 Extracting and Inserting the Power Supply Unit 17
2.2.5 InfiniBand Cable Installation 18
2.2.6 Extracting and Inserting the Fan Unit 19
2.2.7 Replacing the Battery in the Management Module 20
2.3 Disassembly of the Switch from the Rack 20
2.4 Disposal 21
Chapter 3 Management and Tools Overview 22
3.1 Network Management and Clustering Software 22
3.2 Internally Managed Switch System 22
3.2.1 Initializing the switch for the first time 23
3.2.2 Accessing the Switch Locally 23
3.2.3 Starting a Remote Connection to the Switch 23
3.2.4 Downloading Firmware 23
Chapter 4 Switch Management Tools 24
4.1 FabricIT 24
Chapter 5 Troubleshooting 25
Appendix A Specification 27
Appendix B SwitchHardwareComponents 31
Appendix C QSFP Interface 32
Appendix D Replacement Parts Ordering Numbers 33
Appendix E de sécurité d’installation (French) 34
Appendix F Installation - Sicherheitshinweise (German) 36
Appendix G Special Regulations Regarding Finland, Sweden, Denmark, and Norway 38

Rev 2.0.0 MellanoxTechnologies
4
Revision History
Table 1 - Revision History Table
Date Revision Description
June 2009 Rev 2.0 Added Management module label and RS232 DB9 to DB9 harness
Added part numbers for the two management modules.
June 2009 Rev 1.9 Made fixes to management section
added Disassembly instructions
June 2009 Rev 1.8 Added Fabric IT section
April 2009 Rev 1.7 inserted procedure to replace the battery.
April 2009 Rev 1.6 Changes to installation kit and procedure
January 2009 Rev 1.5 added installation instructions
added ECM
Removed Watermark
November 2008 Rev 1.4 fixed weight in specs
October 2008 Rev 1.3 Minor Formatting changes.
September 2008 Rev 1.2 Added Reprogramming the MT3600 Through The I2C Port section.
Added power cord OPNs to table 11 in Appendix D.
September 2008 Rev 1.1 Fixed link to Software package page.
September 2008 Rev 1.0 Initial release

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
5
About this Manual
This manual describes the installation and basic use of the Mellanox MTS3600 switch, which is based on
the InfiniScale IV InfiniBand switch device.
Intended Audience
This manual is intended for users and system administrators responsible for installing and setting up the
switch platforms listed above.
The manual assumes familiarity with the InfiniBand®Architecture Specification.
Related Documentation
Additional Documentation available from Mellanox:
Conventions
Throughout this manual, the name MTS3600 and the term switch are used to describe both the 36-port
40Gb/s InfiniBand Switch and the 36-port QSFP 20Gb/s InfiniBand Switch, unless explicitly indicated oth-
erwise.
Table 2 - Reference Documents
Switch Firmware and Firm-
ware Update Tools See
http://www.mellanox.com > Downloads > Firmware Tools.
Note that the Switch System described in this manual is based on Mellanox Technologies’ InfiniScale®
IV switch device.
Mellanox OFED Stack for
Linux User’s Manual See
http://www.mellanox.com > Downloads > InfiniBand SW/Drivers,
Click “Mellanox OpenFabrics Enterprise Distribution for Linux (MLNX_OFED)”
Select the Linux User’s Manual
The embedded OS and tools on the CPU in the management module is a subset of the Mellanox OFED
stack.
FabricIT Enterprise Fabric
Management Software CLI
User’s Manual
Talk to your Mellanox representative for information regarding licensing and implementation of the
FabricIT Enterprise Fabric Management Software System.
Mellanox Firmware Tools
(MFT)
User’s Manual
Document # 2329
The MFT (Mellanox Firmware Tools) package is a set of firmware tools. The manual supplied with this
package provides an overview of the firmware its installation and replacement. The MFT can be down-
loaded with its documentation at:
http://www.mellanox.com > Downloads > Firmware Tools.

Rev 2.0.0 MellanoxTechnologies
6
Switch Products Covered in this User’s Manual
Mellanox Part Numbering Legend
Table 3 - Switch Products Covered by this User Manual
Product Number Description
MTS3600Q-1BNC 36-port Managed QSFP 40Gb/s InfiniBand switch with one power supply
MTS3600R-1BNC 36-port Managed QSFP 20Gb/s InfiniBand switch with one power supply
MTS3600Q-1UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with one power supply
MTS3600Q-2UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with two power supplies
MTS3600R-1UNC 36-port Unmanaged QSFP 20Gb/s InfiniBand switch with one power supply
MTS3600R-2UNC 36-port Unmanaged QSFP 20Gb/s InfiniBand switch with two power supplies
Table 4 - Part Numbering Legend
Place Field Decoder
MT Mellanox Technologies
SSystem Type S = Switch
MM Model 36 = InfiniScale IV
FF Form factor 00 = Rack mounted switch, 10 = Chassis
CInfiniBand Port Config. G = CX4 DDR, J = CX4 QDR, Q = QSFP QDR, R = QSFP DDR,
-Separator
P# Power Supplies 0 = 0, 1 = 1, 2 = 2
MManagement U = Unmanaged, A = Managed (Celeron), B = Managed (Freescale)
YModule Config. N = IB modules
RRoHS C = RoHS w/ Exemption, R = RoHS Lead-Free

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
7
1 Overview
Mellanox MTS3600 switch systems provide the highest performing fabric solution by delivering high band-
width and low latency to Enterprise Data Centers, High-Performance Computing and Embedded environ-
ments. Networks built with MTS3600 systems can carry converged traffic with the combination of assured
bandwidth and granular quality of service. Built with Mellanox’s 4th generation InfiniScale® IV InfiniBand
switch device, MTS3600 systems provide up to 40Gb/s full bidirectional bandwidth per port. With 36 ports,
these systems are among the densest switching systems available. These stand-alone switches are an ideal
choice for top of-rack leaf connectivity or for building small to medium size clusters.
The switch comes pre-installed with all necessary firmware and is configured for standard operation within
an InfiniBand fabric. This switch requires an InfiniBand compliant Subnet Manager running from one of the
hosts. All that is required for normal operation is to follow the usual precautions for installation and to con-
nect the switch to the HCAs. Once connected, the Subnet Management software automatically configures
and begins utilizing the switch.
It is recommended that Mellanox OpenFabrics software package be installed on all nodes connected to the
MTS3600. The software package provides a subnet manager and network management tools as well as con-
nectivity software for servers and storage, and is available on the Mellanox web site. See Chapter 3 for more
information.
Basic installation, hot-swapping components and hardware maintenance is covered in “Installation and
Basic Operation” on page 8.
1.1 Serial Number and Product Version Information
The serial number and product version information are found on the label seen in the figure below.
Figure 1: Generic Product label
Also on this label is the GUID identifier for the switch. There is also a label with the MAC for the manage-
ment module?
Figure 2: Management Module Label

Rev 2.0.0 MellanoxTechnologies
8
2 Installation and Basic Operation
2.1 Switch Platform Hardware Overview
Figure 3 shows the power side panel and connector side panel views of the QSFP switch. The figure shows
port configurations for the switch systems, including the dual hot-swap power supplies, and hot-swap fan
module, I2C connector, RJ45 connector, USB connectors, VGA port connector, and various status LEDs.
Figure 3: QSFP Switch System Front and Back Panels
All InfiniBand connectivity is via the connector side panel. All connectors can support active cables.
2.1.1 Status LEDs
2.1.1.1 System Status Indicators
The System Status Indicators are located just to the left of the primary power supply unit, and labeled “Sys.”.
The system status indicators should be as follows:
When the switch is plugged in, within a few seconds the STATUS LED should light up green.
The PSU 1 LED should light up green.
The PSU 2 LED should light up green only if a second PSU is installed in the switch for redundancy
and Hot-Swap ability. If only one PSU is installed in the switch, the PSU 2 LED will be off.
The FAN LED should light up green.
If the STATUS LED shows red unplug the switch and call your Mellanox representative for assistance.
If the FAN LED shows yellow, trouble shoot the fan module.
Note: Do not run the switch for more than 2 minutes should the FAN LED show yellow.
If the PSU LEDs are not green, this indicates a problem with the power supplies. Do not run the switch if the
PSU LEDs are not green.
Front panel
Rear panel

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
9
Figure 4: Power and System LEDs
Table 5 - System Status LED/ Configurations
2.1.1.2 Power Supply Status Indicators
The MTS3600 36 Port Switch is available with one or two factory installed Power Supply Units. For
switches with only one unit installed, a second Power Supply Unit can be added to increase security, hot-
swap ability and to add redundancy.
Figure 5: MTS3600 QSFP Front Panel
LED Configuration Status
OK – The system is up and running.
Error –A fault in the system.
Off – The system has no power.
DC output from
the PSU is OK
Latch release mechanism Handle
There is a fault
in the PSU
Input AC voltage
is good
PSU Status
Indicators
Switch Fan
Status
Indicators
System
Status
Indicators
Primary Power
Supply Unit
Place for secondary
Power Supply Unit Fan Unit

Rev 2.0.0 MellanoxTechnologies
10
The primary power supply unit (PSU1) is located on the right side of the front panel, with PSU2 on the left
side. Status indicators are located just to the left of where the primary power supply unit is located. Each
PSU also has three status LEDs on the right side of the PSU, that indicate the internal status of the unit.
~AC– This LED when lit indicates input voltage between 90 and 264 Volts.
–This LED when lit indicates a fault in the power supply.
OK – This LED when lit indicates that the output from the power supply is +12VDC.
The PSU status indicators are located just to the left of the primary power supply unit, and labeled “PSU1”
and “PSU2”. The following status conditions are possible:
2.1.1.3 Fan Status Indicators
The indicator labeled “Fans” is located just to the left of the primary power supply unit, next to PSU 1. The
following fan status conditions are possible:
Table 6 - Fan Status LED Configurations
2.1.2 I2C Connector
The MTS3600 supports an I2C compatible interface on the front panel.This interface is used to program
firmware into the Flash Memory. Firmware can also be programmed in-band over the InfiniBand network.
See Section 3 for more details.
2.1.3 Internal Management
Internal management refers to a switch that has an internal PPC management board. Switches without this
management board can be managed using an external management system. The following interfaces allow
access to the internal management module. These interfaces have no function in externally managed sys-
tems.
LED Configuration Status
OK – All fans are operating.
Error – One or more fans is not operating. Repair
or replace the fan unit.
Off – The fan unit is not receiving any power.
Check that the fan unit is properly and com-
pletely inserted.
All fans must be operating while the power supply is plugged in. Power must be
removed within one minute of the fans failing, to prevent damage to the switch.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
11
2.1.4 Interfaces
There are five interfaces to connect to the MTS3600. They are:
1 I2C DB9 interface is labelled “I2C”. This interface can be used to access and modify the Flash and
EEPROM.
1 RS232 connector is labelled . Use this connector to connect to the host PC.
2 USB ports is labelled . Use these to connect to a local keyboard and mouse.
1 video connector is labelled . Use this to connect to a local video monitor.
Figure 6: Management Interfaces
2.1.4.1 VGA Interface
The VGA port is for video output from the management module.
2.1.4.2 RS232 Interface
The RS232 connector interface is to be used to connect through the Ethernet to a remote host PC.
2.1.4.3 USB interface
There are two USB ports for connecting a keyboard and mouse for local management operation.
2.2 Switch Platform Installation and Operation
Installation and initialization of the switch platform are straightforward processes, requiring attention to the
normal mechanical, power, and thermal precautions for rack-mounted equipment.
The switch platform does not require any programming or configuration to operate as a basic InfiniBand
switch and includes all of the necessary functionality to operate with external standard InfiniBand Subnet
Management software.
An Internal Management option is available for the switch platform which includes InfiniBand Subnet Man-
agement software embedded internally in the switch. This section describes the installation process and
basic operation of the switch platform. Please first read the warnings sub-section carefully before carrying
on with installation procedures.
2.2.1 Installation Safety Warnings
For Safety Warnings in French see Section E,“de sécurité d’installation (French),” on page 34, and for Ger-
man see Section F,“Installation - Sicherheitshinweise (German),” on page 36.

Rev 2.0.0 MellanoxTechnologies
12
For Special Regulations Regarding Finland, Sweden, Denmark, and Norway see Section G,“Special Regula-
tions Regarding Finland, Sweden, Denmark, and Norway,” on page 38.
1. Installation Instructions
2. Over-temperature
3. Stacking the Chassis
4. Redundant Power Supply Connection - Electrical Hazard
5. During Lightning - Electrical Hazard
6. Copper InfiniBand Cable Connecting/Disconnecting
7. Rack Mounting and Servicing
8. Equipment Installation
Read all installation instructions before connecting the equipment to the power
source.
This equipment should not be operated in an area with an ambient temperature
exceeding the maximum recommended: 45°C (113°F). Moreover, to guarantee
proper air flow, allow at least 8cm (3 inches) of clearance around the ventilation
openings.
The chassis should not be stacked on any other equipment. If the chassis falls, it
can cause bodily injury and equipment damage.
This product includes a blank cover over the space for the redundant power sup-
ply. Do not operate the product if the blank cover is not securely fastened or if it
is removed.
During periods of lightning activity, do not work on the equipment or connect or
disconnect cables.
Copper InfiniBand cables are heavy and not flexible, as such they should be
carefully attached to or detached from the connectors. Refer to the cable manu-
facturer for special warnings and instructions.
When this product is mounted or serviced in a rack, special precautions must be
taken to ensure that the system remains stable. In general you should fill the
rack with equipment starting from the bottom to the top.
This equipment should be installed, replaced, or serviced only by trained and
qualified personnel.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
13
9. Equipment Disposal
10. Local and National Electrical Codes
11. Battery Replacement
2.2.2 Mechanical Installation
The switch platform can be rack mounted and is designed for installation in a standard 19” rack. The power
side of the switch includes a hot-swap power supply module, a blank cover for an optional second PSU for
redundancy, a hot-swap fan tray, system LEDs, and management connection ports. The hot-swap fan module
provides front to back air flow. The rear of the switch has the QSFP ports.
The switch platform contains auto-sensing 90 - 264 VAC connections for all possible PSUs.
The installer should use a rack capable of supporting the mechanical and environmental characteristics of a
fully populated platform.
2.2.2.1 Installing the Switch in the Rack
Tools needed:
Phillips Screwdriver
ESD Strap
ESD mat
Disposal of this equipment should be in accordance to all national laws and reg-
ulations.
This equipment should be installed in compliance with local and national elec-
trical codes.
There is a risk of explosion should the battery be replaced with a battery of an incorrect
type.
Dispose of used batteries according to the instructions.
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take pre-
cautions to guarantee proper ventilation for air intake at the power side of the chassis
and exhaust at the connector side in order to maintain good airflow at ambient temper-
ature. Cable routing in particular should not impede the air exhaust from the chassis.

Rev 2.0.0 MellanoxTechnologies
14
Parts included in the installation kit:
Figure 7: Rack Installation Kit Parts
Before you install your new MTS3600 switch, unpack the system and check to make sure that all the parts
have been sent, check this against the parts list. Check the parts for visible damages that may have occurred
during shipping.
Note: If anything is damaged or missing, contact your customer representative immediately.
Procedure
1. Place the ESD mat on the floor where you will be working and put on the ESD strap. Make sure the
ESD strap is touching your skin and that the other end is connected to a verified ground.
2. Choose which side of the switch you want even with the vertical rack support. Either the side
with the power supply units or the side with the IB connectors can be even with the vertical
rack support. The other side of the switch will be further inside of the rack.
Things to consider before choosing where to mount the rails and rail slides.
• 2 rails • 8 recessed flat head screws
• 2 rail slides • 4 caged nuts
• 8 pan head screws M6 • 2 metal washers
rail
rail slide

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
15
Figure 8: Which Side of the Rack Do You Want the Connectors?
Do you want the connector side recessed in the rack to allow for larger cable bending radius?
Will the connector side be recessed past other equipment in the rack and will this be problematic?
3. Install the rail slides onto the switch. Place the end of the rail slide with the 90oangle on the
side of the switch that you want to be even with the vertical support of the 19” rack. Use four
of the flat head screws for each rail slide. There are two sets of holes in the rail slide. Select the
set of holes to either mount the switch closer or farther away from the rack vertical support.
Tighten the screws to 3Nm or 26.5 pound inches.
Figure 9: Screwing the Rail Slide onto the switch
The distance between the rack and the door can be as little as 4 cm on one side of the
rack and as much as 18 cm on the other side of the rack. Keep in mind that there can be
as many as 36 cables connected to the switch.
This side of the
switch will be
next to the verti-
cal rack support.

Rev 2.0.0 MellanoxTechnologies
16
4. Clip the nuts into the holes in the rack you will be using to connect the rail slides. Check that
both sides of the switch are in the same position number on the rack.
5. Using two of the pan head screws and one washer, for each rail, install the rails to the other end
of the rack. Place the rail behind the holes in the rack and screw the screws through the holes in
the washer then through the rails. Tighten the pan head screws that hold the rails to 9.2 Nm or
81.5 pound inches.
Figure 10: Screwing in the Rails
6. Place the four bolts for the caged nuts within reach.
7. Slide the switch into the rails.
8. Put the switch into place and screw the bolts into the nuts from step 4. Tighten the bolts to 9.2
Nm or 81.5 pound inches.
9. Tighten all of the screws.
10. Plug in the power cables.
11. Check the Status LEDs and confirm that all of the LEDs show status lights consistent with nor-
mal operation.
12. You can start connecting all of the cables to the switch.
2.2.3 Power Connections and Initial Power On
The switch platform ships with one or two Power Supply Units. For switches with only one unit installed, a
second PSU may be installed at a later time. Each supply has a separate AC receptacle. The input voltage is
Warning: Any yellow status LEDs is cause for concern and must be dealt with
immediately.
The caged nuts
are separated by a
single space

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
17
auto-adjusting for 90-264 VAC, 47-63Hz power connections. The power cords should be standard 3-wire
AC power cords including a safety ground and rated for 15A or higher.
Note: Do not hot swap the power supply if your switch has only one power supply. You must power
down the system to replace the power supply unit when there is only one PSU in the switch.
Figure 11: Two Power Inlets - Electric Caution Notifications
2.2.4 Extracting and Inserting the Power Supply Unit
With both power supplies installed in the redundant configuration, either PSU may be extracted without
bringing down the system.
Note: Make sure that the PSU that you are NOT replacing is showing all green, for both the PSU and
status indicators.
Caution: The switch platform will automatically power on when AC power is applied.
There is no power switch. Check all boards, power supplies, and fan tray modules for
proper insertion before plugging in a power cable.
Caution: After inserting a power cable and confirming the green system status LED
light is on; make sure that the Fan Status indicator shows green.
If the fan status indicator is not green then unplug the power connection and check that
the fan module is inserted properly and that the mating connector of the fan unit is free
of any dirt and/or obstacles.
Caution: When turning off the switch, make sure ALL LEDS are off to ensure a pow-
ered down status.
CAUTION
Risk of electric shock and energy
hazard. The two PSUs are inde-
pendent.
Disconnect all power supplies to
ensure a powered down state
inside of the switch platform.
ACHTUNG
Gafahr des elektrischen
Schocks. Entferrnen des
Netzsteckers elnes Netz-
teils spannungsfrei. Um
alle Einhieten spannungs-
frei zu machen sind die
Netzstecker aller Netzteile
zu entfernen
ATTENTION
Risque de choc et de danger
e’lectriques. Le de’branch-
ment d’une seule alimentation
stabilise’e ne de’branch
uniquement qu’un module
“Alimentation Stabilise’e”.
Pour isoler completement le
module en cause, Il faut
de’brancher toutes les ali-
mentations stabilise’es.

Rev 2.0.0 MellanoxTechnologies
18
Figure 12: Power Supply Unit Extraction
To extract a PSU:
1. Remove the power cord from the power supply unit.
2. Grasping the handle with your right hand, push the latch release with your thumb while pulling
the handle outward. As the PSU unseats, the PSU status indicators will turn off.
3. Remove the PSU.
To insert a PSU:
1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles.
2. Insert the PSU by sliding it into the opening until a slight resistance is felt.
3. Continue pressing the PSU until it seats completely. The latch will snap into place confirming
the proper installation.
4. Insert the power cord into the supply connector.
Note: The green PSU indicator should light and the yellow indicator should remain off. If not, extract
the PSU and re-insert it.
2.2.5 InfiniBand Cable Installation
All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into
the port receptacle until the connector is firmly seated. The GREEN LED indicator, corresponding to each
QSFP port, will light when the physical connection is established (that is, when the unit is powered on and a
cable is plugged into the port with the other end of the connector plugged into a functioning port). After
plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When a
logical connection is made the yellow light will come on. When data is being transferred the yellow light
will blink.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual
MellanoxTechnologies Rev 2.0.0
19
Note: Cables in the bottom row should be inserted up side down in relation to the how the cables are
inserted in the top row.
To remove, disengage the locks and slowly pull the connector away from the port receptacle. Both LED
indicators will turn off when the cable is unseated.
Care should be taken not to impede the air exhaust flow through the ventilation holes next to the InfiniBand
ports. Cable lengths should be used which allow for routing horizontally around to the side of the chassis
before bending upward or downward in the rack.
Figure 13: Cable connections to the Switch
2.2.6 Extracting and Inserting the Fan Unit
This switch can operate indefinitely with one of the three fans in the fan module inoperable so long as the
ambient temperature is below 45° Celsius.
To extract a Fan Unit:
1. Loosen the two thumb screws locking the fan tray in place.
One of the fan status indicators (either green or yellow) will remain on.
2. Pull the fan unit out by pulling on the thumbscrews. As the fan unseats, the fan status indicator
will turn off.
To insert a FAN Unit:
1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles.
Operation without a fan unit should not exceed one minute.
During fan hot-swap, if both indicators are OFF then the fan unit is disconnected.

Rev 2.0.0 MellanoxTechnologies
20
2. Insert the fan unit by sliding it into the opening until slight resistance is felt. Continue pressing
the fan unit until it seats completely.
3. Turn the two thumb screws to lock the fan unit in place.
Note: The green fan status indicator should light and the yellow fan status should remain off. If not,
extract the fan unit and reinsert it. After two unsuccessful attempts to install the fan unit, power off the
switch before attempting any system debug.
2.2.7 Replacing the Battery in the Management Module
The battery is only used for the clock within the management module. If the Battery is dead the time on the
management module will not be updated. The battery is a lithium 3V CR2032.
To replace the battery by:
1. Unplug all of the power chords and connectors from the switch.
2. Remove the switch from the rack.
3. Put on an ESD strap and ground the strap to a valid ground.
4. Remove the rail slides from the switch. Put aside the rail slides and screws for later use.
5. Remove the cover from the switch and put the cover and screws aside for later use.
6. Remove the battery from the holder. It is found near the front of the switch next to PSU1.
7. Insert the new battery + side up.
8. Replace the top cover using the screws set aside in step 5.
9. Reinstall the rail slides using the screws set aside in step 4.
10. Reinstall the switch in the rack.
11. Plug in the power cords and connectors.
2.3 Disassembly of the Switch from the Rack
To disassemble the switch from the rack:
1. Unplug and remove all connectors.
2. Unplug all power cords.
3. Unscrew the 4 bolts from the side of the switch with the rail slides. See Figure 7,“Rack Instal-
lation Kit Parts” for a picture of the rail slides.
Note: Support the weight of the switch when you remove the screws so that the switch does not fall.
4. Slide the switch from the rack.
5. Remove the rails from the rack.