Cisco Nexus 9408 Manual

Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
First Published: 2022-09-15
Last Modified: 2023-03-02
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: [phone]
800 553-NETS (6387)
Fax: [phone]

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS REFERENCED IN THIS DOCUMENTATION ARE SUBJECT TO CHANGE WITHOUT NOTICE.
EXCEPT AS MAY OTHERWISE BE AGREED BY CISCO IN WRITING, ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS DOCUMENTATION ARE
PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED.
The Cisco End User License Agreement and any supplemental license terms govern your use of any Cisco software, including this product documentation, and are located at:
http://www.cisco.com/go/softwareterms.Cisco product warranty information is available at http://www.cisco.com/go/warranty. US Federal Communications Commission Notices are found
here http://www.cisco.com/c/en/us/products/us-fcc-notice.html.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT
LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS
HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any products and features described herein as in development or available at a future date remain in varying stages of development and will be offered on a when-and if-available basis. Any
such product or feature roadmaps are subject to change at the sole discretion of Cisco and Cisco will have no liability for delay in the delivery or failure to deliver any products or feature
roadmap items that may be set forth in this document.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network
topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional
and coincidental.
The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based
on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language
that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com
go trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any
other company. (1721R)
©2022 Cisco Systems, Inc. All rights reserved.

CONTENTS
Overview 1
CHAPTER 1
Overview of the Cisco Nexus 9408 Switch 1
Preparing the Site 5
CHAPTER 2
Temperature Requirement 5
Humidity Requirement 5
Altitude Requirements 5
Dust and Contaminants 5
Installing the Chassis 7
CHAPTER 3
Safety 7
Preparing to Install the Chassis 11
Unpacking and Inspecting the Chassis 13
Installing the Chassis in a Four-Post Rack 13
Grounding the Chassis 18
Starting the Switch 20
Connecting the Switch to the Network 23
CHAPTER 4
Preparing for Network Connections 23
Connecting to a Console 23
Connecting the Management Interface 24
Connecting Interface Ports to Other Devices 24
Installing SFP+ and SFP Transceivers 25
Installing QSFP+ Transceivers 26
Installing SFP+ and SFP Optical Cables 27
Maintaining Transceivers and Optical Cables 27
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
iii

Replacing Modules 29
CHAPTER 5
Replacing a 4 (RU) Fan Module 29
Replacing an AC Power Supply 30
Replacing a Supervisor Module 31
Installing or Replacing a Line-Card Expansion Module (LEM) 34
Replacing a Switch Card 36
Managing the Switch 41
CHAPTER 6
Displaying Information About the Installed Hardware Modules 41
Displaying the Hardware Inventory for the Switch 44
Displaying the Modules for the Switch 45
Displaying the Serial PROM (SPROM) for the Switch 46
Displaying Environmental Information for the Switch 47
Displaying Environment Temperature for the Switch 48
Rack Specifications 51
APPENDIX A
General Requirements and Guidelines for Cabinets and Racks 51
About Requirements for Perforated Cabinets 52
About Requirements for Open Racks 52
System Specifications 53
APPENDIX B
Environmental Specifications 53
Switch Dimensions 53
Switch and Module Weights 54
2000-W AC Power Supply Specifications 54
AC Power Cable Specifications 54
LEDs 57
APPENDIX C
CPU Card LEDs 57
LEM LEDs 58
Fan LEDs 59
Power Supply LEDs 60
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
iv
Contents

Spare Parts Table 61
APPENDIX D
Spares Support Table 61
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
v
Contents

Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
vi
Contents

CHAPTER 1
Overview
•Overview of the Cisco Nexus 9408 Switch, on page 1
Overview of the Cisco Nexus 9408 Switch
The Cisco Nexus 9408 (N9K-C9408) is a 4 rack unit (RU) 8-slot modular chassis switch, which is configurable
with up to 128 200-Gigabit QSFP56 (256 100-Gigabit by breakout) ports or 64 400-Gigabit ports. This switch
supports port-side intake airflow. The switch requires four AC power supplies for operation, and offers 2+2
power grid redundancy.
This switch includes the following high power optics and MACsec:
• The N9K-X9400-16W LEM offers full MACsec (128 ports) for a full load chassis with no limitation for
200G optics.
• The N9K-X9400-8D LEM offers full MACsec (64 ports) for a full load chassis but with a limit of 400G
high power optics within 32pcs among 8 slots (maximum of 32 ports of 20-W optics irrespective of
MACsec), and the high power optics can go in any of the 400G ports.
The following figure shows the fan-side chassis features that you use when installing the chassis or replacing
its modules.
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
1

Switch card2Power supply modules (4)1
Fan modules (5)3
The following figure shows the port-side chassis features that you use when installing the chassis or replacing
its modules.
GPS 10 MHz2Management port (RJ45)1
GPS 1PPS4Supervisor module (N9K-C9408-SUP-A)3
SYNC, TIMING, GPS, BCN, STS, and ENV, LEDs6ToD (RF-45)5
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
2
Overview
Overview of the Cisco Nexus 9408 Switch

Management port (SFP)8Cisco Nexus line-card expansion module (LEM) (up
to 8)
N9K-X9400-8D shown, N9K-X9400-16W also
available.
7
USB 3.0 port (1)1 1010-Gigabit SFP+ ports9
Console port (RS-232)11
1Careful when using the USB port. This component is sensitive to movement and if bumped, may cause
file corruption.
The following figure shows the side chassis features that you use when installing the chassis.
Grounding pad1
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
3
Overview
Overview of the Cisco Nexus 9408 Switch

Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
4
Overview
Overview of the Cisco Nexus 9408 Switch

CHAPTER 2
Preparing the Site
•Temperature Requirement, on page 5
•Humidity Requirement, on page 5
•Altitude Requirements, on page 5
•Dust and Contaminants, on page 5
Temperature Requirement
This switch is rated to operate at 32 to 104°F (0 to 40°C). It can be stored at -40 to 158°F (-40 to 70°C).
Humidity Requirement
High humidity can cause moisture to enter the switch. Moisture can cause corrosion of internal components
and degradation of properties such as electrical resistance, thermal conductivity, physical strength, and size.
The switch is rated to withstand from 5- to 95-percent (nonoperating) and 5- to 90-percent (operating) relative
humidity.
Buildings cooled with air conditioning during warm months and warmed during cold months usually maintain
an acceptable level of humidity. However, if the site is unusually humid, use a dehumidifier to maintain the
required humidity level.
Altitude Requirements
High-altitude (low-pressure) conditions outside of 0 to 5,000 feet (0 to 1524 m) can reduce the cooling
efficiency and cause electrical problems.
Dust and Contaminants
To prevent contaminant buildup and increased internal chassis temperatures, make sure that the operating
environment is as clean as possible and free of dust and other contaminants. Do not permit smoking, food, or
drinks near the switch.
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
5

Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
6
Preparing the Site
Dust and Contaminants

CHAPTER 3
Installing the Chassis
•Safety, on page 7
•Preparing to Install the Chassis, on page 11
•Unpacking and Inspecting the Chassis, on page 13
•Installing the Chassis in a Four-Post Rack, on page 13
•Grounding the Chassis, on page 18
•Starting the Switch, on page 20
Safety
Before you install, operate, or service the switch, see the Regulatory, Compliance, and Safety Information for
the Cisco Nexus 3000 and 9000 Series for important Safety Information.
Statement 1071—Warning Definition
IMPORTANT SAFETY INSTRUCTIONS
Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar
with standard practices for preventing accidents. Read the installation instructions before using, installing, or
connecting the system to the power source. Use the statement number provided at the end of each warning
statement to locate its translation in the translated safety warnings for this device.
SAVE THESE INSTRUCTIONS
Warning
Statement 1089—Instructed and Skilled Person Definitions
An instructed person is someone who has been instructed and trained by a skilled person and takes the necessary
precautions when working with equipment.
A skilled person or qualified personnel is someone who has training or experience in the equipment technology
and understands potential hazards when working with equipment.
Warning
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
7

Statement 1004—Installation Instructions
Read the installation instructions before using, installing, or connecting the system to the power source.
Warning
Statement 1040—Product Disposal
Ultimate disposal of this product should be handled according to all national laws and regulations.
Warning
Statement 1074—Comply with Local and National Electrical Codes
To reduce risk of electric shock or fire, installation of the equipment must comply with local and national
electrical codes.
Warning
Statement 371—Power Cable and AC Adapter
When installing the product, use the provided or designated connection cables, power cables, AC adapters,
and batteries. Using any other cables or adapters could cause a malfunction or a fire. Electrical Appliance and
Material Safety Law prohibits the use of UL-certified cables (that have the "UL" or "CSA" shown on the
cord), not regulated with the subject law by showing "PSE" on the cord, for any other electrical devices than
products designated by Cisco.
Warning
Statement 407—Japanese Safety Instruction
You are strongly advised to read the safety instruction before using the product.
https://www.cisco.com/web/JP/techdoc/pldoc/pldoc.html
When installing the product, use the provided or designated connection cables/power cables/AC adapters.
Note
Statement 1017—Restricted Area
This unit is intended for installation in restricted access areas. Only skilled, instructed, or qualified personnel
can access a restricted access area.
Warning
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
8
Installing the Chassis
Safety

Statement 1030—Equipment Installation
Only trained and qualified personnel should be allowed to install, replace, or service this equipment.
Warning
Statement 1091—Installation by an Instructed Person
Only an instructed person or skilled person should be allowed to install, replace, or service this equipment.
See statement 1089 for the definition of an instructed or skilled person.
Warning
Statement 1005—Circuit Breaker
This product relies on the building’s installation for short-circuit (overcurrent) protection. To reduce risk of
electric shock or fire, ensure that the protective device is rated not greater than: 20A for AC, 60A for DC
Warning
Statement 1028—More Than One Power Supply
This unit might have more than one power supply connection. To reduce risk of electric shock, remove all
connections to de-energize the unit.
Warning
Statement 1003—DC Power Disconnection
Before performing any of the following procedures, ensure that power is removed from the DC circuit.
Warning
Statement 1046—Installing or Replacing the Unit
To reduce risk of electric shock, when installing or replacing the unit, the ground connection must always be
made first and disconnected last.
Warning
Statement 1022—Disconnect Device
To reduce risk of electric shock and fire, a readily accessible two-poled disconnect device must be incorporated
in the fixed wiring.
Warning
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
9
Installing the Chassis
Safety

Statement 1033—Safety Extra-Low Voltage (SELV)—IEC 60950/ES1–IEC 62368 DC Power Supply
To reduce risk of electric shock, connect the unit only to a DC power source that complies with the SELV
requirements in IEC 60950-based safety standards or ES1 requirements in IEC 62368-based safety standards.
Warning
Statement 1024—Ground Conductor
This equipment must be grounded. To reduce the risk of electric shock, never defeat the ground conductor or
operate the equipment in the absence of a suitably installed ground conductor. Contact the appropriate electrical
inspection authority or an electrician if you are uncertain that suitable grounding is available.
Warning
Statement 1252—Equipment Grounding
This equipment must be grounded. To reduce the risk of electric shock, the power cord, plug, or combination
must be connected to a properly grounded electrode, outlet, or terminal.
Warning
Statement 1076—Clearance Around the Ventilation Openings
To prevent airflow restriction, allow clearance around the ventilation openings to be at least 30cm.
Warning
Statement 1032—Lifting the Chassis
To prevent personal injury or damage to the chassis, never attempt to lift or tilt the chassis using the handles
on modules, such as power supplies, fans, or cards. These types of handles are not designed to support the
weight of the unit.
Warning
Statement 164—Lifting Requirement
2 people are required to lift the heavy parts of the product. To prevent injury, keep your back straight and lift
with your legs, not your back.
Warning
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
10
Installing the Chassis
Safety

Statement 1006—Chassis Warning for Rack-Mounting and Servicing
To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to
ensure that the system remains stable. The following guidelines are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the
heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the
unit in the rack.
Warning
Statement 1047—Overheating Prevention
To reduce the risk of fire or bodily injury, do not operate the unit in an area that exceeds the maximum
recommended ambient temperature of: 40°C
Warning
Preparing to Install the Chassis
Before you can install the switch, you must verify the following:
• The installation site meets the following requirements as stated in Chapter 2:
• Environmental requirements for temperature, humidity, altitude, and air particulates.
• Cabinet or rack is installed and meets the requirements for the switch.
Jumper power cords are available for use in a cabinet.
Note
• The rack is positioned so that you can install the switch with its cold air intakes positioned in a cold
aisle.
If the fan and power supply modules are burgundy or red colored, you must install the chassis with
its port side in a cold aisle. If the modules are blue colored, you must be able install the chassis with
the fan modules in a cold aisle.
•Earth ground connection is close to the switch. You must be able to easily connect the switch directly
to an earth ground or indirectly through a grounded rack.
High leakage current. Earth connection essential before connecting to power
supply.
Caution
• Site power meets the switch requirements. If you are using n+n redundancy, you must have two
power sources within reach of the switch when it is installed in the cabinet or rack.
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
11
Installing the Chassis
Preparing to Install the Chassis

If available, you can use an uninterruptible power supply (UPS) to protect against power failures.
Avoid UPS types that use ferroresonant technology. These UPS types can become
unstable with systems such as the Cisco Nexus switches. These switches can have
substantial current draw fluctuations because of fluctuating data traffic patterns.
Caution
Ensure that circuits are sized according to local and national codes. For North America, the power
supply requires a 15-A or 20-A circuit.
To prevent loss of input power, ensure the total maximum loads on the circuits
supplying power to the switch are within the current ratings for the wiring and
breakers.
Caution
Statement 1076—Clearance Around the Ventilation Openings
To prevent airflow restriction, allow clearance around the ventilation openings
to be at least
Warning
• There is adequate clearance around the rack to install the switch and to allow for unimpeded airflow.
• You have the following equipment in addition to the switch and the kits shipped with the switch:
• Eight customer-supplied 12-24 or 10-32 screws (required for attaching slider rails and mounting
bracket to the mounting rails)
• Number 1 and number 2 Phillips screwdrivers with torque capability
• 3/16-inch flat-blade screwdriver
• Tape measure and level
• ESD wrist strap or other grounding device (wrist strap can be found in the accessory kit)
• Antistatic surface large enough to place the switch
• Grounding cable (6 AWG recommended), sized according to local and national installation
requirements; the required length depends on the proximity of the switch to proper grounding
facilities
• Crimping tool large enough to accommodate the girth of the grounding lug
• Wire stripping tool
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
12
Installing the Chassis
Preparing to Install the Chassis

Unpacking and Inspecting the Chassis
When handling switch components, such as fan or power supply modules, wear a grounded ESD strap and
handle the modules by their carrier edges only. To ground the ESD strap, make sure that it is attached to an
earth ground, a grounded chassis, or a grounded rack.
Caution
Keep the shipping container in case the chassis requires shipping in the future.
Tip
The switch is thoroughly inspected before shipment. If any damage occurred during transportation or any
items are missing, contact your customer service representative immediately.
Note
To inspect the switch, follow these steps:
Step 1 Compare the shipment to the equipment list provided by your customer service representative and verify that you have
received all items.
Step 2 Check for damage and report any discrepancies or damage to your customer service representative. Have the following
information ready:
• Invoice number of shipper (see the packing slip)
• Model and serial number of the damaged unit
• Description of damage
• Effect of damage on the installation
• Photos of the damaged shipping containers and damaged product
Step 3 For dual direction airflow switches, check to be sure that all of the fan and power supply modules have the same airflow
direction.
• Port-side intake airflow direction indicated with burgundy coloring
• Port-side exhaust airflow direction indicated with blue coloring
Installing the Chassis in a Four-Post Rack
This section describes the installation of the Cisco Nexus 9408 platform switch, into a four-post rack, using
the N9K-C9400-RMK rack-mount kit.
Before moving or lifting the chassis, follow these guidelines:
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
13
Installing the Chassis
Unpacking and Inspecting the Chassis

• Ensure that there is adequate space around the switch for servicing and airflow.
• Never attempt to lift an object that is too heavy for you to lift by yourself.
• Ensure that you have solid footing. Distribute the weight of the switch is evenly between your feet.
• Lift the switch slowly, keeping your back straight. Lift with your legs, not with your back. Bend at the
knees, not at the waist.
Statement 1030—Equipment Installation
Only trained and qualified personnel should be allowed to install, replace, or service this equipment.
Warning
Statement 1091—Installation by an Instructed Person
Only an instructed person or skilled person should be allowed to install, replace, or service this equipment.
See statement 1089 for the definition of an instructed or skilled person.
Warning
Statement 1032—Lifting the Chassis
To prevent personal injury or damage to the chassis, never attempt to lift or tilt the chassis using the handles
on modules, such as power supplies, fans, or cards. These types of handles are not designed to support the
weight of the unit.
Warning
Statement 164—Lifting Requirement
people are required to lift the heavy parts of the product. To prevent injury, keep your back straight and lift
with your legs, not your back.
Warning
Statement 1006—Chassis Warning for Rack-Mounting and Servicing
To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to
ensure that the system remains stable. The following guidelines are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the
heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the
unit in the rack.
Warning
Step 1 Attach two front-mount brackets to the sides of the chassis as follows:
Cisco Nexus 9408 NX-OS Mode Switch Hardware Installation Guide
14
Installing the Chassis
Installing the Chassis in a Four-Post Rack