Broadcom Brocade X6-8 Director Manual

Brocade X6-8 Director
Hardware Installation Guide
Hardware Installation Guide
23 April 2021
53-1004105-13
23 April 2021
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Table of Contents
Copyright Statement............................................................................................................................ 8
Introduction...........................................................................................................................................9
About This Document......................................................................................................................................................9
Supported Hardware........................................................................................................................................................ 9
Notes, Cautions, and Danger Notices......................................................................................................................... 10
Contacting Technical Support for Your Brocade® Product.......................................................................................10
Document Feedback...................................................................................................................................................... 11
Device Overview.................................................................................................................................12
Product Features............................................................................................................................................................ 12
Hardware Components.................................................................................................................................................. 12
Port-Side View of the Device........................................................................................................................................ 13
Port-Side Slot Numbering............................................................................................................................................. 15
Nonport-Side View of the Device................................................................................................................................. 15
Device Management Options........................................................................................................................................ 16
Preparing for Installation.................................................................................................................. 18
Safety Precautions......................................................................................................................................................... 18
Facility Requirements.................................................................................................................................................... 19
Time and Items Required.............................................................................................................................................. 20
Shipped Items................................................................................................................................................................. 21
Quick Installation Checklists........................................................................................................................................ 22
Mounting the Device..........................................................................................................................25
Mounting Options...........................................................................................................................................................25
Mounting Precautions....................................................................................................................................................25
Unpacking and Transporting the Device..................................................................................................................... 26
Installing the 14U Rack Mount Kit for Four-Post Racks (XBR-DCX-0120 and XBR-DCX-0152)..............................27
Time and Items Required......................................................................................................................................... 27
Parts List................................................................................................................................................................... 27
Assembling the Rack Hardware............................................................................................................................... 28
Installing the Device in the Rack..............................................................................................................................31
Installing the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks (XBR-DCX-0121).......................................... 32
Time and Items Required......................................................................................................................................... 33
Parts List................................................................................................................................................................... 33
Assembling the Rack Hardware............................................................................................................................... 34
Installing the Device in the Rack..............................................................................................................................35
Initial Setup and Verification.............................................................................................................38
Configuration and Verification Task Guide................................................................................................................. 38
53-1004105-13
2
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Items Required................................................................................................................................................................39
Providing Power to the Device.....................................................................................................................................39
Connecting the Power Cord to AC Power Supplies.................................................................................................40
Connecting to HVAC/HVDC Power Supplies........................................................................................................... 40
Using HVAC/HVDC Power Cords......................................................................................................................43
Establishing a Serial Connection to the Device.........................................................................................................44
Configuring the IP Addresses...................................................................................................................................... 46
Establishing an Ethernet Connection to the Device.................................................................................................. 47
Setting the Domain ID................................................................................................................................................... 48
Setting the Date and Time............................................................................................................................................ 48
Setting the Time Zone.............................................................................................................................................. 49
Synchronizing the Local Time with an External Source...........................................................................................50
Customizing the Chassis and Switch Name............................................................................................................... 50
Verifying Installed Licenses.......................................................................................................................................... 51
Verifying Correct Operation.......................................................................................................................................... 52
Backing Up the Configuration...................................................................................................................................... 52
Powering Down the Chassis.........................................................................................................................................53
Installing Transceivers and Cables..................................................................................................56
Supported Transceivers and Cables............................................................................................................................56
Port and Extension Blade Transceivers................................................................................................................... 57
Core Routing Blade Transceivers.............................................................................................................................58
Time and Items Required.............................................................................................................................................. 59
Precautions Specific to Transceivers and Cables......................................................................................................60
Cleaning the Fiber-Optic Connectors.......................................................................................................................... 60
Cable Management.........................................................................................................................................................60
Installing an SFP+ Transceiver.....................................................................................................................................61
Replacing an SFP+ Transceiver................................................................................................................................... 62
Installing a QSFP Transceiver...................................................................................................................................... 64
Replacing a QSFP Transceiver.....................................................................................................................................65
Verifying the Operation of New Transceivers............................................................................................................. 66
Monitoring the Device....................................................................................................................... 67
Introduction..................................................................................................................................................................... 67
Interpreting FC32-48 Port Blade LEDs.........................................................................................................................67
Interpreting FC32-64 Port Blade LEDs.........................................................................................................................70
Interpreting Extension Blade LEDs..............................................................................................................................72
Interpreting Core Routing Blade LEDs........................................................................................................................75
Interpreting Control Processor Blade LEDs............................................................................................................... 77
Interpreting WWN Card LEDs....................................................................................................................................... 79
Interpreting Power Supply LEDs.................................................................................................................................. 80
53-1004105-13
3
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Interpreting Fan Assembly LEDs................................................................................................................................. 83
Interpreting POST and Boot Results........................................................................................................................... 84
POST......................................................................................................................................................................... 84
Using Monitoring Commands....................................................................................................................................... 85
chassisShow..............................................................................................................................................................85
errDump and errShow...............................................................................................................................................88
fanShow.....................................................................................................................................................................88
haShow......................................................................................................................................................................88
historyShow............................................................................................................................................................... 89
psShow...................................................................................................................................................................... 90
sensorShow............................................................................................................................................................... 90
sfpShow..................................................................................................................................................................... 91
slotShow.................................................................................................................................................................... 91
supportSave...............................................................................................................................................................92
switchShow................................................................................................................................................................93
tempShow..................................................................................................................................................................93
Running Diagnostic Tests............................................................................................................................................. 94
Port and Extension Blades............................................................................................................... 95
FC32-48 Port Blade Overview....................................................................................................................................... 95
FC32-48 Port Blade Numbering and Trunking.........................................................................................................95
FC32-64 Port Blade Overview....................................................................................................................................... 97
FC32-64 Port Blade Numbering and Trunking.........................................................................................................98
Extension Blade Overview............................................................................................................................................ 99
Extension Features................................................................................................................................................. 100
SX6 Blade Port Numbering and Trunking.............................................................................................................. 101
Blade-Specific Precautions......................................................................................................................................... 102
Faulty Blade Indicators................................................................................................................................................102
Time and Items Required for Removal and Installation.......................................................................................... 103
Removing a Blade........................................................................................................................................................ 103
Installing a Blade..........................................................................................................................................................106
Verifying Blade Operation........................................................................................................................................... 107
Core Routing Blades....................................................................................................................... 108
Core Routing Blade Overview.................................................................................................................................... 108
CR32-8 Port Numbering......................................................................................................................................... 108
ICL Trunking Groups...............................................................................................................................................110
ICL Cabling Configurations..................................................................................................................................... 110
Blade-Specific Precautions......................................................................................................................................... 112
Faulty Core Routing Blade Indicators....................................................................................................................... 113
Time and Items Required............................................................................................................................................ 113
53-1004105-13
4
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Replacing a Core Routing Blade................................................................................................................................113
Preparing for Replacement..................................................................................................................................... 114
Removing a Core Routing Blade............................................................................................................................115
Installing a Core Routing Blade..............................................................................................................................116
Verifying Blade Operation........................................................................................................................................... 118
Control Processor Blades...............................................................................................................119
Control Processor Blade Overview............................................................................................................................119
CPX6 Port Identification..........................................................................................................................................119
Blade-Specific Precautions......................................................................................................................................... 120
Blade Fault Indicators..................................................................................................................................................121
Blade Replacement Task Guide..................................................................................................................................121
Time and Items Required............................................................................................................................................ 122
Preparing for Replacement......................................................................................................................................... 122
Replacing a Control Processor Blade....................................................................................................................... 123
Replacing a CP Blade: Hot-Swap Procedure.........................................................................................................124
Removing a Blade........................................................................................................................................... 124
Installing a Blade............................................................................................................................................. 125
Verifying and Synchronizing Firmware on Blades...........................................................................................126
Replacing a CP Blade: Cold-Swap Procedure.......................................................................................................130
Removing a Blade........................................................................................................................................... 130
Installing a Blade............................................................................................................................................. 131
Completing the Replacement..................................................................................................................................132
Verifying Blade Operation........................................................................................................................................... 133
WWN Cards.......................................................................................................................................135
WWN Card Overview....................................................................................................................................................135
WWN Card Location and Numbering..................................................................................................................... 135
Precautions Specific to WWN Cards......................................................................................................................... 136
WWN Card Fault Indicators.........................................................................................................................................136
WWN Card Replacement Task Guide.........................................................................................................................138
Time and Items Required............................................................................................................................................ 138
Using the wwnrecover Utility......................................................................................................................................138
Preparing for Replacement......................................................................................................................................... 140
Hot-Swap Replacement................................................................................................................................................141
Cold-Swap Replacement..............................................................................................................................................142
Removing the WWN Card and Bezel......................................................................................................................... 143
Configuring the Airflow Direction on WWN Cards...................................................................................................144
Verifying WWN Card Operation.................................................................................................................................. 145
Power Supply Assemblies.............................................................................................................. 146
AC Power Supply Overview........................................................................................................................................ 146
53-1004105-13
5
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
HVAC/HVDC Power Supply Overview........................................................................................................................ 147
Power Supply Assembly Numbering......................................................................................................................... 148
Fan and Power Supply Airflow...................................................................................................................................149
Precautions Specific to Power Supply Assemblies................................................................................................. 150
Power Supply Assembly Fault Indicators................................................................................................................. 150
Power Supply Assembly Task Guide.........................................................................................................................150
Time and Items Required............................................................................................................................................ 151
Removing a Power Supply..........................................................................................................................................152
Installing a Power Supply........................................................................................................................................... 154
Verifying Power Supply Operation............................................................................................................................. 154
Fan Assemblies................................................................................................................................ 156
Fan Assembly Overview..............................................................................................................................................156
Fan and Power Supply Airflow............................................................................................................................... 157
Fan Assembly Numbering.......................................................................................................................................158
Precautions Specific to Fan Assemblies...................................................................................................................159
Fan Assembly Fault Indicators...................................................................................................................................159
Fan Assembly Task Guide.......................................................................................................................................... 160
Time and Items Required............................................................................................................................................ 161
Removing a Fan Assembly......................................................................................................................................... 161
Installing a Fan Assembly...........................................................................................................................................162
Verifying Fan Operation...............................................................................................................................................162
Blade Filler Panels........................................................................................................................... 163
Blade Filler Panel Removal and Replacement..........................................................................................................163
Removing a Filler Panel.............................................................................................................................................. 163
Installing a Filler Panel................................................................................................................................................163
Cable Management Comb............................................................................................................... 165
Cable Management Comb Overview.......................................................................................................................... 165
Time and Items Required for Removal and Installation.......................................................................................... 165
Removing the Cable Management Comb.................................................................................................................. 166
Installing the Cable Management Comb....................................................................................................................166
Chassis Door.................................................................................................................................... 167
Chassis Door Overview............................................................................................................................................... 167
Time and Items Required............................................................................................................................................ 167
Removing a Chassis Door.......................................................................................................................................... 167
Installing a Chassis Door............................................................................................................................................ 168
Replacing the Chassis.....................................................................................................................170
Chassis Replacement Overview................................................................................................................................. 170
Precautions Specific to Chassis Replacement.........................................................................................................170
Chassis Replacement Task Guide..............................................................................................................................171
53-1004105-13
6
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Chassis Fault Indicators..............................................................................................................................................171
Time and Items Required............................................................................................................................................ 171
Preparing for Replacement......................................................................................................................................... 172
Recording Critical Device and SAN Information.....................................................................................................172
Disconnecting from the Network and Fabric.......................................................................................................... 176
Removing Components from the Chassis................................................................................................................ 176
Installing the Replacement Chassis...........................................................................................................................177
Installing Components into the Chassis................................................................................................................... 178
Synchronizing Airflow Direction on WWN Cards..................................................................................................... 178
Downloading the Configuration..................................................................................................................................179
Reconnecting the System to the Network and Fabric............................................................................................. 179
Verifying Correct Operation of the System...............................................................................................................180
Verifying Correct Configuration of the Fabric.......................................................................................................... 182
Technical Specifications..................................................................................................................184
Regulatory Statements.................................................................................................................... 191
BSMI Statement (Taiwan).............................................................................................................................................191
Canadian Requirements.............................................................................................................................................. 191
CE Statement................................................................................................................................................................ 191
China ROHS.................................................................................................................................................................. 192
FCC Warning (U.S. Only).............................................................................................................................................192
Germany Statement......................................................................................................................................................192
KCC Statement (Republic of Korea).......................................................................................................................... 192
VCCI Statement.............................................................................................................................................................193
Regulatory Compliance............................................................................................................................................... 193
Cautions and Danger Notices.........................................................................................................195
Cautions.........................................................................................................................................................................195
Danger Notices............................................................................................................................................................. 200
Revision History............................................................................................................................... 205
53-1004105-13
7
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Copyright Statement
Copyright © 2018–2021 Broadcom. All Rights Reserved. Broadcom, the pulse logo, Brocade, and the stylized B logo are
among the trademarks of Broadcom in the United States, the EU, and/or other countries. The term “Broadcom” refers to
Broadcom Inc. and/or its subsidiaries.
Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability,
function, or design. Information furnished by Broadcom is believed to be accurate and reliable. However, Broadcom does
not assume any liability arising out of the application or use of this information, nor the application or use of any product or
circuit described herein, neither does it convey any license under its patent rights nor the rights of others.
The product described by this document may contain open source software covered by the GNU General Public License
or other open source license agreements. To find out which open source software is included in Brocade products, to view
the licensing terms applicable to the open source software, and to obtain a copy of the programming source code, please
download the open source disclosure documents in the Broadcom Customer Support Portal (CSP). If you do not have a
CSP account or are unable to log in, please contact your support provider for this information.
53-1004105-13
8
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
Introduction
About This Document
This hardware installation guide contains procedures and safety requirements for installing the Brocade X6-8 Director into
a rack system or as a stand-alone device. Also provided are steps to initially configure the director for operation, verify and
monitor operation, replace director field-replaceable units (FRUs), and install transceivers and cables. Complete technical
specifications for the director are also included.
Supported Hardware
The following tables list the major FRUs and the rack mount kits that are supported on this device. The first release of this
product was at Fabric OS 8.0.1.
Table 1: OS-Dependent FRUs
FRU Part Number Short Description Introduced (OS) Currently Supported
XBR-X6-
RACNPIPSU-0104
Provides 1450W (100–120 VAC) and
2870W (200–240 VAC). This model supports
nonport-side intake (NPI) airflow.
Fabric OS 8.0.1 Yes
AC power supply
XBR-X6-
RACNPEPSU-0104
Provides 1450W (100–120 VAC) and
2870W (200–277 VAC). This model supports
nonport-side exhaust (NPE) airflow.
Fabric OS 8.0.1 Yes
XBR-X6-
HVNPIPSU-0104
Dual-function high-voltage model provides
the following power output from either high-
voltage AC or DC power source:
•1450W (100–120 VAC)
•2870W (200–277 VAC)
•2870W (240–380 VDC)
This model supports nonport-side intake
(NPI) airflow.
Fabric OS 8.1.0a Yes
HVAC/HVDC power
supply
XBR-X6-
HVNPEPSU-0104
Dual-function high-voltage model provides
the following power output from either high-
voltage AC or DC power source:
•1450W (100–120 VAC)
•2870W (200–277 VAC)
•2870W (240–380 VDC)
This model supports nonport-side exhaust
(NPE) airflow.
Fabric OS 8.1.0a Yes
XBR-X6-NPI-0122 Supports NPI airflow Fabric OS 8.0.1 Yes
Fan assembly
XBR-X6-NPE-0122 Supports NPE airflow Fabric OS 8.0.1 Yes
FC32-48 blade XBR-X6-0148 Fibre Channel port blade with 48 32G SFP+
ports
Fabric OS 8.0.1 Yes
53-1004105-13
9
Broadcom

53-1004105-13 Hardware Installation Guide Brocade X6-8 Director Hardware Installation Guide
FRU Part Number Short Description Introduced (OS) Currently Supported
FC32-64 blade XBR-X6-0164 Port blade with 16 QSFP+ FlexPorts
that can be configured for FC or FCoE
operation. Each port can operate at speeds
up to 4x32G port for a total of 64 32G
ports per blade with FC transceivers
installed. Optionally, you can install Ethernet
transceivers and configure them for
FCoE operation. Various GbE speeds are
supported.
Fabric OS 8.2.0 Yes
CPX6 blade XBR-CPX6-0103 Control processor (CP) blade Fabric OS 8.0.1 Yes
CR32-8 blade XBR-X68-0106 Core routing (CR) blade with 16 4x32G
QSFP+ ports for Brocade X6-8 Director.
Fabric OS 8.0.1 Yes
SX6 blade XBR-SX6-0000 Extension (X) blade with 16 32G Fibre
Channel SFP+ ports, 16 10GbE SFP+ ports,
and 2 40GbE QSFP+ ports
Fabric OS 8.0.1 Yes
WWN card XBR-X6-0124 World Wide Name card Fabric OS 8.0.1 Yes
Blade slot filler
panel
XBR-X6-0128 Required to cover empty slot to maintain
airflow in chassis.
Fabric OS 8.0.1 Yes
Power supply
assembly slot filler
panel
XBR-X6-0130 Required to cover empty slot to maintain
airflow in chassis.
Fabric OS 8.0.1 Yes
Table 2: Rack Mount Kits
Kit Part Number Short Description
XBR-DCX-0121 Mid-mount rack mount kit for two-post rack
XBR-DCX-0120 14U rack mount kit for four-post rack (27–31 in.)
Rack mount kits
XBR-DCX-0152 14U rack mount kit for four-post rack (22 in.)
Notes, Cautions, and Danger Notices
Notes, cautions, and danger statements may be used in this document.
NOTE
A Note provides a tip, guidance, or advice, emphasizes important information, or provides a reference to related
information.
CAUTION
A Caution statement alerts you to situations that can be potentially hazardous to you or cause damage to
hardware, firmware, software, or data.
DANGER
A Danger statement indicates conditions or situations that can be potentially lethal or extremely hazardous to
you. Safety labels are also attached directly to products to warn of these conditions or situations.
Contacting Technical Support for Your Brocade® Product
If you purchased Brocade product support from a Broadcom OEM/solution provider, contact your OEM/solution provider
for all your product support needs.
53-1004105-13
10
Broadcom