IBM 8960-F64 Manual

IBM 64 Port 32G Gen 6 Switch
(8960-F64/8960-N64)
Hardware Installation Guide

Contents
Preface..................................................................................................................................... 7
Document conventions......................................................................................7
Text formatting conventions..................................................................7
Command syntax conventions..............................................................7
Notes, cautions, and warnings..............................................................8
Resources............................... ………..............................................................9
Contacting Technical Support...........................................................................9
Document feedback........................................................................................10
About This Document.............................................................................................................. 11
Supported hardware and software..................................................................11
What's new in this document...........................................................................11
Device Overview...................................................................................................................... 13
Hardware features...........................................................................................13
License options...............................................................................................14
Port-side view..................................................................................................14
Nonport-side view........................................................................................... 15
Device management options...........................................................................15
Preparing for Installation.........................................................................................................17
Safety precautions.......................................................................................... 17
General precautions............................................................................17
ESD precautions.................................................................................18
Power precautions.............................................................................. 18
Lifting and weight-related precautions................................................ 19
Laser precautions................................................................................20
Facility requirements.......................................................................................20
Quick installation checklist..............................................................................21
Shipping carton contents.................................................................................23
Mounting the Device............................................................................................................... 25
Mounting options.............................................................................................25
Precautions specific to mounting.................................................................... 25
Standalone installation ...................................................................................26
Universal four-post rack installation................................................................26
Installation requirements.....................................................................26
Time and items required..................................................................... 27
Flush-front mounting...........................................................................29
Flush-rear (recessed) mounting..........................................................34
Universal two-post rack installation.................................................................39
Installation requirements.....................................................................40
Time and items required..................................................................... 40
Flush-front mounting...........................................................................41
Mid-mounting...................................................................................... 45
Hardware Installation Guide 3

Initial Setup and Verification................................................................................................. 51
Items required...............................................................................................51
Providing power to the device.......................................................................51
Establishing a first-time serial connection.....................................................52
Configuring the IP address............................................................................53
Using DHCP to set the IP address....................................................53
Setting a static IP address................................................................53
Setting the date and time..............................................................................53
Setting the time zone........................................................................54
Synchronizing local time with an external source.............................55
Customizing the chassis name and switch name.........................................55
Establishing an Ethernet connection.............................................................56
Setting the domain ID....................................................................................56
Verifying correct operation............................................................................56
Backing up the configuration.........................................................................57
Powering down the device............................................................................58
Installing the Transceivers and Cables...................................................................................59
Time and items required...............................................................................59
Precautions specific to transceivers and cables...........................................60
Cleaning the fiber-optic connectors.............................................................. 60
Managing cables...........................................................................................60
Installing an SFP+ transceiver......................................................................61
Replacing an SFP+ transceiver.................................................................... 62
Installing a QSFP transceiver........................................................................63
Replacing a QSFP transceiver......................................................................64
Verifying the operation of new transceivers..................................................65
Monitoring the Device........................................................................................................... 67
Interpreting port-side LEDs...........................................................................67
System power LED...........................................................................67
System status LED............................................................................68
FC port status LED............................................................................69
QSFP port status LED.......................................................................69
Interpreting nonport-side LEDs.....................................................................70
Power supply and fan assembly status LED.....................................71
Interpreting the POST results........................................................................71
Interpreting the BOOT results.......................................................................72
Running diagnostic tests...............................................................................72
Power Supply and Fan Assembly............................................................................................75
Power supply and fan assembly FRU overview............................................75
Precautions specific to the power supply and fan assemblies......................76
Identifying the airflow direction......................................................................77
Power supply and fan assembly status LED.................................................77
Power supply and fan assembly unit fault indicators....................................78
Power supply and fan assembly task guide..................................................78
Time and items required...............................................................................79
Recording power supply and fan assembly critical information.................... 79
Removing a power supply and fan assembly............................................... 80
Inserting a new power supply and fan assembly..........................................81
Verifying the operation of the power supply and fan assemblies..................82
4 Hardware Installation Guide

Technical Specifications......................................................................................................... 83
Regulatory Statements............................................................................................................91
BSMI statement (Taiwan)................................................................................91
Canadian requirements...................................................................................91
CE Statement..................................................................................................91
China CC statement........................................................................................92
China ROHS................................................................................................... 93
FCC warning (US only)...................................................................................93
Germany......................................................................................................... 93
KCC statement (Republic of Korea)................................................................93
VCCI statement...............................................................................................93
Cautions and Danger Notices.................................................................................................. 95
Cautions..........................................................................................................95
Danger Notices............................................................................................... 98
Hardware Installation Guide 5

6 HardwareInstallationGuide

Preface
● Document conventions......................................................................................................7
● Resources.........................................................................................................................9
● Contacting Technical Support...........................................................................................9
●Document feedback........................................................................................................10
Document conventions
The document conventions describe text formatting conventions, command syntax conventions, and
important notice formats used in technical documentation.
Text formatting conventions
Text formatting conventions such as boldface, italic, or Courier font may be used in the flow of the text
to highlight specific words or phrases.
Format Description
bold text Identifies command names
Identifies keywords and operands
Identifies the names of user-manipulated GUI elements
Identifies text to enter at the GUI
italic text Identifies emphasis
Identifies variables
Identifies document titles
Courier font Identifies CLI output
Identifies command syntax examples
Command syntax conventions
Bold and italic text identify command syntax components. Delimiters and operators define groupings of
parameters and their logical relationships.
Convention Description
bold text Identifies command names, keywords, and command options.
italic text Identifies a variable.
value In Fibre Channel products, a fixed value provided as input to a command
option is printed in plain text, for example, --show WWN.
Hardware Installation Guide 7

Notes, cautions, and warnings
Convention Description
[ ] Syntax components displayed within square brackets are optional.
Default responses to system prompts are enclosed in square brackets.
{ x | y | z } A choice of required parameters is enclosed in curly brackets separated by
vertical bars. You must select one of the options.
In Fibre Channel products, square brackets may be used instead for this
purpose.
x | y A vertical bar separates mutually exclusive elements.
< > Nonprinting characters, for example, passwords, are enclosed in angle
brackets.
... Repeat the previous element, for example, member[member...].
\ Indicates a “soft” line break in command examples. If a backslash separates
two lines of a command input, enter the entire command at the prompt without
the backslash.
Notes, cautions, and warnings
Notes, cautions, and warning statements may be used in this document. They are listed in the order of
increasing severity of potential hazards.
NOTE
A Note provides a tip, guidance, or advice, emphasizes important information, or provides a reference
to related information.
ATTENTION
An Attention statement indicates a stronger note, for example, to alert you when traffic might be
interrupted or the device might reboot.
CAUTION
A Caution statement alerts you to situations that can be potentially hazardous to you or cause
damage to hardware, firmware, software, or data.
DANGER
A Danger statement indicates conditions or situations that can be potentially lethal or
extremely hazardous to you. Safety labels are also attached directly to products to warn of
these conditions or situations.
8 Hardware Installation Guide

Document feedback
About This Document
● Supported hardware and software..................................................................................11
● What's new in this document...........................................................................................11
Supported hardware and software
The following tables list the field-replaceable units (FRUs) and rack mount kits supported for the
IBM device.
TABLE 1 Power supply and fan assembly units
Part number Description Introduced (OS) Currently
supported (OS)
XBR-250WPSAC-F 250W AC power supply with nonport-side
exhaust airflow Fabric OS 8.0.0 Yes
XBR-250WPSAC-R 250W AC power supply with nonport-side
intake airflow Fabric OS 8.0.0 Yes
TABLE 2 Rack mount kits
Part number Description
XBR-R000294 Universal two-post mid-mount or flush-mount rack kit
XBR-R000296 Universal four-post fixed rack mount kit
What's new in this document
This is a new document.

Hardware Installation Guide 11

What's new in this document
12 HardwareInstallationGuide

Device Overview
● Hardware features...........................................................................................................13
● License options...............................................................................................................14
● Port-side view..................................................................................................................14
● Nonport-side view........................................................................................................... 15
● Device management options...........................................................................................15
Hardware features
The SAN64B-6 offers the following features and capabilities:
• Up to 48 auto-sensing ports supporting high-performance 32-Gbps SFP+ ports technology in a single
domain.
• Up to four 128-Gbps (4 x 32-Gbps) QSFP ports to connect to the QSFP ports of another devices.
• Ports on Demand (POD) scaling from a base configuration of 24 ports to 64 ports (two 12-port SFP+
PODs and one 16-port QSFP POD).
• 4-, 8-, 16-, and 32-Gbps auto-sensing Fibre Channel switch and router ports.
‐ A 32-Gbps optical transceiver can auto-negotiate to 32 Gbps, 16 Gbps, or 8 Gbps.
‐ A 16-Gbps optical transceiver can auto-negotiate to 16 Gbps, 8 Gbps, or 4 Gbps.
NOTE
The port speed is determined by the maximum speed supported by the optical transceiver at the
other end of the link.
• 10-Gbps manually set capability on FC ports (requires the optional 10-Gigabit FCIP/Fibre Channel
license).
‐ 10-Gbps performance is enabled by 10-Gbps SFP+ transceivers.
‐ Ports can be configured for 10-Gbps for metro connectivity.
• Universal ports self-configure as a E_Ports, F_Ports, M_Ports, or D_Ports. EX_Ports can be
activated on a per-port basis with the optional Integrated Routing license.
‐ A Diagnostic Port (D_Port) provides diagnostics, troubleshooting, and verification services for the
physical media.
• Support for port-side exhaust or nonport-side exhaust airflow for cooling.
• Brocade small form-factor pluggable plus (SFP+) optical transceivers support any combination of
Short Wavelength (SWL), Long Wavelength (LWL) or Extended Long Wavelength (ELWL) optical
media among the switch ports.
• Extended distance Fibre Channel to support long distance native FC connectivity.
• 10-Gbps Fibre Channel integration on any selected port provides DWDM metro connectivity on the
same switch.
• Port-to-port latency is minimized to 700 nanoseconds by using cut-through frame switching at 32
Gbps.
• High performance T1022 processor with two cores operating at 1.2 GHz delivers high performance,
scalability, and advanced Fabric Vision functionality.
Hardware Installation Guide 13

License options
• One 10BASE-T / 100BASE-TX / 1000BASE-T RJ45 connector Ethernet port for management
connection. In conjunction with EZSwitchSetup, this port supports switch IP address discovery and
configuration, eliminating the need to attach a serial cable to configure the switch IP address.
• One RS-232 3-wire (Tx, Rx, and Gnd) universal asynchronous receiver/transmitter (UART) serial
port to BMC with RJ-45 connector for debugging initial switch setup (if not using EZSwitch Setup)
and factory default restoration. Integral LEDs remain unlit at all times.
• One internal e-USB module provides 2 GB of persistent storage, increased serviceability, and error
logging functionality by facilitating easier firmware upgrades and downloads of the system log files.
• One external USB connector.
• Two hot-swappable redundant integrated power supply and fan assembly field-replaceable units.
• 48 hot-pluggable SFP+ optical transceiver slots and 4 hot-pluggable QSFP optical transceiver slots.
• 64 bicolor (green/amber) LEDs to indicate the status for each port.
• One green LED to indicate valid system power.
• One bicolor (green/amber) LED to indicate the system status.
• Two Ethernet LEDs: one bicolor (green/amber) LED to indicate link at 1000/100/10 Mbps and one
green LED to indicate activity.
• SEEPROM for switch identification.
• Real-time power monitoring.
• Real-time voltage monitoring.
• Real-time fan monitoring including airflow direction.
• Real-time digital thermometers for temperature monitoring.
• Real-time clock (RTC) with battery.
License options
The SAN64B-6 uses a capacity-based Ports on Demand (POD) license method. Refer to the
Fabric OS Software Licensing Guide for more details.
Port-side view
The following illustration shows the port-side view of the Fibre Channel switch.
1 System status LED
2 System power LED
3 UART RJ-45 serial console port
4 SFP+ FC (four upper and four lower)
ports 0-7
5 SFP+ FC (four upper and four lower)
ports 8-15
6 SFP+ FC (four upper and four lower)
ports 16-23
7 SFP+ FC (four upper and four lower)
ports 24-31
14 Hardware Installation Guide

Nonport-side view
8 SFP+ FC (four upper and four lower)
ports 32-39
9 SFP+ FC (four upper and four lower)
ports 40-47
10 QSFP port 0 (FC ports 48-51)
11 QSFP port 2 (FC ports 56-59)
12 QSFP port 3 (FC ports 60-63)
13 QSFP port 1 (FC ports 52-55)
14 SFP+ (lower) port 14 status LED
15 SFP+ (upper) port 10 status LED
16 1000Base-X/100Base-TX/10Base-T
RJ-45 Ethernet management port
17 USB port
FIGURE 1 Port-side view
NOTE
All the ports are connected to a single ASIC.
Nonport-side view
The following illustration shows the nonport-side view of the FC switch.
1 Ground sticker
2 Ground cable connector
3 Power supply and fan assembly 2
4 Power supply and fan assembly 1
5 Captive screw
6 Fan 1
7 Handle
8 Power supply and fan assembly status
LED
9 Power-on switch
10 Power supply receptacle
11 Fan 2
12 Fan 3
FIGURE 2 Nonport-side view with AC power supply and fan assembly units
Device management options
You can use the management functions built into the device to monitor the fabric topology, port status,
physical status, and other information to help you analyze switch performance and to accelerate system
debugging. The device automatically performs power-on self-test (POST) each time it is turned on. Any
errors are recorded in the RASlog messages.
You can manage the device using any of the management options listed in the following table.
Hardware Installation Guide 15

Device Overview
TABLE 3 Management options for the device
Management tool Out-of-band
support In-band support Reference documents
Command line interface
(CLI)
Up to two admin sessions
and four user sessions
simultaneously.
Ethernet or serial
connection IP over Fibre Channel Fabric OS Administrator's Guide
Fabric OS Command Reference
EZSwitchSetup
EZSwitchSetup helps to
complete the basic
configuration for single-
switch setup.
Ethernet or serial
connection IP over Fibre Channel EZSwitchSetup QuickStart Guide
EZSwitchSetup
Administrator's Guide
Web Tools Ethernet or serial
connection IP over Fibre Channel Web Tools Administrator's Guide
Standard SNMP
applications Ethernet or serial
connection IP over Fibre Channel Fabric OS MIB Reference
Management Server Ethernet or serial
connection Native in-band interface (over HBA only) Fabric OS Administrator's Guide
Fabric OS Command Reference
IBM Network Advisor
(INA)
BNA must be purchased
separately.
Ethernet or serial
connection IP over Fibre Channel IBM Network Advisor documentation set
16 Hardware Installation Guide

Preparing for Installation
● Safety precautions.......................................................................................................... 17
● Facility requirements.......................................................................................................20
● Quick installation checklist..............................................................................................21
● Shipping carton contents.................................................................................................23
Safety precautions
When using this product, observe all danger, caution, and attention notices in this manual. The safety
notices are accompanied by symbols that represent the severity of the safety condition
Refer to Cautions and Danger Notices at the end of this guide for translations of safety notices for this
product.
General precautions
DANGER
The procedures in this manual are for qualified service personnel.
DANGER
Before beginning the installation, see the precautions in “Power precautions.”
CAUTION
Changes or modifications made to this device that are not expressly approved by the party
responsible for compliance could void the user's authority to operate the equipment.
CAUTION
Disassembling any part of the power supply and fan assembly voids the warranty and regulatory
certifications. There are no user-serviceable parts inside the power supply and fan assembly.
CAUTION
Make sure the airflow around the front, sides, and back of the device is not restricted.
CAUTION
Ensure that the airflow direction of the power supply unit matches that of the installed fan tray.
The power supplies and fan trays are clearly labeled with either a green arrow with an "E", or an
orange arrow with an "I."
CAUTION
Never leave tools inside the chassis.
Hardware Installation Guide 17

ESD precautions
CAUTION
To protect the serial port from damage, keep the cover on the port when not in use.
CAUTION
If you do not install a module or a power supply in a slot, you must keep the slot filler panel in
place. If you run the chassis with an uncovered slot, the system will overheat.
ESD precautions
CAUTION
Before plugging a cable into to any port, be sure to discharge the voltage stored on the cable
by touching the electrical contacts to ground surface.
CAUTION
Static electricity can damage the chassis and other electronic devices. To avoid damage, keep
static-sensitive devices in their static-protective packages until you are ready to install them.
CAUTION
Wear a wrist grounding strap connected to the chassis ground (if the device is plugged in) or
to a bench ground.
DANGER
For safety reasons, the ESD wrist strap should contain a series 1 megaohm resistor.
Power precautions
DANGER
Make sure that the power source circuits are properly grounded, then use the power cord
supplied with the device to connect it to the power source.
DANGER
If the installation requires a different power cord than the one supplied with the device, make
sure you use a power cord displaying the mark of the safety agency that defines the
regulations for power cords in your country. The mark is your assurance that the power cord
can be used safely with the device.
DANGER
This device might have more than one power cord. To reduce the risk of electric shock,
disconnect all power cords before servicing.
DANGER
Remove both power cords before servicing.
18 Hardware Installation Guide

Lifting and weight-related precautions
DANGER
Disconnect the power cord from all power sources to completely remove power from the device.
DANGER
To avoid high voltage shock, do not open the device while the power is on.
DANGER
Risk of explosion if battery is replaced by an incorrect type. Dispose of used batteries according
to the instructions.
CAUTION
Use a separate branch circuit for each power cord, which provides redundancy in case one of
the circuits fails.
CAUTION
Ensure that the device does not overload the power circuits, wiring, and over-current protection.
To determine the possibility of overloading the supply circuits, add the ampere (amp) ratings of
all devices installed on the same circuit as the device. Compare this total with the rating limit for
the circuit. The maximum ampere ratings are usually printed on the devices near the input
power connectors.
CAUTION
All devices with AC power sources are intended for installation in restricted access areas only.
A restricted access area is a location where access can be gained only by service personnel
through the use of a special tool, lock and key, or other means of security.
Lifting and weight-related precautions
DANGER
Use safe lifting practices when moving the product.
DANGER
Mount the devices you install in a rack as low as possible. Place the heaviest device at the
bottom and progressively place lighter devices above.
CAUTION
Do not use the port cover tabs to lift the module. They are not designed to support the weight of
the module, which can fall and be damaged.
CAUTION
To prevent damage to the chassis and components, never attempt to lift the chassis using the
fan or power supply handles. These handles were not designed to support the weight of the
chassis.
Hardware Installation Guide 19

Laser precautions
Laser precautions
DANGER
All fiber-optic interfaces use Class 1 lasers.
DANGER
Use only optical transceivers that are qualified by Brocade Communications Systems, Inc. and
comply with the FDA Class 1 radiation performance requirements defined in 21 CFR
Subchapter I, and with IEC 825-2. Optical products that do not comply with these standards
might emit light that is hazardous to the eyes.
Facility requirements
Before installing the device, be sure the following facilities requirements are met.
TABLE 4 Facility requirements
Type Requirements
Electrical • Adequate supply circuit, line fusing, and wire size, as specified by the electrical
rating on the switch nameplate
• Circuit protected by a circuit breaker and grounded in accordance with local
electrical codes
Refer to the Technical Specifications at the end of this guide for complete power
supply specifications.
Thermal • A minimum airflow of 79.8 cubic meters/hour (47 cubic ft/min.) available in the
immediate vicinity of the switch
NOTE
Although this airflow may exceed the airflow maximum listed in the device
Technical Specifications, the additional airflow is recommended to pressurize the
inlet (cool isle) side of rack installations relative to the exhaust side to minimize
recirculation of hot air back to the inlet side.
•Ambient air temperature not exceeding 40°C (104°F) while the switch is operating
Rack (when rack-mounted) • One rack unit (1U) in a 48.3 cm (19-inch) rack
• All equipment in the rack grounded through a reliable branch circuit connection
• Additional weight of switch not to exceed the rack’s weight limits
• Rack secured to ensure stability in case of unexpected movement
20 Hardware Installation Guide

Quick installation checklist
Quick installation checklist
This checklist provides a high-level overview of the basic installation process from the planning stage to
the point where the device comes online and is ready to be deployed. Completing all the tasks in the
suggested order ensures successful installation.
Pre-installation tasks
Review all installation requirements ahead of time as part of your site preparation. Careful planning and
site preparation ensures seamless installation, especially when installing multiple devices.
TABLE 5 Installation prerequisites
Task Task details or additional information Completed
Unpack the device. Take an inventory of the hardware components included in your shipment. Refer to
Shipping carton contents on page 23.
Gather necessary components and
required tools.
Review the time and items required information at the beginning of each chapter to
ensure you have gathered all necessary components required for the following
installation tasks:
• Mounting the Device on page 25
• Power Supply and Fan Assembly on page 75
• Installing the Transceivers and Cables on page 59
Review the safety precautions. Refer to Safety precautions on page 17. For translations, refer to Cautions and
Danger Notices on page 95 at the end of this guide.
Plan the installation. Decide whether you want to install the unit on a flat surface or in a rack. For rack
installation, obtain the appropriate rack mount kit. Refer to Mounting options on
page 25.
Review and verify installation
requirements.
Verify that the following requirements are met. Refer to Facility requirements on
page 20.
• Power requirements
• Environmental requirements
• Clearance for standalone or rack installation
Gather network configuration
parameters. • IP address:
• Subnet mask:
• Default gateway:
• Domain ID:
• Time zone:
Installation and initial configuration
The initial setup includes mounting the device on a flat surface or in a rack and completing the
configuration tasks necessary to bring the device online and verify the operation.
Hardware Installation Guide 21

Preparing for Installation
TABLE 6 Installation and basic system configuration
Task Task details or additional information Completed
Mount the device. Choose one of the following mounting options:
• Mount the device as a standalone unit. Refer to Standalone installation on page
26.
• Mount the device in a four-post rack. Refer to Universal four-post rack
installation on page 26.
• Mount the device in a two-post rack. Refer to Universal two-post rack
installation on page 39.
Check the airflow of the power supply
and fan assembly The airflow direction of the power supply and fan should match. The power supplies and fan trays are clearly labeled with either a green arrow with an "E", or
an orange arrow with an "I." For more details, refer to Identifying the airflow
direction on page 77.
Gather all components required for the
initial setup.
Refer to Items required on page 51.
Provide power to the device. Refer to Providing power to the device on page 51.
Attach a management station, establish
a serial connection, and change the
default passwords (optional).
Refer to Establishing a first-time serial connection on page 52. After completing
this task, log in to the serial port to configure the device.
Set the IP address, subnet mask, and
the default gateway IP address.
Use the ipaddrset command to configure a static device IP address, subnet mask,
and gateway IP address, or you can use a DHCP server to obtain the information
dynamically. Refer to Configuring the IP address on page 53.
Set the date and time. • Use the date command to display and set the date and time.
• Use the tstimezone command to display and set the time zone.
• Use the tsclockserver command to synchronize the time with an external NTP
server.
Customize the switch name and chassis
name.
Refer to Setting the date and time on page 53 for more information.
• Use the swicthname command to change the default switch name.
• Use the chassisname command to change the default chassis name.
Refer to Customizing the chassis name and switch name on page 55 for more
information.
Establish an Ethernet connection. By establishing an Ethernet connection, you can complete the device configuration
using a serial session, Telnet, or management application, such as IBM Network
Advisor. Refer to Establishing an Ethernet connection on page 56.
Optional: Configure the DNS service. Use the dnsconfig command to create DNS server entries. Refer to the Fabric OS
Administrator's Guide.
Optional: Customize the domain ID. Use the configure command to change the domain ID (default ID is 1). Refer to
Setting the domain ID on page 56 for more information.
22 Hardware Installation Guide