IBM s-series User manual

IBM Ethernet Switch s-series
Installation and User Guide
Service information: 4003-S08, -S16
GC27-2243-00
򔻐򗗠򙳰

IBM Ethernet Switch s-series
Installation and User Guide
Service information: 4003-S08, -S16
GC27-2243-00
򔻐򗗠򙳰

The following paragraph does not apply to any country (or region) where such provisions are inconsistent with local
law.
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION ″AS IS″WITHOUT
WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states (or regions) do
not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply
to you.
Order publications through your IBM representative or the IBM branch office serving your locality.
© Copyright International Business Machines Corporation 2009.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Figures ............................ix
Tables ............................xi
Preface ...........................xiii
Safety notices .........................xiii
Safety notices and labels ....................xiii
Notes ..........................xiv
Attention notices ......................xiv
Caution notices.......................xiv
Danger notices .......................xv
Safety labels .......................xviii
Rack safety .........................xx
Rack installation ......................xx
Rack relocation (19″rack)...................xxi
Product recycling and disposal ...................xxi
Product documents .......................xxii
Software documents ......................xxii
Getting help .........................xxiii
Taiwan Contact Information ...................xxiii
How to send your comments ...................xxiv
Chapter 1. About This Guide ...................1
Audience ...........................1
Nomenclature ..........................1
Chapter 2. Product Overview ...................3
Hardware benefits ........................3
POE port density ........................4
Supported configurations......................4
Software features........................4
Power over Ethernet (POE) applications ................5
Support for IPv6 modules .....................5
IPv6 hardware support guidelines ..................5
Hardware features ........................5
B08S .............................6
B16S .............................7
Management modules.......................9
B08S and B16S management modules ...............10
10/100/1000 GbE copper port on the B08S and B16S management
modules ........................11
10-GbE ports on the B08S and B16S 2-port 10-GbE management modules 11
LEDs on the B08S and B16S management modules .........11
Console port........................12
Reset button........................12
Switch fabric modules ......................12
LEDs on the switch fabric module .................13
Interface modules ........................13
Hot swap support .......................13
24-port 10/100/1000 Mbps Ethernet RJ45 copper interface module.....14
LEDs for 24-port 10/100/1000 Mbps Ethernet RJ45 copper interface
module .........................14
24-port 100/1000 Mbps Ethernet hybrid fiber (SFP) interface module ....15
© Copyright IBM Corp. 2009 iii

Support for 100Base-FX on the 100/1000 interface module ......16
2-port 10-Gigabit Ethernet interface modules .............16
LEDs for 2-port 10-Gigabit Ethernet module ............17
Network interfaces .......................17
Port regions ..........................17
Power supplies .........................18
About replacement power supplies ................21
Power supply LEDs ......................22
About redundant power supplies and power supply failure ........23
What happens when one or more system power supplies fail ......23
What happens when one or more POE power supplies fail.......23
Cooling system .........................24
Built-in mounting brackets .....................25
Layer 3 routing protocol table sizes .................25
Chapter 3. Installing the Chassis .................27
Summary of installation tasks ...................27
Unpacking a system .......................28
Installation precautions ......................28
General precautions .......................28
Power precautions and warnings ..................29
Preparing the installation site....................29
Cabling infrastructure .....................29
Installation location ......................29
Removing extra shipment screws (B08S only) ............29
Installing a chassis in a rack ....................30
Installing mounting brackets on the B16S ...............32
Removing the slot panels .....................32
Installing the management and interface modules ............33
Attaching a management station ..................37
Attaching a PC or terminal to the console port or 10/100/1000 copper port . . . 37
Attaching a switch to an Ethernet port ................38
Powering on the system .....................38
Connecting AC power to the chassis .................38
Verifying proper operation .....................40
Observing the LEDs .......................40
Displaying the module status....................42
Chapter 4. Connecting Network Devices and Checking Connectivity ...45
Assigning permanent passwords ..................45
Configuring IP addresses .....................46
IPv4 devices..........................46
IPv4 devices running layer 3 software ...............46
IPv4 devices running layer 2 software ...............47
IPv6 devices..........................48
IPv6 devices running Layer 3 software ...............48
IPv6 devices running Layer 2 software ...............49
Connecting network devices ....................50
Cable specifications .......................50
Connecting to Ethernet or fast Ethernet hubs ..............50
Connecting to workstations, servers, or routers .............51
Connecting a network device to a fiber port on the device .........52
Installing a fiber optic module ..................52
Cabling a fiber optic module ...................52
Cleaning fiber optic modules ...................53
Automatic MDI/MDIX detection ...................53
iv Ethernet Switch s-series Installation and User Guide

Using a CX4 transceiver .....................53
Testing network connectivity ....................54
Pinging an IP address .....................54
Observing LEDs .......................54
Tracing a route ........................55
Troubleshooting network connections................56
Digital optical monitoring .....................56
Chapter 5. Managing the Chassis and Modules ............57
Displaying chassis status and temperature readings ...........57
Managing the cooling system ...................61
Configuring the cooling system ..................61
Thermal planes.......................61
Fan speed modes ......................61
Changing temperature thresholds for thermal planes and fan speeds on
the on the B16S .....................62
Changing temperature thresholds for thermal planes and fan speeds on
the B08S ........................64
Shutdown warning messages .................67
Changing the temperature polling interval .............68
Manually setting the fan speed .................68
Monitoring the cooling system ...................68
Displaying the temperature ...................68
Displaying fan status and speed .................69
Displaying temperature warnings .................69
Displaying the syslog configuration and static and dynamic buffers ......70
Static and dynamic buffers ...................70
Syslog messages for PCI (hardware) errors ..............71
Managing the switch fabric modules .................71
Displaying management module CPU usage ..............72
Removing MAC address entries ..................72
Chapter 6. Using a redundant management module ..........75
How management module redundancy works .............75
Management module redundancy overview ..............75
Management module switchover ..................76
Unavailable active module....................76
Manual switchover ......................76
Removal and replacement of a management module ..........76
Removal and replacement of an active management module ......76
Removal and replacement of a standby management module......77
Switchover implications ......................77
Management sessions .....................77
Syslog and SNMP traps ....................78
MAC address changes .....................78
Management module redundancy configuration .............78
Changing the default active chassis slot................78
Managing management module redundancy ..............78
File synchronization between the active and standby management modules 79
Manually switching over to the standby management module ........80
Rebooting the active and standby management modules .........81
Hitless management support ....................81
What happens during a hitless OS upgrade and hitless switchover ......81
How a hitless OS upgrade and hitless switchover impacts system functions 82
Syslog message for hitless OS upgrade and hitless switchover .......83
Layer 2 hitless switchover .....................83
Contents v

Executing a Layer 2 hitless switchover ...............83
Layer 2 hitless OS upgrade ....................84
Configuration considerations ...................85
Configuration steps ......................86
Loading the software onto the switch ................86
Executing the hitless-reload command ...............86
Verifying the new software image .................87
Monitoring management module redundancy ..............87
Determining management module status ...............87
Status LED .........................87
Software ..........................87
Displaying temperature information .................88
Displaying switchover information ..................88
Chapter 7. Maintaining the hardware ................91
Hardware maintenance schedule ..................91
Cleaning the fiber optic connectors .................91
Replacing a management module ..................91
Installation precautions ......................91
Removing a management module ..................92
Installing a new management module ................92
Replacing a switch fabric module ..................94
Removing a switch fabric module .................94
Installing a new switch fabric module ................95
Replacing an interface module ...................97
Precautions .........................97
Before removing an interface module................97
Removing an interface module ..................98
Installing a new interface module .................98
Configuring a LAN/WAN PHY interface module ............101
Enabling the LAN/WAN PHY module ...............101
Setting the WAN PHY mode ..................101
Disabling and re-enabling an interface module .............101
Installing or replacing a POE daughter card ..............102
Replacing a copper or fiber optic module ...............105
Removing a copper or fiber optic module ...............105
Installing a new copper or fiber optic module .............106
Cabling a fiber optic module ...................106
Installing or replacing a power supply ................107
Determining which power supply failed................107
Removing an AC power supply ..................108
Removing a replacement power supply ..............108
Removing an original power supply ................109
Installing a new power supply ...................110
Installing a replacement power supply ...............110
Installing an original power supply ................111
Connecting AC power to the chassis ................112
Verifying proper operation of the power supply .............114
Displaying the status of the power supplies ..............115
Replacing the B08S fan tray ...................116
Replacing the B16S fan assemblies .................117
Upgrading the device to run Layer 3 software .............119
Chapter 8. Hardware specifications ................121
Physical dimensions ......................121
Environmental considerations ...................121
vi Ethernet Switch s-series Installation and User Guide

Cooling ...........................122
Fan tray for the B08S .....................122
Cooling system on the B16S ..................123
Maximum power consumption ...................124
Power source interruptions ....................125
Pinouts and signalling ......................125
Serial (console) port pinouts ..................125
10/100 and Gigabit port pinouts .................126
Cable specifications ......................127
Power cords .........................128
Power supply specifications....................129
Physical dimensions and weight of power supplies ...........129
Environmental considerations for power supplies ............129
Electrical specifications .....................130
Input connector and plug.....................131
Notices ...........................133
Trademarks..........................134
Electronic emission notices ...................135
Federal Communications Commission (FCC) Class A statement ......135
Industry Canada Class A emission compliance statement .........135
Avis de conformité à la réglementation d’Industrie Canada ........135
European Union (EU) electromagnetic compatibility directive .......135
Germany electromagnetic compatibility directive ............136
People’s Republic of China Class A electronic emission statement .....137
Taiwan Class A warning statement .................137
Japan VCCI Class A ITE electronic emission statement .........137
Korea Class A electronic emission statement .............137
Index ............................139
Contents vii

viii Ethernet Switch s-series Installation and User Guide

Figures
1. B08S ...................................6
2. B08S slots .................................7
3. B16S ...................................8
4. B16S chassis slots ..............................9
5. B08S and B16S management module with no ports ..................11
6. B08S and B16S management module with two 10-GbE ports ..............11
7. B08S and B16S switch fabric module .......................13
8. IPv4 24-port Gigabit Ethernet copper module front panel ................14
9. IPv4 100/1000 Hybrid Fiber interface module ....................15
10. IPv4 2-port 10-Gigabit Ethernet module’s front panel..................16
11. Power supply placement in the B08S .......................20
12. Power supply placement in the B16S .......................20
13. Comparison of 90-240 VAC SYS power supplies ...................21
14. Side-by-Side Comparison of 90-240 VAC POE power supplies ..............21
15. Replacement power supplies. ..........................21
16. Removing the extra screws used for shipment ....................30
17. Positioning two of four mounting screws in a rack. ..................31
18. Front-mount-rack-installation into chassis ......................31
19. Installing the mounting brackets on an B16S ....................32
20. Installing a management module in the B08S ....................34
21. Installing a management module in the B16S chassis .................35
22. Installing an interface module in the B08S .....................36
23. Installing an interface module in the B16S .....................36
24. Connecting AC power to a B08S .........................39
25. Connecting AC power cords to a B16S chassis....................40
26. UTP crossover cable .............................51
27. Cat-5 crossover cable for 1000Base-T .......................51
28. CX4 transceiver ...............................53
29. CX4 transceiver cable .............................54
30. Fan speeds and temperature thresholds on the B16S .................63
31. Fan speeds and temperature thresholds on the B08S .................65
32. Active and standby management module file synchronization ..............80
33. Installing a management module in the B08S ....................93
34. Installing a management module in the B16S ....................94
35. Installing a switch fabric module in the B08S ....................96
36. Installing a switch fabric module in the B16S ....................96
37. Installing an interface module in the B08S .....................100
38. Installing an interface module in the B16S .....................100
39. Connector slots for POE daughter card ......................103
40. POE daughter card key detail..........................104
41. Installing the POE daughter card ........................104
42. Bail latch mechanism on the SFP ........................105
43. Movement of the bail latch ...........................106
44. Placement of the power supply in the B08S ....................107
45. Placement of the power supply in the B16S ....................108
46. Replacement AC power supply .........................108
47. Original power supplies ............................109
48. Power supply removal ............................109
49. Replacement AC power supply .........................110
50. Installing a replacement power supply.......................111
51. Original power supplies ............................112
52. Location of AC power connection on B08S .....................113
53. Attaching AC power cords to a B16S .......................114
© Copyright IBM Corp. 2009 ix

54. Location of shipping screws to be removed.....................116
55. Removing the fan tray ............................117
56. Removing and replacing a B16S fan assembly. ...................118
57. Internal Airflow in the B08S ..........................122
58. Internal airflow in the B16S ..........................124
59. Serial port pin and signalling details .......................126
60. Console Port Pin Assignments Showing Cable Connection Options to a Terminal or PC ....126
61. Pin assignment and signalling for 10/100Base-TX and 1000Base-T ports..........127
62. AC power cable plug and input connector for 90-240 VAC SYS and 90-240 VAC POE power
supplies..................................131
63. AC power cable plug and input connector - male and female ..............132
xEthernet Switch s-series Installation and User Guide

Tables
1. Comparable IBM and Brocade products. ......................xxii
2. Maximum number of POE class 3 (15.4W) ports per power supply .............4
3. Configurations supported on the devices ......................4
4. Details regarding the management modules for the B08S and B16S ............10
5. LED status information for B08S and B16S management modules ............12
6. Front panel switch fabric LED status .......................13
7. Interface modules ..............................13
8. LEDs for 10/100/1000 copper ports ........................15
9. LED on the 2-port 10-Gigabit Ethernet module ....................17
10. Network interfaces ..............................17
11. Power supplies supported in the devices ......................18
12. LED status and meanings ...........................22
13. Installation tasks for your switch and locations of more detailed information .........27
14. Module Installation ..............................33
15. Desired and possible abnormal LED states after system power-on ............41
16. Connecting network devices...........................45
17. Network Connection-Related LED States ......................55
18. Chassis status and temperature Information .....................59
19. Temperature thresholds for each thermal plane and fan speed in the B16S .........64
20. Fan speed, temperature thresholds and fan noise levels on the B08S ...........65
21. Acceptable settings for low temperature thresholds and fan speed ............66
22. Unacceptable settings for low temperature thresholds and high fan speed ..........67
23. Information displayed regarding fan status .....................69
24. Syslog display configuration information ......................70
25. Hitless OS upgrade and hitless switchover impacts ..................82
26. Information regarding Layer 2 hitless OS upgrades ..................84
27. Power supply LED operating status .......................115
28. Physical dimensions and weight for each chassis and devices .............121
29. Environmental Conditions for the Chassis .....................121
30. B16S Fan Operating Noise ..........................123
31. Maximum power consumption for devices .....................124
32. Protection against power surges and drops.....................125
33. Cable length summary table ..........................127
34. Physical dimensions and weight of the power supplies ................129
35. Environmental Considerations for Power Supplies ..................129
36. Electrical specifications for power supplies .....................130
37. AC Input connector properties for power supplies ..................131
© Copyright IBM Corp. 2009 xi

xii Ethernet Switch s-series Installation and User Guide

Preface
This publication is provided for use with your particular IBM®Ethernet switch or
router product or product family. It provides information on installing, configuring,
maintaining, and using your product. Please retain this publication and the
accompanying documentation CD in a convenient location for easy reference and
future use.
The following sections provide information on safety and environmental
considerations, related publications and resources, as well as how to get
assistance, and how to send IBM feedback on this publication.
v“Safety notices”
v“Product recycling and disposal” on page xxi
v“Product documents” on page xxii
v“Getting help” on page xxiii
v“How to send your comments” on page xxiv
Safety notices
This section contains important safety information that should be read before
starting any installation or service procedure.
v“Safety notices and labels,” including:
– “Notes” on page xiv
– “Attention notices” on page xiv
– “Caution notices” on page xiv
– “Danger notices” on page xv
– “Safety labels” on page xviii
v“Rack safety” on page xx
Safety notices and labels
When using this product, observe the danger, caution, and attention notices
contained in this guide. The notices are accompanied by symbols that represent the
severity of the safety condition. The danger and caution notices are listed in
numerical order based on their IDs, which are displayed in parentheses, for
example (D004), at the end of each notice. Use this ID to locate the translation of
these danger and caution notices in the IBM Systems Safety Notices (G229–9054)
publication, which is on the product documentation CD that accompanies this
product.
The following notices and statements are used in IBM documents. They are listed
below in order of increasing severity of potential hazards. Follow the links for more
detailed descriptions and examples of the notes, attention notices, caution, and
danger notices in the sections that follow.
v“Notes” on page xiv: These notices provide important tips, guidance, or advice.
v“Attention notices” on page xiv: These notices indicate potential damage to
programs, devices, or data.
v“Caution notices” on page xiv: These statements indicate situations that can
be potentially hazardous to you.
© Copyright IBM Corp. 2009 xiii

v“Danger notices” on page xv: These statements indicate situations that can be
potentially lethal or extremely hazardous to you. Safety labels are also attached
directly to products to warn of these situations.
vIn addition to these notices, “Safety labels” on page xviii may be attached to the
product to warn of potential hazards.
Notes
Notes can provide tips, guidance, suggestions, or advice for simplifying procedures,
clarifying information, or avoiding potential problems. A sample note follows.
Note: The POE LEDs work only when POE is enabled on your device.
Attention notices
An attention notice indicates the possibility of damage to a program, device, or
system, or to data. An exclamation point symbol may accompany an attention
notice, but is not required. A sample attention notice follows:
Attention: Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can
damage the cable. Tie wraps are not recommended for optical cables because they
can be easily overtightened, causing damage to the cable.
ESD precautions: Attention: Many of the field replaceable units (FRUs) are
sensitive to electrostatic discharge (ESD), and can potentially be damaged by
improper handling. Wear a wrist grounding strap connected to chassis ground (if the
device is plugged in) or a bench ground. Store all ESD-sensitive components in
antistatic packaging.
Caution notices
A caution notice calls attention to a situation that is potentially hazardous to people
because of some existing condition. A caution notice can be accompanied by
different symbols, as in the examples below:
If the symbol
is... It means....
A hazardous electrical condition with less severity than electrical danger.
A generally hazardous condition not represented by other safety symbols.
svc00169
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
A specification of product weight that requires safe lifting practices. The
weight range of the product is listed below the graphic, and the wording
of the caution varies, depending on the weight of the device.
P/N 18P5850-B
SJ000752
A potential hazard of pinching the hand or other body parts between
parts.
A hazardous condition due to moving parts nearby.
xiv Ethernet Switch s-series Installation and User Guide

If the symbol
is... It means....
A hazardous condition due to the use of a laser in the product. Laser
symbols are always accompanied by the classification of the laser as
defined by the U.S. Department of Health and Human Services (for
example, Class I, Class II, and so forth).
Read and comply with the following caution notices before installing or servicing this
device.
CAUTION:
Energy hazard present. Shorting may result in system outage and
possible physical injury. Remove all metallic jewelry before
servicing. (C001)
svc00168
32-55 kg (70.5-121.2 lbs)
32-55 kg
(70.5-121.2 lb)
CAUTION:
The weight of this part or unit is between 32 and 55 kg (70.5 and
121.2 lb). It takes three persons to safely lift this part or unit. (C010)
svc00169
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It takes
specially trained persons, a lifting device, or both to safely lift this
part or unit. (C011)
CAUTION:
This product is equipped with a 3-wire (two conductors and ground)
power cable and plug. Use this power cable with a properly
grounded electrical outlet to avoid electrical shock. (C018)
CAUTION:
Servicing of this product or unit is to be performed by trained
service personnel only. (C032)
Danger notices
A danger notice calls attention to a situation that is potentially lethal or extremely
hazardous to people. A lightning bolt symbol accompanies a danger notice to
represent a dangerous electrical condition. Read and comply with the following
danger notices before installing or servicing this device.
DANGER
To prevent a possible shock from touching two surfaces with
different protective ground (earth), use one hand, when possible,
to connect or disconnect signal cables. (D001)
Preface xv

DANGER
Overloading a branch circuit is potentially a fire hazard and a
shock hazard under certain conditions. To avoid these hazards,
ensure that your system electrical requirements do not exceed
branch circuit protection requirements. Refer to the information
that is provided with your device or the power rating label for
electrical specifications. (D002)
DANGER
If the receptacle has a metal shell, do not touch the shell until
you have completed the voltage and grounding checks. Improper
wiring or grounding could place dangerous voltage on the metal
shell. If any of the conditions are not as described, STOP. Ensure
the improper voltage or impedance conditions are corrected
before proceeding. (D003)
DANGER
An electrical outlet that is not correctly wired could place
hazardous voltage on metal parts of the system or the devices
that attach to the system. It is the responsibility of the customer
to ensure that the outlet is correctly wired and grounded to
prevent an electrical shock. (D004)
The following general electrical danger notice provides instructions on how to avoid
shock hazards when servicing equipment. Unless instructed otherwise, follow the
procedures in this danger notice.
xvi Ethernet Switch s-series Installation and User Guide

DANGER
When working on or around the system, observe the following
precautions:
Electrical voltage and current from power, telephone, and
communication cables are hazardous. To avoid a shock hazard:
vConnect power to this unit only with the IBM provided power
cord. Do not use the IBM provided power cord for any other
product.
vDo not open or service any power supply assembly.
vDo not connect or disconnect any cables or perform
installation, maintenance, or reconfiguration of this product
during an electrical storm.
vThe product might be equipped with multiple power cords. To
remove all hazardous voltages, disconnect all power cords.
vConnect all power cords to a properly wired and grounded
electrical outlet. Ensure that the outlet supplies proper voltage
and phase rotation according to the system rating plate.
vConnect any equipment that will be attached to this product to
properly wired outlets.
vWhen possible, use one hand only to connect or disconnect
signal cables.
vNever turn on any equipment when there is evidence of fire,
water, or structural damage.
vDisconnect the attached power cords, telecommunications
systems, networks, and modems before you open the device
covers, unless instructed otherwise in the installation and
configuration procedures.
vConnect and disconnect cables as described below when
installing, moving, or opening covers on this product or
attached devices.
To Disconnect:
1. Turn off everything (unless instructed otherwise).
2. Remove the power cords from the outlets.
3. Remove the signal cables from the connectors.
4. Remove all cables from the devices.
To Connect:
1. Turn off everything (unless instructed otherwise).
2. Attach all cables to the devices.
3. Attach the signal cables to the connectors.
4. Attach the power cords to the outlets.
5. Turn on the devices.
(D005)
If the weight of the product is greater than 227 kg (500 lb), the following statement
and notice apply. This could apply if multiple products are installed in a single
cabinet, and that cabinet and products needs to be moved.
Preface xvii

Delivery and subsequent transportation of the equipment: The customer
should prepare his environment to accept the new product based on the installation
planning information provided, with assistance from an IBM Installation Planning
Representative (IPR) or IBM authorized service provider. In anticipation of the
equipment delivery, the final installation site should be prepared in advance such
that professional movers/riggers can transport the equipment to the final installation
site within the computer room. If for some reason, this is not possible at the time of
delivery, the customer will need to make arrangements to have professional
movers/riggers return to finish the transportation at a later date. Only professional
movers/riggers should transport the equipment. The IBM authorized service provider
will only perform minimal frame repositioning within the computer room, as needed,
to perform required service actions. The customer is also responsible for using
professional movers/riggers in the case of equipment relocation or disposal.
>(>)500 lbs. 227 kg.
a69i0333
DANGER
Heavy equipment—personal injury or equipment damage might
result if mishandled. (D006)
Safety labels
As an added precaution, safety labels are often installed directly on products or
product components to warn of potential hazards. These can be either danger or
caution notices, depending upon the level of the hazard.
The actual product safety labels may differ from these sample safety labels:
DANGER
Hazardous voltage, current, or energy levels are present inside
any component that has this label attached. Do not open any
cover or barrier that contains this label. (L001)
DANGER
Rack-mounted devices are not to be used as a shelf or work
space. (L002)
DANGER
Multiple power cords. The product might be equipped with
multiple power cords. To remove all hazardous voltages,
disconnect all power cords. (L003)
xviii Ethernet Switch s-series Installation and User Guide