IBM 2109 - SAN Fibre Channel Switch Model S16 User manual

IBM SAN Fibre Channel Switch
2109 Model S16 Installation and Service
Guide
The IBM License Agreement for Machine Code is included
in this book. Carefully read the agreement. By using this
product you agree to abide by the termsof this agreement
and applicable Copyright Laws.
SC26-7352-01

IBMSANFibreChannelSwitch
2109 Model S16 Installation and Service
Guide
SC26-7352-01
IBM

Note:
Before using this information and the product it supports, read the information in “Safety and environmental notices” on
page xi and “Notices” on page 131.
Second Edition (December 2000)
This edition replaces SC26-7352-00.
Publications are not stocked at the address given below. If you want additional IBM publications, ask your IBM
representative or write to the IBM branch office serving your locality.
A form for your comments is provided at the back of this publication. If the form has been removed, address your
comments to:
International Business Machines Corporation
RCF Processing Department
Dept. G26/Bldg. 050-3
5600 Cottle Road
San Jose, CA 95193-0001
U.S.A.
FAX: [phone]
You can also send your comments electronically to: [email protected]
When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any
way it believes appropriate without incurring any obligation to you.
© Copyright International Business Machines Corporation 1999, 2000. All rights reserved.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Figures ...........................vii
Tables ............................ix
Safety and environmental notices .................xi
Translated safety notices .....................xi
Disposing of products.......................xi
About this book ........................xiii
Who should use this book.....................xiii
Where to start ........................xiii
Limited vocabulary ......................xiii
Ordering publications ......................xiii
Product library ........................xiii
Related publications ......................xiv
Web sites..........................xiv
Chapter 1. Introduction......................1
Switch features .........................1
Performance .........................2
Manageability .........................2
System components .......................2
GBICs ...........................2
Power supply .........................3
Fibre-channel cable connections ..................4
Front panel..........................5
Diagnostics overview .......................7
Verifying a power-on self-test (POST) ................7
Running diagnostics ......................7
Loop (FL) connections .....................8
Chapter 2. Customer planning ...................9
Chapter 3. Installing the switch ..................19
Pre-installation checklist .....................19
Installing the switch .......................20
Tabletop installation ......................20
Rack-mount installation.....................20
Installing the optional power supply .................24
Installing GBICs ........................25
Setting the IP address ......................26
Setting the IP address using the Ethernet port ............27
Setting the IP address from the front panel .............28
Switch installation verification ..................31
Code upgrade procedure .....................31
Upgrade procedure .......................31
Downloading firmware from a UNIX
®
host ..............31
Downloading firmware using a Microsoft
®
Windows NT operating system 32
Chapter 4. Maintenance action plans ................33
Problem determination start map ..................33
System reported error .....................33
Service reference table ......................35
© Copyright IBM Corp. 1999, 2000 iii
||

Action codes and recommended actions ..............35
Chapter 5. Replacing FRUs....................45
Parts catalog .........................45
Replacing the power supply ....................45
Tools that are required .....................46
Removing a power supply....................46
Installing a power supply ....................47
Replacing a GBIC module.....................47
Tools that are required .....................47
Removing a GBIC module....................47
Installing a GBIC module ....................47
Replacing a fan assembly .....................48
Tools that are required .....................48
Removing a fan assembly....................48
Installing a fan assembly ....................49
Replacing the system board assembly ................49
Tools that are required .....................49
Removing the system board ...................49
Installing the system board ...................50
Replacing the chassis with touchpad .................50
Tools that are required .....................50
Removing the old chassis ....................51
Installing the new chassis ....................51
Verifying switch repair ......................51
Verifying a repair that did not require turning the switch off........52
Verifying a repair that required turning the switch off ..........52
Chapter 6. Optional features ...................53
Fabric Watch .........................53
Threshold behavior models ...................54
Installing Fabric Watch .....................55
Installing Fabric Watch through Telnet ...............55
Installing Fabric Watch through the IBM StorWatch Specialist.......56
Fabric Watch overview .....................56
Telnet commands overview ...................57
Telnet commands .......................58
Remote Switch .........................62
Introducing the Remote Switch ..................62
Installing the Remote Switch ...................62
Installing through Telnet.....................63
Installing through the IBM StorWatch Specialist ............63
Extended Fabrics ........................64
Introducing Extended Fabrics ..................64
Installing Extended Fabrics ...................64
Installing through Telnet.....................64
Installing through the IBM StorWatch Specialist ............65
Using Extended Fabrics ....................65
Configuring Extended Fabrics ..................65
Accessing through the Telnet interface ...............66
Chapter 7. Management tools ...................69
Switch management methods ...................69
Hardware setup for switch management ...............70
Setting switch IP address using the front panel ............71
Setting the IP address using the Ethernet port ............71
iv IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide
||||||||||||||||||||||||||||||||||||||||||||
||||||||

Setting the IP address .....................73
Managing with Telnet ......................73
Default user name ......................73
Changing passwords......................74
Managing with SNMP ......................74
SNMP transports .......................76
Managing using the management server ...............78
Using the management server ..................79
syslog daemon .........................79
Introduction .........................79
syslogd support .......................80
Error message format .....................80
Message classification .....................81
Power-on self-test (POST).....................82
Chapter 8. Zoning overview ...................85
Appendix A. Specifications....................87
General specifications ......................87
Fabric management specifications..................87
Optical port specifications .....................88
Environmental specifications ....................88
Power supply specifications ....................89
Appendix B. Diagnostics.....................91
Diagnostic overview .......................91
Isolating a system fault .....................91
Removing power .......................91
Service action for error messages .................91
POST tests .........................91
Diagnostic tests ........................92
Test menu .........................92
Running diagnostics from the front panel ..............92
Front panel switch menus ....................94
Running diagnostics using Telnet.................101
Appendix C. Error messages ..................117
System error message formats ..................117
Diagnostic error message formats .................118
Error message numbers .....................119
Repair action code meanings for diagnostic error messages........121
Diagnostic error messages ....................122
System error messages .....................125
Notices ...........................131
Trademarks..........................131
Electronic emission statements ..................132
Federal Communications Commission (FCC) statement ........132
Industry Canada compliance statement ..............132
European Community compliance statement ............132
Germany compliance statement .................133
Japanese Voluntary Control Council for Interference (VCCI) class 1
statement ........................134
Korean Government Ministry of Communication (MOC) statement ....134
Taiwan class A compliance statement ...............134
IBM license agreement for Machine Code ..............134
Contents v
||||||||
||||
||||||||||||||

Statement of limited warranty ...................135
Production status ......................135
IBM warranty for Machines ...................135
Warranty service.......................136
Extent of warranty ......................136
Limitation of liability......................137
Glossary ..........................139
Index ............................145
vi IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide
||

Figures
1. Front panel of the 2109 Model S16 Switch ......................1
2. Short wavelength (SWL) laser fiber-optic GBIC module (P/N and labeling vary) ........3
3. Long wavelength (LWL) laser fiber-optic GBIC module (P/N and labeling vary) ........3
4. Power supplies ................................4
5. Dual SC fiber-optic plug connector.........................5
6. Front panel functionality.............................5
7. Moving slide ................................22
8. Mounting the moving portion of slide and locking ears to the switch ............22
9. Mounting the fixed portion of the rail and the locking ears to the rack ...........23
10. Inserting slides into the rack rails .........................24
11. 2109 model S16 with two power supplies ......................25
12. GBIC ...................................26
13. GBIC swing handle ..............................26
14. Ethernet port connector ............................27
15. Front panel - operator display and control buttons...................28
16. Front panel of the 2109 Model S16 Switch .....................33
17. Generated Telnet messages when a power supply is turned off and removed ........46
18. Power supply handle .............................47
19. IBM GBIC module ..............................47
20. Fan assembly ................................48
21. System board assembly ............................49
22. Chassis with touchpad.............................51
23. Example of range threshold: temperature (Celsius) ..................54
24. Example of rising and falling threshold: Error rate ...................55
25. Methods for managing the switch.........................70
26. Front panel — operator display and control buttons ..................71
27. Front panel of the 2109 Model S16 Switch .....................72
28. MIB tree ..................................75
29. Example of a no memory error generated by the shell .................81
30. syslogd support ...............................82
31. Example syslog configuration file entry.......................82
32. Example syslog configuration file entry.......................82
33. A fabric with three zones ............................86
34. Front panel functionality ............................93
35. Select menu ................................93
36. Menu hierarchy ...............................94
37. Switch setup to run crossPortTest.........................98
38. System memory test .............................98
39. ramTest ..................................99
40. portLoopbackTest command example .......................99
41. portRegTest command example .........................99
42. Push button command example .........................100
43. spinSilk command example ..........................100
44. Switch offline command example ........................101
45. Switch online command example ........................101
46. camTest command example ..........................102
47. centralMemoryTest command example ......................103
48. cmemRetentionTest command example ......................103
49. cmiTest command example ..........................103
50. crossPortTest command example ........................106
51. diagClearError command example ........................106
52. diagDisablePost command example .......................107
53. diagEnablePost command example .......................107
© Copyright IBM Corp. 1999, 2000 vii
||||||||||||

54. diagShow command example..........................108
55. portLoopbackTest command example.......................109
56. portRegTest command example .........................110
57. ramTest command example ..........................110
58. setGbicMode 1 command example ........................111
59. setGbicMode 0 command example ........................111
60. sramRetentionTest command example ......................114
61. supportShow command example ........................115
62. errShow command example ..........................118
viii IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide
||

Tables
1. Cabling connections ..............................4
2. Control buttons ................................5
3. Front panel LED status indicators .........................6
4. Offline and Online tests .............................7
5. Offline and online test .............................8
6. Example of a planning worksheet for a 2109 switch ..................9
7. Blank of a planning worksheet for a 2109 switch ...................11
8. Example of a configuration worksheet for a 2109 switch ................12
9. Blank of a port configuration worksheet for a 2109 switch ................13
10. Example of a zone definitions worksheet ......................14
11. Blank of a zone definitions worksheet .......................15
12. Zone configuration worksheet example.......................16
13. Blank of a zone configuration worksheet ......................17
14. Pre-installation checklist ............................19
15. Control buttons ...............................28
16. Service reference table ............................35
17. Action code and recommended actions ......................35
18. Field replaceable units (FRUs) list ........................45
19. Fabric Watch Telnet commands .........................57
20. Comparison of management access methods ....................69
21. Default user name ..............................73
22.
syslogd message classifications .........................81
23. Switch specifications .............................87
24. Fabric management specifications ........................87
25. Environmental specifications ..........................88
26. Power supply requirements ...........................89
27. POST tests .................................91
28. Control buttons ...............................93
29. Offline and online diagnostic tests ........................94
30. centralMemoryTest example...........................95
31. cmemRetention test example ..........................96
32. cmiTest example ...............................96
33. Offline and online diagnostic tests ........................102
34. diagShow command field descriptions ......................108
35. portLoopbackTest command field descriptions....................109
36. spinSilk command example 1 ..........................112
37. spinsilk command example 2 ..........................113
38. Probable failure actions ............................118
39. Error message code defined ..........................119
40. Action codes and recommended actions......................121
41. Diagnostic error messages...........................122
42. System error messages ............................125
© Copyright IBM Corp. 1999, 2000 ix
||||||||||||||||
||||||
||||||
||||||||||

xIBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide

Safety and environmental notices
Safety notices are printed throughout this manual. Danger notices warn you of
conditions or procedures that can result in death or severe personal injury. Caution
notices warn you of conditions or procedures that can cause personal injury that is
neither lethal nor extremely hazardous. Attention notices warn you of conditions or
procedures that can cause damage to machines, equipment, or programs.
Translated safety notices
The translation of the safety notices in this manual are contained in a separate
manual. See the
IBM External Devices Safety Information Manual , SA26-7003, for a
translation of any danger and caution notices.
Disposing of products
This unit may contain batteries. Remove and discard these batteries, or recycle
them, according to local regulations.
© Copyright IBM Corp. 1999, 2000 xi

xii IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide

About this book
This book describes how to install and maintain the IBM SAN Fibre Channel Switch
2109 Model S16.
Who should use this book
This book is intended for trained service representatives and service providers who
act as the primary level of field hardware service support to help solve and
diagnose hardware problems on the IBM SAN Fibre Channel Switch 2109 Model
S16.
This book also assists the customer in planning the installation of the 2109 Model
S16 switch.
“Chapter 2. Customer planning” on page 9 contains the customer planning
worksheets that are required to be filled out before installing the 2109 switches.
Before using this book, you must know how to service the switch hardware, and
how to analyze, isolate, report, and resolve problems. You must also know how to
safely work with electrical components. Throughout this book, the term “switch”
applies to any IBM 2109 switch, unless the reference is to a specific model.
Where to start When performing any service action on the switch, follow the directions given in
“Chapter 4. Maintenance action plans” on page 33. This ensures that you use the
correct remove, replace, or repair procedures for this machine, including the correct
procedures to turn the power on and off. Failure to follow these instructions can
cause damage to the machine.
Limited vocabulary
This book uses a specific range of words so that the text can be understood by IBM
service support representatives in countries where English is not the primary
language.
Ordering publications
All of the publications listed in the switch product library are shipped as appropriate
with their respective switches. You can also order additional copies of each
publication.
Product libraryThe IBM 2109 Model S16 is an IBM SAN Fibre Channel Switch product. See the
following publications for more information about the switch:
v
IBM SAN Fibre Channel Switch 2109 Model S16 User’s Guide , SC26-7351
This book introduces the IBM 2109 Model S16 Switch, and its features. It also
provides information about using the IBM StorWatch
™
SAN Fibre Channel Switch
Specialist, setting up zoning, and methods for managing the IBM 2109 Model
S16 Switch remotely.
v
IBM SAN Fibre Channel Switch 2109 Model S16 Installation and Service Guide ,
SC26-7352.
© Copyright IBM Corp. 1999, 2000 xiii
|
|

This book introduces the product and lists the features you can order. It also
provides procedures for installing, configuring, and servicing the IBM 2109 Model
S16 Switch.
v
IBM External Devices Safety Information , SA26-7003.
This book provides translations of the Danger and Caution notices used in IBM
2109 switch publications.
Related publications
v Electrical Safety for IBM Customer Engineers , S229-8124
v Fibre Channel Standards
Web sites For additional information about storage products, see our Web site at:
www.ibm.com/storage/fcswitch
For detailed information about the fibre-channel standards, see the fibre-channel
association Web site at:
www.fibrechannel.com
xiv IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide

Chapter 1. Introduction
The IBM SAN Fibre Channel Switch 2109 Model S16 is a 16-port, fibre-channel,
switch. The IBM 2109 Model S16 Switch consists of a system board with
connectors for supporting up to 16 ports, and a fabric operating system for creating
and managing a fabric. A
fabric is an active, intelligent, nonshared interconnection
scheme for a fibre channel.
Figure 1 shows the front view of the 2109 Model S16 Switch. Ports are numbered
sequentially starting with zero for the left-most port. The switch faceplate includes a
silk screen imprint of the port numbers. Up to two power supplies are supported;
these are shown to the left and right of the switch ports in Figure 1.
Switch features
The switch is a high-performance, fibre-channel, switch with the following features:
Simple Easy setup and configuration. After the power-on self-test (POST), you
need only to add the internet protocol (IP) address to the switch. The
remainder of the switch setup is automated.
Intelligent
The fabric operating system of the switch allows discovery of all connected
devices and determines optimum data paths without intervention. It
supports up to 32 interconnected switches.
FlexibleModular design with multiple GBIC (Gigabit interface converter) modules
that support fiber transmission media. The modular construction of the
switch gives the switch a range of flexibility in creating, upgrading,
maintaining, and configuring a fabric.
Reliable
Highly integrated, reliable, multifunction ASIC (application specific integrated
circuit) devices are used throughout the switch.
Fiber Channel Switch 2109 S16
SJ000040
Power supply 1
Port 0 Port 15
Ready LED
Ethernet port
Power supply 2
Figure 1. Front panel of the 2109 Model S16 Switch
© Copyright IBM Corp. 1999, 2000 1

High performance
Low-latency, high-performance design resulting in a worst-case
data-transfer latency of less than 2µs from any port at peak fibre-channel
performance of 100 MBps. The latency can differ when the destination or
device is a loop.
Cascading
Switches can be cascaded for large fabric support.
Universal
The switch ports are designed to support F, FL, and E-port modes of
operation with the software selecting the optimum mode of operation.
Performance A minimum aggregate routing capacity of 4 000 000 frames per second is specified
for class 2, class 3, and class F frames. Non-blocking throughput of up to 800
MBps (0.8 GBps) is provided.
A maximum switch latency of less than 2 µs is specified for class 2, class 3, and
class F frames when the output port is free.
Manageability The unit is managed using the 10BASE-T Ethernet port for Telnet or Web-based
management using the IBM StorWatch Specialist. The switch also provides a front
operator panel for simple switch configuration and diagnostics.
System components
The system board is enclosed in an air-cooled chassis that is either mounted in a
standard rack or used as a stand-alone unit. The chassis includes one or two power
supplies, a fan tray, and an RJ-45 Ethernet connection for switch setup and
management.
GBICs The switch holds up to 16 GBIC modules. All interfaces have status lights that are
visible from the front panel that let you see the status and activity of the GBICs.
The GBIC modules supported are the short wavelength (SWL) and long wavelength
(LWL) fiber-optic versions.
If your installation requires installing less than 16 GBIC modules, the unused port
positions are protected by a metal, spring-loaded door.
SWL fiber-optic GBIC module
The SWL fiber-optic GBIC module, with an SC connector color-coded black, is
based on short wavelength 850 nm lasers supporting 1.0625 GBps link speeds.
This GBIC module supports 50-µm, multimode fiber-optic cables up to 500 m (1640
ft) in length. Figure 2 on page 3 shows an SWL GBIC module.
2IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide
|
|
|

Note: The SWL GBIC module uses a class 1 laser, which complies with the 21
CFR, subpart (J) as of the date of manufacture.
LWL fiber-optic GBIC module
The LWL fiber-optic GBIC module, with the SC connector color-coded blue, is
based on long wavelength 1300-nm lasers supporting 1.0625-GBps link speeds.
This GBIC module supports 9-µm single-mode fiber-optic cables up to 10 km (32
808 ft) in length with a maximum of five splices. Figure 3 shows an LWL GBIC
module.
Power supply The 2109 Model S16 Switch has one or two power supplies. See Figure 4 on
page 4. Only one power supply must be operational for normal switch function. If
two power supplies are present, they operate as load-sharing power supplies. If the
optional second power supply is ordered, it is installed during the installation
procedure. The switch is shipped with one power supply installed and has the
following requirements:
vProperly wired, earth-grounded outlet
vInput voltage: 85 - 265 V ac
vTotal power: Up to 110 watts (depending on configuration)
SJ000041
Switch connector end SC connector end
Figure 2. Short wavelength (SWL) laser fiber-optic GBIC module (P/N and labeling vary)
Switch connector end
SJ000042
SC connector end
Figure 3. Long wavelength (LWL) laser fiber-optic GBIC module (P/N and labeling vary)
Chapter 1. Introduction 3

vInput line frequency: Nominally 47 - 63 Hz
The switch has an autoranging power supply that automatically accepts voltages
and line frequencies within its ranges.
Fibre-channel cable connections
All network cable connections are at the front panel of the switch. All recommended
cabling supports the 1.0625-GBps transfer rate of the switch, as shown in Table 1.
Table 1. Cabling connections
Cable type Cable specification Maximum run length GBIC module
Optical wavelength
SWL
fiber-optic vDuplex standard
connection (SC) plug
connectors
vMultimode fiber
v50 µm core diameter
v125 µm cladding
diameter duplex
cable
500 m (1641 ft) 780 - 860 µm without open
fiber control (non-OFC)
LWL
fiber-optic vDuplex SC plug
connectors
vSingle mode fiber
v9 µm core diameter
v125 µm cladding
diameter duplex
cable
10 Km (32808 ft) 1270 - 1350 µm without
open fiber control
(non-OFC)
Fiber cables connect to the front panel of the switch using standard dual SC plug
connectors as shown in Figure 5 on page 5.
Fiber Channel Switch 2109 S16
SJ000043
Power supply 1Power supply 2
Figure 4. Power supplies
4IBM SAN Fibre Channel Switch: 2109 Model S16 Installation and Service Guide