IBM SAN768B Manual

IBM System Storage SAN768B
Installation, Service, and User’s Guide
Service information: 2499-384
GA32-0574-01
Read Before Using
This product contains software that is licensed under written license agreements. Your use of such software is subject to
the license agreements under which they are provided.


IBM System Storage SAN768B
Installation, Service, and User’s Guide
Service information: 2499-384
GA32-0574-01


Note:
Before using this information and the product it supports, read the information in “Notices” on page 117.
The following paragraph does not apply to any country (or region) where such provisions are inconsistent with local
law.
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION “AS IS” WITHOUT
WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY OR FITNESS FOR APARTICULAR PURPOSE. Some states (or regions) do
not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply
to you.
©Copyright International Business Machines Corporation 2008. All rights reserved.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Read this first
Summary of changes
This is the second edition of the IBM System Storage SAN768B Installation,
Service, and User's Guide.The content changes since the last edition of this
publication are noted by avertical line placed in the left margin beside each
change. Minor edits are not identified by this mark. Asummary of the changes for
each edition are listed below.
Second edition
The following changes were made in the second edition:
vThe section on power cords was corrected.
vThe rack installation instructions were modified to reflect anew rack installation
kit.
vThe Integrated Routing feature was added.
vMinor changes were made to the environmental, safety, and other notices.
vMinor changes to Fabric OS publication titles.
Getting help
For the latest version of your product documentation, visit the web at
http://www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi.
Search by form number or title.
For more information about IBM®SAN products, see the following Web site:
http://www.ibm.com/servers/storage/san/
For support information for this product and other SAN products, see the following
Web site: http://www.ibm.com/servers/storage/support/san
You can also contact IBM within the United States at 1-800-IBMSERV
(1-800-426-7378). For support outside the United States, you can find the service
number at: http://www.ibm.com/planetwide/.
Visit www.ibm.com/contact for the contact information for your country or region.
For detailed information about the Fibre Channel standards, see the Fibre Channel
Industry Association (FCIA) Web site at: www.fibrechannel.org/
For information about storage industry standards, see the Storage Networking
Industry Association (SNIA) Web site at: http://www.snia.org/
Taiwan Contact Information
IBM Taiwan Product Service Contact Info:
IBM Taiwan Corporation
3F, No 7, Song Ren Rd., Taipei Taiwan
Tel: [phone]
©Copyright IBM Corp. 2008 iii
|
|
|
|
|
|
|
|
|
|
|
|
|

How to send your comments
Your feedback is important in helping us provide the most accurate and high-quality
information. If you have comments or suggestions for improving this document,
send us your comments by e-mail to [email protected] or use the Readers’
Comments form at the back of this publication. Be sure to include the following:
vExact publication title
vForm number (for example, GC26-1234-02)
vPage numbers to which you are referring
If the Reader Comment Form in the back of this manual is missing, you can direct
your mail to:
International Business Machines Corporation
Information Development
Department GZW
9000 South Rita Road
Tucson, Arizona 85744-0001 U.S.A.
When you send information to IBM, you grant IBM anonexclusive right to use or
distribute the information in any way it believes appropriate without incurring any
obligation to you.
iv SAN768B Installation, Service, and User’s Guide

Contents
Read this first ......................... iii
Summary of changes ....................... iii
Second edition ........................ iii
Getting help .......................... iii
Taiwan Contact Information.................... iii
How to send your comments ....................iv
Figures ............................ix
Tables ............................xi
Safety and environmental notices ................. xiii
Safety notices and labels ..................... xiii
Danger notices ........................ xiii
Caution notices........................ xvi
Safety labels ........................ xvii
Attention notices ....................... xviii
Rack safety .......................... xix
Rack installation ....................... xix
Rack relocation (19″rack) ....................xx
Safety inspections ....................... xxi
Removing ac power ...................... xxi
External machine checks .................... xxi
Internal machine checks .................... xxi
Product recycling and disposal ................... xxii
Battery return program ..................... xxiii
For the European Union: .................... xxiii
About this document ..................... xxv
Who should read this document .................. xxv
Product documents ....................... xxv
Brocade documents....................... xxv
IBM and Brocade product matrix ................. xxv
Chapter 1. Introduction ......................1
Overview of the SAN768B .....................1
Hardware components ......................2
SAN768B blades ........................4
High availability .........................6
Reliability ...........................6
Serviceability ..........................6
Software features ........................7
Security ...........................7
Network Manageability .....................8
Port numbering .........................8
Managing cables.........................9
Chapter 2. Installing and removing aSAN768B ............11
Ordering the lift tool .......................12
World trade locations .....................12
United States locations .....................12
Installation guidelines ......................13
Installing aSAN768B in acabinet ..................14
©Copyright IBM Corp. 2008 v
||

Time required ........................14
Tools required ........................14
Parts list ..........................14
Unpacking the SAN768B ....................15
Attaching the shelf brackets ...................16
Removing the chassis door ...................17
Using the lift tool, the 24–inch load plate, and the bridge tool .......17
Removing aSAN768B from the cabinet................23
Chapter 3. Starting and configuring the SAN768B ...........25
Providing power to the SAN768B ..................26
Establishing aserial connection and logging on to the SAN768B ......26
Configuring the SAN768B IP addresses................27
Establish an Ethernet connection ..................29
Customize aswitch name .....................30
Set the Domain ID .......................30
Verifying the PID mode and connecting to the fabric ...........30
Enabling software licenses ....................31
Backing up the configuration ....................32
Chapter 4. Monitoring system components .............33
Control processor blade (CP8) ...................33
Core switch blade (CR8) .....................35
FR4-18i router blade .......................37
Port or application blades .....................40
Power supply .........................45
Blower assembly ........................46
WWN bezel and WWN card ....................48
Chapter 5. Removing and installing components ...........51
Removing and installing the chassis door ...............51
Time and items required ....................51
Removing the chassis door ...................51
Removing and installing acable management comb ...........52
Time and items required ....................52
Removing acable management comb ...............52
Installing acable management comb ................53
Removing and installing port blades .................53
Time and items required ....................54
Removing aport blade .....................54
Installing aport blade .....................55
Removing and installing port blade filler panels .............56
Removing afiller panel .....................56
Installing afiller panel .....................57
Removing and installing acontrol processor blade (CP8) .........57
Time and items required ....................58
Verifying the necessity of installation ................58
Recording critical SAN768B information...............58
Removing acontrol processor blade (CP8) .............60
Installing acontrol processor blade (CP8) ..............61
Verifying operation of the new CP blade ..............62
Removing and installing acore switch blade (CR8) ...........63
Time and items required ....................64
Verifying the necessity of installation ................64
Removing acore switch blade (CR8)................64
Installing acore switch blade (CR8) ................65
vi SAN768B Installation, Service, and User’s Guide
||
||
||
||

Removing and installing an FR4-18i router blade ............66
Time required ........................66
Items required ........................66
Removing arouter blade ....................66
Installing arouter blade.....................67
Configuring FCIP and Fibre Channel routing services and enabling the ports 68
Cabling the FR4-18i router blade .................68
Removing and installing apower supply ...............69
Time and items required ....................69
Removing apower supply ....................69
Installing apower supply ....................70
Removing and installing ablower assembly ..............71
Time and items required ....................71
Removing ablower assembly ..................71
Installing ablower assembly ...................72
Removing and installing aWWN bezel and WWN card ..........72
Time and items required ....................72
Verifying necessity of installation .................73
Removing the WWN bezel and WWN card .............74
Installing the WWN bezel and WWN card ..............75
Installing and removing FC transceivers in aport blade ..........76
Chapter 6. Installing new features .................79
FC3816, FC3832, FC3848 -Installing a8-Gb port blade (16, 32, or 48 ports) 79
Time required ........................79
Items required ........................79
Procedures .........................79
FC3850 -Installing an FR4-18i routing blade ..............80
Time required ........................81
Items required ........................81
Procedures .........................81
FC3870 -Installing an FC10-6 10 Gb blade ..............82
Time required ........................82
Items required ........................82
Procedures .........................82
Chapter 7. Installing the chassis..................83
Verifying necessity of replacement..................83
Preparing for achassis installation..................84
Time required ........................84
Items required ........................84
Recording critical SAN768B and SAN information ...........84
Chassis critical information checklist ................87
Disconnecting the SAN768B from the network and fabric .........88
Removing components from the chassis ...............88
Removing and replacing the chassis .................89
Installing components into the new chassis ..............90
Verifying the correct operation of hardware ..............90
Verifying the correct operation of the system ..............91
Reconnecting the system to the network and fabric ...........92
Verifying the correct configuration of the fabric .............93
Cable routing tables .......................93
Appendix A. Product specifications ................95
System architecture .......................95
Physical dimensions .......................97
Contents vii

Facility requirements .......................97
Power specifications .......................98
Environmental requirements ....................99
Data transmission ranges .....................99
Fibre channel port specifications .................. 100
FR4-18i router Fibre channel port specifications ............ 100
FR4-18i router GbE port specifications................ 100
Power cords ......................... 101
Appendix B. Diagnostics and troubleshooting ............ 103
Obtaining chassis and component status ............... 103
Interpreting POST and boot results ................. 104
POST ........................... 104
Boot ........................... 105
Diagnostics.......................... 105
Validating the installation of port blades ............... 105
Troubleshooting ........................ 106
Powering off the SAN768B .................... 109
Appendix C. Port numbering templates .............. 111
Notices ...........................117
Trademarks..........................119
Electronic emission notices .................... 120
Federal Communications Commission (FCC) Class AStatement ..... 120
Industry Canada Class AEmission Compliance Statement ....... 120
Avis de conformité àla réglementation d’Industrie Canada ....... 120
European Union (EU) Electromagnetic Compatibility Directive ...... 120
Germany Electromagnetic Compatibility Directive ........... 121
Japan VCCI Class AITE Electronic Emission Statement ........ 122
People’s Republic of China Class AElectronic Emission Statement .... 122
Korea Class AElectronic Emission Statement ............ 122
Index ............................ 123
viii SAN768B Installation, Service, and User’s Guide

Figures
1. Port side of the SAN768B (sample configuration) ...................3
2. Blower (non-port) side of the SAN768B (sample configuration) ..............4
3. Parts in the 14U rack mount kit .........................15
4. Left and right shelf brackets installed on the cabinet rails ................16
5. Installing clip or retainer nuts on the vertical cabinet rails ................17
6. Chassis installation from rear (exhaust aisle side) of the cabinet .............19
7. Locking the shelf into position ..........................20
8. Attaching the port side of the chassis to the cabinet rails ................21
9. Aligning the chassis door with the ball studs on the chassis ...............22
10. Details of the chassis and door, showing the ball studs on the chassis and the mounting hardware
on the door .................................22
11. Control processor blade (CP8) LEDs .......................34
12. Core switch blade (CR8) LEDs..........................36
13. FR4-18i router blade .............................38
14. FC8-16 port blade ..............................41
15. FC8-32 port blade ..............................42
16. FC8-48 port blade ..............................43
17. FC10-6 port blade ..............................44
18. Power supply LEDs ..............................46
19. Blower assembly LEDs and other parts ......................47
20. LEDs on the WWN card and bezel ........................49
21. Chassis door ................................52
22. Cable management comb ...........................53
23. Port blade removal and installation (16-port blade shown as example) ...........55
24. Port blade removal and installation (16-port blade shown as example) ...........57
25. Removing the control processor (CP) blade .....................61
26. Removing the core switch blade .........................65
27. Removing and installing apower supply ......................70
28. Blower assembly LEDs and other parts ......................72
29. WWN bezel and card removal and installation ....................75
30. SFP extraction tool ..............................77
31. Port side populated with eight FC8-48 port blades, two CR8 blades, and two CP8 blades 112
32. Port side populated with eight FC8-32 port blades, two CR8 blades, and two CP8 blades 113
33. Port side populated with eight FC8-16 port blades, two CR8 blades, and two CP8 blades 114
34. FC10-6 port blade ..............................115
35. FC4-18IP port blade .............................116
©Copyright IBM Corp. 2008 ix
||
||
||
||
||
||
|
||

xSAN768B Installation, Service, and User’s Guide

Tables
1. Brocade and IBM product and model number matrix ................. xxvi
2. Blades available for the SAN768B .........................4
3. Security features ...............................7
4. Port blades available on the SAN768B .......................8
5. Items supplied with the 14U rack mount kit .....................14
6. Configuration parameters............................27
7. Example login without changing the password ....................27
8. Example of viewing enabled licenses .......................31
9. CP blade LED descriptions ...........................34
10. CR blade LED descriptions ...........................36
11. FR4-18i router blade LED patterns during normal operation ...............39
12. Port and application blade LED descriptions .....................45
13. Power supply LED descriptions .........................46
14. Blower assembly LED descriptions ........................47
15. Messages that may indicate WWN card failure ....................48
16. WWN bezel LED descriptions ..........................49
17. WWN LED patterns ..............................73
18. Commands identifying the WWN card status ....................73
19. WWN card related system log messages ......................74
20. Critical information checklist example .......................87
21. Sample cable routing table for SAN768B (Switch Name: swDir) .............93
22. Cable routing table for SAN768B .........................93
23. System architecture ..............................95
24. System sizes and weights ...........................97
25. System FRU weights .............................97
26. Power specifications .............................98
27. Environmental requirements...........................99
28. Data transmission ranges by cable type and port speed ................99
29. Environmental status and maintenance commands .................. 104
30. Commands for validating installation of port blades .................. 106
31. Troubleshooting ............................... 106
©Copyright IBM Corp. 2008 xi
||

xii SAN768B Installation, Service, and User’s Guide

Safety and environmental notices
This section contains information about:
v“Safety notices and labels”
v“Rack safety” on page xix
v“Safety inspections” on page xxi
v“Product recycling and disposal” on page xxii
Safety notices and labels
When using this product, observe the danger, caution, and attention notices
contained in this guide. The notices are accompanied by symbols that represent the
severity of the safety condition. The danger and caution notices are listed in
numerical order based on their IDs, which are displayed in parentheses, for
example (D004), at the end of each notice. Use this ID to locate the translation of
these danger and caution notices in the IBM Systems Safety Notices (G229–9054)
publication, which is on the CD-ROM that accompanies this product.
The following notices and statements are used in IBM documents. They are listed
below in order of increasing severity of potential hazards. Follow the links for more
detailed descriptions and examples of the danger, caution, and attention notices in
the sections that follow.
vNote: These notices provide important tips, guidance, or advice.
v“Attention notices” on page xviii: These notices indicate potential damage to
programs, devices, or data.
v“Caution notices” on page xvi: These statements indicate situations that can
be potentially hazardous to you.
v“Danger notices”: These statements indicate situations that can be potentially
lethal or extremely hazardous to you. Safety labels are also attached directly to
products to warn of these situations.
vIn addition to these notices, “Safety labels” on page xvii may be attached to the
product to warn of potential hazards.
Danger notices
Adanger notice calls attention to asituation that is potentially lethal or extremely
hazardous to people. Alightning bolt symbol accompanies adanger notice to
represent adangerous electrical condition. Read and comply with the following
danger notices before installing or servicing this device.
DANGER
To prevent apossible shock from touching two surfaces with
different protective ground (earth), use one hand, when possible,
to connect or disconnect signal cables. (D001)
©Copyright IBM Corp. 2008 xiii

DANGER
Overloading abranch circuit is potentially afire hazard and a
shock hazard under certain conditions. To avoid these hazards,
ensure that your system electrical requirements do not exceed
branch circuit protection requirements. Refer to the information
that is provided with your device or the power rating label for
electrical specifications. (D002)
DANGER
If the receptacle has ametal shell, do not touch the shell until
you have completed the voltage and grounding checks. Improper
wiring or grounding could place dangerous voltage on the metal
shell. If any of the conditions are not as described, STOP. Ensure
the improper voltage or impedance conditions are corrected
before proceeding. (D003)
DANGER
An electrical outlet that is not correctly wired could place
hazardous voltage on metal parts of the system or the devices
that attach to the system. It is the responsibility of the customer
to ensure that the outlet is correctly wired and grounded to
prevent an electrical shock. (D004)
Ageneral electrical danger notice provides instructions on how to avoid shock
hazards when servicing equipment. Unless instructed otherwise, follow the
procedures in the following danger notice.
xiv SAN768B Installation, Service, and User’s Guide

DANGER
When working on or around the system, observe the following
precautions:
Electrical voltage and current from power, telephone, and
communication cables are hazardous. To avoid ashock hazard:
vConnect power to this unit only with the IBM provided power
cord. Do not use the IBM provided power cord for any other
product.
vDo not open or service any power supply assembly.
vDo not connect or disconnect any cables or perform
installation, maintenance, or reconfiguration of this product
during an electrical storm.
vThe product might be equipped with multiple power cords. To
remove all hazardous voltages, disconnect all power cords.
vConnect all power cords to aproperly wired and grounded
electrical outlet. Ensure that the outlet supplies proper voltage
and phase rotation according to the system rating plate.
vConnect any equipment that will be attached to this product to
properly wired outlets.
vWhen possible, use one hand only to connect or disconnect
signal cables.
vNever turn on any equipment when there is evidence of fire,
water, or structural damage.
vDisconnect the attached power cords, telecommunications
systems, networks, and modems before you open the device
covers, unless instructed otherwise in the installation and
configuration procedures.
vConnect and disconnect cables as described below when
installing, moving, or opening covers on this product or
attached devices.
To Disconnect:
1. Turn off everything (unless instructed otherwise).
2. Remove the power cords from the outlets.
3. Remove the signal cables from the connectors.
4. Remove all cables from the devices.
To Connect:
1. Turn off everything (unless instructed otherwise).
2. Attach all cables to the devices.
3. Attach the signal cables to the connectors.
4. Attach the power cords to the outlets.
5. Turn on the devices.
(D005)
The weight of the SAN cabinet (2109-C36) with two SAN768Bs is greater than 227
kg (500 lb), and has afully loaded capacity of 816 kg (1795 lb). Under these
conditions, the following statement and notice apply.
Safety and environmental notices xv

Delivery and subsequent transportation of the equipment
The customer should prepare his environment to accept the new product based on
the installation planning information provided, with assistance from an IBM
Installation Planning Representative (IPR) or IBM authorized service provider. In
anticipation of the equipment delivery, the final installation site should be prepared
in advance such that professional movers/riggers can transport the equipment to
the final installation site within the computer room. If for some reason, this is not
possible at the time of delivery, the customer will need to make arrangements to
have professional movers/riggers return to finish the transportation at alater date.
Only professional movers/riggers should transport the equipment. The IBM
authorized service provider will only perform minimal frame repositioning within the
computer room, as needed, to perform required service actions. The customer is
also responsible for using professional movers/riggers in the case of equipment
relocation or disposal.
>(>)500 lbs. 227 kg.
a69i0333
DANGER
Heavy equipment—personal injury or equipment damage might
result if mishandled. (D006)
Caution notices
Acaution notice calls attention to asituation that is potentially hazardous to people
because of some existing condition. Acaution notice can be accompanied by
different symbols, as in the examples below:
If the symbol
is... It means....
Ahazardous electrical condition with less severity than electrical danger.
Agenerally hazardous condition not represented by other safety symbols.
svc00169
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
Aspecification of product weight that requires safe lifting practices. The
weight range of the product is listed below the graphic, and the wording
of the caution varies, depending on the weight of the device.
P/N 18P5850-B
SJ000752
Apotential hazard of pinching the hand or other body parts between
parts.
Ahazardous condition due to moving parts nearby.
Ahazardous condition due to the use of alaser in the product. Laser
symbols are always accompanied by the classification of the laser as
defined by the U. S. Department of Health and Human Services (for
example, Class I, Class II, and so forth).
xvi SAN768B Installation, Service, and User’s Guide

Read and comply with the following caution notices before installing or servicing this
device.
CAUTION:
Energy hazard present. Shorting may result in system outage and
possible physical injury. Remove all metallic jewelry before
servicing. (C001)
svc00169
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It takes
specially trained persons, alifting device, or both to safely lift this
part or unit. (C011)
CAUTION:
This product is equipped with a3-wire (two conductors and ground)
power cable and plug. Use this power cable with aproperly
grounded electrical outlet to avoid electrical shock. (C018)
CAUTION:
Servicing of this product or unit is to be performed by trained
service personnel only. (C032)
Safety labels
As an added precaution, safety labels are often installed directly on products or
product components to warn of potential hazards. These can be either danger or
caution notices, depending upon the level of the hazard.
The actual product safety labels may differ from these sample safety labels:
DANGER
Hazardous voltage, current, or energy levels are present inside
any component that has this label attached. Do not open any
cover or barrier that contains this label. (L001)
DANGER
Rack-mounted devices are not to be used as ashelf or work
space. (L002)
Safety and environmental notices xvii

DANGER
Multiple power cords. The product might be equipped with
multiple power cords. To remove all hazardous voltages,
disconnect all power cords. (L003)
DANGER
Hazardous voltage present. Voltages present constitute ashock
hazard, which can cause severe injury or death. (L004)
CAUTION:
Hazardous energy present. Voltages with hazardous energy might
cause heating when shorted with metal, which might result in
splattered metal, burns, or both. (L005)
CAUTION:
Hazardous moving parts nearby (L008)
P/N 18P5850-B
SJ000752
CAUTION:
Pinch hazard. (L012)
Attention notices
An attention notice indicates the possibility of damage to aprogram, device, or
system, or to data. An exclamation point symbol may accompany an attention
notice, but is not required. Asample attention notice follows:
Attention: Do not bend afibre cable to aradius less than 5cm (2 in.); you can
damage the cable. Tie wraps are not recommended for optical cables because they
can be easily overtightened, causing damage to the cable.
xviii SAN768B Installation, Service, and User’s Guide