IBM eserver Cluster 1350 Installation and maintenance instructions

IBM Eserver Cluster 1350
Installation and Service Guide
ERserver


IBM Eserver Cluster 1350
Installation and Service Guide
ER s e r v e r


Note: Before using this information and the product it supports, read the general information in “Safety”
on page vii and Appendix G, “Notices,” on page 93.
Fourth edition, February 2004
© Copyright International Business Machines Corporation 2004. All rights reserved.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Safety Information . . . . . . . . . . . . . . . . . . . . . . . . vii
Notices and statements used in this document . . . . . . . . . . . . . xiii
Chapter 1. System overview . . . . . . . . . . . . . . . . . . . .1
Cluster components . . . . . . . . . . . . . . . . . . . . . . .4
Cluster nodes . . . . . . . . . . . . . . . . . . . . . . . . .5
Management node . . . . . . . . . . . . . . . . . . . . . . .5
Storage nodes . . . . . . . . . . . . . . . . . . . . . . . .5
Storage servers . . . . . . . . . . . . . . . . . . . . . . . .6
Storage expansion units . . . . . . . . . . . . . . . . . . . . .6
SCSI/RAID storage controller adapters . . . . . . . . . . . . . . .6
Console . . . . . . . . . . . . . . . . . . . . . . . . . . .6
KVM switch . . . . . . . . . . . . . . . . . . . . . . . . .6
10/100 Mb Ethernet switch . . . . . . . . . . . . . . . . . . . .6
1 Gb Ethernet switch . . . . . . . . . . . . . . . . . . . . . .7
SMC mini-GBIC expansion module . . . . . . . . . . . . . . . . .7
Terminal server . . . . . . . . . . . . . . . . . . . . . . . .7
High-speed Myrinet switch . . . . . . . . . . . . . . . . . . . .7
Myrinet cluster expansion card . . . . . . . . . . . . . . . . . .7
High-speed Cisco switch . . . . . . . . . . . . . . . . . . . . .7
Power management module . . . . . . . . . . . . . . . . . . .7
Power distribution unit (PDU) . . . . . . . . . . . . . . . . . . .7
Related publications . . . . . . . . . . . . . . . . . . . . . . .8
Chapter 2. Unpacking the Cluster 1350 . . . . . . . . . . . . . . .9
Chapter 3. Placing the cabinets . . . . . . . . . . . . . . . . . .11
Customer responsibilities . . . . . . . . . . . . . . . . . . . . .11
Installer responsibilities . . . . . . . . . . . . . . . . . . . . . .11
Chapter 4. Cabling the Cluster 1350 . . . . . . . . . . . . . . . .13
VLAN options . . . . . . . . . . . . . . . . . . . . . . . . .14
Connecting the cables . . . . . . . . . . . . . . . . . . . . . .20
1 Gb Ethernet cabling . . . . . . . . . . . . . . . . . . . . .20
High-speed (Myrinet) switch cabling . . . . . . . . . . . . . . . .20
10/100/1000 Ethernet cabling . . . . . . . . . . . . . . . . . .21
Fibre Channel cabling . . . . . . . . . . . . . . . . . . . . .21
KVM cabling . . . . . . . . . . . . . . . . . . . . . . . . .21
Remote Console Manager cabling . . . . . . . . . . . . . . . . .21
Replacing a defective cable in a harness . . . . . . . . . . . . . . .22
Chapter 5. Checking the Cluster 1350 cabling process . . . . . . . . .23
Checking connections in the expansion cabinets . . . . . . . . . . . .23
Checking connections in the primary cabinet . . . . . . . . . . . . . .23
Turning on the power to the expansion cabinets . . . . . . . . . . . . .24
Turning on the power to the primary cabinet . . . . . . . . . . . . . .24
Verifying the installation of the Linux Cluster Installation Tool . . . . . . . .25
Lights out or brown out event . . . . . . . . . . . . . . . . . . .26
Related topics . . . . . . . . . . . . . . . . . . . . . . . . .26
Chapter 6. Installing the software . . . . . . . . . . . . . . . . .27
Software version matrix . . . . . . . . . . . . . . . . . . . . . .27
© Copyright IBM Corp. 2004 iii

Downloading device drivers and firmware . . . . . . . . . . . . . . .29
Installing a supported version of Linux . . . . . . . . . . . . . . . .29
Installing the Cluster System Management software . . . . . . . . . . .29
Installing the General Parallel File System system-management software . . .29
Configuring the storage nodes . . . . . . . . . . . . . . . . . . .30
Installing the storage node software . . . . . . . . . . . . . . . .30
Defining nodes . . . . . . . . . . . . . . . . . . . . . . . .31
Distributing the system image to all nodes in the cluster . . . . . . . . .33
Verifying the configuration . . . . . . . . . . . . . . . . . . . . .33
Chapter 7. Administering the Cluster 1350 . . . . . . . . . . . . . .35
Using the remote power command . . . . . . . . . . . . . . . . .35
Remote console . . . . . . . . . . . . . . . . . . . . . . . .35
Shutting down the system components . . . . . . . . . . . . . . . .35
Finding information about a lights out or brown out event . . . . . . . . .36
Related topics . . . . . . . . . . . . . . . . . . . . . . . . .36
Chapter 8. Troubleshooting hardware and software problems . . . . . .37
Isolating network, node, and Linux problems . . . . . . . . . . . . . .38
Clustering with one network . . . . . . . . . . . . . . . . . . .39
Clustering with two networks . . . . . . . . . . . . . . . . . . .39
Isolating hardware problems . . . . . . . . . . . . . . . . . . . .42
Node checks . . . . . . . . . . . . . . . . . . . . . . . . .42
Service processor network . . . . . . . . . . . . . . . . . . .44
Checking storage . . . . . . . . . . . . . . . . . . . . . . .45
Checking the terminal server . . . . . . . . . . . . . . . . . . .46
Troubleshooting the KVM network . . . . . . . . . . . . . . . . .47
File-system failure . . . . . . . . . . . . . . . . . . . . . . .47
PFA alert indicates internal disk . . . . . . . . . . . . . . . . . .47
I/O errors in syslog . . . . . . . . . . . . . . . . . . . . . .47
Isolating software problems . . . . . . . . . . . . . . . . . . . .48
Operating-system checks . . . . . . . . . . . . . . . . . . . .48
CSM checks . . . . . . . . . . . . . . . . . . . . . . . . .48
GPFS checks . . . . . . . . . . . . . . . . . . . . . . . .49
SNMP monitoring . . . . . . . . . . . . . . . . . . . . . . . .49
Configuring SNMP alerts from Myrinet . . . . . . . . . . . . . . . .49
Resetting the Remote Supervisor Adapter card . . . . . . . . . . . . .50
Checking service processor logs . . . . . . . . . . . . . . . . . .50
Management, cluster, and storage node problems . . . . . . . . . . . .50
Disk drive failures . . . . . . . . . . . . . . . . . . . . . . .51
System board failures . . . . . . . . . . . . . . . . . . . . .52
xSeries 335 problems . . . . . . . . . . . . . . . . . . . . .52
BladeCenter problems . . . . . . . . . . . . . . . . . . . . .52
Power problems . . . . . . . . . . . . . . . . . . . . . . .53
Related publications . . . . . . . . . . . . . . . . . . . . . . .54
Chapter 9. Configuring the KVM switch . . . . . . . . . . . . . . .55
Configuring the console switch after device replacement . . . . . . . . .55
Upgrading the console switch FLASH level . . . . . . . . . . . . . .55
Replacement of NetBAY Advanced Connectivity Technology Remote Console
Manager . . . . . . . . . . . . . . . . . . . . . . . . . .56
Chapter 10. Using the KVM switch . . . . . . . . . . . . . . . . .57
Saving the KVM switch settings . . . . . . . . . . . . . . . . . . .57
Connecting components with the KVM switch power turned on . . . . . . .57
Switching between nodes and the console . . . . . . . . . . . . . . .57
iv IBM Eserver Cluster 1350 Installation and Service Guide

Security features . . . . . . . . . . . . . . . . . . . . . . . .58
Resetting the mouse and keyboard . . . . . . . . . . . . . . . . .58
Chapter 11. Configuring the terminal server after device replacement . . .59
Chapter 12. Configuring and replacing the Cisco 10/100 switch . . . . .61
Configuration and setup after device replacement . . . . . . . . . . . .61
Setup troubleshooting . . . . . . . . . . . . . . . . . . . . . .62
Additional information . . . . . . . . . . . . . . . . . . . . . .62
Chapter 13. Configuring and replacing the Cisco Gigabit switch . . . . .63
Replacement procedure . . . . . . . . . . . . . . . . . . . . .63
Configuring after device replacement . . . . . . . . . . . . . . . . .63
Setup troubleshooting . . . . . . . . . . . . . . . . . . . . . .64
Additional information . . . . . . . . . . . . . . . . . . . . . .64
Chapter 14. Replacing the Cisco 4000 series switch . . . . . . . . . .65
Installation, removal, replacement, and troubleshooting procedures . . . . . .65
Additional information . . . . . . . . . . . . . . . . . . . . . .65
Chapter 15. Replacing the Myrinet 2000 Gigabit switch . . . . . . . . .67
Myrinet PCI board . . . . . . . . . . . . . . . . . . . . . . . .67
Myrinet switch chassis . . . . . . . . . . . . . . . . . . . . . .67
Configure and setup after device replacement . . . . . . . . . . . . .68
Additional information . . . . . . . . . . . . . . . . . . . . . .68
Chapter 16. Configuring and replacing the Power Management Module 69
Replacing the Power Management Module . . . . . . . . . . . . . .69
Configuring after device replacement . . . . . . . . . . . . . . . . .69
Related topics . . . . . . . . . . . . . . . . . . . . . . . . .69
Chapter 17. Removing and replacing the Power Distribution Unit . . . . .71
Appendix A. Getting help and technical assistance . . . . . . . . . .73
Before you call . . . . . . . . . . . . . . . . . . . . . . . . .73
Hardware service and support . . . . . . . . . . . . . . . . . . .73
Appendix B. Frequently asked questions . . . . . . . . . . . . . .75
Appendix C. Error and event logs . . . . . . . . . . . . . . . . .77
Appendix D. Known problems . . . . . . . . . . . . . . . . . .79
Node . . . . . . . . . . . . . . . . . . . . . . . . . . . .79
Amber light on node . . . . . . . . . . . . . . . . . . . . . .79
COM port settings in BIOS . . . . . . . . . . . . . . . . . . .79
CSM . . . . . . . . . . . . . . . . . . . . . . . . . . . . .79
Stale NFS mounts . . . . . . . . . . . . . . . . . . . . . . .79
rpower hard shut down . . . . . . . . . . . . . . . . . . . . .79
Storage . . . . . . . . . . . . . . . . . . . . . . . . . . .79
Driver module ordering . . . . . . . . . . . . . . . . . . . . .79
KVM . . . . . . . . . . . . . . . . . . . . . . . . . . . . .80
GUI does not appear on first node . . . . . . . . . . . . . . . . .80
2x8 Switch powers on with console port B . . . . . . . . . . . . . .80
Cluster port 1 reboots . . . . . . . . . . . . . . . . . . . . .80
Subsequent KVMs unresponsive . . . . . . . . . . . . . . . . .80
RSA and Service Processor . . . . . . . . . . . . . . . . . . . .81
Contents v

RSA unable to load firmware . . . . . . . . . . . . . . . . . . .81
RSA/Service Processor invalid naming . . . . . . . . . . . . . . .81
Light path points to PCI LED . . . . . . . . . . . . . . . . . . .81
Myrinet communication fails . . . . . . . . . . . . . . . . . . . .81
Appendix E. Configuring network switches . . . . . . . . . . . . .83
General networking notes . . . . . . . . . . . . . . . . . . . . .83
Switch commands . . . . . . . . . . . . . . . . . . . . . . . .83
Switch commands for the Cisco Catalyst Ethernet 3508/3550 switch running
IOS . . . . . . . . . . . . . . . . . . . . . . . . . . .83
Switch commands for the Cisco Gigabit 4006 switch running IOS . . . . .84
Switch commands for the Cisco Gigabit 4006 switch running Cisco Catalyst
Operating System . . . . . . . . . . . . . . . . . . . . . .85
Miscellaneous CISCO switch commands for the Cisco Catalyst Operating
System . . . . . . . . . . . . . . . . . . . . . . . . . .86
Miscellaneous Cisco switch commands for IOS . . . . . . . . . . . .87
Appendix F. International License Agreement for Non-Warranted Programs 89
Part 1 - General Terms . . . . . . . . . . . . . . . . . . . . . .89
Part 2 - Country-unique Terms . . . . . . . . . . . . . . . . . . .91
License Information . . . . . . . . . . . . . . . . . . . . . . .92
Appendix G. Notices . . . . . . . . . . . . . . . . . . . . . .93
Edition notice . . . . . . . . . . . . . . . . . . . . . . . . .93
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . .94
Important notes . . . . . . . . . . . . . . . . . . . . . . . . .94
Product recycling and disposal . . . . . . . . . . . . . . . . . . .95
Battery return program . . . . . . . . . . . . . . . . . . . . . .95
Electronic emission notices . . . . . . . . . . . . . . . . . . . .96
Federal Communications Commission (FCC) statement . . . . . . . . .96
Industry Canada Class A emission compliance statement . . . . . . . .96
Australia and New Zealand Class A statement . . . . . . . . . . . .96
United Kingdom telecommunications safety requirement . . . . . . . . .96
European Union EMC Directive conformance statement . . . . . . . . .96
Taiwanese Class A warning statement . . . . . . . . . . . . . . .97
Chinese Class A warning statement . . . . . . . . . . . . . . . .97
Japanese Voluntary Control Council for Interference (VCCI) statement . . .97
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . .99
vi IBM Eserver Cluster 1350 Installation and Service Guide

Safety
For general information concerning safety, refer to Electrical Safety for IBM
Customer Engineers, S229-8124. For a copy of the publication, contact your IBM
®
account representative or the IBM branch office serving your locality.
Enterprise rack safety information: Read the safety notices in the manual
provided with the enterprise rack before beginning work. Keep the Enterprise Rack
manual near the rack for fast reference.
The procedures described in this document must be performed by qualified service
personnel. Safety warnings are contained within these procedures. If you cannot
read the language of this document, do not perform any procedures until you
receive a translated copy. IBM does not accept responsibility or liability for failure to
follow these procedures correctly.
Safety Information
Before installing this product, read the Safety Information.
Antes de instalar este produto, leia as Informações de Segurança.
Pred instalací tohoto produktu si prectete prírucku bezpecnostních instrukcí.
Læs sikkerhedsforskrifterne, før du installerer dette produkt.
Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.
Avant d’installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.
© Copyright IBM Corp. 2004 vii

Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.
Antes de instalar este produto, leia as Informações sobre Segurança.
Antes de instalar este producto, lea la información de seguridad.
Läs säkerhetsinformationen innan du installerar den här produkten.
Important:
All caution and danger statements in this documentation begin with a
number. This number is used to cross reference an English caution or
danger statement with translated versions of the caution or danger
statement in the IBM NetBAY Rack Safety Information book.
For example, if a caution statement begins with a number 1,
translations for that caution statement appear in the IBM NetBAY Rack
Safety Information book under statement 1.
Be sure to read all caution and danger statements in this
documentation before performing the instructions. Read any additional
safety information that comes with your server or optional device before
you install the device.
Statement 2:
DANGER
v
Always lower the leveling pads on the rack cabinet.
v Always install stabilizer brackets on the rack cabinet.
v Always install servers and optional devices starting from the bottom of
the rack cabinet.
v Always install the heaviest devices in the bottom of the rack cabinet.
viii IBM Eserver Cluster 1350 Installation and Service Guide

Statement 3:
DANGER
v
Do not extend more than one sliding device at a time.
v The maximum allowable weight for devices on slide rails is 80 kg
(176 lb). Do not install sliding devices that exceed this weight.
Class 1 Laser Product
Laser Klasse 1
Laser Klass 1
Luokan 1 Laserlaite
Appareil A Laser de Classe 1
`
Safety ix

Statement 4:
DANGER
Electrical
current from power, telephone, and communication cables is
hazardous.
To avoid a shock hazard:
v Do not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
v Connect all power cords to a properly wired and grounded electrical
outlet.
v Connect to properly wired outlets any equipment that will be attached to
this product.
v When possible, use one hand only to connect or disconnect signal
cables.
v Never turn on any equipment when there is evidence of fire, water, or
structural damage.
v Disconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
v Connect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached
devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
x IBM Eserver Cluster 1350 Installation and Service Guide

Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
1
2
Statement 6:
CAUTION:
If you install a strain-relief bracket option over the end of the power cord that
is connected to the device, you must connect the other end of the power cord
to an easily accessible power source.
Statement 7:
CAUTION:
If the device has doors, be sure to remove or secure the doors before moving
or lifting the device to avoid personal injury. The doors will not support the
weight of the device.
Safety xi

Statement 8:
DANGER
v
Plug power cords from devices in the rack cabinet into electrical outlets
that are located near the rack cabinet and are easily accessible.
v Each rack cabinet might have more than one power cord. Be sure to
disconnect all power cords in the rack cabinet before servicing any
device in the rack cabinet.
v Install an emergency-power-off switch if more than one power device
(power distribution unit or uninterruptible power supply) is installed in
the same rack cabinet.
v Connect all devices installed in a rack cabinet to power devices installed
in the same rack cabinet. Do not plug a power cord from a device
installed in one rack cabinet into a power device installed in a different
rack cabinet.
xii IBM Eserver Cluster 1350 Installation and Service Guide

Statement 10:
CAUTION:
Removing components from the upper positions in the Enterprise Rack
cabinet improves rack stability during relocation. Follow these general
guidelines whenever you relocate a populated rack cabinet within a room or
building:
v Reduce the weight of the rack cabinet by removing equipment starting at
the top of the rack cabinet. When possible, restore the rack cabinet to the
configuration of the rack cabinet as you received it. If this configuration is
not known, you must do the following:
– Remove all devices in the 32U position and above.
– Ensure that the heaviest devices are installed in the bottom of the rack
cabinet.
– Ensure that there are no empty U-levels between devices installed in the
rack cabinet below the 32U level.
v
If the rack cabinet you are relocating is part of a suite of rack cabinets,
detach the rack cabinet from the suite.
v Inspect the route that you plan to take to eliminate potential hazards.
v Make sure that the route that you choose can support the weight of the
loaded rack cabinet. Refer to the documentation that comes with your rack
cabinet for the weight of a loaded rack cabinet.
v Make sure that all door openings are at least 760 x 2030 MM. (30 x 80 in.)
v Ensure that all devices, shelves, drawers, doors, and cables are secure.
v Ensure that the four leveling pads are raised to their highest position.
v Ensure that there is no stabilizer bracket installed on the rack cabinet.
v Do not use a ramp inclined at more than ten degrees.
v Once the rack cabinet is in the new location, do the following:
– Lower the four leveling pads.
– Install stabilizer brackets on the rack cabinet.
– If you removed any devices from the rack cabinet, repopulate the rack
cabinet from the lowest position to the highest position.
If
a long distance relocation is required, restore the rack cabinet to the
configuration of the rack cabinet as you received it. Pack the rack cabinet in
the original packaging material, or equivalent. Also, lower the leveling pads to
raise the casters off of the pallet and bolt the rack cabinet to the pallet.
Notices and statements used in this document
The caution and danger statements that appear in this document are also in the
multilingual Safety Information document, which is provided on the Web as a PDF
document and an HTML document. Each statement is numbered for reference to
the corresponding statement in the Safety Information document.
The following notices and statements are used in the documentation:
v Note: These notices provide important tips, guidance, or advice.
Safety xiii

v Important:These notices provide information or advice that might help you avoid
inconvenient or problem situations.
v Attention:These notices indicate possible damage to programs, devices, or data.
An attention notice is placed just before the instruction or situation in which
damage could occur.
v Caution:These statements indicate situations that can be potentially hazardous
to you. A caution statement is placed just before the description of a potentially
hazardous procedure step or situation.
v Danger:These statements indicate situations that can be potentially lethal or
extremely hazardous to you. A danger statement is placed just before the
description of a potentially lethal or extremely hazardous procedure step or
situation.
xiv IBM Eserver Cluster 1350 Installation and Service Guide

Chapter 1. System overview
This chapter provides information about the operating systems that support the IBM
Cluster 1350 components and related documentation.
The Cluster 1350 supports a maximum of 512 nodes in addition to the one required
xSeries
®
345 management node (or an Eserver 325 for 64-bit processing
environments). All nodes must run one of the Linux versions shown in the following
table.
Table 1. Linux operating-system support
Microprocessor Operating-system support
32-bit Professional Red Hat Linux version 9.0 (CSM), SUSE LINUX version 8.2 (XCAT)
for Opteron, Red Hat Enterprise Linux (RHEL) version 3.0 and
Workstation for Opteron version 3.0 (XCAT), SUSE LINUX version
8.2 (XCAT)
32-bit Enterprise SLES version 8 (XCAT) for Opteron, Red Hat Enterprise Linux
(RHEL) version 3.0 and Workstation for Opteron version 3.0 (XCAT)
64-bit SLES version 8 for Opteron, Red Hat Enterprise Linux (RHEL) for
Opteron version 3.0 (CSM only)
The Cluster 1350 uses a primary cabinet and an expansion cabinet. The primary
cabinet contains the management node and console monitor. An expansion cabinet
can contain the following components:
v Cluster or compute nodes
v Storage nodes
v Mass storage devices
Note:
An expansion cabinet does not contain a management node or console.
Figure 1 on page 2 illustrates a primary cabinet. Figure 2 on page 3 illustrates an
expansion cabinet containing cluster nodes. Figure 3 on page 4 illustrates an
expansion cabinet containing storage controllers and mass storage.
© Copyright IBM Corp. 2004 1

1-Gb Ethernet Switch
KVM Switch
Management
Node (x345)
Monitor
10/100-Mb Ethernet Switch
Port Servers
Power Management Module
12
11
10
9
8
7
6
5
4
3
2
1
16
15
14
13
Cluster Nodes
(x335)
2nd 10/100-Mb Ethernet Switch Option
Storage
Node (x345)
Storage Expansion Unit
(EXP500)
Storage Server
(FAStT200)
20
19
18
17
Cluster Nodes
(x335)
1U Blank
1U Blank
1U Blank
1U Blank
21
Figure 1. Example of an Eserver Cluster 1350 primary cabinet
2 IBM Eserver Cluster 1350 Installation and Service Guide

Port Server
1U Switch Option
14
13
12
11
10
9
8
7
6
5
4
3
32
31
30
29
28
27
26
25
24
23
22
21
20
19
1
2
18
17
16
15
Cluster
Nodes
(x335)
Cabinet 1
56
55
54
53
52
51
50
49
48
47
73
72
71
70
69
68
67
66
39
40
41
42
43
44
45
46
Cabinet 2
88
87
86
85
84
83
82
81
80
79
78
77
111
110
109
108
107
106
105
104
103
102
101
100
99
98
97
96
91
90
89
Cabinet 3
240
239
238
237
236
235
234
233
232
231
230
229
255
254
253
252
251
250
249
248
244
243
242
241
Cabinet 7
92
Power Management Module
33
34
36
37
38
35
93
94
245
246
76
75
74
65
64
63
62
61
60
59
58
57 95
112
113
114
247
256
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
Blank
............
Cluster
Nodes
(x335)
Figure 2. Example of an Eserver Cluster 1350 expansion cabinet with cluster nodes. This figure also shows how the
node numbering scheme maps to other expansion cabinets.
Chapter 1. System overview 3

Cluster components
This section describes the components in the Cluster 1350. Cluster components
include:
v Cluster nodes
v Management node
v Storage nodes
v Storage servers
v Storage expansion units
v SCSI/RAID storage controller adapters
24
26
23
12
11
10
9
8
7
6
5
4
3
2
1
16
15
14
13
Storage Nodes
(x345)
36
30
29
28
27
Port Servers
32
33
34
31
Storage Servers
(FAStT700)
37
38
39
40
41
42
Storage Servers
(FAStT700)
Storage Expansion Units
(EXP700)
Power Management Module
2nd 10/100-Mb Ethernet Switch Option
1U Blank
1U Blank
1U Blank
35
25
Figure 3. Example of an IBM Eserver Cluster 1350 expansion cabinet containing storage controllers and mass
storage
4 IBM Eserver Cluster 1350 Installation and Service Guide