IBM 87302RU Technical manual

BladeCenter T
Types 8720 and 8730
Planning and Installation Guide
GA27-4339-02


BladeCenter T
Types 8720 and 8730
Planning and Installation Guide
GA27-4339-02


Note
Before using this information and the product it supports, read the general information in
Appendix C, “Notices,” on page 117.
Third Edition (August 2006)
©Copyright International Business Machines Corporation 2004, 2006. All rights reserved.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Preface
This guide is intended for anyone who plans for the physical installation and
configuration of an IBM®BladeCenter®Tunit. This book is organized as follows and
should be used for these tasks:
vUse Chapter 1, “Introducing the BladeCenter Tunits,” on page 1to understand
the overall purpose and usage of BladeCenter Tunits and blade servers.
vUse Chapter 2, “BladeCenter Tunit components,” on page 13 to learn about the
physical components that make up aBladeCenter Tunit.
vUse Chapter 3, “Deployment considerations,” on page 39 to learn about network
topology considerations and deployment considerations.
vUse Chapter 4, “Installation considerations,” on page 51 and Appendix A,
“Planning worksheets,” on page 89 to plan for the physical environment for
installing BladeCenter Tunits. This includes space, power, cooling, and cabling
requirements. The worksheets provide the basis for selecting the features and
options for each blade server, where the blade server is installed in a
BladeCenter Tunit and arack location for each BladeCenter Tunit.
vUse Chapter 5, “Configuration considerations,” on page 75 and Appendix B,
“Configuration worksheets,” on page 101 to plan for the configuration of the:
–Management module
–I/O modules
–Fibre Channel switch modules
–Blade servers
©Copyright IBM Corp. 2004, 2006 iii

iv BladeCenter TTypes 8720 and 8730: Planning and Installation Guide

Summary of changes
This document contains information previously presented in GA27-4339-01.
New and changed information for GA27-4339-02
In Chapter 4, Installation considerations, the following sections were updated to
reflect changes to part numbers for the Type 8730:
vPower distribution units
vPower connections
vPower layout examples
©Copyright IBM Corp. 2004, 2006 v

vi BladeCenter TTypes 8720 and 8730: Planning and Installation Guide

Contents
Preface ............................ iii
Summary of changes ......................v
New and changed information for GA27-4339-02 .............v
Figures ............................xi
Chapter 1. Introducing the BladeCenter Tunits ............1
Why choose the BladeCenter Ttechnology? ..............1
What the BladeCenter Tunit offers .................2
Reliability, availability, and serviceability ...............4
Features and specifications for the BladeCenter TType 8720 .......6
Features and specifications for the BladeCenter TType 8730 .......7
Why blade servers? .......................8
Blade server benefits ......................8
Deployment scenarios......................9
Where to go for more information ..................10
BladeCenter Tdocumentation and operating system installation instructions 10
Hardware documentation ...................10
Redbooks publications .....................11
Operating system installation instructions ..............12
Web sites ..........................12
Chapter 2. BladeCenter Tunit components .............13
Chassis ...........................14
Front view .........................14
Rear view of the BladeCenter Tunit ................15
Input/output connectors .....................16
2-way blade servers .......................18
Features and specifications for the HS20 Type 8843 for anon-NEBS/ETSI
environment ........................19
Features and specifications for the HS20 Type 8843 for aNEBS/ETSI
environments........................20
4-way blade server .......................21
BladeCenter HS40 Type 8839 features and specifications for
non-NEBSI/ETSI environment .................22
BladeCenter HS40 Type 8839 features and specifications for aNEBS/ETSI
environment ........................23
Media tray ..........................24
Management module.......................25
Keyboard, video, and mouse module .................28
LAN module indicators and input/output connectors ...........30
I/O modules ..........................32
Power modules for Type 8720 ...................35
Power modules for Type 8730 ...................36
Blowers ...........................37
Blade servers .........................38
Blade server expansion options ..................38
I/O expansion option .....................38
Expansion unit option ....................38
Storage Expansion Unit option ................38
PCI I/O-expansion Unit option ................38
©Copyright IBM Corp. 2004, 2006 vii

Chapter 3. Deployment considerations ...............39
Network topologies .......................39
Integrated infrastructure ....................39
Single BladeCenter Tchassis .................39
Multiple BladeCenter Tchassis .................41
Using Remote Deployment Manager Version 4.11 Update 3or later ....42
Using IBM Director ......................42
Communicating with the IBM Director software ............42
Preparing for BladeCenter Tdeployment ...............43
Deployment tools .......................43
Deployment infrastructure ....................45
Setting up the management connection ..............46
Cabling the Ethernet port .....................47
Deployment ..........................49
Preparing for blade server deployment ................49
Hardware considerations ....................49
Firmware considerations ....................49
Operating system considerations .................50
Device driver considerations ...................50
Application considerations ....................50
Chapter 4. Installation considerations ...............51
Physical planning ........................51
Dimensions .........................51
Weight considerations .....................51
Floor space .........................52
Noise considerations ......................53
Rack considerations .......................54
IBM NetBAY and non-IBM racks .................54
Moving IBM NetBAY racks safely .................55
General requirements for racks ..................56
Power considerations for Type 8720 .................56
Rack requirements for Type 8720 .................57
Power considerations for Type 8730 .................57
Rack requirements for Type 8730 .................58
Power distribution units ....................58
Wall and floor power drop requirements ...............60
Keyboard, video, and mouse ...................61
Electrical input for Type 8720 ..................62
Electrical input for Type 8730 ..................62
Cooling considerations ......................62
Air temperature and humidity for Telecom/NEBS environment.......62
Air temperature and humidity for non-NEBS environment ........62
Airflow considerations .....................63
Heat output for Types 8720 and 8730 ...............63
Prevention of air recirculation ..................64
Air filtration .........................64
Room cooling ........................64
Power connections for Type 8720 ..................64
Power connections for Type 8730 ..................65
Power layout example 1– single BladeCenter Tunits ..........67
Power layout example 2–two BladeCenter TType 8730 units in NetBAY 25
or 42U racks ........................68
Power layout example 3–three BladeCenter TType 8730 units in NetBAY
25 or 42U racks.......................69
viii BladeCenter TTypes 8720 and 8730: Planning and Installation Guide

Power layout example 4–four BladeCenter TType 8730 units in NetBAY
42U racks .........................70
Power layout example 5–five BladeCenter TType 8730 units in NetBAY
42U racks .........................72
Physical installation time .....................74
Chapter 5. Configuration considerations ..............75
Management module configuration planning ..............75
General settings .......................76
Login profiles ........................76
Alerts ...........................76
Port assignments .......................76
Network interfaces ......................76
Network protocols .......................77
Security ..........................77
Configuration file .......................77
Firmware update .......................77
Restore defaults .......................77
Restart MM .........................77
Ethernet switch module configuration planning .............77
Switch settings ........................78
Port settings .........................79
SNMP ...........................79
User accounts ........................79
TFTP ...........................80
Virtual LANs .........................80
VLAN example .......................80
Multicasting .........................82
Port mirroring ........................82
Spanning tree ........................83
Class of service .......................83
Link aggregation .......................83
Link aggregation group recommendations .............84
Link aggregation example ..................85
Link Aggregation Control Protocol recommendations .........85
Fibre-channel switch module configuration planning ...........86
Blade server configuration planning .................86
Appendix A. Planning worksheets .................89
Blade server worksheet......................90
BladeCenter TTypes 8720 and 8730 worksheet.............93
Rack worksheet ........................95
Cabling worksheet .......................97
Power worksheet for Type 8720 ..................99
Power worksheet for Type 8730 .................. 100
Appendix B. Configuration worksheets .............. 101
Management module configuration worksheet ............. 101
Ethernet switch module configuration worksheet ............ 104
Fibre-channel switch module configuration planning ...........112
Blade server configuration planning .................115
Appendix C. Notices ......................117
Trademarks..........................117
Important notes ........................118
Contents ix

Index ............................ 121
xBladeCenter TTypes 8720 and 8730: Planning and Installation Guide

Figures
1. BladeCenter Tunit...............................1
2. Major BladeCenter Tcomponents ........................13
3. BladeCenter Tfront view ............................14
4. Components on the rear of the BladeCenter Tunit ..................15
5. BladeCenter TType 8720 rear view -I/O connectors .................17
6. BladeCenter TType 8730 rear view -I/O connectors .................17
7. BladeCenter HS20 Type 8843 ..........................18
8. BladeCenter HS40 Type 8839 blade server .....................21
9. BladeCenter Tmedia tray ...........................24
10. BladeCenter Tadvanced management module ....................26
11. Serial port connector .............................26
12. Optional serial cable for connecting the management module to an external serial port .....27
13. BladeCenter TKVM module...........................28
14. BladeCenter TKeyboard connector ........................29
15. BladeCenter TMouse connector .........................29
16. BladeCenter TVideo connector .........................29
17. BladeCenter TLAN module ...........................30
18. Alarms connector...............................31
19. BladeCenter Tpower module for Type 8720 .....................35
20. BladeCenter Tpower module for Type 8730 .....................36
21. BladeCenter Tblower module ..........................37
22. Single BladeCenter Tchassis ..........................40
23. Multiple BladeCenter Tunits as anetwork infrastructure ................41
24. Management network diagram ..........................46
25. Location of the LAN module...........................46
26. Cabling the Ethernet port ............................47
27. Ethernet LEDs................................48
28. Operational clearances for NetBAY 42 Enterprise rack .................52
29. Rack PDU —20-A single phase .........................60
30. Rack PDU —30-A and 32-A single phase .....................60
31. Rack PDU —32-A 3-phase (3-phase +neutral +ground) ................61
32. Rack PDU —60-A single phase .........................61
33. Rack PDU —60-A 3-phase (3-phase +ground) ...................61
34. Typical dc PDU for asingle BladeCenter TType 8720 .................65
35. Single BladeCenter TType 8730 installed in aNetBAY 25 or 42U rack with 1300-W power
supplies ..................................67
36. Two BladeCenter TType 8730 units installed in NetBAY 25 to 42U racks with 1300-W power
supplies (24 or 48 amp (North American) or 32 or 63 amp [international]) ..........68
37. Power layout of two BladeCenter TType 8730 units installed in NetBAY 25 to 42U racks with
1300-W power supplies (3-phase) ........................68
38. Three BladeCenter TType 8730 units in aNetBAY 25 or 42 rack with 1300-W power supplies (24
or 48 amp (North American) or 32 or 63 amp (international) ...............69
39. Three BladeCenter TType 8730 units in aNetBAY 25 or 42 rack; 1300-W power supplies
(3-phase) .................................69
40. Four BladeCenter TType 8730 units in aNetBAY 42U rack with 1300-W power supplies ....70
41. Power layout for four BladeCenter TType 8730 units in aNetBAY 42U rack with 1300-W power
supplies (1- and 3-phase) ...........................71
42. Five BladeCenter TType 8730 units in aNetBAY 42 rack with 1300-W power supplies .....72
43. Power layout for five BladeCenter TType 8730 units in aNetBAY 42 rack with 1300-W power
supplies (32 amp 3-phase) ...........................73
44. VLAN configuration example on asingle BladeCenter Tunit ...............81
45. VLAN configuration example for multiple BladeCenter Tunits ..............82
46. Recommended network topology with multiport link aggregation groups...........85
©Copyright IBM Corp. 2004, 2006 xi

xii BladeCenter TTypes 8720 and 8730: Planning and Installation Guide

Chapter 1. Introducing the BladeCenter Tunits
This guide provides physical planning information for the IBM BladeCenter T, Types
8720 and 8730. It describes the BladeCenter Tunit components, explains
deployment and installation considerations, and provides worksheets that you can
use to determine the BladeCenter Tunit hardware configuration. From these
worksheets, you can determine the configuration, power, weight, and cabling
requirements for the BladeCenter Tunit. In addition, you can use these worksheets
as abasis for placing an order.
Hereinafter, unit will refer to both types unless there are specific differences; then,
each type will be described separately.
Why choose the BladeCenter Ttechnology?
The IBM BladeCenter TTypes 8720 and 8730 are based on the IBM Enterprise
X-Architecture™Technology.1
The BladeCenter Tunit is arack-mounted, high-density, high-performance
blade-server system developed for Network Equipment Building System (NEBS)
telecommunications network applications and other applications requiring additional
physical robustness. The BladeCenter Tuses blades, switches, and other
components that are common to the award-winning IBM BladeCenter product line.
This common component strategy makes it ideal for applications in
telecommunications networks that need high levels of computer power and access
to common off-the-shelf middleware packages otherwise used in IT data centers.
Figure 1represents the BladeCenter Tunit.
The BladeCenter Tsupports up to eight blade servers, making it ideally suited for
networking environments that require alarge number of high-performance servers
in asmall amount of space. The BladeCenter Tsystem provides common resources
that are shared by the blade servers, such as power, cooling, system management,
network connections, and I/O (CD-ROM drive, ports for universal serial bus (USB),
keyboard, video, mouse, and network interfaces). The use of common resources
enables small size in the blade servers, allows minimal cabling, and eliminates
resources sitting idle.
1. IBM Enterprise X-Architecture Technology takes full advantage of existing IBM technologies to build powerful, scalable, and reliable
Intel®processor-based servers. For more information about IBM Enterprise X-Architecture Technology, go to www.ibm.com/servers/
eserver/xseries/xarchitecture/enterprise/.
Figure 1. BladeCenter Tunit
©Copyright IBM Corp. 2004, 2006 1

Performance, ease of use, reliability (NEBS3/ETSI compliance), and expansion
capabilities were key considerations during the design of the BladeCenter Tsystem.
These design features make it possible for you to customize the system hardware
to meet your needs today, while providing flexible expansion capabilities for the
future.
What the BladeCenter Tunit offers
The design of the BladeCenter Tunit takes advantage of advances in server
technology. It provides up to eight functionally separate servers and their shared
resources combined in asingle center. The BladeCenter Tunit with blade servers
has the following features:
vIBM Enterprise X-Architecture Technology
IBM Enterprise X-Architecture Technology leverages proven innovative IBM
technologies to build powerful, scalable, reliable Intel®-processor-based servers.
IBM Enterprise Technology includes features such as IBM Predictive Failure
Analysis®(PFA), scalability, and real-time diagnostics.
vExpansion capabilities
Blades can be added to the BladeCenter Tunit as needed, up to amaximum of
eight blades.
Note: If any blade server or option is in blade bays 5through 8or if an I/O
module is in I/O-module bays 3and 4, power modules must be present in
all four power-module bays.
Some blade servers have connectors for options that can be used to add
capabilities to the blade server, such as an I/O expansion card to add anetwork
interface or astorage expansion unit to add SCSI hard disk drives.
vHot-swap capabilities
The front bays on the BladeCenter Tunit are hot-swap blade, power module, and
management module bays; the rear bays on the BladeCenter Tunit are hot-swap
I/O, keyboard, video, and mouse (KVM), LAN, and blower-module bays. You can
add, remove, or replace blades servers or power, management, I/O, KVM, LAN,
and blower modules in hot-swap bays within specific time limits and without
removing power from the BladeCenter Tunit.
Attention: To maintain proper system cooling, each unoccupied bay must
contain afiller blade or filler module.
vRedundancy capabilities
The redundant components in the BladeCenter Tunit enable continued operation
if one of the components fails.
–Power modules: In normal operation, the redundant power modules provide
redundant power feeds to share the system load. If one of the power modules
fails, the working power module handles the entire load. You can then replace
the failed power module without shutting down the BladeCenter Tunit.
–Blowers: In normal operation, the redundant blower modules share the system
load. If one of the blowers fails, the other three working blowers handle the
entire load. You can then replace the failed blower without shutting down the
BladeCenter Tunit.
–Management module: Only one management module is active at atime. If a
second management module has been installed, and the active management
module fails, then the secondary (redundant) management module becomes
the active management module containing the current BladeCenter T
configuration and status information. You can then replace the failed
management module without shutting down the BladeCenter Tunit.
2BladeCenter TTypes 8720 and 8730: Planning and Installation Guide

–BladeCenter Tbackplane characteristics: The backplane has the following
redundancy characteristics:
-Hot-pluggable connectors for the following components:
vEight blades servers
vFour I/O modules
vTwo management modules
vFour power supplies
vFour blowers
-Redundant high-speed serialize/deserialize (SERDES) interconnects
between blades and switches
-Support for redundant management modules
-Redundant 12C communications between the management modules and all
modules (except the blade servers)
-Redundant RS-485 (EIA 485) communications between management
modules and blade servers
-Redundant analog video connections from blades to management modules
-Redundant USB connections between blades and management modules
-Redundant secure Ethernet management port between switches and
management modules
Chapter 1. Introducing the BladeCenter Tunits 3

vRedundant network connection capabilities
Configuring apair of Ethernet switch modules in I/O-module bays 1and 2
provides support for Ethernet failover configured on blade servers. If the I/O
expansion options can be configured for failover, configuring apair of switch
modules in I/O-module bays 3and 4provides support for the failover configured
on the I/O expansion options. See the documentation that comes with your I/O
expansion and switch module options for more information about configuring for
redundant network connections.
Note: Asystem configuration with I/O expansion options in I/O-module bays 3
and 4requires aunit configuration with power supplies in power-module
bays 3and 4.
Other network-interface I/O expansion options, such as the IBM BladeCenter T
Fibre Channel Expansion Card, can have similar capability for redundant network
connections. See the documentation that comes with your I/O expansion module
and I/O module options for more information about configuring for redundant
network connections.
vSystem-management capabilities
The BladeCenter Tunit comes with aservice processor in the management
module. This service processor in the management module, the
system-management firmware that is provided with the BladeCenter Tunit, and
the service processor in each blade server, enable you to remotely manage the
BladeCenter Tunit, its components, and the blade servers. The management
module also multiplexes the keyboard, mouse, video ports, and the USB port
across all blade servers.
The service processor in each blade server provides blade server system
monitoring, event recording, and alert capability.
vNetwork environment support
The BladeCenter Tunit supports up to two Ethernet-compatible I/O modules
(switch modules or pass-through modules), for blade server integrated Ethernet
controller communication with the network. Each I/O module provides one
internal connection to each blade server, with up to eight internal connections per
I/O module. In addition, each Ethernet-compatible I/O module provides four
external connections to the user’s network infrastructure. These connections
support LAGs, VLANs, and other network protocols dependent on the model
installed.
The BladeCenter Tunit also supports up to two additional I/O modules for atotal
of four I/O modules. The two additional I/O modules support the network
interface on the optional I/O expansion card installed on one or more blade
servers in the BladeCenter Tunit.
Note: The two additional I/O modules must be compatible with the network
interface on the optional I/O expansion cards in the blade servers.
Each of these two additional I/O modules provides one internal connection to the
optional I/O expansion card, with up to eight internal connections per I/O module.
Reliability, availability, and serviceability
Three of the most important features in server design are reliability, availability, and
serviceability (RAS). These factors help to ensure the integrity of the data stored on
the blade server; that the blade server is available when you want to use it; and
that should afailure occur, you can easily diagnose and repair the failure with
minimal inconvenience.
4BladeCenter TTypes 8720 and 8730: Planning and Installation Guide

The BladeCenter Tunit has the following RAS features:
vShared key components, such as power, cooling, backplane, and I/O
vAll components serviced from the front or rear of the BladeCenter Tunit
vAutomatic error retry and recovery
vAutomatic restart after apower failure
vBuilt-in monitoring for blower, power, temperature, and voltage
vBuilt-in monitoring for module redundancy
vCustomer support center 24 hours aday, 7days aweek2
vError codes and messages
vFault-resistant startup
vRemote system management through the management module
vRemote management module firmware upgrade
vRemote upgrade of blade server service processor microcode
vBuilt-in self-test (BIST)
vPredictive Failure Analysis (PFA) alerts
vRedundant components
–Blowers with speed-sensing capability
–Power modules
–Management modules
–I/O modules
v
Redundant system features in the backplane
vHot-swap components
–Blade servers
–Blowers with speed-sensing capability
–I/O modules
–KVM module
–LAN module
–Management module
–Media tray
–Power modules
v
System automatic inventory at startup
vSystem error logging
2. Service availability will vary by country. Response time varies; may exclude holidays.
Chapter 1. Introducing the BladeCenter Tunits 5

Features and specifications for the BladeCenter TType 8720
Table 1provides asummary of the features and specifications for the
BladeCenter TType 8720 that is adc-powered system.
Table 1. BladeCenter TType 8720 features and specifications
Media tray (on front):
vDVD/CD-RW drive: slim IDE
vTwo USB V2.0 Full Speed ports
vSystem-status panel
Module bays (on front):
vEight hot-swap blade bays
vFour hot-swap power-module bays
vTwo hot-swap management-module
bays
Module bays (on rear):
vFour hot-swap I/O module bays
vFour hot-swap blower bays
vOne hot-swap KVM module
vOne hot-swap LAN module
Power modules:
vStandard: Two 1300-watt or greater
hot-swap -48 Vdc (-48 to -60 Vdc)
power modules
–Power modules 1and 2supply
power to:
-Blade bays 1through 4
-Management modules 1and 2
-I/O modules 1and 2
-Media tray
-All KVM, LAN, and alarm
interfaces
-All four blower modules
–Power modules 1and 2provide
redundancy to each other
vMaximum: Four 1300-watt or greater
hot-swap -48 Vdc (-48 to -60 Vdc)
power modules
–Power modules 3and 4supply
power to:
-Blade bays 5through 8
-I/O modules 3and 4
–Power modules 3and 4provide
redundancy to each other
–Blowers are powered by all four
power modules
LAN module:
vTwo 10/100-Mbps Ethernet remote
management connections
vOne DSUB 15P alarm connector
KVM module:
vVideo port (analog)
vIBM PS/2®keyboard port
vPS/2 mouse port
vSystem-status panel
I/O modules:
vStandard: None
vMaximum: Four
–Two hot-swap 1-GB Ethernet
four-port switch modules
–Two hot-swap switch modules of
another network-communication
standard, such as Fibre Channel
Management module:
vStandard: One hot-swap management
module providing system-management
functions for the BladeCenter Tunit
vMaximum: Two hot-swap management
modules (one active, one redundant)
Redundant cooling:
Four variable-speed hot-swap blowers
Front bezel with changeable filter
Upgradeable microcode:
vManagement-module firmware
vI/O module firmware (not all I/O module
types)
vBlade server service processor firmware
(BIOS, service processor)
Size (8U):
vHeight: 349.25 mm (13.75 in. or 8U)
vDepth: 508 mm (20 in.) from front of
chassis to rear I/O connector plane
Maximum depth:
600 mm (23.62 in.) including bezel,
handles, and cable bend radius
vWidth: 442 mm (17.4 in.)
vWeight:
–Fully configured with modules and
blades: approximately 86.64 kg (191
lb)
–Fully configured without blades:
approximately 44.45 kg (98 lb)
Security features:
vLogin password for remote connection
vSecure shell (SSH) for command line
interface
vSecure Sockets Layer (SSL) security for
remote Web management access
Predictive Failure Analysis (PFA) alerts:
vBlowers
vBlade-dependent features
vPower supplies
Declared acoustical noise emission levels
for normal operations:
vSound-power levels (upper-limit): 7.5 bels
vSound-pressure levels (average) for four
one-meter bystander positions: 59 dBA
The noise emission levels stated are the
declared upper limit sound-power levels, in
bels, for arandom sample of machines. All
measurements made in accordance with ISO
7779 and reported in conformance with ISO
9296.
Environment:
vAir temperature:
–Altitude: -60 to 1800 m(-197 ft to 6000
ft)
-BladeCenter Ton: 5° to 40° C(41° to
104° F)
-BladeCenter Ton (short term): -5° to
55° C(23° to 131° F)
–Altitude: 1800 mto 4000 (6000 ft to
13000 ft)
-BladeCenter Ton: 5° to 30° C(41° to
86° F)
-BladeCenter Ton (short term): -5° to
45° C(23° to 113° F)
–System unit off: uncontrolled
v
Rate of temperature change: 30° C/hour
(54° F/hour)
vHumidity:
–BladeCenter Tunit on: 5% to 85%
–BladeCenter Ton (short term): 5% to
90% not to exceed 0.024 water/kg of dry
air
–BladeCenter Tunit off: uncontrolled
Electrical input:
vdc power
vInput voltage: -38 Vdc to -75 Vdc (-48 V
nominal)
vInput current:
–Chassis: 70 amp maximum
–Single power-supply feed: 70 amp
maximum
Heat output:
vInput kilovolt-amperes (kVA) approximately
–Minimum configuration: 0.2 kVA
–Maximum configuration: 3.3 kVA
vBTU output
–Ship configuration:
673 BTU/hour (197 watts)
–Full configuration:
11229 BTU/hour (3291 watts)
6BladeCenter TTypes 8720 and 8730: Planning and Installation Guide