IBM QS21 - BladeCenter - 0792 User manual

Welcome.
Thank you for buying an
IBM blade server.
For more information about your
BladeCenter components and
features, you can view the
publications on the
http://www.ibm.com/bladecenter/
Your blade
server features superior
performance, availability,
and scalability.
This
contains information for setting up,
configuring, and using your
blade server.
Additionally, a service information
label is attached to each BladeCenter
unit and blade server. This label
provides a graphical summary of
many of the installation and service
activities that are associated with
each device.
CD or download them from the
IBM Support Web site.
Go to
Installation and User’s Guide
Documentation
Installation and
User’s Guide
The blade server is now
ready to use. Be sure to
register and profile your
blade server on the
IBM Support Web site.
Before installing the BladeCenter QS21
in a BladeCenter unit, complete the
following procedures:
Install and configure the rack according
to the documentation that came with the rack.
Install the BladeCenter unit into the rack and
configure it, according to the documentation
that comes with the BladeCenter unit.
Supply input power to the BladeCenter unit.
Install the latest firmware in all BladeCenter
components.
Before you install the blade server into the
BladeCenter unit, install optional components
such as memory modules and expansion cards
in the blade server.
Install the blade server in the BladeCenter unit.
See Chapter 4 for more information.
BladeCenter QS21 Type 0792
Install the operating system.
See Chapter 6 for more information.
Install additional applications
according to the instructions that
come with the applications.
Configure the blade server.
See Chapter 5 for more information.

Server Support
Yes
No
No
See the troubleshooting
information that comes with
the server to determine
the cause of the problem
and the action to take.
Update the firmware to the
latest level.
No
No Software
Yes
Yes
Hardware
Is the server working
correctly?
Is the problem
solved?
Hardware or
software problem?
View support telephone numbers at
http://www.ibm.com/planetwide/.
View information about IBM Support Line at
or view support telephone numbers at
http://www.ibm.com/services/sl/products/
http://www.ibm.com/planetwide/.
Register the server. Go to
http://www.ibm.com/support/mysupport/.
Yes
Check all cables for loose connections
and verify that all optional devices you
installed are on the ServerProven list at
http://www.ibm.com/servers/eserver/
serverproven/compat/us/.
Is the problem
solved?
Is the problem
solved?

BladeCenter QS21 Ty pe 0792
Installation and User’s Guide


Note
Before using this information and the product it supports, read the general information in Appendix C, “Notices,” on page 81
and the Warranty and Support Information document for your blade server type on the Documentation CD.
Fifth Edition (September 2008)
©Copyright International Business Machines Corporation 2006, 2008.
US Government Users Restricted Rights –Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Contents
Safety ............................ vii
Chapter 1. Introduction ......................1
The BladeCenter QS21 ......................1
Features and specifications.....................1
Power configuration and power throttling ...............3
Boot support .........................3
Support for local storage .....................3
Major components of the blade server .................3
Reliability, availability, and serviceability features .............4
Registering your BladeCenter QS21 .................5
Checking for software and firmware updates ..............5
Notices and statements used in this document..............5
Using this book .........................6
Related documentation ......................6
The Documentation CD ......................7
Hardware and software requirements ................7
Using the Documentation Browser .................8
Chapter 2. Blade server power, controls, and indicators .........9
Turning on the blade server.....................9
Turning off the blade server ....................10
Blade server controls and LEDs...................11
System board LEDs .......................12
System board internal and expansion card connectors ..........13
Chapter 3. Installing the blade server ................15
Installation guidelines ......................15
Installing the BladeCenter QS21 ..................15
Chapter 4. Installing and removing replaceable units .........19
Installation guidelines ......................19
System reliability guidelines ...................19
Handling static-sensitive devices .................20
Removing the blade server from the BladeCenter unit ..........21
Removing the blade server ...................21
Opening and removing the blade server cover .............22
Removing the BladeCenter PCI Express I/O Expansion Unit ........22
Installing the optional InfiniBand card.................23
Adding I/O DDR2 memory modules .................26
Installing the SAS expansion card ..................27
Installing the BladeCenter PCI Express I/O Expansion Unit ........29
Removing the blade-server front bezel assembly ............31
Replacing the battery ......................31
Finishing the installation .....................34
Installing the front bezel assembly .................34
Closing the blade server cover ..................36
Input/output connectors and devices .................36
Chapter 5. Configuring the blade server...............37
Communicating with the blade server ................37
Using the Advanced Management Module ..............37
Using the Web interface ...................38
©Copyright IBM Corp. 2006, 2008 iii

Using the command-line interface ................38
Using Serial over LAN .....................38
Using the serial interface ....................39
Using the SMS utility program ..................39
Starting SMS .......................39
Viewing FRU information ...................40
Updating the system and BMC firmware ...............41
Updating steps ........................42
Determining current blade server firmware levels ...........42
Updating the BMC firmware ...................43
Using the BMC update package ................44
Using the Advanced Management Module .............44
Installing the system firmware ..................46
The firmware update package ..................47
Using the package .....................47
Updating the system firmware automatically ............48
Installing the firmware manually..................48
Updating the system firmware images ...............49
Updating the optional expansion card firmware .............49
Integrating the Gigabit Ethernet controller into the BladeCenter .......49
Updating the Ethernet controller firmware ...............50
Using the update package....................50
Firmware update steps .....................51
Blade server Ethernet controller enumeration ..............52
Finishing the configuration.....................52
Chapter 6. Installing the operating system ..............53
Preparing aboot device .....................53
Using aboot device on the network ................53
Configuring aSAS boot device ..................54
Preparing the installation source ..................56
Installing over the network....................56
Installing from the media tray...................56
Installing using an ISO image ..................56
Post installation configuration ...................56
Chapter 7. Solving problems ...................59
Prerequisites..........................59
Basic checks .........................59
Troubleshooting charts ......................60
Problems indicated by the front panel LEDs .............60
Power problems .......................61
Power throttling.......................61
Network connection problems ..................62
Service processor problems ...................62
Recovering the system firmware code ................63
Checking the boot image ....................63
Booting from the TEMP image ..................63
Recovering the TEMP image from the PERM image ..........63
System firmware startup messages .................63
Appendix A. Using the SMS utility .................65
Starting the SMS utility ......................65
The SMS utility menu ......................65
Select Language .......................66
Setup Remote IPL (Initial Program Load) ..............66
iv QS21 Installation and User’s Guide

IP Parameters .......................67
Adapter Configuration .....................68
Ping Test ..........................69
Advanced Setup: DHCP ....................69
Change SCSI Settings .....................69
Select Console ........................69
Select Boot Options ......................70
Firmware Boot Side Options ...................72
Progress Indicator History ....................72
FRU information .......................73
Adding FRU information ...................74
SAS Settings ........................76
Appendix B. Getting help and technical assistance ..........79
Before you call .........................79
Using the documentation .....................79
Getting help and information from the World Wide Web ..........79
Software service and support ...................80
Hardware service and support ...................80
Appendix C. Notices ......................81
Trademarks ..........................82
Important notes.........................82
Product recycling and disposal ...................83
Battery return program ......................84
Electronic emission notices ....................85
Federal Communications Commission (FCC) statement .........85
Industry Canada Class Aemission compliance statement ........86
Avis de conformité àla réglementation d’Industrie Canada ........86
Australia and New Zealand Class Astatement ............86
United Kingdom telecommunications safety requirement.........86
Deutschsprachiger EU Hinweis: Hinweis für Geräte der Klasse A
EU-Richtlinie zur Elektromagnetischen Verträglichkeit .........86
Deutschland: Einhaltung des Gesetzes über die elektromagnetische
Verträglichkeit von Geräten .................86
Zulassungsbescheinigung laut dem Deutschen Gesetz über die
elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der EMC
EG Richtlinie 2004/108/EG) für Geräte der Klasse A........86
European Union EMC Directive conformance statement .........87
Taiwanese Class Awarning statement ...............87
Japanese Voluntary Control Council for Interference (VCCI) statement ...88
Korean Class Awarning statement ................88
Index ............................89
Contents v

vi QS21 Installation and User’s Guide

Safety
Before installing this product, read the Safety Information.
Antes de instalar este produto, leia as Informações de Segurança.
Pred instalací tohoto produktu si prectete prírucku bezpecnostních instrukcí.
Læs sikkerhedsforskrifterne, før du installerer dette produkt.
Lees voordat udit product installeert eerst de veiligheidsvoorschriften.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.
Avant d’installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.
Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.
Antes de instalar este produto, leia as Informações sobre Segurança.
©Copyright IBM Corp. 2006, 2008 vii

Antes de instalar este producto, lea la información de seguridad.
Läs säkerhetsinformationen innan du installerar den här produkten.
Important:
All caution and danger statements in this documentation begin with a
number. This number is used to cross reference an English caution or
danger statement with translated versions of the caution or danger
statement in the IBM Safety Information book.
For example, if acaution statement begins with anumber 1,
translations for that caution statement appear in the IBM Safety
Information book under statement 1.
Be sure to read all caution and danger statements in this
documentation before performing the instructions. Read any additional
safety information that comes with the blade server or optional device
before you install the device.
viii QS21 Installation and User’s Guide

Statement 1:
DANGER
Electrical current from power, telephone, and communication cables is
hazardous.
To avoid ashock hazard:
vDo not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
vConnect all power cords to aproperly wired and grounded electrical
outlet.
vConnect to properly wired outlets any equipment that will be attached to
this product.
vWhen possible, use one hand only to connect or disconnect signal
cables.
vNever turn on any equipment when there is evidence of fire, water, or
structural damage.
vDisconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
vConnect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached
devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
Safety ix

Statement 2:
CAUTION:
When replacing the lithium battery, use only IBM Part Number 43W9859 or
03N2449 or an equivalent type battery recommended by the manufacturer. If
your system has amodule containing alithium battery, replace it only with
the same module type made by the same manufacturer. The battery contains
lithium and can explode if not properly used, handled, or disposed of.
Do not:
vThrow or immerse into water
vHeat to more than 100°C (212°F)
vRepair or disassemble
Dispose of the battery as required by local ordinances or regulations.
xQS21 Installation and User’s Guide

Statement 3:
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or
transmitters) are installed, note the following:
vDo not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
vUse of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
Class 1 Laser Product
Laser Klasse 1
Laser Klass 1
Luokan 1 Laserlaite
Appareil A Laser de Classe 1
`
Safety xi

Statement 4:
≥18 kg (39.7 lb) ≥32 kg (70.5 lb) ≥55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
1
2
xii QS21 Installation and User’s Guide

Statement 8:
CAUTION:
Never remove the cover on apower supply or any part that has the following
label attached.
Hazardous voltage, current, and energy levels are present inside any
component that has this label attached. There are no serviceable parts inside
these components. If you suspect aproblem with one of these parts, contact
aservice technician.
Statement 13:
DANGER
Overloading abranch circuit is potentially afire hazard and ashock hazard
under certain conditions. To avoid these hazards, ensure that your system
electrical requirements do not exceed branch circuit protection
requirements. Refer to the information that is provided with your device for
electrical specifications.
Statement 21:
CAUTION:
Hazardous energy is present when the blade is connected to the power
source. Always replace the blade cover before installing the blade.
Safety xiii

WARNING: Handling the cord on this product or cords associated with accessories
sold with this product, will expose you to lead, achemical known to the State of
California to cause cancer, and birth defects or other reproductive harm. Wash
hands after handling.
ADVERTENCIA: El contacto con el cable de este producto ocon cables de
accesorios que se venden junto con este producto, pueden exponerle al plomo, un
elemento químico que en el estado de California de los Estados Unidos está
considerado como un causante de cancer yde defectos congénitos, además de
otros riesgos reproductivos. Lávese las manos después de usar el producto.
xiv QS21 Installation and User’s Guide

Chapter 1. Introduction
This chapter gives an overview of the features of the IBM®BladeCenter®QS21 and
what options are available.
The BladeCenter QS21
The high performance BladeCenter QS21 is based on the 64-bit Cell Broadband
Engine™(Cell/B.E.) processor with afrequency of 3.2 GHz. Two processors are
supported per blade and are directly mounted on the blade planar board to provide
multiprocessing capability. Each processor includes 32/32 KB L1 (data/instruction)
and 512 KB L2 cache.
The Cell/B.E. implementation of the broadband processor architecture includes one
PowerPC®Processor Element (PPE) element and eight synergistic processing
elements (SPE). Each SPE includes one synergistic processing unit (SPU) with its
own local store (LS), and one dedicated memory flow controller (MFC), which has
an associated memory management unit (MMU) to hold and process memory
protection and access permission information. To facilitate data flow on-chip and
externally, the Cell/B.E. also implements the broadband engine bus and other I/O
structures. The memory subsystem on BladeCenter QS21 consists of 18 XDR
memory modules per Cell/B.E. chip, creating 1GB of error checking and correction
(ECC) memory per Cell/B.E. chip. The system board therefore has atotal of 2GB
system memory.
There is ahigh speed RAMBUS interface to the processor, aPCI-X connector for
BladeCenter I/O extension cards, a4x PCI-Express channel providing high speed
I/O, a1Gigabit Ethernet NIC, aUART and an external bus controller. Attached to
the external bus are aFlash EPROM device (8 Mbyte), 1MB of battery-backed
NVRAM and battery-backed real-time clock (RTC).
The local service processor supports environmental monitoring, front panel, chip
initialization and the BladeCenter unit Advanced Management Module interface.
To ensure compatibility with existing blades, the BladeCenter QS21 provides two
midplane connectors. These connectors contain Gigabit Ethernet links, USB ports
(for support of BladeCenter unit media tray devices), power and aunit management
bus. The blade includes support for an optional InfiniBand expansion card and an
optional Serial Attached SCSI (SAS) card.
For more information about the processor itself, see http://www.ibm.com/
developerworks/power/cell.
Features and specifications
The BladeCenter QS21 is ahigh-density, high-performance multiprocessor server
system. It is based on the Cell Broadband Engine processor (Cell/B.E.) and
provides leading edge performance density with its single wide 2-way blade server.
©Copyright IBM Corp. 2006, 2008 1

The BladeCenter QS21 conforms to the generic BladeCenter infrastructure and is
designed for operation with the high-speed interconnect in the following
BladeCenter units:
vBladeCenter HType 8852
vBladeCenter HT Types 8740 and 8750 (enterprise environment only)
vBladeCenter STypes 7779 and 8886 (non RAID type only)
BladeCenter QS21 support is only available for the BladeCenter units listed above.
The BladeCenter QS21 has the following major components:
v2Cell/B.E. processor chips (Cell/B.E.-0 and Cell/B.E.-1) operating at 3.2 GHz
v2GB XDR system memory with ECC, 1GB per Cell/B.E. chip
v2Cell/B.E. companion chips, one per Cell/B.E. chip
v2x16 lanes PCIe, 2masters per Cell/B.E. companion chip
v1PCI-X bus per Cell/B.E. companion chip, running at 100 MHz
vInterface to optional DDR2 memory, for use as the I/O Buffer
vOnboard Dual Channel Gb-Ethernet controller BCM5704S
vOnboard USB controller NEC uPD720101
v1BladeCenter PCI-X expansion card connector
v1BladeCenter High-Speed connector for 2x8PCIe buses
v1Special additional I/O expansion connector for 2x16 PCIe buses
v4DIMM slots (2 slots per Cell/B.E. companion chip) for optional I/O Buffer DDR2
VLP DIMMs
vIntegrated Renesas 2166 Service processor (BMC, IPMI compliant code stack)
The average maximum for power budgeting is 300 Wfor aQS21 blade server
without options.
Figure 1. BladeCenter QS21
2QS21 Installation and User’s Guide

Through the BladeCenter Advanced Management Module Web interface, you can
view the blade server firmware code and other hardware configuration information.
Note: Power, cooling, removable-media drives, external ports, and advanced
system management are provided by the IBM BladeCenter. For more
information, see the relevant BladeCenter guide.
Power configuration and power throttling
Each blade server is powered by two BladeCenter redundant power-supply
modules. By enforcing apower policy known as power domain oversubscription, the
BladeCenter unit can share the power load between two power modules to ensure
efficient power for each device in the BladeCenter unit. This policy is enforced when
the initial power is applied to the BladeCenter unit or when ablade server is
inserted into the BladeCenter unit. You can configure and monitor the power
environment by using the management module.
For more information about configuring power, see the management-module
documentation.
Boot support
The BladeCenter QS21 can boot from:
vThe optical drive of the BladeCenter unit media tray
vASAS storage device, typically one or more hard disks attached to the
BladeCenter unit
vAstorage device attached to the network
Support for local storage
The BladeCenter provides aSAS solution for local storage. This comprises aSAS
Expansion Card attached to the blade server, aSAS switch in the rear of the
chassis, and various options to attach storage to that integrated SAS switch. An
optional SAS Expansion Card is available for the BladeCenter QS21.
Storage can be attached via the external SAS host controller. The BladeCenter
QS21 supports the SAS drives of the IBM System Storage™DS3200 and the IBM
System Storage EXP3000 expansion unit. Check the IBM BladeCenter support Web
site for details of supported SAS drives at http://www.ibm.com/systems/bladecenter/
support/.
Major components of the blade server
In order to see the components of the BladeCenter QS21 you must remove it from
the BladeCenter unit and remove the cover. Figure 2on page 4shows the major
components of the blade server.
Chapter 1. Introduction 3

Both Cell/B.E. processors and Cell/B.E. companion chips are underneath the heat
sinks and therefore not visible. The Cell/B.E. processors and the system XDR
memory are soldered onto the system board and are not removable.
Reliability, availability, and serviceability features
Three important features in server design are reliability, availability, and
serviceability (RAS). These RAS features are designed to help ensure that your
blade server is available when you want to use it; and, in the event of afailure, help
you easily diagnose and repair the failure with minimal inconvenience.
The following is alist of some of the RAS features that your blade server supports:
vTransparent CPU Hardware error recovery
vECC for XDR and DDR2 memory
vPFA for CEs on the Cell/B.E. companion chip attached I/O Buffer DDR2 DIMMs
vMemory Scrubbing on XDR system memory
vXDR System memory failure isolation for memory errors to asingle memory
interface (Cell/B.E.-0 or Cell/B.E.-1 attached)
vDDR2 I/O Buffer memory failure isolation to asingle DIMM
vPCI Bus Parity
Blade level features include:
vDegraded boot for both XDR and DDR2 memory errors. XDR memory errors
may create holes in the memory map.
vAutomatic server recovery and restart:
–Automatic reboot after boot hangs (with switch of the boot flash to the backup
image)
–Automatic reboot after checkstop (without switch of the boot flash side)
v
Environmental monitors and alerts
vSystem VPD and VPD on all major electronic components
vLightbox LEDs
vSystem Management Services (SMS) menu support
vCheckstop detection with data logging and automated reboot
The BladeCenter unit supports the following features:
System XDR
memory
Expansion
option
connectors
Light path
diagnostics
switch Light box Battery I/O buffer DIMM slots
I/O buffer DIMM slots Heat sinks
1
Figure 2. BladeCenter components
4QS21 Installation and User’s Guide