IBM 8677 - BladeCenter Rack-mountable - Power... Technical manual

BladeCenter
Type 8677
Planning and Installation Guide
GA27-4327-01
ERserver


BladeCenter
Type 8677
Planning and Installation Guide
GA27-4327-01
ER s e r v e r


Note:
Before using this information and the product it supports, read the general information in Appendix C,
“Notices,” on page 107.
Second Edition (August 2003)
© Copyright International Business Machines Corporation 2003. All rights reserved.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.

Preface
This book is intended for anyone who plans for the physical installation and
configuration of an IBM
®
ERserver BladeCenter
™
unit. This book is organized as
follows and should be used for these tasks:
v Use Chapter 1, “Introducing the BladeCenter unit,” on page 1 to understand the
overall purpose and usage of BladeCenter units and blade servers.
v Use Chapter 2, “BladeCenter unit components,” on page 9 to learn about the
physical components that make up a BladeCenter unit.
v Use Chapter 3, “Deployment considerations,” on page 21 to learn about network
topology considerations and deployment considerations.
v Use Chapter 4, “Installation considerations,” on page 41 and Appendix A,
“Planning worksheets,” on page 85 to plan for the physical environment for
installing BladeCenter units. This includes, space, power, cooling and cabling.
The worksheets provide the basis for selecting the features and options for each
blade server, where the blade server is installed in a BladeCenter unit and a rack
location for each BladeCenter unit.
v Use Chapter 5, “Configuration considerations,” on page 73 and Appendix B,
“Configuration Worksheets,” on page 95 to plan for the configuration of the:
– management module
– Ethernet switch modules
– Fibre channel switch modules
– Blade servers.
© Copyright IBM Corp. 2003 iii

iv BladeCenter Type 8677: Planning and Installation Guide

Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii
Chapter 1. Introducing the BladeCenter unit . . . . . . . . . . . . .1
Why choose the BladeCenter technology? . . . . . . . . . . . . . . .1
What the BladeCenter unit offers . . . . . . . . . . . . . . . . . .1
BladeCenter unit features . . . . . . . . . . . . . . . . . . . .3
Why blade servers? . . . . . . . . . . . . . . . . . . . . . . .4
Blade server benefits . . . . . . . . . . . . . . . . . . . . . .4
Deployment scenarios . . . . . . . . . . . . . . . . . . . . . .5
Where to go for more information . . . . . . . . . . . . . . . . . .6
BladeCenter documentation and operating system installation instructions . .6
Hardware Documentation . . . . . . . . . . . . . . . . . . .6
Redpapers and redpieces . . . . . . . . . . . . . . . . . . . .7
Operating system installation instructions . . . . . . . . . . . . . . .8
Web sites . . . . . . . . . . . . . . . . . . . . . . . . . .8
Chapter 2. BladeCenter unit components . . . . . . . . . . . . . . .9
Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . .9
Front view . . . . . . . . . . . . . . . . . . . . . . . . .10
Rear view . . . . . . . . . . . . . . . . . . . . . . . . . .10
Input/output connectors . . . . . . . . . . . . . . . . . . . . .11
Blade servers . . . . . . . . . . . . . . . . . . . . . . . . .12
Features and specifications . . . . . . . . . . . . . . . . . . .13
Management module . . . . . . . . . . . . . . . . . . . . . . .14
Power modules . . . . . . . . . . . . . . . . . . . . . . . . .15
Blowers . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Acoustic attenuation option . . . . . . . . . . . . . . . . . . . .16
Switch modules . . . . . . . . . . . . . . . . . . . . . . . . .16
Ethernet switch module . . . . . . . . . . . . . . . . . . . . .17
Standards . . . . . . . . . . . . . . . . . . . . . . . . .19
Fibre Channel switch module . . . . . . . . . . . . . . . . . . .20
Chapter 3. Deployment considerations . . . . . . . . . . . . . . .21
Network topologies . . . . . . . . . . . . . . . . . . . . . . .21
Integrated infrastructure . . . . . . . . . . . . . . . . . . . .21
Single BladeCenter chassis . . . . . . . . . . . . . . . . . .21
Multiple BladeCenter chassis . . . . . . . . . . . . . . . . . .23
Linux high performance cluster . . . . . . . . . . . . . . . . . .24
Cluster VLAN . . . . . . . . . . . . . . . . . . . . . . . .25
Server Farms . . . . . . . . . . . . . . . . . . . . . . . .26
Small server farm-central location-1 zone . . . . . . . . . . . . .26
Large server farm-central location-3 zones . . . . . . . . . . . . .27
Small server farm-remote locations-1 zone . . . . . . . . . . . . .28
Preparing for BladeCenter deployment . . . . . . . . . . . . . . . .29
Deployment tools . . . . . . . . . . . . . . . . . . . . . . .29
Deployment infrastructure . . . . . . . . . . . . . . . . . . . .30
Setting up the management connection . . . . . . . . . . . . . .31
Deployment Examples . . . . . . . . . . . . . . . . . . . . . .33
IBM Director and DHCP . . . . . . . . . . . . . . . . . . . .33
IBM Director without DHCP . . . . . . . . . . . . . . . . . . .34
Web-based interface . . . . . . . . . . . . . . . . . . . . . .36
Preparing for Blade Server deployment . . . . . . . . . . . . . . . .36
Hardware considerations . . . . . . . . . . . . . . . . . . . .36
© Copyright IBM Corp. 2003 v

Firmware considerations . . . . . . . . . . . . . . . . . . . .37
BIOS . . . . . . . . . . . . . . . . . . . . . . . . . .37
Operating system considerations . . . . . . . . . . . . . . . . .37
Windows 2000 installation considerations . . . . . . . . . . . . .37
Linux installation considerations . . . . . . . . . . . . . . . . .38
Red Hat Linux . . . . . . . . . . . . . . . . . . . . . .38
SuSE 8.0 . . . . . . . . . . . . . . . . . . . . . . . .39
Device driver considerations . . . . . . . . . . . . . . . . . . .39
Application considerations . . . . . . . . . . . . . . . . . . . .40
Chapter 4. Installation considerations . . . . . . . . . . . . . . .41
Physical planning . . . . . . . . . . . . . . . . . . . . . . . .41
Dimensions . . . . . . . . . . . . . . . . . . . . . . . . .41
Weight considerations . . . . . . . . . . . . . . . . . . . . .41
Floor space . . . . . . . . . . . . . . . . . . . . . . . . .41
Noise considerations . . . . . . . . . . . . . . . . . . . . . .42
Rack considerations . . . . . . . . . . . . . . . . . . . . . . .43
IBM NetBAY . . . . . . . . . . . . . . . . . . . . . . . . .43
Moving IBM NetBAY racks safely . . . . . . . . . . . . . . . . .44
Using non-IBM racks . . . . . . . . . . . . . . . . . . . . . .44
Power considerations . . . . . . . . . . . . . . . . . . . . . .45
Rack requirements . . . . . . . . . . . . . . . . . . . . . .45
Power distribution units (PDUs) . . . . . . . . . . . . . . . . .45
Wall and floor power drop requirements . . . . . . . . . . . . . . .48
Keyboard, video, and mouse . . . . . . . . . . . . . . . . . . .49
Electrical input . . . . . . . . . . . . . . . . . . . . . . . .49
Cooling considerations . . . . . . . . . . . . . . . . . . . . . .50
Air temperature and humidity . . . . . . . . . . . . . . . . . . .50
Air flow considerations . . . . . . . . . . . . . . . . . . . . .50
Prevention of air recirculation . . . . . . . . . . . . . . . . . .51
Room cooling . . . . . . . . . . . . . . . . . . . . . . . .51
Heat output . . . . . . . . . . . . . . . . . . . . . . . . .51
Power connections . . . . . . . . . . . . . . . . . . . . . . .51
Power layout example 1– single BladeCenter units . . . . . . . . . .52
Power layout sample 2 – two BladeCenter units in NetBAY 25 or 42U racks 54
Power layout sample 3 – three BladeCenter units in a NetBAY 25 or 42U
racks . . . . . . . . . . . . . . . . . . . . . . . . . . .56
Power layout sample 4 – four BladeCenter units in 42U racks . . . . . .58
Power layout sample 5 – five BladeCenter units in 42U racks . . . . . . .61
Power layout sample 6 – six BladeCenter units in 42U racks . . . . . . .65
Power layout sample 7 – four BladeCenter units in a NetBAY 42 Enterprise
rack . . . . . . . . . . . . . . . . . . . . . . . . . . .68
Power layout sample 8 – five BladeCenter units in a NetBAY 42U standard
rack . . . . . . . . . . . . . . . . . . . . . . . . . . .69
Power layout sample 9 – five BladeCenter units in a NetBAY 42 Enterprise
rack . . . . . . . . . . . . . . . . . . . . . . . . . . .70
Power layout sample 10 – six BladeCenter units in a NetBAY 42 Enterprise
rack . . . . . . . . . . . . . . . . . . . . . . . . . . .71
Physical installation time . . . . . . . . . . . . . . . . . . . . .72
Chapter 5. Configuration considerations . . . . . . . . . . . . . .73
Management module configuration planning . . . . . . . . . . . . . .73
General settings . . . . . . . . . . . . . . . . . . . . . . .73
Login Profiles . . . . . . . . . . . . . . . . . . . . . . . .73
Ethernet network interfaces . . . . . . . . . . . . . . . . . . .73
Alerts . . . . . . . . . . . . . . . . . . . . . . . . . . .74
vi BladeCenter Type 8677: Planning and Installation Guide

Network protocols . . . . . . . . . . . . . . . . . . . . . . .74
Security . . . . . . . . . . . . . . . . . . . . . . . . . .74
Ethernet switch module configuration planning . . . . . . . . . . . . .74
Switch settings . . . . . . . . . . . . . . . . . . . . . . . .75
Port settings . . . . . . . . . . . . . . . . . . . . . . . . .76
SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . .76
User accounts . . . . . . . . . . . . . . . . . . . . . . . .76
TFTP . . . . . . . . . . . . . . . . . . . . . . . . . . .76
Virtual LANs (VLANs) . . . . . . . . . . . . . . . . . . . . .77
VLAN example . . . . . . . . . . . . . . . . . . . . . . .77
Multicasting . . . . . . . . . . . . . . . . . . . . . . . . .79
Port mirroring . . . . . . . . . . . . . . . . . . . . . . . .79
Spanning tree . . . . . . . . . . . . . . . . . . . . . . . .80
Class of service . . . . . . . . . . . . . . . . . . . . . . .80
Link aggregation . . . . . . . . . . . . . . . . . . . . . . .80
Link aggregation group recommendations . . . . . . . . . . . . .81
Link aggregation example . . . . . . . . . . . . . . . . . .82
Link aggregation control protocol recommendations . . . . . . . . .82
Blade server configuration planning . . . . . . . . . . . . . . . . .83
Appendix A. Planning worksheets . . . . . . . . . . . . . . . . .85
Blade Server worksheet . . . . . . . . . . . . . . . . . . . . .86
8677 BladeCenter worksheet . . . . . . . . . . . . . . . . . . . .88
Rack worksheet . . . . . . . . . . . . . . . . . . . . . . . .90
Cabling worksheet . . . . . . . . . . . . . . . . . . . . . . .92
Power worksheet . . . . . . . . . . . . . . . . . . . . . . . .94
Appendix B. Configuration Worksheets . . . . . . . . . . . . . . .95
Management module configuration worksheet . . . . . . . . . . . . .95
Ethernet switch module configuration worksheet . . . . . . . . . . . . .98
Blade server configuration planning . . . . . . . . . . . . . . . . . 106
Appendix C. Notices . . . . . . . . . . . . . . . . . . . . . . 107
Edition notice . . . . . . . . . . . . . . . . . . . . . . . . . 107
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . 108
Important notes . . . . . . . . . . . . . . . . . . . . . . . . 108
Electronic emission notices . . . . . . . . . . . . . . . . . . . . 109
Federal Communications Commission (FCC) statement . . . . . . . . 109
Industry Canada Class A emission compliance statement . . . . . . . . 109
Australia and New Zealand Class A statement . . . . . . . . . . . .110
United Kingdom telecommunications safety requirement . . . . . . . .110
European Union EMC Directive conformance statement . . . . . . . .110
Taiwanese Class A warning statement . . . . . . . . . . . . . . .110
Japanese Voluntary Control Council for Interference (VCCI) statement . . . 111
Power cords . . . . . . . . . . . . . . . . . . . . . . . . . 111
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . .113
Contents vii

viii BladeCenter Type 8677: Planning and Installation Guide