Compaq TruCluster Server AA-RHGWC-TE User manual

TruCluster Server
Hardware Configuration
Part Number: AA-RHGWC-TE
August 2000
Product Version: TruCluster Server Version 5.1
Operating System and Version: Tru64 UNIX Version 5.1
This manual describes how to configure the hardware for a TruCluster™
Server environment. TruCluster Server Version 5.1 runs on the
Tru64™ UNIX operating system.
Compaq Computer Corporation
Houston, Texas

© 2000 Compaq Computer Corporation
COMPAQ and the Compaq logo Registered in U.S. Patent and Trademark Office. Alpha, AlphaServer,
StorageWorks, TruCluster, and Tru64 are trademarks of Compaq Information Technologies Group, L.P.
Microsoft and Windows are trademarks of Microsoft Corporation. UNIX and The Open Group are
trademarks of The Open Group. All other product names mentioned herein may be trademarks or
registered trademarks of their respective companies.
Cover photo: Digital imagery ®copyright 1999 PhotoDisc, Inc.
Confidential computer software. Valid license from Compaq required for possession, use, or copying.
Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software
Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under
vendor’s standard commercial license.
Compaq shall not be liable for technical or editorial errors or omissions contained herein. The information
in this document is subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY
KIND. THE ENTIRE RISK ARISING OUT OF THE USE OF THIS INFORMATION REMAINS WITH
RECIPIENT. IN NO EVENT SHALL COMPAQ BE LIABLE FOR ANY DIRECT, CONSEQUENTIAL,
INCIDENTAL, SPECIAL, PUNITIVE, OR OTHER DAMAGES WHATSOEVER (INCLUDING WITHOUT
LIMITATION, DAMAGES FOR LOSS OF BUSINESS PROFITS, BUSINESS INTERRUPTION OR LOSS
OF BUSINESS INFORMATION), EVEN IF COMPAQ HAS BEEN ADVISED OF THE POSSIBILITY
OF SUCH DAMAGES AND WHETHER IN AN ACTION OF CONTRACT OR TORT, INCLUDING
NEGLIGENCE.
The limited warranties for Compaq products are exclusively set forth in the documentation
accompanying such products. Nothing herein should be construed as constituting a further or
additional warranty.

Contents
About This Manual
1 Introduction
1.1 The TruCluster Server Product ..................................... 1–1
1.2 Memory Requirements ............................................... 1–2
1.3 Minimum Disk Requirements ...................................... 1–2
1.3.1 Disks Needed for Installation .................................. 1–2
1.3.1.1 Tru64 UNIX Operating System Disk ..................... 1–2
1.3.1.2 Clusterwide Disk(s) ......................................... 1–3
1.3.1.3 Member Boot Disk .......................................... 1–3
1.3.1.4 Quorum Disk ................................................. 1–4
1.4 Generic Two-Node Cluster ........................................... 1–4
1.5 Growing a Cluster from Minimum Storage to a NSPOF
Cluster .................................................................. 1–6
1.5.1 Two-Node Clusters Using an UltraSCSI BA356 Storage
Shelf and Minimum Disk Configurations .................... 1–7
1.5.2 Two-Node Clusters Using UltraSCSI BA356 Storage Units
with Increased Disk Configurations .......................... 1–9
1.5.3 Two-Node Configurations with UltraSCSI BA356 Storage
Units and Dual SCSI Buses .................................... 1–11
1.5.4 Using Hardware RAID to Mirror the Clusterwide Root
File System and Member System Boot Disks ................ 1–12
1.5.5 Creating a NSPOF Cluster ..................................... 1–14
1.6 Overview of Setting Up the TruCluster Server Hardware
Configuration .......................................................... 1–16
2 Hardware Requirements and Restrictions
2.1 TruCluster Server Member System Requirements .............. 2–1
2.2 Memory Channel Restrictions ...................................... 2–3
2.3 Host Bus Adapter Restrictions ..................................... 2–5
2.3.1 Fibre Channel Requirements and Restrictions .............. 2–5
2.3.2 KZPSA-BB SCSI Adapter Restrictions ....................... 2–8
2.3.3 KZPBA-CB SCSI Bus Adapter Restrictions ................. 2–9
2.4 Disk Device Restrictions ............................................. 2–9
2.5 RAID Array Controller Restrictions ............................... 2–9
Contents iii

2.6 SCSI Signal Converters .............................................. 2–10
2.7 DS-DWZZH-03 and DS-DWZZH-05 UltraSCSI Hubs ........... 2–11
2.8 SCSI Cables ............................................................ 2–12
2.9 SCSI Terminators and Trilink Connectors ........................ 2–14
3 Shared SCSI Bus Requirements and Configurations Using
UltraSCSI Hardware
3.1 Shared SCSI Bus Configuration Requirements .................. 3–2
3.2 SCSI Bus Performance ............................................... 3–3
3.2.1 SCSI Bus Versus SCSI Bus Segments ........................ 3–3
3.2.2 Transmission Methods .......................................... 3–4
3.2.3 Data Path ......................................................... 3–5
3.2.4 Bus Speed ......................................................... 3–5
3.3 SCSI Bus Device Identification Numbers ........................ 3–5
3.4 SCSI Bus Length ...................................................... 3–6
3.5 Terminating the Shared SCSI Bus When Using UltraSCSI
Hubs .................................................................... 3–7
3.6 UltraSCSI Hubs ....................................................... 3–8
3.6.1 Using a DWZZH UltraSCSI Hub in a Cluster
Configuration ..................................................... 3–8
3.6.1.1 DS-DWZZH-03 Description ................................ 3–9
3.6.1.2 DS-DWZZH-05 Description ................................ 3–10
3.6.1.2.1 DS-DWZZH-05 Configuration Guidelines .......... 3–10
3.6.1.2.2 DS-DWZZH-05 Fair Arbitration ..................... 3–12
3.6.1.2.3 DS-DWZZH-05 Address Configurations ............ 3–13
3.6.1.2.4 SCSI Bus Termination Power ......................... 3–15
3.6.1.2.5 DS-DWZZH-05 Indicators ............................. 3–15
3.6.1.3 Installing the DS-DWZZH-05 UltraSCSI Hub .......... 3–15
3.7 Preparing the UltraSCSI Storage Configuration ................ 3–16
3.7.1 Configuring Radially Connected TruCluster Server
Clusters with UltraSCSI Hardware ........................... 3–17
3.7.1.1 Preparing an HSZ70 or HSZ80 for a Shared SCSI Bus
Using Transparent Failover Mode ........................ 3–18
3.7.1.2 Preparing a Dual-Redundant HSZ70 or HSZ80 for a
Shared SCSI Bus Using Multiple-Bus Failover ........ 3–22
4 TruCluster Server System Configuration Using UltraSCSI
Hardware
4.1 Planning Your TruCluster Server Hardware Configuration ... 4–2
4.2 Obtaining the Firmware Release Notes ........................... 4–4
4.3 TruCluster Server Hardware Installation ........................ 4–5
iv Contents

4.3.1 Installation of a KZPBA-CB Using Internal Termination
for a Radial Configuration ...................................... 4–7
4.3.2 Displaying KZPBA-CB Adapters with the show Console
Commands ........................................................ 4–10
4.3.3 Displaying Console Environment Variables and Setting
the KZPBA-CB SCSI ID ........................................ 4–14
4.3.3.1 Displaying KZPBA-CB pk* or isp* Console
Environment Variables ..................................... 4–15
4.3.3.2 Setting the KZPBA-CB SCSI ID .......................... 4–17
4.3.3.3 KZPBA-CB Termination Resistors ........................ 4–17
5 Setting Up the Memory Channel Cluster Interconnect
5.1 Setting the Memory Channel Adapter Jumpers ................ 5–2
5.1.1 MC1 and MC1.5 Jumpers ....................................... 5–2
5.1.2 MC2 Jumpers ..................................................... 5–3
5.2 Installing the Memory Channel Adapter .......................... 5–6
5.3 Installing the MC2 Optical Converter in the Member System 5–6
5.4 Installing the Memory Channel Hub .............................. 5–7
5.5 Installing the Memory Channel Cables ........................... 5–7
5.5.1 Installing the MC1 or MC1.5 Cables .......................... 5–7
5.5.1.1 Connecting MC1 or MC1.5 Link Cables in Virtual Hub
Mode ........................................................... 5–8
5.5.1.2 Connecting MC1 Link Cables in Standard Hub Mode . 5–8
5.5.2 Installing the MC2 Cables ...................................... 5–9
5.5.2.1 Installing the MC2 Cables for Virtual Hub Mode
Without Optical Converters ............................... 5–9
5.5.2.2 Installing MC2 Cables in Virtual Hub Mode Using
Optical Converters .......................................... 5–10
5.5.2.3 Connecting MC2 Link Cables in Standard Hub Mode
(No Fiber Optics) ............................................ 5–10
5.5.2.4 Connecting MC2 Cables in Standard Hub Mode Using
Optical Converters .......................................... 5–10
5.6 Running Memory Channel Diagnostics ........................... 5–11
5.7 Upgrading Memory Channel Adapters ............................ 5–14
6 Using Fibre Channel Storage
6.1 Procedure for Installation Using Fibre Channel Disks ......... 6–2
6.2 Fibre Channel Overview ............................................. 6–4
6.2.1 Basic Fibre Channel Terminology ............................. 6–5
6.2.2 Fibre Channel Topologies ....................................... 6–6
6.2.2.1 Point-to-Point ................................................ 6–6
Contents v

6.2.2.2 Fabric ......................................................... 6–7
6.2.2.3 Arbitrated Loop Topology .................................. 6–8
6.3 Example Fibre Channel Configurations Supported by
TruCluster Server ..................................................... 6–9
6.3.1 Fibre Channel Cluster Configurations for Transparent
Failover Mode ..................................................... 6–10
6.3.2 Fibre Channel Cluster Configurations for Multiple-Bus
Failover Mode ..................................................... 6–11
6.4 Zoning and Cascaded Switches ..................................... 6–14
6.4.1 Zoning .............................................................. 6–14
6.4.2 Cascaded Switches ............................................... 6–15
6.5 Installing and Configuring Fibre Channel Hardware ........... 6–16
6.5.1 Installing and Setting Up the Fibre Channel Switch ...... 6–16
6.5.1.1 Installing the Switch ........................................ 6–17
6.5.1.2 Managing the Fibre Channel Switches .................. 6–18
6.5.1.2.1 Using the Switch Front Panel ........................ 6–19
6.5.1.2.2 Setting the Ethernet IP Address and Subnet Mask
from the Front Panel ................................... 6–19
6.5.1.2.3 Setting the DS-DSGGB-AA and DS-DSGGC-AA
Ethernet IP Address and Subnet Mask from a PC
or Terminal .............................................. 6–21
6.5.1.2.4 Logging In to the Switch with a Telnet Connection 6–22
6.5.1.2.5 Setting the Switch Name via Telnet Session ....... 6–23
6.5.2 Installing and Configuring the KGPSA PCI-to-Fibre
Channel Adapter Module ....................................... 6–23
6.5.2.1 Installing the KGPSA PCI-to-Fibre Channel Adapter
Module ........................................................ 6–23
6.5.2.2 Setting the KGPSA-BC or KGPSA-CA to Run on a
Fabric ......................................................... 6–24
6.5.2.3 Obtaining the Worldwide Names of KGPSA Adapters 6–27
6.5.3 Setting Up the HSG80 Array Controller for Tru64 UNIX
Installation ........................................................ 6–28
6.5.3.1 Obtaining the Worldwide Names of HSG80 Controller 6–33
6.6 Installing Tru64 UNIX and TruCluster Server Software Using
Fibre Channel Storage ............................................... 6–34
6.6.1 Before You Install ................................................ 6–36
6.6.1.1 Configure the HSG80 Storagesets ........................ 6–36
6.6.1.2 Adding Units and Identifiers to the HSG80
Storagesets ................................................... 6–40
6.6.1.3 Set the Device Unit Number ............................... 6–43
6.6.1.4 Displaying the Available Boot Devices ................... 6–48
6.6.1.5 Set the bootdef_dev Console Environment Variable for
Tru64 UNIX Installation ................................... 6–49
vi Contents

6.6.2 Install the Tru64 UNIX Operating System .................. 6–51
6.6.3 Determining /dev/disk/dskn to Use for a Cluster
Installation ........................................................ 6–51
6.6.4 Label the Disks to Be Used to Create the Cluster .......... 6–53
6.6.5 Install the TruCluster Server Software and Create the
First Cluster Member ........................................... 6–53
6.6.6 Reset the bootdef_dev Console Environment Variable ..... 6–53
6.6.7 Add Additional Systems to the Cluster ....................... 6–55
6.7 Converting the HSG80 from Transparent to Multiple-Bus
Failover Mode ......................................................... 6–57
6.7.1 Overview .......................................................... 6–58
6.7.2 Procedure to Convert from Transparent to Multiple-bus
Failover Mode ..................................................... 6–59
6.8 Using the emx Manager to Display Fibre Channel Adapter
Information ............................................................ 6–62
6.8.1 Using the emxmgr Utility to Display Fibre Channel
Adapter Information ............................................. 6–62
6.8.2 Using the emxmgr Utility Interactively ...................... 6–65
7 Using GS80, GS160, or GS320 Hard Partitions in a TruCluster
Server Configuration
7.1 Overview ............................................................... 7–1
7.2 Hardware Requirements for a Hard Partition in a Cluster .... 7–2
7.3 Configuring Partitioned GS80, GS160, or GS320 Systems in a
TruCluster Configuration ............................................ 7–7
7.3.1 Repartitioning a Single-Partition AlphaServer
GS80/160/320 as Two Partitions in a Cluster ................ 7–7
7.4 Determining AlphaServer GS80/160/320 System
Configuration .......................................................... 7–14
7.5 Updating GS80/160/320 Firmware ................................. 7–18
7.5.1 Updating AlphaServer GS80/160/320 Firmware ............ 7–18
8 Configuring a Shared SCSI Bus for Tape Drive Use
8.1 Preparing the TZ88 for Shared Bus Usage ....................... 8–1
8.1.1 Setting the TZ88N-VA SCSI ID ............................... 8–2
8.1.2 Cabling the TZ88N-VA .......................................... 8–3
8.1.3 Setting the TZ88N-TA SCSI ID ............................... 8–5
8.1.4 Cabling the TZ88N-TA .......................................... 8–5
8.2 Preparing the TZ89 for Shared SCSI Usage ...................... 8–6
8.2.1 Setting the DS-TZ89N-VW SCSI ID .......................... 8–6
Contents vii

8.2.2 Cabling the DS-TZ89N-VW Tape Drives ..................... 8–8
8.2.3 Setting the DS-TZ89N-TA SCSI ID ........................... 8–9
8.2.4 Cabling the DS-TZ89N-TA Tape Drives ...................... 8–9
8.3 Compaq 20/40 GB DLT Tape Drive ................................ 8–10
8.3.1 Setting the Compaq 20/40 GB DLT Tape Drive SCSI ID .. 8–10
8.3.2 Cabling the Compaq 20/40 GB DLT Tape Drive ............. 8–11
8.4 Compaq 40/80-GB DLT Drive ....................................... 8–14
8.4.1 Setting the Compaq 40/80-GB DLT Drive SCSI ID ........ 8–14
8.4.2 Cabling the Compaq 40/80-GB DLT Drive ................... 8–15
8.5 Preparing the TZ885 for Shared SCSI Usage .................... 8–17
8.5.1 Setting the TZ885 SCSI ID .................................... 8–17
8.5.2 Cabling the TZ885 Tape Drive ................................ 8–18
8.6 Preparing the TZ887 for Shared SCSI Bus Usage ............... 8–20
8.6.1 Setting the TZ887 SCSI ID .................................... 8–20
8.6.2 Cabling the TZ887 Tape Drive ................................ 8–21
8.7 Preparing the TL891 and TL892 DLT MiniLibraries for
Shared SCSI Usage ................................................... 8–23
8.7.1 Setting the TL891 or TL892 SCSI ID ......................... 8–23
8.7.2 Cabling the TL891 or TL892 MiniLibraries ................. 8–25
8.8 Preparing the TL890 DLT MiniLibrary Expansion Unit ....... 8–29
8.8.1 TL890 DLT MiniLibrary Expansion Unit Hardware ....... 8–29
8.8.2 Preparing the DLT MiniLibraries for Shared SCSI Bus
Usage .............................................................. 8–29
8.8.2.1 Cabling the DLT MiniLibraries ........................... 8–30
8.8.2.2 Configuring a Base Module as a Slave ................... 8–33
8.8.2.3 Powering Up the DLT MiniLibrary ....................... 8–34
8.8.2.4 Setting the TL890/TL891/TL892 SCSI ID ............... 8–35
8.9 Preparing the TL894 DLT Automated Tape Library for Shared
SCSI Bus Usage ....................................................... 8–36
8.9.1 TL894 Robotic Controller Required Firmware .............. 8–37
8.9.2 Setting TL894 Robotics Controller and Tape Drive SCSI
IDs .................................................................. 8–37
8.9.3 TL894 Tape Library Internal Cabling ........................ 8–39
8.9.4 Connecting the TL894 Tape Library to the Shared SCSI
Bus ................................................................. 8–41
8.10 Preparing the TL895 DLT Automated Tape Library for Shared
SCSI Bus Usage ....................................................... 8–43
8.10.1 TL895 Robotic Controller Required Firmware .............. 8–44
8.10.2 Setting the TL895 Tape Library SCSI IDs ................... 8–44
8.10.3 TL895 Tape Library Internal Cabling ........................ 8–45
8.10.4 Upgrading a TL895 .............................................. 8–47
viii Contents

8.10.5 Connecting the TL895 Tape Library to the Shared SCSI
Bus ................................................................. 8–48
8.11 Preparing the TL893 and TL896 Automated Tape Libraries
for Shared SCSI Bus Usage ......................................... 8–48
8.11.1 Communications with the Host Computer ................... 8–50
8.11.2 MUC Switch Functions ......................................... 8–50
8.11.3 Setting the MUC SCSI ID ...................................... 8–51
8.11.4 Tape Drive SCSI IDs ............................................ 8–51
8.11.5 TL893 and TL896 Automated Tape Library Internal
Cabling ............................................................. 8–52
8.11.6 Connecting the TL893 and TL896 Automated Tape
Libraries to the Shared SCSI Bus ............................. 8–54
8.12 Preparing the TL881 and TL891 DLT MiniLibraries for
Shared Bus Usage .................................................... 8–57
8.12.1 TL881 and TL891 DLT MiniLibraries Overview ............ 8–57
8.12.1.1 TL881 and TL891 DLT MiniLibrary Tabletop Model .. 8–57
8.12.1.2 TL881 and TL891 MiniLibrary Rackmount
Components ................................................. 8–58
8.12.1.3 TL881 and TL891 Rackmount Scalability ............... 8–59
8.12.1.4 DLT MiniLibrary Part Numbers .......................... 8–60
8.12.2 Preparing a TL881 or TL891 MiniLibrary for Shared SCSI
BusUse ............................................................ 8–61
8.12.2.1 Preparing a Tabletop Model or Base Unit for
Standalone Shared SCSI Bus Usage ..................... 8–61
8.12.2.1.1 Setting the Standalone MiniLibrary Tape Drive
SCSI ID .................................................. 8–62
8.12.2.1.2 Cabling the TL881 or TL891 DLT MiniLibrary .... 8–63
8.12.2.2 Preparing a TL881 or TL891 Rackmount MiniLibrary
for Shared SCSI Bus Usage ................................ 8–67
8.12.2.2.1 Cabling the Rackmount TL881 or TL891 DLT
MiniLibrary ............................................. 8–67
8.12.2.2.2 Configuring a Base Unit as a Slave to the
Expansion Unit ......................................... 8–70
8.12.2.2.3 Powering Up the TL881/TL891 DLT MiniLibrary . 8–71
8.12.2.2.4 Setting the SCSI IDs for a Rackmount TL881 or
TL891 DLT MiniLibrary ............................... 8–72
8.13 Compaq ESL9326D Enterprise Library ........................... 8–73
8.13.1 General Overview ................................................ 8–73
8.13.2 ESL9326D Enterprise Library Overview ..................... 8–74
8.13.3 Preparing the ESL9326D Enterprise Library for Shared
SCSI Bus Usage .................................................. 8–74
Contents ix

8.13.3.1 ESL9326D Enterprise Library Robotic and Tape Drive
Required Firmware ......................................... 8–75
8.13.3.2 Library Electronics and Tape Drive SCSI IDs .......... 8–75
8.13.3.3 ESL9326D Enterprise Library Internal Cabling ....... 8–75
8.13.3.4 Connecting the ESL9326D Enterprise Library to the
Shared SCSI Bus ............................................ 8–77
9 Configurations Using External Termination or Radial Connections
to Non-UltraSCSI Devices
9.1 Using SCSI Bus Signal Converters ................................ 9–2
9.1.1 Types of SCSI Bus Signal Converters ......................... 9–2
9.1.2 Using the SCSI Bus Signal Converters ....................... 9–3
9.1.2.1 DWZZA and DWZZB Signal Converter Termination .. 9–3
9.1.2.2 DS-BA35X-DA Termination ............................... 9–4
9.2 Terminating the Shared SCSI Bus ................................. 9–5
9.3 Overview of Disk Storage Shelves .................................. 9–8
9.3.1 BA350 Storage Shelf ............................................. 9–9
9.3.2 BA356 Storage Shelf ............................................. 9–10
9.3.2.1 Non-UltraSCSI BA356 Storage Shelf .................... 9–10
9.3.2.2 UltraSCSI BA356 Storage Shelf .......................... 9–13
9.4 Preparing the Storage for Configurations Using External
Termination ............................................................ 9–14
9.4.1 Preparing BA350, BA356, and UltraSCSI BA356 Storage
Shelves for an Externally Terminated TruCluster Server
Configuration ..................................................... 9–15
9.4.1.1 Preparing a BA350 Storage Shelf for Shared SCSI
Usage .......................................................... 9–15
9.4.1.2 Preparing a BA356 Storage Shelf for Shared SCSI
Usage .......................................................... 9–16
9.4.1.3 Preparing an UltraSCSI BA356 Storage Shelf for a
TruCluster Configuration .................................. 9–17
9.4.2 Connecting Storage Shelves Together ........................ 9–17
9.4.2.1 Connecting a BA350 and a BA356 for Shared SCSI
Bus Usage .................................................... 9–18
9.4.2.2 Connecting Two BA356s for Shared SCSI Bus Usage . 9–20
9.4.2.3 Connecting Two UltraSCSI BA356s for Shared SCSI
Bus Usage .................................................... 9–22
9.4.3 Cabling a Non-UltraSCSI RAID Array Controller to an
Externally Terminated Shared SCSI Bus .................... 9–24
9.4.3.1 Cabling an HSZ40 or HSZ50 in a Cluster Using
External Termination ....................................... 9–25
x Contents

9.4.3.2 Cabling an HSZ20 in a Cluster Using External
Termination .................................................. 9–28
9.4.4 Cabling an HSZ40 or HSZ50 RAID Array Controller in a
Radial Configuration with an UltraSCSI Hub .............. 9–28
10 Configuring Systems for External Termination or Radial
Connections to Non-UltraSCSI Devices
10.1 TruCluster Server Hardware Installation Using PCI SCSI
Adapters ................................................................ 10–1
10.1.1 Radial Installation of a KZPSA-BB or KZPBA-CB Using
Internal Termination ............................................ 10–2
10.1.2 Installing a KZPSA-BB or KZPBA-CB Using External
Termination ....................................................... 10–6
10.1.3 Displaying KZPSA-BB and KZPBA-CB Adapters with the
show Console Commands ....................................... 10–9
10.1.4 Displaying Console Environment Variables and Setting
the KZPSA-BB and KZPBA-CB SCSI ID ..................... 10–13
10.1.4.1 Displaying KZPSA-BB and KZPBA-CB pk* or isp*
Console Environment Variables ........................... 10–13
10.1.4.2 Setting the KZPBA-CB SCSI ID .......................... 10–16
10.1.4.3 Setting KZPSA-BB SCSI Bus ID, Bus Speed, and
Termination Power .......................................... 10–17
10.1.4.4 KZPSA-BB and KZPBA-CB Termination Resistors .... 10–18
10.1.4.5 Updating the KZPSA-BB Adapter Firmware ........... 10–18
A Worldwide ID-to-Disk Name Conversion Table
Index
Examples
4–1Displaying Configuration on an AlphaServer DS20 ............. 4–10
4–2Displaying Devices on an AlphaServer DS20 .................... 4–12
4–3Displaying Configuration on an AlphaServer 8200 .............. 4–13
4–4Displaying Devices on an AlphaServer 8200 ..................... 4–13
4–5Displaying the pk* Console Environment Variables on an
AlphaServer DS20 System .......................................... 4–15
4–6Displaying Console Variables for a KZPBA-CB on an
AlphaServer 8x00 System ........................................... 4–16
4–7Setting the KZPBA-CB SCSI Bus ID .............................. 4–17
Contents xi

5–1Running the mc_cable Test .......................................... 5–13
6–1Determine HSG80 Connection Names ............................ 6–31
6–2Setting Up the Mirrorset ............................................ 6–37
6–3Adding Units and Identifiers to the HSG80 Storagesets ....... 6–40
6–4Displaying the UDID and Worldwide Names of Devices Known
to the Console ......................................................... 6–45
6–5Using the wwidmgr quickset Command to Set the Device Unit
Number ................................................................. 6–47
6–6Sample Fibre Channel Device Names ............................. 6–49
6–7Setting Device Unit Number for Additional Member System . 6–55
7–1Defining Hard Partitions with SCM Environment Variables .. 7–10
7–2Turning Partition Power On ........................................ 7–12
7–3Displaying AlphaServer GS160 System Information ........... 7–14
7–4Displaying Console Serial Bus Information ...................... 7–16
10–1Displaying Configuration on an AlphaServer 4100 .............. 10–9
10–2Displaying Devices on an AlphaServer 4100 ..................... 10–10
10–3Displaying Configuration on an AlphaServer 8200 .............. 10–11
10–4Displaying Devices on an AlphaServer 8200 ..................... 10–12
10–5Displaying the pk* Console Environment Variables on an
AlphaServer 4100 System ........................................... 10–13
10–6Displaying Console Variables for a KZPBA-CB on an
AlphaServer 8x00 System ........................................... 10–15
10–7Displaying Console Variables for a KZPSA-BB on an
AlphaServer 8x00 System ........................................... 10–15
10–8Setting the KZPBA-CB SCSI Bus ID .............................. 10–16
10–9Setting KZPSA-BB SCSI Bus ID and Speed ...................... 10–17
Figures
1–1Two-Node Cluster with Minimum Disk Configuration and No
Quorum Disk .......................................................... 1–5
1–2Generic Two-Node Cluster with Minimum Disk Configuration
and Quorum Disk ..................................................... 1–6
1–3Minimum Two-Node Cluster with UltraSCSI BA356 Storage
Unit ..................................................................... 1–8
1–4Two-Node Cluster with Two UltraSCSI DS-BA356 Storage
Units .................................................................... 1–10
1–5Two-Node Configurations with UltraSCSI BA356 Storage
Units and Dual SCSI Buses ......................................... 1–12
1–6Cluster Configuration with HSZ70 Controllers in Transparent
Failover Mode ......................................................... 1–13
1–7NSPOF Cluster Using HSZ70s in Multiple-Bus Failover
Mode .................................................................... 1–15
xii Contents

1–8NSPOF Fibre Channel Cluster Using HSG80s in Multiple-Bus
Failover Mode ......................................................... 1–16
2–1PCI Backplane Slot Layout .......................................... 2–2
3–1VHDCI Trilink Connector (H8861-AA) ............................ 3–8
3–2DS-DWZZH-03 Front View .......................................... 3–10
3–3DS-DWZZH-05 Rear View ........................................... 3–14
3–4DS-DWZZH-05 Front View .......................................... 3–15
3–5Shared SCSI Bus with HSZ70 Configured for Transparent
Failover ................................................................. 3–20
3–6Shared SCSI Bus with HSZ80 Configured for Transparent
Failover ................................................................. 3–21
3–7TruCluster Server Configuration with HSZ70 in Multiple-Bus
Failover Mode ......................................................... 3–24
3–8TruCluster Server Configuration with HSZ80 in Multiple-Bus
Failover Mode ......................................................... 3–25
4–1KZPBA-CB Termination Resistors ................................. 4–18
5–1Connecting Memory Channel Adapters to Hubs ................. 5–9
5–2MC1 to MC2 Virtual Hub Rolling Upgrade ....................... 5–20
5–3MC1 to MC2 Standard Hub Rolling Upgrade: Initial
Configuration .......................................................... 5–21
5–4MC1 to MC2 Standard Hub Rolling Upgrade: First MC1
Module Replaced ...................................................... 5–22
5–5MC1 to MC2 Standard Hub Rolling Upgrade: Replace First
MC1 Adapter in Second System .................................... 5–23
5–6MC1 to MC2 Standard Hub Rolling Upgrade: Replace Third
System Memory Channel Adapters ................................ 5–24
5–7MC1 to MC2 Standard Hub Rolling Upgrade: Replace Second
MC1 in Second System ............................................... 5–25
5–8MC1 to MC2 Standard Hub Rolling Upgrade: Final
Configuration .......................................................... 5–26
6–1Point-to-Point Topology .............................................. 6–7
6–2Fabric Topology ........................................................ 6–8
6–3Arbitrated Loop Topology ............................................ 6–9
6–4Fibre Channel Single Switch Transparent Failover
Configuration ......................................................... 6–10
6–5Multiple-Bus NSPOF Configuration Number 1 .................. 6–12
6–6Multiple-Bus NSPOF Configuration Number 2 .................. 6–13
6–7Multiple-Bus NSPOF Configuration Number 3 .................. 6–14
6–8A Simple Zoned Configuration ...................................... 6–15
7–1Portion of QBB Showing I/O Riser Modules ...................... 7–3
7–2Front View of Expansion and Primary PCI Drawers ............ 7–6
7–3Rear View of Expansion and Primary PCI Drawers ............. 7–7
Contents xiii

8–1TZ88N-VA SCSI ID Switches ....................................... 8–2
8–2Shared SCSI Buses with SBB Tape Drives ....................... 8–4
8–3DS-TZ89N-VW SCSI ID Switches .................................. 8–7
8–4Compaq 20/40 GB DLT Tape Drive Rear Panel .................. 8–11
8–5Cabling a Shared SCSI Bus with a Compaq 20/40 GB DLT
Tape Drive ............................................................. 8–13
8–6Cabling a Shared SCSI Bus with a Compaq 40/80-GB DLT
Drive .................................................................... 8–16
8–7Cabling a Shared SCSI Bus with a TZ885 ........................ 8–19
8–8TZ887 DLT MiniLibrary Rear Panel ............................... 8–21
8–9Cabling a Shared SCSI Bus with a TZ887 ........................ 8–22
8–10 TruCluster Server Cluster with a TL892 on Two Shared SCSI
Buses .................................................................... 8–28
8–11 TL890 and TL892 DLT MiniLibraries on Shared SCSI Buses . 8–32
8–12 TL894 Tape Library Four-Bus Configuration .................... 8–40
8–13 Shared SCSI Buses with TL894 in Two-Bus Mode .............. 8–42
8–14 TL895 Tape Library Internal Cabling ............................. 8–47
8–15 TL893 Three-Bus Configuration .................................... 8–53
8–16 TL896 Six-Bus Configuration ....................................... 8–54
8–17 Shared SCSI Buses with TL896 in Three-Bus Mode ............ 8–56
8–18 TL891 Standalone Cluster Configuration ......................... 8–66
8–19 TL891 DLT MiniLibrary Rackmount Configuration ............ 8–69
8–20 ESL9326D Internal Cabling ........................................ 8–76
9–1Standalone SCSI Signal Converter ................................ 9–4
9–2SBB SCSI Signal Converter ......................................... 9–4
9–3DS-BA35X-DA Personality Module Switches .................... 9–5
9–4BN21W-0B Y Cable ................................................... 9–7
9–5HD68 Trilink Connector (H885-AA) ............................... 9–8
9–6BA350 Internal SCSI Bus ........................................... 9–10
9–7BA356 Internal SCSI Bus ........................................... 9–12
9–8BA356 Jumper and Terminator Module Identification Pins ... 9–13
9–9BA350 and BA356 Cabled for Shared SCSI Bus Usage ......... 9–19
9–10 Two BA356s Cabled for Shared SCSI Bus Usage ................ 9–21
9–11 Two UltraSCSI BA356s Cabled for Shared SCSI Bus Usage .. 9–23
9–12 Externally Terminated Shared SCSI Bus with Mid-Bus HSZ50
RAID Array Controllers ............................................. 9–26
9–13 Externally Terminated Shared SCSI Bus with HSZ50 RAID
Array Controllers at Bus End ....................................... 9–27
9–14 TruCluster Server Cluster Using DS-DWZZH-03, SCSI
Adapter with Terminators Installed, and HSZ50 ................ 9–30
xiv Contents

9–15 TruCluster Server Cluster Using KZPSA-BB SCSI Adapters,
a DS-DWZZH-05 UltraSCSI Hub, and an HSZ50 RAID Array
Controller .............................................................. 9–31
10–1KZPSA-BB Termination Resistors ................................. 10–18
Tables
2–1RAID Controller Minimum Required Array Controller
Software ................................................................ 2–10
2–2RAID Controller SCSI IDs .......................................... 2–10
2–3Supported SCSI Cables .............................................. 2–13
2–4Supported SCSI Terminators and Trilink Connectors .......... 2–14
3–1SCSI Bus Speeds ...................................................... 3–5
3–2SCSI Bus Segment Length .......................................... 3–6
3–3DS-DWZZH UltraSCSI Hub Maximum Configurations ........ 3–11
3–4Hardware Components Used in Configuration Shown in
Figure 3–5 Through Figure 3–8 .................................... 3–21
4–1Planning Your Configuration ....................................... 4–3
4–2Configuring TruCluster Server Hardware ........................ 4–6
4–3Installing the KZPBA-CB for Radial Connection to a DWZZH
UltraSCSI Hub ........................................................ 4–9
5–1MC1 and MC1.5 Jumper Configuration ........................... 5–2
5–2MC2 Jumper Configuration ......................................... 5–4
5–3MC2 Linecard Jumper Configurations ............................ 5–5
5–4Adding a Memory Channel Interconnect or Rolling from a
Dual, Redundant MC1 Interconnect to MC2 Interconnects .... 5–15
6–1Telnet Session Default User Names for Fibre Channel
Switches ................................................................ 6–22
6–2Converting Storageset Unit Numbers to Disk Names .......... 6–43
8–1TZ88N-VA Switch Settings .......................................... 8–3
8–2Hardware Components Used to Create the Configuration
Shown in Figure 8–2 ................................................. 8–4
8–3DS-TZ89N-VW Switch Settings .................................... 8–7
8–4Hardware Components Used to Create the Configuration
Shown in Figure 8–5 ................................................. 8–13
8–5Hardware Components in the Configuration in Figure 8–6.... 8–16
8–6Hardware Components Used to Create the Configuration
Shown in Figure 8–6 ................................................. 8–19
8–7Hardware Components Used to Create the Configuration
Shown in Figure 8–9 ................................................. 8–28
8–8Hardware Components Used to Create the Configuration
Shown in Figure 8–10 ................................................ 8–33
Contents xv

8–9TL894 Default SCSI ID Settings ................................... 8–37
8–10 Hardware Components Used to Create the Configuration
Shown in Figure 8–12 ................................................ 8–42
8–11 TL895 Default SCSI ID Settings ................................... 8–44
8–12 MUC Switch Functions .............................................. 8–50
8–13 MUC SCSI ID Selection ............................................. 8–51
8–14 TL893 Default SCSI IDs ............................................. 8–51
8–15 TL896 Default SCSI IDs ............................................. 8–52
8–16 Hardware Components Used to Create the Configuration
Shown in Figure 8–16 ................................................ 8–56
8–17 TL881 and TL891 MiniLibrary Performance and Capacity
Comparison ............................................................ 8–60
8–18 DLT MiniLibrary Part Numbers ................................... 8–60
8–19 Hardware Components Used to Create the Configuration
Shown in Figure 8–17 ................................................ 8–66
8–20 Hardware Components Used to Create the Configuration
Shown in Figure 8–18 ................................................ 8–70
8–21 Shared SCSI Bus Cable and Terminator Connections for the
ESL9326D Enterprise Library ...................................... 8–77
9–1Hardware Components Used for Configuration Shown in
Figure 8–9 and Figure 8–10 ......................................... 9–20
9–2Hardware Components Used for Configuration Shown in
Figure 9–11 ............................................................ 9–24
9–3Hardware Components Used for Configuration Shown in
Figure 8–12 and Figure 8–13 ....................................... 9–27
9–4Hardware Components Used in Configuration Shown in
Figure 9–14 ............................................................ 9–30
10–1Configuring TruCluster Server Hardware for Use with a PCI
SCSI Adapter .......................................................... 10–2
10–2Installing the KZPSA-BB or KZPBA-CB for Radial Connection
to a DWZZH UltraSCSI Hub ........................................ 10–4
10–3Installing a KZPSA-BB or KZPBA-CB for Use with External
Termination ............................................................ 10–7
A–1Converting Storageset Unit Numbers to Disk Names .......... A–1
xvi Contents

About This Manual
This manual describes how to set up and maintain the hardware
configuration for a TruCluster™Server cluster.
Audience
This manual is for system administrators who will set up and configure the
hardware before installing the TruCluster Server software. The manual
assumes that you are familiar with the tools and methods needed to
maintain your hardware, operating system, and network.
Organization
This manual contains 10 chapters, an appendix, and an index. The
organization of this manual has been restructured to provide a more
streamlined manual. The chapters that contained information on SCSI bus
requirements and configuration, and configuring hardware, in previous
versions of this manual have been split up into two sets of two chapters each.
One set (Chapters 3 and 4) covers the UltraSCSI hardware and is geared
towards radial configurations. The other set (Chapters 9 and 10) covers
configurations using either external termination or radial connection to
non-UltraSCSI devices. A brief description of the contents follows:
Chapter 1 Introduces the TruCluster Server product and provides an overview
of setting up TruCluster Server hardware.
Chapter 2 Describes hardware requirements and restrictions.
Chapter 3 Contains information about setting up a shared SCSI bus, SCSI
bus requirements, and how to connect storage to a shared SCSI bus
using the latest UltraSCSI products (DS-DWZZH UltraSCSI hubs,
and HSZ70 and HSZ80 RAID array controllers).
Chapter 4 Describes how to prepare systems for a TruCluster Server
configuration, and how to connect host bus adapters to shared
storage using the DS-DWZZH UltraSCSI hubs and the newest
RAID array controllers (HSZ70 and HSZ80).
Chapter 5 Describes how to set up the Memory Channel cluster interconnect,
and how to upgrade Memory Channel interconnects.
Chapter 6 Provides an overview of Fibre Channel and describes how
to set up Fibre Channel hardware.
About This Manual xvii

Chapter 7 Describes the use of AlphaServer™GS80, GS160, or GS320 hardware
partitions in a TruCluster Server configuration.
Chapter 8 Describes how to configure a shared SCSI bus for tape drive,
tape loader, or tape library usage.
Chapter 9 Describes the requirements for a shared SCSI bus using externally
terminated configurations and radial configurations using
non-UltraSCSI RAID array controllers.
Chapter 10 Describes how to prepare systems and host bus adapters for the
TruCluster Server configurations described in Chapter 9.
Appendix A Provides a blank table to use to convert from the HSG80 unit
numbers to /dev/disk/dsknand device names for an actual
Fibre Channel TruCluster Server configuration.
Related Documents
Consult the following manuals for assistance in TruCluster Server
installation, administration, and programming tasks:
•TruCluster Server Software Product Description (SPD) —The
comprehensive description of the TruCluster Server Version 5.1 product.
You can find the latest version of the SPD and other TruCluster Server
documentation at the following URL:
http://www.tru64unix.compaq.com/faqs/publications/pub_page/cluster_list.html
•Release Notes —Provides important information about TruCluster
Server Version 5.1.
•Technical Overview —Provides an overview of the TruCluster Server
technology.
•Software Installation —Describes how to install the TruCluster Server
product.
•Cluster Administration —Describes cluster-specific administration
tasks.
•Highly Available Applications —Describes how to deploy applications on
a TruCluster Server cluster.
Consult the following AlphaServer GS80/160/320 documentation to assist
you in configuring an AlphaServer GS80, GS160, or GS320 system in a
TruCluster Server configuration:
•Installation Guide
•System Management Console Installation and User’s Guide
•User’s Guide
•Firmware Reference Manual
xviii About This Manual

The StorageWorks™UltraSCSI Configuration Guidelines document
provides guidelines regarding UltraSCSI configurations.
For information about setting up a RAID subsystem, see the following
manuls as appropriate for your configuration:
•DEC RAID Subsystem User’s Guide
•HS Family of Array Controllers User’s Guide
•RAID Array 310 Configuration and Maintenance Guide User’s Guide
•Configuring Your StorageWorks Subsystem HSZ40 Array Controllers
HSOF Version 3.0
•Getting Started RAID Array 450 V5.4 for Compaq Tru64™UNIX
Installation Guide
•HSZ70 Array Controller HSOF Version 7.0 Configuration Manual
•HSZ80 Array Controller ACS Version 8.2
•Compaq StorageWorks HSG80 Array Controller ACS Version 8.5
Configuration Guide
•Compaq StorageWorks HSG80 Array Controller ACS Version 8.5 CLI
Reference Guide
•MA6000 HSG60 Array Controller ACS Version 8.5 Solution Software for
Compaq Tru64 UNIX Installation and Configuration Guide
•Compaq StorageWorks HSG60/HSG80 Array Controller ACS Version 8.5
Maintenance and Service Guide
•MA6000 HSG60 Array Controller ACS Version 8.5 Solution Software for
Compaq Tru64 UNIX Installation and Configuration Guide
•Compaq StorageWorks Release Notes RA8000/ESA12000 and
MA8000/EMA12000 Solution Software V8.5b for Tru64 UNIX
•Compaq StorageWorks Modular Array Configuration Guide
•Model 2100 and 2200 Ultra SCSI Controller Enclosures User Guide
•Compaq StorageWorks Enclosure 4200 Family LVD Disk Enclosure
User Guide
•Wwidmgr User’s Manual
Consult the following documentation for other Fibre Channel storage
information:
•KGPSA-BC PCI-to-Optical Fibre Channel Host Adapter User Guide
•64-Bit PCI-to-Fibre Channel Host Bus Adapter User Guide
•Compaq StorageWorks Fibre Channel Storage Switch User’s Guide
About This Manual xix

•Compaq StorageWorks SAN Switch 8 Installation and Hardware Guide
•Compaq StorageWorks SAN Switch 16 Installation and Hardware Guide
•Compaq StorageWorks Fibre Channel SAN Switch 8-EL Installation
and Hardware Guide
•Compaq StorageWorks Fibre Channel SAN Switch Management Guide
•Compaq StorageWorks SAN Switch Fabric Operating System
Management Guide
•Fibre Channel Storage Hub 7 Installation Guide
•Fibre Channel Storage Hub 7 Rack Mounting Installation Card
For information about the tape devices, see the following manuals:
•TZ88 DLT Series Tape Drive Owner’s Manual
•TZ89 DLT Series Tape Drive User’s Guide
•TZ885 Model 100/200 GB DLT 5-Cartridge MiniLibrary Owner’s Manual
•TZ887 Model 140/280 GB DLT 7-Cartridge MiniLibrary Owner’s Manual
•TL881 MiniLibrary System User’s Guide
•TL881 MiniLibrary Drive Upgrade Procedure
•Pass-Through Expansion Kit Installation Instructions
•TL891 MiniLibrary System User’s Guide
•TL81X/TL894 Automated Tape Library for DLT Cartridges Facilities
Planning and Installation Guide
•TL81X/TL894 Automated Tape Library for DLT Cartridges Diagnostic
Software User’s Manual
•TL895 DLT Tape Library Facilities Planning and Installation Guide
•TL895 DLT Library Operator’s Guide
•TL895 DLT Tape Library Diagnostic Software User’s Manual
•TL895 Drive Upgrade Instructions
•TL82X/TL893/TL896 Automated Tape Library for DLT Cartridges
Facilities Planning and Installation Guide
•TL82X/TL893/TL896 Automated Tape Library for DLT Cartridges
Operator’s Guide
•TL82X/TL893/TL896 Automated Tape Library for DLT Cartridges
Diagnostic Software User’s Manual
•TL82X Cabinet-to-Cabinet Mounting Instructions
•TL82X/TL89X MUML to MUSL Upgrade Instructions
xx About This Manual