HP 1032 User manual

ClusterPack
Index of Tutorial Sections
Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
Administrators Guide
1.0 ClusterPack Install QuickStart
1.1 ClusterPack General Overview
1.2 Comprehensive Install Instructions
1.3 Installation and Configuration of Optional Components
1.4 Software Upgrades and Reinstalls
1.5 Golden Image Tasks
1.6 System Maintenance Tasks
1.7 System Monitoring Tasks
1.8 Workload Management Tasks
1.9 System Troubleshooting Tasks
Users Guide
2.1 Job Management Tasks
2.2 File Transfer Tasks
2.3 Miscellaneous Tasks
Tool Overview
3.1 Cluster Management Utility Zone Overview
3.2 Service ControlManager (SCM) Overview
3.3 System Inventory Manager Overview
3.4 Application ReStart (AppRS) Overview
3.5 Cluster Management Utility (CMU) Overview
3.6 NAT/IPFilter Overview
3.7 Platform Computing Clusterware Pro V5.1 Overview
3.8 Management Processor (MP) Card Interface Overview
3.9 HP Systems Insight Manager (HPSIM) Overview
Related Documents
4.1 Related Documents

Back to Top
Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
Copyright 1994-2004 hewlet
t
-
p
ackard company
Dictionar
y
of Cluster Terms

ClusterPack Install QuickStart
ClusterPack
ClusterPack Install QuickStart
Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
1.0.1 How Can I Get My HP-UX Cluster Running?
Step Q1 Fill Out the ClusterPack Installation Worksheet
Step Q2 Install Prerequisites
Step Q3 Allocate File System Space
Step Q4 Obtain a License File
Step Q5 Prepare Hardware Access
Step Q6 Power Up the Management Server
Step Q7 Configure the ProCurve Switch
Step Q8 Copy the License Files to the Management Server
Step Q9 Install ClusterPack on the Management Server
Step Q10 Run manager_config on the Management Server
Step Q11 Run mp_register on the Management Server
Step Q12 Power up the Compute Nodes
Step Q13 Run compute_config on the Management Server
Step Q14 Run finalize_config on the Management Server
1.0.1 How Can I Get My HP-UX Cluster Running?
If you have installed ClusterPack before, follow the instructions in this section as a quick
reminder. You can refer to the detailed instructions for any given step via the links provided.
If you have not installed ClusterPack before, use the Comprehensive Install Instructions
section instead. This QuickStart Guide does NOT cover the use of Golden Images. If you
wish to use Golden Images, use the Comprehensive Install Instructions section instead.
Note:
If you do the installation steps out of order or omit steps, your installation
will leave your systems in an unknown and non-deterministic state.
Back to Top

Step Q1 Fill Out the ClusterPack Installation Worksheet
Print out this form and fill out all information for each node in your cluster.
Installation Worksheet (pdf)
Note:
You will not be able to complete the following steps if you have not
collected all of this information.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 1 Fill Out the ClusterPack Installation Worksheet
Back to Top
Step Q2 Install Prerequisites
Install the following software on the Management Server.
zHP-UX 11i Ignite-UX
zHP-UX 11i V2.0 TCOE
Install the following software on each Compute Node.
zHP-UX 11i Ignite-UX
zHP-UX 11i V2.0 TCOE
Allow the default choices to install.
ClusterPack requires a homogeneous operating system environment. That is, all Compute
N
odes and the Management Server must have the same release of HP-UX installed as well
as the same operating environment.
The Management Server requires at least one LAN connection. The manager must be able
to contact all the compute nodes using a "management network" that will ve configured by
Clusterpack. In addition, the management server must be able to connect to all the MP cards
on the compute nodes. No network connections need to be configured before installing
Clusterpack, the console interface can be used for all installation and configuration steps.

The Compute Nodes must have Management Processor (MP) cards.
ClusterPack depends on certain open source software which is normally installed as a part
of the operating environment. The minimum release versions required are:
zMySQL Version 3.23.58 or higher
zPerl Version 5.8 or higher
For more information, see the Comprehensive Instructions for this step.
References:
zStep 2 Install Prerequisites
Back to Top
Step Q3 Allocate File System Space
Allocate file system space on the Management Server. Minimum requirements are listed
below.
z/var - 4GB
z/opt - 4GB
z/share - 500MB (Clusterware edition only)
For more information, see the Comprehensive Instructions for this step.
References:
zStep 3 Allocate File System Space
Back to Top
Step Q4 Obtain a License File
zGet the Host ID number of the Management Server.
zContact Hewlett-Packard Licensing Services to redeem your license
certificates.
zIf you purchased the ClusterPack Base Edition, redeem the Base Edition
license certificate.
zIf you purchased the ClusterPack ClusterWare Edition, redeem the Base
Edition certificate and the ClusterWare edition certificate

Note:
It may take up to 24 hours to receive the license file. Plan accordingly.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 4 Obtain a License File
Back to Top
Step Q5 Prepare Hardware Access
Get a serial console cable long enough to reach all the Compute Nodes from the
Management Server.
Note:
If you are installing ClusterPack on Compute Nodes for the first time, DO
NOT power up the systems, ClusterPack will do that for you automatically.
If you do accidentally power the compute nodes, DO NOT answer the HP-
UX boot questions.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 5 Prepare Hardware Access
Back to Top
Step Q6 Power Up the Management Server
Perform a normal first boot for the Management Server.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 6 Power Up the Management Server
Back to Top

Step Q7 Configure the ProCurve Switch
zSelect an IP address from the same IP subnet that will be used for the
Compute Nodes.
zConnect a console to the switch
zLog onto the switch through the console
zType 'set-up'
zSelect IP Config and select the "manual" option
zSelect the IP address field and enter the IP address to be used for the
switch
For more information, see the Comprehensive Instructions for this step.
References:
zStep 7 Configure the ProCurve Switch
Back to Top
Step Q8 Copy the License Files to the Management Server
Put the files in any convenient directory on the Management Server (e.g. /tmp).
For more information, see the Comprehensive Instructions for this step.
References:
zStep 8 Copy the License Files to the Management Server
Back to Top
Step Q9 Install ClusterPack on the Management Server
zMount and register the ClusterPack DVD as a software depot.
zInstall the ClusterPack Manager software (CPACK-MGR) using
swinstall.
zLeave the DVD in the DVD drive for the next step.
For more information, see the Comprehensive Instructions for this step.

References:
zStep 9 Install ClusterPack on the Management Server
Back to Top
Step Q10 Run manager_config on the Management Server
Provide the following information to the manager_config program:
zThe path to the license file(s),
zThe DNS domain and optional NIS domain for the cluster,
zThe host name of the manager and the name of the cluster,
zThe management LAN interface on the Management Server,
zThe IP address(es) of the Compute Node(s),
zWhether to mount a home directory,
zWhether to configure SCM / SysInvMgr or HP SIM software ,
zThe LSF admin password. (Clusterware edition only)
For more information, see the Comprehensive Instructions for this step.
References:
zStep 10 Run manager_config on the Management Server
Back to Top
Step Q11 Run mp_register on the Management Server
Provide the following information to the mp_register program about each Management
Processor card that is connected to a Compute Node:
zIP address,
znetmask,
zgateway IP address.
The information can be provided to mp_register in a file. See the mp_register(1) man page
for the file format.
For more information, see the Comprehensive Instructions for this step.
References:

zStep 11 Run mp_register on the Management Server
Back to Top
Step Q12 Power up the Compute Nodes
Use the clbootnodes program to power up all Compute Nodes that have a connected
Management Processor that you specified in the previous step. The clbootnodes program
will provide the following information to the Compute Nodes:
zLanguage to use,
zHost name,
zTime and time zone settings,
zNetwork configuration,
zRoot password.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 12 Power up the Compute Nodes
Back to Top
Step Q13 Run compute_config on the Management Server
The compute_config program will register the nodes with various programs.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 13 Run compute_config on the Management Server
Back to Top
Step Q14 Run finalize_config on the Management Server
This program completes the installation and configuration process, verifies the Cluster
Management Software, and validates the installation. If it reports diagnostic error messages,

Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
Copyright 1994-2004 hewlet
t
-
p
ackard company
repeat the installation process, performing all steps in the order specified.
For more information, see the Comprehensive Instructions for this step.
References:
zStep 14 Set up HyperFabric (optional)
Back to Top

ClusterPack General Overview
ClusterPack
ClusterPack General Overview
Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
1.1.1 ClusterPack Overview
1.1.2 Who should use the material in this tutorial?
1.1.3 What is the best order to review the material in the tutorial?
1.1.4 Operating System and Operating Environment Requirements
1.1.5 System Requirements
1.1.1 ClusterPack Overview
Compute Cluster
A cluster is a set of independent computers combined into a unified system through system
software and networking technologies. Compute clusters are important options for a
growing number of technical and commercial customers. The primary driver for clustering
of compute workstations and servers is that it provides a low cost alternative to
supercomputers. It also has the following key benefits:
zhorizontally scalable by adding more nodes
zvertically scalable by using larger SMP nodes
zfault-isolation - failure of a single Compute Node will not shutdown the
entire cluster system
zasymmetry: mix and match of different nodes in a cluster
zconfiguration flexibility: nodes, interconnect
zre-deployable nodes
A compute cluster consists of Compute Nodes that incorporate multiple processors in a
symmetric multiprocessor configuration. These nodes are connected through interconnection
network(s) and are supervised within a single administrative domain. A compute cluster
usually resides in a single machine room and is managed as a single computer system. The
interconnection network employs standard local area network (LAN) and/or high
p
erformance interconnect technologies based on the application requirements. A compute
cluster has to support both time-to-solution jobs and throughput jobs. HP high performance
technical computing cluster is available on HP Integrity servers with interconnection options

of Gigabit Ethernet or Infiniband. The common components of a cluster are:
zHead Node - provides user access to the cluster. In smaller clusters, the
Head Node may also serve as a Management Server.
zManagement Server - server that provides single point of management for
all system components in the cluster
zManagement LAN/switch - usually an Ethernet network used to monitor
and control all the major system components. May also handle traffic to
the file server.
zInterconnect switch - provides high speed connectivity between Compute
Nodes. Used for message passing and remote memory access capabilities
for parallel applications.
zStorage - includes both local disk space on each Compute Node and
optionally an independent storage unit accessible to the Compute Nodes
(See NAS below).
zCluster management software - ClusterPack for system administrators
and end-users.
zManagement Processor (MP) - controls the system console, reset and
power management functions of a server.
zConsole LAN - network for remote management of consoles (ex. using
the Management Processor LAN).
zNetwork Attached Storage (NAS) - attach directly to Ethernet networks,
providing easy installation, low maintenance, and high uptime.
Compute Nodes
Compute Nodes in a cluster are normal compute servers that provide system computing
resource and storage capability. A ClusterPack cluster is built with HP Integrity servers: 2-
way or 4-way server platforms based on Intel Itanium 2-based processors and HP's zx1
chipset technologies.
The HP Integrity rx2600 server, powered by Intel Itanium 2-based processors, is the
industry's first dual-processor Itanium 2-based server. The rx2600 dramatically improves
p
rice/performance for technical applications and gives customers a cost-effective yet
p
owerful entry into a technology with tremendous growth potential. Its 2U rack density is
ideal for clustering solutions.
HP's extensive Itanium 2-based systems experience and co-developer insights have resulted
in premium performance through the development of the HP Scalable Processor Chipset
zx1. Invented by HP, the HP zx1 chipset fully unleashes the power of Intel Itanium 2-based
p
rocessors by lowering memory latencies and increasing memory and I/O subsystem
scalability. With the HP zx1 chipset, HP Integrity servers and Itanium 2-based servers
achieve even better performance and memory expandability.
Interconnection Networks
An ClusterPack cluster is built with the industry standard Gigabit Ethernet. This
interconnect network is capable of transferring data packets between Compute Nodes for
both file serving and inter-node communication for applications. When applications benefit
from lower latency, HP's Infiniband can be configured into the cluster to provide lower

latency and higher bandwidth. A cluster LAN is also configured to separate the system
management traffic from application message passing and file serving traffics.
Management Software and Head Node
The ability to manage and use a cluster as easily as a single compute system is critical to the
success of any cluster solution. To facilitate ease of use for both system administrators and
end-users, HP has created a software package called ClusterPack. The ClusterPack cluster
can be managed and used just as easily as a single server platform.
The ClusterPack is an integrated solution that offers the following key features:
Installation and configuration
zautomated cluster setup
znetwork services setup (NFS, NTP, NIS, Ignite-UX)
zremote power-on
znetwork configuration
System administration
zsingle point of administration
zrole-based management
zsoftware and patch management
zuser account maintenance
zresource control
zcluster health monitoring
zcluster troubleshooting
zcluster tuning
zgolden image creation and distribution
zcluster reconfiguration
zcluster system hardware and software inventory management
zcluster server nodes consistency checking
Distributed resource management
zcluster resource scheduling
zpolicy based queues and multiple queue management
zjob submission, monitor, and control
zuser specified job priority
zApplication ReStart file migration
The ClusterPack integrates HP's enterprise system management solution, HP System Insight
Manager (HP SIM), and Platform Computing's Clusterware. HP SIM has been widely used
in large-scale data centers for managing hundreds of HP systems through a single point of
control. Its multi-system management capabilities, such as group operations and role-based
management, enable customers to achieve optimal IT resource efficiency. Platform
Computing's Clusterware is based on the industry distributed resource management solution,
Load Sharing Facility (LSF), and is specially designed for cluster management and ease-of-
use for both system administrators and end-users. ClusterPack is available on HP-UX 11i

Version 2.0. The ClusterPack has a server component that runs on a Management Server,
and client agents that run on the managed Integrity compute servers.
NAS 8000
N
AS 8000 High Availability Cluster was designed to significantly reduce downtime and
maximize the availability of storage by providing heterogeneous file-sharing and file-
serving functionality across a wide variety of application areas, including content delivery
and distribution, consolidated storage management, technical computing, and Web serving.
It allows capacity without server downtime so additions can be made without losing access
to valuable data. The HP NAS 8000 series provides interoperability with other applications.
It also provides storage flexibility.
The critical need for more accessible data, and more reliable storage, is met with a NAS
solution.
Back to Top
1.1.2 Who should use the material in this tutorial?
This tutorial is divided into four main sections:
zAdministrators Guide
zUsers Guide
zTool Overview
zRelated Documents
zData Dictionary
The Administrators Guide is intended for the system administrators who will be responsible
for the initial setup and continuing operation of the cluster. The Administrators section of
the tutorial covers a range of topics including: installation and setup of the ClusterPack
software on the cluster, creating and managing golden images, system maintenance tasks,
adding users to the cluster, adding third party software to the cluster, system monitoring
tasks, and basic troubleshooting of the ClusterPack software.
The Users Guide is intended for users who will be using the ClusterPack software to submit
j
obs to the cluster. The Users section of the tutorial covers a range of topics including: basic
user account setup and access, the layout of the cluster, submitting jobs to the cluster,
monitoring jobs currently running on the cluster, collecting data in a central location, and
general troubleshooting of the ClusterPack software.
The Tool Overview is a general overview of each major software component of the
ClusterPack solution. For each tool, a basic functional overview is presented. This section
includes information that is useful for both system administrators and end users.
The Related Documents gives the location of additional information for components of
ClusterPack and HP Integrity clusters.

The Data Dictionary contains definitions for common terms that are used through the
tutorial.
Back to Top
1.1.3 What is the best order to review the material in the tutorial?
System Administrators
Initial installation and configuration of the cluster requires a complete understanding of the
steps involved and the information required. Before installing a new cluster, the system
administrator should read and understand all of the steps involved before beginning the
actual installation. It is assumed that anyone setting up a cluster is familiar with Unix system
administration, HP-UX OS installation, the Management Processor interface and network
setup and configuration. Before installing a cluster for the first time, read and understand the
following material:
zSection 1.2 Initial Installation and Set-Up
zSection 1.3 Installation and Configuration of Optional Components
zSection 1.4 Software Upgrades and Reinstalls
zSection 1.5 Golden Image Tasks
It is helpful prior to installation to review and be familiar with several additional sections of
the tutorial. This material does not need to be completely reviewed, but should be read and
available during the initial testing of the new cluster:
zSection 1.6 System Maintenance Tasks
zSection 1.7 System Monitoring Tasks
zSection 1.8 Workload Management Tasks
zSection 1.9 System Troubleshooting Tasks
zTool Overview
Users
Before beginning to use the cluster for daily tasks, it is helpful to review several sections in
order to be familiar with the tools that are provided on the cluster to submit and monitor
j
obs. This material should be kept readily available for reference.
zSection 2.1 Job Management Tasks
zSection 2.2 File Transfer Tasks
zSection 2.3 Miscellaneous Tasks
zTool Overview
Is the Online Tutorial available in a single printable file?
The Online Tutorial is available in a single file. From the Master Index of Sections, there is

a link to the printable version at the bottom of the page.
References:
zPrintable Version
Back to Top
1.1.4 Operating System and Operating Environment Requirements
The key components of the HP Integrity Server Technical Cluster are:
zManagement Server: HP Integrity server with HP-UX 11i Version 2.0
TCOE
zCompute Nodes: HP Integrity servers with HP-UX 11i Version 2.0
TCOE
zCluster Management Software: ClusterPack V2.4
The following prerequisites are assumed:
zHP-UX 11i V2.0 TCOE installed on the Management Server
zHP-UX 11i V2.0 TCOE installed on each Compute Node
The following software components must be installed for all features of ClusterPack V2.4 to
function effectively:
zHP-UX 11i Ignite-UX on the Management Server
zHP-UX 11i Ignite-UX on each Compute Node
Back to Top
1.1.5 System Requirements
In order to install the ClusterPack solution, the Management Server must have access to a
DVD drive.
The Management Server hard drive must be partitioned to allow sufficient disc space for the
following directories:
z/var - 4 GB
z/opt - 4 GB
z/share - 500 MB

Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
Copyright 1994-2004 hewlet
t
-
p
ackard company
Back to Top

Comprehensive Install Instructions
ClusterPack
Comprehensive Install Instructions
Index | Administrators Guide | Users Guide | Tool Overview | Related Documents | Dictionary
1.2.1 Comprehensive Installation Overview
Step 1 Fill Out the ClusterPack Installation Worksheet
Step 2 Install Prerequisites
Step 3 Allocate File System Space
Step 4 Obtain a License File
Step 5 Prepare Hardware Access
Step 6 Power Up the Management Server
Step 7 Configure the ProCurve Switch
Step 8 Copy the License Files to the Management Server
Step 9 Install ClusterPack on the Management Server
Step 10 Run manager_config on the Management Server
Step 11 Run mp_register on the Management Server
Step 12 Power up the Compute Nodes
Step 13 Run compute_config on the Management Server
Step 14 Set up HyperFabric (optional)
Step 15 Set up InfiniBand (optional)
Step 16 Run finalize_config on the Management Server
Step 17 Create a Golden Image of a Compute Node from the Management Server
Step 18 Add nodes to the cluster that will receive the Golden Image
Step 19 Distribute the Golden Image to the remaining Compute Nodes
Step 20 Install and Configure the remaining Compute Nodes
Step 21 Verify the final cluster configuration
1.2.1 Comprehensive Installation Overview
ClusterPack uses a two-stage process for setting up an HP-UX Cluster:
zCreate a base configuration with a Management Server and one Compute Node
{Prepare for installation.
{Install and configure the Management Server.
{Install and configure the initial Compute Node and its Management

Processor.
{Verify the Management Server and the initial Compute Node.
zConfigure the remaining Compute Nodes with a Golden Image.
{Create a Golden Image.
{Add nodes to the configuration that will receive the Golden Image.
{Distribute the Golden Image to remaining nodes.
{Install and configure the Compute Nodes that received the Golden
Image.
{Verify the final cluster configuration.
These processes are further broken down into a number of discrete steps. Each step contains the followin
g
sections:
zBackground
zOverview
zDetails
The background section explains why this step is necessary and what will be done for you. The overvie
w
section tells you what this step entails in general terms. The details section gives the exact commands yo
u
must enter.
Note:
The steps in this section have to be followed in the specified order to ensure that
everything works correctly. Please read all of the following steps BEFORE beginning the
installation process.
Back to Top
Step 1 Fill Out the ClusterPack Installation Worksheet
Background
ClusterPack simplifies the creation and administration of a cluster of HP Integrity Servers running HP-U
X
b
y automating the collection, recording, and distribution of information about the systems in a network.
Y
the system administrator, must still make decisions about how to identify and secure those network
components. You can record all of your decisions on a form that you can keep nearby as you execute the
steps of the installation process.
Overview
Print out this form and fill out all information for each node in your cluster.
Installation Worksheet (pdf)

Note:
You will not be able to complete the following steps if you have not collected all of this
information.
Details
At various points during the configuration you will be queried for the following information:
zDNS Domain name [ex. domain.com]
zNIS Domain name [ex. hpcluster]
zNetwork Connectivity:
{Information on which network cards in each Compute Node connect to
the Management Server
{Information on which network card in the Management Server
connects to the Compute Nodes.
zMySQL root password (You will be asked to set it).
zHP SIM Administrator password (You will be asked to set it).
zLSF Administrator password (You will be asked to set it).
Back to Top
Step 2 Install Prerequisites
Background
ClusterPack works on HP Integrity Servers running HP-UX. In order to install ClusterPack, you must ha
v
the Technical Computing Operating Environment (TCOE) version of HP-UX installed. You must also h
a
the Ignite-UX software, which is used for installation. Installing Ignite-UX on the Compute Nodes make
s
p
ossible to create and distribute "golden images" from the Compute Nodes.
ClusterPack requires a homogeneous operating system environment. That is, all Compute Nodes and the
Management Server must have the same release of HP-UX installed as well as the same operating
environment.
Overview
Install the following software on the Management Server.
zHP-UX 11i Ignite-UX
zHP-UX 11i V2.0 TCOE
Install the following software on each Compute Node.