Hp Cluster platform introduction v2010 Reference manual

HP Cluster Platform

Site Preparation Guide

HP Part Number: A-CPSPG-1D

Published: August 2007

Edition: 1.3

The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express

warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP

shall not be liable for technical or editorial errors or omissions contained herein. Intel, Pentium, Intel Inside, and the Intel Inside logo are trademarks

or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

Intel®, Intel® Xeon™, and Itanium® are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the U.S. and other

countries.

AMD® and AMD Opteron™ are trademarks or registered trademarks of Advanced Micro Devices, Inc.

Quadrics® and QsNetII™ are trademarks or registered trademark of Quadrics, Ltd.

Myrinet® and Myricom® are registered trademarks of Myricom Inc.

InfiniBand™ is a trademark the InfiniBand® Trade Association

Voltaire™ and the V logo, V™, are registered trademarks of Voltaire Inc.

Table of Contents

About This Manual.............................................................................................................7

Audience.................................................................................................................................................7

How To Use This Guide..........................................................................................................................7

Organization...........................................................................................................................................8

Related Documentation..........................................................................................................................8

HP Cluster Platform Documentation................................................................................................8

Cross-Platform Documents..........................................................................................................8

Platform-Specific Documents.......................................................................................................8

HP BladeSystems.........................................................................................................................9

Component Documentation..............................................................................................................9

World-Wide Web Resources..............................................................................................................9

Warranty, Service, and Support Options..............................................................................................10

Contact Information and Providing Feedback.....................................................................................10

Symbols on Equipment.........................................................................................................................10

Text Annotations...................................................................................................................................11

Safety Considerations.....................................................................................................12

Information on Ergonomics..................................................................................................................14

Recycling...............................................................................................................................................14

1 Installation Planning.....................................................................................................15

1.1 Delivery Status................................................................................................................................15

1.2 Determining the Number of Racks.................................................................................................16

1.2.1 HP StorageWorks Scalable File Share Rack Configurations...................................................17

1.2.2 HP SFS for HP SFS20 Enclosure Building Blocks....................................................................17

1.2.3 Example HP SFS System Rack Configurations.......................................................................18

1.3 Site Preparation and Planning Overview........................................................................................19

1.4 Time and Labor Requirements........................................................................................................20

1.5 Physical Layout Requirements........................................................................................................21

1.5.1 HP 10000 Series Rack Characteristics......................................................................................21

1.5.2 Unpacking Space.....................................................................................................................23

1.5.3 Access Space Requirements....................................................................................................24

1.5.4 Estimating Power and Cooling...............................................................................................25

1.5.5 Estimating the Total Weight of a Custom or Modular Installation.........................................26

1.6 Planning for Connections................................................................................................................27

1.6.1 Rack Layout Planning.............................................................................................................27

1.6.2 General Considerations for Connections................................................................................28

1.6.3 Cable Routing..........................................................................................................................29

1.6.4 Power Connections..................................................................................................................29

1.6.5 Data and Communication Connections..................................................................................31

1.7 Power Supply Planning...................................................................................................................31

1.8 Grounding Requirements................................................................................................................32

1.9 Environmental Requirements.........................................................................................................32

1.9.1 Temperature Requirements.....................................................................................................32

1.9.2 Acoustics.................................................................................................................................33

1.9.3 Other Environmental Considerations.....................................................................................34

1.10 Tools and Resources......................................................................................................................35

1.11 Delivery Route Verification...........................................................................................................35

2 Unpacking and Assembling the Racks......................................................................37

2.1 Thermal Stabilization......................................................................................................................37

2.2 Removing Rack Packaging..............................................................................................................37

2.3 Removing a Rack from a Pallet.......................................................................................................39

Table of Contents 3

2.4 Inspecting the Racks........................................................................................................................42

2.5 Leveling the Racks...........................................................................................................................43

2.6 Connecting the Racks......................................................................................................................43

2.7 Installing Side Panels.......................................................................................................................44

A Planning Checklist........................................................................................................46

A.1 Preinstallation Survey....................................................................................................................46

A.2 Installation Schedule......................................................................................................................46

A.3 Site Inspection................................................................................................................................46

A.3.1 Customer and HP Information Worksheet............................................................................46

A.3.2 Site Inspection Checklists.......................................................................................................47

A.4 Delivery Survey .............................................................................................................................48

B Cluster Interconnect Topology.....................................................................................50

C General Guidelines for the Computer Room............................................................51

C.1 Power and Safety............................................................................................................................51

C.1.1 Fire Protection.........................................................................................................................51

C.1.2 Power Quality and Protection................................................................................................51

C.1.3 Distribution Hardware...........................................................................................................52

C.1.3.1 Wire Selection.................................................................................................................52

C.1.3.2 Raceways........................................................................................................................52

C.1.3.3 Building Distribution......................................................................................................52

C.1.3.4 Wiring Connections........................................................................................................53

C.1.3.5 Data Communications Cables........................................................................................53

C.1.4 Computer Safety Ground.......................................................................................................53

C.2 Environment...................................................................................................................................53

C.2.1 Computer Room.....................................................................................................................53

C.2.2 Air Conditioning Equipment.................................................................................................54

C.2.2.1 Air Conditioning System Guidelines.............................................................................54

C.2.2.2 Air Conditioning System Types.....................................................................................54

C.2.2.3 Basic Air Distribution Systems.......................................................................................54

C.2.2.4 Humidity Levels.............................................................................................................54

C.2.2.5 Dust and Pollution Control............................................................................................55

C.2.3 Metal Particulate Contamination...........................................................................................55

D Calculating Noise Levels.............................................................................................56

E Preventing Electrostatic Damage.................................................................................57

E.1 Electrostatic Precautions.................................................................................................................57

E.2 Grounding Methods........................................................................................................................57

Index.................................................................................................................................58

4 Table of Contents

List of Figures

1-1 Maximum Rack Configuration Using a 1:1 Ratio of HP SFS20 Enclosures to ProLiant DL360

Object Storage Servers...................................................................................................................19

1-2 HP 10000 Series Rack.....................................................................................................................22

1-3 Thee-Rack Cluster Footprint.........................................................................................................23

1-4 Rack Clearances for Servicing.......................................................................................................24

1-5 Cable Routing Calculation............................................................................................................29

1-6 PDU Connectors............................................................................................................................31

2-1 Unpacking the Rack......................................................................................................................39

2-2 Ramp Extension and Installation..................................................................................................40

2-3 Shipping Bolt and Bracket.............................................................................................................41

2-4 Dismounting a Rack from a Pallet.................................................................................................42

2-5 Leveler Foot...................................................................................................................................43

2-6 Installing the Standard Baying Kit Brackets.................................................................................44

2-7 Side Panel Installation...................................................................................................................44

B-1 Fat Tree Topology..........................................................................................................................50

List of Tables

1-1 Dense Cluster Using 1U Server.....................................................................................................16

1-2 Dense Cluster Using 2U Server.....................................................................................................16

1-3 Number of Object Storage Servers in a Cabinet Using ProLiant DL360 Servers..........................17

1-4 Number of Object Storage Servers in a Cabinet Using ProLiant DL380 Servers..........................18

1-5 Task and Time List.........................................................................................................................20

1-6 HP Rack 10000 Series Rack Callouts and Dimensions..................................................................22

1-7 42U Rack Dimensions and Weight................................................................................................22

1-8 Recommended Minimum Clearances...........................................................................................24

1-9 Cluster Power Consumption Calculation Worksheet (per Cluster Building Block).....................25

1-10 Cluster Weight Calculation Worksheet (per Cluster Building Block)...........................................27

1-11 Environmental Requirements for Air Handling...........................................................................33

2-1 Thermal Stabilization Specifications.............................................................................................37

A-1 Customer and HP Information Worksheet...................................................................................46

A-2 Site Inspection Worksheet.............................................................................................................47

A-3 Delivery Survey Worksheet...........................................................................................................48

About This Manual

This manual provides an overview of the HP Cluster Platform hardware and describes how to

plan for the receipt and installation of cluster hardware in a dedicated computer facility.

Audience

This guide is intended for experienced hardware administrators of large-scale computer systems,

and for HP Global Deployment representatives. Readers of this book typically perform tasks

such as determining the site requirements for a cluster, modifying the cluster site as needed, and

preparing to receive and install the cluster. Customers can opt either to perform the planning

and preparation work or to purchase preparation and installation services from HP through its

Global Deployment organization.

This guide references skilled tasks and describes important safety considerations and is not

intended as a training aide for untrained personnel. The information in this manual assumes

that the reader has the following abilities:

• Understands the procedures for installing HP rack-mounted components and associated

rack hardware and is trained in safe work procedures.

• Understands networking concepts, network switch technology, and network cabling.

• Is qualified to perform installation planning tasks, such as power budgeting and calculating

floor loads.

• Is familiar with theory and implementation of high-speed system interconnects in modular

clustering technology.

How To Use This Guide

The HP Cluster Platform is available in many different configurations and it is not possible to

include all possible configurations in this guide. To perform site planning and preparation, use

the following procedure:

1. Determine the exact cluster configuration that will be delivered to the site. This information

is usually generated by the system configuration tools that are used by HP Sales. The sales

procedure results in a bill of materials (BOM) that specifies all the components to be delivered.

If you want to begin site planning before the cluster order is generated and a BOM is created,

you will at least need to know the size, model, and type of cluster. For example, you will

need to know if it is a 128-node, CP4000 cluster using Myrinet fiber-optic interconnect

technology.

2. Obtain the documentation for the cluster model. This guide contains specifications for the

cluster components, and other data required for planning. For example, the installation

guide enables you to determine the cluster's density (servers per rack) to calculate heat loads

and power requirements.

If you are performing advance planning and the installation guide is not yet available, use

the information provided for clusters that have similar characteristics, For example:

• The same server models, such as ProLiant DL145 and ProLiant DL585.

• The same interconnect technology, such as Quadrics® and QsNetII™.

• Similar density (servers per rack, racks per cluster).

3. Use the data from the preceding resources to create a site plan by using the procedures and

worksheets described in this guide.

This guide can assist you in the following tasks, depending on your planning requirements.

• Performing a preinstallation site survey

• Preparing a delivery and installation schedule

Audience 7

• Performing a site inspection

• Performing a delivery survey

See the outline and checklists provided in Appendix A.

Organization

This manual is organized as follows:

Describes how to plan for the installation of a cluster.Chapter 1

Describes how to unpack and assemble the cluster racks.Chapter 2

Provides planning checklists.Appendix A

Describes the cluster topology.Appendix B

Provides general guidelines on a dedicated computer room environment.Appendix C

Explains how to calculate noise levels.Appendix D

Explains how to prevent electrostatic damage.Appendix E

See the Terminology Appendix in the Cluster Platform Overview for a glossary of terms used in

this document.

Related Documentation 9

The home page for the InfiniBand Trade Association (location of the specifications) is:

http://www.infinibandta.org/home

The home page for the Voltaire Infiniband Interconnect is:

http://www.voltaire.com/index.html

Warranty, Service, and Support Options

HP Cluster Platform solutions warranties and service options are based on the offerings of the

underlying components. Refer to the appropriate product specifications for HP Cluster Platform.

For information on HP Services offerings go to: http://www.hp.com/hps .

For information on worldwide limited warranty and technical support got to:

http://h18004.www1.hp.com/products/servers/platforms/warranty/index.html

Contact Information and Providing Feedback

HP encourages your comments concerning this document. We are committed to providing

documentation that meets your needs. Send any errors found, suggestions for improvement, or

compliments to [email protected]. Include the document title, manufacturing part number,

and any comment, error found, or suggestion for improvement you have concerning this

document.

Symbols on Equipment

The following symbols (or similar representations) might appear on labels affixed to cluster

components:

WARNING: This symbol, in conjunction with any of the following symbols, indicates the presence

of a potential hazard. The potential for injury exists if warnings are not observed. Consult your

component documentation for specific details.

zk-2071

This symbol indicates that you should not open an enclosure, or otherwise use tools on an enclosure

or component. Sample wording follows:

zk-2072

WARNING: To reduce the risk of injury from electric shock hazards, do not open this enclosure.

Refer all maintenance, upgrades, and servicing to qualified personnel.

This symbol indicates the presence of electric shock hazards. The area contains no user or field

serviceable parts. Do not open for any reason. Sample wording follows:

ZK-2073

WARNING: To reduce the risk of injury from electric shock hazards, do not open this enclosure.

This symbol on an RJ-45 receptacle indicates a network interface connection. Sample wording

follows:

ZK-2073

WARNING: To reduce the risk of electric shock, fire, or damage to the equipment, do not plug

telephone or telecommunications connectors into this receptacle.

This symbol indicates the presence of a hot surface or hot component. If this surface is contacted,

the potential for injury exists. Sample wording follows:

ZK-2074

WARNING: To reduce the risk of injury from a hot component, allow the surface to cool before

touching.

10 About This Manual

These symbols, on power supplies or systems, indicate that the equipment is supplied by multiple

sources of power. Sample wording follows:

ZK-2075

WARNING: To reduce the risk of injury from electric shock, remove all power cords to completely

disconnect power from the system.

This symbol indicates that the component exceeds the recommended weight for one individual

to handle safely. Sample wording follows:

ZK-2076

WARNING: To reduce the risk of personal injury or damage to the equipment, observe local

occupational health and safety requirements and guidelines for manual material handling.

In addition to component labels, there might be warning, safety, and other information labels

on the cluster racks and rack hardware, such as on rail kits and power distribution units (PDUs).

These labels supplement the information that you find in the user documentation for a specific

rack model. Ensure that you read and follow any directions on such labels.

Text Annotations

The following annotations might appear in this guide:

Warning !

Text set off in this manner indicates that failure to follow directions could result in bodily harm

or loss of life

Caution:

Text set off in this manner indicates that failure to follow directions could result in equipment

damage or data loss.

Important:

Text set off in this manner presents clarifying information or specific instructions.

Note:

Text set off in this manner presents commentary, sidelights, or interesting points of information.

Text Annotations 11

Safety Considerations

To avoid bodily harm and damage to electronic components, read the following safety and

comfort guidelines before unpacking and configuring the cluster components. Heed the following

additional warnings and refer to the Preface section titled “HP Cluster Platform Documentation”

to obtain specific information on safety issues for any cluster component:

Avoiding Electrical Shocks To avoid electrical shock, do not open the power supplies

or any other parts and components that bear a warning

label. There are no user-serviceable parts inside.

Only certified technicians should perform the following

tasks:

• Adding electrical circuits for the cluster.

• Checking ground paths.

• Measuring voltage levels of completed circuits.

Laser Radiation Do not open a CD-ROM reader or DVD reader laser

module. There are no user-serviceable parts inside. The

laser module should be serviced by service personnel only.

Do not attempt to make any adjustment to the laser unit.

See the label on the unit for power requirements and

wavelength. HP recommends that you read the ergonomics

information provided on the documentation CD-ROM

before using your system.

Moving and Stabilizing Racks To reduce the risk of personal injury or damage to

equipment in the cluster racks, do not attempt to move the

racks without adequate assistance, due to their height and

weight. Also, do not attempt to move a rack on an incline

that is greater than 10 degrees from the horizontal. No rack

stabilization kits are provided with the cluster. For a

multiple-rack installation, ensure that the racks are coupled

together using the specified baying kit.

Warning!

Some HP cluster models contain zero-U power distribution

units (PDUs). The PDU is mounted in the side of the rack

and you access it by removing the side panel from the rack

cabinet. Do not block access to the side panel by placing

the rack close to other equipment.

Removing and Replacing Cluster

Components

Many cluster components are not equipped with

extendable rail kits and cable management devices. Refer

to the cluster documentation for instructions on how to

move components in the rack. There are no safety interlocks

which prevent the extension of multiple components at

the same time. To reduce the risk of personal injury or

damage to equipment in the cluster racks, do not attempt

to extend more than one component from a rack at a time.

The rack might become unstable and tip over if more than

one component is extended.

Be careful when pressing component rail release latches

and sliding a component into the rack. The slide rails can

pinch your fingertips.

12 Safety Considerations

If you need to remove more than one component from a

rack for any reason, always start from the top of the rack

and remove the lightest items first. When reloading the

rack, start from the bottom of the rack and replace the

heaviest items first.

Refer to the specifications section of the component

documentation to find the weight of a component.

Removing and Replacing

Component Covers

For your safety, never remove the cover from a cluster

component without first disconnecting the power cord

from the power outlet and removing any connection to a

telecommunications network. If a Power Protection Device

is fitted to your system, you must shut down the computer

using its on/off switch, then remove the power cord before

removing the component's cover. Remove the Power

Protection Device cables before any servicing operation.

Always replace the cover before switching the component

on again.

Using Cellular Phones and Other

Wireless Technology

Cellular telephones and other wireless technology can

interfere with the operation of components in the HP

Cluster Platform when the racks are opened and

components are removed for service. A cellular telephone

might emit a particularly strong signal when it is hunting

for a signal. Shut off all wireless technology when servicing

the cluster.

Battery Safety Information There is a danger of explosion if a battery is incorrectly

installed. For your safety, never attempt to recharge,

disassemble, or burn an old battery. Replace the battery

with the same or equivalent type, as recommended by the

manufacturer. The battery in this system is a lithium

battery that does not contain any heavy metals. However,

to protect the environment, do not dispose of batteries in

household waste. Return used batteries either to the shop

from which you bought them, to the dealer from whom

you purchased your system, or to HP so that they can either

be recycled or disposed of correctly. Returned batteries are

accepted free of charge.

Avoiding Hearing Damage Your HP Cluster Platform might exceed local safety

requirements for noise. For your safety and comfort, always

use hearing protection if you are going to be within 10 feet

of the cluster. The cluster documentation contains

information that enables you to calculate the sound energy

produced by the cluster.

Avoiding Burn Injuries Some parts of the cluster or cluster components become

hot during normal use. Wait approximately 3–5 minutes

after shutting off the components for them to cool down

before touching them.

Avoiding Static Electricity Static electricity can damage electronic components and

cause minor electrical shocks. See Appendix E “Preventing

Electrostatic Damage” for more information.

Information on Ergonomics

Ergonomics and safety information is provided with all components. HP recommends that you

read and ensure that you understand all such information before using a component. Safety and

comfort information is provided at the following URL:

http://www.hp.com/ergo/checklist.html

Recycling

Shipping an integrated cluster generates far less packaging than the individual components that

it contains. However, large clusters use a substantial amount of packaging material that is not

reusable. The bulk of the packaging material is recyclable, and is labeled as such. You should

plan on providing a number of dumpsters into which this packaging can be sorted and recycled.

HP has a strong commitment to protecting the environment. Your HP system has been designed

to be as environmentally safe as possible. HP can also take back your old system for recycling

when it reaches the end of its useful life. HP has a product take-back program in several countries.

The collected equipment is sent to HP recycling facilities in Europe or the U.S.A. As many parts

as possible are reused. The remainder is recycled. Special care is taken for batteries and other

potentially toxic substances; these are reduced into non-harmful components through special

chemical processes. If you require more information about the HP product take-back program,

contact your local dealer or your nearest HP Sales Office. Further information is also available

on the HP Product Recycling web site.

14 Safety Considerations

1 Installation Planning

This chapter describes the following preparation work and information gathering that is typically

required to write an installation plan:

• The delivery status of the cluster, (see Section 1.1).

• An overview of the installation process, (see Section 1.2).

• Site preparation and planning requirements, (see Section 1.3).

• Time and labor requirements, (see Section 1.4).

• Physical layout requirements, (see Section 1.5).

• Planning for connections, (see Section 1.6).

• Power supply planning, (see Section 1.7).

• Grounding requirements, (see Section 1.8).

• Environmental requirements, (see Section 1.9).

• Tools and resources, (see Section 1.10).

• Delivery route verification, (see Section 1.11).

Not all topics will apply to your site, and the installation plan might include additional site-specific

requirements for your installation.

HP Global Deployment Services can provide services to assist you with installation planning

and with installation of your cluster. The installation service covers the entire hardware installation

sequence, from site planning to running verification tests of the cluster. When purchased, these

services are specified in your sales agreement.

1.1 Delivery Status

All HP Cluster Platform modules are factory configured and tested at an HP Integration Center

prior to delivery. Configuration at the Integration Center includes the following tasks:

• Install all cluster components and their cable management kits.

• Permanently install cabling that stays within the racks (intra-rack cabling).

Note:

At the time of publication, some Gigabit Ethernet interconnect models are not qualified for

in-rack shipment. You must rack-mount the components on site.

• Temporarily install all cables that run between the racks (inter-rack cabling) to facilitate

hardware testing of all links in the cluster.

• Label all cables, ports and devices only where necessary. The documentation for a specific

model of cluster contains a definitive port-to-port cabling connection guide that specifies

the topologies of the cluster's networks. See Section .

• Configure the cluster's interconnect management processor (its control console) as required

to test all hardware links.

• Connect nodes to the administration and console networks as required to test all hardware

links.

• If specified in the solution, install operating system software and layered products on the

system.

• Configure disk partitions.

• Set up TCP/IP addresses and all network equipment for systems.

• Load any custom configuration files.

• Verify the cluster's hardware configuration.

• Configure optional storage building blocks, external storage devices, or local embedded file

system storage.

1.1 Delivery Status 15

After configuration, the individual racks are disconnected and are mounted on shock pallets for

shipment. Some cables that run between racks are connected to their origin ports, and then looped

and secured within the rack cabinet. This ensures that the cluster is complete and allows for

quick installation of the equipment at the installation site.

This site preparation guide enables you to determine the site requirements and making the

necessary preparations for delivery, power, and network considerations. It also describes the

following procedures, which apply to all installations:

• Taking delivery of the equipment and removing it from the packaging.

• Moving the racks into place, leveling the racks, and bolting them together.

The installation process for a cluster involves the following steps, which are described in detail

in the documentation for a specific cluster model:

1. Connecting and routing cables between the racks.

2. Connecting the cluster's external network link cables to the LAN or WAN.

3. Connecting the cluster's external power cables to the appropriate power sources. Depending

on the installation and connection type, local regulations might specify that a certified

electrical technician be available to perform this task.

4. Turning on each of the cluster components in sequence.

5. Entering license information to unlock preinstalled software on the HP Cluster Platform, or

installing an operating system and any associated products.

6. Performing diagnostics to ensure correct assembly.

7. Troubleshooting the hardware assembly, if necessary.

1.2 Determining the Number of Racks

The cluster hardware is organized into modules (such as CBBs) containing different components,

in which one module equals one rack. See the Cluster Platform Overview for more information.

Dense clusters are restricted to the following configurations, depending on whether the application

server is a 1U design (Table 1-1) or 2U design (Table 1-2).

Table 1-1 Dense Cluster Using 1U Server

ModulesRacksNodes

1 C/UBB (combined)116–32

1 CBB, 1 UBB232–64

2 CBB, 1 UBB364–99

3 CBB, 1 UBB499–128

Table 1-2 Dense Cluster Using 2U Server

ModulesRacksNodes

1 CBB, 1 UBB216–24

2 CBB, 1 UBB324–42

3 CBB, 1 UBB442–60

7 CBB, 3 IBB, 1 UBB, 1 UXR1260–128

For modular (custom) clusters, the actual number of racks in a cluster is determined by the

configuration rules for the number of nodes selected. As you can see from the last line of Table 1-2,

the number of racks increases exponentially as node numbers increase. This is because more

interconnects (IBBs) are required, for the reasons described in Cluster Platform Overview.

If you have already generated an order for a custom cluster, you will know the number of

modules. Otherwise, consult the online cluster documentation for information about the number

16 Installation Planning

of modules in relation to the number of nodes. To find documentation resources, see the section

titled Section in the Preface of this guide.

1.2.1 HP StorageWorks Scalable File Share Rack Configurations

HP SFS An typical system can consist of a base rack which contains:

• ProLiant DL380 MDS and administration servers, which also function as Object Storage

Servers

• HP SFS20 Enclosures

• A management network HP ProCurve Switch 2626

• KVM switch

• TFT console display

An HP SFS expandable configuration consists of a base rack which contains the MDS and

administrative server, pairs of Object Storage Servers, and the other items listed above. The MDS

server, administration server, and each pair of Object Storage Servers have associated HP SFS20

Enclosures.

An expandable configuration can also have expansion racks which contain pairs of Object Storage

Servers and HP SFS20 Enclosures. The number of expansion racks in the maximum configuration

(32 Object Storage Servers) depends on both the number of HP SFS20 Enclosures for each Object

Storage Server and the type of server used.

An HP SFS system with 10 or fewer Object Storage Servers uses one HP ProCurve Switch 2626

for the management network. Configurations with between 12 and 22 Object Storage Servers

require a second HP ProCurve Switch 2626 for the management network. A third HP ProCurve

Switch 2626 is required for larger configurations of between 24 and 32 Object Storage Servers.

1.2.2 HP SFS for HP SFS20 Enclosure Building Blocks

In an HP SFS for HP SFS20 Enclosure configuration, the number of Object Storage Servers that

can be installed in a cabinet depend on the type of server (DL360 or DL380) and on the ratio of

HP SFS20 Enclosures to servers.

For example, a building block with a 1:1 ratio of HP SFS20 Enclosures to ProLiant DL360 servers

requires 6U of cabinet space (2U for the two DL360s, and 4U for the two HP SFS20 Enclosures).

The same building block using ProLiant DL380 servers requires 8U of cabinet space (4U for the

two DL380s, and 4U for the two HP SFS20 Enclosures). A ProLiant DL360 4:1 building block

needs 18U, whereas a ProLiant DL380 4:1 building block requires 20U of cabinet space.

Table 1-3 and Table 1-4 list the cabinet capacities for Object Storage Server building blocks using

varying ratios. The base rack is always configured to allow a 2:1 ratio of HP SFS20 Enclosures

to MDS and administration servers.

Table 1-3 Number of Object Storage Servers in a Cabinet Using ProLiant DL360 Servers

Ratio

4:14

3:13

2:12

1:11

Cabinet

2248Base

46814Expansion

1 The maximum configuration requires 3 racks.

2 The maximum configuration requires 5 racks.

3 The maximum configuration requires 6 racks.

4 The maximum configuration requires 9 racks.

1.2 Determining the Number of Racks 17

Table 1-4 Number of Object Storage Servers in a Cabinet Using ProLiant DL380 Servers

Ratio

4:13

3:13

2:12

1:11

Cabinet

2246Base

44610Expansion

1 The maximum configuration requires 4 racks.

2 The maximum configuration requires 6 racks.

3 The maximum configuration requires 9 racks.

1.2.3 Example HP SFS System Rack Configurations

An HP SFS for HP SFS20 Enclosure system has a minimum of one base rack. It may also have

expansion racks. The base rack is flanked by expansion racks that contain only Object Storage

Servers and their associated HP SFS20 Enclosures.

The number of racks depends on:

• The model of ProLiant server used (DL360 or DL380)

• The ratio of HP SFS20 Enclosures to Object Storage Servers

The base rack contains:

• The ProLiant DL380 MDS and administration servers and their associated HP SFS20

Enclosures at a 1:1 or 2:1 ratio

• KVM switch

• TFT console display

• Management network ProCurve switches

• The first sets of Object Storage Servers and their associated HP SFS20 Enclosures

The expansion racks contain the remaining sets of Object Storage Servers and their associated

HP SFS20 Enclosures.

Note:

The ratio of HP SFS20 Enclosures to Object Storage Servers must remain the same throughout

all the cabinets.

Figure 1-1 shows maximum cabinet configurations using ProLiant DL360 Object Storage Servers

with a ratio of 1:1 (HP SFS20 Enclosures to Object Storage Servers).

18 Installation Planning

Figure 1-1 Maximum Rack Configuration Using a 1:1 Ratio of HP SFS20 Enclosures to ProLiant

DL360 Object Storage Servers

Base Rack

Expansion

Rack 1

Expansion

Rack 2

Object

Storage

Servers

0 - 7

MDS &

Admin

Servers

Object

Storage

Servers

22 - 35

ProCurve

Switch

1, 2, 3

SFS20

Enclosures

SFS20-M0A,

SFS20-M0B,

SFS20-M1A,

SFS20-M1B

SFS20

Enclosures

SFS20-00A,

SFS20-01A,

SFS20-02A,

SFS20-03A,

SFS20-04A,

SFS20-05A,

SFS20-06A,

SFS20-07A

Object

Storage

Servers

8 - 21

SFS20

Enclosures

SFS20-08A,

SFS20-09A,

SFS20-10A,

SFS20-11A,

SFS20-12A,

SFS20-13A,

SFS20-14A,

SFS20-15A,

SFS20-16A,

SFS20-17A,

SFS20-18A,

SFS20-19A,

SFS20-20A,

SFS20-21A

SFS20

Enclosures

SFS20-22A,

SFS20-23A,

SFS20-24A,

SFS20-25A,

SFS20-26A,

SFS20-27A,

SFS20-28A,

SFS20-29A,

SFS20-30A,

SFS20-31A,

SFS20-32A,

SFS20-33A,

SFS20-34A,

SFS20-35A

Object

Storage

Servers

50 - 63

Object

Storage

Servers

36 - 49

Expansion

Rack 3

Expansion

Rack 4

SFS20

Enclosures

SFS20-50A,

SFS20-51A,

SFS20-52A,

SFS20-53A,

SFS20-54A,

SFS20-55A,

SFS20-56A,

SFS20-57A,

SFS20-58A,

SFS20-59A,

SFS20-60A,

SFS20-61A,

SFS20-62A,

SFS20-63A

SFS20

Enclosures

SFS20-36A,

SFS20-37A,

SFS20-38A,

SFS20-39A,

SFS20-40A,

SFS20-41A,

SFS20-42A,

SFS20-43A,

SFS20-44A,

SFS20-45A,

SFS20-46A,

SFS20-47A,

SFS20-48A,

SFS20-49A

For more configuration examples, see the HP StorageWorks Scalable File Share manuals.

1.3 Site Preparation and Planning Overview

Read the following topics in conjunction with the technical specifications included in the

appendixes of the online cluster documentation. See the Preface section titled Section for the

location of the online documentation. Information in this section is intended to help HP customers

and HP Global Deployment representatives to prepare an installation plan and schedule any

necessary site work. For example, it might be necessary for you to make physical modifications

to your site before you can receive the cluster for installation.

A cluster is delivered as pre-configured building block modules installed in HP model 10000-series

racks, usually a 42U (2-meter) rack. For some configurations, a shorter rack model might be

employed. The building block modules are packaged and mounted on shock pallets for shipping.

In addition to the information in this chapter, you should consult the following resources,

particularly if you are unfamiliar with the HP 10000 series rack or with the process of receiving

preconfigured systems:

• Online information for the HP rack 10000 Series is located at the following URL:

http://h18000.www1.hp.com/products/servers/platforms/rackandpower.html

•Best Practices for HP 10000 Series and HP 10000 Series G2 is available at the following location:

http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00637362/c00637362.pdf

1.3 Site Preparation and Planning Overview 19

•Optimizing Data Centers for High-Density Computing is available at the following location:

http://h18000.www1.hp.com/products/servers/proliantstorage/racks/10000series/documentation.html

•Power and Cooling Trends in the Datacenter available at the following location:

http://techcomm.cca.cpqcorp.net/whitepapers/tc030203tb.pdf

• Power Calculator (ProLiant)

http://h18001.www1.hp.com/partners/microsoft/utilities/power.html

• For HP Cluster Platform BladeSystem configurations, see the HP BladeSystem Site Planning

Guide at the following location:

http://h71028.www7.hp.com/enterprise/cache/499697-0-0-0-121.html

You can find other white papers of interest at the following URL:

http://h18004.www1.hp.com/products/servers/technology/whitepapers/proliant-storage.html

General guidelines for computer room planning are located in Appendix C.

1.4 Time and Labor Requirements

This section provides information that enables you to plan a schedule for the installation and

plan human resources. In addition to the actual installation time, you might also need to plan

and schedule down time for adjacent systems, particularly if they are moved or powered down

to facilitate the cluster installation. Your service requirements will determine when you can

implement the schedule. For example, you might need to begin the installation at a specific hour

in order to avoid impacting peak usage time for other systems.

Caution:

Any work in a computer room has the potential to disrupt normal services. While every care is

taken to avoid disruptions, emergencies might result in unplanned outages. Include appropriate

contingency planning in your site preparation, such as warning users of potential outages.

As a planning guideline only, Table 1-5 indicates typical times required for installation tasks.

Table 1-5 Task and Time List

Task TimeTask

20 minutesUnpacking (per rack)

15 minutesRack preparation (per rack per person)

90 minutesInterrack cabling (per CBB per person)

45 minutesInstallation of ProCurve system, Gb/E (per box per person)

Plan for the availability of key personnel to provide specific services or to assist in moving and

unpacking the cluster. Such availability might constrain the times at which you can schedule

installation. Timely availability of key personnel ensures that the HP service representative can

install the cluster with maximum efficiency. The following people might be needed:

• System or site administrators.

• Site electrical engineers.

• Security personnel for access to restricted areas. Ensure that security badges or pass keys

are available to HP service personnel, where appropriate.

•Suitably equipped and trained personnel to assist in heavy lifting. While component removal

is not anticipated, post-installation troubleshooting might require the removal of components.

Some rack-mounted components weigh 27.2 kg (60 pounds) and require at least two people

to remove and replace in the rack. The HP 10000 Series 42U rack is 2 meters (78.7 in) tall,

and component installation might require some overhead lifting. Consult the rack and

component safety information before attempting to remove and replace rack components.

20 Installation Planning

Other manuals for Cluster Platform Introduction v2010

This manual suits for next models

Table of contents

Other HP Server manuals

HP D5970A - NetServer - LCII User manual

HP Tc4100 - Server - 256 MB RAM User manual

HP DL120 - ProLiant - G5 User instructions

HP D5970A - NetServer - LCII User manual

HP ProLiant WS460c G6 Workstation Blade User manual

HP Tc2120 - Server - 256 MB RAM Instruction Manual

HP DesignJet T730 Operating and maintenance manual

HP rp7420 User manual

HP ProLiant BL360 G5 Manual

HP P5389A - Intel Pentium III-S 1.4 GHz Processor... User manual

HP Proliant DL580 User manual

HP D7171A - NetServer - LPr Parts list manual

HP D7171A - NetServer - LPr User manual

HP Integrity rx8640 User instructions

HP D7171A - NetServer - LPr User manual

HP AlphaServer DS15 Specification sheet

HP ProLiant ML115HP User instructions

HP rp4410 User manual

HP cc2300 User manual

HP t5300 - Thin Client User manual

HP ProLiant ML350e Gen8 Manual

HP ProLiant DL380 Gen10 Plus Installation instructions

HP ProLiant ML110 Gen9 User manual

HP ProLiant SL250s Gen8 User manual

Popular Server manuals by other brands

Grandstream Networks

Grandstream Networks GXV 3501 quick start guide

Dell

Dell EMC PowerProtect DD6400 System Expansion guidelines

3One data

3One data NP5100 Series Quick installation guide

Tripp Lite

Tripp Lite U2S-2A Specifications

7th Sense

7th Sense R Series user guide

Multitech

Multitech FaxFinder FF240 Administrator's guide

Blackbe;rry

Blackbe;rry ENTERPRISE SERVER FOR MICROSOFT EXCHANGE installation guide

seeed studio

seeed studio reServer Getting started

Multitech

Multitech FaxFinder FF130 Administrator user guide

7th Sense

7th Sense M101-4 user guide

q-Tech

q-Tech QSRV-26 Series manual

InWin

InWin IW-RS112-08 user manual

Black Box

Black Box LES1102A quick start guide

3One data

3One data NP316Series user manual

Planet

Planet 1-Bay SATA NAS Server NAS-7100 Quick installation guide

HIK VISION

HIK VISION DS-6001FI user manual

ARTESYN EMBEDDED TECHNOLOGIES

ARTESYN EMBEDDED TECHNOLOGIES ATCA-8330 manual

Black Box

Black Box LS4103A user manual

HP Cluster Platform Introduction v2010 Reference manual

Popular Server manuals by other brands