Cray CX1000 User manual

Blade System
Installation Guide

The following copyright notice protects this book under Copyright laws which prohibit such actions as, but
not limited to, copying, distributing, modifying, and making derivative works.
Trademarks and Acknowledgements
We acknowledge the rights of the proprietors of the trademarks mentioned in this manual.
All brand names and software and hardware product names are subject to trademark and/or patent
protection.
Quoting of brand and product names is for information purposes only and does not represent trademark
misuse.
The information in this document is subject to change without notice. Cray will not be liable for
errors contained herein, or for incidental or consequential damages in connection with the use of
this material.

Preface i
Table of contents
Preface ............................................................................................................................... v
Intended readers ............................................................................................................................................v
Highlighting.......................................................................................................................................................v
Related publications ......................................................................................................................................v
Legal information ........................................................................................................................................... vi
Regulatory declarations and disclaimers ......................................................................................... vi
FCC Declaration of conformity ......................................................................................................... vii
Canadian compliance statement (Industry Canada) ................................................................. vii
Laser compliance notice....................................................................................................................viii
Safety information.........................................................................................................................................viii
Definition of safety notices .................................................................................................................viii
Electrical safety....................................................................................................................................... x
Laser safety information ........................................................................................................................ x
Data integrity and verification............................................................................................................ xi
Waste management ............................................................................................................................ xi
Installation flowchart .....................................................................................................................................xii
Chapter 1. Delivery ..................................................................................................... 1
1.1 Introduction ........................................................................................................................................2
1.2 Inspecting the Cray CX1000 blade system packing..................................................................3
1.3 Unpacking the Cray CX1000 blade system .................................................................................4
1.3.1 Removing the Cray CX1000 blade system packing........................................................4
1.4 Checking the Cray CX1000 blade system ...................................................................................5
Chapter 2. Getting to know the Cray CX1000 blade system ................................. 7
2.1 Overview.............................................................................................................................................8
2.2 What your Cray CX1000 blade system offers ............................................................................10
2.3 Reliability, Availability, and Serviceability (RAS)........................................................................12
2.4 Features and specifications ..........................................................................................................13
2.4.1 Cabinet specification..........................................................................................................13
2.4.2 Cray CX1000 blade chassis-level platform management ...........................................13
2.4.3 Server-level platform management .................................................................................13
2.4.4 External connections/interfaces .......................................................................................14
2.5 Components, controls, and LEDs .................................................................................................15
2.5.1 Front view...............................................................................................................................16
2.5.2 Rear view ...............................................................................................................................22
Chapter 3. Installing the Cray CX1000 blade system in the cabinet................... 33
3.1 Cray CX1000 blade system cabinet requirements...................................................................34
3.2 Preparing the Cray CX1000 blade chassis rack-mount kit......................................................35

ii
3.2.1 Checking the rack-mount kit............................................................................................. 35
3.2.2 Required tools ....................................................................................................................... 35
3.3 Installing rack-mount rails in the cabinet ................................................................................... 36
3.4 Securing the Cray CX1000 blade chassis in position ............................................................... 37
Chapter 4. Connecting and testing the Cray CX1000 blade system...................39
4.1 Connecting the Cray CX1000 blade system to the site power supply ................................ 40
4.2 Powering on the Cray CX1000 blade system for the first time............................................... 41
4.3 Checking correct operation......................................................................................................... 42
4.4 Powering off the Cray CX1000 blade system............................................................................ 43
4.5 Connecting the Cray CX1000 blade system to the site LAN ................................................. 44
4.6 Testing LAN connections ............................................................................................................... 46
4.7 Setting up the Cray CX1000 blade system for remote access via the CHC....................... 47
4.8 Setting up the Cray CX1000 compute blades for remote access via the BHC ................. 48
Appendix A. Cray CX1000 blade system specifications.............................................51
Glossary ............................................................................................................................53
Index .................................................................................................................................63

Preface iii
List of figures
Figure 1-1. Cray CX1000 blade system...................................................................................................2
Figure 1-2. Inspecting the Cray CX1000 blade system packing .........................................................3
Figure 2-1. User label.................................................................................................................................9
Figure 2-2. Major Cray CX1000 blade system components...............................................................15
Figure 2-3. Front view...............................................................................................................................16
Figure 2-4. Cray CX1000 compute blade (18 in total) ........................................................................17
Figure 2-5. Cray CX1000 compute blade.............................................................................................17
Figure 2-6. Fan blades.............................................................................................................................20
Figure 2-7. Local Control Panel ..............................................................................................................21
Figure 2-8. Rear view ...............................................................................................................................22
Figure 2-9. Power Supply Unit .................................................................................................................23
Figure 2-10. Chassis Management Module............................................................................................25
Figure 2-11. Quad Switch Module............................................................................................................27
Figure 2-12. Ultra Capacitor Module .......................................................................................................28
Figure 2-13. Ethernet Switch Module .......................................................................................................30
Figure 3-1. Recommended position of Cray CX1000 blade system .................................................34
Figure 3-2. Installing rack-mounted rail in cabinet .............................................................................36
Figure 3-3. Securing the Cray CX1000 blade chassis in the cabinet ................................................37
Figure 4-1. Connecting the Cray CX1000 blade system to the site LAN...........................................44
Figure 4-2. Chassis Hardware Console page .......................................................................................47
Figure 4-3. Blade Hardware Console page ..........................................................................................49

iv
List of tables
Table 2-1. Record information .................................................................................................................8
Table 3-1. Rack-mount kit items ...........................................................................................................35

Preface v
Preface
This guide explains how to install your Cray CX1000 blade system.
Note The Cray Web site may be consulted for product information, documentation,
downloads, updates, and service offers:
http://Cray.com
Intended readers
This guide is intended for use by qualified support personnel.
Highlighting
The following highlighting conventions are used in this guide:
Bold Identifies the following:
Interface objects such as menu names, labels, buttons and icons
File directory and path names
Keywords to which particular attention must be paid
Italics Identifies references such as manuals or URLs
Related publications
Cray CX1000 blade system Maintenance and Troubleshooting Guide explains
how to maintain, service, and upgrade the Cray CX1000 blade system. This guide
is intended for use by qualified support personnel
Cray CX1000 blade chassis User's Guide explains how to use the Cray CX1000
blade chassis. This guide is intended for use by Customer Administrators and
Operators
Cray CX1000 compute blade User's Guide explains how to use the Cray CX1000
compute blade. This guide is intended for use by Customer Administrators and
Operators

vi
Legal information
Regulatory declarations and disclaimers
Declaration of the manufacturer or importer
We hereby certify that this product is in compliance with:
European Union EMC Directive 2004/108/EC, using standards EN55022 (Class A)
and EN55024 and Low Voltage Directive 2006/95/EC, using standard EN60950
International Directive IEC 60297 and US ANSI Directive EIA-310-E
Safety compliance statement
UL 60950-1 USA
EC 60950-1 international
CSA 60950-1 Canada
European Community (EC) Council directives
This product is in conformity with the protection requirements of the following EC
Council Directives:
Electromagnetic compatibility
2004/108/EC
Low voltage 2006/95/EC
EC conformity 93/68/EEC
Telecommunications terminal equipment
1999/5/EC
Neither the provider nor the manufacturer can accept responsibility for any failure to
satisfy the protection requirements resulting from a non-recommended modification
of the product.
Compliance with these directives requires:
An EC declaration of conformity from the manufacturer
An EC label on the product
Technical documentation

Preface vii
Mechanical structures
IEC 60297
EIA-310-E
FCC Declaration of conformity
This device complies with Part 15 of the FCC Rules. Operation is subject to the
following two conditions: (1) this device may not cause harmful interference, and (2)
this device must accept any interference received, including interference that may
cause undesired operation.
Federal Communications Commission (FCC) Statement
This equipment has been tested and found to comply with the limits for a Class A
digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to
provide reasonable protection against harmful interference when the equipment is
operated in a commercial environment. This equipment generates, uses, and can
radiate radio frequency energy and, if not installed and used in accordance with the
instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful
interference in which case the user will be required to correct the interference at
their own expense.
Properly shielded and grounded cables and connectors must be used in order to
meet FCC emission limits. Neither the provider nor the manufacturer is responsible for
any radio or television interference caused by using other than recommended
cables and connectors or by unauthorized changes or modifications to this
equipment. Unauthorized changes or modifications could void the user's authority to
operate the equipment.
Pursuant to Part 15.21 of the FCC Rules, any changes or modifications to this
equipment not expressly approved by Cray, Inc may cause harmful interference and
void the FCC authorization to operate this equipment.
An FCC regulatory label is affixed to the equipment.
Canadian compliance statement (Industry Canada)
This Class A digital apparatus meets all requirements of the Canadian Interference
Causing Equipment Regulations.
Cet appareil numérique de la classe A est conforme à la norme NMB-003 du
Canada.
This product is in conformity with the protection requirements of the following
standards:
ICES-003
NMB-003

viii
Laser compliance notice
This product that uses laser technology complies with Class 1 laser requirements.
A CLASS 1 LASER PRODUCT label is affixed to the laser device.
Class 1 Laser Product
Luokan 1 Laserlaite
Klasse 1 Laser Apparat
Laser Klasse 1
Safety information
For Your Safety, this manual contains important information, required to operate the
server safely. Thoroughly review the information in this manual before using the server.
Use the following safety guidelines to ensure your personal safety and to help protect
your server from potential damage. Throughout this guide, blocks of text may be
accompanied by an icon which needs to be followed for your safety.
Definition of safety notices
DANGER
A Danger notice indicates the presence of a hazard that has the potential of causing
death or serious personal injury.
CAUTION
A Caution notice indicates an action that could cause damage to a program,
device, system, or data. A Caution notice may also indicate the presence of a
hazard that has the potential of causing moderate or minor personal injury.
Read the installation instructions before connecting the system to the power source.
Hazardous current and energy levels are present in areas indicated by this label.
There are no serviceable parts inside these components. If you suspect a problem
with one of these parts, contact a service technician.
CAUTION
This unit is intended for installation in restricted access areas. A restricted access area
can be accessed only through the use of a special tool, lock and key or other means
of security. Only trained and qualified personnel should be allowed to install, replace,
or service this equipment.
This equipment must be grounded. Contact the appropriate electrical inspection
authority or an electrician if you are uncertain that suitable grounding is
available

Preface ix
Do not overload the AC supply branch circuit that provides power to the rack.
The total rack load should not exceed 80 percent of the branch circuit rating
Use only power cables that are approved for use in the respective country. The
power cable must be rated for the product and for the voltage and current
marked on the product‟s electrical ratings label. The voltage and current rating
of the cable should be greater than the ratings marked on the product
If any of the following conditions occur, unplug the equipment from the
electrical outlet and replace the part or contact your trained service technician:
The power cable, extension cable, or plug is damaged
An object has fallen into the equipment
The equipment has been exposed to water
The equipment does not operate correctly when you follow the operating
instructions
Allow the equipment to cool before removing covers or touching internal
components
Suitable disconnect device must be provided as part of the building installation.
The purpose of the disconnect device is to provide an easy and accessible
means for removing power from the product for servicing
Opening or removing covers that are marked with the triangle symbol with a
caution mark may expose you to risk of electrical shock. Components inside
these compartments should be serviced only by a trained service technician
Ensure that the voltage and frequency of your power source match the voltage
and frequency inscribed on the equipment‟s electrical rating label
Hazardous energy is present when the blade is connected to the power source.
Always replace the blade cover before installing the blade
When removing the Cray CX1000 compute blade/power supply, dummy Cray
CX1000 compute blade, filler covers, do not insert your hand into the open slots.
Doing so may cause electric shock
Do not operate your equipment with any filler covers removed
Do not push any objects into the openings of your system components. Doing so
can cause fire or electric shock by shorting out interior components
Do not use top blade handle to lift the Cray CX1000 blade chassis. These are
used only to install and remove the blade only
Do not restrict airflow into the equipment by blocking any vents or air intakes
Cleaning: Unplug your system from wall outlet before cleaning
Do not spill food or liquids on your system components. Never operate the
product in a wet environment
CAUTION
When connecting or disconnecting power to hot-pluggable power supplies observe
the following guidelines:
Install the power supply before connecting the power cable to the power supply

x
Unplug the power cable before removing the power supply
If the equipment has multiple sources of power, disconnect power from the
system by unplugging all power cables from the power supplies to reduce shock
hazard
Never open the power supply module for any reason
The power supplies in your system may produce high voltages and energy
hazards. Only trained service technicians are authorized to remove the covers
and access any of the components inside the system
CAUTION
Incorrectly installing a battery or using an incompatible battery may increase the risk
of fire or explosion. Replace the battery only with the same or equivalent type
recommended by the manufacturer, carefully following installation instructions.
Dispose of used batteries properly. Handle batteries carefully. Do not disassemble,
crush, or puncture batteries.
Electrical safety
DANGER
The Customer is responsible for ensuring that the AC electricity supply is compliant
with national and local recommendations, regulations, standards and codes of
practice.
An incorrectly wired and grounded electrical outlet may place hazardous voltage on
metal parts of the system or the devices that attach to the system and result in an
electrical shock.
It is mandatory to remove power cables from electrical outlets before relocating the
system.
CAUTION
This unit has more than one power supply cable. Follow procedures for removal of
power from the system when directed.
Laser safety information
The optical drive in this system unit is classified as a Class 1 level Laser product. The
optical drive has a label that identifies its classification.
The optical drive in this system unit is certified in the U.S. to conform to the
requirements of the Department of Health and Human Services 21 Code of Federal
Regulations (DHHS 21 CFR) Subchapter J for Class 1 laser products. Elsewhere, the
drive is certified to conform to the requirements of the International Electro technical
Commission (IEC) 60825-1: 2001 and CENELEC EN 60825-1: 1994 for Class 1 laser
products.

Preface xi
CAUTION
Invisible laser radiation when open. Do not stare into beam or view directly with
optical instruments.
Class 1 Laser products are not considered to be hazardous. The optical drive
contains internally a Class 3B gallium-arsenide laser that is nominally 30 milliwatts at
830 nanometers. The design incorporates a combination of enclosures, electronics,
and redundant interlocks such that there is no exposure to laser radiation above a
Class 1 level during normal operation, user maintenance, or servicing conditions.
Data integrity and verification
CAUTION
Cray products are designed to reduce the risk of undetected data corruption or loss.
However, if unplanned outages or system failures occur, users are strongly advised to
check the accuracy of the operations performed and the data saved or transmitted
by the system at the time of outage or failure.
Waste management
This product has been built to comply with the Restriction of Certain Hazardous
Substances (RoHS) Directive 2002/95/EC.
This product has been built to comply with the Waste Electrical and Electronic (WEEE)
Directive 2002/96/EC.

xii
Installation flowchart
Step
Installation process
Remarks
Pointers in guide
1
Unpacking the
Cray CX1000 blade
system
Inspect the Cray CX1000 blade
system packing, unpack and
unload, and store packing items.
Chapter 1
2
Installing the Cray
CX1000 blade
system in the
cabinet
Fix the rack mount brackets and
shipping brackets, push the Cray
CX1000 blade system into the
cabinet and secure it with screws.
Chapter 3
3
Powering the Cray
CX1000 blade
system
Section 4.2
4
Connecting the
Cray CX1000 blade
system to the LAN
Connect the Cray CX1000 blade
system to the site LAN and test
network connections.
Section 4.5
5
Setting up the Cray
CX1000 blade
system
Configure the Cray CX1000 blade
system for remote management.
Sections 4.7 and
4.8

Chapter 1. Delivery 1
Chapter 1.Delivery
This chapter explains delivery, unpacking, and inspection for the Cray CX1000 blade
system.

2
1.1 Introduction
The Cray CX1000 blade system is a high-density and high-performance rack-
mounted server system developed for medium-to-large businesses. The Cray CX1000
blade system is delivered in a box that contains all the data and items required for
installation.
Figure 1-1. Cray CX1000 blade system
CAUTION
It is mandatory for the Cray CX1000 blade system to be transported vertically.

Chapter 1. Delivery 3
1.2 Inspecting the Cray CX1000 blade system packing
Before unpacking, inspect the Cray CX1000 blade system packing to check its
condition:
Check for any damages or any visible defects on the packaged Cray CX1000
blade system
Shockwatch label should be in white color, which indicates that the package
has not faced any impact or thrust force during transit
Tiltwatch label should not be in red
Note the indicator status on the bill of lading and carefully inspect the Cray
CX1000 blade system before powering up
Figure 1-2. Inspecting the Cray CX1000 blade system packing
A. Tiltwatch
B. Shockwatch
C. Safety label
D. Wooden stand
E. Packing lists
F. Product label
G. Warning label

4
1.3 Unpacking the Cray CX1000 blade system
After ensuring that the Cray CX1000 blade system package is devoid of damages,
you have to unpack and store it in a proper place.
DANGER
Authorized service personnel only may unpack and physically install the Cray
CX1000 blade system.
1.3.1 Removing the Cray CX1000 blade system packing
CAUTION
To avoid personnel injury, before lifting the Cray CX1000 blade system, remove all the
Cray CX1000 compute blades to reduce the weight.
The following steps help you to remove the packing:
1. Cut the straps covering the package.
2. Remove the top corrugated cover.
The inner foam is now visible and it contains another small package that has a
rack-mounting kit and shipping bracket assembly that are needed to place the
Cray CX1000 blade system in a cabinet.
3. Remove the small package and take out this top foam.
There will be another corrugated sleeve covering the Cray CX1000 blade system
from outside.
4. Hold the sleeve and lift it up.
5. Remove the inner foams at different ends.
6. Move the Cray CX1000 blade system to a required place, like a cabinet, through
suitable lifting equipment.
mportant
Store the package material in a safe and clean place for possible future use.

Chapter 1. Delivery 5
1.4 Checking the Cray CX1000 blade system
Perform a preliminary visual inspection after unpacking the Cray CX1000 blade
system. The following list helps in your inspection:
Check that the Cray CX1000 blade system delivered is compliant with the
Purchase Order
Check for internal damage, alterations and obvious safety hazards, such as
broken wires, sharp edges, or broken insulation
Check internal cables for damage
CAUTION
If the inspection indicates an unacceptable safety condition, the condition must be
corrected before powering up the Cray CX1000 blade system.