HP Cluster Platform Express v2010 Instruction sheet

HP Cluster Platform
Cisco SFS 7000D, 7012D, and 7024D InfiniBand
Interconnects
Read This First: Documentation Roadmap
This document describes how to access the documentation that you will need to maintain and troubleshoot a
Cisco InfiniBand interconnect.
Part number: AC-CIBRM-1F
Third Edition: August 2008

Overview
The documentation for the Cisco® SFS 7000D, 7012D, and 7024 InfiniBand™ interconnects and
related Cluster Platform documentation referenced in this guide is available from the docs.hp and
Cisco websites. You can link directly to any of the documentation here to assist you in maintaining
your Cluster Platform.
NOTE: Before you begin any system operations, go to the following website and download the
latest documentation updates:
http://www.docs.hp.com/en/highperfcomp.html (High Performance Computing)
If your hardware configuration contains HP BladeSystems and enclosures, important updates are
available from this site.
2

Cisco SFS 7000D, 7012D, and 7024D InfiniBand
Interconnect Documentation
The Cisco SFS 7000D, 7012D, and 7024D InfiniBand interconnects are modular systems that you
can use to create large, single-system grid/cluster fabrics, or you can use them as building blocks
for larger fabrics. These interconnects are designed to maximize performance, streamline
operations, and to ensure uptime by providing full hardware and software reliability, availability, and
serviceability (RAS) features.
Although these Cisco interconnects and cables were installed by an HP service representative, it is
assumed that you are familiar with the Cisco InfiniBand Interconnects and have the knowledge
necessary to maintain and troubleshoot the Cisco technology that is used in an HP Cluster Platform
solution. This document contains links to the documentation that you will need to troubleshoot and
maintain the Cisco interconnects.
All of the documentation referenced in this document is currently available on the docs.hp.com and
Cisco websites. If you have any comments about this HP document, please send them to:
http://docs.hp.com/en/feedback.html
NOTE: Before you begin any system operations, go to the High Performance Computing website
to download the latest documentation updates:
http://www.docs.hp.com/en/highperfcomp.html
If your hardware configuration contains HP BladeSystems and enclosures, important updates are
available at the preceding site.
NOTE: For technical support and updates, contact your HP representative rather than using the
Cisco Technical Assistance Center (TAC) referenced in the Cisco documentation.
Revision History
Revision
Date Changes
August
2008 Added new release notes for OFED Release 1.3 and link to new version of the supported
firmware support matrix released in May 2008.
May 2008 Changed document title to specify interconnect names.
March
2008 Added:
Revised outdated links throughout
Revised versions of the 7012 Hardware Installation Guide, 7012 InfiniBand
Server Switch Hardware User Guide, SFS 7000 Series Product Family Chassis
Manager User Guide, SFS 7000 Series Product Family Element Manager User
Guide, 7024 InfiniBand Server Switch Hardware Users Guide, and 7024
InfiniBand Server Switch Installation and Configuration Note
January
2008 First edition
3

Cisco SFS 7000D InfiniBand Interconnect Documentation
The Cisco SFS 7000D InfiniBand Interconnect and cables were installed by an HP service
representative. Go only to the HP Web site for updates, technical assistance, and support.
The following documents are provided for your reference and contain information necessary for you
to perform certain maintenance and troubleshooting procedures for the Cisco SFS 7000D InfiniBand
Interconnect. Chapters that contain maintenance and troubleshooting procedures are indicated in
bold text.
Title/Contents
Cisco SFS 7000D InfiniBand Server Switch (January 2008)
Web page with general switch information and links to product literature and data sheets.
Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide,
Release 2.9.0 (updated March 2007)
Chapters:
Product Overview
Preparation for Installation
Installing the Switches
Installing Field Replaceable Units
Managing the Switch
Hardware Diagnostic Tests
Cisco SFS 7000D InfiniBand Server Switch Installation and Configuration Note, Release 2.9.0
(January 2007)
Sections:
Safety Overview
Parts List
Required Tools
Installation Guidelines
Installing the Cisco SFS 7000D Server Switch
Connecting and Removing InfiniBand Cables
Configuring the Cisco SFS 7000D Server Switch
Connecting the 10/100 Ethernet Management Port
Troubleshooting
Translated Safety Warnings
Related Documentation
Obtaining Documentation
Documentation Feedback
Cisco Product Security Overview
Product Alerts and Field Notices
Obtaining Technical Assistance
Obtaining Additional Publications and Information
4

Cisco SFS InfiniBand Redundancy Configuration Guide Release 2.10 (December 2007)
Provides redundancy configuration information for enterprise solutions containing SFS switches.
Cisco SFS 7000 Series Product Family Chassis Manager User Guide Release 2.9.0 (February
2008)
Topics include:
Getting started
Chassis tasks
Maintenance tasks
InfiniBand tasks
Ethernet tasks
Fibre Channel tasks
Cisco SFS 7000 Series Product Family Element Manager User Guide Release 2.9.0 (February
2008)
Topics include:
About Element Manager
Chassis display tasks
Files tasks
Edit tasks
Maintenance tasks
Health tasks
Report tasks
Various InfiniBand management tasks
Ethernet Menu tasks
Fibre Channel Menu tasks
Help Menu tasks
InfiniBand concepts
Cisco SFS Product Family Command Reference Release 2.9.0 (June 2007)
Topics include:
Using the command-line interface
Command groups
Commands
NOTE: For technical support and updates, contact your HP representative rather than using the
Cisco Technical Support Web site referenced in the Cisco documentation.
5

Cisco SFS 7012D InfiniBand Interconnect Documentation
The Cisco SFS 7012D InfiniBand Interconnect and cables were installed by an HP service
representative. Go only to the HP Web site for updates, technical assistance, and support.
The following documents are provided for your reference and contain information necessary for you
to perform certain maintenance and troubleshooting procedures for the Cisco SFS 7012 InfiniBand
Interconnect. Chapters and appendices that contain maintenance and troubleshooting procedures
are indicated in bold text.
Title/Contents
Cisco SFS 7012 InfiniBand Server Switch (January 2008)
Web page with general switch information and links to product literature and data sheets.
Cisco SFS 7012 Hardware Installation Guide (January 2007)
Chapters:
Product Overview
Installation
Operations and Administration
Technical Specifications
Command Line Interface
Troubleshooting
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide, Release 4.1 (January 2008)
Chapters:
Product Overview
Installation
Operations and Administration
Technical Specifications
Command Line Interface
Troubleshooting
Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide, Release 3.4 (February 2007)
Chapters:
Product Overview
Installation
Operations and Administration
Technical Specifications
Command Line Interface
Troubleshooting
Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note, Release 4.1
(January 2008)
Describes how to install and configure a Cisco SFS 7012 switch.
6

7
Title/Contents
Cisco SFS 7000 Series Product Family Chassis Manager User Guide Release 2.9.0 (February
2008)
Topics include:
Getting started
Chassis tasks
Maintenance tasks
InfiniBand tasks
Ethernet tasks
Fibre Channel tasks
Cisco SFS 7000 Series Product Family Element Manager User Guide Release 2.9.0 (February
2008)
Topics include:
About Element Manager
Chassis display tasks
Files tasks
Edit tasks
Maintenance tasks
Health tasks
Report tasks
Various InfiniBand management tasks
Ethernet Menu tasks
Fibre Channel Menu tasks
Help Menu tasks
InfiniBand concepts
Cisco SFS Product Family Command Reference Release 2.9.0 (June 2007)
Topics include:
Using the command-line interface
Command groups
Commands
NOTE: For technical support and updates, contact your HP representative rather than using the
Cisco Technical Support Web site referenced in the Cisco documentation.

Cisco SFS 7024D InfiniBand Interconnect Documentation
The Cisco SFS 7024D InfiniBand Interconnect and cables were installed by an HP service
representative. Go only to the HP Web site for updates, technical assistance, and support.
The following documents are provided for your reference and contain information necessary for you
to perform certain maintenance and troubleshooting procedures for the Cisco SFS 7024 InfiniBand
Interconnect. Chapters and appendices that contain maintenance and troubleshooting procedures
are indicated in bold text.
Title/Contents
Cisco SFS 7024D InfiniBand Server Switch (January 2008)
Web page with general switch information and links to product literature and data sheets.
Cisco SFS 7024 Hardware Installation Guide, Release 3.3 (January 2007)
Chapters:
Product Overview
Installation
Operations and Administration
Technical Specifications
Command Line Interface
Troubleshooting
Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide, Release 4.1 (January 2008)
Chapters:
Product Overview
Installation
Operations and Administration
Technical Specifications
Command Line Interface
Troubleshooting
Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide, Release 3.4 (February 2007)
Chapters:
Product Overview
Installation
Operations and Administration
Technical Specifications
Command Line Interface
Troubleshooting
Cisco SFS 7024 InfiniBand Server Switch Installation and Configuration Note, Release 4.1
(January 2008)
Describes how to install and configure a Cisco SFS 7024 switch.
8

Cisco SFS 7000 Series Product Family Chassis Manager User Guide Release 2.9.0 (February
2008)
Topics include:
Getting started
Chassis tasks
Maintenance tasks
InfiniBand tasks
Ethernet tasks
Fibre Channel tasks
Cisco SFS 7000 Series Product Family Element Manager User Guide Release 2.9.0 (February
2008)
Topics include:
About Element Manager
Chassis display tasks
Files tasks
Edit tasks
Maintenance tasks
Health tasks
Report tasks
Various InfiniBand management tasks
Ethernet Menu tasks
Fibre Channel Menu tasks
Help Menu tasks
InfiniBand concepts
Cisco SFS Product Family Command Reference Release 2.9.0 (June 2007)
Topics include:
Using the command-line interface
Command groups
Commands
NOTE: For technical support and updates, contact your HP representative rather than using the
Cisco Technical Support Web site referenced in the Cisco documentation.
9

Cable Management
The following documents describe the cable management and installation procedures for the Cisco
SFS 7012 and 7024D InfiniBand interconnects:
AC070A Cable Management Bracket Installation Guide
AC089A Cable Management Bracket Installation Guide
10

Related Documentation
The following documentation or websites may be of use in managing your Cluster Platform
environment and Voltaire interconnects:
Title/Description
Cisco Regulatory Compliance and Safety Information for the Cisco SFS 7000P, SFS 7000D,
SFS 7008P, 3013R, and 3504 (August 2007)
Describes how to safely work with lasers and contains translated safety warnings, European
directives, and regulatory standards compliance, EMC environmental conditions for products
installed in the European union, EMC Class A notices and warnings, and other standards-
related information.
Cisco OpenFabrics Enterprise Distribution InfiniBand Host Drivers User Guide for Linux,
Release 1.1 (December 2006)
Describes the basics of the OpenFabrics Enterprise Distribution InfiniBand host driver, how to
install one, how to configure the driver, and other related topics.
Release Notes for Cisco OFED Release 1.3 (May 2008)
Describes the features and known issues for the Cisco OpenFabrics Enterprise Distribution
InfiniBand Host Drivers 1.3 for Linux.
Release Notes for Cisco OFED Release 1.2.5 (October 2007)
Describes the features and known issues for the Cisco OpenFabrics Enterprise Distribution
InfiniBand Host Drivers 1.2.5 for Linux.
Release Notes for Cisco OFED Release 1.2 (June 2007)
Describes the features and known issues for the Cisco OpenFabrics Enterprise Distribution
InfiniBand Host Drivers 1.2 for Linux.
Release Notes for Cisco High-Performance Subnet Manager (HSM) Release 1.2.1 (February
2008)
Describes features and known issues for HSM Release 1.2.1.
Cisco High-Performance Subnet Manager for InfiniBand Server Switches, Release 1.2
(August 2007)
Describes the Cisco High-Performance Subnet Manager, how to install it and use it, and also
lists and describes the Subnet Manager administrative, configuration, performance monitoring,
and show commands.
Cisco SFS Product Family Command Reference Release 2.10.0 (January 2008)
Explains how to use the command line interface (CLI) and provides a categorized, alphabetical
list of the available CLI commands.
Cisco SFS Product Family Command Reference, Release 2.9.0 (September 2007)
Explains how to use the command line interface (CLI) and provides a categorized, alphabetical
list of the available CLI commands.
11

12
Title/Description
Cisco SFS Product Family Chassis Manager User Guide, Release 2.9.0 (February 2008)
Describes how to get started with Chassis Manager and how to use it to display and configure
a variety of operations.
Cisco SFS Product Family Element Manager User Guide Release 2.10.0 (December 2007)
Describes installing and using the GUI interface of Element Manager.
Cisco SFS Product Family Element Manager User Guide, Release 2.9.0 (December 2006)
Describes how to install and use the GUI interface of Element Manager.
Cisco SFS InfiniBand Host Drivers User Guide for Linux, Release 3.2.0 (July 2007)
Describes the host drivers and how to install and configure them for various protocols.
Release Notes for Cisco InfiniBand Drivers on HP BladeSystem c-Class (January 2007)
Describes the features and known issues for Cisco InfiniBand drivers on HP BladeSystem c-
Class with Cisco InfiniBand products.
Cisco Supported Firmware Matrix (May 19, 2008)
HP documentation describing the minimum firmware versions required for correct operation of
the Cisco interconnects that are used with HP Cluster Platform components.
Cluster Platform Overview
HP manual providing an overview of HP Cluster Platform environments, as well as the HP
Storage Works Scalable File Share (SFS) and the HP Scalable Visual Array (SVA).
Site Preparation Guide
HP manual providing an overview of the HP Cluster Platform hardware and describes how to
plan for the receipt and installation of cluster hardware in a dedicated computer facility.
High Performance Computing website
HP website providing the latest documentation for High Performance Computing hardware and
software products (Cluster Platform products, cabling tables, interconnect and firmware
information, cable management guides, and SVA).
Cisco website
See the Cisco website for any SFS-related information not found in this document.
For the latest information regarding the HP Cluster Platform products, go to:
http://www.hp.com/techservers
Contact your local HP sales or support representative if you need additional information.

© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change
without notice. The only warranties for HP products and services are set forth in the express warranty
statements accompanying such products and services. Nothing herein should be construed as constituting
an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Cisco is a registered trademark of Cisco Systems, Inc.
InfiniBand™ is a trademark of the InfiniBand® Trade Association.
13