HP 409366-B21 - Voltaire DDR Switch Instruction sheet

HP Cluster Platform
Voltaire InfiniBand Interconnects
Read This First: Documentation Roadmap
This document roadmap describes how to access the documentation for Voltaire InfiniBand switches
and software.

This guide supports the following HP part numbers:
HP Part Number Hardware Descriptions
Voltaire 4036
519571-B21 Voltaire InfiniBand 4X QDR 36-Port Managed Switch
Voltaire 4700
590200-B21 Voltaire InfiniBand QDR 324-Port Switch Chassis
590201-B21 Voltaire InfiniBand QDR 324-Port Switch Fabric Board
590202-B21 Voltaire InfiniBand QDR 648-Port Switch Fabric Board
590203-B21 Voltaire InfiniBand QDR 324-Port Switch 18-Port Line
Board
590204-B21 Voltaire InfiniBand QDR 324-Port Switch Management
Module
Voltaire 2004/2012
409370-B21 Voltaire InfiniBand DDR 96-Port Switch Chassis
409371-B21 Voltaire InfiniBand DDR 288-Port Switch Chassis
450697-B21 Voltaire InfiniBand DDR Rev B 96-Port Switch Chassis
450699-B21 Voltaire InfiniBand DDR Rev B 288-Port Switch Chassis
450702-B21 Voltaire InfiniBand DDR Rev B 24-Port Line Board
450698-B21 Voltaire InfiniBand DDR Rev B 96-Port Fabric Board
450700-B21 Voltaire InfiniBand DDR Rev B 288-Port Fabric Board
Voltaire 9024/9096/9288
409367-B21 Voltaire InfiniBand 4X DDR 24-Port Internally Managed
Switch
409366-B21 Voltaire InfiniBand 4X DDR 24-Port Externally Managed
Switch
376166-B22 Voltaire InfiniBand 4X SDR 24-Port Internally Managed
Switch
376165-B22 Voltaire InfiniBand 4X SDR 24-Port Externally Managed
Switch
394080-B21 InfiniBand 96-Port Chassis
376170-B21 InfiniBand 288-Port Chassis
HP Part Number Software Descriptions
UFM 2.x and Newer
590643-B21 Voltaire Unified Fabric Manager Per Node RTU
BladeFM
450717-B21 GridVision BladeFM Software License for HP BladeSystem
c-Class
Voltaire Per Node Software License
450716-B21 Per Node SW License

Contents
Contents ............................................................................................................................................. 3
Overview............................................................................................................................................ 4
Voltaire InfiniBand Interconnect Documentation ....................................................................................... 5
Revision History ............................................................................................................................... 5
Voltaire QDR InfiniBand Hardware and Software .................................................................................... 7
Voltaire ISR 4036 Documentation ...................................................................................................... 7
Voltaire Grid Director 4700 Documentation ........................................................................................ 8
Unified Fabric Manager Information................................................................................................... 9
Voltaire DDR InfiniBand Hardware and Software...................................................................................10
Voltaire ISR 2004 Documentation .................................................................................................... 10
Voltaire ISR 2012 Documentation .................................................................................................... 14
GridVision BladeFM Documentation ................................................................................................. 20
Voltaire SDR InfiniBand Hardware and Software ...................................................................................21
Voltaire ISR 9096-9288 Documentation............................................................................................21
Voltaire ISR 9024 Documentation .................................................................................................... 26
Voltaire OFED 1.4 Documentation ....................................................................................................... 30
Voltaire OFED Linux 5.xDocumentation ............................................................................................... 31
GridStack 4.xDrivers for Red Hat Documentation.................................................................................. 32
GridStack 3.x(IBHOST) Drivers for Red Hat Documentation.................................................................... 35
Windows GridStack Documentation..................................................................................................... 37
Cable Management ........................................................................................................................... 41
Related Documentation....................................................................................................................... 42
For more information.......................................................................................................................... 43

Overview
This document describes the Voltaire InfiniBand interconnects and the related Cluster Platform
documentation. You can link directly to any of the documentation here to assist you in maintaining
your Cluster Platform configuration.
NOTE: Before you begin any system operations, go to the following website and download the latest
documentation updates from the High Performance Computing website:
http://www.docs.hp.com/en/highperfcomp.html
If your hardware configuration contains HP BladeSystems and enclosures, important updates are
available from this site.
4

Voltaire InfiniBand Interconnect Documentation
The Voltaire InfiniBand interconnects are modular systems that you can use to create large, single-
system grid/cluster fabrics, or you can use them as building blocks for larger fabrics. These
interconnects are designed to maximize performance, streamline operations, and to ensure uptime by
providing full hardware and software reliability, availability, and serviceability (RAS) features.
It is assumed that you are familiar with the Voltaire InfiniBand interconnects and have the knowledge
necessary to maintain and troubleshoot the Voltaire technology that is used in an HP Cluster Platform
configuration.
The Voltaire InfiniBand interconnects and cables were installed by an HP service representative. The
Cluster Platform and Voltaire documentation is provided for your reference and contains information
necessary for you to perform certain maintenance and troubleshooting procedures. All of the
documentation referenced in this document is currently available on the docs.hp.com and Voltaire
websites. If you have any comments about the HP document, please send them to:
http://docs.hp.com/en/feedback.html
For technical support and updates, contact your HP representative rather than using the Voltaire
Technical Assistance Center (TAC) referenced in the Voltaire documentation.
Revision History
Revision Date Changes
December 2009 Added links for:
•Voltaire 4700 switch documentation
•Unified Fabric Manager (UFM)
March 2009 Added links for:
•Voltaire 4036 switch documentation
•Voltaire GridVision Integrated For Grid Directors User Documentation, Grid
Director Software Version 5.4, ISR 9024 Grid Director Software Version:
GridVision 5.1.1
•OFED 1.4 documentation
•Host-based Subnet Manager Version 1.5 documentation
•WinOF Version 2.0 documentation
5

August 2008 Added links for:
•OFED 5.x release notes
•Linux GridStack User Manual Release 4.3
•GridVision Integrated for Grid Directors User Documentation, Software
Release GridVision 5.2
•Voltaire Grid Director ISR 2012 and ISR 2004 Installation Manual
•Voltaire GridVision ISR 9288/ISR 9096/ISR2012/ISR 2004 Grid Directors
Version 5.2 Release Notes
•Voltaire Grid Director ISR 2012 and ISR 2004 Installation Manual
•Getting Started Short Guide — Voltaire Solution for the ISR 9XXX, ISR 2012
•Voltaire InfiniBand-to-10 GbE Gateway (sRB-2021G Module User Manual,
Software Release 1.0.0
•Release Notes for the Voltaire GridVision Grid Switch ISR 9024, Software
Release 5.1.0
•Voltaire GridVision Integrated for Grid Directors User Documentation, Grid
Switch Software Release GridVision 5.1
May 2008 Added ISR 2004 documentation and OFED 5.x documentation.
April 2008 Added revised GridVision BladeFM Getting Started Guide Software Release
4.2.0 (March 2008), which replaces the 2007 version
March 2008 Added:
•Voltaire InfiniBand GridStack Release Notes Revision 4.3.5.c_8
•OpenMPI Release Notes Version 1.2.5 Revision VLT0
•Grid Director ISR 2012 and ISR 2004 Installation Manual Release 5.0 and
removed the Release 4.1 version
•Release Notes for the Grid Director ISR 9288/ISR9092/ISR2012/ISR 2004
GridVision Revision 5.0.0
•Voltaire GridVision Integrated User Manual, Software Release 5.0
•Voltaire GridVision Integrated Grid Directors ISR 2012/ISR2004 and ISR
9288/9096 User Documentation Suite, Software Release 5.0, which
replaces the Release 4.1 version
•Release notes for GridVision version 5.0
January 2008 First edition
6

Voltaire QDR InfiniBand Hardware and Software
Voltaire ISR 4036 Documentation
The Voltaire ISR 4036 documentation describes how to install and maintain the ISR 4036 product.
Go to the HP website for updates, technical assistance, and support.
The following documents are provided for your reference and contain information necessary for you
to perform certain maintenance and troubleshooting procedures on the ISR 4036 components.
For Voltaire documentation updates, go to the Voltaire Product Documentation website:
http://www.voltaire.com/SupportAndServices/Product_Documentation
Title/Publication Date/Contents
Grid Director 4036 (QDR) /2036 (DDR) Installation Manual (April 2009)
Topics covered include:
•Introduction
•Unpacking
•Getting started
•Product options
•Technical specifications and certifications
•Hardware installation
•Cabling
•Operation
•Powering on the 4036/2036
•Switch management
•Troubleshooting
•Cable and port pinout
•QSFP cable
7

Voltaire 4036/2036 Grid Director User Manual (April 2009)
Topics covered include:
•Introduction
•CLI Overview
•Initial System Setup (CLI)
•Built-in-Test
•Updating, Backing up, and Upgrading the Software
•Handover Mechanism and Redundancy/High Availability
•4036/2036 Device Manager
•Remote Configuration Settings
•Security Settings
•Unified Fabric Manager Support
•Factory Defaults
•QSFP Port Management
•Configuring the Subnet Manager
•Configuring Routing Algorithms
•Utilities
•Getting Started with the CLI and Top Level Structure
•Guest Mode
•Admin Mode
•Configuration (config) Mode
Voltaire Grid Director 4700 Documentation
The Voltaire Grid Director 4700 documentation describes how to install and maintain the Grid
Director 4700 product. Go to the HP website for updates, technical assistance, and support.
The following documents are provided for your reference and contain information necessary for you
to perform certain maintenance and troubleshooting procedures on the Grid Director 4700
components.
For Voltaire documentation updates, go to the Voltaire Product Documentation website:
http://www.voltaire.com/SupportAndServices/Product_Documentation
Title/Publication Date/Contents
Voltaire Grid Director 4700 Installation Manual (August 2009)
Topics covered include:
•Introduction
•System Configurations
•4700 Specifications
•Packing and Unpacking
•Preparing for Installation
•Rack-Mounting the 4700 Chassis
•Installing System Boards
•Verifying Installation
•System Cabling
•Troubleshooting
•Definitions and Acronyms
8

Voltaire Grid Director 4700 User Manual (August 2009)
Topics covered include:
•Introduction
•CLI Overview
•Initial System Setup (CLI)
•Built-in-Test
•Updating, Backing up, and Upgrading the Software
•Handover Mechanism and Redundancy/High Availability
•4700 Device Manager
•Remote Configuration Settings
•Security Settings
•Getting Started with the CLI and Top Level Structure
•Guest Mode
•Admin Mode
•Configuration (config) Mode
Unified Fabric Manager Information
Voltaire’s Unified Fabric Manager (UFM) allows data center operators to efficiently monitor and
operate the entire fabric, increase application performance and maximize fabric resource utilization.
When you purchase UFM from HP, you will receive instructions explaining how to download the UFM
software and obtain a License Key to activate it.
The following links are provided for your reference.
Description Link
•Unified Fabric Manager Software for Data Center Management
•Voltaire Unified Fabric Manager Software - Data Sheet, 2009
•Features & Benefits
Voltaire UFM
9

Voltaire DDR InfiniBand Hardware and Software
Voltaire ISR 2004 Documentation
The Voltaire ISR 2004 documentation describes how to install and maintain the ISR 2004 product.
Go to the HP website for updates, technical assistance, and support.
The following documents are provided for your reference and contain information necessary for you
to perform certain maintenance and troubleshooting procedures on the ISR 2004 components.
Title/Publication Date/Contents
Voltaire GridVision ISR 9288/ISR 9096/ISR 2012/ISR 2004 Grid Directors Version 5.2
Release Notes (June 2008)
Release notes for the Voltaire GridVision ISR 9288/ISR 9096/ISR 2012/ISR 2004 Grid
Directors, Release 5.2.
Release Notes for the Grid Director ISR 9288/ISR 9096/ISR 2012/ISR 2004 Voltaire
GridVision Software Revision 5.0.0 (March 2008)
Release notes for the ISR 9288/ISR 9096/ISR 2012/ISR 2004 GridVision, Release 5.0.0.
Voltaire InfiniBand-to-10 GbE Gateway (sRB-20210G Module) User Manual, Software Release
1.0.0 (June 2008)
Topics covered include:
•First-time configuration
•The sRB-20210G GUI Device Manager
•Device information
•Device configuration
•Advanced features and configuration tasks
•Networks
•Traffic flow management
•Static route
•Logs and statistics
•Multicast settings
•Accessing the sRB-20210G via the switch GUI VFM
•Partitioning
•sRB-20210G CLI interface reference
•Safe mode
10