HP IBRIX 9300 Service manual

HP IBRIX 9300/9320 Storage Administrator
Guide
Abstract
This guide describes tasks related to cluster configuration and monitoring, system upgrade and recovery, hardware component
replacement, and troubleshooting for the HP 9300 Storage Gateway and the HP 9320 Storage. It does not document IBRIX
file system features or standard Linux administrative tools and commands. For information about configuring and using IBRIX
software file system features, see the HP IBRIX 9000 Storage File System User Guide.
This guide is intended for system administrators and technicians who are experienced with installing and administering networks,
and with performing Linux operating and administrative tasks. For the latest IBRIX guides, browse to
nl
http://www.hp.com/support/IBRIXManuals.
HP Part Number: AW549-96049
Published: July 2013
Edition: 11

© Copyright 2010, 2012 Hewlett-Packard Development Company, L.P.
Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial
Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under
vendor's standard commercial license.
The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express
warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall
not be liable for technical or editorial errors or omissions contained herein.
Acknowledgments
Microsoft® and Windows® are U.S. registered trademarks of Microsoft Corporation.
UNIX® is a registered trademark of The Open Group.
Warranty
WARRANTY STATEMENT: To obtain a copy of the warranty for this product, see the warranty information website:
http://www.hp.com/go/storagewarranty
Revision History
DescriptionSoftware
Version
DateEdition
Initial release of the 9300 Storage Gateway and 9320 Network Storage System
administration guides.
5.3.1December 20091
Added network management and support ticket.5.4April 20102
Added management console backup, migration to an agile management console
configuration, software upgrade procedures, and system recovery procedures.
5.4.1August 20103
Revised upgrade procedure.5.4.1August 20104
Added information about NDMP backups and configuring virtual interfaces, and updated
cluster procedures.
5.5December 20105
Updated segment evacuation information.5.5March 20116
Revised upgrade procedure and updated server information.5.6April 20117
Added or revised information about agile management console, NTP servers, Statistics
tool, Ibrix Collect, event notification, upgrades.
6.0September 20118
Combined the 9300 and 9320 administration guides, added or revised information about
segment evacuation, events, Statistics tool, software upgrades, HP Insight Remote Support.
6.1June 20129
Added or revised information about High Availability, failover, server tuning, segment
migration and evacuation, SNMP
6.2December 201210

Contents
1 Product description...................................................................................10
9300 Storage Gateway .........................................................................................................10
9320 Storage System..............................................................................................................10
System Components................................................................................................................10
HP IBRIX software features.......................................................................................................10
High availability and redundancy.............................................................................................11
2 Getting started.........................................................................................12
Setting up the system...............................................................................................................12
Installation steps................................................................................................................12
Additional configuration steps.............................................................................................12
Management interfaces...........................................................................................................13
Using the GUI...................................................................................................................14
Customizing the GUI..........................................................................................................17
Adding user accounts for GUI access...................................................................................17
Using the CLI.....................................................................................................................18
Starting the array management software...............................................................................18
9000 client interfaces.........................................................................................................18
IBRIX software manpages........................................................................................................19
Changing passwords..............................................................................................................19
Configuring ports for a firewall.................................................................................................19
Configuring NTP servers..........................................................................................................20
Configuring HP Insight Remote Support on IBRIX 9000 systems.....................................................21
Configuring the IBRIX cluster for Insight Remote Support..........................................................22
Configuring Insight Remote Support for HP SIM 7.1 and IRS 5.7...............................................23
Configuring Insight Remote Support for HP SIM 6.3 and IRS 5.6..............................................26
Testing the Insight Remote Support configuration....................................................................29
Updating the Phone Home configuration...............................................................................29
Disabling Phone Home.......................................................................................................29
Troubleshooting Insight Remote Support................................................................................29
3 Configuring virtual interfaces for client access..............................................31
Network and VIF guidelines.....................................................................................................31
Creating a bonded VIF............................................................................................................32
Configuring backup servers......................................................................................................32
Configuring NIC failover.........................................................................................................32
Configuring automated failover................................................................................................33
Example configuration.............................................................................................................33
Specifying VIFs in the client configuration...................................................................................33
Configuring VLAN tagging......................................................................................................34
Configuring link state monitoring for iSCSI network interfaces.......................................................34
4 Configuring failover..................................................................................36
Agile management consoles....................................................................................................36
Agile Fusion Manager modes..............................................................................................36
Viewing information about Fusion Managers.........................................................................36
Agile Fusion Manager and failover......................................................................................36
Configuring High Availability on the cluster................................................................................37
What happens during a failover..........................................................................................38
Configuring automated failover with the HA Wizard...............................................................38
Configuring automated failover manually..............................................................................43
Changing the HA configuration manually.........................................................................45
Failing a server over manually.............................................................................................45
Contents 3

Failing back a server .........................................................................................................46
Setting up HBA monitoring..................................................................................................46
Checking the High Availability configuration.........................................................................48
Capturing a core dump from a failed node................................................................................49
Prerequisites for setting up the crash capture..........................................................................50
Setting up nodes for crash capture.......................................................................................50
5 Configuring cluster event notification...........................................................52
Cluster events.........................................................................................................................52
Setting up email notification of cluster events..............................................................................52
Associating events and email addresses................................................................................53
Configuring email notification settings..................................................................................53
Dissociating events and email addresses...............................................................................53
Testing email addresses......................................................................................................53
Viewing email notification settings........................................................................................54
Setting up SNMP notifications..................................................................................................54
Configuring the SNMP agent...............................................................................................54
Configuring trapsink settings................................................................................................55
Associating events and trapsinks..........................................................................................56
Defining views...................................................................................................................56
Configuring groups and users..............................................................................................56
Deleting elements of the SNMP configuration........................................................................57
Listing SNMP configuration information.................................................................................57
Event notification for MSA array systems....................................................................................57
6 Configuring system backups.......................................................................59
Backing up the Fusion Manager configuration............................................................................59
Using NDMP backup applications............................................................................................59
Configuring NDMP parameters on the cluster........................................................................60
NDMP process management...............................................................................................60
Viewing or canceling NDMP sessions..............................................................................60
Starting, stopping, or restarting an NDMP Server..............................................................61
Viewing or rescanning tape and media changer devices.........................................................61
NDMP events....................................................................................................................62
7 Creating host groups for 9000 clients.........................................................63
How host groups work.............................................................................................................63
Creating a host group tree.......................................................................................................63
Adding an 9000 client to a host group.....................................................................................64
Adding a domain rule to a host group.......................................................................................64
Viewing host groups................................................................................................................64
Deleting host groups...............................................................................................................64
Other host group operations....................................................................................................65
8 Monitoring cluster operations.....................................................................66
Monitoring 9300/9320 hardware............................................................................................66
Monitoring servers.............................................................................................................66
Monitoring hardware components........................................................................................70
Obtaining server details.................................................................................................70
Monitoring storage and storage components.........................................................................74
Managing LUNs in a storage cluster................................................................................75
Monitoring the status of file serving nodes..................................................................................75
Monitoring cluster events.........................................................................................................76
Viewing events..................................................................................................................76
Removing events from the events database table....................................................................77
Monitoring cluster health.........................................................................................................77
Health checks....................................................................................................................77
4 Contents

Health check reports..........................................................................................................77
Viewing logs..........................................................................................................................79
Viewing operating statistics for file serving nodes........................................................................80
9 Using the Statistics tool..............................................................................81
Installing and configuring the Statistics tool................................................................................81
Installing the Statistics tool...................................................................................................81
Enabling collection and synchronization................................................................................81
Upgrading the Statistics tool from IBRIX software 6.0...................................................................82
Using the Historical Reports GUI...............................................................................................82
Generating reports.............................................................................................................83
Deleting reports.................................................................................................................84
Maintaining the Statistics tool...................................................................................................84
Space requirements............................................................................................................84
Updating the Statistics tool configuration...............................................................................85
Changing the Statistics tool configuration..............................................................................85
Fusion Manager failover and the Statistics tool configuration...................................................85
Checking the status of Statistics tool processes.......................................................................86
Controlling Statistics tool processes.......................................................................................86
Troubleshooting the Statistics tool..............................................................................................86
Log files.................................................................................................................................87
Uninstalling the Statistics tool...................................................................................................87
10 Maintaining the system............................................................................88
Shutting down the system.........................................................................................................88
Shutting down the IBRIX software.........................................................................................88
Powering off the hardware..................................................................................................89
Starting the system..................................................................................................................89
Starting the IBRIX software..................................................................................................89
Powering file serving nodes on or off.........................................................................................90
Performing a rolling reboot......................................................................................................90
Starting and stopping processes...............................................................................................91
Tuning file serving nodes and 9000 clients................................................................................91
Managing segments...............................................................................................................95
Migrating segments............................................................................................................95
Evacuating segments and removing storage from the cluster ....................................................97
Removing a node from the cluster...........................................................................................100
Maintaining networks............................................................................................................100
Cluster and user network interfaces....................................................................................100
Adding user network interfaces..........................................................................................101
Setting network interface options in the configuration database..............................................102
Preferring network interfaces..............................................................................................102
Unpreferring network interfaces.........................................................................................103
Making network changes..................................................................................................103
Changing the IP address for a Linux 9000 client.............................................................103
Changing the IP address for the cluster interface on a dedicated management console........104
Changing the cluster interface.......................................................................................104
Managing routing table entries.....................................................................................104
Deleting a network interface.........................................................................................105
Viewing network interface information................................................................................105
11 Migrating to an agile Fusion Manager configuration..................................106
Backing up the configuration..................................................................................................106
Performing the migration........................................................................................................106
Testing failover and failback of the agile Fusion Manager..........................................................108
Removing the dedicated Management Server...........................................................................109
Contents 5

12 Upgrading the IBRIX software to the 6.2 release.......................................111
Online upgrades for IBRIX software 6.x to 6.2..........................................................................112
Preparing for the upgrade.................................................................................................113
Performing the upgrade....................................................................................................113
After the upgrade............................................................................................................113
Automated offline upgrades for IBRIX software 6.x to 6.2...........................................................114
Preparing for the upgrade.................................................................................................114
Performing the upgrade....................................................................................................115
After the upgrade............................................................................................................115
Manual offline upgrades for IBRIX software 6.x to 6.2...............................................................116
Preparing for the upgrade.................................................................................................116
Performing the upgrade manually.......................................................................................118
After the upgrade............................................................................................................118
Upgrading Linux 9000 clients................................................................................................120
Installing a minor kernel update on Linux clients...................................................................120
Upgrading Windows 9000 clients..........................................................................................121
Troubleshooting upgrade issues..............................................................................................121
Automatic upgrade..........................................................................................................121
Manual upgrade.............................................................................................................122
Offline upgrade fails because iLO firmware is out of date......................................................122
Node is not registered with the cluster network ...................................................................122
File system unmount issues.................................................................................................123
13 Licensing.............................................................................................124
Viewing license terms............................................................................................................124
Retrieving a license key.........................................................................................................124
Using AutoPass to retrieve and install permanent license keys......................................................124
14 Upgrading firmware..............................................................................125
Components for firmware upgrades.........................................................................................125
Steps for upgrading the firmware............................................................................................126
Finding additional information on FMT...............................................................................129
Downloading MSA2000 G2/G3 firmware for 9320 systems.....................................................129
15 Troubleshooting....................................................................................130
Collecting information for HP Support with Ibrix Collect.............................................................130
Collecting logs................................................................................................................130
Downloading the archive file.............................................................................................131
Deleting the archive file....................................................................................................131
Configuring Ibrix Collect...................................................................................................132
Viewing data collection information....................................................................................133
Adding/deleting commands or logs in the XML file..............................................................133
Viewing software version numbers..........................................................................................133
Troubleshooting specific issues................................................................................................134
Software services.............................................................................................................134
Failover..........................................................................................................................134
Windows 9000 clients.....................................................................................................135
Synchronizing information on file serving nodes and the configuration database...........................135
Troubleshooting an Express Query Manual Intervention Failure (MIF)...........................................135
16 Recovering a file serving node................................................................138
Obtaining the latest IBRIX software release...............................................................................138
Performing the recovery.........................................................................................................138
Completing the restore on a file serving node...........................................................................143
17 Support and other resources...................................................................145
Contacting HP......................................................................................................................145
6 Contents

Related information...............................................................................................................145
HP websites....................................................................................................................146
Rack stability........................................................................................................................146
Product warranties................................................................................................................146
Subscription service..............................................................................................................146
18 Documentation feedback.......................................................................147
A Cascading Upgrades.............................................................................148
Upgrading the IBRIX software to the 6.1 release........................................................................148
Online upgrades for IBRIX software 6.x to 6.1......................................................................148
Preparing for the upgrade............................................................................................148
Performing the upgrade................................................................................................149
After the upgrade........................................................................................................149
Offline upgrades for IBRIX software 5.6.x or 6.0.x to 6.1......................................................150
Preparing for the upgrade............................................................................................150
Performing the upgrade................................................................................................151
After the upgrade........................................................................................................151
Upgrading Linux 9000 clients............................................................................................152
Installing a minor kernel update on Linux clients..............................................................152
Upgrading Windows 9000 clients.....................................................................................153
Upgrading pre-6.0 file systems for software snapshots..........................................................153
Upgrading pre–6.1.1 file systems for data retention features...................................................154
Troubleshooting upgrade issues.........................................................................................154
Automatic upgrade......................................................................................................155
Manual upgrade.........................................................................................................155
Offline upgrade fails because iLO firmware is out of date.................................................155
Node is not registered with the cluster network ...............................................................155
File system unmount issues............................................................................................156
Upgrading the IBRIX software to the 5.6 release.......................................................................157
Automatic upgrades.........................................................................................................157
Manual upgrades............................................................................................................158
Preparing for the upgrade............................................................................................158
Saving the node configuration......................................................................................158
Performing the upgrade................................................................................................158
Restoring the node configuration...................................................................................159
Completing the upgrade..............................................................................................159
Troubleshooting upgrade issues.........................................................................................159
Automatic upgrade......................................................................................................160
Manual upgrade.........................................................................................................160
Upgrading the IBRIX software to the 5.5 release.......................................................................160
Automatic upgrades.........................................................................................................161
Manual upgrades............................................................................................................161
Standard upgrade for clusters with a dedicated Management Server machine or blade........162
Standard online upgrade.........................................................................................162
Standard offline upgrade.........................................................................................164
Agile upgrade for clusters with an agile management console configuration.......................166
Agile online upgrade..............................................................................................166
Agile offline upgrade..............................................................................................169
Troubleshooting upgrade issues.........................................................................................172
B Component diagrams for 9300 systems.....................................................173
Front view of file serving node................................................................................................173
Rear view of file serving node................................................................................................173
C Spare parts list for 9300 systems..............................................................176
1GbE spare parts.................................................................................................................176
Contents 7

1 GbE Network Storage Gateway (AW539A) ....................................................................176
1 GbE Network Storage Gateway (AW539B) ....................................................................177
1 HP IBRIX 9300 1 GbE Gateway (AW539D) ....................................................................178
10 GbE spare parts..............................................................................................................179
10 GbE Network Storage Gateway (AW540A) ..................................................................179
10 GbE/IB Network Storage Gateway (AW540B) ..............................................................180
1 HP IBRIX 9300 10 GbE Gateway (AW540D) ..................................................................181
IB Network Storage Gateway (AW541A) ................................................................................182
9300 Storage Base (AW546A) .............................................................................................183
D System component and cabling diagrams for 9320 systems.........................185
System component diagrams..................................................................................................185
Front view of 9300c array controller or 9300cx 3.5" 12-drive enclosure..................................185
Rear view of 9300c array controller...................................................................................186
Rear view of 9300cx 3.5" 12-drive enclosure.......................................................................186
Front view of file serving node...........................................................................................187
Rear view of file serving node............................................................................................187
Cabling diagrams................................................................................................................190
Cluster network cabling diagram.......................................................................................190
SATA option cabling........................................................................................................191
SAS option cabling..........................................................................................................192
Drive enclosure cabling....................................................................................................193
E Spare parts list for 9320 systems..............................................................194
1 GbE spare parts................................................................................................................194
10 GbE spare parts..............................................................................................................205
IB spare parts......................................................................................................................218
9320 Capacity Block............................................................................................................227
9320 Storage......................................................................................................................229
F Warnings and precautions.......................................................................233
Electrostatic discharge information..........................................................................................233
Preventing electrostatic discharge.......................................................................................233
Grounding methods.....................................................................................................233
Equipment symbols...............................................................................................................234
Rack warnings and precautions..............................................................................................234
Device warnings and precautions...........................................................................................235
G Regulatory compliance notices................................................................237
Regulatory compliance identification numbers..........................................................................237
Federal Communications Commission notice............................................................................237
FCC rating label..............................................................................................................237
Class A equipment......................................................................................................237
Class B equipment......................................................................................................237
Modification...................................................................................................................238
Cables...........................................................................................................................238
Canadian notice (Avis Canadien)...........................................................................................238
Class A equipment...........................................................................................................238
Class B equipment...........................................................................................................238
European Union notice..........................................................................................................238
Japanese notices..................................................................................................................239
Japanese VCCI-A notice....................................................................................................239
Japanese VCCI-B notice....................................................................................................239
Japanese VCCI marking...................................................................................................239
Japanese power cord statement.........................................................................................239
Korean notices.....................................................................................................................239
Class A equipment...........................................................................................................239
8 Contents

Class B equipment...........................................................................................................239
Taiwanese notices.................................................................................................................240
BSMI Class A notice.........................................................................................................240
Taiwan battery recycle statement........................................................................................240
Turkish recycling notice..........................................................................................................240
Vietnamese Information Technology and Communications compliance marking.............................240
Laser compliance notices.......................................................................................................240
English laser notice..........................................................................................................240
Dutch laser notice............................................................................................................241
French laser notice...........................................................................................................241
German laser notice.........................................................................................................241
Italian laser notice............................................................................................................242
Japanese laser notice.......................................................................................................242
Spanish laser notice.........................................................................................................242
Recycling notices..................................................................................................................243
English recycling notice....................................................................................................243
Bulgarian recycling notice.................................................................................................243
Czech recycling notice......................................................................................................243
Danish recycling notice.....................................................................................................243
Dutch recycling notice.......................................................................................................243
Estonian recycling notice...................................................................................................244
Finnish recycling notice.....................................................................................................244
French recycling notice.....................................................................................................244
German recycling notice...................................................................................................244
Greek recycling notice......................................................................................................244
Hungarian recycling notice...............................................................................................244
Italian recycling notice......................................................................................................245
Latvian recycling notice.....................................................................................................245
Lithuanian recycling notice................................................................................................245
Polish recycling notice.......................................................................................................245
Portuguese recycling notice...............................................................................................245
Romanian recycling notice................................................................................................246
Slovak recycling notice.....................................................................................................246
Spanish recycling notice...................................................................................................246
Swedish recycling notice...................................................................................................246
Battery replacement notices...................................................................................................247
Dutch battery notice.........................................................................................................247
French battery notice........................................................................................................247
German battery notice......................................................................................................248
Italian battery notice........................................................................................................248
Japanese battery notice....................................................................................................249
Spanish battery notice......................................................................................................249
Glossary..................................................................................................250
Index.......................................................................................................252
Contents 9

1 Product description
This guide provides information about configuring, monitoring, and maintaining HP IBRIX 9300
Storage Gateways and 9320 Storage.
IMPORTANT: It is important to keep regular backups of the cluster configuration.
9300 Storage Gateway
The 9300 Storage Gateway is a flexible, scale-out solution that brings gateway file services to HP
MSA, EVA, P4000, or 3rd-party arrays or SANs. The system provides the following features:
•Segmented, scalable file system under a single namespace
•NFS, SMB (Server Message Block), FTP, and HTTP support for accessing file system data
•Centralized CLI and GUI cluster management
•Policy management
•Continuous remote replication
9320 Storage System
The 9320 Storage System is a highly available, scale-out storage solution for file data workloads.
The system combines HP IBRIX File Serving Software with HP server and storage hardware to create
an expansible cluster of file serving nodes. The system provides the following features:
•Segmented, scalable file system under a single namespace
•NFS, SMB, FTP, and HTTP support for accessing file system data
•Centralized CLI and GUI cluster management
•Policy management
•Continuous remote replication
•Dual redundant paths to all storage components
•Gigabytes-per-second throughput
System Components
For 9300 system components, see “Component diagrams for 9300 systems” (page 173).
For 9320 system components, see “System component and cabling diagrams for 9320 systems”
(page 185).
For a complete list of system components, see the HP IBRIX Storage System QuickSpecs, which are
available at:
http://www.hp.com/go/StoreAll
HP IBRIX software features
HP IBRIX software is a scale-out, network-attached storage solution including a parallel file system
for clusters, an integrated volume manager, high-availability features such as automatic failover
of multiple components, and a centralized management interface. IBRIX software can scale to
thousands of nodes.
Based on a segmented file system architecture, IBRIX software integrates I/O and storage systems
into a single clustered environment that can be shared across multiple applications and managed
from a central Fusion Manager.
10 Product description

IBRIX software is designed to operate with high-performance computing applications that require
high I/O bandwidth, high IOPS throughput, and scalable configurations.
Some of the key features and benefits are as follows:
•Scalable configuration. You can add servers to scale performance and add storage devices
to scale capacity.
•Single namespace. All directories and files are contained in the same namespace.
•Multiple environments. Operates in both the SAN and DAS environments.
•High availability. The high-availability software protects servers.
•Tuning capability. The system can be tuned for large or small-block I/O.
•Flexible configuration. Segments can be migrated dynamically for rebalancing and data
tiering.
High availability and redundancy
The segmented architecture is the basis for fault resilience—loss of access to one or more segments
does not render the entire file system inaccessible. Individual segments can be taken offline
temporarily for maintenance operations and then returned to the file system.
To ensure continuous data access, IBRIX software provides manual and automated failover protection
at various points:
•Server. A failed node is powered down and a designated standby server assumes all of its
segment management duties.
•Segment. Ownership of each segment on a failed node is transferred to a designated standby
server.
•Network interface. The IP address of a failed network interface is transferred to a standby
network interface until the original network interface is operational again.
•Storage connection. For servers with HBA-protected Fibre Channel access, failure of the HBA
triggers failover of the node to a designated standby server.
High availability and redundancy 11

2 Getting started
IMPORTANT: Follow these guidelines when using your system:
•Do not modify any parameters of the operating system or kernel, or update any part of the
9320 Storage unless instructed to do so by HP; otherwise, the system could fail to operate
properly.
•File serving nodes are tuned for file serving operations. With the exception of supported
backup programs, do not run other applications directly on the nodes.
Setting up the system
Installation steps
An HP service specialist sets up the system at your site, including the following tasks:
•Remove the product from the shipping cartons that you have placed in the location where the
product will be installed, confirm the contents of each carton against the list of included items
and check for any physical damage to the exterior of the product, and connect the product
to the power and network provided by you.
•Review your server, network, and storage environment relevant to the HP Enterprise NAS
product implementation to validate that prerequisites have been met.
•Validate that your file system performance, availability, and manageability requirements have
not changed since the service planning phase. Finalize the HP Enterprise NAS product
implementation plan and software configuration.
•Implement the documented and agreed-upon configuration based on the information you
provided on the pre-delivery checklist.
•Document configuration details.
Additional configuration steps
When your system is up and running, you can continue configuring the cluster and file systems.
The Management Console GUI and CLI are used to perform most operations. (Some features
described here may be configured for you as part of the system installation.)
Cluster. Configure the following as needed:
•Firewall ports. See “Configuring ports for a firewall” (page 19)
•HP Insight Remote Support and Phone Home. See “Configuring HP Insight Remote Support
on IBRIX 9000 systems” (page 21).
•Virtual interfaces for client access. See “Configuring virtual interfaces for client access”
(page 31).
•Cluster event notification through email or SNMP. See “Configuring cluster event notification”
(page 52).
•Fusion Manager backups. See “Backing up the Fusion Manager configuration” (page 59).
•NDMP backups. See “Using NDMP backup applications” (page 59).
•Statistics tool. See “Using the Statistics tool” (page 81).
•Ibrix Collect. See “Collecting information for HP Support with Ibrix Collect” (page 130).
12 Getting started

File systems. Set up the following features as needed:
•NFS, SMB (Server Message Block), FTP, or HTTP. Configure the methods you will use to access
file system data.
•Quotas. Configure user, group, and directory tree quotas as needed.
•Remote replication. Use this feature to replicate changes in a source file system on one cluster
to a target file system on either the same cluster or a second cluster.
•Data retention and validation. Use this feature to manage WORM and retained files.
•Antivirus support. This feature is used with supported Antivirus software, allowing you to scan
files on an IBRIX file system.
•IBRIX software snapshots. This feature allows you to capture a point-in-time copy of a file
system or directory for online backup purposes and to simplify recovery of files from accidental
deletion. Users can access the file system or directory as it appeared at the instant of the
snapshot.
•Block Snapshots. This feature uses the array capabilities to capture a point-in-time copy of a
file system for online backup purposes and to simplify recovery of files from accidental deletion.
The snapshot replicates all file system entities at the time of capture and is managed exactly
like any other file system.
•File allocation. Use this feature to specify the manner in which segments are selected for storing
new files and directories.
•Data tiering. Use this feature to move files to specific tiers based on file attributes.
For more information about these file system features, see the HP IBRIX 9000 Storage File System
User Guide.
Localization support
Red Hat Enterprise Linux 5 uses the UTF-8 (8-bit Unicode Transformation Format) encoding for
supported locales. This allows you to create, edit and view documents written in different locales
using UTF-8. IBRIX software supports modifying the /etc/sysconfig/i18n configuration file
for your locale. The following example sets the LANG and SUPPORTED variables for multiple
character sets:
LANG="ko_KR.utf8"
SUPPORTED="en_US.utf8:en_US:en:ko_KR.utf8:ko_KR:ko:zh_CN.utf8:zh_CN:zh"
SYSFONT="lat0-sun16"
SYSFONTACM="iso15"
Management interfaces
Cluster operations are managed through the IBRIX Fusion Manager, which provides both a GUI
and a CLI. Most operations can be performed from either the GUI or the CLI.
The following operations can be performed only from the CLI:
•SNMP configuration (ibrix_snmpagent,ibrix_snmpgroup,ibrix_snmptrap,
ibrix_snmpuser,ibrix_snmpview)
•Health checks (ibrix_haconfig,ibrix_health,ibrix_healthconfig)
•Raw storage management (ibrix_pv,ibrix_vg,ibrix_lv)
•Fusion Manager operations (ibrix_fm) and Fusion Manager tuning (ibrix_fm_tune)
•File system checks (ibrix_fsck)
•Kernel profiling (ibrix_profile)
•Cluster configuration (ibrix_clusterconfig)
Management interfaces 13

•Configuration database consistency (ibrix_dbck)
•Shell task management (ibrix_shell)
The following operations can be performed only from the GUI:
•Scheduling recurring data validation scans
•Scheduling recurring software snapshots
•Scheduling recurring block snapshots
•Scheduling recurring block snapshots
•Scheduling recurring block snapshots
Using the GUI
The GUI is a browser-based interface to the Fusion Manager. See the release notes for the supported
browsers and other software required to view charts on the dashboard. You can open multiple
GUI windows as necessary.
If you are using HTTP to access the GUI, open a web browser and navigate to the following
location, specifying port 80:
http://<management_console_IP>:80/fusion
If you are using HTTPS to access the GUI, navigate to the following location, specifying port 443:
https://<management_console_IP>:443/fusion
In these URLs, <management_console_IP> is the IP address of the Fusion Manager user VIF.
The GUI prompts for your user name and password. The default administrative user is ibrix.
Enter the password that was assigned to this user when the system was installed. (You can change
the password using the Linux passwd command.) To allow other users to access the GUI, see
“Adding user accounts for GUI access” (page 17).
Upon login, the GUI dashboard opens, allowing you to monitor the entire cluster. (See the online
help for information about all GUI displays and operations.) There are three parts to the dashboard:
System Status, Cluster Overview, and the Navigator.
14 Getting started

System Status
The System Status section lists the number of cluster events that have occurred in the last 24 hours.
There are three types of events:
Alerts. Disruptive events that can result in loss of access to file system data. Examples are a segment that is
unavailable or a server that cannot be accessed.
Warnings. Potentially disruptive conditions where file system access is not lost, but if the situation is not
addressed, it can escalate to an alert condition. Examples are a very high server CPU utilization level or a
quota limit close to the maximum.
Information. Normal events that change the cluster. Examples are mounting a file system or creating a
segment.
Cluster Overview
The Cluster Overview provides the following information:
Capacity
The amount of cluster storage space that is currently free or in use.
File systems
The current health status of the file systems in the cluster. The overview reports the number of
file systems in each state (healthy, experiencing a warning, experiencing an alert, or unknown).
Segment Servers
The current health status of the file serving nodes in the cluster. The overview reports the number
of nodes in each state (healthy, experiencing a warning, experiencing an alert, or unknown).
Management interfaces 15

Services
Whether the specified file system services are currently running:
One or more tasks are
running.
No tasks are running.
Statistics
Historical performance graphs for the following items:
•Network I/O (MB/s)
•Disk I/O (MB/s)
•CPU usage (%)
•Memory usage (%)
On each graph, the X-axis represents time and the Y-axis represents performance.
Use the Statistics menu to select the servers to monitor (up to two), to change the maximum
value for the Y-axis, and to show or hide resource usage distribution for CPU and memory.
Recent Events
The most recent cluster events. Use the Recent Events menu to select the type of events to display.
You can also access certain menu items directly from the Cluster Overview. Mouse over the
Capacity, Filesystems or Segment Server indicators to see the available options.
Navigator
The Navigator appears on the left side of the window and displays the cluster hierarchy. You can
use the Navigator to drill down in the cluster configuration to add, view, or change cluster objects
such as file systems or storage, and to initiate or view tasks such as snapshots or replication. When
you select an object, a details page shows a summary for that object. The lower Navigator allows
you to view details for the selected object, or to initiate a task. In the following example, we selected
Filesystems in the upper Navigator and Mountpoints in the lower Navigator to see details about
the mounts for file system ifs1.
16 Getting started

NOTE: When you perform an operation on the GUI, a spinning finger is displayed until the
operation is complete. However, if you use Windows Remote Desktop to access the GUI, the
spinning finger is not displayed.
Customizing the GUI
For most tables in the GUI, you can specify the columns that you want to display and the sort order
of each column. When this feature is available, mousing over a column causes the label to change
color and a pointer to appear. Click the pointer to see the available options. In the following
example, you can sort the contents of the Mountpoint column in ascending or descending order,
and you can select the columns that you want to appear in the display.
Adding user accounts for GUI access
IBRIX software supports administrative and user roles. When users log in under the administrative
role, they can configure the cluster and initiate operations such as remote replication or snapshots.
When users log in under the user role, they can view the cluster configuration and status, but cannot
make configuration changes or initiate operations. The default administrative user name is ibrix.
The default regular username is ibrixuser.
User names for the administrative and user roles are defined in the /etc/group file. Administrative
users are specified in the ibrix-admin group, and regular users are specified in the ibrix-user
Management interfaces 17

group. These groups are created when IBRIX software is installed. The following entries in the
/etc/group file show the default users in these groups:
ibrix-admin:x:501:root,ibrix
ibrix-user:x:502:ibrix,ibrixUser,ibrixuser
You can add other users to these groups as needed, using Linux procedures. For example:
adduser -G ibrix-<groupname> <username>
When using the adduser command, be sure to include the -G option.
Using the CLI
The administrative commands described in this guide must be executed on the Fusion Manager
host and require root privileges. The commands are located in $IBRIXHOME⁄bin. For complete
information about the commands, see the HP IBRIX 9000 Network Storage System CLI Reference
Guide.
When using ssh to access the machine hosting the Fusion Manager, specify the IP address of the
Fusion Manager user VIF.
Starting the array management software
Depending on the array type, you can launch the array management software from the GUI. In
the Navigator, select Vendor Storage, select your array from the Vendor Storage page, and click
Launch Storage Management.
9000 client interfaces
9000 clients can access the Fusion Manager as follows:
•Linux clients. Use Linux client commands for tasks such as mounting or unmounting file systems
and displaying statistics. See the HP IBRIX 9000 Storage CLI Reference Guide for details about
these commands.
•Windows clients. Use the Windows client GUI for tasks such as mounting or unmounting file
systems and registering Windows clients.
Using the Windows 9000 client GUI
The Windows 9000 client GUI is the client interface to the Fusion Manager. To open the GUI,
double-click the desktop icon or select the 9000 client program from the Start menu on the client.
The client program contains tabs organized by function.
NOTE: The Windows 9000 client GUI can be started only by users with Administrative privileges.
•Status. Shows the client’s Fusion Manager registration status and mounted file systems, and
provides access to the IAD log for troubleshooting.
•Registration. Registers the client with the Fusion Manager, as described in the HP IBRIX 9000
Storage Installation Guide.
•Mount. Mounts a file system. Select the Cluster Name from the list (the cluster name is the
Fusion Manager name), enter the name of the file system to mount, select a drive, and then
click Mount. (If you are using Remote Desktop to access the client and the drive letter does
not appear, log out and log in again.)
•Umount. Unmounts a file system.
•Tune Host. Tunable parameters include the NIC to prefer (the client uses the cluster interface
by default unless a different network interface is preferred for it), the communications protocol
(UDP or TCP), and the number of server threads to use.
•Active Directory Settings. Displays current Active Directory settings.
18 Getting started

For more information, see the client GUI online help.
IBRIX software manpages
IBRIX software provides manpages for most of its commands. To view the manpages, set the
MANPATH variable to include the path to the manpages and then export it. The manpages are in
the $IBRIXHOME/man directory. For example, if $IBRIXHOME is /usr/local/ibrix (the
default), set the MANPATH variable as follows and then export the variable:
MANPATH=$MANPATH:/usr/local/ibrix/man
Changing passwords
You can change the following passwords on your system:
•Hardware passwords. See the documentation for the specific hardware for more information.
•Root password. Use the passwd(8) command on each server.
•IBRIX software user password. This password is created during installation and is used to log
in to the GUI. The default is ibrix. You can change the password using the Linux passwd
command.
# passwd ibrix
You will be prompted to enter the new password.
Configuring ports for a firewall
IMPORTANT: To avoid unintended consequences, HP recommends that you configure the firewall
during scheduled maintenance times.
When configuring a firewall, you should be aware of the following:
•SELinux should be disabled.
•By default, NFS uses random port numbers for operations such as mounting and locking.
These ports must be fixed so that they can be listed as exceptions in a firewall configuration
file. For example, you will need to lock specific ports for rpc.statd,rpc.lockd,
rpc.mountd, and rpc.quotad.
•It is best to allow all ICMP types on all networks; however, you can limit ICMP to types 0, 3,
8, and 11 if necessary.
Be sure to open the ports listed in the following table.
DescriptionPort
SSH22/tcp
NTP123/tcp, 123/upd
Multicast DNS, 224.0.0.2515353/udp
netperf tool12865/tcp
Fusion Manager to file serving nodes80/tcp
443/tcp
Fusion Manager and IBRIX file system5432/tcp
8008/tcp
9002/tcp
9005/tcp
9008/tcp
IBRIX software manpages 19

DescriptionPort
9009/tcp
9200/tcp
Between file serving nodes and NFS clients (user network)
NFS
2049/tcp, 2049/udp
111/tcp, 111/udp RPC
875/tcp, 875/udp quota
32803/tcp lockmanager
32769/udp lockmanager
892/tcp, 892/udp mount daemon
662/tcp, 662/udp stat
2020/tcp, 2020/udp stat outgoing
4000:4003/tcp reserved for use by a custom application (CMU) and can be disabled if not used
Between file serving nodes and SMB clients (user network)137/udp
138/udp
139/tcp
445/tcp
Between file serving nodes and 9000 clients (user network)9000:9002/tcp
9000:9200/udp
Between file serving nodes and FTP clients (user network)20/tcp, 20/udp
21/tcp, 21/udp
Between GUI and clients that need to access the GUI7777/tcp
8080/tcp
Dataprotector5555/tcp, 5555/udp
Internet Printing Protocol (IPP)631/tcp, 631/udp
ICAP1344/tcp, 1344/udp
Configuring NTP servers
When the cluster is initially set up, primary and secondary NTP servers are configured to provide
time synchronization with an external time source. The list of NTP servers is stored in the Fusion
Manager configuration. The active Fusion Manager node synchronizes its time with the external
source. The other file serving nodes synchronize their time with the active Fusion Manager node.
In the absence of an external time source, the local hardware clock on the agile Fusion Manager
node is used as the time source. This configuration method ensures that the time is synchronized
on all cluster nodes, even in the absence of an external time source.
On 9000 clients, the time is not synchronized with the cluster nodes. You will need to configure
NTP servers on 9000 clients.
List the currently configured NTP servers:
ibrix_clusterconfig -i -N
Specify a new list of NTP servers:
ibrix_clusterconfig -c -N SERVER1[,...,SERVERn]
20 Getting started