Isilon Systems Isilon IQ 4U X Series Use and care manual

Isilon IQ
4U X-Series and NL-Series Field Replacement
Manual
August 2010
*120-0032-01REVD*
120-0032-01REVD

Isilon Systems respects the intellectual property of others.
©2011 Isilon Systems LLC. All rights reserved.
Isilon, Isilon Systems, OneFS, and SyncIQ are registered trademarks of Isilon Systems LLC. Isilon IQ, SmartConnect,
SnapshotIQ, TrueScale,Autobalance, FlexProtect, SmartCache, SmartPools, InsightIQ, “SIMPLE IS SMART,” and the Isilon
logo are trademarks of Isilon. Other product and company names mentioned are the trademarks of their respective owners.
Due to ongoing product development, innovation, and revision, the information contained here is subject to change without
notice. Isilon will publish updates and revisions to this document as needed. The systems documented herein are provided
under End User License Agreements. Please refer to the Agreements for details governing the use of Isilon IQ systems.

Contents
Chapter 1: Field replacement procedures overview.................................................................5
Nodes covered by this manual............................................................................................5
Safety precautions..............................................................................................................5
General recommendations..................................................................................................6
Where to go for support......................................................................................................6
Chapter 2: Front panel.................................................................................................................7
Replacing the front panel....................................................................................................7
Chapter 3: Power supply.............................................................................................................9
Replacing a power supply...................................................................................................9
Chapter 4: NVRAM battery assembly.......................................................................................11
Replacing an NVRAM battery assembly...........................................................................11
Removing an NVRAM battery assembly from a 4U node......................................11
Install the NVRAM battery assembly......................................................................12
Chapter 5: Hard drives...............................................................................................................15
Replacing a failed hard drive.............................................................................................15
Remove a drive......................................................................................................17
Install a hard drive..................................................................................................17
Chapter 6: Cooling fans.............................................................................................................19
Replacing a cooling fan.....................................................................................................19
Chapter 7: DIMM modules.........................................................................................................21
Replacing a DIMM module................................................................................................21
Chapter 8: Expansion cards......................................................................................................25
Removing the riser card assembly....................................................................................25
Installing the riser card assembly......................................................................................26
Replacing the IB/NVRAM card..........................................................................................27
Remove the IB/NVRAM Card.................................................................................27
Installing the IB/NVRAM card.................................................................................28
Replacing the SAS drive controller card...........................................................................29
Replacing the network interface card................................................................................30
Remove a network interface card...........................................................................30

Install the network interface card............................................................................31
Chapter 9: Node chassis...........................................................................................................33
Replacing a 108NL chassis...............................................................................................33
Replacing a node by using a 3/4 chassis..........................................................................33
Test a file system journal........................................................................................35
Transfer the file system journal from a failed node.................................................35
Update a replacement chassis SKU to a product SKU..........................................37
Gather information about a cluster.........................................................................37
Return a failed node...............................................................................................38
Shutting down a node by using the command-line interface.............................................38
Remove the node top panel..............................................................................................38
Install the node top panel..................................................................................................39
Remove a node from a rack cabinet.................................................................................39
Install a node chassis in a rack cabinet.............................................................................40

Field replacement procedures overview
Isilon IQ nodes contain a number of components that are easily serviced in the field by trained service personnel.
Note: It is important to replace hardware components as soon as possible after becoming aware of a hardware failure
or impending hardware issue.
Before performing maintenance on Isilon hardware, carefully read and understand all relevant safety information and
recommendations. Contact Isilon Technical Support with any questions about Isilon hardware maintenance.
Nodes covered by this manual
This manual covers all field replacement procedures for Isilon 4U X-Series and NL-Series nodes, with the exception of
the chassis replacement procedure for the IQ 108NL.
The procedures detailed in this manual apply to the following Isilon nodes:
• 32000X-SSD
• 36000X
• 72000X
• 36NL
• 72NL
108NL field replacement procedures
All field replacement procedures in this manual may be used with the IQ 108NL, with the exception of the NodeChassis
replacement procedure. To replace a failed 108NL chassis, refer to the separate document titled Replace an IQ 108NL
Node using a 3/4 Chassis.
Safety precautions
Safety warnings describe circumstances under which there is risk of electric shock, bodily injury, fire, damage to Isilon
hardware, or loss of data. Failure to heed these warnings may void the product warranty.
• Ensure that the ambient temperature of the environment in which an Isilon node operates does not exceed the
maximum rated ambient temperature: 35°C (95°F).
• Provide proper airflow to Isilon nodes.
•Ensure that theAC supply circuit for each Isilon node is capable of supplying the total current specified on the node
label.
•Properly ground allAC power supply connections. Pay close attention to connections that are not directly connected
to the branch circuit, such as a node connected to a power strip.
• Before performing maintenance on Isilon nodes, disconnect both power cables.
• Do not overload the branch circuit of the AC power supply providing power to the rack cabinet containing Isilon
nodes. The total rack load must not exceed 80 percent of the branch circuit rating.
• To help protect the system from sudden increases or decreases in electrical power, use a surge suppressor, line
conditioner, or uninterruptible power supply (UPS).
5

• When installing Isilon nodes in a rack cabinet, always use both front and side rack stabilizers. Installing nodes in a
rack cabinet without stabilizers can cause the rack to tip over and potentially result in personal injury.
• Due to the weight of Isilon nodes, use a minimum of two people to install nodes into a rack cabinet. A 4U Isilon
node with the drives installed can weigh up to 130 lbs (57.97 kg). To minimize the chance of injury during node
installation, 4U Isilon nodes must be installed in a rack cabinet without the hard drives installed in the node.
General recommendations
Before replacing components or performing other maintenance operations on Isilon nodes, review these general
recommendations and best practices.
• Only trained and qualified personnel should install or replace equipment.
• Use only approved replacement parts and equipment.
• Handle all electronic components according to the manufacturer instructions.
• Always follow electrostatic discharge (ESD) prevention procedures when removing and replacing cards and other
static-sensitive system components.You must use a wrist strap attached to the node chassis for grounding when
working on these components.
•You may need to log in to the node and access the system in order to view status and other information about defective
components, or to configure and verify the proper installation of the new components.
•If a drive, power supply, or other component of an Isilon node fails or needs to be replaced, the replacement part kit
must be supplied by Isilon Systems. This replacement policy helps to ensure compatibility between all of the parts.
In addition, Isilon Systems requests that customers return defective parts to Isilon Systems for analysis and evaluation.
To return a component to Isilon, contact Isilon Technical Support and follow the instructions provided by the support
engineer. Make sure to include the following details about the failed component on a label or packing sheet:
• Serial number of node
• Technical Support case number (if any)
• Slot number or drive number (if applicable)
• Brief description of the failure circumstances
• Component serial number (if applicable)
Include the label on the package or insert the packing sheet in the package and follow the instructions provided by
the Technical Support Engineer to send the component back to Isilon.
Where to go for support
Contact Isilon Technical Support for any questions about Isilon products.
Isilon Technical Support engineers can be contacted using any of the following methods:
Local: 1-206-777-7970
Toll free: 1-866-276-0723
Email: [email protected]
Online: isilon.com/support
Japan support: 03-5358-7180
6©2011 Isilon Systems, LLC.
Field replacement procedures overview

Front panel
The front panel covers the hard drive bays and contains an LCD to display node status information.
General ESD guidelines
Always follow electrostatic discharge (ESD) prevention procedures when removing and replacing cards, memory, and other
system components.You must use a wrist strap, attached to the node chassis, for grounding.
Required hardware
• Replacement front panel assembly
• ESD grounded wrist strap
Replacing the front panel
You may need to replace the front panel of a node if the font panel become damaged or if there is an issue with the
integrated LCD.
Note: Removing a front panel does not require powering down the node. However, you may need to restart the
LCD on the front panel through the command-line interface when you replace the front panel.
1. Place one hand on each side of the front panel and gently pull forward to remove the front panel.
2. Align the new front panel with the ear brackets on the node and snap the front panel into place.
2
1
2 Ear bracket1 Front panel
Figure 1. Installing the front panel
3. Restart the front panel LCD by logging into the node and running the isi_lcd_d restart command.
The front panel LCD will also restart when a front panel button is pressed; however, you may still need to run
isi_lcd_d to reset the Alarm and Cluster LEDs.
7

Power supply
Isilon IQ nodes include a dual power supply system to help minimize downtime caused by power source complications. The
two power supply units operate in tandem, each providing half of the amperage draw to the node components.
General ESD guidelines
Always follow electrostatic discharge (ESD) prevention procedures when removing and replacing cards, memory, and other
system components.You must use a wrist strap, attached to the node chassis, for grounding.
Required hardware
• Replacement power supply
• ESD grounded wrist strap
Replacing a power supply
Isilon IQ nodes have two power supplies that provide redundant power to the node.The power supply units are accessible
from the back of the node.
Caution: Never remove both power supply units from a running node.
!
Note: Replacing a power supply does not require powering down the node. The remaining power unit provides
enough power for the node.
1. Check the LED on each of the power supply units to determine which unit has failed. An amber LED indicates a
failed unit. Disconnect the power cord from the plug of the unit to be replaced.
1 2
2 Power supply release lever1 Power supply LED
Figure 2. 4U Isilon IQ power supply location
2. Push the power supply release lever to the left to release the unit from the retaining catch.
3. Pull the power supply unit from the power supply bay, using the vertical loop handle.
9

1
2
2 Power supply bay1 Power supply unit
Figure 3. Removing a power supply from the node
4. Insert a new power supply into the empty power supply bay with the label side facing up.
5. Push the new power supply firmly but carefully into the bay. The retaining latch automatically clicks into place to
secure the power supply.
6. Connect a power cord to the new power supply.
The LED on the power supply turns green when the power supply begins supplying power to the node.
7. Return the old hardware to Isilon Technical Support.
For more information, see General recommendations on page 6.
10 ©2011 Isilon Systems, LLC.
Power supply

NVRAM battery assembly
Isilon IQ nodes have two batteries that provide redundant power to temporarily maintain non-volatile RAM (NVRAM) journal
information in the event of an unexpected power outage and shutdown of the node. The battery units are accessible from the
back of the node.
Failure of an NVRAM battery causes the node to switch to a read-only state as well as generate alerts. Read-only status can
be confirmed on the Node Status page on the web administration interface, on the front panel display, or through the
command-line interface.
After replacing an NVRAM battery, the node performs a quick test to ensure that the new battery is charging properly. It can
take up to seven hours for the battery to fully charge. After charging successfully completes, a full battery test is scheduled
for the next day. A full battery test runs in the background and can take up to 60 hours.
General ESD guidelines
Always follow electrostatic discharge (ESD) prevention procedures when removing and replacing cards, memory, and other
system components.You must use a wrist strap, attached to the node chassis, for grounding.
Required hardware
• Replacement non-volatile RAM (NVRAM) battery assembly
• ESD grounded wrist strap
Replacing an NVRAM battery assembly
After an alert is issued, it is important to replace the NVRAM battery as soon as possible.
Note: Replacing the NVRAM battery assembly does not require powering down the node. However, verify that
the node is in read-only state prior to replacing the NVRAM batter assembly. Use the Node Status page on the
web interface, front panel LCD display, or isi readonly show from the command-line interface to verify
the node is read-only.
1. Remove the failed NVRAM battery assembly from the node.
For more information, see Removing an NVRAM battery assembly from a 4U node on page 11.
2. Install a new battery assembly.
For more information, see Install the NVRAM battery assembly on page 12.
3. Return the failed battery assembly to Isilon, unless otherwise directed by Isilon Technical Support.
Removing an NVRAM battery assembly from a 4U node
You can safely remove an NVRAM battery assembly from a node as long as the remaining battery assembly status LED
lights green, indicating a good battery.
Important: Do not remove both NVRAM batteries at the same time. Removing both NVRAM batteries puts
data at risk in the event of a power loss.
11

1. On the node back panel, check the LED indicator for each battery assembly to determine which battery has failed.
The LED on the right side of the battery assembly lights red when the battery fails.
1
1 NVRAM battery assemblies
Figure 4. NVRAM battery location
2. Lift up the locking tab at the bottom of the battery assembly.
2
1
2 NVRAM battery1 Locking tab
Figure 5. Removing an NVRAM battery assembly
3. Remove the battery assembly from the node, using the handle. The system software detects the removal of the battery,
and generates alerts.
4. Wait at least 30 seconds for all the alerts to generate.
Install the NVRAM battery assembly
Install a battery assembly to replace a failed battery, or after using it as a transfer battery to move an IB/NVRAM card.
Note: Installing an NVRAM battery assembly does not require powering down the node. However, verify that
the node is in the read-only state prior to installing the NVRAM battery assembly. Use the Node Status page on
the web interface, front panel LCD display, or isi readonly show from the command-line interface to
verify the node is in a read-only state.
Insert the battery assembly into the empty battery bay.
The locking tab clicks into place when the battery assembly is fully inserted.
12 ©2011 Isilon Systems, LLC.
NVRAM battery assembly

2
1
2 NVRAM battery1 Locking tab
Figure 6. Installing an NVRAM battery assembly
©2011 Isilon Systems, LLC. 13
NVRAM battery assembly

Hard drives
Isilon IQ nodes store cluster data on a series of hard drives. If a hard drive fails, the hard drive must be replaced.
Important: Replacement hard drives must be supplied by Isilon Systems. Hard drives must also have the correct
capacity and type for the node model. If you do not know what kind of hard drive the node requires, contact Isilon
Technical Support.
General ESD guidelines
Always follow electrostatic discharge (ESD) prevention procedures when removing and replacing cards, memory, and other
system components.You must use a wrist strap, attached to the node chassis, for grounding.
Required hardware
• Replacement hard drive
• ESD grounded wrist strap
Replacing a failed hard drive
Replace failed drives as soon as possible to minimize the potential for data loss.
Caution: Do not remove a healthy drive from a node unless instructed to remove the drive by Isilon Technical
Support.
!
Drive bays are numbered left-to-right, top-to-bottom. For example, the top row of bays on the front of a node are
numbered 1-4.
1. Identify the failed hard drive.
If you already know which hard drive to replace, proceed to the next step. To determine which hard drive to replace,
complete the following steps.
a. Log in to the node.
b. Type isi devices -a status -d <node ID number> , and then press ENTER.
The following message shows an example of the information returned by the isi devices -a status
command.
Node 4, [ OK ]
Bay 1 Lnum 8 [HEALTHY] SN:A603SPEE /dev/da0
Bay 2 Lnum 7 [HEALTHY] SN:A6082A2E /dev/da1
Bay 3 Lnum 6 [HEALTHY] SN:Y60PFJWE /dev/da2
Bay 4 Lnum 5 [HEALTHY] SN:A6086AVE /dev/da3
Bay 5 Lnum 4 [HEALTHY] SN:Y604H2NE /dev/da4
Bay 6 Lnum 3 [HEALTHY] SN:Y604XD5E /dev/da5
Bay 7 Lnum 9 [HEALTHY] SN:Y604HBGE /dev/da6
Bay 8 Lnum 10 [HEALTHY] SN:Y603E6GE /dev/da7
Bay 9 Lnum 0 [REPLACE] SN:Y60PFPEE /dev/da8
Bay 10 Lnum 11 [HEALTHY] SN:A60877NE /dev/da9
15

Bay 11 Lnum 11 [HEALTHY] SN:A60877NE /dev/da10
Bay 12 Lnum 11 [HEALTHY] SN:A60877NE /dev/da11
The example message shows that the hard drive in Bay 9 needs replacing.
2. If the failed hard drive is located in one of the front drive bays, remove the node front panel. Otherwise, proceed to
the next step.
3. Remove the failed hard drive from the node.
You can quickly locate the correct hard drive to remove by looking for a drive with the red drive-fault LED lit. For
more information, see Remove a drive on page 17.
4. Install the new hard drive.
For more information, see Install a hard drive on page 17.
Note: SSDs can only go in drive bays 1-4 (the top row of bays on the front of the chassis). Non-SSD drives
can go in any drive bay.You can identify an SSD by the color of the drive tray locking handle; SSDs have
silver handles, whereas all other drive types have black handles. SSDs are also smaller 2 1/2" drives.
5. Align the front panel with the ear brackets on the node and snap the front panel into place.
6. On the command-line interface, type isi devices -a add -d <node ID number>:<drive bay number> ,
and then press ENTER.
7. Complete one of the following options based on the result of the previous step.
• If the inserted drive has been properly formatted, the following message appears:
The add operation succeeded. A OneFS-formatted drive was found in
bay <drive bay number> and is being attached to the file system. Wait a few
minutes and re-run 'isi devices' to verify that the attach
operation completed successfully.
Wait a few minutes, and then run the isi devices command again to verify that the drive was added
successfully.
•If the inserted drive has encountered an add-operation failure, an error message appears. If the message indicates
that the failure is the result of an unrecognized drive or a previously used drive, or that the removed drive has
been re-inserted, type isi devices -a format -d <node ID number>:<drive bay number> to format
the drive.
• If the inserted drive has not been previously formatted, the following message appears:
This drive does not appear to be pre-formatted with OneFS.
Formatting this drive will destroy any existing data and attach
it to OneFS. Do you wish to continue formatting this drive?
To format the drive, type yes. To cancel the formatting process, type no.
• If the inserted drive has been used in another node, the following message appears:
This drive appears to contain OneFS data not recognized by this
node. Formatting this drive will erase the existing data,
completely re-format the drive, and attach it to OneFS. Do you
wish to continue formatting this drive?
To format the drive, type yes. To cancel the formatting process, type no.
• If the inserted drive is the same drive that was removed, the following message appears:
This drive has been removed from the cluster. It is
likely that the drive is faulty and the suggested action is to
replace the drive. Re-formatting the drive will erase all data
16 ©2011 Isilon Systems, LLC.
Hard drives

and force it back into service. Are you sure you wish to continue
formatting this drive?
To format the drive, type yes. To cancel the formatting process, type no.
Note: If the add-operation failure is not the result of an unrecognized drive or a previously used drive,
or if the removed drive has been re-inserted, follow the instructions provided in the error message or
contact Isilon Technical Support.
8. Return the old hardware to Isilon Technical Support.
For more information, see General recommendations on page 6.
Remove a drive
1. If the hard drive you want to remove is located in one of the front drive bays (bays 1–24), place one hand on each
side of the front panel and gently pull forward to remove the front panel, and reveal the drive bays. Otherwise,
proceed to the next step.
2. Locate the hard drive to be removed and release the drive locking handle. Remove the drive.
2
3
1
3 Hard drive bay1 Locking handle
2 Hard drive
Figure 7. Removing a hard drive
3. Repeat as necessary with other drives that need to be removed.
Install a hard drive
You can install a hard drive in a node as part of a new node installation or to replace a failed hard drive.
1. With the locking handle open, insert an install drive into an empty drive bay by sliding the drive along the bay rails
until it stops.
Caution: Do not force the drive into the drive bay. Forcing the drive into the drive bay could result in irreparable
damage to both the drive and the drive bay.
!
©2011 Isilon Systems, LLC. 17
Hard drives

2
3
1
3 Hard drive bay1 Locking handle
2 Hard drive
Figure 8. Installing a hard drive
2. Gently push the locking handle on the drive until the drive clicks into place.
3. Optional: Repeat the previous steps to install additional hard drives.
18 ©2011 Isilon Systems, LLC.
Hard drives

Cooling fans
Isilon IQ nodes contain three cooling fans to prevent the node components from overheating.
General ESD guidelines
Always follow electrostatic discharge (ESD) prevention procedures when removing and replacing cards, memory, and other
system components.You must use a wrist strap, attached to the node chassis, for grounding.
Required hardware
• Replacement cooling fan
• ESD grounded wrist strap
• #2 Phillips screwdriver or #2 JIS driver
Replacing a cooling fan
Isilon nodes contain three cooling fans to maintain proper airflow. Each cooling fan can be individually replaced without
powering down the node.
1. Remove the top panel from the node.
For more information, see Remove the node top panel on page 38.
Note: Removing the top panel from a node temporarily places the node into a read-only state. The node
returns to a read/write state when the top panel is replaced.
2. Identify the fan you want to replace.
A small red fan fault LED at the rear base of each fan indicates the fan to replace. The following figure shows the
location of each fan.
1
1 Cooling fans
Figure 9. 4U Isilon IQ fan location
19

3. Pull the fan straight up to remove the fan from the node.
Caution: Keep fingers clear of fan blades while removing the fan.
!
1
2
2 Fan alignment slot1 Cooling fan
Figure 10. Removing a fan
4. Slide the new fan into the fan alignment slots with the arrow on top of the fan pointing toward the rear of the node.
5. Press the fan straight down to secure the fan.
The fan should begin spinning and the fan fault LED should turn off.
6. Replace the node top panel.
For more information, see Install the node top panel on page 39.
7. Return the old hardware to Isilon Technical Support.
For more information, see General recommendations on page 6.
20 ©2011 Isilon Systems, LLC.
Cooling fans