IBM High IOPS Adapter Installation manual

IBM High IOPS Adapter
Hardware User Guide
for Driver Release 2.2.3
5.4.2011

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 2
IBM High IOPS Hardware User Guide for Driver Version 2.2.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Safety Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
IBM High IOPS Adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Hardware Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
In the Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
IBM High IOPS Adapter Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Half-Height Bracket Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
External Hard Drive LED (optional) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
IBM High IOPS Duo Adapter Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
External Hard Drive LED Cable (optional) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
IBM Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 3
IBM High IOPS Hardware User Guide for Driver Version 2.2.3
Copyright Notice
© Copyright International Business Machines 2011. All rights reserved.
© Copyright 2006-2011 Fusion-io, Inc. All rights reserved. Fusion-io is a trademark of Fusion-io, Inc.
Part Number D0003073-000_1C

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 4
1.
2.
3.
4.
5.
1.
2.
3.
4.
Safety Information
DANGER
Electrical current from power, telephone, and communication cables is hazardous.
To avoid a shock hazard:
Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this
product during an electrical storm.
Connect all power cords to a properly wired and grounded electrical outlet.
Connect to properly wired outlets any equipment that will be attached to this product.
When possible, use one hand only to connect or disconnect signal cables.
Never turn on any equipment when there is evidence of fire, water, or structural damage.
Disconnect the attached power cords, telecommunications systems, networks, and modems before you open
the device covers, unless instructed otherwise in the installation and configuration procedures.
Connect and disconnect cables as described in the following table when installing, moving, or opening covers on this
product or attached devices.
To Connect To Disconnect
Turn everything OFF.
First, attach all cables to devices.
Attach signal cables to connectors.
Attach power cords to outlet.
Turn device ON.
Turn everything OFF.
First, remove power cords from outlet.
Remove signal cables from connectors.
Remove all cables from devices.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 5
Introduction
Overview
Congratulations on your purchase of a IBM solid-state storage device. This guide explains how to install, troubleshoot
and maintain your IBM High IOPS Adapter.
NOTE Throughout this manual, when you see a reference to an "IBM High IOPS Adapter," you may substitute
your device.
"IBM High IOPS Duo Adapter" refers to devices with two memory modules, including the IBM High
IOPS SD/MD Class SSD PCIe Adapters.
Designed around a revolutionary silicon-based storage architecture, the IBM High IOPS Adapter is the world's most
advanced NAND flash storage device, with performance comparable to DRAM and storage capacity on par with
today's hard disks—giving you the power to improve storage performance by orders of magnitude. The IBM High
IOPS Adapter allows every computer to exceed the I/O performance of an enterprise SAN.
The IBM High IOPS Adapter is a data accelerator designed specifically to improve the bandwidth for I/O-bound
applications. The IBM High IOPS Adapter is a no-compromise solution for the toughest computational challenges
faced by data centers today, putting it in a league of its own.
IBM High IOPS Adapters
IBM High IOPS Adapter Options
Feature Code Option Part Number Description
0096 46M0877 IBM 160GB High IOPS SS Class SSD PCIe Adapter
0097 46M0878 IBM 320GB High IOPS SD Class SSD PCIe Adapter
1649 46M0898 IBM 320GB High IOPS MS Class SSD PCIe Adapter
5985 81Y4519 640GB High IOPS MLC Duo Adapter for IBM System x
A1NE 81Y4535 320GB High IOPS SLC Adapter for IBM system x
A1ND 81Y4539 640GB High IOPS SLC Duo Adapter for IBM System x
A1NC 81Y4531 640GB High IOPS MLC Adapter for IBM System x
A1NB 81Y4527 1.28TB High IOPS MLC Duo Adapter for IBM System x

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 6
Memory Attributes
Feature
Code
NAND
Type [1]
Total
Memory
Memory
Modules
Module
Capacity
Maximum writes per
memory module
Maximum writes
per card
0096 SLC 160GB 1 160GB 75PB 75PB
0097 SLC 320GB 2 160GB 75PB 150PB [2]
1649 MLC 320GB 1 320GB 4PB 4PB
5985 MLC 640GB 2 320GB 4PB 8PB [2]
A1NE SLC 320GB 1 320GB 50PB 50PB
A1ND SLC 640GB 2 320GB 50PB 100PB [2]
A1NC MLC 640GB 1 640GB 10PB 10PB
A1NB MLC 1.28TB 2 640GB 10PB 20PB [2]
1. Single Level Cell (SLC), Multi Level Cell (MLC).
2. Assumes uniform distribution of writes across both memory modules.
Performance Attributes
Feature Code NAND Type [1] Read Bandwidth Write Bandwidth IOPS [2] Access Latency
0096 SLC 770 MB/s 750 MB/s 123,000 26 µs
0097 SLC 1.5 GB/s 1.5 GB/s 238,000 26 µs
1649 MLC 735 MB/s 510 MB/s 67,000 29 µs
5985 MLC 1.5 GB/s 1.0 GB/s 138,000 29 µs
A1NE SLC 770 MB/s 790 MB/s 119,000 26 µs
A1ND SLC 1.5 GB/s 1.5 GB/s 236,000 26 µs
A1NC MLC 750 MB/s 550 MB/s 74,000 30 µs
A1NB MLC 1.5 GB/s 1.1 GB/s 150,000 30 µs
1. Single Level Cell (SLC), Multi Level Cell (MLC).
2. IOPS with 75/25 mixed read/write and 512B packet sizes.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 7
System Requirements
Supported Operating Systems
All operating systems must be 64-bit x86 architecture to support the IBM High IOPS Adapter. Running the latest
Service Pack of a release is strongly recommended.
Attention UPGRADE WARNING: Version 2.2 and later of the driver software, including ioMemory VSL, are not
backward-compatible with any driver version earlier than 2.2. When you install version 2.2 or later, you
cannot revert to any driver version before 2.2.
Supported Linux Distributions
Red Hat Enterprise Linux (RHEL) 5, 6
SUSE Linux Enterprise Server (SLES) 10, 11
Supported Windows Operating Systems
Microsoft Windows 2003 Server 64-Bit (with SP2 or higher)
Microsoft Windows 2008 Server 64-Bit, R1 (with SP2 or higher)
Microsoft Windows 2008 Server 64-Bit, R2
NOTE IBM High IOPS Adapters cannot be used as hibernation devices.
Hardware Requirements
IBM High IOPS Adapter Requirements
The IBM High IOPS Adapter requires at least:
A PCI-Express (PCIe) Gen1 x4 slot.
The IBM High IOPS Adapter is a half-height, half-length, PCIe 1.1 x4 card and for full performance, it must
reside in a PCIe slot where at least 4 lanes are electrically active.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 8
Adequate system cooling.
To maximize the longevity and performance of an IBM High IOPS Adapter, we recommend at least 300 Linear
Feet per Minute (LFM) of airflow through the system.
In order to protect against thermal damage, the IBM High IOPS Adapter monitors the temperature of its
onboard controller chip (This is reported by the command line utility as "Internal temperature").fio-status
The IBM High IOPS Adapter will start throttling write performance once the controller temperature reaches
78°C. If the controller temperature continues to rise, the IBM High IOPS Adapter will shut down once the
controller temperature reaches 85°C.
NOTE If you experience write-performance throttling due to high temperatures, consult your server's
documentation for details on increasing airflow within your system .
Sufficient system memory (RAM).
The amount of RAM the VSL requires varies according to the average block size written to the device. Using
the average block size table below, you can estimate the amount of system memory needed. You can reduce
worst-case memory use by formatting your IBM High IOPS Adapter with a 4K sector size and thereby force
the average written block size to be 4K or greater.
Note however, that for many systems, even those formatted with 512 byte sectors, actual memory utilization
typically tracks with I/O operations on 4k or larger chunks of data.
At various block sizes, the following table shows the upper limit of RAM that may be required of your system for
every 80 GB of IBM High IOPS Adapter storage space used.
Average Written Block Size (bytes) RAM Usage (MB) per 80GB of storage space
8192 225
4096 (Most common) 425
2048 825
1024 1600
512 3175
For example, if your system is equipped with a IBM High IOPS Duo Adapter, formatted to use 4,096 byte sectors,
your system may require as much as:
(425 MB of RAM / 80 GB) x (640 GB) = for use by the IBM High3,400 MB (or around 3.32 GB) of system RAM
IOPS Duo Adapter driver.
IBM High IOPS Duo Adapter Requirements
In addition to the IBM High IOPS Duo Adapter cooling and RAM requirements given above, the IBM High IOPS
Duo Adapter requires at least:
A PCIe Gen1 x8 slot or a PCIe Gen2 x4 slot.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 9
A minimum of a , half-length slot with a x8 physical connection. For systems with PCI 1.1, all 8full-height
signaling lanes must be active for full IBM High IOPS Duo Adapter performance. For systems with PCIe 2.0,
only 4 signaling lanes must be active for full performance.
In the Box
Your IBM High IOPS Adapter comes with these items:
IBM High IOPS Adapter
USB Key
Quick Start Instructions
IBM High IOPS Adapter half-height bracket (used on low-profile systems; the IBM High IOPS Duo Adapter
does not use a half-height bracket)
Important Notices document
On the USB Key are the following items:
IBM High IOPS Adapter User Guide for Linux
IBM High IOPS Management Application User Guide
Environmental Notices document
Important Notices document

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 10
1.
2.
3.
4.
IBM High IOPS Adapter Installation
NOTE To install the IBM High IOPS Duo Adapter, see the next section .IBM High IOPS Duo Adapter Installation
For IBM High IOPS Adapter requirements, please see .Hardware Requirements
Installation Instructions
Attention Electrostatic discharge (ESD) can damage electronic components. Be sure that you are properly grounded
before beginning any hardware installation procedure.
If you are installing the IBM High IOPS Adapter in a low-profile system, you need to use the half-height
bracket. Please refer to the section for details.Half-Height Bracket Installation
Locate the serial number on your IBM High IOPS Adapter and record it for future reference.
Turn off the computer and disconnect the power cable.
Remove the computer's access panel. Locate an available x4 PCIe slot. (Consult your computer's
documentation for details on removing the panel and identifying PCIe slots.)

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 11
5.
6.
7.
Remove the cover slot (if applicable).
You now have the option to install the external HDD LED connection. If you choose to do this, proceed to
the section of this guide. Otherwise, continue with these steps to completeExternal Hard Drive LED (optional)
the hardware installation.
Grasp the IBM High IOPS Adapter by the top edge and seat it gently but firmly in the available PCIe slot:

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 12
8.
9.
10.
11.
Secure the IBM High IOPS Adapter's retaining bracket using a screw or lever (depending on how your
hardware is configured):
Replace the computer's access panel.
Plug in the power cable and turn on the computer.
Your operating system may detect the IBM High IOPS Adapter and ask if you want it to install a hardware
driver for the device. In that case, click .Cancel
You are now ready to install the driver and utilities software. See the IBM High IOPS Adapter user guide based on
your operating system.
Half-Height Bracket Installation
For half-height installation (such as in low-profile systems), you need to replace the full-height retaining bracket with
the included half-height bracket.
Attention Electrostatic discharge (ESD) can damage electronic components. Be sure you are properly grounded
before starting any hardware installation procedure.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 13
1.
2.
3.
Locate the half-height bracket in your IBM High IOPS Adapter package:
Attention Use care in removing the retaining screws. Do not twist or pull on the bracket until both screws are
out as this can cause damage to the components.
To prevent damage to the IBM High IOPS Adapter, use only a Philips #1 tip screwdriver. Remove the two
screws holding the full-height bracket to the IBM High IOPS Adapter in the order shown.
Remove the bracket carefully from the device.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 14
4.
5.
6.
Align the LEDs on the IBM High IOPS Adapter with the holes in the half-height bracket:
NOTE Be sure the bracket tabs are on the backside of the device (opposite of heat sink).
Attach the half-height bracket using a Philips #1 tip screwdriver to tighten the two screws:
Attention Do not over-tighten! This can cause damage to the device.
Return to Step 2 of the Hardware Installation section to complete the install.
External Hard Drive LED (optional)
The IBM High IOPS Adapter includes a two-pin LED pinout for attaching to an external HDD access light. To attach
the LED:

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 15
1.
2.
3.
4.
Locate the two-pin pinout at the right of the IBM High IOPS Adapter:
Plug in the connector:
NOTE The pin closest to the PCIe connector is the negative pin.
Replace the computer's access panel.
Plug in the power cable and turn on the computer.
The external LED now displays both read and write operations performed on the IBM High IOPS Adapter.
Resume the installation of your IBM High IOPS Adapter

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 16
1.
IBM High IOPS Duo Adapter Installation
NOTE For IBM High IOPS Duo Adapter requirements, please see .Hardware Requirements
Installation Instructions
Attention Electrostatic discharge (ESD) can damage electronic components. Be sure that you are properly grounded
before beginning any hardware installation procedure.
Locate the serial and informational numbers on each side of your IBM High IOPS Adapter and record them
for future reference.
NOTE Record four serial numbers: one serial number for each of the two ioMemory modules, one for the
adapter serial number and the IBM Device serial number.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 17
1.
2.
3.
4.
Turn off the computer and disconnect the power cable.
Remove the computer's access panel. Locate an available Gen1 x8 or Gen2 x4 PCIe slot.* (Consult your
computer's documentation for details on removing the panel and identifying PCIe slots.)
*Gen1 slot with a minimum physical width of x8 and a minimum signaling width of x8, or a Gen2 slot with minimum physical
width of x8 and minimum signaling width of x4.
Plug in optional LED connector (if desired).
NOTE If you choose to use the optional connector, make that optional connectionExternal Hard Drive LED
before proceeding. It will be difficult to make that connection once the IBM High IOPS Adapter is
installed.
Return to the next step after completing the connection.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 18
5.
6.
7.
8.
Grasp the IBM High IOPS Adapter by the top edge and seat it gently but firmly in the available PCIe slot:
Secure the IBM High IOPS Adapter's retaining bracket using a screw or lever (depending on how your
hardware is configured):
Replace the computer's access panel.
Plug in the power cable and turn on the computer.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 19
9.
1.
2.
3.
4.
Your operating system may detect the device and ask if you want it to install a driver for the device. In that
case, click .Cancel
You are now ready to install the driver and utilities software. See the IBM High IOPS Adapter user guide based
on your operating system.
External Hard Drive LED Cable (optional)
The IBM High IOPS Duo Adapter includes a two-pin LED pinout for attaching to an external HDD access light. To
attach the LED,
Locate the two-pin pinout near the lower left corner of the The IBM High IOPS Duo Adapter, as shown in the
diagram.
Plug in the connector.
Replace the computer's access panel.
Plug in the power cable and turn on the computer.
NOTE The pin closest to the PCIe connector is the positive pin.
The external LED now indicates a combination of both the reads and writes executing on the The IBM High IOPS
Duo Adapter.
Return to the The IBM High IOPS Duo Adapter installation instructions.

IBM High IOPS Adapter - Hardware User Guide 2.2.3 |__________________ __ __ 20
IBM Support
IBM High IOPS Adapter Customer Support is available on the web at the following address:
http://www.ibm.com/systems/support
IBM part number 60Y1443