Silicon Graphics Rackable C1104-GP2 User manual

SGI®Rackable™C1104-GP2 and C1110-GP2
System User Guide
007-6388-001

COPYRIGHT
© 2014 Silicon Graphics International Corp. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No
permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part,
without the prior written permission of SGI.
LIMITED RIGHTS LEGEND
The software described in this document is “commercial computer software” provided with restricted rights (except as to included open/free source) as specified
in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws,
treaties and conventions. This document is provided with limited rights as defined in 52.227-14.
The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any
contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR
12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto.
Contractor/manufacturer is SGI, 46600 Landing Parkway, Fremont, CA 94538.
TRADEMARKS AND ATTRIBUTIONS
Silicon Graphics, SGI, the SGI logo, Rackable, and Supportfolio are trademarks or registered trademarks of Silicon Graphics International Corp. in the United
States and/or other countries worldwide.
Intel, Intel QuickPath Interconnect (QPI) and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and
other countries.
AMIBIOS is a registered trademark of American Megatrends Inc. in the United States and/or other countries worldwide.
Fusion-MPT, Integrated RAID, MegaRAID, and LSI Logic are trademarks or registered trademarks of LSI Logic Corporation.
HyperTransport is a licensed trademark of the HyperTransport Technology Consortium.
InfiniBand is a registered trademark of the InfiniBand Trade Association.
Internet Explorer and MS-DOS are registered trademarks of Microsoft Corporation.
Linux is a registered trademark of Linus Torvalds, used with permission by SGI.
Novell and Novell Netware are registered trademarks of Novell Inc.
PCIe and PCI-X are registered trademarks of PCI SIG.
Phoenix and PhoenixBIOS are registered trademarks of Phoenix Technologies Ltd.
Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries.
SUSE LINUX and the SUSE logo are registered trademarks of Novell, Inc.
UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.
All other trademarks mentioned herein are the property of their respective owners.

007-6388-001 iii
Record of Revision
Version Description
001 December, 2014
First release

007-6388-001 v
Contents
Record of Revision . . . . . . . . . . . . . . . . . . . . . . . iii
About This Guide . . . . . . . . . . . . . . . . . . . . . . . ix
Audience. . . . . . . . . . . . . . . . . . . . . . . . . . ix
Chapter Descriptions . . . . . . . . . . . . . . . . . . . . . . ix
Related Publications . . . . . . . . . . . . . . . . . . . . . . . x
Conventions . . . . . . . . . . . . . . . . . . . . . . . . . xi
Product Support . . . . . . . . . . . . . . . . . . . . . . . . xi
Reader Comments . . . . . . . . . . . . . . . . . . . . . . . xii
1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . 1
Server Board Features . . . . . . . . . . . . . . . . . . . . . . 3
Processors . . . . . . . . . . . . . . . . . . . . . . . . 3
QPI Interconnect . . . . . . . . . . . . . . . . . . . . . . 3
Memory . . . . . . . . . . . . . . . . . . . . . . . . . 3
Serial ATA and Optional SAS . . . . . . . . . . . . . . . . . . . 4
PCI Express Expansion Slots . . . . . . . . . . . . . . . . . . . 4
Onboard Controllers/Ports . . . . . . . . . . . . . . . . . . . . 4
Onboard Graphics Controller . . . . . . . . . . . . . . . . . . . 4
IPMI . . . . . . . . . . . . . . . . . . . . . . . . . 4
Other Features . . . . . . . . . . . . . . . . . . . . . . . 5
Server Chassis Features . . . . . . . . . . . . . . . . . . . . . . 5
System Power . . . . . . . . . . . . . . . . . . . . . . . 5
Serial ATA Subsystems . . . . . . . . . . . . . . . . . . . . 5
Front Control Panel . . . . . . . . . . . . . . . . . . . . . . 5
Serverboard and PCIe Subsystem . . . . . . . . . . . . . . . . . . 6
PCIe Features . . . . . . . . . . . . . . . . . . . . . . 6
Cooling System . . . . . . . . . . . . . . . . . . . . . . . 7

vi 007-6388-001
Contents
2 Server Installation . . . . . . . . . . . . . . . . . . . . . . . 9
Unpack the System . . . . . . . . . . . . . . . . . . . . . . . 9
Prepare for Setup . . . . . . . . . . . . . . . . . . . . . . 9
Choose a Setup Location . . . . . . . . . . . . . . . . . . . . 9
System Warnings and Precautions . . . . . . . . . . . . . . . . . . . 10
Server Precautions . . . . . . . . . . . . . . . . . . . . . . 11
Rack Mounting Considerations . . . . . . . . . . . . . . . . . . . . 11
Ambient Operating Temperature . . . . . . . . . . . . . . . . . . 11
Reduced Airflow . . . . . . . . . . . . . . . . . . . . . . 12
Mechanical Loading . . . . . . . . . . . . . . . . . . . . . . 12
Circuit Overloading . . . . . . . . . . . . . . . . . . . . . . 12
Reliable Ground . . . . . . . . . . . . . . . . . . . . . . . 12
Install the System into a Rack . . . . . . . . . . . . . . . . . . . . 12
Separate the Sections of the Rack Rails . . . . . . . . . . . . . . . . . 12
Inner Rail Extensions . . . . . . . . . . . . . . . . . . . . . 14
Installing the Inner Rail Extensions . . . . . . . . . . . . . . . . 14
Assembling the Outer Rails . . . . . . . . . . . . . . . . . . . . 15
Assembling the Outer Rails. . . . . . . . . . . . . . . . . . . 15
Attaching the Outer Rack Rails . . . . . . . . . . . . . . . . . . . 16
Using the Rail Locking Tabs . . . . . . . . . . . . . . . . . . 17
Install the Server in a Rack . . . . . . . . . . . . . . . . . . . . 18
Supply Power to the System . . . . . . . . . . . . . . . . . . 19
3 System Interface. . . . . . . . . . . . . . . . . . . . . . . . 21
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Control Panel Buttons . . . . . . . . . . . . . . . . . . . . . . 21
Control Panel LEDs . . . . . . . . . . . . . . . . . . . . . . . 22
Power Fail LED . . . . . . . . . . . . . . . . . . . . . . . 23
UID LED . . . . . . . . . . . . . . . . . . . . . . . . 23
NIC1 . . . . . . . . . . . . . . . . . . . . . . . . . . 23
NIC2 . . . . . . . . . . . . . . . . . . . . . . . . . . 24
HDD . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Info LED. . . . . . . . . . . . . . . . . . . . . . . . . 24
Drive Carrier LEDs . . . . . . . . . . . . . . . . . . . . . . . 25

Contents
007-6388-001 vii
4 System Safety . . . . . . . . . . . . . . . . . . . . . . . . 27
Electrical Safety Precautions . . . . . . . . . . . . . . . . . . . . 27
Serverboard Battery. . . . . . . . . . . . . . . . . . . . . . 28
ESD Precautions . . . . . . . . . . . . . . . . . . . . . . 28
Mainboard Replaceable Soldered-in Fuses . . . . . . . . . . . . . . . . 29
General Safety Precautions . . . . . . . . . . . . . . . . . . . . . 29
5 System and Serverboard Information . . . . . . . . . . . . . . . . . 31
Handling Circuit Boards and Drives . . . . . . . . . . . . . . . . . . 31
ESD Precautions . . . . . . . . . . . . . . . . . . . . . . 32
Unpacking . . . . . . . . . . . . . . . . . . . . . . . . 32
System Rear I/O Ports . . . . . . . . . . . . . . . . . . . . . . 33
Serverboard Details . . . . . . . . . . . . . . . . . . . . . . 33
CPUs . . . . . . . . . . . . . . . . . . . . . . . . 34
Memory . . . . . . . . . . . . . . . . . . . . . . . 34
PCIe Expansion . . . . . . . . . . . . . . . . . . . . . 34
System Health Monitoring . . . . . . . . . . . . . . . . . . . 34
ACPI Features . . . . . . . . . . . . . . . . . . . . . . 35
Onboard I/O . . . . . . . . . . . . . . . . . . . . . . 35
Serverboard Dimensions . . . . . . . . . . . . . . . . . . . 35
Hard Drives (C1104-GP2 and C1110-GP2 Chassis) . . . . . . . . . . . . . . 37
Drive Configurations . . . . . . . . . . . . . . . . . . . . . 37
PCIe Expansion Cards . . . . . . . . . . . . . . . . . . . . . . 38
Power Supply Functional Rating . . . . . . . . . . . . . . . . . . 39
6 Basic Troubleshooting and Chassis Service . . . . . . . . . . . . . . . . 41
Basic Troubleshooting Procedures . . . . . . . . . . . . . . . . . . . 41
If the System Does Not Power Up . . . . . . . . . . . . . . . . . . 41
System Powers Up But Will Not Boot . . . . . . . . . . . . . . . . . 42
No Video After System Power Up . . . . . . . . . . . . . . . . . . 42
Memory Errors . . . . . . . . . . . . . . . . . . . . . . . 42
Chassis Service Information. . . . . . . . . . . . . . . . . . . . . 43
Static-Sensitive Devices . . . . . . . . . . . . . . . . . . . . 43
Precautions . . . . . . . . . . . . . . . . . . . . . . . . 43

viii 007-6388-001
Contents
Unpacking . . . . . . . . . . . . . . . . . . . . . . . . 44
Control Panel . . . . . . . . . . . . . . . . . . . . . . . . . 44
Drive Bay Installation/Removal . . . . . . . . . . . . . . . . . . . . 44
Accessing the Drive Bays . . . . . . . . . . . . . . . . . . . . 44
Removing Hard Drives or Carriers from the Chassis . . . . . . . . . . . . . 45
The Hard Drive Backplane . . . . . . . . . . . . . . . . . . . 45
Disk Drive Installation . . . . . . . . . . . . . . . . . . . . . 45
Hard Drive Carrier Assembly Usage . . . . . . . . . . . . . . . . . 46
Power Supply. . . . . . . . . . . . . . . . . . . . . . . . . 49
Power Supply Failure . . . . . . . . . . . . . . . . . . . . . 49
Removing/Replacing a Power Supply . . . . . . . . . . . . . . . . . 50
Removing the Power Supply . . . . . . . . . . . . . . . . . . 50
Installing a New Power Supply. . . . . . . . . . . . . . . . . . 50
Accessing the Inside of the Chassis . . . . . . . . . . . . . . . . . . . 52
System Fans . . . . . . . . . . . . . . . . . . . . . . . . . 52
System Fan Failure . . . . . . . . . . . . . . . . . . . . . . 52
Replacing System Fans . . . . . . . . . . . . . . . . . . . . . 53
Remove/Replace a Fan . . . . . . . . . . . . . . . . . . . . 53
Install/Replace a PCIe Expansion Card . . . . . . . . . . . . . . . . . . 57
Install/Replace a Low-profile PCIe Card . . . . . . . . . . . . . . . . 57
A BIOS Error Codes . . . . . . . . . . . . . . . . . . . . . . . 59
B System Operating and Regulatory Overview . . . . . . . . . . . . . . . . 61
Environmental Specifications . . . . . . . . . . . . . . . . . . . . 61
System Input Requirements . . . . . . . . . . . . . . . . . . . . . 62
Power Supply. . . . . . . . . . . . . . . . . . . . . . . . . 62
Regulatory Compliance . . . . . . . . . . . . . . . . . . . . . . 63

007-6388-001 ix
About This Guide
This guide provides an overview of the installation, architecture, general operation, and
descriptions of the major components in the SGI®Rackable™C1104-GP2/C1110-GP2 server. It
also provides basic troubleshooting and maintenance information, BIOS error code information,
and important safety and regulatory specifications. Note that the C1104-GP2 and C1110-GP2 are
functionally the same, they differ only in drive slot capacity and size of drive used. The
C1104-GP2 uses up to four 3.5-inch hard-disk or SSD drives; the C1110-GP2 servers use up to
ten 2.5-inch hard-disk or SSD drives.
Audience
This guide is written for users of SGI Rackable C1104-GP2/C1110-GP2 server systems. It is
written with the assumption that the reader has a good working knowledge of computers and
computer systems. This guide may be useful to installers and system administrators looking for
overview information on the server.
Chapter Descriptions
The following topics are covered in this guide:
• Chapter 1, “Introduction”
Provides an overview of the server’s components.
• Chapter 2, “Server Installation”
Provides a quick setup checklist to get the server operational.
• Chapter 3, “System Interface”
Describes several LEDs on the control panel as well as others on the SATA drive carriers
that keep you constantly informed of the overall status of the system as well as the activity
and health of specific components.
• Chapter 4, “System Safety”
Provides general system safety information.

x007-6388-001
• Chapter 5, “System Severboard Information”
Provides best practice procedures to work with a node board in a C1104-GP2/C1110-GP2
chassis, install memory DIMMs, PCIe expansion cards and hard disk drives.
• Chapter 6, “Basic Troubleshooting and Chassis Service”
Describes some basic steps required to troubleshoot your system. Additional sections in this
chapter are intended to guide you through basic component remove and replace procedures.
•Appendix A, “BIOS Error Codes,”
Provides a brief listing of BIOS error code information.
• Appendix B, “System Specifications,”
Describes system component, environmental, and compliance specifications.
Related Publications
The following SGI documents may be relevant to the use of your server:
• SGI Foundation Software release notes
• SGI Performance Suite release notes
• SGI InfiniteStorage series documentation
• Man pages
You can obtain SGI documentation, release notes, or man pages in the following ways:
• Refer to the SGI Technical Publications Library at http://docs.sgi.com. Various formats are
available. This library contains the most recent books and man pages.
• Refer to the SGI Supportfolio™ webpage for release notes and other documents whose
access require a support contract. See “Product Support” on page xi.

:
007-6388-001 xi
Conventions
The following conventions are used throughout this document:
Product Support
SGI provides a comprehensive product support and maintenance program for its products. SGI
also offers services to implement and integrate Linux applications in your environment.
• Refer to http://www.sgi.com/support/
• If you are in North America, contact the Technical Assistance Center at
[phone]SGI or contact your authorized service provider.
• If you are outside North America, contact the SGI subsidiary or authorized distributor in
your country.
Convention Meaning
Command This fixed-space font denotes literal items such as commands, files,
routines, path names, signals, messages, and programming language
structures.
variable The italic typeface denotes variable entries and words or concepts being
defined. Italic typeface is also used for book titles.
user input This bold fixed-space font denotes literal items that the user enters in
interactive sessions. Output is shown in nonbold, fixed-space font.
[ ] Brackets enclose optional portions of a command or directive line.
... Ellipses indicate that a preceding element can be repeated.
man page(x) Man page section identifiers appear in parentheses after man page names.
GUI element This font denotes the names of graphical user interface (GUI) elements such
as windows, screens, dialog boxes, menus, toolbars, icons, buttons, boxes,
fields, and lists.

xii 007-6388-001
Reader Comments
If you have comments about the technical accuracy, content, or organization of this document,
contact SGI. Be sure to include the title and document number of the manual with your comments.
(Online, the document number is located in the front matter of the manual. In printed manuals, the
document number is located at the bottom of each page.)
You can contact SGI in any of the following ways:
• Send e-mail to the following address: t[email protected]
• Contact your customer service representative and ask that an incident be filed in the SGI
incident tracking system:
http://www.sgi.com/support/supportcenters.html
SGI values your comments and will respond to them promptly.

007-6388-001 1
Chapter 1
1. Introduction
Important: SGI Rackable server systems may sometimes require driver versions that are not
included in the original operating system release. When required, SGI provides these drivers on
an SGI Driver CD, which may ship with the system, or on the system disk (pre-installed in the
factory). For more information on this topic check with your sales or service representative.
The Rackable C1104-GP2/C1110-GP2 server is a 1U rackmount system (see Figure 1-1 on page 2
for an example).
In addition to the serverboard and chassis, various hardware components may be included with
the system, as listed:
• Eight 4-cm chassis fans
• One internal air shroud
• Two passive 1U CPU heatsinks
• Riser cards as follows:
– One riser for two internal PCIe 3.0 x16 cards, (full-height cards)
– One riser that supports a low-profile PCIe 3.0 x8 card (external-facing rear card) and
one internal PCIe 3.0 x8 low-profile card
• Power cables for PCI cards
• SATA/SAS drive accessories:
– One SATA/SAS backplane
– Four 3.5-inch hot-swap disk drive carriers (RAID must be enabled for hot swap)
or
– Ten 2.5-inch hot-swap disk drive carriers (RAID must be enabled for hot swap)
• Optional CD/DVD drive (with C1104-GP2 model only)
• Two power supplies
• One rackmount kit

2007-6388-001
1: Introduction
Tip: The Rackable C1110-GP2 (ten-drive chassis) server does not use an internal CD/DVD drive.
Check with your SGI sales or service representative for information on optional external CD/DVD
drive units. The 10-drive version of the server (C1110-GP2 is shown in Figure 1-1).
Figure 1-1 Rackable C1110-GP2 Server Front and Rear View Example
Note: Check with your SGI sales or service representative for the latest information on optional
PCIe cards available for this server.
VGA Port
Ethernet LAN Ports IPMI LAN Port
USB Ports
Control Panel
Disk Drives (10)
COM Port
UID
Power Supplies (2)
Front
Back

Server Board Features
007-6388-001 3
Server Board Features
At the heart of the system is a dual-processor serverboard based on the Intel C612 platform
controller hub (PCH) chipset and designed to provide maximum performance. The main features
of the serverboard are described in the following subsections.
Processors
The serverboard supports two multi-core Intel®Xeon™ E5-2600(v3) Series processors. Each
processor sits in an LGA 2011 socket and is interconnected via double Intel QuickPath
Interconnect (QPI) link support; see the next subsection for more information on the QPI
interconnects. Twelve DDR4 DIMM slots are available per CPU socket with three DIMM slots
per channel. A direct media interface connects the node’s PCH ASIC to processor 1; while 40-lane
Gen-3 PCIe interconnect lines link both processors directly to the motherboard LAN ports.
QPI Interconnect
Double QPI link pairs connect the two processors together on the motherboard, providing
processor-controlled transfer bandwidths of up to 9.6 GB/second per QPI link between sockets.
Each QPI comprises two 20-lane point-to-point data links, one in each direction (full duplex), with
a separate clock pair in each direction, for a total of 42 signals. Each signal is a differential pair,
so the total number of pins is 84. The 20 data lanes are divided onto four “quadrants” of 5 lanes
each. The basic unit of transfer is the 80-bit “flit”, which is transferred in two clock cycles (four
20 bit transfers, two per clock.) The 80-bit “flit” has 8 bits for error detection, 8 bits for “link-layer
header” and 64 bits for “data”. QPI bandwidths are advertised by computing the transfer of 64 bits
(8 bytes) of data every two clock cycles in each direction
Memory
The serverboard has 24 DIMM slots (twelve per processor) that support DDR4
2133/1866/1600/1333 MHz (L)RDIMMs. Up to three DIMMs per channel are supported.
Important: Use of three DIMMs per channel will limit the DIMMs to run at 1600 MHz
maximum. Always use DIMMs that are the same type and speed for best performance.
Note also that memory speed support is dependent on the type of CPUs used on the mother board.

4007-6388-001
1: Introduction
Serial ATA and Optional SAS
The Intel PCH C612 is integrated into the system serverboard to provide an internal four-port or
ten-port SATA disk subsystem. The drive ports are SATA 3.0 ports. The hot-swappable SATA
drives are connected to a backplane that provides power, bus termination and configuration
settings. Optional RAID 0, 1, 5, 6 and 10 are supported. Note that your operating system must have
RAID support enabled to accommodate hot swapping of disk drives.
SAS RAID drive configurations require use of optional hardware ordered when the system is
purchased. Check with your sales or service representative to obtain information on set-up
procedures if your system did not come pre-configured with SATA or SAS RAID.
PCI Express Expansion Slots
The dual processor serverboard has two PCIe 3.0 x16 slots to support internal double-width PCIe
cards. Another PCIe riser at the rear of the server supports one external-facing PCIe 3.0 x8
low-profile card and one internal low-profile PCIe 3.0 x8 card.
See the section “PCIe Expansion Cards” in Chapter 5 for more information on these topics.
Onboard Controllers/Ports
The color-coded I/O ports include (an internal COM header located on the serverboard), VGA
(monitor) port, RJ45 LAN ports and two external USB 3.0 ports. A dedicated external IPMI LAN
port is also included.
Onboard Graphics Controller
The dual-processor serverboard features an integrated Aspeed AST2400 video controller
providing a DDR3 2D video graphics interface through the system VGA connector. The AST
video controller in the 1U server features PCIe 1x support, advanced BMC features, low power
consumption, high reliability and 1920 x 1200 60Hz display capability.
IPMI
IPMI (Intelligent Platform Management Interface) is a hardware-level interface specification that
provides remote access, monitoring and administration for your SGI C1104-GP2/C1110-GP2

Server Chassis Features
007-6388-001 5
server platforms. IPMI allows server administrators to view a server’s hardware status remotely,
receive an alarm automatically if a failure occurs, and power cycle a system that is non-responsive.
Other Features
Other on-board features that promote system health include on-board voltage monitors, a chassis
intrusion header, auto-switching voltage regulators, chassis and CPU overheat sensors, virus
protection and BIOS rescue.
Server Chassis Features
The following subsections provide a general outline of the main features of the SGI Rackable
C1104-GP2/C1110-GP2 server chassis.
System Power
The Rackable C1104-GP2/C1110-GP2 1U server chassis features a redundant power supply
composed of two separate power modules. This power redundancy feature allows you to replace
a failed power supply without shutting down the system. Note that each power supply provides up
to 750 Watts of power to the system.
Serial ATA Subsystems
The server chassis supports up to four 3.5-in or ten 2.5-inch SATA drives. Chassis drives are SATA
3.0 6-Gb/second slots. RAID 0, 1, 5, 6 and 10 drives are hot-swappable units and are connected
to a backplane that provides power and control. Note that the operating system you have installed
must support RAID to enable the hot-swap capability of RAID drives. Certain RAID levels may
require use of optional hardware or software to support RAIDed hard disk drives in the server. Use
of certain RAID combinations may limit the number of drives in an array.
Front Control Panel
The control panel on the C1104-GP2/C1110-GP2 server provides you with system monitoring and
control. LEDs that indicate system power, HDD activity, network activity, system overheat and a

6007-6388-001
1: Introduction
system overheat/fan-fail/ UID LED. A main power button and a system reset button are also
included.
Serverboard and PCIe Subsystem
The C1104-GP2/C1110-GP2 server chassis is an ATX form factor chassis designed to be used in
a 1U rackmount configuration. The serverboard’s I/O backplane supports up to three standard size
(double-width) and one half-height PCIe cards which can offer optional computing solutions. A
15-pin VGA port, two USB 3.0 ports, Gigabit LAN ports and a dedicated RJ-45 IPMI LAN port
are also supported.
Important: Check with your SGI sales or service representative prior to using any PCIe device
not sourced from the SGI factory or documented by SGI as a supported option.
Figure 1-2 on page 7 shows a general block diagram of the C1104-GP2/C1110-GP2 server’s
processor and I/O chipset.
Cooling System
The 1U server chassis has a cooling design that includes ten internal 4-cm counter-rotating Pulse
Width Modulated (PWM) system cooling fans located in the chassis. An air shroud channels the
airflow from the system fans to efficiently cool the processor and PCIe areas of the system. Each
power supply module also includes an internal cooling fan. All chassis and power supply fans
operate continuously.

Server Chassis Features
007-6388-001 7
Figure 1-2 Processor, Memory and I/O Chipset System Block Diagram