Silicon Graphics Rackable C1110-RP6 User manual

SGI®Rackable™C1110-RP6
System User Guide
007-5843-002

COPYRIGHT
© 2012, 2013 Silicon Graphics International Corp. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No
permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part,
without the prior written permission of SGI.
LIMITED RIGHTS LEGEND
The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any
contractor thereto, it is acquired as "commercial computer software" subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR
12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto.
Contractor/manufacturer is Silicon Graphics, International, Inc., 46600 Landing Parkway, Freemont, CA 94538.
TRADEMARKS AND ATTRIBUTIONS
Silicon Graphics, SGI, the SGI logo, Rackable, and Supportfolio are trademarks or registered trademarks of Silicon Graphics International Corp. or its
subsidiaries in the United States and other countries.
Intel, Intel QuickPath Interconnect (QPI) and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and
other countries.
Infiniband is a trademark of the InfiniBand Trade Association.
Linux is a registered trademark of Linus Torvalds.
Novell is a registered trademark of Novell Inc., in the United States and other countries.
PCIe and PCI-X are registered trademarks of PCI SIG.
Red Hat and Red Hat Enterprise LINUX are registered trademarks of Red Hat Inc.
TYAN is a registered trademark of MiTAC International Corporation.
UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.
All other trademarks mentioned herein are the property of their respective owners.

:
007-5843-002 iii
Record of Revision
Version Description
001 October 2012
Original publication
002 September 2013
Added support for Intel®Xeon®E5-2600 and E5-2600v2 Series processors plus
miscellaneous front matter changes.

007-5843-002 v
Contents
Record of Revision . . . . . . . . . . . . . . . . . . . . . . . iii
About This Guide . . . . . . . . . . . . . . . . . . . . . . . ix
Audience. . . . . . . . . . . . . . . . . . . . . . . . . . ix
Related Publications. . . . . . . . . . . . . . . . . . . . . . . x
Product Support . . . . . . . . . . . . . . . . . . . . . . . . xi
Reader Comments . . . . . . . . . . . . . . . . . . . . . . . xi
1 Introduction and Overview . . . . . . . . . . . . . . . . . . . . 1
ESD and Safety Precautions. . . . . . . . . . . . . . . . . . . . . 1
System Overview . . . . . . . . . . . . . . . . . . . . . . . 2
Serverboard Features . . . . . . . . . . . . . . . . . . . . . 3
Processors . . . . . . . . . . . . . . . . . . . . . . . 3
Quick Path Interconnect (QPI). . . . . . . . . . . . . . . . . . 3
Memory . . . . . . . . . . . . . . . . . . . . . . . 4
Serial ATA/SAS . . . . . . . . . . . . . . . . . . . . . 4
PCI Expansion Slots . . . . . . . . . . . . . . . . . . . . 4
On-board Controllers/Ports . . . . . . . . . . . . . . . . . . 4
IPMI . . . . . . . . . . . . . . . . . . . . . . . . . 5
Other Features . . . . . . . . . . . . . . . . . . . . . . . 5
BMC Features . . . . . . . . . . . . . . . . . . . . . . . 5
PCIe Sub-system . . . . . . . . . . . . . . . . . . . . . . 6
Server Chassis Features . . . . . . . . . . . . . . . . . . . . . . 7
System Power . . . . . . . . . . . . . . . . . . . . . . . 7
Disk Drive Subsystem . . . . . . . . . . . . . . . . . . . . . 7
Control Panel . . . . . . . . . . . . . . . . . . . . . . . 8
Cooling System . . . . . . . . . . . . . . . . . . . . . . . 8

vi 007-5843-002
Contents
2 System Operation . . . . . . . . . . . . . . . . . . . . . . . 9
Unpacking the System and Choosing an Operating Location . . . . . . . . . . . . 9
Preparing for Setup . . . . . . . . . . . . . . . . . . . . . . 9
Choosing a Setup Location . . . . . . . . . . . . . . . . . . . 9
Rack Precautions . . . . . . . . . . . . . . . . . . . . . . 10
Server Precautions . . . . . . . . . . . . . . . . . . . . . . 10
Rack Mounting Considerations . . . . . . . . . . . . . . . . . . . 11
Ambient Operating Temperature . . . . . . . . . . . . . . . . . 11
Reduced Airflow . . . . . . . . . . . . . . . . . . . . . 11
Mechanical Loading . . . . . . . . . . . . . . . . . . . . 11
Circuit Overloading. . . . . . . . . . . . . . . . . . . . . 11
Reliable Ground . . . . . . . . . . . . . . . . . . . . . 11
System Warnings and Precautions . . . . . . . . . . . . . . . . . . . 12
Installing the System into a Rack . . . . . . . . . . . . . . . . . . . 13
Identifying the Sections of the Rack Rails . . . . . . . . . . . . . . . . 13
Installing the Inner Rails . . . . . . . . . . . . . . . . . . . . 14
Installing the Outer Rails . . . . . . . . . . . . . . . . . . . . 14
Locking Tabs . . . . . . . . . . . . . . . . . . . . . . . 15
Installing the Server into the Rack . . . . . . . . . . . . . . . . . . 16
Installing the Server into a Telco Rack . . . . . . . . . . . . . . . . . 17
Server Access After Rack Installation . . . . . . . . . . . . . . . . . 17
Remove/Replace the Chassis Top Covers . . . . . . . . . . . . . . . 18
Checking the Components and Setup Before Power On . . . . . . . . . . . . 20
Checking the Hard Disk Drives . . . . . . . . . . . . . . . . . . . 20
Checking the Airflow . . . . . . . . . . . . . . . . . . . . . 20
Providing Power. . . . . . . . . . . . . . . . . . . . . . . 20

Contents
007-5843-002 vii
3 System Interfaces Overview . . . . . . . . . . . . . . . . . . . . 23
System Interface Overview . . . . . . . . . . . . . . . . . . . . . 23
Control Panel Buttons . . . . . . . . . . . . . . . . . . . . . 24
Control Panel LEDs . . . . . . . . . . . . . . . . . . . . . 24
HDD . . . . . . . . . . . . . . . . . . . . . . . . 25
Power . . . . . . . . . . . . . . . . . . . . . . . . 25
Universal Information LED . . . . . . . . . . . . . . . . . . 25
Disk Drive Carrier LEDs . . . . . . . . . . . . . . . . . . . . 25
4 Internal Component Replacement and Upgrades . . . . . . . . . . . . . . 27
General Precautions . . . . . . . . . . . . . . . . . . . . . . . 27
Installing System DIMM Memory . . . . . . . . . . . . . . . . . . . 27
Installing Memory DIMMs. . . . . . . . . . . . . . . . . . . . 29
Adding PCIe Cards . . . . . . . . . . . . . . . . . . . . . . . 30
System Fans. . . . . . . . . . . . . . . . . . . . . . . . 31
System Fan Failure. . . . . . . . . . . . . . . . . . . . . 31
Drive Bay Installation/Removal . . . . . . . . . . . . . . . . . . 31
Disk Drive Removal and Installation . . . . . . . . . . . . . . . . . . 31
Mounting a Drive in a Carrier . . . . . . . . . . . . . . . . . . . 32
Installing/Removing Hot-swap Drives . . . . . . . . . . . . . . . . . 32
Power Supply . . . . . . . . . . . . . . . . . . . . . . . . 34
Power Supply Failure . . . . . . . . . . . . . . . . . . . . . 35
Removing the 650-Watt Redundant Power Supply . . . . . . . . . . . . . 35
Installing a New 650-Watt Redundant Power Supply . . . . . . . . . . . . . 37
Removing the 450-Watt Non-Redundant Power Supply . . . . . . . . . . . . 38
Installing the 450-Watt Non-Redundant Power Supply . . . . . . . . . . . . 40

viii 007-5843-002
Contents
A System Specifications . . . . . . . . . . . . . . . . . . . . . . 41
Processors . . . . . . . . . . . . . . . . . . . . . . . . . 41
I/O Chipset . . . . . . . . . . . . . . . . . . . . . . . . . 41
BIOS . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Memory Capacity . . . . . . . . . . . . . . . . . . . . . . . 41
Disk Drive Controller . . . . . . . . . . . . . . . . . . . . . . 42
Drive Bays . . . . . . . . . . . . . . . . . . . . . . . . . 42
Expansion Slots . . . . . . . . . . . . . . . . . . . . . . . . 42
Serverboard . . . . . . . . . . . . . . . . . . . . . . . . . 42
Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Weight . . . . . . . . . . . . . . . . . . . . . . . . . . 43
System Cooling . . . . . . . . . . . . . . . . . . . . . . . . 43
System Input Requirements . . . . . . . . . . . . . . . . . . . . . 43
Power Supply. . . . . . . . . . . . . . . . . . . . . . . . . 43
Environmental Specifications . . . . . . . . . . . . . . . . . . . . 44
Regulatory Compliance . . . . . . . . . . . . . . . . . . . . . . 45

007-5843-002 ix
.About This Guide
This guide provides an overview of the SGI®Rackable™ C1110-RP6 servers along with
instructions for system installation and general operation. The appendices include technical
specifications and safety practices.
Audience
This guide is written for owners, installers, system administrators, and users of C1110-RP6
servers. It is written with the assumption that the reader has a good working knowledge of
computers and computer systems.

x007-5843-002
About This Guide
Related Publications
Depending on your choice of system components and operating system, the following SGI
documents may be relevant to your server:
• SGI Foundation Software release notes
• SGI Performance Suite release notes
• SGI InfiniteStorage series documentation
• Man pages
You can obtain SGI documentation, release notes, or man pages in the following ways:
• Refer to the SGI Technical Publications Library at http://docs.sgi.com. Various formats are
available. This library contains the most recent set of books and man pages.
• Refer to the SGI Supportfolio™ webpage for release notes and other documents whose
access require a support contract. See “Product Support” on page xi.
Note: For information on your motherboard and related system components, see the
documentation provided by the manufacturer/supplier.

About This Guide
007-5843-002 xi
Product Support
SGI provides a comprehensive product support and maintenance program for its products. SGI
also offers services to implement and integrate Linux applications in your environment.
• Refer to http://www.sgi.com/support/
• If you are in North America, contact the Technical Assistance Center at
[phone]SGI or contact your authorized service provider.
• If you are outside North America, contact the SGI subsidiary or authorized distributor in
your country.
Be sure to have the following information before you call Technical Support:
• Product serial number
• Product model name and number
• Applicable error messages
• Add-on boards or hardware
• Third-party hardware or software
• Operating system type and revision level
• Motherboard BIOS revision
Reader Comments
If you have comments about the technical accuracy, content, or organization of this document,
contact SGI. Be sure to include the title and document number of the manual with your comments.
(Online, the document number is located in the front matter of the manual. In printed manuals, the
document number is located at the bottom of each page.)
You can contact SGI in any of the following ways:
• Send e-mail to the following address: techpu[email protected]
• Contact your customer service representative and ask that an incident be filed in the SGI
incident tracking system:
http://www.sgi.com/support/supportcenters.html
SGI values your comments and will respond to them promptly.

007-5843-002 1
Chapter 1
1. Introduction and Overview
This chapter provides an overview of your server’s main features.
Operating precautions are provided in this chapter, followed by a general overview of the product.
Before operating your system, familiarize yourself with the safety information that follows:
ESD and Safety Precautions
Caution: Observe all ESD precautions. Failure to do so can result in damage to the equipment.
Wear an approved grounding wrist strap when you handle any ESD-sensitive device to eliminate
possible ESD damage to equipment. Connect the wrist strap cord directly to earth ground.
Warning: Before operating or servicing any part of this product, read the safety
precautions.
Danger: Keep fingers and conductive tools away from high-voltage areas. Failure to
follow these precautions will result in serious injury or death. The high-voltage areas of the
system are indicated with high-voltage warning labels.
Caution: Power off the system only after the system software has been shut down in an orderly
manner. If you power off the system before you halt the operating system, data may be corrupted.
!

2007-5843-002
1: Introduction and Overview
Warning: If a lithium battery is installed in your system as a soldered part, only qualified
SGI service personnel should replace this lithium battery. For a battery of another type,
replace it only with the same type or an equivalent type recommended by the battery
manufacturer, or an explosion could occur. Discard used batteries according to the
manufacturer’s instructions.
System Overview
The SGI®Rackable™ C1110-RP6 system is a compute-optimized server comprised of two main
subsystems: the 1U chassis and a serverboard (motherboard). Check with your sales or service
representative before loading any operating system on your server not provided by the SGI factory
or service organization.
Various hardware components may be included as part of your SGI Rackable C1110-RP6 system
configuration as listed below:
• Serverboard with:
–TwoIntel
®Xeon®E5-2600 or E5-2600v2 Series processors in LGA2011 sockets
– Intel C602 chipset and Quick Path Interconnect system bus support the processors
– Sixteen DDR3 memory DIMM slots
– Two external Gen3 x16 PCIe slots (one full-height and one low-profile)
• Two disk drive configurations include:
– Four 3.5-inch hard disk drives plus DVD option drive
– Ten 2.5-inch hard disk drives (no DVD option available)
• Seven 4-cm counter-rotating cooling fans for the serverboard
• One 450 Watt auto-ranging power supply (with single power connector)
• Optional 650 Watt redundant auto-ranging power supply (with dual power connectors)
Note: The TYAN S7056 serverboard is the standard C1110-RP6 motherboard offering.
Other customized offerings may be available for specific system or clustering needs. Check
with your SGI sales or service representative for additional information.

System Overview
007-5843-002 3
Figure 1-1 Four-Drive C1110-RP6 System Chassis Front View Example
Figure 1-2 Ten-Drive C1110-RP6 System Chassis Front View Example
Serverboard Features
The SGI Rackable C1110-RP6 system has a dual processor serverboard based on the Intel C602
chipset. The following subsections describe the main features of the serverboard. See Figure 1-3
on page 6 for a functional block diagram of the serverboard.
Processors
Each serverboard supports two Intel Xeon series processors. Each processor sits in an LGA2011
socket and is interconnected via Intel QPI link support, see the next subsection for more
information on the QPI bus. Four-core, six-core and eight-core processors are available.
The exact type of processors provided with your system depends on the specific configuration you
ordered. Check with your SGI sales or service representative for information on processor
upgrades.
Quick Path Interconnect (QPI)
Separate QPI link pairs connect the two processors in an 8.0-GT/s network on the serverboard.
Each QPI comprises two 20-lane point-to-point datalinks, onein eachdirection (full duplex), with
a separate clock pair in each direction, for a total of 42 signals. Each signal is a differential pair,
so the total number of pins is 84. The 20 data lanes are divided onto four “quadrants” of 5 lanes
each. The basic unit of transfer is the 80-bit “flit”, which is transferred in two clock cycles (four

4007-5843-002
1: Introduction and Overview
20 bit transfers, two per clock.) The 80-bit “flit” has 8 bits for error detection, 8 bits for “link-layer
header” and 64 bits for “data”. QPI bandwidths are advertised by computing the transfer of 64 bits
(8 bytes) of data every two clock cycles in each direction
Memory
The SGI Rackable C1110-RP6 system has 16 DIMM slots that support registered ECC
DDR3-1600/1333/1066/800 SDRAM. Memory DIMMs of the same size and speed are highly
recommended for best overall system performance. A minimum of two DIMMs are required for
the server to be functional. For best memory performance, install DIMMs in multiples of eight.
See “Installing System DIMM Memory” in Chapter 4, for more details on installing memory.
Serial ATA/SAS
A Serial ATA controller is integrated into the system serverboard to provide a SATA subsystem
with transfer rates up to 6 Gb/second. The optionally hot-swappable SATA drives are connected
to a backplane that provides power, bus termination and configuration settings. Optional SAS or
SATA RAID 0, 1, 5, 6 and 10 are supported (RAID 5 and 6 require optional hardware). Note that
RAID functionality is required for hot-swap capability.
Note: Your operating system must support RAID functionality in order to use RAIDed drives.
The Intel C600 chipset provides BIOS-assisted software RAID only, not hardware RAID.
Hardware RAID support is available as an optional configuration.
Contact your SGI sales or service provider to order a specific RAID upgrade if your system was
not ordered with that option.
PCI Expansion Slots
The serverboard has two external PCI-Express Gen3 x16 slots.One slot is a low-profile form
factor, the other is a (half-length) full-height PCIe slot.
On-board Controllers/Ports
The rear-mounted I/O ports include one COM port, a VGA (monitor) port, two USB 2.0 ports, and
three Gigabit Ethernet ports (LAN3 is a shared IPMI port). A special serial port is included for
system management.

System Overview
007-5843-002 5
IPMI
The IPMI (Intelligent Platform Management Interface) is a hardware-level interface specification
that provides remote access, monitoring and administration for the SGI Rackable C1110-RP6
system. IPMI allows server administrators to view a server’s hardware status remotely, receive an
alarm automatically if a failure occurs, and power cycle a system that is non-responsive.
Other Features
Other on-board features that promote system health include voltage monitors, auto-switching
voltage regulators, chassis and CPU overheat sensors, virus protection and BIOS rescue.
BMC Features
The baseboard management controller (BMC) has the following features:
• The platform management subsystem uses the BMC to communicate with buses, sensors,
system BIOS, and server management firmware via the Server Management Bus (SMBUS)
• Enables serial-over-LAN (SOL) functionality via serial port B only
• Supports serial-console redirection in BIOS
• The BMC LAN may be configured in BIOS or via ipmitool.
• The ipmitool command is used to communicate with the BMC via an SOL session or by
using the web-based BMC interface.

6007-5843-002
1: Introduction and Overview
Figure 1-3 Functional Block Diagram of SGI Rackable C1110-RP6 System Server Board
PCIe Sub-system
The primary I/O bus for the serverboard is PCI Express.

Server Chassis Features
007-5843-002 7
Server Chassis Features
The following sections provide a general outline of the main features of the 1U system chassis.
Figure 1-4 shows an example of the rear panel features of the SGI Rackable C1110-RP6 system.
Figure 1-4 SGI Rackable C1110-RP6 System Rear Panel and I/O Ports
System Power
Your SGI Rackable C1110-RP6 system uses a single-cord high-efficiency 450-Watt cold-swap
power supply (shown on the left side of Figure 1-4). Optionally, a dual-cord 650-Watt redundant
power supply is available. Both types of supply are 80+ Gold rated.
The AC power supply cord(s) should always be removed from the system before servicing or
replacing the power supply.
Disk Drive Subsystem
The SGI Rackable C1110-RP6 system chassis includes four 3.5-inch drive bays or ten 2.5-inch
drive bays. These drives can be JBOD disks,or software RAID, or BIOS-assisted software RAID,
or optional hardware RAID disks. An optional SAS disk controller is also supported.
RAID support levels are as follows:
Low-profile x16 PCIe Slot
LAN1
UID LED
button
LAN2
Power
HDD
activity
IPMI
LAN/LAN3
COM
Port
VGA Port
Full-height x16 PCIe slot
USB
Ports
Serial Port

8007-5843-002
1: Introduction and Overview
• Hardware RAID 0, 1, 10, 5 and 6 (with optional SAS HBA or Megaraid card)
• BIOS-assisted software RAID 0, 1 and 10 when configured as a standalone server
• Linux software RAID 0 and 1 when configured as a compute node
Note: A cluster head node will only support hardware RAID options.
Control Panel
The SGI Rackable C1110-RP6 system control panel provides a system monitoring and control
interface. The main power button included on the control panel will boot-up or shut down the
system when pressed - it does not remove all power inputs to the system. Remove the power
cord(s) from the system power supply if you need to remove power completely. LEDs on the
control panel (from top to bottom) indicate HDD activity, system power status and system UID.
Figure 1-5 SGI Rackable C110-RP6 Control Panel Example
Cooling System
The server chassis has an innovative cooling design that includes seven 4-cm counter-rotating
pulse width modulated (PWM) fans located in the middle section of the chassis. Additional
cooling fans are incorporated into each power supply module. All chassis and power supply fans
operate continuously while the system is on to efficiently cool the processors, memory and other
system components.