Supero SUPERSERVER 1018GR-T User manual

SUPER ®
USER’S MANUAL
Revision 1.0
SUPERSERVER®
1018GR-T

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
Manual Revision 1.0
Release Date: December 12, 2014
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2014 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America

3
Preface
Preface
About this Manual
This manual is written for professional system integrators and PC technicians. It
provides information for the installation and use of the SuperServer. Installation and
maintainance should be performed by experienced technicians only.
Please refer to the server specications page on our Web site for updates on
supported memory, processors and operating systems (http://www.supermicro.
com).
Notes
For your system to work properly, please follow the links below to download all
necessary drivers/utilities and the user’s manual for your server.
•Supermicro product manuals: http://www.supermicro.com/support/manuals/
•Product drivers and utilities: ftp://ftp.supermicro.com
•Product safety info: http://super-dev/about/policies/safety_information.cfm
If you have any questions, please contact our support team at:
[email protected]
This manual may be periodically updated without notice. Please check the
Supermicro Web site for possible updates to the manual revision level.
Warnings
Special attention should be given to the following symbols used in this manual.
Warning! Indicates high voltage may be encountered when performing
a procedure.
Warning! Indicates important information given to prevent equipment/
property damage or personal injury.

4
SUPERSERVER 1018GR-T Manual
Contents
Chapter 1 Introduction
1-1 Overview ......................................................................................................... 1-1
1-2 Motherboard Features..................................................................................... 1-2
Processors ...................................................................................................... 1-2
Memory ........................................................................................................... 1-2
Serial ATA........................................................................................................ 1-2
PCI Expansion Slots ....................................................................................... 1-2
I/O Ports ......................................................................................................... 1-2
IPMI................................................................................................................. 1-3
1-3 Server Chassis Features ................................................................................ 1-4
System Power................................................................................................. 1-4
SATA Subsystem............................................................................................. 1-4
Front Control Panel......................................................................................... 1-4
Cooling System............................................................................................... 1-4
1-4 GPU Subsystem.............................................................................................. 1-4
1-5 Contacting Supermicro.................................................................................... 1-5
Chapter 2 Installation in a Rack
2-1 Preparing for Setup......................................................................................... 2-1
Choosing a Setup Location............................................................................. 2-1
2-2 Warnings and Precautions.............................................................................. 2-2
Rack Precautions............................................................................................ 2-2
Server Precautions.......................................................................................... 2-2
Rack Mounting Considerations ....................................................................... 2-3
Ambient Operating Temperature ................................................................ 2-3
Reduced Airow ......................................................................................... 2-3
Mechanical Loading ................................................................................... 2-3
Circuit Overloading..................................................................................... 2-3
Reliable Ground ......................................................................................... 2-3
2-3 Installing the System into a Rack .................................................................. 2-4
Identifying the Sections of the Rack Rails...................................................... 2-4
Installing the Optional Inner Rail Extensions.................................................. 2-5
Assembling the Outer Rails ............................................................................ 2-6
Installing the Outer Rails onto the Rack......................................................... 2-7
Sliding the Chassis onto the Rack Rails......................................................... 2-8
Installing the Server into a Two Post Rack..................................................... 2-9

5
Preface
Chapter 3 System Interface
3-1 Overview ........................................................................................................ 3-1
3-2 Control Panel Buttons ..................................................................................... 3-2
4-3 Control Panel LEDs ........................................................................................ 3-2
Overheating..................................................................................................... 3-3
Overheat Temperature Setting ................................................................... 3-3
Responses.................................................................................................. 3-3
3-4 Drive Carrier LEDs.......................................................................................... 3-4
3-5 Power Supply LEDs ........................................................................................ 3-4
Chapter 4 Standardized Warning Statements for AC Systems
About Standardized Warning Statements....................................................... 4-1
Warning Denition........................................................................................... 4-1
Installation Instructions.................................................................................... 4-4
Circuit Breaker ................................................................................................ 4-5
Power Disconnection Warning ........................................................................ 4-6
Equipment Installation..................................................................................... 4-8
Restricted Area................................................................................................ 4-9
Battery Handling............................................................................................ 4-10
Redundant Power Supplies (if applicable to your system)........................... 4-12
Backplane Voltage (if applicable to your system)......................................... 4-13
Comply with Local and National Electrical Codes........................................ 4-14
Product Disposal........................................................................................... 4-15
Hot Swap Fan Warning (if applicable to your system) ................................. 4-16
Power Cable and AC Adapter ...................................................................... 4-18
Chapter 5 Advanced Motherboard Setup
5-1 Handling the Motherboard .............................................................................. 5-1
Precautions ..................................................................................................... 5-1
Unpacking ....................................................................................................... 5-1
5-2 Connecting Cables.......................................................................................... 5-2
Connecting Data Cables ................................................................................. 5-2
Connecting Power Cables .............................................................................. 5-2
Connecting the Control Panel......................................................................... 5-2
5-3 I/O Ports.......................................................................................................... 5-3
5-4 Installing the Processor and Heatsink ............................................................ 5-4
Installing an LGA 2011 Processor................................................................... 5-4
Installing the CPU Heatsink ............................................................................ 5-7
Removing the Heatsink .................................................................................. 5-7

6
SUPERSERVER 1018GR-T Manual
5-5 Installing Memory............................................................................................ 5-8
DIMM Installation ............................................................................................ 5-8
Removing Memory Modules ........................................................................... 5-8
Memory Support.............................................................................................. 5-9
Memory Population Guidelines ..................................................................... 5-10
5-6 Expansion Cards............................................................................................5-11
5-7 Motherboard Details...................................................................................... 5-12
Motherboard Quick Reference...................................................................... 5-13
5-8 Connector Denitions ................................................................................... 5-15
Power Connectors......................................................................................... 5-15
5-9 Jumper Settings ............................................................................................ 5-22
5-10 Onboard Indicators........................................................................................ 5-24
5-11 SATA Ports .................................................................................................... 5-25
5-12 Installing Software......................................................................................... 5-26
SuperDoctor®5 ............................................................................................. 5-27
5-13 Serverboard Battery...................................................................................... 5-28
Chapter 6 Advanced Chassis Setup
6-1 Static-Sensitive Devices.................................................................................. 6-1
Precautions ..................................................................................................... 6-1
6-2 Removing Power from the System ................................................................. 6-2
6-3 Removing the Chassis Cover ......................................................................... 6-3
6-4 System Cooling............................................................................................... 6-4
System Fan Failure......................................................................................... 6-5
Maintaining System Fan Trays........................................................................ 6-5
Installing the Air Shroud.................................................................................. 6-7
6-5 Installing Expansion Cards ............................................................................. 6-8
6-6 Drive Bay Installation/Removal ..................................................................... 6-10
Hard Drive Installation................................................................................... 6-10
6-7 Power Supply................................................................................................ 6-12
Chapter 7 BIOS .........................................................................................7-1
7-1 Introduction...................................................................................................... 7-1
Starting BIOS Setup Utility.............................................................................. 7-1
How To Change the Conguration Data ......................................................... 7-1
How to Start the Setup Utility ......................................................................... 7-2
7-2 Main Setup...................................................................................................... 7-2
7-3 Advanced Setup Congurations...................................................................... 7-4
7-4 Event Logs .................................................................................................... 7-36
7-5 IPMI............................................................................................................... 7-38

7
Preface
7-6 Security Settings ........................................................................................... 7-41
7-7 Boot Settings................................................................................................. 7-42
7-8 Save & Exit ................................................................................................... 7-45
Appendix A BIOS POST Error Codes .................................................... A-1
Appendix B System Specications ........................................................ B-1

8
SUPERSERVER 1018GR-T Manual
Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Web Site: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Web Site: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Email: [email protected]
Web Site: www.supermicro.com.tw

Chapter 1
Introduction
1-1 Overview
The SuperServer 1018GR-T is a GPU-optimized server comprised of two
main subsystems: the SC118G-1K43BP 1U server chassis and the X10SRG-F
motherboard. Refer to our web site to learn which operating systems have been
certied for use with this system (www.supermicro.com).
•SATA Accessories
One SAS backplane (BPN-SAS-118TQ)
Six 2.5" drive carriers (MCP-220-00047-0B)
SATA cables (four CBL-0484L; two CBL-SAST-0624)
•Eight 4-cm counter-rotating fans (FAN-0141L4)
•One air shroud (MCP-310-81802-0B)
•One passive CPU heatsink (SNK-P0047PS)
•Riser Cards
One for PCIe x8 low-prole card, above motherboard (RSC-R1U-E16R)
One for PCIe x16 card, left side (RSC-R1UG-E16-UP)
One for PCIe x16 card, right side (RSC-R1UG-E16R-UP)
•Power cable for GPU cards, one 8 pin to two 6+2 pin (CBL-PWEX-0582)
•One rail set (MCP-290-00054-0N)
For your system to work properly, please follow the links below to download all
necessary drivers/utilities and the user’s manual for your server.
•Supermicro product manuals: http://www.supermicro.com/support/manuals/
•Product drivers and utilities: ftp://ftp.supermicro.com
•Product safety info: http://super-dev/about/policies/safety_information.cfm
If you have any questions, please contact our support team at:
[email protected].
Chapter 1: Introduction
1-1

1-2
SUPERSERVER 1018GR-T User's Manual
1-2 Motherboard Features
At the heart of the 1018GR-T SuperServer is the X10SRG-F, a single processor
motherboard based on the Intel C612 Express chipset. Below are the main features
of the system (See Figure 1-1 for a block diagram of the motherboard).
Processors
The motherboard supports a single Intel E5-2600/1600 Series processor in
LGA 2011 Socket 3. Please refer to the motherboard description pages on
the Supermicro web site for a complete listing of supported processors (www.
supermicro.com).
Memory
The motherboard has eight DIMM slots that can support up to 256GB RDIMM or
512 LRDIMM of DDR4 ECC memory at 1333/1600/2133 MHz. Modules of the same
size and speed are recommended. DIMM sizes are 2GB, 4GB, 8GB, 16GB, 32GB,
64GB. See Chapter 5 for details.
Serial ATA
Two SATA3 controllers are integrated into the chipset to provide a 10-port SATA
subsystem. The sSATA controller supports four SATA drives and the AHCI controller
can support six SATA drives. RAID 0, 1, 5 and 10 are supported, although RAID
cannot be congured across the drives controlled by different controllers. Note:
The operating system you use must have RAID support to enable the hot-swap
capability and RAID function.
The server also supports two SATA DOM ports.
PCI Expansion Slots
The motherboard has two PCI-Express 3.0 x16 slots to support two double-width
GPU cards. An additional slot supports one PCI-Express 3.0 x8 low-prole card.
I/O Ports
The rear I/O ports include two Gb Ethernet LAN ports, one dedicated IPMI LAN
port, two USB 3.0 ports, one COM port, and a VGA (monitor) port
Internal headers include two additional USB 3.0 ports, ve USB 2.0 ports (four via
headers, one via eUSB) and one COM port.

1-3
Chapter 1: Introduction
SPI
LAN3
RGRMII
Debug Card
FRONT PANEL
SYSTEM POWER
CTRL
FAN SPEED
PCI-E X1 Gen2
USB 2.0
#13 USB2.0
PCH
6.0 Gb/S
USB 2.0
LPC
USB
1
0
SATA
5
4
RTL8211E-VB-CG
3
2
RJ45
BIOS
SPI
SPI
Temp Sensor
W83773G at SMBUS
RT1/RT2
TPM HEADER
AST2400
BMC
#3
RMII/NCSI
COM1
Connector
COM2
Header
VGA CONN
BMC Boot Flash
DDR3
5 PHASE
145W
VR12.5
PCI-E X8 Gen3
DMI2
PCI-E X16 Gen3
PCI-E X16 Gen3
DMI2
Skt-R3
LGA2011-3
#3
I350
LAN
PCI-E X4 Gen2
#1 #2
6789
1333/1600/2133
#0-4
#0-3
#0-2
#0-1
DDRIV
1333/1600/2133
DDRIV
#0-8
#0-7
#0-6
#0-5
SLOT1 PCIe3.0 x16
PCIe3.0 x16
SLOT2
SLOT3
PCIe3.0 x8
(x8 in x16)
234567
RJ45
RJ45 #5/6/7/8
USB 3.0
USB
5
4
2
1
MUX
SPI
Figure 1-1. Intel C612 Express Chipset Block Diagram
Note: This is a general block diagram. Please see Chapter 5 for details.
IPMI
IPMI (Intelligent Platform Management Interface) is a hardware-level interface
specication that provides remote access, monitoring and administration for
Supermicro server platforms. IPMI allows server administrators to view a server’s
hardware status remotely, receive an alarm automatically if a failure occurs, and
power cycle a system that is non-responsive.

1-4
SUPERSERVER 1018GR-T User's Manual
1-3 Server Chassis Features
System Power
The SC118G-1K43BP chassis features a high-efciency 1400W power supply.
SATA Subsystem
The chassis includes six 2.5" drive bays, which may be used to house hot-
swappable SATA drives.
Front Control Panel
The control panel provides a system monitoring and control interface. LEDs indicate
system power, HDD activity, network activity, and a system overheat/fan-fail/UID
LED. A main power button and a system reset button are also included.
Cooling System
The chassis has an innovative cooling design that includes eight sets of back-to-
back 4-cm counter-rotating PWM (Pulse Width Modulated) fans. The power supply
modules also include a cooling fan. All chassis and power supply fans operate
continuously. An air shroud is included to further help cool the GPUs.
1-4 GPU Subsystem
The 1018GR-T server represents one of Supermicro's massively parallel processing
multiple-GPU servers, with support for up to two NVIDIA Kepler GPUs, which place
this system at the forefront of today's GPU computing solutions.
Please refer to the NVIDIA web site (www.nvidia.com) for details on GPUs.
Two GPUs can be bundled with the system. See chapter 6 for installation procedures.

1-5
Chapter 1: Introduction
1-5 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Web Site: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Web Site: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Email: [email protected]
Web Site: www.supermicro.com.tw

1-6
SUPERSERVER 1018GR-T User's Manual
Notes

Chapter 2: Installation in a Rack
Chapter 2
Installation in a Rack
This chapter provides instructions for mounting your chassis in a rack.
2-1 Preparing for Setup
The box in which your system was shipped should include two sets of rail
assemblies, two rail mounting brackets and the mounting screws to mount the
system into the rack. Please read this chapter in its entirety before beginning the
installation procedure.
Choosing a Setup Location
Decide on a suitable location for the rack unit that will hold your system. It should
be a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical
noise and electromagnetic elds are generated. A nearby grounded power outlet.
is required
•Leave at least 25 inches clearance in front of the rack to open the front door
completely.
•Leave approximately 30 inches of clearance in the back of the rack to allow for
sufcient airow and access for servicing.
•It should be a restricted access location, such as a dedicated equipment room
or a service closet.
2-1

SUPERSERVER 1018GR-T User's Manual
2-2
2-2 Warnings and Precautions
Rack Precautions
•Ensure that the leveling jacks on the bottom of the rack are fully extended to
the oor with the full weight of the rack resting on them.
•In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
•Always make sure the rack is stable before extending a component from the
rack.
•You should extend only one component at a time - extending two or more
simultaneously may cause the rack to become unstable.
Server Precautions
•Review the electrical and general safety precautions in Chapter 4.
•Determine the placement of each component in the rack before you install the
rails.
•Install the heaviest server components on the bottom of the rack rst, and then
work up.
•Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
•Allow the hot plug SAS drives and power supply modules to cool before touching
them.
•Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.

2-3
Chapter 2 Installation in a Rack
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating
temperature of the rack environment may be greater than the ambient temperature
of the room. Therefore, consideration should be given to installing the equipment
in an environment compatible with the manufacturer’s maximum rated ambient
temperature (Tmra).
Reduced Airow
Equipment should be mounted into a rack so that the amount of airow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack
itself should be grounded. Particular attention should be given to power supply
connections other than the direct connections to the branch circuit (i.e. the use of
power strips, etc.).
To prevent bodily injury when mounting or servicing this unit in a rack, you
must take special precautions to ensure that the system remains stable.
The following guidelines are provided to ensure your safety:
•This unit should be mounted at the bottom of the rack if it is the only unit
in the rack.
•When mounting this unit in a partially lled rack, load the rack from the
bottom to the top with the heaviest component at the bottom of the rack.
•If the rack is provided with stabilizing devices, install the stabilizers before
mounting or servicing the unit in the rack.
•Slide rail mounted equipment is not to be used as a shelf or a work space.

SUPERSERVER 1018GR-T User's Manual
2-4
2-3 Installing the System into a Rack
This section provides information on installing the chassis into a rack unit with the
rails provided. There are a variety of rack units on the market, which may mean
that the assembly procedure differs slightly. You should also refer to the installation
instructions that came with the rack unit you are using.
Note: These rails will t a rack between 25.6" and 33" deep.
Identifying the Sections of the Rack Rails
The chassis package includes two sets of rack rails, one set for the right side of the
chassis and one for the left. Each set consists of an inner rail that is xed directly
to the chassis and an outer rail that attaches to the rack.
The inner rails are pre-attached and do not interfere with normal use of the chassis
if you decide not to install it into a rack.
Figure 2-1. Identifying the Sections of the Rack Rails
Inner Rail
Extension--
attach to the
chassis
Outer Rails--
slide together
Inner Rail--
pre-attached to the
chassis
Front and Rear
Brackets--
attach to the rack

2-5
Chapter 2 Installation in a Rack
Figure 2-2. Installing the Inner Rail Extension
Installing the Optional Inner Rail Extensions
Attaching the optional inner rail extensions allows you to pull the server farther out
of the rack. Do not put downward force on the chassis when it is fully extended.
Installing the Inner Rail Extensions
1. Place the inner rail extensions at the side of the chassis. Align the holes of the
inner rail extension with the hooks on the side of the chassis. Make sure the
extension faces outward like the inner rail.
2. Slide the extension toward the front of the chassis and under the hooks until the
quick release bracket snaps into place, securing the extension to the chassis.
3. If desired, you can install a screw to further secure the extention to the chassis.
4. Repeat for the other inner rail extension.
Chassis Front

SUPERSERVER 1018GR-T User's Manual
2-6
Figure 2-3. Assembling the Outer Rails
Assembling the Outer Rails
Each outer rail comes in two sections that must be assembled before mounting
onto the rack.
Assembling the Outer Rails
1. Identify the left and right outer rails by examining the ends, which bend outward.
Match the left front outer rail with the left rear outer rail and the same for the
right rails.
2. Align the round post in the rear rail (B) with the round hole at the end of the slot
in the front rail (A), and slide the front section into the rear section.
Outer rail assembled
Secure to the
front of the rack
Secure to the
rear of the rack
Slide outer rails
together
Assembling the sections of
the outer rail
1
A
1
B
Round Hole
Bracket with
Square Pegs