Supermicro SUPERSERVER 6028TP-HC1R User manual

USER'S MANUAL
Revision 1.0a
SUPERSERVER®
6028TP-HC1R
6028TP-HC1TR
6028TP-HC1FR

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
Manual Revision 1.0a
Release Date: March 06, 2018
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2014 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America

iii
Preface
Preface
About This Manual
This manual is written for professional system integrators and PC technicians.
It provides information for the installation and use of the SuperServer
6028TP-HC1R/HC1TR/HC1FR. Installation and maintainance should be performed
by experienced technicians only.
The SuperServer 6028TP-HC1R/HC1TR/HC1FR is a high-end server based
on the SC827HQ+-R2K02B 2U rackmount chassis and the dual processor
X10DRT-P/PT/PIBF serverboard. Both models have an IPMI LAN port and four
serverboard nodes with three hot-swap Hard Disk Drives (HDD) each per node.
Manual Organization
Chapter 1: Introduction
           
the server system and describes the main features of the X10DRT-P/PT/PIBF
serverboard and the SC827HQ+-R2K02B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the SuperServer

prior to powering up the system. If your server was ordered without processor and
memory components, this chapter will refer you to the appropriate sections of the
manual for their installation.
Chapter 3: System Interface
Refer here for details on the system interface, which includes the functions and
information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
Chapter 4: Standardized Safety Warnings
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 6028TP-HC1R/HC1TR/HC1FR.
Chapter 5: Advanced Serverboard Setup
Chapter 5 provides detailed information on the X10DRT-P/PT/PIBF serverboard,
including the locations and functions of connections, headers and jumpers. Refer
to this chapter when adding or removing processors or main memory and when


SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
iv
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC827HQ+-R2K02B server
chassis. You should follow the procedures given in this chapter when installing,
          
power supply units and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed information
on running the CMOS Setup Utility.
Appendix A: BIOS Error Beep Codes
Appendix B: System Specications
Appendix C: Chinese Safety Warnings

v
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
Notes

vi
Table of Contents
Chapter 1 Introduction
1-1 Overview ......................................................................................................... 1-1
1-2 Serverboard Features ..................................................................................... 1-2
Processors ...................................................................................................... 1-2
Memory ........................................................................................................... 1-2
SAS ................................................................................................................. 1-2
Serial ATA ....................................................................................................... 1-2
PCI Expansion Slots ....................................................................................... 1-2
Onboard Controllers/Ports .............................................................................. 1-3
Graphics Controller ......................................................................................... 1-3
 ........................................................................................................ 1-3
Other Features................................................................................................ 1-3
1-3 Server Chassis Features ................................................................................ 1-3
System Power................................................................................................. 1-3
SAS/SATA Subsystem..................................................................................... 1-4
Front Control Panel......................................................................................... 1-4
I/O Ports.......................................................................................................... 1-4
Cooling System............................................................................................... 1-4
Air Shrouds ..................................................................................................... 1-4
Mounting Rails ................................................................................................ 1-4
1-5 Contacting Supermicro.................................................................................... 1-6
1-6 2U Twin2: System Notes ................................................................................. 1-7
Nodes.............................................................................................................. 1-7
System Power................................................................................................. 1-7
SAS/SATA Backplane/Drives .......................................................................... 1-7
Chapter 2 Server Installation
2-1 Overview ......................................................................................................... 2-1
2-2 Unpacking the System .................................................................................... 2-1
2-3 Preparing for Setup......................................................................................... 2-1
2-4 Warnings and Precautions .............................................................................. 2-2
Choosing a Setup Location............................................................................. 2-2
Rack Precautions............................................................................................ 2-2
Server Precautions.......................................................................................... 2-2
Rack Mounting Considerations ....................................................................... 2-3
Ambient Operating Temperature ................................................................ 2-3
 ......................................................................................... 2-3
Mechanical Loading ................................................................................... 2-3
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL

vii
Circuit Overloading..................................................................................... 2-3
Reliable Ground ......................................................................................... 2-3
2-5 Installing the System into a Rack ................................................................... 2-4
Separating the Sections of the Rack Rails..................................................... 2-4
Installing the Inner Rail Extension .................................................................. 2-5
Outer Rack Rails............................................................................................. 2-6
Chapter 3 System Interface
3-1 Overview ......................................................................................................... 3-1
3-2 Control Panel Button....................................................................................... 3-2
3-3 Control Panel LEDs ........................................................................................ 3-2
3-4 Hard Drive Carrier LEDs................................................................................. 3-3
Chapter 4 Standardized Warning Statements for AC Systems
4-1 About Standardized Warning Statements....................................................... 4-1
........................................................................................... 4-1
Installation Instructions.................................................................................... 4-4
Circuit Breaker ................................................................................................ 4-5
Power Disconnection Warning ........................................................................ 4-6
Equipment Installation..................................................................................... 4-8
Restricted Area................................................................................................ 4-9
Battery Handling............................................................................................ 4-10
Redundant Power Supplies .......................................................................... 4-12
Backplane Voltage ........................................................................................ 4-13
Comply with Local and National Electrical Codes........................................ 4-14
Product Disposal........................................................................................... 4-15
Hot Swap Fan Warning................................................................................. 4-16
Power Cable and AC Adapter ...................................................................... 4-18
Chapter 5 Advanced Serverboard Setup
5-1 Handling the Serverboard ............................................................................... 5-1
Precautions ..................................................................................................... 5-1
Unpacking ....................................................................................................... 5-1
5-2 Connecting Cables.......................................................................................... 5-2
Connecting Data Cables ................................................................................. 5-2
5-3 Rear I/O Ports................................................................................................. 5-3
5-4 Processor and Heatsink Installation................................................................ 5-4
Installing a Passive CPU Heatsink ................................................................. 5-7
Removing the Heatsink................................................................................... 5-8
5-5 Installing Memory............................................................................................ 5-9
Memory Support.............................................................................................. 5-9
Table of Contents

viii
5-6 Adding PCI Expansion Cards ........................................................................5-11
5-7 Serverboard Details ...................................................................................... 5-12
X10DRT-P/PT/PIBF Quick Reference........................................................... 5-13
 .................................................................................... 5-14
5-9 Jumper Settings ............................................................................................ 5-17
Explanation of Jumpers ................................................................................ 5-17
5-10 Onboard Indicators........................................................................................ 5-19
5-11 PCI-Express and SATA Connections............................................................ 5-21
5-12 Installing Software......................................................................................... 5-22
SuperDoctor® 5 ............................................................................................ 5-23
5-13 Onboard Battery............................................................................................ 5-24
Chapter 6 Advanced Chassis Setup
6-1 Static-Sensitive Devices.................................................................................. 6-1
Precautions ..................................................................................................... 6-1
Unpacking ....................................................................................................... 6-1
6-2 Control Panel .................................................................................................. 6-2
6-3 Chassis Cover................................................................................................. 6-3
6-4 Air Shrouds ..................................................................................................... 6-4
  ....................................................................................... 6-5
6-6 System Fans ................................................................................................... 6-5
 ........................................................................... 6-5
6-7 Removing and Installing the Backplane.......................................................... 6-8
Removing the Backplane ................................................................................ 6-8
Installing the Backplane................................................................................ 6-10
6-8 Installing the Serverboard ..............................................................................6-11
I/O Shield .......................................................................................................6-11
Permanent and Optional Standoffs................................................................6-11
6-9 Adapter Card Replacement........................................................................... 6-13
Add-on Card/Expansion Slot Setup .............................................................. 6-14
6-10 Drive Bay Installation/Removal ..................................................................... 6-15
Accessing the Drive Bays ............................................................................. 6-15
6-11 Power Supply................................................................................................ 6-19
Power Supply Replacement.......................................................................... 6-19
Chapter 7 BIOS
7-1 Introduction...................................................................................................... 7-1
Starting BIOS Setup Utility.............................................................................. 7-1
 ......................................................... 7-1
How to Start the Setup Utility ......................................................................... 7-2
7-2 Main Setup...................................................................................................... 7-2
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL

 ...................................................................... 7-4
7-4 Event Logs .................................................................................................... 7-32
7-5 IPMI............................................................................................................... 7-34
7-6 Security Settings ........................................................................................... 7-36
7-7 Boot Settings................................................................................................. 7-37
7-8 Save & Exit ................................................................................................... 7-39
Appendix A BIOS Error Beep Codes
Appendix B System Specications
ix
Table of Contents

x
Notes
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL

Chapter 1
Introduction
1-1 Overview
The SuperServer 6028TP-HC1R/HC1TR/HC1FR is a high-end server comprised
of two main subsystems: the SC827HQ+-R2K02B 2U server chassis and the
X10DRT-P/PT/PIBF dual processor serverboard in four hot-swap nodes. Please

for use with the system (www.supermicro.com).
In addition to the serverboard and chassis, various hardware components have
been included with the SuperServer 6028TP-HC1R/HC1TR/HC1FR server, as
listed below:
• Heatsinks
Four 1U passive CPU heatsinks for rear CPU (SNK-P0047PSM)
Four 1U passive CPU heatsinks w/narrow ILM (SNK-P0057PS)
• Four mylar air shrouds (MCP-310-21702-0B)
• Four 80x80x38mm cooling fans (FAN-0136L4)
• SATA/SAS Backplane
Four HD backplanes (BPN-ADP-S3108L-H6IRP)
One SAS backplane for 12 3.5" HDD (BPN-SAS3-827HQ)
Twelve hot-swap 3.5" HDD trays (MCP-220-00075-0B)
• Four riser cards (RSC-R1UTP-E16R-O-P)
• One rackmount rail kit (MCP-290-00053-0N)
Note: For your system to work properly, please follow the links below to download
all necessary drivers/utilities and the user’s manual for your server.
• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: ftp://ftp.supermicro.com
• Product safety info: http://www.supermicro.com/about/policies/safety_
information.cfm
Chapter 1: Introduction
1-1

1-2
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
1-2 Serverboard Features
At the heart of the SuperServer 6028TP-HC1R/HC1TR/HC1FR lies the
X10DRT-P/PT/PIBF, a dual processor serverboard based on the Intel®
PCH C612 chipset and designed to provide maximum performance. Four of these
serverboards can be mounted in the SC827HQ+-R2K02B chassis.
The sections below cover the main features of the X10DRT-P/PT/PIBF serverboard
(see Figure 1-1 for a block diagram of the chipset).
Processors
The X10DRT-P/PT/PIBF supports single or dual Intel® Xeon® E5-2600 v3 series
processors (Socket R LGA 2011). Please refer to the serverboard description pages
on our web site for a complete listing of supported processors (www.supermicro.
com).
Memory
The X10DRT-P/PT/PIBF has sixteen DIMM slots supporting up to 1024 GB
of LRDIMM (Load Reduced DIMM) or 512 GB of RDIMM (Registered DIMM)
DDR4-2133/1866/1600 MHz registered ECC memory. See Chapter 5 for details.
Note: Check the Supermicro website for the latest memory support information.
SAS
An LSI 3108 controller is included in the system to support three SAS3 hard drives
per node. (RAID 0, 1, 5 and 6 supported). The SAS drives are hot-swappable units.
Note: The operating system you use must have RAID support to enable the hot-
swap capability and RAID function of the SAS drives.
Serial ATA
A Serial ATA controller is integrated into the PCH C612 to provide up to a ten-port 6
Gb/s SATA3 subsystem, which is RAID 0, 1, 5 and 10 supported. The SATA drives
are hot-swappable units.
Note: The operating system you use must have RAID support to enable the hot-
swap capability and RAID function of the SATA drives.
PCI Expansion Slots
The SuperServer 6028TP-HC1R/HC1TR/HC1FR has for each node
one (1) PCI Express 3.0 x16 slot (Slot 1) available for use with a riser card.

1-3
Chapter 1: Introduction
Onboard Controllers/Ports
An Intel i350 Gigabit (10/100/1000 Mb/s) Ethernet dual-channel controller is included
on the X10DRT-P and X10DRT-PIBF. The X10DRT-PT has an Intel X540 10 Gigabit
         
supports a single QSFP connector is provided on the the X10DRT-PIBF only. The
I/O ports include a VGA (monitor) port, two USB 3.0 ports (additional one internal
USB headers are included on the serverboard), an IPMI dedicated LAN port and
two Ethernet ports.
Note:          
Configuration User's Guide available at http://www.supermicro.com/support/
manuals/.
Graphics Controller
The X10DRT-P/PT/PIBF features an integrated ASpeed 2400 BMC with an
integrated VGA/2D graphics controller.
InniBand

 
connecting processors with high-speed peripherals.
Other Features
Other onboard features that promote system health include onboard voltage
monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and
CPU overheat sensors, virus protection, node manager software and BIOS rescue.
1-3 Server Chassis Features
The following is a general outline of the main features of the SC827HQ+ server
chassis.
System Power

power supply, rated at 2000 Watts plus one redundant backup power supply.
In the unlikely event your power supply fails, replacement is simple and can be
accomplished without tools.

1-4
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
SAS/SATA Subsystem
The SC827HQ+ supports up to twelve (12) 3.5" hot-swap SAS/SATA drives in trays
(3 for each node). These drives are hot-swappable units and are connected to a
backplane that provides power and control.
Front Control Panel
SC827HQ+-R2K02B chassis includes four front panels on the handles of the
chassis which control each of the systems. Each control panel on the SuperServer
6028TP-HC1R/HC1TR/HC1FR provides you with system monitoring and control
for one server node. LEDs indicate system power, HDD activity, network activity,
system overheat and power supply failure. A main power button and a system reset
button are also included.
I/O Ports
The SC827HQ+ is an proprietary form factor chassis designed to be used in a 2U
        
card slot, a VGA port, two USB 3.0 ports , one IPMI Ethernet port and two gigabit
Ethernet ports per node.
Cooling System
The SC827HQ+ chassis accepts four system fans powered from the backplane.
If one of the serverboard drawers is removed, the other fans will continue to run.
Air Shrouds

cooling is needed on each serverboard. Always use the air shroud included with
your chassis on each serverboard.
Mounting Rails
The SC827HQ+ includes a set of quick-release rails, and can be placed in a rack
for secure storage and use. To setup your rack, follow the step-by-step instructions
included in this manual.

1-5
Chapter 1: Introduction
Figure 1-1. Intel PCH C612 Chipset:
System Block Diagram
Note: This is a general block diagram and may not exactly repre-
sent the features on your serverboard. See the previous pages for

intended for your reference only.
SPI
LAN3
RGRMII
Debug Card
FRONT PANEL
SYSTEM POWER
CTRL
FAN SPEED
PCI-E X1 G2
USB 2.0
PCHC612
6.0 Gb/S
LPC
1
0
SATA
5
4
RTL8211E-VB-CG
3
2
RJ45
Temp Sensor
EMC1402-1 *2 at diff SMBUS
TPM HEADER
USB 3.0
USB
AST2400
BMC
RMII/NCSI
VGA CONN
BMC Boot Flash
DDR3
5 PHASE
145W
1333/2133
1333/2133
DDR4
P1
P1
P0
VR12.5
P0
#2-1
DDR4
#1-4
#1-3
#1-2
#1-1
QPI
9.6G
CX3 IB
CPU1
DMI2
PCI-E X8 G3
#1-5
#1-6
PCI-E X8 G3
DMI2
CPU2
DDR-4DDR-4
QPI
9.6G
5 PHASE
145W
VR12.5
#1
i350/
X540
LAN
PCI-E X8
SLOT1
SLOT2
PCI-E X8 G3
PCI-E X16 G3
PCI-E X16 G3
#1-7
#1-8
#2-2
#2-3
#2-4
#2-5
#2-6
#2-7
#2-8
6789
SXB2
COM1
Connector
#1
#2 #2
DMI2
#3 #3
SXB1
SPI
BIOS
SPI

1-6
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
1-5 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Website: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Email: [email protected]
Website: www.supermicro.com.tw

1-7
Chapter 1: Introduction
1-6 2U Twin2: System Notes
As a 2U Twin2
unique server system. With four system boards incorporated into a single chassis
acting as four separate nodes, there are several points you should keep in mind.
Nodes
Each of the four serverboards act as a separate node in the system. As independent
nodes, each may be powered off and on without affecting the others. In addition,
each node is a hot-swappable unit that may be removed from the rear of the chassis.
The nodes are connected to the server backplane by means of an adapter card.
Note: A guide pin is located between the upper and lower nodes on the inner chassis
wall. This guide pin also acts as a “stop” when a node is fully installed. If too much
force is used when inserting a node this pin may break off. Take care to slowly slide
a node in until you hear the “click” of the locking tab seating itself.
System Power
Dual 2000 Watt power supplies are used to provide the power for all four
serverboards. Each serverboard however, can be shut down independently of the
other with the power button on its own control panel.
SAS/SATA Backplane/Drives
As a system, the SuperServer 6028TP-HC1R/HC1TR/HC1FR supports the use of
twelve SAS/SATA drives. A single SAS/SATA backplane works to apply system-
based control for power and fan speed functions, yet at the same time logically
connects a set of three hard drives to each serverboard. Consequently, RAID setup
is limited to a three-drive scheme (RAID cannot be spread across all twelve drives).
See the Drive Bay Installation/Removal section in Chapter 6 for the logical hard


1-8
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
Notes

Chapter 2: Server Installation
2-1
Chapter 2
Server Installation
2-1 Overview
This chapter provides a quick setup checklist to get your SuperServer
6028TP-HC1R/HC1TR/HC1FR up and running. Following these steps in the order
given should enable you to have the system operational within a minimum amount
of time. This quick setup assumes that your system has come to you with the
processors and memory preinstalled. If your system is not already fully integrated
with a serverboard, processors, system memory etc., please turn to the chapter or

2-2 Unpacking the System
You should inspect the box the SuperServer 6028TP-HC1R/HC1TR/HC1FR was
shipped in and note if it was damaged in any way. If the server itself shows damage

Decide on a suitable location for the rack unit that will hold the SuperServer
6028TP-HC1R/HC1TR/HC1FR. It should be situated in a clean, dust-free area that

are generated. You will also need it placed near a grounded power outlet. Read the
Rack and Server Precautions in the next section.
2-3 Preparing for Setup
The box the SuperServer 6028TP-HC1R/HC1TR/HC1FR was shipped in should
include two sets of rail assemblies, two rail mounting brackets and the mounting
screws you will need to install the system into the rack. Follow the steps in the
order given to complete the installation process in a minimum amount of time.
Please read this section in its entirety before you begin the installation procedure
outlined in the sections that follow.

2-2
SUPERSERVER 6028TP-HC1R/HC1TR/HC1FR USER'S MANUAL
2-4 Warnings and Precautions
Choosing a Setup Location
• Leave enough clearance in front of the rack to enable you to open the front door
completely (~25 inches) and approximately 30 inches of clearance in the back

• This product is for installation only in a Restricted Access Location (dedicated
equipment rooms, service closets and the like).
• This product is not suitable for use with visual display work place devices
according to §2 of the German Ordinance for Work with Visual Display Units.
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are fully extended to

• In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a component from the
rack.
• You should extend only one component at a time - extending two or more
simultaneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Chapter 4.
• Determine the placement of each component in the rack before you install the
rails.
• 
work up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
• Allow any hot plug drives and power supply modules to cool before touching
them.
• Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.