Supermicro SUPERSERVER 2028TP-DTR User manual

USER'S MANUAL
Revision 1.0a
SUPERSERVER®
2028TP-DTR
2028TP-DTTR
2028TP-DTFR

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
Manual Revision 1.0a
Release Date: September 15, 2016
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2014 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America

iii
Preface
Preface
About This Manual
This manual is written for professional system integrators and PC technicians.
It provides information for the installation and use of the SuperServer
2028TP-DTR/DTTR/DTFR. Installation and maintainance should be performed by
experienced technicians only.
The SuperServer 2028TP-DTR/DTTR/DTFR is a high-end server based on
the SC217HD+-R1K28B 2U rackmount chassis and the dual processor
X10DRT-P/PT/PIBF serverboard. All models have two serverboard nodes with
twelve hot-swap Hard Disk Drives (HDDs) per node.
Manual Organization
Chapter 1: Introduction
The rst chapter provides a checklist of the main components included with
the server system and describes the main features of the X10DRT-P/PT/PIBF
serverboard and the SC217HD+-R1K28B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the SuperServer
2028TP-DTR/DTTR/DTFR into a rack and check out the server conguration prior to
powering up the system. If your server was ordered without processor and memory
components, this chapter will refer you to the appropriate sections of the manual
for their installation.
Chapter 3: System Interface
Refer here for details on the system interface, which includes the functions and
information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
Chapter 4: Standardized Safety Warnings
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 2028TP-DTR/DTTR/DTFR.
Chapter 5: Advanced Serverboard Setup
Chapter 5 provides detailed information on the X10DRT-P/PT/PIBF serverboard,
including the locations and functions of connections, headers and jumpers. Refer
to this chapter when adding or removing processors or main memory and when
reconguring the serverboard.

SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL
iv
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC217HD+-R1K28B server
chassis. You should follow the procedures given in this chapter when installing,
removing or reconguring SATA or peripheral drives and when replacing system
power supply units and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed information
on running the CMOS Setup Utility.
Appendix A: BIOS Error Beep Codes
Appendix B: System Specications

v
Notes
Table of Contents

vi
Table of Contents
Chapter 1 Introduction
1-1 Overview ......................................................................................................... 1-1
1-2 Serverboard Features ..................................................................................... 1-2
Processors ...................................................................................................... 1-2
Memory ........................................................................................................... 1-2
SATA .............................................................................................................. 1-2
PCI Expansion Slots ....................................................................................... 1-2
Onboard Controllers/Ports .............................................................................. 1-3
Graphics Controller ......................................................................................... 1-3
InniBand ........................................................................................................ 1-3
Other Features................................................................................................ 1-3
1-3 Server Chassis Features ................................................................................ 1-4
System Power................................................................................................. 1-4
Front Control Panel......................................................................................... 1-4
Cooling System............................................................................................... 1-4
Air Shrouds ..................................................................................................... 1-4
Mounting Rails ................................................................................................ 1-4
1-5 Contacting Supermicro.................................................................................... 1-6
1-6 2U Twin: System Notes................................................................................... 1-7
Nodes.............................................................................................................. 1-7
System Power................................................................................................. 1-7
Hard Drive Backplane/Drives.......................................................................... 1-7
Chapter 2 Server Installation
2-1 Overview ......................................................................................................... 2-1
2-2 Unpacking the System .................................................................................... 2-1
2-3 Preparing for Setup......................................................................................... 2-1
Choosing a Setup Location............................................................................. 2-2
2-4 Warnings and Precautions .............................................................................. 2-2
Rack Precautions............................................................................................ 2-2
Server Precautions.......................................................................................... 2-2
Rack Mounting Considerations ....................................................................... 2-3
Ambient Operating Temperature ................................................................ 2-3
Reduced Airow ......................................................................................... 2-3
Mechanical Loading ................................................................................... 2-3
Circuit Overloading..................................................................................... 2-3
Reliable Ground ......................................................................................... 2-3
2-5 Installing the System into a Rack ................................................................... 2-4
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL

vii
Identifying the Sections of the Rack Rails...................................................... 2-4
Locking Tabs ................................................................................................... 2-5
Releasing the Inner Rail ................................................................................. 2-5
Installing The Inner Rails on the Chassis....................................................... 2-6
Installing the Outer Rails on the Rack............................................................ 2-7
Standard Chassis Installation ......................................................................... 2-8
Chapter 3 System Interface
3-1 Overview ......................................................................................................... 3-1
3-2 Control Panel Button....................................................................................... 3-2
Power .............................................................................................................. 3-2
UID .................................................................................................................. 3-2
3-3 Control Panel LEDs ........................................................................................ 3-2
Information LED .............................................................................................. 3-2
NIC .................................................................................................................. 3-3
3-4 Hard Drive Carrier LEDs................................................................................. 3-3
Chapter 4 Standardized Warning Statements for AC Systems
4-1 About Standardized Warning Statements....................................................... 4-1
Warning Denition........................................................................................... 4-1
Installation Instructions.................................................................................... 4-4
Circuit Breaker ................................................................................................ 4-5
Power Disconnection Warning ........................................................................ 4-6
Equipment Installation..................................................................................... 4-8
Restricted Area................................................................................................ 4-9
Battery Handling............................................................................................ 4-10
Redundant Power Supplies .......................................................................... 4-12
Backplane Voltage ........................................................................................ 4-13
Comply with Local and National Electrical Codes........................................ 4-14
Product Disposal........................................................................................... 4-15
Hot Swap Fan Warning................................................................................. 4-16
Power Cable and AC Adapter ...................................................................... 4-18
Chapter 5 Advanced Serverboard Setup
5-1 Handling the Serverboard ............................................................................... 5-1
Precautions ..................................................................................................... 5-1
Unpacking ....................................................................................................... 5-1
5-2 Connecting Cables.......................................................................................... 5-2
Connecting Data Cables ................................................................................. 5-2
5-3 Rear I/O Ports................................................................................................. 5-3
5-4 Processor and Heatsink Installation................................................................ 5-4
Installing a Passive CPU Heatsink ................................................................. 5-7
Table of Contents

viii
Removing the Heatsink................................................................................... 5-8
5-5 Installing Memory............................................................................................ 5-9
Memory Support.............................................................................................. 5-9
5-6 Adding PCI Expansion Cards ........................................................................5-11
5-7 Serverboard Details ...................................................................................... 5-12
X10DRT-P/PT/PIBF Quick Reference........................................................... 5-13
5-8 Connector Denitions.................................................................................... 5-14
5-9 Jumper Settings ............................................................................................ 5-17
Explanation of Jumpers ................................................................................ 5-17
5-10 Onboard Indicators........................................................................................ 5-19
5-11 PCI-Express and SATA Connections............................................................ 5-21
5-12 Installing Software......................................................................................... 5-22
SuperDoctor® 5 ............................................................................................ 5-23
5-13 Onboard Battery............................................................................................ 5-24
Chapter 6 Advanced Chassis Setup
6-1 Static-Sensitive Devices.................................................................................. 6-1
Precautions ..................................................................................................... 6-1
Unpacking ....................................................................................................... 6-1
6-2 Control Panel .................................................................................................. 6-2
6-3 Chassis Cover................................................................................................. 6-3
6-4 Air Shrouds ..................................................................................................... 6-4
6-5 Checking the Airow ....................................................................................... 6-5
6-6 System Fans ................................................................................................... 6-5
Optional Fan Congurations ........................................................................... 6-5
6-7 Removing and Installing the Backplane.......................................................... 6-8
Removing the Backplane ................................................................................ 6-8
Installing the Backplane................................................................................ 6-10
6-8 Installing the Serverboard ..............................................................................6-11
I/O Shield .......................................................................................................6-11
Permanent and Optional Standoffs................................................................6-11
6-9 Adapter Card Replacement........................................................................... 6-14
Expansion Card/PCI Slot Setup.................................................................... 6-15
6-10 Drive Bay Installation/Removal ..................................................................... 6-16
Accessing the Drive Bays ............................................................................. 6-16
6-11 Power Supply................................................................................................ 6-19
Power Supply Replacement.......................................................................... 6-19
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL

Chapter 7 BIOS
7-1 Introduction...................................................................................................... 7-1
Starting BIOS Setup Utility.............................................................................. 7-1
How To Change the Conguration Data ......................................................... 7-1
How to Start the Setup Utility ......................................................................... 7-2
7-2 Main Setup...................................................................................................... 7-2
7-3 Advanced Setup Congurations...................................................................... 7-4
7-4 Event Logs .................................................................................................... 7-32
7-5 IPMI............................................................................................................... 7-34
7-6 Security Settings ........................................................................................... 7-36
7-7 Boot Settings................................................................................................. 7-37
7-8 Save & Exit ................................................................................................... 7-39
Appendix A BIOS Error Beep Codes
Appendix B System Specications
ix
Table of Contents

x
Notes
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL

Chapter 1
Introduction
1-1 Overview
The SuperServer 2028TP-DTR/DTTR/DTFR is a high-end server comprised
of two main subsystems: the SC217HD+-R1K28B 2U server chassis and the
X10DRT-P/PT/PIBF dual processor serverboard in two hot-swap nodes. Please
refer to our website for information on operating systems that have been certied
for use with the system (www.supermicro.com).
In addition to the serverboard and chassis, various hardware components have been
included with the SuperServer 2028TP-DTR/DTTR/DTFR server, as listed below:
• Four passive CPU heatsinks (SNK-P0048PS)
• Four mylar air shrouds (MCP-310-82718-0B)
• Four 8-cm cooling fans (FAN-0136L4)
• SATA Backplane
Two HD backplanes (BPN-ADP-8SATA3P-O-P)
One midplane HDD (BPN-SAS3-217HD)
Twenty-four hot-swap 2.5" HDD trays (MCP-220-00047-0B)
• One rackmount rail kit (MCP-290-00053-0N)
Note: For your system to work properly, please follow the links below to download
all necessary drivers/utilities and the user’s manual for your server.
• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: ftp://ftp.supermicro.com
• Product safety info: http://www.supermicro.com/about/policies/safety_
information.cfm
Chapter 1: Introduction
1-1

1-2
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL
1-2 Serverboard Features
At the heart of the SuperServer 2028TP-DTR/DTTR/DTFR lies the
X10DRT-P/PT/PIBF, a dual processor serverboard based on the Intel®
PCH C612 chipset and designed to provide maximum performance. Two of these
serverboards can be mounted in the SC217HD+-R1K28B chassis.
The sections below cover the main features of the X10DRT-P/PT/PIBF serverboard
(see Figure 1-1 for a block diagram of the chipset).
Processors
The X10DRT-P/PT/PIBF supports single or dual Intel® Xeon® E5-2600 v3/v4 series
processors (Socket R LGA 2011). Please refer to the serverboard description pages
on our website for a complete listing of supported processors (www.supermicro.
com).
Memory
The X10DRT-P/PT/PIBF has sixteen DIMM slots supporting up to 2 TB of
3DS LRDIMM (Load Reduced DIMM) or 1 TB of RDIMM (Registered DIMM)
DDR4-2400/2133/1866/1600 MHz registered ECC memory. See Chapter 5 for
details.
Note: Check the Supermicro website (www.supermicro.com) for the latest memory
support information.
SATA
A Serial ATA controller is integrated into the PCH C612 to provide up to eight SATA3
(6 Gb/s) hard drives per node (RAID 0, 1, 5 and 10 supported). The SATA drives
are hot-swappable units.
Note: The operating system you use must have RAID support to enable the hot-
swap capability and RAID function of the SATA drives.
PCI Expansion Slots
The SuperServer 2028TP-DTR/DTTR/DTFR can accommodate two low-prole
expansion cards.

1-3
Chapter 1: Introduction
Onboard Controllers/Ports
An Intel i350 Gigabit (10/100/1000 Mb/s) Ethernet dual-channel controller is included
on the X10DRT-P and X10DRT-PIBF. The X10DRT-PT has an Intel X540 10 Gigabit
Ethernet dual-channel controller. A Connect-X3 port for InniBand (on), which
supports a single QSFP connector, is provided on the the X10DRT-PIBF only. The
I/O ports include a VGA (monitor) port, two USB 3.0 ports (additional one internal
USB headers are included on the serverboard), an IPMI dedicated LAN port and
two Ethernet ports.
Note: For IPMI Conguration Instructions, please refer to the Embedded BMC
Configuration User's Guide available at http://www.supermicro.com/support/
manuals/.
Graphics Controller
The X10DRT-P/PT/PIBF features an integrated ASpeed 2400 BMC with an
integrated VGA/2D graphics controller.
InniBand
The 2028TP-DTFR server includes an FDR (fourteen data rate) speed InniBand
QSFP connector. InniBand is a scalable serial communications link intended for
connecting processors with high-speed peripherals.
Other Features
Other onboard features that promote system health include onboard voltage
monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and
CPU overheat sensors, virus protection, node manager software and BIOS rescue.

1-4
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL
1-3 Server Chassis Features
The following is a general outline of the main features of the SC217HD+ server
chassis.
System Power
Each SC217HD+ chassis model includes a high-efciency 80-plus Platinum certied
power supply, rated at 1280 Watts plus one redundant backup power supply.
In the unlikely event your power supply fails, replacement is simple and can be
accomplished without tools.
Front Control Panel
SC217HD+-R1K28B chassis includes two control panels on the handles of the
chassis. Each control panel on the SuperServer 2028TP-DTR/DTTR/DTFR provides
you with system monitoring and control for one server node. LEDs indicate system
power, HDD activity, network activity, system overheat and power supply failure. A
main power button and a system reset button are also included.
Cooling System
The SC217HD+ chassis accepts four system fans, which are powered from the
backplane.
Air Shrouds
The SC217HD+ chassis includes one mylar air shroud for each node that directs
the airow where cooling is needed on each serverboard. Always use the air shroud
included with your chassis on each serverboard.
Mounting Rails
The SC217HD+ includes a set of quick-release rails, and can be placed in a rack
for secure storage and use. To setup your rack, follow the step-by-step instructions
included in this manual.

1-5
Chapter 1: Introduction
Figure 1-1. Intel PCH C612 Chipset:
System Block Diagram
Note: This is a general block diagram and may not exactly repre-
sent the features on your serverboard. See the previous pages for
the actual specications of your serverboard. This block diagram is
intended for your reference only.
SPI
LAN3
RGRMII
Debug Card
FRONT PANEL
SYSTEM POWER
CTRL
FAN SPEED
PCI-E X1 G2
USB 2.0
PCHC612
6.0 Gb/S
LPC
1
0
SATA
5
4
RTL8211E-VB-CG
3
2
RJ45
Temp Sensor
EMC1402-1 *2 at diff SMBUS
TPM HEADER
USB 3.0
USB
AST2400
BMC
RMII/NCSI
VGA CONN
BMC Boot Flash
DDR3
5 PHASE
145W
1333/2133
1333/2133
DDR4
P1
P1
P0
VR12.5
P0
#2-1
DDR4
#1-4
#1-3
#1-2
#1-1
QPI
9.6G
CX3 IB
CPU1
DMI2
PCI-E X8 G3
#1-5
#1-6
PCI-E X8 G3
DMI2
CPU2
DDR-4DDR-4
QPI
9.6G
5 PHASE
145W
VR12.5
#1
i350/
X540
LAN
PCI-E X8
SLOT1
SLOT2
PCI-E X8 G3
PCI-E X16 G3
PCI-E X16 G3
#1-7
#1-8
#2-2
#2-3
#2-4
#2-5
#2-6
#2-7
#2-8
6789
SXB2
COM1
Connector
#1
#2 #2
DMI2
#3 #3
SXB1
SPI
BIOS
SPI

1-6
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL
1-5 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Website: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Website: www.supermicro.nl
Asia-Pacic
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Email: [email protected]
Website: www.supermicro.com.tw

1-7
Chapter 1: Introduction
1-6 2U Twin: System Notes
As a 2U Twin conguration, the SuperServer 2028TP-DTR/DTTR/DTFR is a unique
server system. With two system boards incorporated into a single chassis acting as
two separate nodes, there are several points you should keep in mind.
Nodes
Each of the two serverboards act as a separate node in the system. As independent
nodes, each may be powered off and on without affecting the other. In addition, each
node is a hot-swappable unit that may be removed from the rear of the chassis.
The nodes are connected to the server backplane by means of an adapter card.
Note: A guide pin is located between the upper and lower nodes on the inner chassis
wall. This guide pin also acts as a “stop” when a node is fully installed. If too much
force is used when inserting a node this pin may break off. Take care to slowly slide
a node in until you hear the “click” of the locking tab seating itself.
System Power
Dual 1280 Watt power supplies are used to provide the power for both serverboards.
Each serverboard however, can be shut down independently of the other with the
power button on its respective control panel.
Hard Drive Backplane/Drives
As a system, the SuperServer 2028TP-DTR/DTTR/DTFR supports the use of
16 hard drives (SATA). A single backplane works to apply system-based control
for power and fan speed functions, yet at the same time logically connects a set
of 12 hard drives to each serverboard. Consequently, RAID setup is limited to a
eight-drive scheme (RAID cannot be spread across all 16 drives). See the Drive
Bay Installation/Removal section in Chapter 6 for the logical hard drive and node
conguration.

1-8
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL
Notes

Chapter 2: Server Installation
2-1
Chapter 2
Server Installation
2-1 Overview
This chapter provides a quick setup checklist to get your SuperServer
2028TP-DTR/DTTR/DTFR up and running. Following these steps in the order
given should enable you to have the system operational within a minimum amount
of time. This quick setup assumes that your system has come to you with the
processors and memory preinstalled. If your system is not already fully integrated
with a serverboard, processors, system memory etc., please turn to the chapter or
section noted in each step for details on installing specic components.
2-2 Unpacking the System
You should inspect the box the 2028TP-DTR/DTTR/DTFR server was shipped in
and note if it was damaged in any way. If the server itself shows damage you should
le a damage claim with the carrier who delivered it.
Decideonasuitablelocationfortherackunitthatwillholdthe2028TP-DTR/DTTR/DTFR
server. It should be situated in a clean, dust-free area that is well ventilated. Avoid
areas where heat, electrical noise and electromagnetic elds are generated. You
will also need it placed near a grounded power outlet. Read the Rack and Server
Precautions in the next section.
2-3 Preparing for Setup
The box the SuperServer 2028TP-DTR/DTTR/DTFR was shipped in should include
two sets of rail assemblies, two rail mounting brackets and the mounting screws you
will need to install the system into the rack. Follow the steps in the order given to
complete the installation process in a minimum amount of time. Please read this
section in its entirety before you begin the installation procedure outlined in the
sections that follow.

2-2
SUPERSERVER 2028TP-DTR/DTTR/DTFR USER'S MANUAL
Choosing a Setup Location
• Leave enough clearance in front of the rack to enable you to open the front door
completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for sufcient airow and ease in servicing.
• This product is for installation only in a Restricted Access Location (dedicated
equipment rooms, service closets and the like).
• This product is not suitable for use with visual display work place devices
acccording to §2 of the the German Ordinance for Work with Visual Display Units.
2-4 Warnings and Precautions
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are fully extended to
the oor with the full weight of the rack resting on them.
• In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a component from the
rack.
• You should extend only one component at a time - extending two or more
simultaneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Chapter 4.
• Determine the placement of each component in the rack before you install the
rails.
• Install the heaviest server components on the bottom of the rack rst, and then
work up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
• Allow any hot plug drives and power supply modules to cool before touching
them.
• Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.