Supero A+ SERVER 2022TG-HTRF User manual

Altus 2840
High density server for HPC and virtualization
Technical Guide
Rev. 1.0
PENGUIN
COMPUTING
www.penguincomputing.com | 1-888-PENGUIN (736-4846) | twitter:@PenguinHPC

A+ SERVER 2022TG-HTRF
A+ SERVER 2022TG-HIBQRF
®
SUPER
USER’S MANUAL
Revision 1.0

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to
provide reasonable protection against harmful interference when the equipment is operated in a
commercial environment. This equipment generates, uses, and can radiate radio frequency
energy and, if not installed and used in accordance with the manufacturer’s instruction manual,
may cause harmful interference with radio communications. Operation of this equipment in a
residential area is likely to cause harmful interference, in which case you will be required to correct
the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
Manual Revision 1.0
Release Date: December 30, 2010
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2010 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America

iii
Preface
Preface
About This Manual
This manual is written for professional system integrators and PC technicians.
It provides information for the installation and use of the A+
SERVER 2022TG-HTRF/HIBQRF. Installation and maintainance should be
performed by experienced technicians only.
The A+ SERVER 2022TG-HTRF/HIBQRF is a high-end server based on the
SC827H-R1400BP 2U rackmount chassis and the H8DGT-HF/HIBQF dual processor
serverboard. The only difference between the 2022TG-HTRF and 2022TG-HIBQF
servers is that the 2022TG-HIBQF server has a QSFP Infi niBand Connector and
the the 2022TG-HTRF does not.
Manual Organization
Chapter 1: Introduction
The fi rst chapter provides a checklist of the main components included with
the server system and describes the main features of the H8DGT-
HF/HIBQF serverboard and the SC827H-R1400BP chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the A+ SERVER
2022TG-HTRF/HIBQRF into a rack and check out the server confi guration prior to
powering up the system. If your server was ordered without processor and memory
components, this chapter will refer you to the appropriate sections of the manual
for their installation.
Chapter 3: System Interface
Refer here for details on the system interface, which includes the functions
and information provided by the control panel on the chassis as well as other
LEDs located throughout the system.
Chapter 4: System Safety
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the A+
SERVER 2022TG-HTRF/HIBQRF.

A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
Chapter 5: Advanced Serverboard Setup
Chapter 5 provides detailed information on the H8DGT-HF/HIBQF serverboard,
including the locations and functions of connections, headers and jumpers. Refer
to this chapter when adding or removing processors or main memory and
when reconfi guring the serverboard.
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC827H-R1400BP server chassis.
You should follow the procedures given in this chapter when installing, removing or
reconfi guring SATA or peripheral drives and when replacing system power supply
units and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed
information on running the CMOS Setup Utility.
Appendix A: BIOS Error Beep Codes
Appendix B: System Specifi cations
iv

A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
Table of Contents
Chapter 1 Introduction
1 Overview 1-1
2 Serverboard Features 1-2
Processors 1-2
Memory 1-2
Serial ATA 1-2
PCI Expansion Slots 1-2
Onboard Controllers/Ports 1-2
Graphics Controller 1-3
Infi niBand 1-3
Other Features 1-3
3 Server Chassis Features 1-3
System Power 1-3
SATA Subsystem 1-3
Front Control Panel 1-4
I/O Backplane 1-4
Cooling System 1-4
Air Shrouds 1-4
Mounting Rails 1-4
4Contacting Supermicro 1-6
1-5 2U Twin2: System Notes 1-7
Nodes 1-7
System Power 1-7
SATA Backplane/Drives 1-7
Chapter 2 Server Installation
2-1 Overview 2-1
2-2 Unpacking the System 2-1
2-3 Preparing for Setup 2-1
Choosing a Setup Location 2-1
Warnings and Precautions! 2-2
Rack Precautions 2-2
Server Precautions 2-2
Rack Mounting Considerations 2-3
Ambient Operating Temperature 2-3
Reduced Airfl ow 2-3
Mechanical Loading 2-3
v

Table of Contents
Circuit Overloading 2-3
Reliable Ground 2-3
4 Installing the System into a Rack 2-4
Separating the Sections of the Rack Rails 2-4
Installing the Inner Rail Extension 2-5
Outer Rack Rails 2-6
5Checking the Serverboard Setup 2-8
2-6 Checking the Drive Bay Setup 2-10
Chapter 3 System Interface
3-1 Overview 3-1
4-2 Control Panel Button 3-2
4-3 Control Panel LEDs 3-2
4-4 Drive Carrier LEDs 3-3
SATA Drives 3-3
SCSI Drives 3-3
Chapter 4 System Safety
4-1 Electrical Safety Precautions 4-1
4-2 General Safety Precautions 4-2
4-3 ESD Precautions 4-3
4-4 Operating Precautions 4-3
Chapter 5 Advanced Serverboard Setup
1 Handling the Serverboard 5-1
Precautions 5-1
Unpacking 5-2
2 Serverboard Installation 5-2
3 Connecting Cables 5-2
Connecting Data Cables 5-3
4I/O Port Connections 5-3
5-5 Processor and Heatsink Installation 5-4
Installing a Passive CPU Heatsink 5-6
Removing the Heatsink 5-6
6 Installing Memory 5-7
DIMM Module Population Confi guration 5-9
7PCI Expansion Cards 5-10
5-8 Serverboard Details 5-11
5-9 Connector Defi nitions 5-13
5-10 Jumper Settings 5-16
Explanation of Jumpers 5-16
vi

vii
5-11
5-12
5-13
Onboard Indicators 5-18
SATA Ports 5-19
Enabling SATA RAID 5-20
Serial ATA (SATA) 5-20
Installing the OS/SATA Driver 5-20
Building a Driver Diskette 5-20
Enabling SATA RAID in the BIOS 5-21
Using the Adaptec RAID Utility 5-22
Installing the RAID Driver During OS Installation 5-22
Installing Drivers 5-23
Supero Doctor III 5-24
5-14
Chapter 6 Advanced Chassis Setup
1 Static-Sensitive Devices 6-1
Precautions 6-1
2 Control Panel 6-2
Unpacking 6-2
3 Chassis Cover 6-3
4Air Guides 6-4
6-5 Checking the Airfl ow 6-4
Installation Complete 6-4
6 System Fans 6-5
Optional Fan Confi gurations 6-5
7 Removing and Installing the Backplane 6-7
Removing the Backplane 6-7
Installing the Backplane 6-9
8 Installing the Motherboard 6-10
I/O Shield 6-10
Permanent and Optional Standoffs 6-10
9 Adapter Card Replacement 6-12
Add-on Card/Expansion Slot Setup 6-13
Drive Bay Installation/Removal 6-15
Accessing the Drive Bays 6-15
Power Supply 6-19
Power Supply Replacement 6-19
Power Supply Replacement 6-19
6-10
6-11
A+ SERVER 2022TG-HTRF/HIBQRF User's Manual

viii
Table of Contents
Chapter 7 BIOS
1 Introduction 7-1
Starting BIOS Setup Utility 7-1
How To Change the Confi guration Data 7-1
Starting the Setup Utility 7-2
2Main Setup 7-2
7-3 Advanced Setup Confi gurations 7-4
4-3 Security Menu 7-16
4 Boot Menu 7-16
5 Exit Menu 7-17
Appendix A BIOS Error Beep Codes
Appendix B Installing Windows
B-1 Installing the Windows OS for a RAID System ..............................................B-1
B-2 Installing the Windows OS for a Non-RAID System.......................................B-2
Appendix C System Specifi cations

Chapter 1: Introduction
Chapter 1
Introduction
1 Overview
The A+ SERVER 2022TG-HTRF/HIBQRFis a high-end servercomprised of two main
subsystems: the SC827H-R1400BP 2U server chassis and the H8DGT-HF/HIBQF
dual processor serverboard. Please refer to our web site for information on operating
systems that have been certifi ed for use with the system (www.supermicro.com).
In addition to the serverboard and chassis, various hardware components
have been included with the 2022TG-HTRF/HIBQRF, as listed below:
Four (4) Air shrouds for H8 DP (G34), SC827 chassis (MCP-310-82711-0B)
Four (4) 4-port Adapter cards for backplane (BPN-ADP-4SATA-H8)
One (1) SAS/SATA Backpane (BPN-SAS-827B)
Eight (8) 1U Passive CPU heatsinks for AMD Socket G34 (SNK-P0042P)
Four (4) Riser Cards (RSC-R1U-E16R)
Twelve (12) Hard Disk Drive Trays (MCP-220-00075-0B)
One (1) Rack mount rail kit (MCP-290-00053-0N)
Four (4) 80x38mm 4-pin PWM chassis fans (FAN-0111L4)
One CD containing manual, drivers and utilities
1-1

1-2
A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
1-2 Serverboard Features
At the heart of the A+ SERVER 2022TG-HTRF/HIBQRF lies the H8DGT-HF/HIBQF,
a dual processor serverboard based on the AMD SR5670/SP5100 Chipset
and designed to provide maximum performance. Up to four of these serverboards
can be mounted in the SC827 chassis.
The sections below cover the main features of the H8DGT-HF/HIBQF serverboard
(see Figure 1-1 for a block diagram of the chipset).
Processors
The H8DGT-HF/HIBQF supports single or dual AMD Opteron 6100 series processors
(Socket G34 type). Please refer to the serverboard description pages on our web
site for a complete listing of supported processors (www.supermicro.com).
Memory
The H8DGT-HF/HIBQF has sixteen (16) single/dual/tri/quad channel DIMM slots
supporting up to 256 GB of DDR3-1333/1066/800 registered ECC or 64GB of DDR3
Unbuffered ECC/non-ECC SDRAM. See Chapter 5 for details.
Serial ATA
A Serial ATA controller is integrated into the AMD SP5100 Chipset to provide a
four-port 3 Gb/s SATA subsystem, which is RAID 0 and 1 supported. The SATA
drives are hot-swappable units.
Note: The operating system you use must have RAID support to enable the hot-
swap capability and RAID function of the SATA drives.
PCI Expansion Slots
The H8DGT-HF/HIBQF has one PCI Express 2.0 x16 expansion slot.
Onboard Controllers/Ports
One Fast UART 16550 compatible serial port and a Mellonox Connect-X Infi niBand
(on 2022TG-HIBQRF server only) supporting a single QSFP connector are located
on the serverboard. The color-coded I/O ports include one COM port (an additional
COM header is located on the serverboard), a VGA (monitor) port, two USB 2.0
ports (additional two internal USB headers and a USB Type A port are included
on the serverboard), an IPMI dedicated LAN port and two gigabit Ethernet ports.

1-3
Chapter 1: Introduction
Graphics Controller
The H8DGT-HF/HIBQF features an integrated Matrox®G200 graphics controller
with 16 MB DDR2 memory.
Infi niBand
The 2022TG-HIBQRF includes a QDR (quad data rate) speed InfiniBand
QSFP connector. Infi niBand is a scalable serial communications link intended for
connecting processors with high-speed peripherals.
Other Features
Other onboard features that promote system health include onboard voltage
monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and
CPU overheat sensors, virus protection and BIOS rescue.
1-3 Server Chassis Features
The following is a general outline of the main features of the SC827
server chassis.
System Power
Each SC827 chassis model includes a high-effi ciency 80 Plus Gold certifi ed power
supply, rated at 1400 Watts plus one redundant backup power supply. In the unlikely
event your power supply fails, replacement is simple and can be accomplished
without tools.
SATA Subsystem
The SC827 supports up to twelve 3.5" hot-swap SATA drives in trays (3 for each
node). These drives are hot-swappable units and are connected to a
backplane that provides power and control.
Note: The operating system you use must have RAID support to enable the hot-
swap capability of the drives.

1-4
A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
Front Control Panel
SC827 models include four front panels on the handles of the chassis which control
each of the systems. Each control panel on the A+ SERVER 2022TG-
HTRF/HIBQRF provides you with system monitoring and control for one server
node. LEDs indicate system power, HDD activity, network activity, system
overheat and power supply failure. A main power button and a system reset
button are also included.
I/O Backplane
The SC827 is an ATX form factor chassis designed to be used in a 2U rackmount
confi guration. The SAS827B I/O backplane provides a low-profi le add-on
card slot, a COM port, a VGA port, two USB 2.0 ports and two gigabit Ethernet
ports per node.
For more information regarding the backplane, view the appendices found at the
end of this manual.
Cooling System
The SC827 chassis accepts four system fans powered from either backpane or the
serverboards. If not powered from the backpane, the SC827B model chassis powers
two fans from two motherboards, so that when one of the motherboard drawers is
removed, the second motherboard will continue running both fans.
Air Shrouds
The SC827 chassis includes four mylar air shrouds that direct the airfl ow where
cooling is needed on each serverboard. Always use the air shroud included with
your chassis on each serverboard.
Mounting Rails
The SC827 includes a set of quick-release rails, and can be placed in a rack for
secure storage and use. To setup your rack, follow the step-by-step instructions
included in this manual.

1-5
Chapter 1: Introduction
Figure 1-1. AMD SR5670/SP5100 Chipset:
System Block Diagram
Note: This is a general block diagram. Please see Chapter 5 for details.
AMD
Socket G34
CPU2
MUX
SATA x6
PCI-E GEN2 X16 Slot1
PCI-E GEN2 X4
INTEL
KAWELA
A-Link
SP5100
BMC
VGA
WPCM450-R
PCI
SMBus
HWM SIO
W83795G W83527 SPI Flash
RMII
FE PHY
RTL8201N
DDR2 SDRAM
64Mb X16bit
PSU I2C
IPMB
VGA
RJ45 USB x5
Clock Gen
LPC
SR5670
RJ45
RJ45
COM1
COM2
HT3 Link
(8+8)x(8+8)-6.4GT/s
HT3 Link
8x8-3.2GT/s
HT3 Link
8x8-3.2GT/s
Mellanox
ConnectX
(H8DGT-HIBQF)
DIMM A1
DIMM A0
DIMM B1
DIMM B0
DIMM C1
DIMM C0
DIMM D1
DIMM D0
HT3 Link
16x16-5.2GT/s
AMD
Socket G34
CPU1
DIMM A1
DIMM A0
DIMM B1
DIMM B0
DIMM C1
DIMM C0
DIMM D1
DIMM D0
PCI-E GEN2 X8

1-6
A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
1-4 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
[phone]
[phone]
Tel:
Fax:
Email: [email protected]m (General Information)
[email protected] (Technical Support)
Web Site: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel:
Fax:
Email:
[phone]
[phone]
[email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Asia-Pacific
Address: Super Micro Computer, Inc.
4F, No. 232-1, Liancheng Rd.
Chung-Ho 235, Taipei County
Taiwan, R.O.C.
Tel:
Fax:
[phone]
[phone]
Web Site:
Technical Support:
Email:
www.supermicro.com.tw
[email protected].tw
Tel: [phone], ext.132 or 139

1-7
Chapter 1: Introduction
1-5 2U Twin2: System Notes
As a 2U Twin2 confi guration, the 2022TG-HTRF/HIBQRF is a unique server system.
With four system boards incorporated into a single chassis acting as four separate
nodes, there are several points you should keep in mind.
Nodes
Each of the four serverboards act as a separate node in the system. As
independant nodes, each may be powered off and on without affecting the
others. In addition, each node is a hot-swappable unit that may be removed from
the rear of the chassis. The nodes are connected to the server backplane by
means of an adapter card.
Note: A guide pin is located between the upper and lower nodes on the inner
chassis wall. This guide pin also acts as a “stop” when a node is fully installed. If
too much force is used when inserting a node this pin may break off. Take care to
slowly slide a node in until you hear the “click” of the locking tab seating itself.
System Power
A single 1400W power supply is used to provide the power for all four serverboards.
Each serverboard however, can be shut down independently of the other with the
power button on its own control panel. As an option, you may add an additional
1400W power supply module for power redundancy.
SATA Backplane/Drives
As a system, the 2022TG-HTRF/HIBQRF supports the use of twelve SATA drives.
A single SATA backplane works to apply system-based control for power and fan
speed functions, yet at the same time logically connects a set of three SATA drives
to each serverboard. Consequently, RAID setup is limited to a three-drive scheme
(RAID cannot be spread across all twelve drives). See the Drive Bay Installation/
Removal section in Chapter 6 for the logical hard drive and node confi guration.

1-8
A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
Notes

Chapter 2: Server Installation
Chapter 2
Server Installation
1 Overview
This chapter provides a quick setup checklist to get your A+
SERVER 2022TG-HTRF/HIBQRF up and running. Following these steps in the
order given should enable you to have the system operational within a minimum
amount of time. This quick setup assumes that your system has come to you with
the processors and memory preinstalled. If your system is not already fully
integrated with a serverboard, processors, system memory etc., please turn to the
chapter or section noted in each step for details on installing specifi c components.
2 Unpacking the System
You should inspect the box the A+ SERVER 2022TG-HTRF/HIBQRF was shipped
in and note if it was damaged in any way. If the server itself shows damage you
should fi le a damage claim with the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the A+
SERVER 2022TG-HTRF/HIBQRF. It should be situated in a clean, dust-free area
that is well ventilated. Avoid areas where heat, electrical noise and
electromagnetic fi elds are generated. You will also need it placed near a
grounded power outlet. Read the Rack and Server Precautions in the next
section.
3 Preparing for Setup
The box the A+ SERVER 2022TG-HTRF/HIBQRF was shipped in should include
two sets of rail assemblies, two rail mounting brackets and the mounting screws
you will need to install the system into the rack. Follow the steps in the order
given to complete the installation process in a minimum amount of time. Please
read this section in its entirety before you begin the installation procedure outlined
in the sections that follow.
Choosing a Setup Location
Leave enough clearance in front of the rack to enable you to open the front
door completely (~25 inches) and approximately 30 inches of clearance in the
back of the rack to allow for suffi cient airfl ow and ease in servicing.
2-1

Rack Precautions
Ensure that the leveling jacks on the bottom of the rack are fully extended to
the fl oor with the full weight of the rack resting on them.
In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
Always make sure the rack is stable before extending a component from the
rack.
You should extend only one component at a time - extending two or more
si- multaneously may cause the rack to become unstable.
Server Precautions
Review the electrical and general safety precautions in Chapter 4.
Determine the placement of each component in the rack before you install
the rails.
Install the heaviest server components on the bottom of the rack fi rst, and
then work up.
Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
Allow any hot plug drives and power supply modules to cool before touching
them.
Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.
2-2
A+ SERVER 2022TG-HTRF/HIBQRF User's Manual
This product is for installation only in a Restricted Access Location (dedicated
equipment rooms, service closets and the like).
This product is not suitable for use with visual display work place devices
acccording to §2 of the the German Ordinance for Work with Visual
Display Units.
!!
Warnings and Precautions!

Chapter 2: Server Installation
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating
temperature of the rack environment may be greater than the ambient temperature
of the room. Therefore, consideration should be given to installing the equipment
in an environment compatible with the manufacturer’s maximum rated ambient
temperature (Tmra).
Reduced Airfl ow
Equipment should be mounted into a rack so that the amount of airfl ow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does
not arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the
power supply circuitry and the effect that any possible overloading of circuits
might have on overcurrent protection and power supply wiring. Appropriate
consideration of equipment nameplate ratings should be used when addressing
this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack
itself should be grounded. Particular attention should be given to power
supply connections other than the direct connections to the branch circuit (i.e.
the use of power strips, etc.).
2-3