Supermicro A+ 2021TM-BTRF User manual

Chapter 1
Introduction
1-1 Overview
The A+ Server 2021TM-BTRF/BIBXRF is a high-end server comprised of two main
subsystems: the SC827 2U server chassis and the H8DMT-F/H8DMT-IBXF dual
processor serverboard. Please refer to our web site for information on operating
systems that have been certified for use with the system (www.supermicro.com).
In addition to the serverboard and chassis, various hardware components have
been included with the 2021TM-BTRF/BIBXRF, as listed below:
Eight passive CPU heatsinks (SNK-P0022+)•
Four 8-cm chassis fans (FAN-0111L4)•
Four air shrouds (MCP-310-82703-0B)•
Four riser cards (RSC-R1U-E16R-O-P)•
SATA Accessories•
One SATA backplane (BPN-SAS-827B)
Four 16-pin to 16-pin front control cable (CBL-0151L)
Four sets of SATA cables (CBL-0317L)
Four 4-pin fan cables (CBL-0320L)
Four 4-pin to 4-pin I2C cables (CBL-0323L)
Twelve 3.5" hot-swappable drive carriers (MCP-220-00024-0B)
One rackmount kit (MCP-290-00053-0N)•
One CD containing manual, drivers and utilities•
Chapter 1: Introduction
1-1

1-2
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
1-2 Serverboard Features
At the heart of the A+ Server 2021TM-BTRF/BIBXRF lies the H8DMT-F/H8DMT-
IBXF, a dual processor serverboard based on the nVidia MCP55 Pro Chipset and
designed to provide maximum performance. Up to four of these serverboards can
be mounted in the SC827 chassis. The 2021TM-BTRF server contains the H8DMT-F
serverboard, while the 2021TM-BIBXRF contains the H8DMT-IBXF serverboard.
The difference between the H8DMT-F and H8DMT-IBXF serverboards are the
availability of InfiniBand components. Refer to the table below for details.
Serverboard Full IPMI Capability InfiniBand
Components
H8DMT-F X
H8DMT-IBXF X X
The sections below cover the main features of the H8DMT-F/H8DMT-IBXF
serverboards (see Figure 1-1 for a block diagram of the chipset).
Processors
The H8DMT-F/H8DMT-IBXF supports single or dual AMD Opteron 2000 series
processors (Socket F type). Please refer to the serverboard description pages on our
web site for a complete listing of supported processors (www.supermicro.com).
Memory
The H8DMT-F/H8DMT-IBXF has eight 240-pin DIMM slots that can support up to
64 GB of DDR2-800/667/533 registered ECC SDRAM. The memory operates in an
interleaved configuration and requires modules of the same size and speed to be
installed two at a time. See Chapter 5 for details.
Serial ATA
A Serial ATA controller is integrated into the nVidia MCP55 Pro Chipset to provide
a four-port 3 Gb/s SATA subsystem, which is RAID 0, 1, 5 and JBOD supported.
The SATA drives are hot-swappable units.
Note: The operating system you use must have RAID support to enable the hot-
swap capability and RAID function of the SATA drives.
PCI Expansion Slots
The H8DMT-F/H8DMT-IBXF has one PCI Express x16 expansion slot.

1-3
Chapter 1: Introduction
Onboard Controllers/Ports
One Fast UART 16550 compatible serial port and a Mellanox Connect-X MT25408
20Gb/s InfiniBand controller are located on the serverboard. The color-coded
I/O ports include one COM port (an additional COM header is located on the
serverboard), a VGA (monitor) port, two USB 2.0 ports (additional 2+2 internal USB
headers are included on the serverboard) and two gigabit Ethernet ports.
Graphics Controller
The H8DMT-F/H8DMT-IBXF features an integrated Windbond WPCM450 BMC
graphics controller.
Other Features
Other onboard features that promote system health include onboard voltage
monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and
CPU overheat sensors, virus protection and BIOS rescue.
1-3 Server Chassis Features
The following is a general outline of the main features of the SC827 server
chassis.
System Power
Each SC827 chassis model includes a high-efficiency 80 Plus Gold certified power
supply, rated at 1200 Watts plus one redundant backup power supply. In the unlikely
event your power supply fails, replacement is simple and can be accomplished
without tools.
SATA Subsystem
The SC827 supports up to twelve 3.5" hot-swap SATA drives in trays (3 for each
node). These drives are hot-swappable units and are connected to a backplane
that provides power and control.
Note: The operating system you use must have RAID support to enable the hot-
swap capability of the drives.

1-4
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
Front Control Panel
SC827 models include four front panels on the handles of the chassis which control
each of the systems. Each control panel on the A+ Server 2021TM-BTRF/BIBXRF
provides you with system monitoring and control for one server node. LEDs indicate
system power, HDD activity, network activity, system overheat and power supply
failure. A main power button and a system reset button are also included.
I/O Backplane
The SC827 is an ATX form factor chassis designed to be used in a 2U rackmount
configuration. The SAS827B I/O backplane provides a low-profile add-on card
slot, a COM port, a VGA port, two USB 2.0 ports and two gigabit Ethernet ports
per node.
For more information regarding the backplane, view the appendices found at the
end of this manual.
Cooling System
The SC827 chassis accepts four system fans powered from either backpane or the
serverboards. If not powered from the backpane, the SC827B model chassis powers
two fans from two motherboards, so that when one of the motherboard drawers is
removed, the second motherboard will continue running both fans.
Air Shrouds
The SC827 chassis includes four mylar air shrouds that direct the airflow where
cooling is needed on each serverboard. Always use the air shroud included with
your chassis on each serverboard.
Mounting Rails
The SC827 includes a set of quick-release rails, and can be placed in a rack for
secure storage and use. To setup your rack, follow the step-by-step instructions
included in this manual.

1-5
Chapter 1: Introduction
Figure 1-1. nVidia MCP55 Pro Chipset:
System Block Diagram
Note: This is a general block diagram. Please see Chapter 5 for details.
COM
HT
HT
HT
AMD
Socket F AMD Socket F
RDIMM
RDIMM
RDIMM
RDIMM
RDIMM
RDIMM
RDIMM
RDIMM
MCP55 PRO S
PCI-E Slot
PCI x16
IB MT25408
PCI x8
WPCM450
INTEL 82575
PCI x4
Gigabit LAN
Gigabit LAN
Gigabit LAN RTL8201N
6x USB
USB
4x SATA
SATA
RMII
RMII
PCI LPC
DDR
HM
W83793AG 4x Fan
W83627DHG
BIOS
COM

1-6
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
1-4 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Web Site: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Asia-Pacific
Address: Super Micro Computer, Inc.
4F, No. 232-1, Liancheng Rd.
Chung-Ho 235, Taipei County
Taiwan, R.O.C.
Tel: [phone]
Fax: [phone]
Web Site: www.supermicro.com.tw
Technical Support:
Email: [email protected]
Tel: [phone], ext.132 or 139

1-7
Chapter 1: Introduction
1-5 2U Twin2: System Notes
As a 2U Twin2configuration, the 2021TM-BTRF/BIBXRF is a unique server system.
With four system boards incorporated into a single chassis acting as four separate
nodes, there are several points you should keep in mind.
Nodes
Each of the four serverboards act as a separate node in the system.As independant
nodes, each may be powered off and on without affecting the others. In addition,
each node is a hot-swappable unit that may be removed from the rear of the chassis.
The nodes are connected to the server backplane by means of an adapter card.
Note: a guide pin is located between the upper and lower nodes on the inner chassis
wall. This guide pin also acts as a “stop” when a node is fully installed. If too much
force is used when inserting a node this pin may break off. Take care to slowly slide
a node in until you hear the “click” of the locking tab seating itself.
System Power
Asingle 1200W power supply is used to provide the power for all four serverboards.
Each serverboard however, can be shut down independently of the other with the
power button on its own control panel. As an option, you may add an additional
1200W power supply module for power redundancy.
SATA Backplane/Drives
As a system, the 2021TM-BTRF/BIBXRF supports the use of twelve SATA drives.
A single SATA backplane works to apply system-based control for power and fan
speed functions, yet at the same time logically connects a set of three SATA drives
to each serverboard. Consequently, RAID setup is limited to a three-drive scheme
(RAID cannot be spread across all twelve drives). See the Drive Bay Installation/
Removal section in Chapter 6 for the logical hard drive and node configuration.

1-8
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
Notes

Chapter 2: Server Installation
2-1
Chapter 2
Server Installation
2-1 Overview
This chapter provides a quick setup checklist to get your A+ Server 2021TM-BTRF/
BIBXRF up and running. Following these steps in the order given should enable
you to have the system operational within a minimum amount of time. This quick
setup assumes that your system has come to you with the processors and memory
preinstalled. If your system is not already fully integrated with a serverboard,
processors, system memory etc., please turn to the chapter or section noted in
each step for details on installing specific components.
2-2 Unpacking the System
You should inspect the box the A+ Server 2021TM-BTRF/BIBXRF was shipped in
and note if it was damaged in any way. If the server itself shows damage you should
file a damage claim with the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the A+ Server 2021TM-
BTRF/BIBXRF. It should be situated in a clean, dust-free area that is well ventilated.
Avoid areas where heat, electrical noise and electromagnetic fields are generated.
You will also need it placed near a grounded power outlet. Read the Rack and
Server Precautions in the next section.
2-3 Preparing for Setup
The box the A+ Server 2021TM-BTRF/BIBXRF was shipped in should include two
sets of rail assemblies, two rail mounting brackets and the mounting screws you
will need to install the system into the rack. Follow the steps in the order given to
complete the installation process in a minimum amount of time. Please read this
section in its entirety before you begin the installation procedure outlined in the
sections that follow.
Choosing a Setup Location
Leave enough clearance in front of the rack to enable you to open the front door•
completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for sufficient airflow and ease in servicing.

2-2
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
This product is for installation only in a Restricted Access Location (dedicated•
equipment rooms, service closets and the like).
This product is not suitable for use with visual display work place devices•
acccording to §2 of the the German Ordinance for Work with Visual Display
Units.
!
!
Warnings and Precautions!
Rack Precautions
Ensure that the leveling jacks on the bottom of the rack are fully extended to•
the floor with the full weight of the rack resting on them.
In single rack installation, stabilizers should be attached to the rack. In multiple•
rack installations, the racks should be coupled together.
Always make sure the rack is stable before extending a component from the•
rack.
You should extend only one component at a time - extending two or more si-•
multaneously may cause the rack to become unstable.
Server Precautions
Review the electrical and general safety precautions in Chapter 4.•
Determine the placement of each component in the rack• before you install the
rails.
Install the heaviest server components on the bottom of the rack first, and then•
work up.
Use a regulating uninterruptible power supply (UPS) to protect the server from•
power surges, voltage spikes and to keep your system operating in case of a
power failure.
Allow any hot plug drives and power supply modules to cool before touching•
them.
Always keep the rack's front door and all panels and components on the servers•
closed when not servicing to maintain proper cooling.

Chapter 2: Server Installation
2-3
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating
temperature of the rack environment may be greater than the ambient temperature
of the room. Therefore, consideration should be given to installing the equipment
in an environment compatible with the manufacturer’s maximum rated ambient
temperature (Tmra).
Reduced Airflow
Equipment should be mounted into a rack so that the amount of airflow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack
itself should be grounded. Particular attention should be given to power supply
connections other than the direct connections to the branch circuit (i.e. the use of
power strips, etc.).

2-4
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
2-4 Installing the System into a Rack
This section provides information on installing the SC827 chassis into a rack unit with the
quick-release rails provided. There are a variety of rack units on the market, which may
mean the assembly procedure will differ slightly. You should also refer to the installation
instructions that came with the rack unit you are using.
NOTE: This rail will fit a rack between 26" and 33.5" deep.
Separating the Sections of the Rack Rails
The chassis package includes two rail assemblies in the rack mounting kit. Each
assembly consists of two sections: an inner fixed chassis rail that secures directly
to the server chassis and an outer fixed rack rail that secures directly to the rack
itself.
Figure 2-1: Separating the Rack Rails
1
1
1
2
1
4
1
3
Separating the Inner and Outer Rails
Locate the rail assembly in the chassis1. packaging.
Extend the rail assembly by pulling it2. outward.
Press the quick-release tab.3.
Separate the inner rail extension from4. the outer rail assembly.
Rail Assembly
Extending the Rails
Quick-
Release Tab
Separating
the Inner Rail
Extension

Chapter 2: Server Installation
2-5
Figure 2-2: Installing the Inner Rail Extensions
Installing the Inner Rail Extension
The SC827 chassis includes a set of inner rails in two sections: inner rails and inner
rail extensions. The inner rails are pre-attached to the chassis, and do not interfere
with normal use of the chassis if you decide not to use a server rack. The inner rail
extension is attached to the inner rail to mount the chassis in the rack.
Installing the Inner Rails
Place the inner rail extensions on the side of the chassis aligning the hooks1. of the chassis with the rail extension holes. Make sure the extension faces
"outward" just like the pre-attached inner rail.
Slide the extension toward the front of the chassis.2.
Secure the chassis with 2 screws as illustrated. Repeat steps for the other3. inner rail extension.
1
1
1
2
1
3
1
3

2-6
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
Outer Rack Rails
Outer rails attach to the rack and hold the chassis in place. The outer rails for the
SC827 chassis extend between 30 inches and 33 inches.
Installing the Outer Rails to the Rack
Secure the back end of the outer rail to the rack, using the screws provided.1.
Press the button where the two outer rails are joined to retract the smaller2. outer rail.
Hang the hooks of the rails onto the rack holes and if desired, use screws to3. secure the front of the outer rail onto the rack.
Repeat steps 1-3 for the remaining outer rail.4.
Figure 2-3. Assembling the Outer Rails
1
1
1
2
1
3

Chapter 2: Server Installation
2-7
1
Figure 2-4: Installing the Rack Rails
Installing the Chassis into a Rack
Extend the outer rails as illustrated above.1.
Align the inner rails of the chassis with the outer rails on the rack.2.
Slide the inner rails into the outer rails, keeping the pressure even on both3. sides. When the chassis has been pushed completely into the rack, it should
click into the locked position.
Optional screws may be used to secure the to hold the front of the chassis to4. the rack.

2-8
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
2-5 Checking the Serverboard Setup
After you install the 2021TM-BTRF/BIBXRF in the rack, you will need to open the
unit to make sure the serverboard is properly installed and all the connections
have been made.
Accessing the inside of the System
Before operating the server for the first time, it is important to remove the protective
film covering the top of the chassis, in order to allow for proper ventilation and
cooling.
Removing the Chassis Cover and Protective Film
Remove the two screws which secure the top cover onto the chassis as1. shown above.
Lift the top cover up and off the chassis.2.
Peel off the protective film covering the top cover and the top of the chassis3.
Check that all ventilation openings on the top cover and the top of the chassis4. are clear and unobstructed.
Checking the Components and Setup
You may have one or two processors already installed into the serverboard.1. Each processor needs its own heat sink. See Chapter 5 for instructions on
processor and heat sink installation.
Your 2021TM-BTRF/BIBXRF server system may have come with system2. memory already installed. Make sure all DIMMs are fully seated in their slots.
For details on adding system memory, refer to Chapter 5.
If desired, you can install add-on cards to the system. See Chapter 5 for3. details on installing PCI add-on cards.
Make sure all power and data cables are properly connected and not blocking4. the chassis airflow. Also make sure that no cables are positioned in front of
the fans. See Chapter 5 for details on cable connections.

Chapter 2: Server Installation
2-9
Figure 2-5. Accessing the Inside of the System
Remove two
screws
Check Ventilation
Openings
1
2
1
3
1
4
1
1

2-10
A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
2-6 Checking the Drive Bay Setup
Next, you should check to make sure the peripheral drives and the SATA drives
have been properly installed and all connections have been made.
Checking the Drives
All drives are accessable from the front of the server. For servicing the DVD-1. ROM and floppy drives, you will need to remove the top chassis cover. The
hard drives can be installed and removed from the front of the chassis without
removing the top chassis cover.
Depending upon your system's configuration, your system may have one or2. more drives already installed. If you need to install hard drives, please refer to
Chapter 6.
Checking the Airflow
Airflow is provided by four hot-swappable 8-cm chassis cooling fans. The1. system component layout was carefully designed to direct sufficient cooling
airflow to the components that generate the most heat.
Note that all power and data cables have been routed in such a way that they2. do not block the airflow generated by the fans.
Providing Power
Plug the power cord(s) from the power supply unit(s) into a high-quality1. power strip that offers protection from electrical noise and power surges. It is
recommended that you use an uninterruptible power supply (UPS).
Depress the power on button on the front of the chassis.2.

Chapter 3: System Interface
3-1
Chapter 3
System Interface
3-1 Overview
There are several LEDs on the control panel and on the drive carriers to keep you
constantly informed of the overall status of the system. SC827 models include four
front panels on the handles of the chassis which control each of the systems.
This chapter explains the meanings of all LED indicators and the appropriate re-
sponse you may need to take.

A+ SERVER 2021TM-BTRF/BIBXRF User's Manual
3-2
4-2 Control Panel Button
Power: The main power button on each of the four control panels is used to•
apply or remove power from the power supply to each of the four systems in
the chassis. Turning off system power with this button removes the main power,
but keeps standby power supplied to the system. Therefore, you must unplug
system before servicing.
4-3 Control Panel LEDs
The four control panels are located on the front handle of the SC827 chassis. Each
control panel has three LEDs. These LEDs provide you with critical information
related to different parts of the system. This section explains what each LED
indicates when illuminated and any corrective action you may need to take.
Overheat: This LED is illuminated when an overheat condition occurs.•
A solid red LED indicates an overheat condition in the system.
A flashing red LED which flashes in one second intervals indicates a fan failure.
A flashing red LED which flashes in four second interfals indicates a power
failure. Check the routing of the cables and make sure all fans are present and
operating normally. You should also check to make sure that the chassis cov-
ers and air shrouds are installed. Finally, verify that the heatsinks are installed
properly. This LED will remain flashing or on as long as the temperature is too
high or a fan does not function properly.
NIC1: Indicates network activity on GLAN1 when flashing.•