Super Superserver 5038ML-H24TRF User manual

SUPER
SUPERSERVER
MicroCloud
5038ML-H24TRF
®
USER’S MANUAL
Revision 1.0

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and docu-
mentation, is the property of Supermicro and/or its licensors, and is supplied only under a license.
Any use or reproduction of this product is not allowed, except as expressly permitted by the terms
of said license.
IN NO EVENT WILLSUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATASTORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in a commercial environ-
ment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed
and used in accordance with the manufacturer’s instruction manual, may cause harmful interference
with radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warn-
ing applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to the
State of California to cause birth defects and other repro-
ductive harm.
Manual Revision 1.0
Release Date: January 3, 2014
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2014 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America

Preface
About This Manual
This manual is written for professional system integrators and PC technicians. It pro-
vides information for the installation and use of the SuperServer 5038ML-H24TRF.
Installation and maintenance should be performed by experienced technicians only.
The SuperServer 5038ML-H24TRF is a 24-node, MicroCloud server system based
on the SC939HD-R2K02B 3U chassis and 12 X10SLE-DF motherboards. Please
refer to our web site for an up-to-date list of supported processors.
Manual Organization
Chapter 1: Introduction
The first chapter provides a checklist of the main components included with the
system and describes the main features of the Super X10SLE-DF motherboard
and the SC939HD-R2K02B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the server into a rack and
check out the server configuration prior to powering up the system. If your server
was ordered without the processor and memory components, this chapter will refer
you to the appropriate sections of the manual for their installation.
Chapter 3: System Interface
Refer to this chapter for details on the system interface, which includes the functions
and information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
Chapter 4: Standardized Warning Statements
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 5038ML-H24TRF.
iii
Preface

SUPERSERVER 5038ML-H24TRF User's Manual
iv
Chapter 5: Advanced Motherboard Setup
Chapter 5 provides detailed information on the X10SLE-DF motherboard, including
the locations and functions of connectors, headers and jumpers. Refer to this chap-
ter when adding or removing processors or main memory and when reconfiguring
the motherboard.
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC939HD-R2K02B 3U server
chassis. You should follow the procedures given in this chapter when installing,
removing or reconfiguring drives and when replacing system power supply units
and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed informa-
tion on running the CMOS Setup Utility.
Appendix A: System Specifications

v
Preface
Notes

vi
Table of Contents
Chapter 1 Introduction
1-1 Overview .........................................................................................................1-1
1-2 Motherboard Features.....................................................................................1-2
Processors ......................................................................................................1-2
Memory ...........................................................................................................1-2
SATA................................................................................................................1-2
Rear I/O Ports.................................................................................................1-2
IPMI.................................................................................................................1-2
1-3 Server Chassis Features ................................................................................1-4
System Power................................................................................................. 1-4
Cooling System............................................................................................... 1-4
1-4 Contacting Supermicro....................................................................................1-5
Chapter 2 Server Installation
2-1 Overview .........................................................................................................2-1
2-2 Unpacking the System.................................................................................... 2-1
2-3 Preparing for Setup.........................................................................................2-1
Choosing a Setup Location............................................................................. 2-1
2-4 Warnings and Precautions.............................................................................. 2-2
Rack Precautions............................................................................................ 2-2
Server Precautions..........................................................................................2-2
Rack Mounting Considerations.......................................................................2-3
Ambient Operating Temperature................................................................2-3
Reduced Airflow .........................................................................................2-3
Mechanical Loading ................................................................................... 2-3
Circuit Overloading.....................................................................................2-3
Reliable Ground ......................................................................................... 2-3
2-5 Installing the System into a Rack ...................................................................2-4
Chapter 3 System Interface
3-1 Overview .........................................................................................................3-1
3-2 Nodes..............................................................................................................3-1
Power Button/LED...........................................................................................3-1
Warning LEDs.................................................................................................3-1
UID LED..........................................................................................................3-2
KVM Switch LED.............................................................................................3-2
3-3 Power Supply Module..................................................................................... 3-2
Power Module LED......................................................................................... 3-2
SUPERSERVER 5038ML-H24TRF User's Manual

vii
Table of Contents
Chapter 4 Standardized Warning Statements for AC Systems
4-1 About Standardized Warning Statements.......................................................4-1
Warning Definition........................................................................................... 4-1
Installation Instructions.................................................................................... 4-4
Circuit Breaker ................................................................................................ 4-5
Power Disconnection Warning........................................................................ 4-6
Equipment Installation.....................................................................................4-8
Restricted Area................................................................................................ 4-9
Battery Handling............................................................................................ 4-10
Redundant Power Supplies ..........................................................................4-12
Backplane Voltage ........................................................................................ 4-13
Comply with Local and National Electrical Codes........................................4-14
Product Disposal........................................................................................... 4-15
Hot Swap Fan Warning.................................................................................4-16
Power Cable and AC Adapter ...................................................................... 4-18
Chapter 5 Advanced Motherboard Setup
5-1 Handling the Motherboard ..............................................................................5-1
Precautions .....................................................................................................5-1
Unpacking .......................................................................................................5-1
5-2 Motherboard Installation/Removal...................................................................5-2
5-3 Connecting Cables..........................................................................................5-2
Data Cables .................................................................................................... 5-2
Connecting Power Cables ..............................................................................5-2
5-4 I/O Ports.......................................................................................................... 5-2
5-5 Processor and Heatsink Installation................................................................5-3
Installing an LGA1150 Processor....................................................................5-3
Installing a Heatsink........................................................................................5-6
5-6 Installing Memory............................................................................................ 5-7
How to Install Memory.................................................................................... 5-7
Memory Support..............................................................................................5-7
Memory Population Guidelines.......................................................................5-8
5-7 Motherboard Details........................................................................................ 5-9
X10SLE-DF Quick Reference.......................................................................5-10
5-8 Connector Definitions.....................................................................................5-11
5-9 Jumper Settings............................................................................................ 5-12
5-10 Onboard Indicators........................................................................................5-14
5-11 SATA Ports....................................................................................................5-15
5-12 Installing Software.........................................................................................5-16

viii
SuperDoctor® 5 ............................................................................................ 5-17
5-13 Onboard Battery............................................................................................5-18
Chapter 6 Advanced Chassis Setup
6-1 Static-Sensitive Devices..................................................................................6-1
Precautions .....................................................................................................6-1
6-2 Removing the Chassis Cover .........................................................................6-2
6-3 Corresponding Sleds and Fans ......................................................................6-3
6-4 Removing and Installing Sleds .......................................................................6-4
6-5 Installing/Removing Hard Drives..................................................................... 6-5
6-6 System Fans................................................................................................... 6-7
6-7 Power Supply..................................................................................................6-8
Power Supply Replacement............................................................................ 6-9
Chapter 7 BIOS
7-1 Introduction...................................................................................................... 7-1
Starting the BIOS Setup Utility .......................................................................7-1
How To Change the Configuration Data......................................................... 7-1
How to Start the Setup Utility .........................................................................7-2
7-2 Main Setup...................................................................................................... 7-2
7-3 Advanced Setup Configurations......................................................................7-4
7-4 Event Logs....................................................................................................7-23
7-5 IPMI ..............................................................................................................7-24
7-6 Boot Settings.................................................................................................7-27
7-7 Security Settings........................................................................................... 7-30
7-8 Save & Exit ................................................................................................... 7-31
Appendix A System Specifications
SUPERSERVER 5038ML-H24TRF User's Manual

Chapter 1
Introduction
1-1 Overview
The SuperServer 5038ML-H24TRF is a 24 node, MicroCloud server system com-
prised of the SC939HD-R2K02B 3U chassis and 12 X10SLE-DF motherboards.
Please refer to our web site for information on operating systems that have been
certified for use with the 5038ML-H24TRF (www.supermicro.com).
Various hardware components have been included with the system, as listed below:
• Four chassis fans (FAN-0149L4)
• Two passive heatsinks, each motherboard (SNK-P0047PSR)
• One air shroud, each motherboard (MCP-310-93902-0N)
• One 11.5-cm KVM/SUVI 30/28AWG dual USB cable, each motherboard (CBL-
0218L)
• One rail kit (MCP-290-41803-0N)
Optional parts for 2.5" slim SSD support:
• One 2.5" slim HDD mounting kit for the SC939, each motherboard (MCP-220-
93906-0N)
Note: For your system to work properly, please follow the links below to download
all necessary drivers/utilities and the user’s manual for your server.
• Supermicro product manuals: http://www.supermicro.com/support/manuals/
• Product drivers and utilities: ftp://ftp.supermicro.com
• Product safety info: http://super-dev/about/policies/safety_information.cfm
• If you have any questions, please contact our support team at:
[email protected]
Chapter 1: Introduction
1-1

1-2
SUPERSERVER 5038ML-H24TRF User's Manual
1-2 Motherboard Features
The 5038ML-H24TRF includes a total of 12 X10SLE-DF single processor mother-
boards, which are based on the Intel C224 PCH chipset. Each motherboard consti-
tutes two nodes in the system by supporting two independent CPUs. Below are the
main features of the X10SLE-DF. (See Figure 1-1 for a block diagram of the chipset.)
Processors
Each X10SLE-DF supports two Intel® Xeon® E3-1200 v3 processor (up to 80W) or
4th Gen Core i3, Pentium®, Celeron® processor in an LGA1150 socket (Socket H3).
Please refer to the motherboard description pages on our web site for a complete
listing of supported processors (www.supermicro.com).
Memory
Each X10SLE-DF consists of two nodes, each node has four DIMM slots that can
support up to 32 GB of ECC DDR3-1600/1333 UDIMM (Unbuffered), VLP(Very Low
Profile) memory. This equates to a maximum of 768 GB for the system. Memory
modules of the same size and speed should be used. See Chapter 5 for details.
SATA
A SATA controller integrated into the chipset provides a two-port SATA 3.0 subsys-
tem on each node. Each motherboard supports two 2.5” HDD or four 2.5" slim SSD
hard drives (with an optional kit).
Rear I/O Ports
The rear I/O panel on each motherboard includes one KVM connector, four Gb
Ethernet LAN ports (two for each node), one dedicated IPMI LAN port, a power
button and a node switch (for KVM).
IPMI
IPMI (Intelligent Platform Management Interface) is a hardware-level interface speci-
fication that provides remote access, monitoring and administration for Supermicro
server platforms. IPMI allows server administrators to view a server’s hardware
status remotely, receive an alarm automatically if a failure occurs, and power cycle
a system that is non-responsive. Each node features IPMI 2.0 with KVM over a
dedicated LAN port.

1-3
Chapter 1: Introduction
Figure 1-1. Intel C224 Chipset:
System Block Diagram
Note: This is a general block diagram. See Chapter 5 for details.
C224
PCH
Lynx Point
DDR3 (CHA)
Haswell
(H3)
VRM 12.5
SVID
DDR3 (CHB)
DIMM1
DIMM2(Far)
DIMM1
DIMM2(Far)
4 UDIMM
MISC VRs
1600/1333MHz
x4 DMI II
5.0Gb
1600/1333MHz
FLASH SPI
128Mb
SPI
C224
PCH
Lynx Point
DDR3 (CHA)
Haswell
(H3)
DDR3 (CHB)
DIMM1
DIMM2(Far)
DIMM1
DIMM2(Far)
4 UDIMM
1600/1333MHz
x4 DMI II
5.0Gb
1600/1333MHz
SPI FLASH SPI
128Mb
VRM 12.5
SVID
MISC VRs
PCIe 2.0 X 1
I-350-AM2
PCIe 2.0 X 1
I-350-AM2
4 ports stacked
RJ45 (1Gb)
(KVM Switch) ASPEED
ASP2400
ASPEED
ASP2400
PCIe 1.0 X 1 PCIe 1.0 X 1
VGA
(KVM Switch)
COM
(LAN Switch)
RTL8363SB
Dedicated LAN
(KVM Switch)
USB 2.0 X 2
USB 2.0 X 2
USB 2.0 X 2
AOM-BPN-MC24
SATA 3.0 X 2
SATA 3.0 X 2
6.0Gb/s 6.0Gb/s
480Mb/s 480Mb/s
4 X SATA 3.0
CONNECTORS
NODE 1 NODE 2

1-4
SUPERSERVER 5038ML-H24TRF User's Manual
1-3 Server Chassis Features
The following is a general outline of the main features of the SC939HD-R2K02B
server chassis.
System Power
The SC939HD-R2K02B features a redundant 2000W high-efficiency power supply
comprised of two separate power modules. This power redundancy feature allows
you to replace a failed power supply without shutting down the system.
Note: for the PWS-2K02P-1R power supply you will need to use the C13 to C14
size 14AWG wire power cord set (14AWG/250V/15A, 3FT) for the rack. See Chapter
6 for further details.
Cooling System
The SC939HD-R2K02B chassis includes four 9-cm fans located at the rear of the
chassis. Each motherboard also has an air shroud to channel the airflow from the
system fans to efficiently cool the components that generate the most heat.

1-5
Chapter 1: Introduction
1-4 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Web Site: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Asia-Pacific
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 23511
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Web Site: www.supermicro.com.tw
Technical Support:
Email: [email protected]
Tel: [phone]

1-6
SUPERSERVER 5038ML-H24TRF User's Manual
Notes

Chapter 2: Server Installation
2-1
Chapter 2
Server Installation
2-1 Overview
This chapter outlines the procedure to set up your system and install it to a rack. If
your system is not already fully integrated with a motherboard, processors, system
memory etc., please turn to the chapter or section noted in each step for details on
installing specific components.
2-2 Unpacking the System
You should inspect the box the system was shipped in and note if it was damaged
in any way. If the server itself shows damage you should file a damage claim with
the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the server. It should be
situated in a clean, dust-free area that is well ventilated. Avoid areas where heat,
electrical noise and electromagnetic fields are generated. You will also need it placed
near a grounded power outlet. Be sure to read the Rack and Server Precautions
in the next section.
2-3 Preparing for Setup
The server may have come with hardware to mount the system into a server rack. If
mounting to a rack with the rail kit, follow the steps in the order given to complete the
installation process in a minimum amount of time. Please read this section in its en-
tirety before you begin the installation procedure outlined in the sections that follow.
Choosing a Setup Location
• Leave enough clearance in front of the rack to enable you to open the front door
completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for sufficient airflow and ease in servicing.
• This product is for installation only in a Restricted Access Location (dedicated
equipment rooms, service closets and the like).

2-2
SUPERSERVER 5038ML-H24TRF User's Manual
• This product is not suitable for use with visual display work place devices
acccording to §2 of the the German Ordinance for Work with Visual Display Units.
2-4 Warnings and Precautions
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are fully extended to
the floor with the full weight of the rack resting on them.
• In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a component from it.
• You should extend only one component at a time - extending two or more si-
multaneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Chapter 4.
• Determine the placement of each component in the rack before you install the
rails.
• Install the heaviest server components on the bottom of the rack first, and then
work up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
• Allow the hot plug drives and power supplies to cool before touching them.
• Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.

Chapter 2: Server Installation
2-3
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating tempera-
ture of the rack environment may be greater than the ambient temperature of the
room. Therefore, consideration should be given to installing the equipment in an
environment compatible with the manufacturer’s maximum rated ambient tempera-
ture (Tmra).
Reduced Airflow
Equipment should be mounted into a rack so that the amount of airflow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself
should be grounded. Particular attention should be given to power supply connec-
tions other than the direct connections to the branch circuit (i.e. the use of power
strips, etc.).
Warning! To prevent bodily injury when mounting or servicing this unit in a
rack, you must take special precautions to ensure that the system remains
stable. The following guidelines are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in
the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom
to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before
mounting or servicing the unit in the rack.

2-4
SUPERSERVER 5038ML-H24TRF User's Manual
2-5 Installing the System into a Rack
Use the procedure below for installing the system to a rack.
1. Decide where you want to place the system into the rack (see "Rack Mount-
ing Considerations" in the previous section).
2. Position the template at the front of the system to determine the locations of
the screws for the chassis rails (see Figure 2-1).
Figure 2-1. Positioning the Template
3. The two rail sections are screwed together to keep them immobile during
shipping. Release these screws just enough to allow the rails to slide apart.
Note the arrow on the rail, which indicates the end that attaches to the front
of the rack.
4. Slide the rails apart far enough to match the depth of the rack. Position the
rails with the template and secure the front of each to the front of the rack
with two flathead screws, then secure the back of each rail to the rear of the
rack with two flathead screws (see Figure 2-2). Note that the rails are left/right
specific and very heavy.
5. (Optional step) Add the front left and right handles to the chassis using
screws to secure each handle. Install a thumbscrew through the bottom hole
of each handle.

Chapter 2: Server Installation
2-5
Figure 2-2. Securing the Rails to the Rack
Note: These handles are optional and need only be installed when mounting the
system into a short rack. When mounting into a deep rack, they are unnecessary
and regular screws should be used instead of thumbscrews.
6. With one person on either side, lift the system and slide it into the installed
rails.
7. After pushing the enclosure all the way into the rack, use two roundhead
screws on each side of the server to lock it into place.
Warning: do not pick up the server with the front handles. They are de-
signed to pull the system from a rack only.

2-6
SUPERSERVER 5038ML-H24TRF User's Manual
Figure 2-3. Installing to the Rack
Stability hazard. The rack stabilizing mechanism must be in place, or the
rack must be bolted to the floor before you slide the unit out for servicing.
Failure to stabilize the rack can cause the rack to tip over.
Note: this figure is for illustrative purposes only. Always install servers to the bot-
tom of a rack first.