Supero MicroCloud 5038ML-H8TRF User manual

SUPER
SUPERSERVER
MicroCloud
5038ML-H8TRF
®
USER’S MANUAL
Revision 1.0

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and docu-
mentation, is the property of Supermicro and/or its licensors, and is supplied only under a license.
Any use or reproduction of this product is not allowed, except as expressly permitted by the terms
of said license.
IN NO EVENT WILLSUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATASTORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in a commercial environ-
ment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed
and used in accordance with the manufacturer’s instruction manual, may cause harmful interference
with radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warn-
ing applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to the
State of California to cause birth defects and other repro-
ductive harm.
Manual Revision 1.0
Release Date: August 7, 2013
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2013 by Super Micro Computer, Inc.
All rights reserved.
Printed in the United States of America

Preface
About This Manual
This manual is written for professional system integrators and PC technicians. It
provides information for the installation and use of the SuperServer 5038ML-H8TRF.
Installation and maintenance should be performed by experienced technicians only.
The SuperServer 5038ML-H8TRF is an 8-node, MicroCloudTM server system based
on the SC938BH-R1620B 3U chassis and eight X10SLD-F motherboards.
Manual Organization
Chapter 1: Introduction
The first chapter provides a checklist of the main components included with the
system and describes the main features of the Super X10SLD-F motherboard and
the SC938BH-R1620B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the server into a rack and
check out the server configuration prior to powering up the system. If your server
was ordered without the processor and memory components, this chapter will refer
you to the appropriate sections of the manual for their installation.
Chapter 3: System Interface
Refer to this chapter for details on the system interface, which includes the functions
and information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
Chapter 4: Standardized Warning Statements
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 5038ML-H8TRF.
iii
Preface

SUPERSERVER 5038ML-H8TRF User's Manual
iv
Chapter 5: Advanced Motherboard Setup
Chapter 5 provides detailed information on the X10SLD-F motherboard, including
the locations and functions of connectors, headers and jumpers. Refer to this chap-
ter when adding or removing processors or main memory and when reconfiguring
the motherboard.
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC938BH-R1620B 3U server
chassis. You should follow the procedures given in this chapter when installing,
removing or reconfiguring drives and when replacing system power supply units
and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed informa-
tion on running the CMOS Setup Utility.
Appendix A: BIOS Error Beep Codes
Appendix B: System Specifications

v
Preface
Notes

vi
Table of Contents
Chapter 1 Introduction
1-1 Overview .........................................................................................................1-1
1-2 Motherboard Features.....................................................................................1-2
Processors ......................................................................................................1-2
Memory ...........................................................................................................1-2
SATA .............................................................................................................. 1-2
Rear I/O Ports.................................................................................................1-2
IPMI.................................................................................................................1-2
Other Features................................................................................................1-2
1-3 Server Chassis Features ................................................................................1-4
System Power................................................................................................. 1-4
Front Control Panel.........................................................................................1-4
Cooling System............................................................................................... 1-4
1-4 Contacting Supermicro....................................................................................1-5
Chapter 2 Server Installation
2-1 Overview .........................................................................................................2-1
2-2 Unpacking the System.................................................................................... 2-1
2-3 Preparing for Setup.........................................................................................2-1
Choosing a Setup Location............................................................................. 2-1
2-4 Warnings and Precautions.............................................................................. 2-2
Rack Precautions............................................................................................ 2-2
Server Precautions..........................................................................................2-2
Rack Mounting Considerations.......................................................................2-2
Ambient Operating Temperature................................................................2-2
Reduced Airflow .........................................................................................2-3
Mechanical Loading ................................................................................... 2-3
Circuit Overloading.....................................................................................2-3
Reliable Ground ......................................................................................... 2-3
2-5 Installing the System into a Rack ...................................................................2-4
Identifying the Sections of the Rack Rails......................................................2-4
Locking Tabs ...................................................................................................2-5
Releasing the Inner Rail .................................................................................2-5
Installing The Inner Rails on the Chassis.......................................................2-6
Installing the Outer Rails on the Rack............................................................2-7
Standard Chassis Installation ......................................................................... 2-8
Optional Quick Installation Method.................................................................2-9
SUPERSERVER 5038ML-H8TRF User's Manual

vii
Table of Contents
Chapter 3 System Interface
3-1 Overview .........................................................................................................3-1
3-2 Control Panel Buttons..................................................................................... 3-1
3-3 LEDs................................................................................................................ 3-2
3-4 Hard Drive Carrier LEDs................................................................................. 3-3
3-5 Node LEDs......................................................................................................3-3
Chapter 4 Standardized Warning Statements for AC Systems
4-1 About Standardized Warning Statements.......................................................4-1
Warning Definition........................................................................................... 4-1
Installation Instructions.................................................................................... 4-4
Circuit Breaker ................................................................................................ 4-5
Power Disconnection Warning........................................................................ 4-6
Equipment Installation.....................................................................................4-8
Restricted Area................................................................................................ 4-9
Battery Handling............................................................................................ 4-10
Redundant Power Supplies .......................................................................... 4-12
Backplane Voltage ........................................................................................ 4-13
Comply with Local and National Electrical Codes........................................4-14
Product Disposal........................................................................................... 4-15
Hot Swap Fan Warning.................................................................................4-16
Power Cable and AC Adapter ...................................................................... 4-18
Chapter 5 Advanced Motherboard Setup
5-1 Handling the Motherboard .............................................................................. 5-1
Precautions .....................................................................................................5-1
Unpacking .......................................................................................................5-2
5-2 Connecting Cables..........................................................................................5-2
5-3 I/O Ports.......................................................................................................... 5-2
5-4 Installing the Processor and Heatsink ............................................................5-3
Installing an LGA1150 Processor....................................................................5-3
Installing a CPU Heatsink............................................................................... 5-6
5-5 Installing Memory............................................................................................ 5-7
Memory Support..............................................................................................5-7
Memory Population Guidelines.......................................................................5-8
5-6 Adding PCI Add-On Cards.............................................................................. 5-9
5-7 Motherboard Details.......................................................................................5-11
X10SLD-F Quick Reference..........................................................................5-12
5-8 Connector Definitions ...................................................................................5-13
5-9 Jumper Settings............................................................................................ 5-15

viii
5-10 Onboard Indicators........................................................................................5-17
5-11 SATA Drive Connections............................................................................... 5-17
5-12 Installing Software.........................................................................................5-18
SuperDoctor III.............................................................................................. 5-19
5-13 Onboard Battery............................................................................................5-20
Chapter 6 Advanced Chassis Setup
6-1 Static-Sensitive Devices..................................................................................6-1
Precautions .....................................................................................................6-1
6-2 Removing the Chassis Cover .........................................................................6-2
6-3 Corresponding Nodes, Fans and Hard Drives................................................ 6-3
6-4 Removing and Installing Hard Drives .............................................................6-4
6-5 Removing and Installing the Backplane.......................................................... 6-7
Removing the Backplane and Fan Bracket Assembly....................................6-7
Removing the Backplane from the Fan Bracket.............................................6-8
Installing the Backplane onto the Fan Bracket............................................... 6-9
Installing the Backplane and Fan Bracket Assembly.................................... 6-10
6-6 Removing and Installing Motherboard Nodes................................................6-11
6-7 Installing an Air Shroud.................................................................................6-12
6-8 System Fans................................................................................................. 6-13
6-9 Power Supply................................................................................................ 6-14
Power Supply Replacement.......................................................................... 6-14
Chapter 7 BIOS
7-1 Introduction...................................................................................................... 7-1
Starting BIOS Setup Utility..............................................................................7-1
How To Change the Configuration Data......................................................... 7-1
How to Start the Setup Utility ......................................................................... 7-2
7-2 Main Setup...................................................................................................... 7-2
7-3 Advanced Setup Configurations......................................................................7-4
7-4 Event Logs....................................................................................................7-23
7-5 IPMI............................................................................................................... 7-25
7-6 Boot Settings.................................................................................................7-27
7-7 Security Settings........................................................................................... 7-29
7-8 Save & Exit ................................................................................................... 7-30
Appendix A BIOS Error Beep Codes
Appendix B System Specifications
SUPERSERVER 5038ML-H8TRF User's Manual

Chapter 1
Introduction
1-1 Overview
The SuperServer 5038ML-H8TRF is an eight node, MicroCloud server system
comprised of two main subsystems: the SC938BH-R1620B 3U chassis and eight
X10SLD-F motherboards. Please refer to our web site for information on operating
systems that have been certified for use with the 5038ML-H8TRF (www.supermicro.
com).
In addition to the motherboards and chassis, various hardware components have
been included with the 5038ML-H8TRF, as listed below:
• Four chassis fans (FAN-0133L4)
• One passive heatsink, each node (SNK-P0047PS+)
• One air shroud, each node (MCP-310-93804-0B)
• One riser card, each node (RSC-RR1U-E8)
• One add-on card, each node (AOC-CGP-i2)
• SATA Accessories
One SATA backplane (BPN-SAS-938H)
Sixteen hot-swap hard drive carriers (MCP-220-00094-0B)
• One rail kit (MCP-290-00057-0N)
Chapter 1: Introduction
1-1

1-2
SUPERSERVER 5038ML-H8TRF User's Manual
1-2 Motherboard Features
The 5038ML-H8TRF includes a total of eight X10SLD-F single processor mother-
boards, which are based on the Intel C224 PCH chipset. Below are the main features
of the X10SLD-F. (See Figure 1-1 for a block diagram of the chipset).
Processors
Each X10SLD-F supports a single Intel® Xeon® E3-1200 v3 family or Intel 4th
Gen Core™ i3, Pentium or Celeron processor in an LGA 1150 socket (Socket H3).
Please refer to the motherboard description pages on our web site for a complete
listing of supported processors (www.supermicro.com).
Memory
The X10SLD-F has four DIMM slots that can support up to 32 GB of ECC UDIMM
DDR3-1600/1333/1066 memory. This equates to a maximum of 256 GB for the
system. Memory modules of the same size and speed should be used. See Chapter
5 for details.
SATA
Each X10SLD-F has a SATAcontroller integrated into the chipset to provide four on-
board SATA3.0 ports. Two of these can be connected to the system's hot-swappable
SATA drives (two from each node for 16 total in the system).
Rear I/O Ports
The rear I/O panel includes one KVM connector, an IPMI port, a power LED and
buttons for UID (Unit Identification) and power.
IPMI
IPMI (Intelligent Platform Management Interface) is a hardware-level interface speci-
fication that provides remote access, monitoring and administration for Supermicro
server platforms. IPMI allows server administrators to view a server’s hardware
status remotely, receive an alarm automatically if a failure occurs, and power cycle
a system that is non-responsive.
Other Features
Other onboard features that promote system health include onboard voltage moni-
tors, a chassis intrusion header, auto-switching voltage regulators, chassis and CPU
overheat sensors, virus protection and BIOS rescue.

1-3
Chapter 1: Introduction
Figure 1-1. Intel C224 Chipset:
System Block Diagram
Note: This is a general block diagram. See Chapter 5 for details.
RJ45
(1Gb)
C224/C226
PCH
SATA-III
4 SATA PORTS
RGMII
VGA PORT
(KVM)
RTL8211E
PHY
ASPEED
ASP2400
PCIe2.0 x1
LPC
COM1 (KVM)
LPC
HEALTH
INFO
6.0Gb/s
LPC
TPM1.2 Header
Lynx Point
DDR3 (CHA)
Haswell
(H3)
PCIe3.0_x8
VRM 12.5
SVID
LPC I/O
NCT6776D
PCIe x8 Micro-LP SLOT
DDR3 (CHB)
DIMM1
DIMM2 (Far)
DIMM1
DIMM2 (Far)
MISC VRs
1600/1333MHz
8.0Gb/s
x4 DMI II
5.0Gb
FLASH SPI 128Mb
SPI
1600/1333MHz
2 USB PORTS
SATA-II
1 SATA PORT
(3.0Gb/s for-F, 6.0Gb/s for-HF)
USB3.0 X 1
5.0Gb/s
1 USB PORT (Type A)
USB2.0 X 1
480Mb/s
PCIe3.0_x8
PCIe x8 SLOT
USB2.0 X 3
480Mb/s
2 USB PORTS (KVM)
USB3.0 X 1
5.0Gb/s

1-4
SUPERSERVER 5038ML-H8TRF User's Manual
1-3 Server Chassis Features
The following is a general outline of the main features of the SC938BH-R1620B
server chassis.
System Power
The SC938BH-R1620B features a redundant (two separate power modules) 1620W
Platinum Level, high-efficiency power supply. This power redundancy feature allows
you to replace a failed power supply without shutting down the system.
Front Control Panel
The control panel on the 5038ML-H8TRF features a power button/LED, a power fail
LED and eight LEDs to indicate the status of each node in the system.
Cooling System
The SC938BH-R1620B chassis includes four 8-cm fans located behind the back-
plane. Each fan is associated with and controlled by two nodes. Each node also
has an air shroud to channel the airflow from the system fans to efficiently cool the
components that generate the most heat. See Chapter 6 for details.

1-5
Chapter 1: Introduction
1-4 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
Web Site: www.supermicro.com
Europe
Address: Super Micro Computer B.V.
Het Sterrenbeeld 28, 5215 ML
's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [email protected] (General Information)
[email protected] (Technical Support)
[email protected] (Customer Support)
Asia-Pacific
Address: Super Micro Computer, Inc.
3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 23511
Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Web Site: www.supermicro.com.tw
Technical Support:
Email: [email protected]
Tel: [phone]

1-6
SUPERSERVER 5038ML-H8TRF User's Manual
Notes

Chapter 2: Server Installation
2-1
Chapter 2
Server Installation
2-1 Overview
This chapter provides a quick setup checklist to get your 5038ML-H8TRF up and
running. Following these steps in the order given should enable you to have the
system operational within a minimum amount of time. This quick setup assumes
that your system has come to you with the processors and memory preinstalled.
2-2 Unpacking the System
You should inspect the box the 5038ML-H8TRF was shipped in and note if it was
damaged in any way. If the server itself shows damage you should file a damage
claim with the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the 5038ML-H8TRF.
It should be situated in a clean, dust-free area that is well ventilated. Avoid areas
where heat, electrical noise and electromagnetic fields are generated. You will also
need it placed near a grounded power outlet. Be sure to read the Rack and Server
Precautions in the next section.
2-3 Preparing for Setup
The 5038ML-H8TRF may have come with hardware to mount it into a server rack. If
mounting to a rack with the rail kit, follow the steps in the order given to complete the
installation process in a minimum amount of time. Please read this section in its en-
tirety before you begin the installation procedure outlined in the sections that follow.
Choosing a Setup Location
• Leave enough clearance in front of the rack to enable you to open the front door
completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for sufficient airflow and ease in servicing.
• This product is for installation only in a Restricted Access Location (dedicated
equipment rooms, service closets and the like).

2-2
SUPERSERVER 5038ML-H8TRF User's Manual
• This product is not suitable for use with visual display work place devices
acccording to §2 of the the German Ordinance for Work with Visual Display Units.
2-4 Warnings and Precautions
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are fully extended to
the floor with the full weight of the rack resting on them.
• In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a component from it.
• You should extend only one component at a time - extending two or more si-
multaneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Chapter 4.
• Determine the placement of each component in the rack before you install the
rails.
• Install the heaviest server components on the bottom of the rack first, and then
work up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
• Allow the SATA drives and power supply modules to cool before touching them.
• Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating tempera-
ture of the rack environment may be greater than the ambient temperature of the

Chapter 2: Server Installation
2-3
room. Therefore, consideration should be given to installing the equipment in an
environment compatible with the manufacturer’s maximum rated ambient tempera-
ture (Tmra).
Reduced Airflow
Equipment should be mounted into a rack so that the amount of airflow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself
should be grounded. Particular attention should be given to power supply connec-
tions other than the direct connections to the branch circuit (i.e. the use of power
strips, etc.).
Warning! To prevent bodily injury when mounting or servicing this unit in a
rack, you must take special precautions to ensure that the system remains
stable. The following guidelines are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in
the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom
to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before
mounting or servicing the unit in the rack.

2-4
SUPERSERVER 5038ML-H8TRF User's Manual
2-5 Installing the System into a Rack
This section provides information on installing the chassis into a rack unit with the
rails provided. There are a variety of rack units on the market, which may mean
that the assembly procedure will differ slightly from the instructions provided. You
should also refer to the installation instructions that came with the rack unit you are
using. Note: This rail will fit a rack between 26.5" and 36.4" deep.
Identifying the Sections of the Rack Rails
The chassis package includes two rail assemblies in the rack mounting kit. Each
assembly consists of three sections: An inner chassis rail that secures directly to
the chassis, an outer rail that secures to the rack, and a middle rail, which extends
from the outer rail. These assemblies are specifically designed for the left and right
side of the chassis.
Figure 2-1. Identifying the Outer, Middle and Inner Rails
(Left Rail Assembly Shown)
Inner Rail
Rail Assembly
(Shown with Rails
Retracted)
This Side Faces
Outward
Locking Tab
Middle Rail
Outer Rail
Warning: do not pick up the server with the front handles. They are de-
signed to pull the system from a rack only.

Chapter 2: Server Installation
2-5
Figure 2-2. Extending and Releasing the Inner Rail
1
2
1
1
1
3
1
4
Locking Tabs
Each inner rail has a locking tab. This tab locks the chassis into place when installed
and pushed fully into the rack. These tabs also lock the chassis in place when fully
extended from the rack. This prevents the server from coming completely out of
the rack when when the chassis is pulled out for servicing.
Releasing the Inner Rail
Releasing Inner Rail from the Outer Rails
1. Identify the left and right outer rail assemblies as described on the previous
page.
2. Pull the inner rail out of the outer rail until it is fully extended as illustrated
below.
3. Press the locking tab down to release the inner rail.
4. Repeat steps 1-3 for the remaining outer rail.

2-6
SUPERSERVER 5038ML-H8TRF User's Manual
Figure 2-3. Installing the Inner Rails
Figure 2-4. Inner Rails Installed on the Chassis
Installing The Inner Rails on the Chassis
Installing the Inner Rails
1. Confirm that the left and right inner rails have been correctly identified.
2. Place the inner rail firmly against the side of the chassis, aligning the hooks
on the side of the chassis with the holes in the inner rail.
3. Slide the inner rail forward toward the front of the chassis until the rail clicks
into the locked position, which secures the inner rail to the chassis.
4. Secure the inner rail to the chassis with the screws provided.
5. Repeat steps 1 through 4 above for the other inner rail.
1
3
1
4
1
4
1
2
Inner Rails