Supermicro SuperBlade SBS-820H-420P User manual

USER’S MANUAL
Revision 1.0
®


The information in this User’s Manual has been carefully reviewed and is believed to be accurate. The vendor assumes
no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update

www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual
at any time and without notice. This product, including software and documentation, is the property of Supermicro and/
or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except
as expressly permitted by the terms of said license.
              



           

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the
State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution
of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.


  

installed and used in accordance with the manufacturer’s instruction manual, may cause harmful interference with
         



See www.dtsc.ca.gov/hazardouswaste/perchlorate”.
WARNING: This product can expose you to chemicals including
lead, known to the State of California to cause cancer and birth
defects or other reproductive harm. For more information, go
to www.P65Warnings.ca.gov.
!

nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical

property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products
  
indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and

Manual Revision 1.0
 mk


to herein are trademarks or registered trademarks of their respective companies or mark holders.

All rights reserved.
Printed in the United States of America

3

Preface
About this Manual
            
information for the installation and use of the server. Installation and maintenance should be
performed by experienced technicians only.

on supported memory, processors and operating systems ().
Notes
For your system to work properly, please follow the links below to download all necessary
drivers/utilities and the user’s manual for your server.
• 
• 
• 

[email protected]m

for possible updates to the manual revision level.
Secure Data Deletion
A secure data deletion tool designed to fully erase all data from storage devices can be found
   

Warnings
Special attention should be given to the following symbols used in this manual.
Warning! Indicates high voltage may be encountered when performing a procedure.
Warning! 




Contents
Chapter 1 Introduction
1.1 Overview...............................................................................................................................9
  ................................................................................................................10
Front View .........................................................................................................................10
..................................................................................................11
.......................................................................................................
Rear View..........................................................................................................................13
..................................................................................................
.................................................................................................................
 ................................................................................................16
 ...............................................................................................................17
 .............................................................................................
Chapter 2 Server Installation
 .............................................................................................................................19
  .......................................................................................................19
  ............................................................................................................19
Choosing a Setup Location...............................................................................................19
 ..............................................................................................................
............................................................................................................
Rack Mounting Considerations .........................................................................................
Ambient Operating Temperature....................................................................................
 ............................................................................................................................
Mechanical Loading.......................................................................................................
Circuit Overloading ........................................................................................................
.............................................................................................................
  ......................................................................................................
Chapter 3 Installation and Setup
3.1 Unpacking the System .......................................................................................................
  ....................................................................................
 ........................................................................................
.................................................................................................
............................................................................................



 ................................................................................
.........................................................................
 .....................................................................
 ........................................................................
...................................................................................
 ......................................................................................
 ...........................................................................31
...........................................................................
 .......................................................................
 ..............................................36
........................................................37
3.7 Memory...............................................................................................................................
Memory Support................................................................................................................
 .........................................................................................39
 ............................................................................39
........................................................................................................39
 ......................................................................................39
Installing Memory...........................................................................................................
 ...........................................................................................................
 ....................................................................................................................
.................................................................................................................
...............................................................................................
..................................................................
 .....................................................................................................................
3.10 Cooling .............................................................................................................................
Fans, Enclosure ................................................................................................................
Auxiliary Fans ................................................................................................................
 ............................................................................................................
Checking the Server Air Flow........................................................................................
Overheating.......................................................................................................................
3.11Installing Components........................................................................................................
Chapter 4 Power
 .............................................................................................................
 .......................................................................................................................

6

 ...................................................................................................
................................................................................................
  .........................................................................................................
...............................................................................................
  ...........................................................................................................
.......................................................................................................
 ..............................................................................................
Chapter 5 Chassis Management Module
  .............................................................................................................................
Capabilities........................................................................................................................
Module Redundancy .........................................................................................................
 ...................................................................
  ..........................................................................................................................
  .........................................................................................................
 ............................................................................60
  ..................................................................................................................
 ........................................................................................................
Remote Storage (Virtual Media) .......................................................................................
Serial Over LAN (SOL) .....................................................................................................
Monitoring Functions.........................................................................................................63
....................................................................................63
  .............................................................................................63
 .............................................................................................................................
  .........................................................................................
..........................................................................................................
Network Connection/Login ................................................................................................
...............................................................................................................
 .......................................................................................................................
Chapter 6 SuperBlade HDR 200G InniBand Blade Switch
6.1 Overview.............................................................................................................................66
Module Managment...........................................................................................................66
  ............................................................................................................................67
6.3 Installation ..........................................................................................................................

7

  .....................................................................................................................69
....................................................................................................69
 ..........................................................................69
........................................................................................................69
Enclosure Compatibility.....................................................................................................69
 ......................................................................................................................70
6.6 Cabling and Transceiver Compatibility...............................................................................71
Chapter 7 Motherboard Connections
  ............................................................................................................
  ...................................................................................................
 ..............................................................................................................................
 .................................................................................................
 ....................................................................................................................
Chapter 8 Blade Software
..........................................................................................76
............................................................76
Microsoft Windows OS Installation ...................................................................................77
 ................................................................................................................79
 ®...................................................................................................................
 ....................................................................................................................................
 ...........................................................................................
Chapter 9 Optional Components
 .........................................................................................................
 ....................................................................................
.........................................................................................
 ..........................................................................
Additional Information .......................................................................................................
 ...................................................................................................................
....................................................................................
Status Indications..............................................................................................................90
 ...............................................................................................................90
 .....................................................................................................................90
 .........................................................................................................................90
Related Information Links .................................................................................................90



Chapter 10 Troubleshooting and Support
10.1 Information Resources ......................................................................................................91
Website .............................................................................................................................91
................................................................91
 .......................................................91
 ...................................................................................................................
 ............................................................................................93
 ..........................................................................................................................93
No Video ...........................................................................................................................
.........................................................................................................
Memory Errors ..................................................................................................................
 ...........................................................................
 ..............................................................................
 ......................................................................................96
 ..........................................................................................96
..........................................................................97
 ........................................................................................................
Overview ...........................................................................................................................
....................................................................................
......................................................
10.7 CMOS Clear....................................................................................................................103
......................................................................................................................103
.......................................................................
10.10 Reporting an Issue........................................................................................................
 ........................................................................................
Returning Merchandise for Service.................................................................................
Vendor Support Filing System ........................................................................................
10.11 Feedback.......................................................................................................................
..................................................................................................106
Appendix A Standardized Warning Statements for AC Systems
Appendix B System Specications

9
Chapter 1: Introduction
Chapter 1
Introduction
1.1 Overview


System Overview
Blades 
Enclosure 
Motherboard (per node)
Processor (per node)

Memory
(per node)



and selected Silver processors.
Switch Modules



Drive Support
(per node)


System Cooling
Eight heavy duty fans with Optimal Fan Speed Control
Air Shrouds

Power 
Form Factor 
product page of the Supermicro
website.
           


10
Chapter 1: Introduction
1.2 System Features
The following views of the system display the main features. Refer to  for additional

Front View
Figure 1-1. Front View
Status
Indicators
LAN Port
Console Port
System Front Features
Feature Description
Status
Indicators


 Network port for the blade system
 Serial console port for the CMM

11
Chapter 1: Introduction
Blade Front View
Item Description
01
2
 
KVM Keyboard, video, mouse connector
Service/Asset
Tag 
Drive Carrier Indicators



VROC section in this manual.
Drive Carrier LED Indicators
Color Blinking Pattern Behavior for Device
Activity
LED
 Solid On Idle SAS or NVMe drive installed
  I/O activity
󰀨 Idle SATA or no drive
Status
LED
Red Solid On Failure of drive with RSTe support
Red  Rebuild drive with RSTe support
Red  Identify drive with RSTe support
Red 


Red 
󰀨

Amber  Safe to remove NVMe drive
 Solid on 
Figure 1-2. Blade Front View
KVM
Control Panel
1
2
0
Service/Asset Tab
with BMC Password


Chapter 1: Introduction
Control Panel Features
Features Color/State Description


power is maintained.
" in Chapter 6.

 
 
Amber, steady 󰀨

 Indicates that KVM has been initialized

slowly

management program.)


 

 󰀩
module
 󰀩
 Red 
other fatal error that prevents the operating system from booting.
Blade Control Panel
Figure 1-3. Control Panel
Power Button
KVM/UID LED
Power LED
NIC LED
System Fail LED

13
Chapter 1: Introduction
Rear Features
Feature Description
1Eight power supply modules with fans (see )
Three pairs of auxiliary fans
3Chapter 6)
Chassis Management Module (CMM) (see )

Figure 1-4. SBE-820H-822 Rear View
3
1
2
1
1
1
1
1
1
1
4
22
Rear View
5 5


Chapter 1: Introduction
Power Supply Indicator

Power Supply Indicator
LED Color and State Power Supply Condition
 Indicates that the power supply is on
 󰀨
 Indicates that the power supply has a warning condition and continues to operate.
Solid Amber Indicates that the power supply is plugged in, and is in an abnormal state. The

󰀨 No AC power to modules


Chapter 1: Introduction
Top View, Blade
Figure 1-5. System: Top View
Control Board
CPU under
Heatsink
M.2 Slot
under PCB
Memory
under an
Air Shroud
Memory
under an
Air Shroud
CPU under
Heatsink
Asset Tab
Pull-out

16
Chapter 1: Introduction
Figure 1-7. Motherboard Layout
1.3 Blade Motherboard Layout

shown. See the table on the following page for descriptions. For detailed descriptions, pinout
Chapter 7or the Motherboard Manual.
HDD0
JFP1
LEDM1
DA7 DA6
MEZZ2
MEZZ1
MP1
PWR1
JM2-1
I-SATA1
HDD2_PWR
JPME1
LED1
BIOS
JTPM1
JBT1
JRK1
BT1
JLED
HDD1
PCH
BMC
LAN CTRL
BMC
Memory
CPLD0
DA5
MB PWR
25G Midplane
Dual Boot
for CPLD
CPLD
Flash
VROC
CPLD
DA4
M.2
MH
BMC Flash
BAR CODE
MAC CODE
REV:1.00
B12DPT-6
P2-DIMMC1
P2-DIMMF1
P2-DIMME1 P2-DIMMH1 P2-DIMMG1
P2-DIMMA1 P2-DIMMD1 P2-DIMMB1
P1-DIMMF1 P1-DIMMH1 P1-DIMME1 P1-DIMMG1
CPU2
CPU1
P1-DIMMD1 P1-DIMMC1 P1-DIMMB1 P1-DIMMA1
FAN1
HDD2 PWR
P2-DIMMC1
BT1
D7
P2-DIMMD1
P2-DIMMA1
P2-DIMMB1
P1-DIMMG1
P1-DIMMH1
P1-DIMME1
P1-DIMMF1
I-SATA1
JTPM1
JPME1
MEZZ1
LEDM1
VROC(JRK1)
MB PWR
FAN1
P2-DIMMG1
P2-DIMMF1
P2-DIMMH1
P2-DIMME1
25G Midplane
CPLD
JLED
JBT1
MEZZ2
D5
HDD1JM2-1
LED1
D6
D4
CPLD0
HDD0
M.2 MH
(Mounting Hole)
JFP1
P1-DIMMB1
P1-DIMMA1
P1-DIMMD1
P1-DIMMC1
BIOS
BMC Flash

17
Chapter 1: Introduction
Quick Reference
Jumper Description Default Setting
 CMOS Clear Open (Normal)
 ME Manufacturing Recovery 
Connector Description
 Onboard CMOS battery
 
FAN1 
 
 
 Contacts for CMOS Clear
 
 
  
 
 
 
 
 
 
LED Description State: Status
  
  
  
  
  
  


Chapter 1: Introduction
Figure 1-8. Motherboard Block Diagram
Motherboard Block Diagram
LAN3 (To CMM)
RGRMII
PCIe GEN2 X1
USB 2.0
#12 USB2.0
PCH
6.0 Gb/S
USB 2.0
RTL8211FS
-VS-CG
ESPI
Temperature Sensor
TMP432 RT1/RT2/RT8
AST2600
BMC
#5 DDR4
2666/2933/3200
DDR4
P2
P1
P0
P1
UPI
4RDD4RDD
10.4/11.2G
UPI
2UPC1UPC
DMI X4
SATA/NVMe
SAS (Optional)
SATA0-1
SSATA0
Mezzanine Connector
(For SAS AOC)
MEZZ2
VGA/ USBx2/ COM1
To KVM connector
JFP1
USB2_1
USB2_2
USB 3.0
USB3_4
USB2_8
USB3.0 Type A
JUSB0
CPU1-A1
2666/2933/3200
DDR4
CPU1-B1
2666/2933/3200
DDR4
CPU1-C1
2666/2933/3200
DDR4
CPU1-D1
CPU1-E1CPU1-H1
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
2666/2933/3200
DDR4
CPU2-D1
2666/2933/3200
DDR4
CPU2-C1
2666/2933/3200
DDR4
CPU2-B
1
2666/2933/3200
DDR4
CPU2-A1
CPU2-H1CPU2-E1
#3
PORT1
PORT0
Mellanox
FLASH
T27712A0
SPI
PORT2
PORT0
10/25G
10/25G
PCIe GEN3 X8
U46
U36
MP1
#0 #1
#2
6.0 Gb/S
SATA
SATA2
PCIe GEN4 X16
Mezzanine Connector
(For NIC AOC)
MEZZ1
PCIe GEN4 X8
UPI
P0 P2
ConnectX-4 Lx En
VGA/COM1/Temperature Sensor
USB2_5
USB2_7
SPI
CPLD
(PFR)
SPI
SPI
CPLD
FLASH
Debug Card
BMC Boot Flash
SPI
TPM HEADER BIOS
SPIDUAL
BOOT
PCIe GEN4 X16 PCIe GEN4 X4
PCIe X8
PCIe
X4
PCIe
X4
M.2
UPI
#2 #1
#0
DMI3
DMI3
Socket ID: 0
DMI3
CPU1-G1CPU1-F1
#0 #1
#2 #3
Socket ID: 1
PEIC:30 PEIC:31
CPU2-G1CPU2-F
1

19
Chapter 2: Server Installation
Chapter 2
Server Installation
2.1 Overview
This chapter provides advice and instructions for mounting your system in a server rack.
If your system is not already fully integrated with processors, system memory etc., refer to
Chapter 3
Caution: 


2.2 Unpacking the System





Appendix A.
2.3 Preparing for Setup
The box in which the system was shipped should include the rackmount hardware needed to

Choosing a Setup Location
• 

• Leave enough clearance in front of the rack so that you can open the front door completely
 
󰀩
• 
rooms, service closets, etc.).


Chapter 2: Server Installation
• 

Rack Precautions
• 
the full weight of the rack rests on them.
• In single rack installations, stabilizers should be attached to the rack. In multiple rack in
stallations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from
the rack.
• 
taneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Appendix A.
• before you install the rails.
• 
way up.
•             
surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the
servers closed to maintain proper cooling.
Rack Mounting Considerations
Ambient Operating Temperature
             
the rack environment may be greater than the room's ambient temperature. Therefore,

the manufacturer’s maximum rated ambient temperature (TMRA).