Supermicro CSE-938NH-R2K20BP2 User manual

10
Chapter 1: Introduction
1.2 System Features
The CSE-938NH-R2K20BP2 is a 3U chassis that supports 16 front hot-swape drives and
eight rear hot-plug nodes.
Front View
Figure 1-1. System: Front View
System Features: Front
Feature Description
Control Panels Power buttons and status indicators; details on the next page
Storage Drives Sixteen 3.5" drive bays, two for each computing node; drive carriers display status lights
Drive Carrier LED Indicator
LED Color Blinking Pattern Behavior for Device
Activity LED
Blue Solid On SAS/NVMe drive installed
Blue Blinking I/O activity
Status LED
Red Solid On Failure of drive with RSTe support
Red Blinking at 1 Hz Rebuild drive with RSTe support
Red Blinking with two blinks and one
stop at 1 Hz
Hot spare for drive with RSTe support
(not supported in VMD mode)
Red On for ve seconds, then o󰀨 Power on for drive with RSTe support
Red Blinking at 4 Hz Identify drive with RSTe support
Green Solid On Safe to remove NVMe device (not
supported in VMD mode)
Amber Blinking at 1 Hz Attention state---do not remove NVMe
device (not supported in VMD mode)
1A 1B 2A 2B 3A 3B 4A 4B 5A 5B 6A 6B 7A 7B 8A 8B
Control Panel

11
Chapter 1: Introduction
Control Panel
The chassis front features a control panel to monitor node function and power o󰀨 and on the
entire system.
Figure 1-2. Control Panel
Control Panel Features
Item Feature Description
1Node Status Indicators Eight numbered LEDs that indicate the status of each node (see table
below).
2Power Fail LED Illuminated when one of the power supplies fails while any node is
powered on. It is o󰀨 during normal operation.
3Main Power button Used to apply or remove power from the power supply to the server
system. Whether on or o󰀨, standby power to the system remains on.
1
32
Node Activity LED Indicators
LED Appearance Description
Solid Green The node is powered on and operating normally.
Blinking Green The node is in the process of shutting down.
Solid Red The node is detecting an overheated condition.
1Hz Blinking Red The node is detecting a fan failure.
.25Hz Blinking Red The node is detecting a power failure.
Solid Blue The node local UID is on.
1Hz Blinking Blue The node remote UID is on.
No Illumination The node is powered down.

12
Chapter 1: Introduction
Rear View
Figure 1-3. System: Rear View
Figure 1-4. Node I/O Features
KVM Port
Power Button
USB UID Switch
Node 3 Node 1
Power Supply
Node 2Node 4Node 5Node 6Node 7Node 8
Power Supply
Dedicated and Centralized BMC LAN Ports
System Features: Rear
Feature Description
Nodes 1-8 Each node features a power button, two LAN ports and a KVM port
Power Supplies Two redundant power supply modules, PWS1 on the left, PWS2 on the right
BMC LAN Ports
Dedicated and centralized ports in cascade or redundancy mode
Cascade: connect the rst port to a management device and the second port to another
server
Redundancy: connect each port to a di󰀨erent subnetwork switch
KVM Port One VGA, one COM, and two USB 2.0 (with KVM dongle)
Power Button Node power switch and indicator (green)
USB Port USB Type C Port
UID Button Toggle switch and LED indicator for Unit ID (blue)

13
Chapter 1: Introduction
Connecting to a Node
USB, COM, and VGA port capabilities can be added to any node through the KVM port on
the rear. Plug in the adapter (dongle).
Figure 1-5. Adapter to Provide USB, COM, and VGA Ports
Node Trays
The chassis contains eight separate computing node drawers, each with its own motherboard.
Figure 1-6. AS -3015MR-H8TNR Node Tray
BMC Password
Each node supports a pull-out server tag with a unique BMC Password Label. Extend the
server tag and use the unique password to log into the BMC as the ADMIN user.
Service Tag

14
Chapter 1: Introduction
Main Node Components
Feature Description
PCIe Slot One PCIe 5.0 x8 (in x16) LP slot
Processor Single AMD Ryzen Zen4 7000 Series Processor
SAS/SATA Ports Two SAS2/SATA3 ports for AOC
DIMM Slots Four DIMM slots DDR5 (ECC/non-ECC UDIMM)
M.2 Slot One NVMe M.2 slot (2280/22110 form factor)
LAN Ports Dual 1GbE/10GbE/25GbE PCIe 5.0 x8 LAN ports (Micro LP)
1.3 System Architecture
This section highlights the features on each node.
Main Components
Figure 1-7. Node Features
PCIe Slot
M.2 Slot
LAN Ports
Processor SAS2/SATA3 Ports
DIMM Slots

15
Chapter 1: Introduction
System Block Diagram
The block diagram below shows the connections and relationships between the subsystems
and major components of the overall system.
Figure 1-5. System Block Diagram
USB 2.0(P3/P4)
2 SAS PORTS
(SAS AOC from PCIe x8 SLOT)
up to 5200MT/s
2 HDD PORTS
NVMe
AOC-SAS
AOC-SATA
(system front)
AOM-BPN-938NH
(Socket LGA-1718)
UDIMM-B2
DDR5 (CHA)
AM5
PCIe5.0 x8 (L0 - L7)
DDR5 (CHB)
UDIMM-A1
PCIe x8 SLOT(open end)
AMD Ryzen 7000X
H13SRD-F R1.00 BLOCK DIAGRAM
UDIMM-B1
UDIMM-A2
CPLD
Vender: MPS
SVI3 VRM
PCIe 5.0 x1(L26)
up to 5200MT/s
SERDES
AST2600
SMBUS
eSPI Bus
RGMII RTL8211FS
BMC
KVM connector
VGA
COM
PCIe5.0 x4 (L16-L19)
PCIe5.0 x4 (L20-L23)
LCMXO2
1 X USB Type-C
TPM2.0 Header
SPI Bus
TPM2.0
EEPROM
SPI 256Mb
M.2 PCIE PCIe 5.0 x2 (L24 - 25)
2x USB 3.2 (P0)
2x USB 2.0 (P0)
MLP SLOT
1 to 4
GL852GT-60
USB HUB 1x USB 2.0 (P1)
PCIe5.0 x8 (L8 - L15)
1x PCIe x8
2x USB 2.0
1x RMII
2x USB2.0 (Hub_P0-P1)
2x USB 2.0 (Hub_P2-P3)
With Redriver & PD
PI3EQX2004
IT8851FN-64
1x RMII

16
Chapter 1: Introduction
Figure 1-6. Motherboard Layout
1.4 Motherboard Layout
Below is a layout of the H13SRD-F motherboard with jumper, connector and LED locations
shown. See the table on the following page for descriptions. For detailed descriptions, pinout
information and jumper settings, refer to Chapter 4 or the Motherboard Manual.
PRESS FIT
MAC CODE
BAR CODE
BIOS
LICENSE
APU
SAS1
SAS2
MH2
MH1
MH4
MH3
MH5
MH7MH6
JPO1 JWD1
JSS1
MH8
MH9
JTPM1
J12
LEDM1
BMC
CPLD
JKVM1
JMD1
M.2-C PCIe 5.0 x2
USB2
(3.2 Gen2)
JVRM1
JBM1
BT1
JPT1
LED1
LED2
SW1
JUIDB1
SRW1
SRW2
JBT1
SGPIO1
DIMMA1 DIMMA2 DIMMB1 DIMMB2
MICRO-LP PCIe 5.0 x8
SLOT1 PCIe 5.0 x8
JPWR1
H13SRD-F
REV:1.00
DESIGNED IN USA
JKVM1MH1SW1JUIDB1
USB2LED2
MH8
J9 MICRO-LP PCIe 4.0 x8 Slot
MH4
BT1
S-SGPIO1
MH6
JPWR1
JVRM1
JPO1
JMB1
JWD1
DIMMA1
DIMMA2
DIMMB1
DIMMB2
LED1
MH2
MH3
Processor
SRW2
JTPM1
JBT1
JSS1
MH7
SRW1
LEDM1
J10 SLOT1 PCIe 5.0 x8
JMD1 M.2-C PCIe 5.0 x2
MH5
J12
MH9
SAS2
SAS1

17
Chapter 1: Introduction
Quick Reference Table
Jumper Description Default Setting
JBM1 Disable IPMI Share LAN Pins 1-2 Open: Enabled
JPO1 CPU Throttle when PWR_FAIL Pins 2-3: Disabled
JPT1 Onboard TPM 2.0 Enable/Disable Pins 1-2: Enabled
JSS1 AOC SAS Enable/Disable Pins 1-2: Disabled
JWD1 Watch Dog Timer Pins 1-2: Reset
LED Description Status
LED1 OH/Power Fail/FAN Fail Blinking Red: Power Fail or FAN Fail
Solid Red: Overheat
LED2 Unit Identier LED Solid Blue: Unit Identied
LEDM1 BMC Heartbeat LED Blinking Green: BMC Normal
Connector Description
BT1 Onboard Battery
J9 Micro Low-Prole PCIe 5.0 x8 Slot with two USB 2.0
J10 PCIe 5.0 x8 Slot (Open-End support up to 75W)
J12 MicroCloud Backplane Connector for 2x PCIe 5.0 x4 / Dedicated IPMI LAN / 2x AOC SATA/SAS
JKVM1 KVM Connector for USB0/1, COM1, VGA
JMD1 M.2 M-Key 2280/22110 Slot (PCIe 5.0 x2)
JPWR1 12V Input Power Connector
JTPM1 Trusted Platform Module/Port 80 Connector
JUIDB1 UID Switch
SAS1, SAS2 AOC SATA/SAS Input Connector (Link to AOC SAS Card)
S-SGPIO1 Serial Link General Purpose I/O Header
SW1 Power Switch, Power LED
USB0/1 Two USB 2.0 Ports via JKVM1
USB2 USB 3.2 Gen2 Type C Connector

18
Chapter 2: Server Installation
Chapter 2
Server Installation
2.1 Overview
This chapter provides advice and instructions for mounting your system in a server rack.
If your system is not already fully integrated with processors, system memory etc., refer to
Chapter 3 for details on installing those specic components.
Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent such
damage to PCBs (printed circuit boards), it is important to use a grounded wrist strap, handle
all PCBs by their edges and keep them in anti-static bags when not in use.
2.2 Unpacking the System
Inspect the box in which the AS -3015MR-H8TNR was shipped, and note if it was damaged
in any way. If any equipment appears damaged, le a damage claim with the carrier who
delivered it.
Decide on a suitable location for the rack unit that will hold the server. It should be situated
in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and
electromagnetic elds are generated. It will also require a grounded AC power outlet nearby.
Be sure to read the precautions and considerations noted in Appendix A.
2.3 Preparing for Setup
The box in which the system was shipped should include the rackmount hardware needed to
install it into the rack. Please read this section in its entirety before you begin the installation.
Choosing a Setup Location
• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas
where heat, electrical noise and electromagnetic elds are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely
(~25 inches) and approximately 30 inches of clearance in the back of the rack to allow
su󰀩cient space for airow and access when servicing.
• This product should be installed only in a Restricted Access Location (dedicated equipment
rooms, service closets, etc.).

19
Chapter 2: Server Installation
• This product is not suitable for use with visual display workplace devices according to §2
of the German Ordinance for Work with Visual Display Units.
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are extended to the oor so that
the full weight of the rack rests on them.
• In single rack installations, stabilizers should be attached to the rack. In multiple rack in-
stallations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from
the rack.
• You should extend only one server or component at a time - extending two or more simul-
taneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Appendix A.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack rst and then work your
way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power
surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the
servers closed to maintain proper cooling.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of
the rack environment may be greater than the room's ambient temperature. Therefore,
consideration should be given to installing the equipment in an environment compatible with
the manufacturer’s maximum rated ambient temperature (TMRA).