NEC SX-Aurora TSUBASA B300-8 Series User manual

SX-Aurora TSUBASA
B300-8 series
USER'S GUIDE
Revision 1.0
SX-Aurora TSUBASA
NEC

The information in this User’s Guidehas beencarefully reviewed and is believed to be accurate. The vendor assumes no
responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to
keep current the information in this guide, or to notify any person or organization of the updates.
Please Note: For the most up-to-date version of this guide, please see our website at
http://www.nec.com/en/global/prod/hpc/aurora/document/
NEC Corporation (“NEC”) reserves the right to make changes to the product described in this guide at any time and
without notice. This product, including software and documentation, is the property of NEC and/ or its licensors, and is
supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL NEC CORPORATION BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVEOR CONSEQUENTIALDAMAGESARISINGFROMTHEUSEORINABILITYTOUSETHISPRODUCT
OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, NEC
CORPORATION SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR
RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
The products sold by NEC are not intended for and will not be used in life support systems, medical equipment, nuclear
facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems
whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property
damage. Accordingly, NEC disclaims any and all liability, and should buyer use or sell such products for use in such
ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend
and hold NEC harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind
arising out of or related to such ultra-hazardous use or sale.
Guide Revision 1.0
Release Date: October. 2, 2020
Unless you request and receive written permission from NEC Corporation, you may not copy any part of this document.
Information in this document is subject to change without notice. Other products and companies referred to herein are
trademarks or registered trademarks of their respective companies or mark holders.

SX-Aurora TSUBASA B300-8 Series User's Guide
3
Preface
About this Guide
This Guide is written for professional system integrators and PC technicians. It provides
information for the installation and use of the SX-Aurora TSUBASA B300-8 series. Installation
and maintenance should be performed by experienced technicians only.
Please refer to the B300-8 series server specifications page on our website for updates on
supported memory, processors and operating systems
(http://www.nec.com/en/global/prod/hpc/aurora/document/).
Notes
For your system to work properly, please follow the links below to download all necessary
drivers/utilities and the user’s guide for your server.
• NEC product manuals: http://www.nec.com/en/global/prod/hpc/aurora/document/
• Product safety info:
http://www.nec.com/en/global/prod/hpc/aurora/document/safety_information.pdf
This guidemay be periodically updated without notice. Please check the NEC website for
possible updates to the guide revision level.
Warnings
Special attention should be given to the following symbols used in this guide.
Warning! Indicates important information given to prevent equipment/property damage
or personal injury.
Warning! Indicates high voltage may be encountered when performing a procedure.

Preface
4
Contents
Chapter 1 Introduction........................................................................................................................5
1.1 Overview.....................................................................................................................................................5
1.2 Unpacking the System................................................................................................................................5
1.3 System Features.........................................................................................................................................6
1.4 Server Chassis Features............................................................................................................................7
Control Panel.............................................................................................................................................7
Front Features...........................................................................................................................................9
Rear Features..........................................................................................................................................10
1.5 System Block Diagram..............................................................................................................................11
1.6 Ports and Headers....................................................................................................................................12
Rear I/O Ports..........................................................................................................................................12
1.7 LED Indicators ..........................................................................................................................................14
1.8 Environmental specifications.....................................................................................................................16
Chapter 2 Server Installation............................................................................................................18
2.1 Overview...................................................................................................................................................18
2.2 Preparing for Setup..................................................................................................................................18
Choosing a Setup Location.....................................................................................................................18
Rack Precautions.....................................................................................................................................18
Server Precautions ..................................................................................................................................19
Rack Mounting Considerations ................................................................................................................19
2.3 Procedure for Rack Mounting...................................................................................................................21
Identifying the Inner Rack Rails ..............................................................................................................21
Installing the Inner Rails on the Chassis ..................................................................................................22
Installing the Outer Rails onto the Rack...................................................................................................23
Installing the Chassis into a Rack ............................................................................................................24
Removing the Chassis from the Rack......................................................................................................25
Chapter 3 Maintenance and BIOS Setting.......................................................................................26
3.1 Overview...................................................................................................................................................26
Appendix A BIOS Error Codes.........................................................................................................27
Appendix B Standardized Warning Statements for AC Systems..................................................28

5
SX-Aurora TSUBASA B300-8 Series User's Guide
Chapter 1
Introduction
1.1 Overview
ThischapterprovidesabriefoutlineofthefunctionsandfeaturesoftheSX-Aurora TSUBASA
B300-8 series.
1.2 Unpacking the System
Inspect the box the SX-Aurora TSUBASA B300-8 series was shipped in and note if it was
damaged in any way. If any equipment appears damaged, please file a damage claim with the
carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the server. It should be situated in
a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise and
electromagnetic fields are generated. It will also require a grounded AC power outlet nearby.
Be sure to read the precautions and considerations noted in Appendix B.

6
Chapter 1: Introduction
1.3 System Features
The following table provides you with an overview of the main features of the SX-Aurora
TSUBASA B300-8 series.
System Features
Motherboard
Supermicro X11DPG-O
Chassis
Supermicro SC418GTS-R4000BP
CPU
Supports dual Intel Xeon 6226/4208 [B300-8 model] processors
Socket Type
Socket P0-LGA3647
Memory
192GB
Chipset
Intel PCH C622 chipset
PCIe Cards
Up to Eight Vector Engine 2.0 cards
Up to two InfiniBand HCA cards
Hard Drives
two fixed 2.5” internal drive
Power
Four 2000W power supplies
Form Factor
4U Rack mount server
Dimensions
(WxHxD) 17.2 x 1.7 x 23.5 in. (437 x 43 x 597 mm)
Host Server
B300-8-VH

7
SX-Aurora TSUBASA B300-8 Series User's Guide
1.4 Server Chassis Features
Control Panel
There are two buttons located on the front of the chassis: a power on/off button and a reset
button. In addition there are six LEDs. The locations of these buttons and LEDs on the control
panel are described below. See Chapter 4 for details on the control panel connections.
Figure 1-1. Control Panel View
Control Panel Features
Item
Feature
Description
1
Power Button
The main power switch applies or removes primary power from the power
supply to the server but maintains standby power. Toperform most maintenance
tasks, unplug the system to remove all power.
2
Reset Button
The reset button is used to reboot the system.
3
Power LED
Indicates power is being supplied to the system power supply units. This LED is
illuminated when the system is operating normally.
4
HDD LED
Indicates IDE channel activity. SAS2/SATA drive and/or DVD-ROM drive activity
when flashing.
5
NIC1 LED
Indicates network activity on GLAN2 when flashing.
6
NIC2 LED
Indicates network activity on GLAN1 when flashing.
7
Universal Information LED
See the following table for the status shown by this LED.
8
Power Fail LED
Indicates a power supply module has failed.
1
2
3
4
5
6
7
8

8
Chapter 1: Introduction
Universal Information LED
Status
Description
Continuously on and red
An overheat condition has occurred (this may be caused by cable
congestion).
Blinking red (1 Hz)
Fan failure: check for an inoperative fan.
Blinking red (0.25 Hz)
Power failure: check for an inoperative power supply.
Solid blue
Local UID has been activated. Use this function to locate the server in a rack
environment.
Blinking blue (300 msec)
Remote UID has been activated. Use this function to activate the server from
a remote location.

9
SX-Aurora TSUBASA B300-8 Series User's Guide
Front Features
The chassis is a 4U rack mount chassis. See the illustration below for the features included
on the front of the chassis.
1 1 1 1 1
2
1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Figure 1-2. Chassis Front View
Front Chassis Features
Item Feature Description
1 Hot-swap drive bays (24) Drive bays for hot-swap 2.5" drive carriers
2 Control Panel Control panel for the server. See the Control Panel section above for details.
SX-Aurora TSUBASA
NEC

10
Chapter 1: Introduction
Rear Features
The illustration below shows the features included on the rear of the chassis.
3
1 1 2 1 1
Figure 1-3. Chassis Rear View
Rear Chassis Features
Item Feature Description
1 Power Supplies Two hot-swappable redundant power supplies are available for use.
2 Rear I/O ports See Motherboard Layout below for details on the rear I/O ports.
Up to twelve (12) slots are provided in the chassis rear for accessing PCI-E
3 Rear PCI-E Expansion Slot Expansion cards using four riser cards.

11
SX-Aurora TSUBASA B300-8 Series User's Guide
1.5 System Block Diagram
X11DPG-OT-CPU
UPI
10.4G
VCCP0-(F) VCCP1
#
#J-1
#H-2
#H-1
#M-2
#
#K
DDR4
PECI
P0 P1
UPI
P1
P0
UPI
PECI
DDR4 #
S KET ID: 0 P2
P2
S
KET ID: 1
#1 #2 #3A #3C DMI3 UPI
#3A #3C #2 #1
PCI-E X16 G3
PCI-E X16 G3
PCI-E X16 G3
PCI-E X16 G3
PCI-E X8 G3
PCI-E X4 G3
DMI3
PCI-E X8 G3
PCI-E X8 G3
6.0 Gb/S
#7 #8
#6
#5
#4
RJ45
RGRMII
PCI-E X1 G2
#3
#2
6.0 Gb/S
iPass4x2
SPI
USB 2.0
Rear x4
Internal Type A
PCI-E X4 G2
USB 3.0
SPI
Figure 1-4. System Block Diagram
Note: This is a general block diagram and may not exactly represent the features on your
motherboard.
M-1
#
1
1
RJ45
10G
SuperDOM
DDR4
SYSTEM POWER
TPM HEADER
Debug Card
BIOS
CLOCK
BUFFER
DB1900
FRONT PANEL
FAN SPEED
CTRL
ESPI
BMC Boot Flash
USB 2.0
BMC
AST2500
LAN3
RTL8211E-
VB-CG
LAN 10G
X557-AT2
OCULINK
G-1
#G-2
J-2
#K-
-2
L-
2
L-
#
KR
PCH
LBG-2 X8 UPLINK NO QAT
(~17W)
#F-2
#F-1
#E-2
#E-1
#D-2
#D-1
#C-2
#C-1
#B-2
#B-1
#A-2
#A-1
M.2
PCI-E X8 G3
PCI-E X24
DDR4
Up to 2666
RMII/NCSI
USB
USB
SATA
DDR4
Up to 2666
PCI-E X24

12
Chapter 1: Introduction
1.6 Ports and Headers
Rear I/O Ports
See the figure below for the locations and descriptions of the various I/O ports on the rear of
the motherboard.
Figure 4-2. Rear I/O Ports
I/O Back Panel
Port Descriptions
Pin#
Definition
Pin#
Definition
1
USB 1 (3.0)
6
LAN Port 1
2
USB 2 (3.0)
7
LAN Port 2
3
IPMI_LAN
8
VGA
4
USB 3 (3.0)
9
UID Switch
5
USB 4 (3.0)
(UID LED: on the motherboard)
Ethernet Ports
Two Ethernet ports (LAN1, LAN2) that support 10 GbE LAN connections are located on the
I/O backplane. Additionally, an IPMI-dedicated LAN, supported by the ACT2500 Baseboard
Controller (BMC), is located above USB 1/2 ports on the backplane. The IPMI LAN supports 1
GbE Connection. All these Ethernet LAN ports accept RJ45 type cables. Please refer to the
LED Indicator Section for LAN LED information.
Notes:
- LAN1 and LAN2 interface link speed supports 10Gb/s and 1Gb/s, don’t supports 100Mb/s
and 10Mb/s.
VGA Port
The onboard VGA port is located next to LAN Port 2 on the I/O back panel. Use this connection
for VGA display.
3
5
2
1
4
6
7
8
9

13
SX-Aurora TSUBASA B300-8 Series User's Guide
Universal Serial Bus (USB) Ports
Four USB 3.0 port (USB1/2, 3/4) are located on the I/O back panel. A Type A internal USB
2.0 header provides front access. Connect appropriate cables here to use USB support. (USB
cables are not included).
Back Panel USB (3.0)
Pin Definitions
Pin#
1
Definition
VBUS
Pin#
10
Definition
Power
2
D-
11
USB 2.0 Differential Pair
3
D+
12
4
Ground
13
Ground of PWR Return
5
StdA_SSRX-
14
SuperSpeed Receiver
6
StdA_SSRX+
15
Differential Pair
7
GND_DRAIN
16
Ground for Signal Return
8
StdA_SSTX-
17
SuperSpeed Transmitter
9
StdA_SSTX+
18
Differential Pair
USB (2.0)
Pin Definitions
Pin#
Definition
1
Vcc
2
Data-
3
Data+
4
Ground
Unit Identifier Switch/UID LED Indicator
A Unit Identifier (UID) switch and a rear UID LED (LE1) are located on the I/O back panel. A
front UID switch is located on pins 7 & 8 of the front panel control (JF1). When you press the
rear UID switch, both front and rear UID LEDs will be turned on. Press the UID switch again to
turn off the LED indicators. The UID indicators provide easy identification of a system that may
be in need of service.
UID LED
Pin Definitions
Color
Status
Blue: On
Unit Identified

14
Chapter 1: Introduction
1.7 LED Indicators
LAN LEDs
The LAN ports are located on the IO Backplane on the motherboard. Each Ethernet LAN port
has two LEDs. The yellow LED indicates activity. Link LED, located on the left side of the LAN
port, may be green, amber or off indicating the speed of the connection. See the tables at right
for more information.
GLAN Activity Indicator (Left)
LED Settings
Color
State
Definition
Yellow
Flashing
Active
LAN Link Indicator
LED Settings
LED Color
Definition
Off
No Connection
Green
10 Gbps
Amber
1 Gbps
LAN 1/2
Link LED Activity LED
Dedicated IPMI LAN LEDs
In addition to LAN 1/LAN 2, a dedicated IPMI LAN is located on the I/O Backplane of the
motherboard. The amber LED on the right indicates activity, while the green LED on the left
indicates the speed of the connection. See the tables at right for more information.
IPMI LAN Link LED (Left) &
Activity LED (Right)
Color
State
Definition
Link (Left)
Green: Solid
1000 Mbps
Activity (Right)
Amber: Blinking
Active
IPMI LAN
Link LED Activity LED

15
SX-Aurora TSUBASA B300-8 Series User's Guide
Hard Drive LEDs
Each hard drive carrier in front drive bays has two LEDs, an active LED and a status LED. See
the tables at below for details.
SATA Drive
Color
LED color
Blinking pattern
Activity LED
Blue
SATA Power On stay off,
Blinking during IO time.
Status LED
Red
Fail Drive Red LED solid On.
Red
Power on Status LED stay on
for 5 second then turn off.
Red
Identify drive Red LED
blinking at 4Hz.
NVMe Drive
Color
LED color
Blinking pattern
Activity LED
Blue
NVMe Power On stay On,
Blinking during IO time.
Status LED
Red
Fail Drive Red LED solid On.
Red
Power on Status LED stay on
for 5 second then turn off.
Red
Identify drive Red LED
blinking at 4Hz.

16
Chapter 1: Introduction
1.8 Environmental specifications
Environment temperature
Please keep environment temperature at 30℃or lower to avoid throttling and performance
degradation when SX-Aurora TSUBASA server is operating.
SX-Aurora TSUBASA server has thermal throttling function to protect the LSI mounted on
Vector Engine card (VE card) from heat damage and to keep working. If VE LSI temperature
exceeds a certain temperature, the VE reduces instruction execution rate in order to suppress
heat production.
+-----------------------------------+-----------+
| Guaranteed operating temperature | below 35℃|
| Recommended operating temperature | below 30℃|
+-----------------------------------+-----------+
How to confirm the throttling occurrence history
SX-Aurora TSUBASA server records throttling history. By checking VE card log, it can be
confirmed if throttling happened or not. The steps are described as bellow;
If throttling occurs, please keep enough intake/exhaust space around the server to provide
enough airflow and keep the room temperature at 30℃or lower.
□For users and programmers (without root privileges)
-Set a value “DETAIL” to the environment variable “VE_PROGINF” when you run a
program.
-It doesn’t affect program performance at all.
If throttling occurs, Power Throttling (sec) and Thermal Throttling (sec) show values more than
0.000000. (Please check the lines marked with the token “*”.)

17
SX-Aurora TSUBASA B300-8 Series User's Guide
Ex) bash
$ export VE_PROGINF=DETAIL
$ /opt/nec/ve/bin/ve_exec ./a.out
(standard output)
******** Program Information ********
Real Time (sec) : 192.360841
User Time (sec) : 1534.571764
（...skip...）
Power Throttling (sec) : 0.000000 *
Thermal Throttling (sec) : 0.000000 *
Max Active Threads : 8
Available CPU Cores : 8
Please access to “PROGINF/FTRACE User's Guide“ on Aurora Forum web site, and you can
find details about PROGINF.
□For system administrators (with root privileges)
1. Login to the Vector Host
2. Execute the following commands
$ su 《change to super user》
Input the password of root
# grep 'Environmental Warning detecting' /var/log/messages*
(If throttling occurs, messages like the one described below come out.)
/var/log/messages-20190630:Jun 28 15:27:18 a_server ve_monitor: VE_MMM4033007: VE0
Environmental Warning detecting

18
Chapter 2: Sever Installation
Chapter 2
Server Installation
2.1 Overview
This chapter provides advice and instructions for mounting your system in a server rack.
2.2 Preparing for Setup
The box in which the system was shipped should include the rackmount hardware needed to
install it into the rack. Please read this section in its entirety before you begin the installation.
Choosing a Setup Location
• The system should be situated in a clean, dust-free area that is well ventilated. Avoid areas
where heat, electrical noise and electromagnetic fields are generated.
• Leave enough clearance in front of the rack so that you can open the front door completely
(~25 inches) and approximately 30 inches of clearance in the back of the rack to allow
sufficient space for airflow and access when servicing.
• This product should be installed only in a RestrictedAccess Location (dedicated equipment
rooms, service closets, etc.).
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the
full weight of the rack rests on them.

19
SX-Aurora TSUBASA B300-8 Series User's Guide
• In single rack installations, stabilizers should be attached to the rack. In multiple rack in-
stallations, the racks should be coupled together.
• Always make sure the rack is stable before extending a server or other component from
the rack.
• Youshould extend only one server or component at a time - extending two or more simul-
taneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Appendix B.
• Determine the placement of each component in the rack before you install the rails.
• Install the heaviest server components at the bottom of the rack first and then work your
way up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from power
surges and voltage spikes and to keep your system operating in case of a power failure.
• Allow any drives and power supply modules to cool before touching them.
• When not servicing, always keep the front door of the rack and all covers/panels on the
servers closed to maintain proper cooling.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the
rack environment may be greater than the room's ambient temperature. Therefore,
consideration should be given to installing the equipment in an environment compatible with
the manufacturer’s maximum rated ambient temperature (TMRA).
Airflow
Equipment should be mounted into a rack so that the amount of airflow required for safe
operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not arise due
to uneven mechanical loading.

20
Chapter 2: Sever Installation
Circuit Overloading
Consideration should be given to the connection of the equipment to the power supply circuitry
and the effect that any possible overloading of circuits might have on overcurrent protection
and power supply wiring. Appropriate consideration of equipment nameplate ratings should be
used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself should be
grounded. Particular attention should be given to power supply connections other than the
direct connections to the branch circuit (i.e. the use of power strips, etc.).
To prevent bodily injury when mounting or servicing this unit in a rack, you must take
special precautions to ensure that the system remains stable. The following guidelines
are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
• When mounting this unit in a partially filled rack, load the rack from the bottom to the top
with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before mounting or
servicing the unit in the rack.