Asus 90SF00H1-M00080 User manual

4U Rackmount Server
ESC8000 G4
User Guide

ii
Copyright © 2018 ASUSTeK COMPUTER INC. All Rights Reserved.
No part of this manual, including the products and software described in it, may be reproduced, transmitted,
transcribed, stored in a retrieval system, or translated into any language in any form or by any means,
except documentation kept by the purchaser for backup purposes, without the express written permission
of ASUSTeK COMPUTER INC. (“ASUS”).
ASUS provides this manual “as is” without warranty of any kind, either express or implied, including but not
limited to the implied warranties or conditions of merchantability or tness for a particular purpose. In no
event shall ASUS, its directors, ofcers, employees, or agents be liable for any indirect, special, incidental,
or consequential damages (including damages for loss of prots, loss of business, loss of use or data,
interruption of business and the like), even if ASUS has been advised of the possibility of such damages
arising from any defect or error in this manual or product.
Specications and information contained in this manual are furnished for informational use only, and are
subject to change at any time without notice, and should not be construed as a commitment by ASUS.
ASUS assumes no responsibility or liability for any errors or inaccuracies that may appear in this manual,
including the products and software described in it.
Product warranty or service will not be extended if: (1) the product is repaired, modied or altered, unless
such repair, modication of alteration is authorized in writing by ASUS; or (2) the serial number of the
product is defaced or missing.
Products and corporate names appearing in this manual may or may not be registered trademarks or
copyrights of their respective companies, and are used only for identication or explanation and to the
owners’ benet, without intent to infringe.
E14372
Revised Edition V3
July 2018

iii
Contents
Safety information.................................................................................................... viii
About this guide......................................................................................................... ix
Chapter 1: Product Introduction
1.1 System package contents.........................................................................1-2
1.2 Serial number label....................................................................................1-3
1.3 System specifications ...............................................................................1-4
1.4 Front panel features...................................................................................1-6
1.5 Rear panel features....................................................................................1-6
1.6 Internal features .........................................................................................1-7
1.7 LED information .........................................................................................1-8
1.7.1 Front panel LEDs ........................................................................ 1-8
1.7.2 LAN (RJ-45) LEDs ...................................................................... 1-9
1.7.3 Storage device status LED........................................................ 1-10
Chapter 2: Hardware Setup
2.1 Chassis cover.............................................................................................2-2
2.1.1 Air duct........................................................................................ 2-4
2.2 Central Processing Unit (CPU) ................................................................. 2-6
2.2.1 Installing the CPU and cooler...................................................... 2-6
2.3 System memory .........................................................................................2-9
2.3.1 Overview ..................................................................................... 2-9
2.3.2 Memory Congurations............................................................. 2-10
2.3.3 Installing a DIMM on a single clip DIMM socket........................ 2-12
2.4 Storage devices........................................................................................2-13
2.4.1 Installing 2.5-inch SATA HDD/SAS storage devices................. 2-13
2.5 Expansion slots........................................................................................2-15
2.5.1 The PCI Express riser card....................................................... 2-15
2.5.2 Installing an ASUS PIKE II card................................................ 2-18
2.5.3 Installing an ASUS HFI-OMNI card........................................... 2-20
2.5.4 Installing an M.2 expansion card............................................... 2-24
2.6 Cable connections ...................................................................................2-26
2.7 Removable/optional components...........................................................2-29
2.7.1 GPU fans................................................................................... 2-29
2.7.2 Redundant power supply units.................................................. 2-30
2.8 Installing GPU cards................................................................................2-32

iv
Contents
Chapter 3: Installation Options
3.1 Rail Kit.........................................................................................................3-2
3.1.1 Selecting rack rail cabinets ......................................................... 3-2
3.1.2 Attaching the rack rails ............................................................... 3-3
3.2 Cable management arm (optional for 1200 mm rack rails) ....................3-8
3.2.1 Attaching the cable management arm ........................................ 3-8
Chapter 4: Motherboard Information
4.1 Z11PG-D24 Motherboard layout ............................................................... 4-2
4.2 Jumpers ......................................................................................................4-4
4.3 Internal LEDs..............................................................................................4-9
4.4 Internal connectors.................................................................................. 4-11
Chapter 5: BIOS Setup
5.1 Managing and updating your BIOS .......................................................... 5-2
5.1.1 ASUS CrashFree BIOS 3 utility................................................... 5-2
5.1.2 ASUS EZ Flash Utility ................................................................. 5-3
5.1.3 BUPDATER utility ....................................................................... 5-4
5.2 BIOS setup program .................................................................................. 5-6
5.2.1 BIOS menu screen...................................................................... 5-7
5.2.2 Menu bar..................................................................................... 5-7
5.2.3 Menu items.................................................................................. 5-8
5.2.4 Submenu items ........................................................................... 5-8
5.2.5 Navigation keys........................................................................... 5-8
5.2.6 General help................................................................................ 5-8
5.2.7 Conguration elds ..................................................................... 5-8
5.2.8 Pop-up window............................................................................ 5-8
5.2.9 Scroll bar..................................................................................... 5-8
5.3 Main menu ..................................................................................................5-9
5.3.1 System Date [Day xx/xx/xxxx]..................................................... 5-9
5.3.2 System Time [xx:xx:xx] ............................................................... 5-9
5.4 Ai Tweaker ................................................................................................5-10

v
Contents
5.5 Advanced menu .......................................................................................5-13
5.5.1 Trusted Computing.................................................................... 5-14
5.5.2 ACPI Settings............................................................................ 5-14
5.5.3 SMART Settings........................................................................ 5-15
5.5.4 Super IO Conguration ............................................................. 5-15
5.5.5 Serial Port Console Redirection................................................ 5-16
5.5.6 Onboard LAN ............................................................................ 5-19
5.5.7 APM .......................................................................................... 5-20
5.5.8 PCI Subsystem Settings ........................................................... 5-21
5.5.9 Network Stack Conguration..................................................... 5-25
5.5.10 CSM Conguration.................................................................... 5-26
5.5.11 NVMe Conguration.................................................................. 5-27
5.5.12 USB Conguration .................................................................... 5-27
5.5.13 iSCSI Conguration .................................................................. 5-28
5.6 Platform Configuration menu ................................................................. 5-28
5.6.1 PCH Conguration .................................................................... 5-28
5.6.2 Miscellaneous Conguration..................................................... 5-31
5.6.3 Server ME Conguration........................................................... 5-32
5.6.4 Runtime Error Logging.............................................................. 5-32
5.7 Socket Configuration menu ....................................................................5-33
5.7.1 Processor Conguration............................................................ 5-33
5.7.2 Common RefCode Conguration.............................................. 5-35
5.7.3 UPI Conguration...................................................................... 5-35
5.7.4 Memory Conguration............................................................... 5-36
5.7.5 IIO Conguration....................................................................... 5-38
5.7.6 Advanced Power Management Conguration........................... 5-39
5.8 Event Logs menu ..................................................................................... 5-41
5.8.1 Change Smbios Event Log Settings ......................................... 5-41
5.8.2 View Smbios Event Log ............................................................ 5-41
5.9 Server Mgmt menu................................................................................... 5-42
5.9.1 System Event Log..................................................................... 5-43
5.9.2 BMC network conguration....................................................... 5-43
5.9.3 View System Event Log ............................................................ 5-44
5.10 Security menu ..........................................................................................5-45
5.11 Boot menu ................................................................................................5-48
5.12 Tool menu.................................................................................................5-49
5.13 Save & Exit menu.....................................................................................5-49

vi
Contents
Chapter 6: RAID Configuration
6.1 Setting up RAID.......................................................................................... 6-2
6.1.1 RAID denitions .......................................................................... 6-2
6.1.2 Installing hard disk drives............................................................ 6-3
6.1.3 Setting the RAID item in BIOS .................................................... 6-3
6.1.4 RAID conguration utilities.......................................................... 6-3
6.2 Intel®Rapid Storage Technology enterprise
SATA Option ROM Utility........................................................................... 6-4
6.2.1 Creating a RAID set .................................................................... 6-5
6.2.2 Deleting a RAID set..................................................................... 6-7
6.2.3 Resetting disks to Non-RAID ...................................................... 6-8
6.2.4 Exiting the Intel®Rapid Storage Technology enterprise
SATA Option ROM utility............................................................. 6-9
6.2.5 Rebuilding the RAID.................................................................... 6-9
6.2.6 Setting the Boot array in the BIOS Setup Utility........................ 6-11
6.3 Intel®Rapid Storage Technology enterprise (Windows)...................... 6-12
6.3.1 Creating a RAID set .................................................................. 6-13
6.3.2 Changing a Volume Type.......................................................... 6-15
6.3.3 Deleting a volume ..................................................................... 6-16
6.3.4 Preferences............................................................................... 6-17
Chapter 7: Driver Installation
7.1 RAID driver installation .............................................................................7-2
7.1.1 Creating a USB ash drive with RAID drive................................ 7-2
7.1.2 Installing the RAID controller driver............................................. 7-2
7.2 Management applications and utilities installation ................................ 7-5
7.3 Running the Support DVD......................................................................... 7-5
7.4 Intel®chipset device software installation .............................................. 7-8
7.5 VGA driver installation ............................................................................ 7-10
7.6 Intel®Rapid Storage Technology enterprise installation ..................... 7-12

vii
Contents
Appendix
Z11PG-D24 block diagram (Single Root) .................................................................. 2
Z11PG-D24 block diagram (Dual Root) ..................................................................... 2
Changing System PCI-E Topology ............................................................................ 3
Q-Code table................................................................................................................ 5
Notices ........................................................................................................................ 8
REACH ....................................................................................................... 9
Australia statement notice............................................................................... 9
ASUS contact information........................................................................................ 10

viii
Safety information
Electrical Safety
• Before installing or removing signal cables, ensure that the power cables for the system
unit and all attached devices are unplugged.
• To prevent electrical shock hazard, disconnect the power cable from the electrical outlet
before relocating the system.
• When adding or removing any additional devices to or from the system, ensure that the
power cables for the devices are unplugged before the signal cables are connected. If
possible, disconnect all power cables from the existing system before you add a device.
• If the power supply is broken, do not try to x it by yourself. Contact a qualied service
technician or your dealer.
Operation Safety
• Any mechanical operation on this server must be conducted by certied or experienced
engineers.
• Before operating the server, carefully read all the manuals included with the server
package.
• Before using the server, ensure all cables are correctly connected and the power cables
are not damaged. If any damage is detected, contact your dealer as soon as possible.
• To avoid short circuits, keep paper clips, screws, and staples away from connectors,
slots, sockets and circuitry.
• Avoid dust, humidity, and temperature extremes. Place the server on a stable surface.
Lithium-Ion Battery Warning
CAUTION! Danger of explosion if battery is incorrectly replaced. Replace only with
the same or equivalent type recommended by the manufacturer. Dispose of used
batteries according to the manufacturer’s instructions.
Heavy System
CAUTION! This server system is heavy. Ask for assistance when moving or carrying
the system.
This product is equipped with a three-wire power cable and plug for the user’s safety. Use
the power cable with a properly grounded electrical outlet to avoid electrical shock.
CLASS 1 LASER PRODUCT

ix
About this guide
Audience
This user guide is intended for system integrators, and experienced users with at least basic
knowledge of conguring a server.
Contents
This guide contains the following parts:
1. Chapter 1: Product Introduction
This chapter describes the general features of the server, including sections on front
panel and rear panel specications.
2. Chapter 2: Hardware Setup
This chapter lists the hardware setup procedures that you have to perform when
installing or removing system components.
3. Chapter 3: Installation Options
This chapter describes how to install optional components into the barebone server.
4. Chapter 4: Motherboard Information
This chapter gives information about the motherboard that comes with the server. This
chapter includes the motherboard layout, jumper settings, and connector locations.
5. Chapter 5: BIOS Setup
This chapter tells how to change system settings through the BIOS Setup menus and
describes the BIOS parameters.
6. Chapter 6: RAID Configuration
This chapter tells how to change system settings through the BIOS Setup menus.
Detailed descriptions of the BIOS parameters are also provided.
7 Chapter 7: Driver Installation
This chapter provides instructions for installing the necessary drivers for different
system components.

x
Conventions
To ensure that you perform certain tasks properly, take note of the following symbols used
throughout this manual.
Typography
Bold text Indicates a menu or an item to select.
Italics Used to emphasize a word or a phrase.
<Key> Keys enclosed in the less-than and greater-than
sign means that you must press the enclosed key.
Example: <Enter> means that you must press
the Enter or Return key.
<Key1>+<Key2>+<Key3> If you must press two or more keys simultaneously,
the key names are linked with a plus sign (+).
Example: <Ctrl>+<Alt>+<Del>
Command Means that you must type the command
exactly as shown, then supply the required
item or value enclosed in brackets.
Example: At the DOS prompt, type the
command line: format A:/S
DANGER/WARNING: Information to prevent injury to yourself when
trying to complete a task.
CAUTION: Information to prevent damage to the components when
trying to complete a task.
NOTE: Tips and additional information to help you complete a task.
IMPORTANT: Instructions that you MUST follow to complete a task.
References
Refer to the following sources for additional information, and for product and software
updates.
1. ASUS Control Center (ACC) user guide
This manual tells how to set up and use the proprietary ASUS server management
utility.
2. ASUS websites
The ASUS websites worldwide provide updated information for all ASUS hardware and
software products. Refer to the ASUS contact information.

This chapter describes the general features of the chassis kit. It
includes sections on front panel and rear panel specications.
1
Product Introduction
Chapter 1: Product Introduction

Chapter 1: Product Introduction
1-2
The system does not include a USB oppy drive. You may have to use a USB oppy drive
when creating a SATA RAID driver disk. Refer to Chapter 6 for details.
• ASUSSystemWeb-basedManagement
If any of the above items is damaged or missing, contact your retailer.
1.1 Systempackagecontents
Check your system package for the following items.
ESC8000G4
Chassis ASUS 4U Rackmount Chassis
Motherboard ASUS Z11PG-D24 Server Board
Accessory box
1 x MB Support DVD
1 x ACC instruction card
1 x ASMB9 instruction card
2 x Front PIKE II cables
1 x Bag of Screws
3 x AC Power Cables
8 x GPU air ducts (for Nvidia/AMD)
8 x Mylar for GPU air duct for AMD GPU
2 x CPU coolers
1 x Rail Kit
16 x VGA power cables
8 x ASUS CPU 8-pin Power cables
4 x CPU carriers (2 for Intel Xeon processor Scalable, 2 for Intel Xeon
processor with Omni-Path Architecture)
Optional Items
One Row SYS FAN (Redundant FAN-Optional)
2 x Omni-Path Fabric (optional, by request)
1 x Redundant Power Supply Module
1 x Trend Micro Server Protect Anti-virus Software CD
1 x PEM-FDR
1 x PEB-10G/57840-2S
1 x PEB-10G/57811-1S
1 x PIKE II RAID Card

ASUS ESC8000 G4 1-3
1
2
3
4
5
6
7
8
1
2
1.2 Serialnumberlabel
Before requesting support from the ASUS Technical Support team, you must take note of
the product’s serial number containing 12 characters such as xxS0xxxxxxxx. See the gure
below.
With the correct serial number of the product, ASUS Technical Support team members can
then offer a quicker and satisfying solution to your problems.
The serial number on ESC8000 G4 is printed on the Asset tag.
xxS0xxxxxxxx
ESC8000G4

Chapter 1: Product Introduction
1-4
1.3 Systemspecifications
The ASUS ESC8000 G4 servers features the ASUS Z11PG-D24 Series server board that
supports Intel® LGA 3647 Xeon®processor Scalable family.
(continued on the next page)
ModelName ESC8000G4
Processor/SystemBus
2 x Socket P0 (LGA 3647)
Intel® Xeon®processor Scalable family
Intel® Xeon®processors family with Omni-Path Architecture
UPI 10.4 GT/s
CoreLogic Intel® C621 PCH
Memory
TotalSlots 24 (6-channel per CPU, 12 DIMMs per CPU)
Capacity Maximum up to 3072 GB
MemoryType DDR4 2666/2400/2133 RDIMM/LR-DIMM/LR-DIMM 3DS
MemorySize
4GB, 8GB, 16GB, 32GB (RDIMM)
32GB, 64GB (LRDIMM)
64GB, 128GB (LRDIMM/RDIMM 3DS)
* RefertoASUSserverAVLforthelatestupdate
Expansion
Slots
TotalPCI/PCI-X/
PCI-ESlots 11
SlotType
8 x PCI-E x16 (Gen3 x16 link) , FH, FL
Rear:
Dual root topology: 2 x PCI-E x16 (Gen3 x 16 link), LP, HL
or
Single root topology: 1 X PCI-E x16 (Gen3 x16 link), LP, HL
Front:
1 x PCI-E x8 (Gen3 x8 link) , LP, HL
Storage
SATAController
Intel®C621PCH
- 8 x SATA 6Gb/s ports + 2 x M.2 connector (SATA 6Gb/s &
PCI-E Gen3 x4 link, M.2 supports up to 22110)
or 6 x SATA 6Gb/s ports + 2 x NVMe + 2 x M.2 connector (SATA
6Gb/s & PCI-E Gen3 x4 link, M.2 supports up to 22110)
Intel®RSTe
( Support software RAID 0, 1, 10 & 5)
SASController
Optionalkits:
ASUS PIKE II 3008 8-port SAS HBA card
ASUS PIKE II 3108 8-port SAS HW RAID card
12G SAS Support
Storage
DeviceBays
I=Internal
AorSwillbehot-
swappable
8 x Hot-swap 2.5-inch Storage Bays
Networking LAN 1 x Dual Port Intel I350-AM2 Gigabit LAN controller
1 x Management Port
Infiniband Optionalkits:
PEM-FDR

ASUS ESC8000 G4 1-5
ModelName ESC8000G4
Graphic VGA Aspeed AST2500 64MB
FrontI/O
2 x USB 3.0 ports
2 x USB 2.0 ports
1 x VGA port
1 x COM port
RearI/O 2 x RJ-45 GbE LAN ports
1 x RJ-45 Mgmt LAN port
Switch/LED
FrontSwitch/LED:
1 x Q-Code/Port 80 LED
1 x Power switch/LED
1 x Location switch/LED
1 x Storage Device Access LED
1 x Message LED
LAN 1-4 LED
OSSupport
Windows® Server 2016
Windows® Server 2012 R2
RedHat®Enterprise Linux
SuSE® Linux Enterprise Server
CentOS
Ubuntu
VMware
Citrix XenServer
* PleasefindthelatestOSsupportfromhttp://www.asus.com/
Management
Solution
OutofBand
Remote
Hardware
On-Board ASMB9-iKVM for KVM-over-IP
Software ACC
RegulatoryCompliance BSMI, CE, FCC (Class A)
Dimension(HHxWWxDD) 798 mm x 439 mm x 175.6 mm (4U)
NetWeightKg(CPU,DRAM&
StorageDevicenotincluded) 23.5 Kg
PowerSupply/PowerRating
2+1 Redundant 1600W 80PLUS Platinum Power Supply;
1600W: 100-127/200-240 Vac,12.9/9.5A (for each inlet),
47-63Hz, Class I
Environment
Operating temperature: 10°C ~ 35°C
Non operating temperature: -40°C ~ 70°C
Non operating humidity: 20% ~ 90% (Non-condensing)
Systemspecifications
• Specications are subject to change without notice.
• Refer to www.asus.com for the latest OS AVL update.

Chapter 1: Product Introduction
1-6
1
2
3
4
5
6
7
8
1
2
1.4 Frontpanelfeatures
The barebone server features a simple yet stylish front panel. The power and reset buttons,
LED indicators, and USB ports are located and easily accessible on the front panel.
USB2.0ports
USB3.0ports
SteelpullhandleSteelpullhandle
2.5-inchBay1-8
Assettag(hidden)
VGAport
Serialport
The Dedicated Management LAN port is for the ASUS ASMB9-iKVM only.
1.5 Rearpanelfeatures
The LAN ports and system power socket are located on the rear panel of the server.
Powercordconnectorand
Redundantpowersupply
LANports
LocateLED
DedicatedManagementLANport
Full-length/Full-heightexpansionslots
Half-length/Low-profileexpansionslot
MessageLED
LAN1LED
LAN2LED
StorageDeviceAccessLED
LocationbuttonwithLED
PowerbuttonwithLED

ASUS ESC8000 G4 1-7
1.6 Internalfeatures
The barebone server includes the basic components as shown.
The barebone server does not include a oppy disk drive or an optical drive. Connect a
USB oppy disk drive to any of the USB ports on the front or rear panel if you need to use a
oppy disk.
WARNING
HAZARDOUS MOVING PARTS
KEEP FINGERS AND OTHER BODY PARTS AWAY
1. Redundant Power Supply
(hidden)
2. ASUS Z11PG-D24 server
Board
3. System fans (second row
of fans are optional)
4. 8 x Hot-swap 2.5-inch
Storage Bays
5. PCIE SKU board with
eight full-height/full-length
PCIE Expansion slots
6. Asset tag (hidden)
7. Riser card with two half-
length/low-prole PCIE
Expansion slots
(2 x Gen3 x16 link)
8. SATA/SAS backplane
(hidden)
9. Half-length/Low-prole
PCIE Expansion slot
(1 x Gen3 x8 link)
10. M.2 board with two M.2
connectors
(supports up to 22110)
11. ASUS HFI-OMNI card
bracket (supports up to
two optional ASUS HFI-
OMNI cards)
A protection lm is pre-attached to the front cover before shipping. Please remove the
protection lm before turning on the system for proper heat dissipation.

Chapter 1: Product Introduction
1-8
1.7 LEDinformation
1.7.1 FrontpanelLEDs
ESC8000G4
LED Icon Displaystatus Description
Power button
with LED ON System power ON
Storage Device
Access LED
OFF
Blinking
No activity
Read/write data into the storage device
Message LED OFF
ON
System is normal; no incoming event
A hardware monitor event is indicated
Location button
with LED
OFF
ON
Normal status
Location switch is pressed
(Press the location switch again to turn off)
LAN LEDs
OFF
Blinking
ON
No LAN connection
LAN is transmitting or receiving data
LAN connection is present
1
2
3
4
5
6
7
8
1
2
MessageLED
LAN2LED
LAN1LED
StorageDevice
AccessLED
LocationbuttonwithLED
PowerbuttonwithLED
1
2
1
2

ASUS ESC8000 G4 1-9
1.7.2 LAN(RJ-45)LEDs
LAN1/LAN2LEDs
DedicatedManagementLANLEDs(forASUSASMB9-iKVMandDM_LAN1)
ACT/LINKLED SPEEDLED
Status Description Status Description
OFF No link OFF 10 Mbps connection
GREEN Linked ORANGE 100 Mbps connection
BLINKING Data activity GREEN 1 Gbps connection
ACT/LINKLED SPEEDLED
Status Description Status Description
OFF No link OFF 10 Mbps connection
ORANGE Linked ORANGE 100 Mbps connection
BLINKING Data activity GREEN 1 Gbps connection
ACT/LINKLED SPEEDLED
DM_LAN1 LAN1/LAN2
SPEEDLEDACT/LINKLED

Chapter 1: Product Introduction
1-10
1.7.3 StoragedevicestatusLED
SATA/SASStorageDeviceLEDDescription
GREEN ON SATA/SAS storage device power ON
RED ON Storage device has failed and should be swapped immediately
GREEN/
RED Blinking RAID rebuilding
GREEN/
RED Blinking Locate
GREEN/
RED OFF Storage device not found
GREEN Blinking Read/write data from/into the SATA/SAS storage device
1
2
3
4
5
6
7
8
1
2
RedLED
GreenLED