Penguin Computing Niveus 4904GT Quick start guide
Niveus 4904GT
Technical Guide
Rev. 1.0
PENGUIN
COMPUTING
www.penguincomputing.com | 1-888-PENGUIN (736-4846) | twitter:@PenguinHPC
The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.penguincomputing.com.
Penguin Computing reserves the right to make changes to the product described in this manual at
any time and without notice. This product, including software and documentation, is the property of
Penguincomputing and/or its licensors, and is supplied only under a license.Any use or reproduction
of this product is not allowed, except as expressly permitted by the terms of said license.
IN NO EVENT WILL PENGUIN COMPUTING BE LIABLE FOR DIRECT, INDIRECT, SPECIAL,
INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE
OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE
POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, PENGUIN COMPUTING SHALL NOT
HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE
PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING
OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Penguin Computing's total liability
for all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
Manual Revision 1.0
Release Date: December 12, 2014
Unless you request and receive written permission from Penguin Computing, you may not copy
any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Copyright © 2014 by Penguin Computing
All rights reserved.
Printed in the United States of America
3
Preface
Preface
About this Manual
This manual is written for professional system integrators and PC technicians.
It provides information for the installation and use of the server. Installation and
maintainance should be performed by experienced technicians only.
Please refer to the server specications page on our Web site for updates on
supported memory, processors and operating systems (www.penguincomputing.
com).
Notes
If you have any questions, please contact our support team at:
This manual may be periodically updated without notice. Please check the Penguin
Computing Web site for possible updates to the manual revision level.
Warnings
Special attention should be given to the following symbols used in this manual.
Warning! Indicates high voltage may be encountered when performing
a procedure.
Warning! Indicates important information given to prevent equipment/
property damage or personal injury.
4
Niveus 4904GT User's Guide
Contents
Chapter 1 Introduction..............................................................................1-1
1-1 Overview .........................................................................................................1-1
1-2 Serverboard Features.....................................................................................1-2
Processors ......................................................................................................1-2
Memory ...........................................................................................................1-2
SATA ..............................................................................................................1-2
PCI Expansion Slots.......................................................................................1-2
Rear I/O Ports.................................................................................................1-2
IPMI.................................................................................................................1-2
1-3 Chassis Features............................................................................................1-3
System Power.................................................................................................1-3
Hard Drive/Drive Bays ....................................................................................1-3
Control Panel ..................................................................................................1-3
Cooling System...............................................................................................1-3
Mounting Rails (optional)................................................................................1-3
1-4 GPU Subsystem ............................................................................................1-4
GPU Kit...........................................................................................................1-4
1-5 Contacting Penguincomputing ........................................................................1-6
Chapter 2 Rack Installation .....................................................................2-1
2-1 Unpacking the System....................................................................................2-1
2-2 Preparing for Setup.........................................................................................2-1
Choosing a Setup Location.............................................................................2-1
2-3 Warnings and Precautions..............................................................................2-2
Rack Precautions............................................................................................2-2
General Server Precautions............................................................................2-2
Rack Mounting Considerations.......................................................................2-3
Ambient Operating Temperature................................................................2-3
Sufcient Airow.........................................................................................2-3
Circuit Overloading.....................................................................................2-3
Reliable Ground .........................................................................................2-3
2-4 Procedure for Rack Mounting ........................................................................2-4
Removing the Tower Top Cover and Feet......................................................2-4
Identifying the Sections of the Rack Rails......................................................2-6
Installing the Chassis Handles and Inner Rails..............................................2-7
Installing the Outer Rails onto the Rack.........................................................2-8
Sliding the Chassis onto the Rack Rails.........................................................2-9
2-5 Tower Conguration Instructions...................................................................2-10
5
Preface
Chapter 3 System Interface......................................................................3-1
3-1 Overview .........................................................................................................3-1
3-2 Control Panel Buttons.....................................................................................3-2
3-3 Control Panel LEDs ........................................................................................3-2
3-4 Drive Carrier LEDs..........................................................................................3-3
3-5 Power Supply LEDs........................................................................................3-4
Chapter 4 Standardized Warning Statements for AC Systems
About Standardized Warning Statements.......................................................4-1
Warning Denition...........................................................................................4-1
Installation Instructions....................................................................................4-4
Circuit Breaker ................................................................................................4-5
Power Disconnection Warning........................................................................4-6
Equipment Installation.....................................................................................4-8
Restricted Area................................................................................................4-9
Battery Handling............................................................................................4-10
Redundant Power Supplies (if applicable to your system)...........................4-12
Backplane Voltage (if applicable to your system).........................................4-13
Comply with Local and National Electrical Codes........................................4-14
Product Disposal...........................................................................................4-15
Hot Swap Fan Warning (if applicable to your system)................................. 4-16
Power Cable and AC Adapter ......................................................................4-18
Chapter 5 Advanced Serverboard Setup................................................5-1
5-1 Handling the Serverboard...............................................................................5-1
Precautions .....................................................................................................5-1
Unpacking .......................................................................................................5-1
5-2 Connecting Cables..........................................................................................5-2
Connecting Data Cables.................................................................................5-2
Connecting Power Cables ..............................................................................5-2
Connecting the Control Panel.........................................................................5-2
5-3 I/O Ports..........................................................................................................5-3
5-4 Installing the Processor and Heatsink ............................................................5-4
Installing an LGA 2011 Processor...................................................................5-4
Installation and Removal of the Heatsink.......................................................5-7
5-5 Installing Memory............................................................................................5-8
Memory Support ............................................................................................5-8
Processor & Memory Module Population Conguration ............................5-9
Populating LRDIMM and RDIMM ECC Memory Modules.......................5-10
5-6 Installing PCI Expansion Cards ....................................................................5-10
5-7 Serverboard Details ......................................................................................5-12
6
Niveus 4904GT User's Guide
5-8 Connector Denitions ...................................................................................5-15
Power Connections.......................................................................................5-15
Control Panel Connections...........................................................................5-15
Other Connectors..........................................................................................5-18
5-9 Jumper Settings............................................................................................5-23
5-10 Onboard Indicators........................................................................................5-26
5-11 SATA Ports....................................................................................................5-27
5-12 Onboard Battery............................................................................................5-28
Chapter 6 Advanced Chassis Setup........................................................6-1
6-1 Static-Sensitive Devices..................................................................................6-2
Precautions .....................................................................................................6-2
6-2 Control Panel ..................................................................................................6-2
Control Panel Orientation................................................................................6-3
6-3 Conguring Drives...........................................................................................6-5
Conguring the 5.25" Drive Bays....................................................................6-5
Additional Hard Drives ..............................................................................6-8
Installing Drives in the Default HDD Bays......................................................6-9
6-4 System Cooling..............................................................................................6-11
System Fan Failure........................................................................................6-11
Replacing System Fans.................................................................................6-11
Installing the GPU Kit....................................................................................6-13
6-5 Power Supply................................................................................................6-19
Replacing the Power Supply.........................................................................6-19
Power Supply Connections...........................................................................6-20
Chapter 7 BIOS .........................................................................................7-1
7-1 Introduction......................................................................................................7-1
Starting BIOS Setup Utility..............................................................................7-1
How To Change the Conguration Data.........................................................7-2
Starting the Setup Utility.................................................................................7-2
7-2 Main Setup......................................................................................................7-2
7-3 Advanced Setup Congurations......................................................................7-4
7-4 Event Logs.................................................................................................... 7-31
7-5 IPMI...............................................................................................................7-33
7-6 Security Settings...........................................................................................7-35
7-7 Boot Settings.................................................................................................7-36
7-8 Save & Exit ...................................................................................................7-38
Appendix A BIOS Error Beep Codes ..................................................... A-1
7
Preface
Appendix B System Specications ........................................................ B-1
8
Niveus 4904GT User's Guide
Notes
Chapter 1
Introduction
1-1 Overview
The workstation Niveus 4904gt is comprised of two main subsystems: the
SC747BTQ-R2K02B 4U/Tower chassis and the X10DRG-Q dual Intel Xeon
processor serverboard. Please refer to our web site for information on operating
systems that have been certied for use with the system (www.penguincomputing.
com).
In addition to the serverboard and chassis, various hardware components have
been included with the workstation, as listed below:
• SATA accessories:
One HD backplane (BPN-SAS-747TQ)
Eight 3.5" hard disk drive carriers (MCP-220-00094-0B)
Three 5.25" drive trays (MCP-220-00073-0B)
• Cooling
Four 92x38 mm middle fans (FAN-0138L4, FAN-0114L4)
Two 80x38 mm rear exhaust fans (FAN-0082L4)
Two 4U active CPU heatsinks (SNK-P0050AP4)
Optional
• One 4U 17.2" width rack rail set (MCP-290-00059-0B)
• SC747B GPU / Add-on Card Dummy Assembly (2 Slots), Single Pack (MCP-
240-00096-0N)
• GPU Kit that includes two rear fans and one air shroud (MCP-320-74701-0N-
KIT)
• HDD conversion tray, hotswap Gen. 6 3.5" to 2.5" (MCP-220-93801-0B)
Chapter 1: Introduction
1-1
1-2
Niveus 4904GT User's Manual
1-2 Serverboard Features
At the heart of the Niveus 4904GT workstation lies the X10DRG-Q, a dual processor
serverboard based on the Intel C612 Express chipset. Below are the main features
of the serverboard. (See Figure 1-1 for a block diagram of the chipset).
Processors
The system supports two Intel Xeon E5-2600 v3 Series processors in
Dual Socket R3 (LGA 2011). Please refer to the serverboard description pages on
the Penguin Computing web site for a complete listing of supported processors.
Memory
The system has sixteen DDR4 DIMM slots that can support up to 1 TB ECC LRDIMM
or 512 GB ECC RDIMM. Memory type is 2133/1866/1600MHz ECC DDR4 SDRAM
72-bit. See Chapter 5 for details.
SATA
A SATA controller is integrated into the chipset to provide a ten-port SATA 3.0
subsystem, which is RAID 0, 1, 5 and 10 supported. The SATA drives are hot-
swappable units.
Note: The operating system you use must have RAID support to enable the hot-
swap capability and RAID function of the Serial ATA drives.
PCI Expansion Slots
The serverboard has four PCI-E 3.0 x16, two PCI-E 3.0 x8 (one in x16) and one
PCI-E 2.0 x4 (in x8) slots for a total of seven PCI expansion slots.
Rear I/O Ports
The I/O ports include one COM port, a VGA (monitor) port, two USB 3.0 ports and
two USB 2.0 ports, a dedicated IPMI LAN port and two Gb Ethernet LAN ports.
IPMI
IPMI (Intelligent Platform Management Interface) is a hardware-level interface
specication that provides remote access, monitoring and administration for Penguin
Computing workstation platforms. IPMI allows administrators to view a workstation’s
hardware status remotely, receive an alarm automatically if a failure occurs, and
power cycle a system that is non-responsive.
1-3
Chapter 1: Introduction
1-3 Chassis Features
The following is a general outline of the main features of the SC747BTQ-R2K02B
chassis.
System Power
The chassis includes a 2000 W high-efciency, hoto-plug, redundant (1+1) power
supply consisting of two power supply modules. In the unlikely event a power supply
module fails, replacement is simple.
Hard Drive/Drive Bays
The chassis features eight drive bays for SATA drives. These drives are hot
-swappable. Once set up correctly, these drives can be removed without powering
down the workstation.
The SC747B chassis also provides three 5.25” peripheral drive bays for oppy
drives, DVD/CD drives, or additional hard drives.
Control Panel
The control panel on the workstation provides you with system monitoring and
control. LEDs indicate system power, HDD activity, network activity, system
overheat, UID and power supply failure. A main power button and a system reset
button are also included.
Cooling System
The chassis accepts four system fans and two rear exhaust fans. System fans are
powered from the serverboard. These fans are 4U high and are powered by 4-pin
connectors.
Mounting Rails (optional)
The system can be placed in a rack for secure storage and use.
1-4
Niveus 4904GT User's Manual
1-4 GPU Subsystem
The Niveus 4904GT is a massively parallel-processing, quad-GPU server with
support for up to four NVIDIA Tesla GPUs (such as Kepler K10, K20, K20X, K40,
K80) and Xeon Phi Coprocessor GPUs, placing this system at the forefront of today's
GPU computing solutions.
Refer to the NVIDIA web site (www.nvidia.com) or the Intel website (www.intel.com)
for details on these GPUs
GPU Kit
When using passive GPUs with this system, you must use the GPU add-on kit,
MCP-320-74701-0N-KIT. This kit consists of one mylar air shroud to concentrate
air ow to the GPU and two fans with cages that can be attached to the back of
the chassis to provide the required cooling for passive GPUs.
1-5
Chapter 1: Introduction
Figure 1-1. Intel C612 Express Chipset:
System Block Diagram
Note: This is a general block diagram. Please see Chapter 5 for details.
1-6
Niveus 4904GT User's Manual
1-5 Contacting Penguin Computing
Headquarters
Address: Penguin Computing
45800 Northport Loop West
Fremont, CA 94538 U.S.A.
Tel: +1 (888) 736-4846
Fax: +1 (415) 954-2899
Email: [email protected] (General Information)
[email protected] (Technical Support)
Website: www.penguincomputing.com
2-1
Chapter 2: Rack Intallation
Chapter 2
Rack Installation
This chapter provides instructions for preparing and mounting your chassis in a
rack. By default, the chassis is shipped congured as a tower. The tower top cover
and bottom feet must be removed to mount in a rack. Also, the control panel/drive
module should be rotated 90 degrees. See Chapter 6 for this procedure.
2-1 Unpacking the System
You should inspect the box the chassis was shipped in and note if it was damaged
in any way. If the chassis itself shows damage, le a damage claim with the carrier
who delivered it.
Mounting rails are optional for this system. Be sure you have received the correct
rail kit for your server.
2-2 Preparing for Setup
Decide on a suitable location for the rack unit that will hold your chassis. It should
be a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical
noise and electromagnetic elds are generated. A nearby grounded power outlet.
is required
Choosing a Setup Location
• Leave at least 25 inches clearance in front of the rack to open the front door
completely.
• Leave approximately 30 inches of clearance in the back of the rack to allow
for sufcient airow and access for servicing.
• It should be a restricted access location, such as a dedicated equipment room
or a service closet.
Niveus 4904GT User's Guide
2-2
2-3 Warnings and Precautions
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are fully extended to
the oor with the full weight of the rack resting on them.
• In single rack installations, stabilizers should be attached to the rack.
• In multiple rack installations, the racks should be coupled together.
• Always make sure that the rack is stable before extending a component from
the rack.
• Only one chassis should be extended from the rack at a time. Extending two
or more chassis simultaneously may cause the rack to become unstable.
• When initially installing the server to a rack, test that the rail locking tabs en-
gage to prevent the server from being overextended. Have a rack lift in place
as a precaution in case the test fails.
• In any instance of pulling the system from the rack, always use a rack lift and
follow all associated safety precautions.
General Server Precautions
• Review the electrical and general safety precautions that came with the com-
ponents you are adding to your chassis.
• Determine the placement of each component in the rack before you install the
rails.
• Install the heaviest server components on the bottom of the rack rst, and
then work upward.
• Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
• Allow the hot-swappable hard drives and power supply modules to cool be-
fore touching them.
• Always keep the rack's front door and all panels and components on the serv-
ers closed when not servicing to maintain proper cooling.
2-3
Chapter 2: Rack Intallation
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating tempera-
ture of the rack environment may be greater than the ambient temperature of the
room. Therefore, consideration should be given to installing the equipment in an
environment compatible with the manufacturer’s maximum rated ambient tempera-
ture (TMRA).
Sufcient Airow
Equipment should be mounted into a rack so that the amount of airow required
for safe operation is not compromised.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself
should be grounded. Particular attention should be given to power supply connec-
tions other than the direct connections to the branch circuit (i.e. the use of power
strips, etc.).
Warning: To prevent bodily injury when mounting or servicing this unit in a
rack, you must take special precautions to ensure that the system remains
stable. The following guidelines are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in
the rack.
• When mounting this unit in a partially lled rack, load the rack from the bottom
to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before
mounting or servicing the unit in the rack.
• Slide rail mounted equipment is not to be used as a shelf or a work space.
Niveus 4904GT User's Guide
2-4
2-4 Procedure for Rack Mounting
This section provides information on installing a 4U chassis into a rack. There are
a variety of rack units on the market, so the assembly procedure may differ slightly.
Also refer to the installation instructions for your rack unit.
The tower top cover and bottom feet must be removed to mount in a rack. Also,
the control panel/drive module should be rotated 90 degrees. See Chapter 6 for
this procedure.
Removing the Tower Top Cover and Feet
The chassis is shipped with the tower top cover and feet installed. Both must be
removed for before installing the rails.
Removing the Tower Top Cover
1. Locate the chassis cover lock (blue lever) at the rear of the chassis cover.
2. Slide the chassis cover lock to the right and push chassis cover forward.
3. Lift the chassis top cover off the chassis.
Removing the Chassis Feet
1. Place the chassis on its side with the chassis side cover facing upward.
2. Remove the screw holding the chassis foot in place.
3. The foot lock is a tab located in the center of the foot that prevents the foot from
sliding. Using a at head screwdriver, gently lift the foot lock upward and slide
the foot toward the rear of the chassis.
2-5
Chapter 2: Rack Intallation
Chassis Cover
Chassis Foot
Chassis Cover Lock
Figure 2-1. Removing the Feet and Chassis Top Cover
Niveus 4904GT User's Guide
2-6
Figure 2-2. Identifying the Inner Rails and Chassis Handles
Chassis Handle
Inner Rails
Warning: Do not pick up the server with the front handles. They are de-
signed to pull the system from a rack only.
Identifying the Sections of the Rack Rails
The chassis package includes two rail assemblies. Each assembly consists of three
sections: An inner rail that secures directly to the chassis, an outer rail that secures
to the rack, and a middle rail which extends from the outer rail. These assemblies
are specically designed for the left and right side of the chassis.
Table of contents
