Penguin Computing Relion 1900e Quick start guide

Relion 1900e
Technical Guide
Rev. 1.0
PENGUIN
COMPUTING
www.penguincomputing.com | 1-888-PENGUIN (736-4846) | twitter:@PenguinHPC

Relion 1900e/2900e
Manual
Revision 1.3
April 2016
Intel®Server Boards and Systems

ii Revision 1.3
Relion 1900e/2900e Manual
Revision History
Date
Revision
Number
Modifications
August 2014
1..0
1st External Public Release
December 2014 1.01
Changes from previous release:
•Removed content references to PCIx Riser Card support
•Added Appendix F – Statement of Volatility
July 2015 1.1
Changes from previous release:
•Chapter 7.1.2. Updated to “Fan speed control with SDR”
•Chapter 7.3.10. Updated to “Power supply inlet temperature
•Chapter 7.3.10.2. Updated content references to “Processor DTS-Spec
Margin Sensor(s)
•Chapter 7.3.10.6. Updated content references to “Inlet Temperature
Sensor”
•Chapter 7.3.14.5. Updated “buffer DIMMs” to “DIMMs with teperature
sensors”
•Chapter 7.3.14.6.2.1. Updated content references to “Memory Thermal
Throttling”
•Chapter 7.3.14.6.5. Updated “Fan profiles” to “Autoprofile”
•Chapter 7.3.14.6.6. Removed content references to open loop thermal
throttling(OLTT)
•Chapter 7.3.14.6.7. Updated content references to “ASHRAE Compliance”
November 2015 1.2
•Chapter 6.1. Updated BIOS Setup Utility Security Options Menu
•Chapter 11.6. BIOS Updated BIOS recovery jumper
April 2016 1.3
•Updated to include Refresh SKUs.
•Added TPM (2.0)
•Added E5-2600 v4 Processor famility support
•Updated DIMMs support table

Revision 1.3 iii
Relion 1900e/2900e Manual
Disclaimers
Information in this document is provided in connection with Penguin Computing® products. No license, express or implied, by estoppel
or otherwise, to any intellectual property rights is granted by this document. Except as provided in Penguin's Terms and Conditions of
Sale for such products, Penguin Computing assumes no liability whatsoever, and Penguin Computing disclaims any express or implied
warranty, relating to sale and/or use of Penguin Computing products including liability or warranties relating to fitness for a particular
purpose, merchantability, or infringement of any patent, copyright or other intellectual property right. Penguin Computing products are
not intended for use in medical, lifesaving, or life sustaining applications. Penguin Computing may make changes to specifications and
product descriptions at any time, without notice.
A "Mission Critical Application" is any application in which failure of the Penguin Computing Product could result, directly or indirectly,
in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION,
YOU SHALL INDEMNIFY AND HOLD Penguin Computing AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE
DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND
REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL
INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT PENGUIN COMPUTING
OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE PENGUIN COMPUTING PRODUCT
OR ANY OF ITS PARTS.
Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined."
Penguin Computing reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities
arising from future changes to them.
The Relion 1900e/2900e may contain design defects or errors known as errata which may cause the product to deviate from
published specifications. Current characterized errata are available on request.
This document and the software described in it are furnished under license and may only be used or copied in accordance with the
terms of the license. The information in this manual is furnished for informational use only, is subject to change without notice, and
should not be construed as a commitment by Penguin Computing. Penguin Computing assumes no responsibility or liability for any
errors or inaccuracies that may appear in this document or any software that may be provided in association with this document.
Except as permitted by such license, no part of this document may be reproduced, stored in a retrieval system, or transmitted in any
form or by any means without the express written consent of Penguin Computing.
Intel and Xeon are trademarks or registered trademarks of Intel Corporation.
*
Copyright © 2014 - 2016 Penguin Computing. All rights reserved.

Relion 1900e/2900e Manual
iv Revision 1.3
Table of Contents
1. Introduction........................................................................................................................................1
1.1 Chapter Outline....................................................................................................................................1
1.2 Server Board Use Disclaimer..........................................................................................................1
2. Product Features Overview.............................................................................................................2
2.1 Server Board Component/Feature Identification..................................................................4
2.2 Product Architecture Overview.....................................................................................................8
2.3 System Software Overview ............................................................................................................. 9
2.3.1 System BIOS..........................................................................................................................................9
2.3.2 Field Replaceable Unit (FRU) and Sensor Data Record (SDR) Data............................. 13
2.3.3 Baseboard Management Controller (BMC) & Management Engine (ME)
Firmware................................................................................................................................................................. 13
3. Processor Support.......................................................................................................................... 14
3.1 Processor Socket Assembly ........................................................................................................ 14
3.2 Processor Thermal Design Power (TDP) Support .............................................................. 15
3.3 Processor Population Rules......................................................................................................... 15
3.4 Processor Initialization Error Summary.................................................................................. 16
3.5 Processor Function Overview ..................................................................................................... 18
3.5.1 Processor Core Features:.............................................................................................................. 18
3.5.2 Supported Technologies: ............................................................................................................. 18
4. System Memory .............................................................................................................................. 21
4.1 Memory Sub-system Architecture............................................................................................ 21
4.2 IMC Modes of operation................................................................................................................ 22
4.3 Memory RASM Features................................................................................................................ 22
4.4 Supported Memory ......................................................................................................................... 23
4.5 NVDIMM Support ............................................................................................................................. 24
4.6 Memory Slot Identification and Population Rules ............................................................. 24
4.6.1 Memory Interleaving Support..................................................................................................... 27
4.6.2 NUMA Configuration Support..................................................................................................... 27
4.7 System Memory Sizing and Publishing................................................................................... 27
4.7.1 Effects of Memory Configuration on Memory Sizing........................................................ 27
4.7.2 Publishing System Memory......................................................................................................... 28
4.8 Memory Initialization...................................................................................................................... 29
4.8.1 DIMM Discovery............................................................................................................................... 29
4.8.2 DIMM Population Validation Check.......................................................................................... 29
4.8.3 Channel Training .............................................................................................................................. 30
5. System I/O ....................................................................................................................................... 32

Relion 1900e/2900e Manual
Revision 1.3 v
5.1 PCIe* Support .................................................................................................................................... 32
5.2 PCIe* Enumeration and Allocation ........................................................................................... 33
5.3 PCIe* Non-Transparent Bridge (NTB) ...................................................................................... 33
5.4 Add-in Card Support ...................................................................................................................... 34
5.4.1 Riser Card Support .......................................................................................................................... 35
5.4.2 Intel® I/O Module Support............................................................................................................ 38
5.4.3 Intel®Integrated RAID Option...................................................................................................... 39
5.5 Serial ATA (SATA) Support........................................................................................................... 40
5.5.1 Staggered Disk Spin-Up................................................................................................................ 42
5.6 Embedded SATA SW-RAID support......................................................................................... 42
5.6.1 Intel®Rapid Storage Technology (RSTe) 4.1 ......................................................................... 42
5.6.2 Intel®Embedded Server RAID Technology 2 (ESRT2) 1.41 ............................................ 43
5.7 Network Interface............................................................................................................................. 44
5.7.1 Intel® Ethernet Controller Options............................................................................................ 45
5.7.2 Factory Programmed MAC Address Assignments ............................................................. 45
5.8 Video Support ................................................................................................................................... 45
5.8.1 Dual Video and Add-In Video Adapters ................................................................................. 46
5.8.2 Setting Video Configuration Options using the BIOS Setup Utility ............................ 48
5.9 USB Support....................................................................................................................................... 50
5.9.1 Low Profile eUSB SSD Support.................................................................................................. 50
5.10 Serial Ports.......................................................................................................................................... 51
6. System Security .............................................................................................................................. 53
6.1 BIOS Setup Utility Security Options Menu............................................................................ 53
6.1.1 Password Setup ................................................................................................................................ 53
6.1.2 System Administrator Password Rights ................................................................................. 54
6.1.3 Authorized System User Password Rights and Restrictions.......................................... 54
6.1.4 Front Panel Lockout........................................................................................................................ 55
6.2Trusted Platform Module (TPM) Support .............................................................................. 55
6.2.1 TPM security BIOS ........................................................................................................................... 56
6.2.2 Physical Presence ............................................................................................................................ 56
6.2.3 TPM Security Setup Options ....................................................................................................... 56
6.3 Intel®Trusted Execution Technology....................................................................................... 57
7. Platform Management................................................................................................................... 58
7.1 Management Feature Set Overview ......................................................................................... 58
7.1.1 IPMI 2.0 Features Overview ......................................................................................................... 58
7.1.2 Non IPMI Features Overview ....................................................................................................... 59
7.2 Platform Management Features and Functions.................................................................. 61
7.2.1 Power Sub-system........................................................................................................................... 61

Relion 1900e/2900e Manual
vi Revision 1.3
7.2.2 Advanced Configuration and Power Interface (ACPI)....................................................... 61
7.2.3 System Initialization........................................................................................................................ 61
7.2.4 Watchdog Timer............................................................................................................................... 62
7.2.5 System Event Log (SEL)................................................................................................................. 62
7.3 Sensor Monitoring ........................................................................................................................... 62
7.3.1 Sensor Scanning............................................................................................................................... 63
7.3.2 Sensor Rearm Behavior ................................................................................................................. 63
7.3.3 BIOS Event-Only Sensors ............................................................................................................. 64
7.3.4 Margin Sensors.................................................................................................................................. 64
7.3.5 IPMI Watchdog Sensor .................................................................................................................. 64
7.3.6 BMC Watchdog Sensor.................................................................................................................. 64
7.3.7 BMC System Management Health Monitoring..................................................................... 64
7.3.8 VR Watchdog Timer........................................................................................................................ 64
7.3.9 System Airflow Monitoring........................................................................................................... 64
7.3.10 Thermal Monitoring ........................................................................................................................ 65
7.3.11 Processor Sensors ........................................................................................................................... 68
7.3.12 Voltage Monitoring.......................................................................................................................... 70
7.3.13 Fan Monitoring.................................................................................................................................. 70
7.3.14 Standard Fan Management.......................................................................................................... 72
7.3.15 Power Management Bus (PMBus*)............................................................................................ 78
7.3.16 Power Supply Dynamic Redundancy Sensor ....................................................................... 78
7.3.17 Component Fault LED Control ................................................................................................... 78
7.3.18 NMI (Diagnostic Interrupt) Sensor............................................................................................. 79
7.3.19 LAN Leash Event Monitoring....................................................................................................... 79
7.3.20 Add-in Module Presence Sensor............................................................................................... 79
7.3.21 CMOS Battery Monitoring............................................................................................................. 80
8. Intel® Intelligent Power Node Manager (NM) Support Overview ........................................ 81
8.1 Hardware Requirements ............................................................................................................... 81
8.2Features................................................................................................................................................ 81
8.3 ME System Management Bus (SMBus*) interface............................................................... 81
8.4 PECI 3.0 ................................................................................................................................................ 82
8.5 NM “Discovery” OEM SDR............................................................................................................. 82
8.6 SmaRT/CLST ...................................................................................................................................... 82
8.6.1 Dependencies on PMBus*-compliant Power Supply Support...................................... 83
9. Basic and Advanced Server Management Features............................................................... 84
9.1 Dedicated Management Port ...................................................................................................... 85
9.2 Embedded Web Server.................................................................................................................. 85
9.3 Advanced Management Feature Support (RMM4 Lite)................................................... 87

Relion 1900e/2900e Manual
Revision 1.3 vii
9.3.1 Keyboard, Video, Mouse (KVM) Redirection ......................................................................... 87
9.3.2 Remote Console ............................................................................................................................... 88
9.3.3 Performance....................................................................................................................................... 88
9.3.4 Security................................................................................................................................................. 89
9.3.5 Availability........................................................................................................................................... 89
9.3.6 Usage..................................................................................................................................................... 89
9.3.7 Force-enter BIOS Setup ................................................................................................................ 89
9.3.8 Media Redirection ............................................................................................................................ 89
10. On-board Connector/Header Overview.................................................................................... 91
10.1 Power Connectors ........................................................................................................................... 91
10.1.1 Main Power ......................................................................................................................................... 91
10.1.2 Hot Swap Backplane Power Connector.................................................................................. 92
10.1.3 Peripheral Drive Power Connector........................................................................................... 93
10.1.4 Riser Card Supplemental 12V Power Connectors.............................................................. 93
10.2 Front Panel Headers and Connectors ..................................................................................... 94
10.2.1 Front Panel Button and LED Support...................................................................................... 94
10.2.2 Front Panel LED and Control Button Features Overview................................................ 95
10.2.3 Front Panel USB 2.0 Connector ................................................................................................. 96
10.2.4 Front Panel USB 3.0 Connector ................................................................................................. 97
10.2.5 Front Panel Video Connector...................................................................................................... 97
10.2.6 Intel®Local Control Panel Connector....................................................................................... 97
10.3 On-Board Storage Option Connectors ................................................................................... 98
10.3.1 Single Port SATA Only Connectors .......................................................................................... 98
10.3.2 Internal Type-A USB Connector ................................................................................................ 99
10.3.3 Internal 2mm Low Profile eUSB SSD Connector ................................................................ 99
10.4 System Fan Connectors.............................................................................................................. 100
10.5 Other Connectors and Headers .............................................................................................. 101
10.5.1 Chassis Intrusion Header ........................................................................................................... 101
10.5.2 Storage Device Activity LED Header...................................................................................... 101
10.5.3 Intelligent Platform Management Bus (IPMB) Connector............................................ 101
10.5.4 Hot Swap Backplane I2C* Connectors ................................................................................. 102
10.5.5 SMBus Connector.......................................................................................................................... 102
11. Reset and Recovery Jumpers..................................................................................................... 103
11.1 BIOS Default Jumper Block ...................................................................................................... 103
11.2 Serial Port ‘A’ Configuration Jumper .................................................................................... 104
11.3 Password Clear Jumper Block................................................................................................. 104
11.4 Management Engine (ME) Firmware Force Update Jumper Block........................... 104
11.5 BMC Force Update Jumper Block .......................................................................................... 105

Relion 1900e/2900e Manual
viii Revision 1.3
11.6 BIOS Recovery Jumper............................................................................................................... 106
12. Light Guided Diagnostics............................................................................................................ 107
12.1 System ID LED ................................................................................................................................ 108
12.2 System Status LED........................................................................................................................ 108
12.3 BMC Boot/Reset Status LED Indicators ............................................................................... 111
12.4 Post Code Diagnostic LEDs....................................................................................................... 111
12.5 Fan Fault LEDs................................................................................................................................ 111
12.6 Memory Fault LEDs ...................................................................................................................... 111
12.7 CPU Fault LEDs............................................................................................................................... 111
13. Power Supply Specification Guidelines .................................................................................. 112
13.1 Power Supply DC Output Connector.................................................................................... 112
13.2 Power Supply DC Output Specification............................................................................... 113
13.2.1 Output Power/Currents.............................................................................................................. 113
13.2.2 Standby Output ............................................................................................................................. 113
13.2.3 Voltage Regulation ....................................................................................................................... 113
13.2.4 Dynamic Loading........................................................................................................................... 113
13.2.5 Capacitive Loading ....................................................................................................................... 114
13.2.6 Grounding......................................................................................................................................... 114
13.2.7 Closed loop stability .................................................................................................................... 114
13.2.8 Residual Voltage Immunity in Standby mode................................................................... 114
13.2.9 Common Mode Noise.................................................................................................................. 114
13.2.10 Soft Starting .................................................................................................................................... 114
13.2.11 Zero Load Stability Requirements ......................................................................................... 114
13.2.12 Hot Swap Requirements............................................................................................................. 114
13.2.13 Forced Load Sharing.................................................................................................................... 114
13.2.14 Ripple/Noise.................................................................................................................................... 115
13.2.15 Timing Requirements.................................................................................................................. 115
Appendix A – Integration and Usage Tips ...................................................................................... 117
Appendix B – Integrated BMC Sensor Tables................................................................................ 118
Appendix C – Management Engine Generated SEL Event Messages ....................................... 132
Appendix D –POST Code Diagnostic LED Decoder .................................................................... 134
Appendix E – POST Code Errors....................................................................................................... 141
Appendix F – Statement of Volatility .............................................................................................. 147
Appendix G – Supported Intel®Server Systems............................................................................ 149

Relion 1900e/2900e Manual
Revision 1.3 ix
List of Figures
Figure 1. Server Board Component/Features Identification........................................................................4
Figure 2. SW2600T External I/O Connector Layout ................................................ 5
Figure 3. Intel® Light Guided Diagnostics - DIMM Fault LEDs......................................................................5
Figure 4. Intel®Light Guided Diagnostic LED Identification..........................................................................6
Figure 5. Jumper Block Identification....................................................................................................................7
Figure 6. Relion 1900e/2900e Architectural Block Diagram ..................................................... 8
Figure 7. Processor Socket Assembly ............................................................................................................... 14
Figure 8. LGA2011-3 ILM (Narrow) ...................................................................................................................... 14
Figure 9. Memory Sub-system Block Diagram................................................................................................ 21
Figure 10. Memory Slots Definition..................................................................................................................... 24
Figure 11. S2600WT Memory Slot Layout ................................................................ 25
Figure 12. On-board Add-in Card Support ...................................................................................................... 35
Figure 13. 1U one slot PCIe* riser card (iPC – F1UL16RISER2)................................................................ 36
Figure 14. 2U three PCIe* slot riser card (iPC – A2UL8RISER2) ............................................................... 36
Figure 15. 2U two PCIe* slot riser card (iPC – A2UL16RISER2)................................................................ 37
Figure 16. 2U two PCIe* slot (Low Profile) PCIe* Riser card (iPC – A2UX8X4RISER) – Riser Slot
#3 compatible only............................................................................................................................................ 37
Figure 17. Server Board Layout - I/O Module Connector........................................................................... 38
Figure 18. Server Board Layout – Intel® Integrated RAID Module Option Placement.................... 39
Figure 19. Onboard SATA Features..................................................................................................................... 40
Figure 20. SATA RAID 5 Upgrade Key................................................................................................................. 44
Figure 21. Network Interface Connectors......................................................................................................... 44
Figure 22. External RJ45 NIC Port LED Definition......................................................................................... 45
Figure 23. BIOS Setup Utility - Video Configuration Options................................................................... 48
Figure 24. Onboard USB Port Support .............................................................................................................. 50
Figure 25. Low Profile eUSB SSD Support ....................................................................................................... 50
Figure 26. High-level Fan Speed Control Process......................................................................................... 75
Figure 27. Intel®RMM4 Lite Activation Key Installation.............................................................................. 85
Figure 28. High Power Add-in Card 12V Auxiliary Power Cable Option.............................................. 93
Figure 29. System Fan Connector Pin-outs .................................................................................................. 100
Figure 30. System Fan Connector Placement.............................................................................................. 100
Figure 31. Reset and Recovery Jumper Block Location........................................................................... 103
Figure 32. On-Board Diagnostic LED Placement ........................................................................................ 107
Figure 33. DIMM Fault LED Placement............................................................................................................ 108
Figure 34. Turn On/Off Timing (Power Supply Signals)........................................................................... 116
Figure 35. POST Diagnostic LED Location..................................................................................................... 134

Relion 1900e/2900e Manual
x Revision 1.3
Figure 36. Relion 1900e................................................................................................... 149
Figure 37. Relion 2900e................................................................................................... 152

Relion 1900e/2900e Manual
Revision 1.3 xi
List of Tables
Table 1. Relion 1900e/2900e Feature Set ......................................................................................... 2
Table 2. POST Hot-Keys........................................................................................................................................... 11
Table 3. Mixed Processor Configurations Error Summary......................................................................... 16
Table 4. DDR4 RDIMM & LRDIMM Support ..................................................................................................... 23
Table 5. Relion 1900e/2900e Memory Slot Identification ................................................................ 25
Table 6. DIMM Population Matrix......................................................................................................................... 26
Table 7. PCIe* Port Routing CPU #1.................................................................................................................... 32
Table 8. PCIe* Port Routing – CPU #2 ............................................................................................................... 33
Table 9. Riser Card #1 - PCIe* Root Port Mapping........................................................................................ 35
Table 10. Riser Card #2 - PCIe* Root Port Mapping ..................................................................................... 35
Table 11. Riser Slot #3 - PCIe* Root Port Mapping....................................................................................... 36
Table 12. Supported Intel®I/O Module Options ............................................................................................ 38
Table 13. SATA and sSATA Controller BIOS Utility Setup Options ....................................................... 41
Table 14. SATA and sSATA Controller Feature Support............................................................................ 41
Table 15. Video Modes............................................................................................................................................. 46
Table 16. Serial A Connector Pin-out................................................................................................................. 51
Table 17. Serial-B Connector Pin-out ................................................................................................................ 52
Table 18. TPM Setup Utility – Security Configuration Screen Fields .................................................... 57
Table 19. Server Board Power Control Sources............................................................................................. 61
Table 20. ACPI Power States.................................................................................................................................. 61
Table 21. Processor Sensors.................................................................................................................................. 68
Table 22. Processor Status Sensor Implementation.................................................................................... 68
Table 23. Component Fault LEDs......................................................................................................................... 78
Table 24. Intel®Remote Management Module 4 (RMM4) Options......................................................... 84
Table 25. Basic and Advanced Server Management Features Overview............................................. 84
Table 26. Main Power (Slot 1) Connector Pin-out (“MAIN PWR 1”)...................................................... 91
Table 27. Main Power (Slot 2) Connector Pin-out ("MAIN PWR 2”) ....................................................... 92
Table 28. Hot Swap Backplane Power Connector Pin-out (“HSBP PWR") .......................................... 92
Table 29. Peripheral Drive Power Connector Pin-out ("Peripheral_PWR")......................................... 93
Table 30. Riser Slot Auxiliary Power Connector Pin-out ("OPT_12V_PWR”)..................................... 93
Table 31. Front Panel Features ............................................................................................................................. 94
Table 32. Front Panel Connector Pin-out ("Front Panel” and “Storage FP”)...................................... 94
Table 33. Power/Sleep LED Functional States ............................................................................................... 95
Table 34. NMI Signal Generation and Event Logging .................................................................................. 96
Table 35. Front Panel USB 2.0 Connector Pin-out ("FP_USB_2.0_5-6 ")............................................. 96
Table 36. Front Panel USB 2.0/3.0 Connector Pin-out (“FP_USB_2.0/ 3.0”) ..................................... 97

Relion 1900e/2900e Manual
xii Revision 1.3
Table 37. Front Panel Video Connector Pin-out ("FP VIDEO")................................................................. 97
Table 38. Intel Local Control Panel Connector Pin-out ("LCP")............................................................... 98
Table 39. Single Port SATA Connector Pin-out ("SATA 4" & "SATA 5") ............................................... 98
Table 40. SATA SGPIO Connector Pin-out ("SATA_SGPIO")..................................................................... 99
Table 41. Internal Type-A USB Connector Pin-out ("USB 2.0") ............................................................... 99
Table 42. Internal eUSB Connector Pin-out ("eUSB SSD") ........................................................................ 99
Table 43. Chassis Intrusion Header Pin-out ("CHAS_INTR") .................................................................. 101
Table 44. Hard Drive Activity Header Pin-out ("HDD_LED")................................................................... 101
Table 45. IPMB Connector Pin-out................................................................................................................... 101
Table 46. Hot-Swap Backplane I2C* Connector Pin-out......................................................................... 102
Table 47. SMBus Connector Pin-out................................................................................................................ 102
Table 48. System Status LED State Definitions........................................................................................... 109
Table 49. BMC Boot/Reset Status LED Indicators...................................................................................... 111
Table 50. Power Supply DC Power Output Connector Pinout.............................................................. 112
Table 51. Minimum Load Ratings...................................................................................................................... 113
Table 52. Voltage Regulation Limits ................................................................................................................ 113
Table 53. Transient Load Requirements ........................................................................................................ 113
Table 54. Capacitive Loading Conditions....................................................................................................... 114
Table 55. Ripples and Noise................................................................................................................................ 115
Table 56. Timing Requirements......................................................................................................................... 115
Table 57. BMC Core Sensors............................................................................................................................... 120
Table 58. Server Platform Services Firmware Health Event .................................................................. 132
Table 59. Node Manager Health Event ........................................................................................................... 133
Table 60. POST Progress Code LED Example.............................................................................................. 135
Table 61. MRC Progress Codes .......................................................................................................................... 135
Table 62. MRC Fatal Error Codes....................................................................................................................... 136
Table 63. POST Progress Codes........................................................................................................................ 138
Table 64. POST Error Codes and Messages.................................................................................................. 141
Table 65. POST Error Beep Codes.................................................................................................................... 146
Table 66. Integrated BMC Beep Codes ........................................................................................................... 146
Table 67. Relion 1900e Feature Set................................................................................................... 149
Table 68. Relion 2900e Feature Set................................................................................................... 152

Relion 1900e/2900e Manual
Revision 1.3 xiii
<This page is intentionally left blank.>

Relion 1900e/2900e Manual
1 Revision 1.3
1. Introduction
This manual or Technical Product Specification (TPS) provides board-specific information
detailing the features, functionality, and high-level architecture of the Relion 1900e/2900e.
Design-level information related to specific server board components and subsystems can beobtained by
ordering External Product Specifications (EPS) orExternal Design Specifications (EDS) related to this
server generation. EPS and EDS documents are made available under NDA with Penguin Computing and
must be ordered through your local Penguin Computing representative. See the Reference Documents
section for a list ofavailable documents.
1.1 Chapter Outline
This document is divided into the following chapters:
Chapter 1 – Introduction
Chapter 2 – Product Features Overview
Chapter 3 – Processor Support
Chapter 4 – System Memory
Chapter 5 – System I/O
Chapter 6 – System Security
Chapter 7 – Platform Management
Chapter 8 – Intel®Intelligent Power Node Manager (NM) Support Overview
Chapter 9 – Basic and Advanced Server Management Features
Chapter 10 – On-Board Connector and Header Overview
Chapter 11 – Reset and Recovery Jumpers
Chapter 12 – Light-Guided Diagnostics
Chapter 13 – Power Supply Specification Guidelines
Appendix A – Integration and Usage Tips
Appendix B – Integrated BMC Sensor Tables
Appendix C – Management Engine Generated SEL Event Messages
Appendix D – POST Code Diagnostic LED Decoder
Appendix E – POST Code Errors
Appendix F – Statement of Volatility
Appendix G – Supported Intel®Server Systems
1.2 Server Board Use Disclaimer
Penguin Computing server boards support add-in peripherals and contain a number of high-density
VAVAGO and power delivery components that need adequate airflow to cool. Penguin ensures through its
own chassis development and testing that when Intel server building blocks are used together, the fully
integrated system will meet the intended thermal requirements of these components. It is the
responsibility of the system integrator who chooses not to use Intel developed server building blocks to
consult vendor datasheets and operating parameters to determine the amount of airflow required for their
specific application and environmental conditions. Penguin Computing cannot be held responsible if
components fail or the server board does not operate correctly when used outside any of its published
operating or non-operating limits.

Relion 1900e/2900e Manual
Revision 1.0 2
2. Product Features Overview
The S2600WT is a monolithic printed circuit board assembly with features that are intended for high
density 1Uand 2Urack mount servers. This server board is designed to support the Intel®Xeon®
processor E5-2600 v3, v4 product family. Previous generation Intel®Xeon®processors are not supported.
The server board is offered with either of the two following on-board networking options:
•Intel®Ethernet Controller X540, supporting 10 GbE (Intel Server Board Product Code -S2600WTTR)
•Intel®Ethernet Controller I350, supporting 1 GbE (Intel Server Board Product Code – S2600WT2R)
All other onboard features will be identical.
Table 1. Relion 1900e/2900e Feature Set
Feature
Description
Processor Support
•Two LGA2011-3 (Socket R3) processor sockets
•Support for one or two Intel®Xeon®processors E5-2600 v3, v4 product family
•Maximum supported Thermal Design Power (TDP) of up to 145 W
Memory
•24 DIMM slots – 3 DIMMs/Channel – 4 memory channels per processor
•Registered DDR4 (RDIMM), Load Reduced DDR4 (LRDIMM)
•Memory data transfer rates:
oDDR4 RDIMM: 1600 MT/s (3DPC), 1866 MT/s (2DPC) and 2133 MT/s (1DPC)
oDDR4 LRDIMM: 1600 MT/s (3DPC), 2133 MT/s (2DPC & 1DPC)
•DDR4 standard I/O voltage of 1.2V
Chipset
Intel®C612 chipset
External (Back Panel)
I/O connections
•DB-15 Video connector
•RJ-45 Serial Port A connector
•Dual RJ-45 Network Interface connectors supporting either :
o10 GbE RJ-45 connectors (Intel Server Board Product Code – S2600WTTR)
or
o1 GbE RJ-45 connectors (Intel Server Board Product Code – S2600WT2R)
•Dedicated RJ-45 server management port
•Three USB 2.0 / 3.0 ports
Internal I/O
connectors/headers
•One Type-A USB 2.0 connector
•One 2x5 pin connector providing front panel support for two USB 2.0 ports
•One 2x10 pin connector providing front panel support for two USB 2.0 / 3.0 ports
•One 2x15 pin SSI-EEB compliant Standard Front Panel header
•One 2x15 high density Storage Front Panel connector
•One 2x7pin Front Panel Video connector
•One 1x7pin header for optional Intel®Local Control Panel support
•One DH-10 Serial Port B connector
PCIe* Support
•PCIe* 3.0 (2.5, 5, 8 GT/s) – backwards compatible with PCIe* Gen 1 and Gen 2 devices
1U Server – Riser Card
Support
•Server board includes two PCIe* 3.0 compatible riser card only slots
oRiser #1 – PCIe* 3.0 x24 – 1 PCIe* Full Height / Half Length add-in card support in 1U
o
Riser #2 – PCIe* 3.0 x24 – 1 PCIe* Full Height / Half Length add-in card support in 1U

Relion 1900e/2900e Manual
3 Revision 1.3
Feature
Description
2U Server – Riser Card
Support
•Server board includes three PCIe* 3.0 compatible riser card only slots:
oRiser #1 – PCIe* 3.0 x24 – up to 3 PCIe* slots in 2U
oRiser #2 – PCIe* 3.0 x24 – up to 3 PCIe* slots in 2U
oRiser #3 – PCIe* 3.0 x8 + DMI x4 (PCIe* 2.0 compatible) – up to 2 PCIe* slots in 2U
•With three riser cards installed, up to 8 possible add-in cards can be supported:
o4 Full Height / Full Length + 2 Full Height / Half Length add-in cards via Risers #1 and #2
o2 low profile add-in cards via Riser #3
Available I/O Module
Options
The server board includes a proprietary on-board connector allowing for the installation of a variety of
available I/O modules. An installed I/O module can be supported in addition to standard on-board
features and add-in PCIe* cards.
•AXX4P1GBPWLIOM – Quad port RJ45 1 GbE based on Intel® Ethernet Controller I350
•AXX10GBTWLIOM3 – Dual port RJ-45 10GBase-T I/O Module based on Intel® Ethernet Controller
x540
•AXX10GBNIAIOM – Dual port SFP+ 10 GbE module based on Intel® 82599 10 GbE controller
•AXX1FDRIBIOM – Single port QSFP FDR 56 GT/S speed InfiniBand* module
•AXX2FDRIBIOM – Dual port QSFP FDR 56 GT/S speed infiniband* module
•AXX1P40FRTIOM – Single port QSFP+ 40 GbE module
•AXX2P40FRTIOM – Dual port QSFP+ 40 GbE module
System Fan Support
•Six system fans supported in two different connector formats: hot swap (2U) and cabled (1U)
oSix 10-pin managed system fan headers (Sys_Fan 1-6) – Used for 1U system configuration
oSix 6-pin hot swap capable managed system fan connectors (Sys_Fan 1-6) – Used for 2U system
configuration
Video
•Integrated 2D Video Controller
•16 MB DDR3 Memory
On-board storage
controllers and
options
•10x SATA 6Gbps ports (6Gb/s, 3 Gb/s and 1.5Gb/s transfer rates are supported)
oTwo 7-pin single port SATA connectors capable of supporting up to 6 Gb/sec
oTwo 4-port mini-SAS HD (SFF-8643) connectors capable of supporting up to 6 Gb/sec SATA
•One eUSB 2x5 pin connector to support 2mm low-profile eUSB solid state devices
•Optional SAS IOC/ROC support via on-board Intel® Integrated RAID module connector
•Embedded Software SATA RAID
oIntel®Rapid Storage RAID Technology (RSTe) 4.1
o
Intel®Embedded Server RAID Technology 2 (ESRT2) 1.41 with optional RAID 5 key support
Security
•Intel®Trusted Platform Module (TPM) - AXXTPME5 (1.2), AXXTPME6 (v2.0) and AXXTPME7 (v2.0)
(Accessory Option)
Server Management
•Integrated Baseboard Management Controller, IPMI 2.0 compliant
•Support for Intel®Server Management Software
•On-board RJ45 management interface
•Intel®Remote Management Module 4 Lite support (Accessory Option)

Relion 1900e/2900e Manual
Revision 1.0 4
2.1 Server Board Component/Feature Identification
The following illustration provides a general overview of the server board, identifying key feature and
component locations.
Figure 1. Server Board Component/Features Identification

5 Revision 1.3
Relion 1900e/2900e Manual
The back edge ofthe server board includes several external connectors tosupport the following features:
A – RJ45 Networking Port – NIC #1
B – RJ45 Networking Port – NIC #2
C – Video
D – RJ45 Serial ‘A’ Port
E – Stacked 3-port USB 2.0 / 3.0
F – RJ45 Dedicated Management Port
Figure 2. S2600WT External I/O Connector Layout
Figure 3. Intel® Light Guided Diagnostics - DIMM Fault LEDs