Raptor T2P9D01 User manual

T2P9D01 Mainboard
User's Guide
For System Configuration
and Set Up
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com

Table of Contents
COPYRIGHT AND DISCLAIMERS............................................................................................5
SAFETY INFORMATION............................................................................................................6
Electrical Safety.................................................................................................................................................... 6
Operati nal Safety................................................................................................................................................ 6
NOTICES....................................................................................................................................7
Federal C mmunicati ns C mmissi n Statement............................................................................................7
Envir nmental Disp sal Statements................................................................................................................... 7
MAINBOARD SPECIFICATIONS...............................................................................................8
MAINBOARD OVERVIEW.......................................................................................................10
Design.................................................................................................................................................................. 10
Installati n........................................................................................................................................................... 11
Rem val............................................................................................................................................................... 11
CPU INSTALLATION AND REMOVAL....................................................................................12
Backgr und......................................................................................................................................................... 12
Installati n........................................................................................................................................................... 13
Rem val............................................................................................................................................................... 15
RAM INSTALLATION AND REMOVAL...................................................................................16
P pulati n Tables............................................................................................................................................... 16
Installati n........................................................................................................................................................... 17
Rem val............................................................................................................................................................... 17
HEADERS AND CONNECTORS.............................................................................................18
Pin Numbering C nventi ns............................................................................................................................. 18
Fr nt Panel.......................................................................................................................................................... 19
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
2

BMC Serial C ns le............................................................................................................................................ 21
Trusted Platf rm M dule C nnect r.................................................................................................................22
FlexVer™ C nnect r.......................................................................................................................................... 24
OCC M de........................................................................................................................................................... 26
BMC External Reset Header.............................................................................................................................. 27
BMC TTL Auxiliary Serial Header...................................................................................................................... 28
BMC Heartbeat Indicat r Header....................................................................................................................... 29
Internal USB 3.0 Header..................................................................................................................................... 30
BMC I2C P rt 5.................................................................................................................................................... 32
BMC I2C P rt 6.................................................................................................................................................... 33
Planar VPD Pr gramming Header..................................................................................................................... 34
FPGA Pr gramming Header.............................................................................................................................. 35
FPGA M de Switch 1.......................................................................................................................................... 36
Chassis Intrusi n Detect.................................................................................................................................... 37
FPGA M de Switch 2.......................................................................................................................................... 38
PM8068 SAS Debug C nnect r......................................................................................................................... 39
5V P wer............................................................................................................................................................. 41
CPU 1 Secure M de Disable.............................................................................................................................. 42
CPU 2 Secure M de Disable.............................................................................................................................. 43
PMBus C nnect r............................................................................................................................................... 44
CPU EPS P wer C nnect rs............................................................................................................................. 45
ATX P wer C nnect r........................................................................................................................................ 46
CPU 1 PCI Express Sl ts................................................................................................................................... 48
CPU 2 PCI Express Sl ts................................................................................................................................... 52
CPU 2 Micr PCIe C nnect r............................................................................................................................. 56
CPU 1 Fan Header............................................................................................................................................... 58
CPU 2 Fan Header............................................................................................................................................... 59
Primary Chassis Fan Headers........................................................................................................................... 60
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
3

Sec ndary Chassis Fan Header........................................................................................................................ 61
FAN ZONES..............................................................................................................................62
C nnecti ns........................................................................................................................................................ 62
Alg rithm Descripti n........................................................................................................................................ 62
USAGE......................................................................................................................................63
Initial P wer-On.................................................................................................................................................. 63
Selecting a B t Medium................................................................................................................................... 63
BMC Access........................................................................................................................................................ 64
H st Firmware Updates...................................................................................................................................... 64
BMC Firmware Updates..................................................................................................................................... 64
EARLY BOOT DEVICE FIRMWARE........................................................................................66
Intr ducti n......................................................................................................................................................... 66
Installati n........................................................................................................................................................... 66
Rem val............................................................................................................................................................... 66
SUPPORT.................................................................................................................................68
Getting Help........................................................................................................................................................ 68
ERRATA....................................................................................................................................69
PCB Versi n 1.00................................................................................................................................................ 69
PCB Versi n 1.01................................................................................................................................................ 69
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
4

Copyright and Disclaimers
C pyright © 2017 – 2018 Rapt r C mputing Systems, LLC. All Rights Reserved.
Product warranty or service will not be extended if: (1) the product is damaged by the consumer in any
way, including any alterations that affect the operability of the feature or features being claimed under
warranty and/or product service; or (2) the serial number of the product is defaced or missing.
RAPTOR COMPUTING SYSTEMS, LLC PROVIDES THIS MANUAL “AS IS” WITHOUT WARRANTY
OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE IMPLIED
WARRANTIES OR CONDITIONS OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE. IN NO EVENT SHALL RAPTOR COMPUTING SYSTEMS, LLC, ITS DIRECTORS,
OFFICERS, MEMBERS, MANAGERS, EMPLOYEES OR AGENTS BE LIABLE FOR ANY INDIRECT,
SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES (INCLUDING DAMAGES FOR LOSS OF
PROFITS, LOSS OF BUSINESS, LOSS OF USE OR DATA, INTERRUPTION OF BUSINESS AND
THE LIKE), EVEN IF RAPTOR COMPUTING SYSTEMS, LLC HAS BEEN ADVISED OF THE
POSSIBILITY OF SUCH DAMAGES ARISING FROM ANY DEFECT OR ERROR IN THIS MANUAL
OR PRODUCT.
SPECIFICATIONS AND INFORMATION CONTAINED IN THIS MANUAL ARE FURNISHED FOR
INFORMATIONAL USE ONLY, AND ARE SUBJECT TO CHANGE AT ANY TIME WITHOUT NOTICE,
AND SHOULD NOT BE CONSTRUED AS A COMMITMENT BY RAPTOR COMPUTING SYSTEMS,
LLC. RAPTOR COMPUTING SYSTEMS, LLC ASSUMES NO RESPONSIBILITY OR LIABILITY FOR
ANY ERRORS OR INACCURACIES THAT MAY APPEAR IN THIS MANUAL, INCLUDING THE
PRODUCTS AND SOFTWARE DESCRIBED IN IT.
Products and corporate names appearing in this manual may or may not be registered trademarks or
copyrights of their respective companies, and are used only for identification or explanation and to the
owners’ benefit, without intent to infringe.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
5

Safety Information
ELECTRICAL SAFETY
• To reduce the risk of electric shock, disconnect the power cable before relocating or servicing the
system.
• When adding or removing devices to or from the system, ensure that the power cables for the
devices are unplugged before the signal cables are connected. If possible, disconnect all power
cables from the existing system before you add a device.
• Before connecting or removing signal cables from the motherboard, ensure that all power cables are
unplugged.
• Seek professional assistance before using an adapter or extension cord. These devices could
interrupt the grounding circuit.
• Make sure that your power supply is set to the correct voltage in your area. If you are not sure about
the voltage of the electrical outlet you are using, contact your local power company.
• If your power supply is not functioning, do not attempt to repair it. Contact a qualified service
technician or your retailer.
OPERATIONAL SAFETY
• Before installing the motherboard or connecting devices to it, carefully read any and all provided
manuals for the devices in question.
• Before using the product, make sure all cables are correctly connected and the power cables are
not damaged. If you find any damage, contact your dealer immediately.
• To avoid short circuits, keep paper clips, screws, staples, and other foreign metallic objects away
from connectors, slots, sockets and circuitry.
• Avoid dust, humidity, and temperature extremes. Do not locate the product in any area where it may
become wet or damp.
• Place the product on a stable surface at all times.
• If you encounter technical problems with the product, contact a qualified service technician or your
retailer.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
6

Notices
FEDERAL COMMUNICATIONS COMMISSION STATEMENT
This device complies with Part 15 of the FCC Rules. Operation is subject to the
following two conditions:
• This device may not cause harmful interference, and
• This device must accept any interference received including interference that
may cause undesired operation.
This equipment has been tested and found to comply with the limits for a Class
B digital device, pursuant to Part 15 of the FCC Rules. These limits are designed
to provide reasonable protection against harmful interference in a residential
installation. This equipment generates, uses and can radiate radio frequency energy
and, if not installed and used in accordance with manufacturer’s instructions, may
cause harmful interference to radio communications. However, there is no guarantee
that interference will not occur in a particular installation. If this equipment does
cause harmful interference to radio or television reception, which can be determined
by turning the equipment off and on, the user is encouraged to try to correct the
interference by one or more of the following measures:
• Reorient or relocate the receiving antenna.
• Increase the separation between the equipment and receiver.
• Connect the equipment to an outlet on a circuit different from that to which the
receiver is connected.
• Consult the dealer or an experienced radio/TV technician for help.
ENVIRONMENTAL DISPOSAL STATEMENTS
DO NOT throw the motherboard in municipal waste. This product has been designed to
enable proper reuse of parts and recycling. This symbol of the crossed out wheeled bin
indicates that the product (electrical and electronic equipment) should not be placed in
municipal waste. Check local regulations for disposal of electronic products.
DO NOT throw the mercury-containing button cell battery in municipal waste. This
symbol of the crossed out wheeled bin indicates that the battery should not be
placed in municipal waste.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
7

Mainboard Specifications
Pr cess r 2x IBM POWER9 “Sforza” Socket (LGA 2601)
4 - 24 core IBM POWER9 Processors
High speed XBUS interconnect
C re L gic Direct Attach PCIe
F rm Fact r EATX, 12” x 13”
System Features Fan C ntr l Y
N minal Fan Z nes 3
Fan C nnect rs 7
Fan C ntr l Driver MAX31785 / AST2500
Rack Ready Y
Fr nt Panel Header SuperMicro Compatible
TPM Header LPC / I2C
SMBus Header Y
BMC Y
BMC Type OpenBMC Compatible (AST2500)
FlexVer™ Ready Y
Mem ry T tal Sl ts 16 (4 channels per CPU)
Capacity 2TB maximum
Mem ry Type DDR4 1600/1866/2133/2400/2666
Mem ry Features ECC
M dule Sizes 8GB, 16GB, 32GB, 64GB, 128GB (RDIMM)
Expansi n Sl ts T tal PCIe Sl ts 5
T tal µPCIe P rts 1
PCIe Generati n 1,2,3,4
CAPI 2 Capable Sl ts 3 x16 slots
St rage Micr semi PM8068
( pti nal)
4 SAS (iPASS+)
4 SAS/SATA
Netw rking Br adc m BCM5719 2 host GbE
NCSI-SI BMC link
Graphics AST2500 VGA
USB TI TUSB7430 2x USB3.0 ports on rear panel
2x USB3.0 ports on internal header
Serial H st 1x RS232 port on rear panel
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
8

BMC 1x RS232 port on internal header
1x TTL port on internal header
Envir nmental Requirements Operation: 10°C - 35°C
Storage: -40°C - 70°C
Humidity: 20% - 90%, non-condensing
NOTE: Specifications are subject to change without notice.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
9

Mainboard Overview
DESIGN
The T2P9D01 has been specifically designed for applications requiring high security, high I/O
capability, and large amounts of processing capability. PCIe slots and peripherals are directly
connected to each CPU, therefore two CPUs must be installed to use all PCIe slots.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
10
Illustration 1: TL2P9D01 Block Diagram

INSTALLATION
NOTE: Before you install this mainboard into your chassis, study the pattern of mounting studs, rear
panel slots, and internal chassis components to ensure the mainboard fits correctly. There are 10
mounting holes available on the T2P9D01; ensure that your chassis provides studs for all 10 for
maximum reliability and longevity of the mainboard.
NOTE: Installation of the mainboard should take place in a static-controlled environment using
appropriate anti-static measures. Failure to follow these precautions could result in permanent
damage to the mainboard and attached components.
Begin installation by examining your chassis. If there is an existing I/O shield in your chassis, remove
it by gently striking it from the outside of your chassis; it should pop free. Align the new I/O shield
inside your chassis so that the ridges on the I/O shield point away from the interior of your chassis;
then, gently but firmly snap the new I/O shield into place in the rear of your chassis.
Carefully place the mainboard inside the chassis, ensuring that the I/O ports are aligned with the
corresponding holes in the I/O shield. Gently press the mainboard into the I/O shield until the
mounting holes are aligned with the chassis studs. Secure the mainboard with one screw in the lower
right corner, followed by one in the upper left corner, then install the remaining screws. Torque all
mainboard mounting screws to 7 ft-lbs (0.8N-m).
WARNING: There are fragile electronic components located on the entire bottom surface of the
mainboard, including near the mainboard mounting holes. Ensure that the mainboard is aligned with
the studs before allowing any part of the rear surface to contact the mounting studs; also ensure that
the mainboard does not slide on the studs once positioned. Failure to follow these instructions could
result in severe damage to the mainboard. If you believe you have damaged one or more parts on the
bottom of the mainboard, but have not yet applied power, st p and remove the mainboard without
applying power. Inspect the mainboard for mechanical damage, and if present return the mainboard
for repair service.
REMOVAL
Begin by moving the chassis to a static-controlled environment. Before removing the mainboard,
remove all attached cables, peripherals, and RAM. Ensure that both CPUs and heatsinks have been
removed, and that both protective socket covers are in place. Carefully loosen and remove all screws,
saving the lower right hand corner for last. Gently lift the side of the mainboard farthest from the I/O
shield, then slide the ports out of the I/O shield. Do not allow the mainboard to fall onto or contact the
chassis mounting studs at this point. Carefully remove the mainboard from the chassis. If the
mainboard is to be returned for service, immediately place it in an appropriately sized anti-static bag.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
11

CPU Installation and Removal
BACKGROUND
The POWER9 CPU uses a unique retention mechanism designed to center-load the CPU in the
socket and ensure good contact in the area of the central lands. This mechanism is spring loaded; a
single 5/32” hex screw engages and disengages the retention system.
The heatsink assemblies you have received may have had the screw tighten or loosen in transit. After
placing the heatsink on the CPU per the following instructions, visually inspect the two latching prongs
protruding from the load frame assembly. If these prongs are not vertical, loosen the retention screw
of the heatsink assembly and gently reposition the heatsink, watching for the latching prongs to move
into a vertical position.
NOTE: Incorrectly positioned locking pins will cause the heatsink to start to tilt as the retention screw
is tightened. If this happens, immediately st p tightening the screw, carefully loosen the retention
screw, and double-check the prong and pin alignment before attempting to reattach the heatsink. In
some cases, removing and re-placing the heatsink is the easiest method to allow it to seat correctly.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
12
Illustration 2: Correct etention Mechanism Prong Alignment (Unlocked)

INSTALLATION
WARNING: Both the CPUs and the mainboard are static sensitive. Installation and removal of either
CPU must take place in an appropriate anti-static environment.
Carefully remove the protective cover, making sure not to touch any of the exposed socket pins.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
13
Illustration 3: Socket as Shipped
Illustration 4: emove Protective Cover

Align the notches of the CPU with the protrusions on the socket, then carefully place the CPU in the
socket. If no indium pad is present on the bottom of the heatsink assembly, carefully center an indium
pad on top of the CPU.
Place the heatsink assembly on top of the CPU, following instructions given earlier.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
14
Illustration 5: Align Notches and Carefully Place CPU in Socket
Illustration 6: Align Pins and Place Heatsink on CPU

Using a 5/32” hex driver fully inserted into the retention mechanism screw, tighten the retention
mechanism screw by turning the driver clockwise until a hard stop has been reached.
Your CPU now is correctly installed. If you have a second CPU, repeat this process for the other
socket.
REMOVAL
Removal of the heatsink and CPU follows the installation procedure given above, only in reverse.
Start with step 5, turning the hex driver counterclockwise, and end with step 1, replacing the socket
protective cover into postion over the socket.
WARNING: Before attempting to remove the heatsink, ensure the mainboard has been placed
horizontal to the ground. Failing to do so could cause the CPU to fall out of the socket, causing
damage to the CPU, the CPU socket, and any components located below the CPU.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
15
Illustration 7: Tighten etention Scew until Hard Stop

RAM Installation and Removal
POPULATION TABLES
Quantity Slot Population
Processor 1 Processor 2
A1 B1 C1 D1 A2 B2 C2 D2 A1 B1 C1 D1 A2 B2 C2 D2
1 DIMM X
Processor Not Installed
2 DIMMs X X
3 DIMMs X X X
4 DIMMs X X X X
5 DIMMs X X X X X
6 DIMMs X X X X X X
7 DIMMs X X X X X X X
8 DIMMs X X X X X X X X
1 DIMM X
2 DIMMs X X
3 DIMMs X X X
4 DIMMs X X X X
5 DIMMs X X X X X
6 DIMMs X X X X X X
7 DIMMs X X X X X X X
8 DIMMs X X X X X X X X
9 DIMMs X X X X X X X X X
10 DIMMs X X X X X X X X X X
11 DIMMs X X X X X X X X X X X
12 DIMMs X X X X X X X X X X X X
13 DIMMs X X X X X X X X X X X X X
14 DIMMs X X X X X X X X X X X X X X
15 DIMMs X X X X X X X X X X X X X X X
16 DIMMs X X X X X X X X X X X X X X X X
(X) denotes memory DIMM is installed in indicated slot
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
16

INSTALLATION
For maximum performance under typical workloads, RAM should be populated according to the table
above.
Using proper anti-static procedures, locate the slot in which you want to install RAM, then gently move
the two retaining prongs away from the center of the slot until they reach a hard stop. Grasping the
memory DIMM by the edges, align the notch on the memory DIMM with the key in the slot, then firmly
and evenly press the DIMM into place while holding the DIMM at a 90° angle to the mainboard. The
DIMM is properly seated when both retaining prongs move inward and contact the sides of the DIMM.
Do not touch the electrical contacts on the memory DIMM as this may induce corrosion, leading to
poor connections and unreliable operation.
WARNING: If a DIMM will not fully seat, or tilts to one side, st p. Remove the DIMM and double-
check the location of the notch versus the slot key. If the DIMM still will not seat, double check that the
type of memory is correct. The T2P9D01 only accepts full-size 288-pin DDR4 DIMMs, and other types
of memory will not seat or function. DO NOT attempt to force a DIMM into a slot as this may cause
permanent damage to the RAM, CPU, and/or mainboard.
WARNING: Do not attempt to install memory DIMMs in an improperly mounted mainboard. Due to
the pressure required to properly seat a DIMM, mainboard flex tolerances could be exceeded if one or
more mounting studs is missing. Exceeding flex tolerances may cause irreparable damage to the
mainboard.
REMOVAL
Locate the DIMM you wish to remove, then, using proper anti-static procedures, gently move the two
retaining prongs away from the center of the slot until they reach a hard stop. The memory DIMM will
partially unseat from the slot, and may be fully removed by gently and evenly pulling away from the
mainboard while grasping the DIMM by its two short edges. Do not touch the electrical contacts on
the memory DIMM as this may induce corrosion and lead to poor connections and unreliable
operation.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
17

Headers and Connectors
PIN NUMBERING CONVENTIONS
All headers on the TLP9D01 follow a standard layout, with pin 1 being denoted with a white silkscreen
marking. Dual row headers follow the numbering convention shown above, where all even pins are on
one side of the header and all odd pins are on the other. Single row headers use a monotonically
increasing pin number, starting from pin 1. Key pins are not physically present, but are still counted as
pins in the numbering scheme.
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
18
Illustration 8: Dual ow Header with Annotated Pins, Marker, and Key

FRONT PANEL
J9800
Pin Functi n Pin Functi n
1 Power button (active low) 2 Ground
3 Reset button (active low) 4 Ground
5 +3.3V (main power) 6 Fan fail LED cathode
7 LED Anode +3.3V (main power) 8 Fan Fail LED Anode (+5V main power)
9 LED Anode +3.3V (standby power) 10 NIC 2 link / activity LED cathode
11 LED Anode +3.3V (standby power) 12 NIC 1 link / activity LED cathode
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
19

13 Identify button (active low) 14 HDD activity LED cathode
15 +3.3V (main power) 16 Power LED cathode
17 KEY 18 KEY
19 NMI button (active low) 20 Ground
2017 - 2018 Raptor Computing Systems, LLC T2P9D01 User's Guide Version 1.04
All Rights Reserved https://www. raptorcs.com
20