ADLINK Technology aTCA-9710 User manual

Leading EDGE COMPUTING
aTCA-9710
Dual Intel Xeon E5-2658 v3
40G AdvancedTCA Processor Blade
User’s Manual
Manual Revision: 1.0
Revision Date: June 6, 2018
Part No.: 50-1G040-1000

2
aTCA-9710
Preface
Copyright 2018 ADLINK Technology, Inc.
This document contains proprietary information protected by copyright. All rights are reserved.
No part of this manual may be reproduced by any mechanical, electronic, or other means in
any form without prior written permission of the manufacturer.
Disclaimer
The information in this document is subject to change without prior notice in order to improve
reliability, design, and function and does not represent a commitment on the part of the
manufacturer.
In no event will the manufacturer be liable for direct, indirect, special, incidental, or
consequential damages arising out of the use or inability to use the product or documentation,
even if advised of the possibility of such damages.
Environmental Responsibility
ADLINK is committed to fulfill its social responsibility to global
environmental preservation through compliance with the European
Union's Restriction of Hazardous Substances (RoHS) directive and
Waste Electrical and Electronic Equipment (WEEE) directive.
Environmental protection is a top priority for ADLINK. We have enforced
measures to ensure that our products, manufacturing processes,
components, and raw materials have as little impact on the environment
as possible. When products are at their end of life, our customers are
encouraged to dispose of them in accordance with the product disposal and/or recovery
programs prescribed by their nation or company.
Battery Labels (for products with battery)
廢電池請回收
California Proposition 65 Warning
WARNING: This product can expose you to chemicals including acrylamide, arsenic,
benzene, cadmium, Tris(1,3-dichloro-2-propyl)phosphate (TDCPP), 1,4-Dioxane,
formaldehyde, lead, DEHP, styrene, DINP, BBP, PVC, and vinyl materials, which are
known to the State of California to cause cancer, and acrylamide, benzene, cadmium, lead,
mercury, phthalates, toluene, DEHP, DIDP, DnHP, DBP, BBP, PVC, and vinyl materials, which
are known to the State of California to cause birth defects or other reproductive harm. For
more information go to www.P65Warnings.ca.gov.

3
aTCA-9710
Trademarks
Product names mentioned herein are used for identification purposes only and may be
trademarks and/or registered trademarks of their respective companies.
Revision History
Revision Release Date Description of Change(s)
1.0 6/6/2018 Initial release

4
aTCA-9710
Table of Contents
Preface .....................................................................................................................................2
1Overview ...........................................................................................................................6
1.1 Introduction .................................................................................................................................6
1.2 Block Diagram.............................................................................................................................7
1.3 Package Contents.......................................................................................................................8
2Specifications ...................................................................................................................9
2.1 aTCA-9710 Specifications...........................................................................................................9
2.1.1 CPU/ Chipset/ Memory........................................................................................................................ 9
2.1.2 Standard and Interface ........................................................................................................................ 9
2.1.3 Software............................................................................................................................................. 10
2.1.4 Mechanical & Environmental ............................................................................................................. 10
2.2 Power Consumption.................................................................................................................. 11
2.3 Board Layout.............................................................................................................................12
2.3.1 aTCA-9710 Board Layout - Component Side.................................................................................... 12
2.3.2 aTCA-9710 Board Layout - Solder Side............................................................................................13
2.3.3 aTCA-9710 Front Panel..................................................................................................................... 14
2.3.4 Status LED Definitions ....................................................................................................................... 15
2.4 Compliance ...............................................................................................................................18
3Functional Description...................................................................................................19
3.1 CPU, Memory and Chipset .......................................................................................................19
3.1.1 CPU ................................................................................................................................................... 19
3.1.2 Memory.............................................................................................................................................. 20
3.1.3 Intel® C612 Chipset Overview .......................................................................................................... 20
3.1.4 Silicon Motion SM750 Graphics Controller........................................................................................21
3.2 Peripherals................................................................................................................................21
3.2.1 Reset ................................................................................................................................................. 21
3.2.2 SMBus Devices ................................................................................................................................. 22
3.3 I/O Interfaces ............................................................................................................................23
3.3.1 USB ................................................................................................................................................... 23
3.3.2 VGA Interface .................................................................................................................................... 24
3.3.3 Ethernet Connection.......................................................................................................................... 24
3.3.4 Serial Port .......................................................................................................................................... 25
3.3.5 Onboard mSATA Module ................................................................................................................... 25
3.3.6 Switch And Jumper Settings.............................................................................................................. 25
4Intelligent Platform Management System .........................................................................27
4.1 IPMI Sensors ............................................................................................................................27
4.1.1 Sensor Reading (FRU Hotswap Sensor)........................................................................................... 29
4.1.2 Get Sensor Reading (Physical IPMB-0 Sensor)................................................................................ 30
4.1.3 Watchdog Timer Sensor .................................................................................................................... 31
4.1.4 Version Change Sensor..................................................................................................................... 32
4.1.5 System Firmware Progress Sensor................................................................................................... 33
4.1.6 Get Sensor Reading Command ........................................................................................................ 34
4.2 IPMI Commands .......................................................................................................................36
5Getting Started................................................................................................................38
5.1 Safety Requirements.................................................................................................................38
5.2 Installing and Removing the aTCA-9710 ..................................................................................39
5.2.1 Installing the Blade ............................................................................................................................ 39
5.2.2 Removing the Blade .......................................................................................................................... 43
5.3 Firmware Update Procedure.....................................................................................................46
5.3.1 Update Over Serial Interface ............................................................................................................. 46

5
aTCA-9710
5.3.2 Update over KCS............................................................................................................................... 47
5.3.3 Update over LAN ............................................................................................................................... 48
6BIOS ................................................................................................................................49
6.1 Entering the BIOS Setup Screen ..............................................................................................49
6.1.1 Navigation.......................................................................................................................................... 50
6.2 Main BIOS Setup Screen..........................................................................................................51
6.3 Advanced Setup Screen ...........................................................................................................53
6.3.1 ACPI Settings .................................................................................................................................... 55
6.3.2 NCT5104D Super IO Configuration................................................................................................... 56
6.3.3 Serial Port Console Redirection ........................................................................................................ 58
6.3.4 PCI Subsystem Settings.................................................................................................................... 61
6.3.5 Network Stack Configuration ............................................................................................................. 62
6.3.6 CSM Configuration ............................................................................................................................ 63
6.3.7 Trusted Computing ............................................................................................................................ 64
6.3.8 ADLINK IPMI settings........................................................................................................................ 65
6.4 Intel RC Setup...........................................................................................................................66
6.4.1 Processor Configuration .................................................................................................................... 67
6.4.2 Advanced Power Management Configuration................................................................................... 69
6.4.3 Common RefCode Configuration ...................................................................................................... 71
6.4.4 Memory Configuration ....................................................................................................................... 71
6.4.5 IIO Configuration................................................................................................................................ 73
6.4.6 PCH Configuration............................................................................................................................. 74
6.5 Server Mgmt Setup Screen.......................................................................................................75
6.6 Boot Setup Screen....................................................................................................................76
6.7 Security Setup Screen ..............................................................................................................77
6.8 Save & Exit Setup Screen.........................................................................................................78
7Serial Over LAN ..............................................................................................................80
7.1 Preparation For SOL Connection..............................................................................................80
7.2 Configure The Remote Client....................................................................................................80
7.2.1 Install IPMItool For The Remote Client.............................................................................................. 80
7.3 Configure the Target aTCA-9710 ..............................................................................................81
7.3.1 BIOS Configurations.......................................................................................................................... 81
7.3.2 Linux GRUB Settings......................................................................................................................... 81
7.3.3 Linux System Setting ......................................................................................................................... 82
7.4 Establish SOL Connection ........................................................................................................82
8Drivers.............................................................................................................................84
Safety Instructions ................................................................................................................85
Getting Service ......................................................................................................................86

6
aTCA-9710
1 Overview
1.1 Introduction
The ADLINK aTCA-9710 is a high performance AdvancedTCA® (ATCA) processor blade
featuring dual 12-core Intel® Xeon® Processor E5-2658 v3, Intel® C612 Chipset, eight-
channel memory up to 256GB of DDR4 memory and 400W power supply subsystem. Versatile
connectivity includes four 40GbE Fabric Interfaces, dual GbE Base Interfaces, dual front panel
10GbE egress ports, front panel dual COM and USB 2.0 ports and front panel VGA connector.
An onboard SATA connector supports a mSATA up to 256GB and the optional RTM (aTCA-
R9700) supports six 10GbE SFP+ ports and one hot-swappable SATA bay providing additional
network throughput and storage capacities.
The aTCA-9710's thermal solution (including VRM heat sink) ensures stable operation under
extreme operating environments and allows for compliance to the NEBS Level 3 standard
(design only). The robust computing power and reliability of the aTCA-9710 meets the
requirements of telecom equipment manufacturers (TEMs) and network equipment providers
(NEPs), allowing them to build the next-generation telecom networks and communication
infrastructures.
Detailed features are outlined below and a functional block diagram is shown in the next
section.
Two 12-core Intel® Xeon® processor E5-2658 v3
Server-class Intel® C612 Chipset
DDR4-2133 JEDEC standard VLP RDIMM (REG/ECC), up to 256 GB
Onboard bootable 32GB mSATA module (max. 256GB)
One Intel® I350 AM2 dual-port PCI Express Gigabit Ethernet controller
Two Intel® XL-710-AM2 dual-port PCI Express 40Gigabit Ethernet controllers
One Intel 82599ES 10Gigabit Ethernet Controller to front panel via SFP+ ports
Optional three Intel® 82599ES 10Gigabit Ethernet Controllers (6 SFP+ ports) on RTM
(aTCA-R9700)
Optional SATA 6G interface drive bay on RTM (aTCA-R9700)
PICMG 3.1 Option 9-KR four Fabric Interface channels supporting dual dual-star
Failover system BIOS
Analog VGA output up to 1920x1440 resolution

7
aTCA-9710
1.2 Block Diagram

8
aTCA-9710
1.3 Package Contents
Before opening, please check the shipping carton for any damage. If the shipping carton and
contents are damaged, notify the dealer for a replacement. Retain the shipping carton and
packing material for inspection by the dealer. Obtain authorization before returning any
product to ADLINK.
Check that the following items are included in the package. If there are any missing items,
contact your dealer:
aTCA-9710 AdvancedTCA processor blade (CPU, RAM specifications may differ
depending on options selected)
USB Mini-B to DB-9 cable (for front panel serial port)

9
aTCA-9710
2 Specifications
2.1 aTCA-9710 Specifications
2.1.1 CPU/ Chipset/ Memory
CPU Dual 12-core Intel® Xeon® Processor E5-2658 v3,
(2.2/2.9GHz QPI 9.6GT/s, 30MB L2 cache, LGA2011 Socket)
Chipset Intel® C612 Chipset
Memory Registered ECC DDR4-1600/1866/2133 VLP RDIMM
16x RDIMM sockets
Up to 256GB
2.1.2 Standard and Interface
Standards PICMG 3.0 R3.0 AdvancedTCA
PICMG 3.1 AdvancedTCA Ethernet, Option 9-KR
Networking 1x dual-port Intel® I350 AM2 Gigabit Ethernet Controller
1x dual-port Intel® 82599ES 10Gigabit Ethernet Controller
2x 10GbE SFP+ ports on face plate
2x 10/100/1000BASE-T Base Interface channels
4x 10GBASE-KR4 Fabric Interface channels via two XL-710-
AM2 40G Ethernet Controllers (Option 9-KR)
6x 10GBASE SFP+ ports on RTM (aTCA-R9700)
Display Silicon Motion SM750 graphics controller
Front panel analog VGA connector supports up to 1920x1440
resolution
USB 2x USB 2.0 ports on front panel, two USB 2.0 ports to RTM
Serial 1x IPMC serial debug port (USB Mini-B)
1x RS-232 ports on front panel (USB Mini-B)
1x RS-232 port to RTM
Storage Onboard mSATA module 32GB, up to 256GB
2x SATA channels to RTM
Front Panel I/O 1x VGA port (DB-15)
3x USB 3.0 port (Type-A)
1x IPMC serial debug port (USB Mini-B connector)
1x RS-232 port (USB Mini-B connector)
2x 10GbE ports (SFP+)
LEDs: OOS, BIOS/OS boot OK, IPMC payload power
authorization and IPMC chassis identify command
Recessed reset button
Rear I/O
(aTCA-R9700)
6x SFP+ ports (three Intel® 82599ES 10G Ethernet
Controllers)
1x SATA port from Intel® C612 PCH

10
aTCA-9710
2.1.3 Software
BIOS AMI BIOS with 8Mbit flash memory
Supported OS Microsoft Windows Server 2012 R2
Red Hat Enterprise Linux 6.x/7.0
Contact ADLINK for other OS availability
2.1.4 Mechanical & Environmental
Dimensions 322.25mm x 280mm x 30.48mm (H x D x W) - 6HP slot
Operating
Temperature
Standard: 0°C to 55°C
NEBS short-term: 0°C to 61°C (sea level)
Storage
Temperature
-40°C to 85°C
Humidity 5% to 90% non-condensing
Shock 15G peak-to-peak, 11ms duration, non-operation
Vibration Non-operating: 1.88 Grms, 5 to 500 Hz, each axis
Operating: 0.5 Grms, 5 to 500Hz, each axis
Compliance CE, FCC Class A, UL, NEBS Level 3 (design)

11
aTCA-9710
2.2 Power Consumption
This section provides information on the power consumption of the aTCA-9710.
System configuration
(1) Memory: 16x 8GB DDR4-2133 ECC REG
(2) Graphics: Silicon Motion SM750
(3) Power Supply: Chroma DC Power supply 62012P-80-60
(4) CPU: 2x 12-core Intel® Xeon® processor E5-2658 v3
The following table lists power consumption under different operating systems and
applications with a 48V power rail.
OS and Application Power Consumption
Windows Server 2008 R2, idle 81.12 W
Windows Server 2008 R2, BurnIn Test, CPU 100% usage 316.32 W
Windows Server 2008 R2, Power Thermal Utility, CPU 100% Usage 365.76 W

12
aTCA-9710
2.3 Board Layout
2.3.1 aTCA-9710 Board Layout - Component Side
Location Description Location Description
CN1 XL710 JTAG debug header SW1 Reserved for PCH debug
CN2 XL710 JTAG debug header SW2 Clear CMOS
CN7 Ground connection SW3 IPMC Programming mode
DIMM_AB/CD DDR4 DIMM A-D SW4 IPMC Mode Select
DIMM_EF/GH DDR4 DIMM E-H SW6 HW Reset Button
J3/4 Zone 3 to RTM SW7 Reserved for XL710 debug
PSU1 400W -48V DC/DC module SW8 Reserved for XL710 debug
PSU2 400W Hot Swap Power Module
CPU1
CPU2
J3
SW4
SW1
CN7
DIMM_GH
CN2
J4
SW8
PSU1
CN1
DIMM_CD SW7
DIMM_EF
DIMM_AB
PSU2
B1A1
SW3
C1D1
B2A2
C2D2
H1
G1
E1F1
H2
G2
E2F2

13
aTCA-9710
2.3.2 aTCA-9710 Board Layout - Solder Side
Location Description
SW2 Clear CMOS
SW6 HW Reset Button
SW6
SW2

14
aTCA-9710
2.3.3 aTCA-9710 Front Panel
VGA
10GbE (SFP)
USB
IPMC Serial Debug Port
RS-232 Serial Port
Base and Fabric Channel LEDs
Reset button
OOS LED
BIOS/OS Boot OK
IPMC Payload Power Authorized
IPMC Chassis Identify Command
Hot-Swap LED

15
aTCA-9710
2.3.4 Status LED Definitions
The following sections describe the front panel Status LEDs: Hot-swap LED, OOS LED,
BIOS/OS Boot OK LED, IPMC Payload Power Authorized LED and IPMC Chassis Identify
Command LED.
2.3.4.1 Out of Service (OOS) LED
Out of Service LED (Red) State Remark
Blinking During BIOS POST M4
Off BIOS POST OK M4
On After OS shutdown M1
2.3.4.2 BIOS/OS Boot OK
BIOS/OS Boot OK (Green) State Remark
Blinking During OS Boot
Off During BIOS POST
On OS Boot OK
2.3.4.3 IPMC Payload Power Authorized
IPMC Payload Power Authorized
(Amber)
State Remark
On Payload Power Authorized
Off Payload Power Not
Authorized

16
aTCA-9710
2.3.4.4 IPMC Chassis Identify Command LED
IPMC Chassis Identify Command
(Amber)
State Remark
Off Default Off
Blinking Chassis Identify Command
Active
2.3.4.5 Hot-swap LED
Hot-swap LED
(Blue)
FRU State
number
FRU State Name
Off M0 FRU not installed
On M1 FRU inactive
Long blink M2 FRU activation request
Off M3 FRU activation in process
Off M4 FRU active
Short blink M5 FRU deactivation request
Short blink M6 FRU deactivation in process

17
aTCA-9710
2.3.4.6 Base and Fabric Channels LEDs
Base and Fabric Channels LEDs
FCH1 ACT (Amber)
Blink when accessing
Ethernet I/O
Fabric 1 Link
(Amber)
40Gbps – ON
FCH 2 ACT (Amber)
Blink when accessing
Ethernet I/O
Fabric 2 Link
(Amber)
40Gbps – ON
FCH 3 ACT (Amber)
Blink when accessing
Ethernet I/O
Fabric 3 Link
(Amber)
40Gbps – ON
FCH 4 ACT (Amber)
Blink when accessing
Ethernet I/O
Fabric 4 Link
(Amber)
40Gbps – ON
BCH1 ACT (Amber)
Blink when accessing
Ethernet I/O
BCH1 Speed and
Link
100 Mbps: Green
1Gbps: Amber
BCH2 ACT (Amber)
Blink when accessing
Ethernet I/O
BCH2 Speed and
Link
100 Mbps: Green
1Gbps: Amber
2.3.4.7 Front Panel 10GbE SFP+ LEDs
Left LED: Speed and Link
1Gbps: Amber,
100Mbps: Green
Right LED: ACT
Blinking while data exchanging
Color: Amber

18
aTCA-9710
2.4 Compliance
The aTCA-9710 conforms to the following specifications:
PICMG 3.0 R2.0 ECN0002 AdvancedTCA
PICMG 3.1 Ethernet over AdvancedTCA Option 9-KR
NEBS Level 3 (design)

19
aTCA-9710
3 Functional Description
3.1 CPU, Memory and Chipset
3.1.1 CPU
The Intel® Xeon® processor E5-2658 v3 implements several key technologies:
Four channel Integrated Memory Controller supporting DDR4
Integrated I/O with up to 40 lanes for PCI Express Generation 3.0
Two point-to-point link interface based on Intel® QuickPath Interconnect (Intel® QPI)
up to 9.6GT/s
30 MB of shared cache
The Intel® Xeon® processor E5-2658 v3 supports several advanced technologies:
Intel® 64 Technology
Enhanced Intel® SpeedStep® Technology
Intel® Virtualization Technology (Intel® VT)
Intel® Hyper-Threading Technology (Intel® HT Technology)
The Intel® Xeon® processor E5-2658 v3 has a maximum TDP of 105W and has an
elevated case temperature specification. The elevated case temperatures are intended to
meet the short-term thermal profile requirements of NEBS Level 3. The Intel® Xeon®
processor E5-2658 v3 is ideal for thermally constrained form factors in embedded servers,
communications and storage markets.
Supported Processors, Maximum Power Dissipation
The following table describes the Intel® Xeon® processor E5 family CPUs supported by the
aTCA-9710:
Name E5-2658 v3
L2 cache 30MB
Clock 2.2GHz
QPI 9.6 GT/s
TDP 105W

20
aTCA-9710
3.1.2 Memory
The aTCA-9710 is a dual processor system with each Intel® Xeon® processor E5 2600 v3
series providing four memory channels supporting DDR4, 1600, 1866, 2133 MT/s DIMMs.
The maximum memory capacity is 256GB with memory interleaving support. The
400/533/667/800/933 MHz differential memory clocks are driven by the Intel® Xeon®
processor E5-2658 v3 CPU with length-matching and impedance controlled through all the
DIMM slots.
The DDR4 DIMMs support the I2C interface. They are connected together and routed to the
PCH for the management.
Memory configuration changes are only permitted to be performed at the factory.
Failure to comply with the above may result in damage to your board or improper
operation.
3.1.3 Intel® C612 Chipset Overview
The Intel® C612 Chipset provides a connection point between various I/O components and
DMI based processors. Functions and capabilities include:
PCI Express Base Specification, Revision 2.0 support for up to eight ports with
transfers up to 5 GT/s.

ACPI Power Management Logic Support, Revision 4.0a Enhanced DMA controller,
interrupt controller, and timer functions
Integrated Serial ATA host controller switch independent DMA operation on up to 10
ports.
USB host interface with two EHCI high-speed USB 2.0 Host controllers and 2 rate
matching hubs provide support for support for up to fourteen USB 2.0 ports
Integrated 10/100/1000 Gigabit Ethernet MAC with System Defense
System Management Bus (SMBus) Specification, version 2.0 with additional support
for I2C devices
Intel® High Definition Audio Supports
Intel® Rapid Storage Technology enterprise (Intel® RSTe)
Intel® Active Management Technology (Intel® AMT)
Intel® Virtualization Technology for Directed I/O (Intel® VT-d)
Intel® Trusted Execution Technology (Intel® TXT)
Low Pin Count (LPC) interface Firmware Hub (FWH) interface
Serial Peripheral Interface (SPI)
Intel® Anti-Theft Technology (Intel® AT)
JTAG Boundary Scan support