ADLINK Technology aTCA-3430 User manual

1
aTCA-3430
10GbE AdvancedTCA
Fabric Interface Switch
User's Manual
Manual Revision: 0.20 preliminary
Revision Date: Dec. 30, 2014
Part Number: 50-1G039-1000
Advance Technologies; Automate the World.

aTCA-3430 User's Manual
2
Revision History
Rev Date Description
0.10 2014/12/27 Preliminary release
0.20 2014/12/30 Update switch info, 10GbE port switching diagram

aTCA-3430 User's Manual
3
Preface
Copyright 2014 ADLINK Technology, Inc.
This document contains proprietary information protected by copyright. All rights are reserved. No part of this
manual may be reproduced by any mechanical, electronic, or other means in any form without prior written
permission of the manufacturer.
Disclaimer
The information in this document is subject to change without prior notice in order to improve reliability,
design, and function and does not represent a commitment on the part of the manufacturer. In no event will
the manufacturer be liable for direct, indirect, special, incidental, or consequential damages arising out of the
use or inability to use the product or documentation, even if advised of the possibility of such damages.
Environmental Responsibility
ADLINK is committed to fulfill its social responsibility to global environmental preservation through compliance
with the European Union's Restriction of Hazardous Substances (RoHS) directive and Waste Electrical and
Electronic Equipment (WEEE) directive. Environmental protection is a top priority for ADLINK. We have
enforced measures to ensure that our products, manufacturing processes, components, and raw materials
have as little impact on the environment as possible. When products are at their end of life, our customers are
encouraged to dispose of them in accordance with the product disposal and/or recovery programs prescribed
by their nation or company.
Trademarks
Product names mentioned herein are used for identification purposes only and may be trademarks and/or
registered trademarks of their respective companies.

aTCA-3430 User's Manual
4
Table of Contents
Revision History .................................................................................................................................... ii
Preface................................................................................................................................................... iii
List of Tables......................................................................................................................................... vi
List of Figures ....................................................................................................................................... vi
Abbreviations....................................................................................................................................... vii
1. Overview........................................................................................................................................... 9
1.1 Introduction................................................................................................................................ 9
1.2 Functional Block Diagram ...................................................................................................... 10
1.3 Package Contents ................................................................................................................... 10
2. Features and Specifications......................................................................................................... 11
3. External Interfaces ........................................................................................................................ 12
3.1 Front Panel............................................................................................................................... 12
3.2 Front Panel............................................................................................................................... 12
3.2.1 Serial Console Port................................................................................................................. 12
3.2.2 USB Port................................................................................................................................. 13
3.2.3 Management Ethernet Port .................................................................................................... 13
3.2.4 Service Ports .......................................................................................................................... 14
3.2.5 Reset Switch........................................................................................................................... 14
3.2.6 LEDs and Markers .................................................................................................................. 14
3.3 Zone 2 Backplane Interfaces.................................................................................................. 15
4. Getting Started............................................................................................................................... 16
4.1 Safety Requirements............................................................................................................... 16
4.2 Quick Start ............................................................................................................................... 17
4.2.1 Hardware Configuration Setting ............................................................................................. 17
Headers and Jumpers................................................................................................................... 18
DIP Switches................................................................................................................................. 21
Programmable Devices................................................................................................................. 22
4.2.2 Connecting to the Blade .........................................................................................................23
Connecting to the aTCA-3430 via COM port ................................................................................ 23
Connecting to the aTCA-3430 remotely ....................................................................................... 25
Boot into CLI for Base Switch Management ................................................................................. 26
Boot into CLI for Fabric Switch Management ............................................................................... 27
5. Software Setup/Update/Recovery................................................................................................ 28
5.1 U-Boot Installation .................................................................................................................. 28
5.1.1 Building U-Boot....................................................................................................................... 28
5.1.2 Updating U-Boot ..................................................................................................................... 28
5.2 BSP/Embedded Linux/BCM SDK Installation ....................................................................... 29
5.3 Redundant LMP Firmware & Boot ......................................................................................... 31
5.3.1 Boot Auto-Switch .................................................................................................................... 31
5.3.2 Boot Manual Switch................................................................................................................ 31
5.4 IPMI Firmware Update Procedure.......................................................................................... 32
5.4.1 Update over Serial Interface................................................................................................... 32
5.4.2 Update over LAN .................................................................................................................... 32
6. Configuring and Managing the Fabric Switch ............................................................................. 34
7. Advanced Operation ..................................................................................................................... 35
7.1 Switching I/O between Front Panel and Base Switch ......................................................... 35
7.2 Switch UART Serial Port between Front Panel and IPMC................................................... 36
8. Architecture Overview .................................................................................................................. 38
8.1 LMP Subsystem....................................................................................................................... 38

aTCA-3430 User's Manual
5
8.1.1 Boot Image Redundancy ........................................................................................................ 38
U-Boot Redundancy...................................................................................................................... 38
8.1.2 LMP SDK/BSP Porting (U-Boot file system) .......................................................................... 40
8.1.3 Device Drivers ........................................................................................................................ 40
8.1.4 LMP State Machines............................................................................................................... 42
8.1.5 Boot Sequence ....................................................................................................................... 43
8.1.6 Non-volatile Memory Mapping................................................................................................ 44
8.2 Switch Subsystem................................................................................................................... 45
8.2.1 Broadcom SDK ....................................................................................................................... 45
I.................................................................................................................................................. 46
8.3 PMI Subsystem........................................................................................................................ 46
8.3.1 Platform Management Overview ............................................................................................ 46
8.3.2 Serial Over LAN (SOL) ...........................................................................................................46
8.3.3 IPMI Sensors .......................................................................................................................... 46
Sensor Reading (FRU Hot Swap Sensor) .................................................................................... 49
Get Sensor Reading (Physical IPMB-0 Sensor) ........................................................................... 49
Watchdog Timer Sensor ............................................................................................................... 50
Version Change Sensor................................................................................................................ 51
Get Sensor Reading Command.................................................................................................... 52
8.3.4 FRU Information ..................................................................................................................... 53
Board information area ................................................................................................................. 53
Product information area............................................................................................................... 53
Board E-key Information ............................................................................................................... 54
8.3.5 IPMI Commands ..................................................................................................................... 56
9. Software Component Overview ................................................................................................... 58
9.1 IPMI Subsystem....................................................................................................................... 58
9.2 LMP Subsystem....................................................................................................................... 59
9.3 Switch Subsystem................................................................................................................... 59
9.4 PacketManager ........................................................................................................................ 60
9.4.1 Features List ........................................................................................................................... 60
Safety .................................................................................................................................................... 61
Consignes de Sécurité........................................................................................................................ 62
Getting Service .................................................................................................................................... 63

aTCA-3430 User's Manual
6
List of Tables
Table 1: aTCA-3430 Specifications ..................................................................................................................................... 11
Table 2. Serial Console Port Pinout .................................................................................................................................... 13
Table 3. Serial Console Port Configuration Values ............................................................................................................. 13
Table 4. RJ-45 Management Port Pinout ............................................................................................................................ 13
Table 5. Front Panel LEDs and Markers ............................................................................................................................. 15
Table 6. Ground Header Settings (JP3) .............................................................................................................................. 18
Table 7. XAUI_SEL Status Settings (JP5)........................................................................................................................... 19
Table 8. JTAGSEL Pin Definition (JP8)............................................................................................................................... 19
Table 9. SPI Flash or SD Card Selection (SW1) ................................................................................................................. 21
Table 10. Faceplate Serial Port Selection (SW2) ................................................................................................................ 21
Table 11. Multi-function Switch (SW3) ................................................................................................................................ 22
Table 12. Programmable Devices ....................................................................................................................................... 22
Table 13. Firmware Image and File Name .......................................................................................................................... 33
Table 14. LMP U-Boot Boot-up Failover Actions ................................................................................................................. 39
Table 15. Summary of Devices and Access........................................................................................................................ 41
Table 16. LMP State Descriptions ....................................................................................................................................... 42
Table 17. LMP State Transition Descriptions ...................................................................................................................... 43
Table 18. Boot Sequence State Descriptions ...................................................................................................................... 44
Table 19. Non-volatile Memory Map.................................................................................................................................... 44
List of Figures
Figure 1. aTCA-3430 Block Diagram................................................................................................................................... 10
Figure 2. Configurable Component Locations ..................................................................................................................... 17
Figure 3. Ground Header Schematic (JP3) ......................................................................................................................... 18
Figure 4. XAUI_SEL Status Header Schematic (JP5) ......................................................................................................... 18
Figure 5. JTAGSEL Mode Header Schematic (JP8) ........................................................................................................... 19
Figure 6. IPMC JTAG Header Schematic (JP9) .................................................................................................................. 20
Figure 7. CPLD JTAG Header Schematic (JP12)................................................................................................................ 20
Figure 8. Switching I/O between Front Panel and Base Switch .......................................................................................... 35
Figure 9. U-Boot Redundancy Flow .................................................................................................................................... 39
Figure 10. LMP SDK/BSP Porting ....................................................................................................................................... 40
Figure 11. LMP State Machine............................................................................................................................................ 42
Figure 12. aTCA-3430 Boot Sequence ............................................................................................................................... 43
Figure 13. Broadcom SDK Porting ...................................................................................................................................... 45
Figure 14. aTCA-3430 Software Overview.......................................................................................................................... 58
Figure 15. IPMI Function Blocks.......................................................................................................................................... 59
Figure 16. Broadcom SDK Function Blocks ........................................................................................................................ 60

aTCA-3430 User's Manual
7
Abbreviations
Term Description
ASIC Application Specific Integrated Circuit
ATCA Advanced Telecom Computing Architecture
Base Interface ATCA Base Interface on Zone-2 connectors to connect to the dual hubs, 4 differential pairs
per Base Channel.
Blade A printed circuit board assembly that plugs into a chassis
BSP Board Support Package
Boot-flash Flash memory where the bootloader program is stored
Bootloader Code used to boot the System before loading OS
DDR Double Data Rate DRAM memory
DFT/DFM Design For Test/Manufacturing
DIMM Dual Inline Memory Module
ECC Error Correction Control
E-keying Standard defined by PICMG useful to verify whether the ATCA blade plugged in is compliant
to the fabric link capabilities
Fabric Interface ATCA Fabric Interface on the Zone-2 connectors to connect to the dual Switch Fabric Blades
Fabric Slot A slot supporting a link connection to/from each node slot
FRU Field Replaceable Unit
GPIO General Purpose Input/Output
Hot-swap Functions of replacing system components without shutting down the system
IPMB Intelligent Platform Management Bus
IPMB-L IPMB Local interface
IPMC Intelligent Platform Management Controller
IPMI Intelligent Platform Management Interface
JTAG Joint Test Action Group
MAC Media Access Controller
MMC Module Management Controller
NPU Network Processor Unit
OOS Out Of Service
PCI Peripheral Component Interconnect
PCIe Peripheral Component Interconnect-Express
PHY Physical Layer or Physical Layer Device
PICMG PCI Industrial Computer Manufacturers Group
RGMII Reduced Gigabit Medium Independent Interface
RTM Rear Transition Module
RXAUI Reduced XAUI, having 2 [email protected]
SDR Sensor Data Record
SDRAM Synchronous Dynamic Random Access Memory
SFP Small Form Pluggable (1G interface)
SFP+ Small Form Pluggable Plus (10G interface)

aTCA-3430 User's Manual
8
Term Description
SGMII Serial Gigabit Medium Independent Interface
SOL Serial Over LAN
QSFP+ Quad Small Form Pluggable Plus (40G interface)
UART Universal Asynchronous Receiver-Transmitter
VLP Very Low Profile, DRAM Module Form Factor Spec
XAUI 10 Gigabit (X) Attachment Unit Interface, having 4 [email protected]Gbps
XLAUI 40 Gigabit (XL) Attachment Unit Interface

aTCA-3430 User's Manual
9
1. Overview
1.1 Introduction
The aTCA-3430 is a high performance 10G Fabric switch blade for AdvancedTCA®platforms. This product is
ideal for bandwidth intensive telecom applications such as wireless access controllers, DPI/security network,
IPTV, IP multimedia subsystems, RNC/BSC, broadband access/bearer networks, data centers, and LTE/4G
network applications. The aTCA-3430 provides 10GbE hub-to-node connectivity and integrated switch silicon
that supports load balancing, priority queues, packet classification, and flow control to enable strict bandwidth
management for implemented applications.
In addition to a Fabric switch, the aTCA-3430 also incorporates a Base switch to provide PICMG 3.0 Gigabit
Ethernet backplane connectivity. The Base switch provides up to 13 ports of node slot connectivity to support
both 6 and 14-slot chassis in addition to 8 ports of front I/O, with 6 ports supporting 1GbE and 2 ports
supporting 10GbE. Other ports are used to provide connectivity to other components on the board such as the
Local Management Processor (LMP) and Intelligent Platform Management Controller (IPMC), and a
redundant switch slot supports connectivity with the redundant Base switch and shelf management. A
powerful quad-core LMP executes all switch functions, blade setup and hardware platform management
functions. Dual boot flash memory is provided for redundancy and a microSD card is provided for OS storage.
The ADLINK aTCA-3430 is equipped with the ADLINK PacketManager software package, which combines all
the essential features required for a fully functional switch infrastructure on ATCA platforms. This complete
package allows customers to focus on revenue-generating software development projects and provides the
flexibility to develop specific functions according to customer requirements.

aTCA-3430 User's Manual
10
1.2 Functional Block Diagram
Fabric InterfaceBase Interface
Zone 1
RJ-45
RJ-45
IPMC
ShMC
1
ShMC
2
GbE
RS-232
10/100M
10/100M
GbE x1
IPMB-A
GbE x13
10GbE x9
SFP+
#1
SFP+
#9
PCIe x2
GbE x6
10GbE x13
IPMB-B
LED
UART (SOL)
USB 2.0
USB
RJ-45
#1
RJ-45
#6
UART (payload)
Base Switch
(BCM56334)
24x GbE
Fabric Switch
BCM56842 320G
GbE x1
4GB, DDR3 SDRAM
8GB, microSD card
2x 1MB, Boot Flash
LMP
UART (debug)
SFP+
#12
10GbE x1
MUX
DIP SW
SFP+
#11
10GbE x1
MUX
SFP+
#10
10GbE x1
Figure 1. aTCA-3430 Block Diagram
1.3 Package Contents
The aTCA-3430 is shipped with the components listed below. If any of the items in the contents list are
missing or damaged, retain the shipping carton and packing material and contact the dealer for inspection.
Please obtain authorization before returning any product to ADLINK.
The packing contents of non-standard configurations may vary depending on customer requests.
aTCA-3430 AdvancedTCA Switch Blade