VVDN T4MFCS Scaleout Assembly instructions

© 2015 VVDN Technologies
All Rights Reserved
DT4CS-Scale out
User Manual Guide
Revision: A1

VVDN_T4MFCS_Scaleout_User_Manual Rev. A1
CONFIDENTIAL 2
Copyright Notice
This document is copyright of VVDN, All Rights Reserved. No part of this document, in whole or in part,
may be used, reproduced, stored in a retrieval system or transmitted, in any form, or by any means,
electronic or otherwise, including photocopying, reprinting, or recording, for any purpose, without the
express written permission of VVDN.
Legal Disclaimer
The information contained in this document is subject to change without notice. The information in this
document is provided for informational purposes only. VVDN Technologies specifically disclaims all
warranties, express or limited, including, but not limited, to the implied warranties of merchantability and
fitness for a particular purpose, except as provided for in a separate software license agreement.
The Open Server
The Open server provides an established framework to demonstrate the accelrated communication
process.It provide the solution for communication with higher network connectivity and powerful security
using encryption methodology.It offering powerful unified communication using scale-out and storage
option. The storage appliance is designed to provide features that include data compression, de-
duplication and encryption.
VVDN Technologies
VVDN Technologies Pvt Ltd is responsible for the design and development of all products . VVDN
provide end-to-end product design capability to its customer. Founded in 2007, VVDN is a technology
innovation and development company providing a broad spectrum of services and technology expertise to
our core domains. VVDN provides “Concept to Customer” services at any point in the development
cycle, as well as full turnkey solutions.
Correspondence
VVDN Technologies,
B-22, infocity sector- 34,
Gurgaon- 122001,
Haryana, India.
Email: [e-mail]
Website: www.theopenservers.com

VVDN_T4MFCS_Scaleout_User_Manual Rev. A1
CONFIDENTIAL 3
Revision History:
Date
Rev No.
Description
By
13-March-2015
A0-01
User Manual -Initial Draft
VVDN
23-March-2015
A0-02
Updated BMC GUI Features
VVDN
27-March-2015
A0-03
Updated NOR booting Steps
VVDN

VVDN_T4MFCS_Scaleout_User_Manual Rev. A1
CONFIDENTIAL 4
Table of contents
1INTRODUCTION ............................................................................................................................................ 6
2OVERVIEW .................................................................................................................................................... 6
PREREQUISITES ....................................................................................................................................................62.1
2.1.1 Host requirement ...................................................................................................................................6
2.1.2 Target requirements ..............................................................................................................................7
CONFIGURING THE NETWORK INTERFACE ..................................................................................................................82.2
2.2.1 Finding and Changing the MAC Address................................................................................................8
SETTING UP TFTP ..............................................................................................................................................102.3
3BMC INTERFACE ......................................................................................................................................... 12
PREPARING BOARD:............................................................................................................................................123.1
UPGRADING IMAGE ON BMC ...............................................................................................................................13
3.2
STEPS TO FLASH THE IMAGE ON BMC.....................................................................................................................133.3
BMC GUI DESCRIPTION FOR DUAL T4 SERVER:.......................................................................................................143.4
4MFCS BOOTING OPTIONS ........................................................................................................................... 22
NOR FLASH.....................................................................................................................................................224.1
SWITCH SETTING FOR SERVER1AND SERVER2FOR NOR FLASH ...................................................................................224.2
NOR FLASH.....................................................................................................................................................234.3
EEPROM FLASH..............................................................................................................................................234.4
4.4.1 Switch setting for server1 and server2 for EEPROM Flash ...................................................................23
5CONFIGURATION AND COMPILATION ........................................................................................................ 24
COMPILE U-BOOT FOR SD CARD ............................................................................................................................245.1
BUILD LINUX KERNEL AND DEVICE TREE...................................................................................................................245.2
BUILD ROOT FILE SYSTEM ....................................................................................................................................26
5.3
SWITCH SETTING ON T4240MFCS BOARD FOR SERVER1AND SERVER2FOR SD CARD ......................................................265.4
6STARTUP U-BOOT ....................................................................................................................................... 27
PROGRAM SD CARD ...........................................................................................................................................276.1
STARTUP U-BOOT FROM SD CARD .........................................................................................................................276.2
U-BOOT PROMPT COMMANDS: ............................................................................................................................316.3
I2C INTERFACE ..................................................................................................................................................326.4
DDR3 SPD.......................................................................................................................................................326.5
USB INTERFACE .................................................................................................................................................336.6
SD CARD INTERFACE ...........................................................................................................................................346.7
PCIE INTERFACE.................................................................................................................................................346.8
7STARTING LINUX FROM SD CARD ............................................................................................................... 36
STEPS FOR ETHERNET PORT SETTING.......................................................................................................................367.1
UPGRADE U-BOOT ON SD CARD ............................................................................................................................367.2
UPGRADE UIMAGE AND T4240MFCS.DTB ON SD CARD .............................................................................................377.3

VVDN_T4MFCS_Scaleout_User_Manual Rev. A1
CONFIDENTIAL 5
Table of figures
Figure 1 Login screen ...................................................................................................................................................14
Figure 2 System Page 1................................................................................................................................................15
Figure 3 System Page 2................................................................................................................................................15
Figure 4 Network Configuration ..................................................................................................................................16
Figure 5 Debug Screen with prompt box to save the logs ...........................................................................................17
Figure 6 Debug Screen.................................................................................................................................................17
Figure 7 T4 Server: Product Details .............................................................................................................................18
Figure 8 Board Details..................................................................................................................................................18
Figure 9 Firmware Upgrade .........................................................................................................................................19
Figure 10 Fan Monitoring ............................................................................................................................................19
Figure 11 Temperature Monitoring .............................................................................................................................20
Figure 12 Voltage Monitoring......................................................................................................................................20
Figure 13 Power on/off and reset................................................................................................................................21
Figure 14 Disc Status....................................................................................................................................................21
Figure 15 Configuration for NVME ..............................................................................................................................25
Figure 16 Configuration For RapidIO Support .............................................................................................................25
Figure 17 Table for SD card partition...........................................................................................................................36

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
1Introduction
This document will describe in detail the procedures for SDK compilation, booting a Linux kernel and
mounting a root file system on the Dual T4240MFCS. The Communication Server product will be built
with Dual T4240 which is a communication processor from Freescale. The T4240 QorIQ multicore
processor combines 12 dual-threaded e6500 Power Architecture® processor cores for a total of 24 threads
with high-performance datapath acceleration logic and network and peripheral bus interfaces required for
networking, telecom/datacom, data center, wireless infrastructure, and mil/aerospace applications.
A Dual T4240 based Communication server with Scale-out option, offering a powerful unified
communication solution with up to 80G of external network connectivity, SRIO inter-chip and external
connectivity. External SRIO interface helps to (scale-out) expand system with similar system through
Internal SRIO switch.
2Overview
The following files will be released with t4240mfcs.
1. U-boot, linux kernel and root files for T4240mfcs included in the below mentioned binaries:
QorIQ-SDK-V1.6-SOURCE-20140619-yocto.iso –ISO to build the SDK.
u-boot-with-spl-pbl.bin - U-boot Binary file that could be used to upgrade the U-boot with SD card.
u-boot.bin –U-boot binary file that could be used to upgrade the U-boot for NOR Flash.
fsl_fman_ucode_t4240_r2.0_106_4_10.bin –fman ucode binary to configure the fman interface.
fsl-image-core-t4240mfcs-20150304072707.rootfs.tar.gz - root file system for t4240 mfcs.
uImage - Linux kernel for t4240mfcs.
t4240mfcs.dtb –linux device tree blob (binaries) for t4240mfcs.
Prerequisites2.1
2.1.1 Host requirement
To properly boot a board host machine must meet the following requirements:
1. Make sure that SDK1.6 is compiled as per the changes required in MFCS project.
2. Modern (latest) GNU/Linux Distribution.
a. Ubuntu (Most recent release or LTS)

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
7
CONFIDENTIAL
3. An internet connection on the Development Host.
4. Root or sudo permission on the Development Host.
5. A copy of the Linux Kernel (uImage) and Root File System (rootfs.tar.gz) for the Target Board
that is compiled using SDK 1.6. These are found in the output directory of SDK build, or in the
directory build_t4240mfcs_release/tmp/deploy/images/t4240mfcs on the command line.
6. An available serial port on your Development Host.
2.1.2 Target requirements
To boot the t4240mfcs board we need the following items:
T4240MFCS Board
Custom Console cables
Ethernet Cable
ScaleOut Add On card
Once we have all the above mentioned components proceed with the following steps:
1. Connect the serial console port of the board to the serial port of host using the custom console
cables on both server1 and server2.
2. SD cards for booting the images.
3. Connect the power supply to the board.
2.1.2.1 Preparing the Target
1. Start minicom on your host machine in configuration mode. As root:
# sudo minicom -s -w
2. A menu of configuration should appear. Select the Serial port setup option, and press Enter.
3. Verify that the listed serial port is the same one that is connected to the target board. If it is not, press
A, and enter the correct device. This is /dev/ttyS0 on most Linux distributions.
4. Set the Bps/Par/Bits option by pressing the letter E and using the next menu to set the appropriate
values. You press the key that corresponds to the value 115200, and then press Enter.
5. Set Hardware flow control to No using the F key.
6. Set Software flow control to No using the G key.
7. Press Enter to return to the main configuration menu, and then press Esc to exit this menu.
8. Reset the board, and wait for a moment. If you do not see output from the board, press Enter several
times until you see the prompt. If you do not see any output from the board, and have verified that
the serial terminal connection is setup correctly, contact your board vendor.

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
8
CONFIDENTIAL
Configuring the Network Interface2.2
2.2.1 Finding and Changing the MAC Address
The MAC address on the T4240MFCS is set by the ethaddr environment variable in U-Boot.
If ethaddr is not set, it can be set using the setenv command.
Example
setenv ethaddr 00:11:22:33:44:55
The MAC Address can be found using the printenv command in U-Boot.
Example
printenv
baudrate=115200
bootargs=root=/dev/ram rw console=ttyS0, 115200 rio-scan.scan=0
fsl_fm_max_frm=9600
bootcmd=setenv bootargs root=/dev/mmcblk0p1 rw rootdelay=5 rio-
scan.scan=1 rapidio.hdid=-1
console=$consoledev,$baudrate;mmcinfo;ext2load mmc 0:1 $loadaddr
/boot/$bootfile;ext2load mmc 0:1 $fdtaddr /boot/$fdtfile;bootm
$loadaddr - $fdtaddr
bootdelay=10
bootfile=uImage
consoledev=ttyS0
eth10addr=00:10:F3:3A: BA:B0
eth11addr=00:10:F3:3A:BA:B1
eth12addr=00:10:F3:3A:BA:B2
eth13addr=00:10:F3:3A:BA:B3
eth14addr=00:10:F3:3A:BA:B4
eth15addr=00:10:F3:3A:BA:BC
eth1addr=00:10:F3:3A:BA:AB
eth2addr=00:10:F3:3A:BA:AC
eth3addr=00:10:F3:3A:BA:A1
eth4addr=00:10:F3:3A:BA:A0
eth5addr=00:10:F3:3A:BA:BF

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
9
CONFIDENTIAL
eth6addr=00:10:F3:3A:BA:B8
eth7addr=00:10:F3:3A:BA:B9
eth8addr=00:10:F3:3A:BA:AA
ethact=FM1@DTSEC1
ethaddr=00:11:22:33:44:55
ethprime=FM1@DTSEC1
fdtaddr=0x00c00000
fdtfile=t4240mfcs.dtb
fman_ucode=7fb6b948
hwconfig=fsl_ddr:ctlr_intlv=3way_4KB,bank_intlv=auto;usb1:dr_mode=host
,phy_type=utmi
ipaddr=192.168.1.10
loadaddr=0x1000000
mdioreg1=mdio write FM1@DTSEC1 22 0x12
mdioreg2=mdio write FM1@DTSEC1 20 0x8001
mmcboot=setenv bootargs root=/dev/mmcblk0p1 rwrootdelay=5
console=$consoledev,$baudratefsl_fm_max_frm=9600 ;mmcinfo;ext2load mmc
0:1 $loadaddr /boot/$bootfile;ext2load
mmc 0:1 $fdtaddr /boot/$fdtfile;bootm $loadaddr - $fdtaddr
netdev=eth0
nfsboot=setenv bootargs root=/dev/nfs rw nfsroot=$serverip:$rootpath
ip=$ipaddr:$serverip:$gatewayip:$netmask:$hostname:$netdev:off
console=$consoledev,$baudrate $othbootargs;tftp $loadaddr
$bootfile;tftp $fdtaddr $fdtfile;bootm $loadaddr - $fdtaddr
othbootargs=rio-scan.scan=0
ramboot=setenv bootargs root=/dev/ram rw console=$consoledev,$baudrate
fsl_fm_max_frm=9600 $othbootargs;tftp $ramdiskaddr $ramdiskfile;tftp
$loadaddr $bootfile;tftp $fdtaddr $fdtfile;bootm $loadaddr
$ramdiskaddr $fdtaddr
ramdiskaddr=0x02000000
ramdiskfile=ramdisk.uboot
rootpath=/opt/nfsroot
serverip=192.168.1.251

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
10
CONFIDENTIAL
setenv serverip 192.168.1.251; setenv ipaddr 192.168.1.10; setenv
ethaddr 00:11:22:33:44:55; bdev=sda3
stderr=serial
stdin=serial
stdout=serial
tftpflash=tftpboot $loadaddr $uboot && protect off $ubootaddr
+$filesize && erase $ubootaddr +$filesize && cp.b $loadaddr $ubootaddr
$filesize && protect on $ubootaddr+
$filesize && cmp.b $loadaddr $ubootaddr $filesize
uboot="u-boot.bin"
ubootaddr=0x00201000
Environment size: 2458/8188 bytes
NOTE: Once the MAC address has been set, it cannot be changed without destroying the entire
U-Boot environment.
Setting up TFTP
2.3
1. Edit the xinetd.conf file
oOn Ubuntu, edit /etc/xinetd.conf and add the following lines just above the line
that reads include dir /etc/xinetd.d.
service tftp
{
socket_type = dgram
protocol = udp
wait = yes
user = root
server = /usr/sbin/in.tftpd
server_args = -s /tftpboot
disable = no
}
2. Create the /tftpboot folder if it does not exist:
mkdir /tftpboot
3. Copy the kernel image to the /tftpboot directory:
cp /path/to/kernel/image/uImage-t4240mfcs.bin /tftpboot

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
11
CONFIDENTIAL
cp /path/to/kernel/image/uImage-t4240mfcs.dtb /tftpboot
cp /path/to/kernel/image/fsl-image-core-t4240mfcs.ext2.gz.u-boot
/tftpboot
4. Restart the xinetd server with the following command:
/etc/init.d/xinetd restart
5. Test the TFTP server by setting the environment variables and run the following
commands.
baudrate=115200
bootargs=root=/dev/ram rw console=ttyS0,115200 rio-scan.scan=0
fsl_fm_max_frm=9600
bootcmd=setenv bootargs root=/dev/mmcblk0p1 rw rootdelay=5 rio-
scan.scan=1 rapidio.hdid=-1
console=$consoledev,$baudrate;mmcinfo;ext2load mmc 0:1 $loadaddr
/boot/$bootfile;ext2load mmc 0:1 $fdtaddr /boot/$fdtfile;bootm
$loadaddr - $fdtaddr
bootdelay=10
bootfile=uImage
consoledev=ttyS0
fdtaddr=0x00c00000
fdtfile=t4240mfcs.dtb
loadaddr=0x1000000
othbootargs=rio-scan.scan=0
setenv ramboot=setenv bootargs root=/dev/ram rw
console=$consoledev,$baudrate fsl_fm_max_frm=9600 $othbootargs;tftp
$ramdiskaddr $ramdiskfile;tftp $loadaddr $bootfile;tftp $fdtaddr
$fdtfile;bootm $loadaddr $ramdiskaddr $fdtaddr
ramdiskaddr=0x02000000
ramdiskfile=ramdisk.uboot
rootpath=/opt/nfsroot
6. After setting the ramboot variables run the command.
run ramboot

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
12
CONFIDENTIAL
3BMC Interface
Preparing Board:3.1
1. Attach an RS-232 cable between T4240 UART port and host computer.
2. Open a serial console tool on the host computer to communicate with MFCS.
3. Push the reset button for BMC and the following u-boot console messages appear on the
host :
BMC booting Logs:
U-Boot 2009.01.ast(v0.62)-svn39 (Feb 07 2015 - 13:29:07)
I2C: ready
DRAM: 64 MB
In: serial
Out: serial
Err: serial
H/W: AST2400 series chip Rev. 01
Net: eth_initialize
faradaynic_initialize
Hit any key to stop autoboot: 0
## Booting kernel from Legacy Image at 20080000 ...
Image Name: Linux-2.6.28.9
Image Type: ARM Linux Kernel Image (uncompressed)
Data Size: 1842824 Bytes = 1.8 MB
Load Address: 40008000
Entry Point: 40008000
## Loading init Ramdisk from Legacy Image at 20300000 ...
Image Name:
Image Type: ARM Linux RAMDisk Image (gzip compressed)
Data Size: 3894038 Bytes = 3.7 MB
Load Address: 40800000
Entry Point: 40800000
Loading Kernel Image ... OK
OK
Starting kernel ...
Uncompressing
Linux.................................................................
..................................................
sh: UHCI: unknown operand
sh: UHCI: unknown operand
Starting T4 initialization...
Power sequencing...
T4-power-sequence t4-power-sequence.0: ############# ALL POWERS FOR T4
ARE UP ##############
power sequence successful
Releasing Clock Generator Reset...
Starting clock generation for T4 processor...

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
13
CONFIDENTIAL
Clock generator is configured Starting T4 reset sequences ...
Upgrading image on BMC3.2
To get the images from server it is necessary to configure the server. This configuration
involves
Create the tftp server.
Network configuration.
Steps to flash the image on BMC3.3
1. Boot the BMC and let the kernel up.
2. Set the ip of the BMC by using ifconfig. For e.g.
ifconfig eth0 down
ifconfig eth0 192.168.0.45 up
3. Check whether the host is connected or not using ping command. To use tftp, host (e.g.
laptop) and BMC should be in same domain. (NOTE: Both server and BMC in same i.e.
192.168.0.x domain)
Ping 192.168.0.81
4. If connection is done goto tmp directory. This can be done by
cd /tmp
5. Get the image from host by executing tftp command
tftp -gr <image name> <host_ip>
The image should present in /tftpboot directory in host system.
6. Flash the image to onboard flash memory with the help of following command
flashcp -v <image_name> /dev/mtd0
Flashing will take some time for erasing, writing and verifying data.
7. Once the flash is done reboot the BMC.

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
14
CONFIDENTIAL
BMC GUI Description for Dual T4 Server:3.4
1. Connect BMC console.
2. Let BMC and kernel up. Default ip is 192.168.0.45. We can change the default ip by ifconfig
eth0 <ip> up.
ifconfig eth0 down
ifconfig eth0 192.168.0.45 up
3. Now the server starts and opens the URL with the local host ip.
4. And the login page appears on the browser.
Figure 1 Login screen
5. Enter the user name and password.
Username : admin
Password : admin

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
15
CONFIDENTIAL
6. On successful login system page will appear on the screen.
Figure 2 System Page 1
Figure 3 System Page 2

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
16
CONFIDENTIAL
7. System page displays details of server and BMC like serial number, CPU location, BMC FW
build time, CPU FW build time, software version of BMC & CPU etc, it displays status of
voltage, temperature and power supply unit status.
8. Network Configuration for 1G and 10G ports: Displays the Mac address. IP, Subnet Mask,
Gateway of the particular port. There is option to choose static and dynamic. If static, the
MAC, IP, Subnet mask and gateway will be default. If dynamic, one can change it and click
on apply to apply the changes.
Figure 4 Network Configuration
9. Debug console on BMC: Display the location led status (ON/OFF/Blink). Displays the
console logs of BMC and Server. The server and BMC logs can be saved as text file. To
save the logs click on ON button one prompt will be displayed just click on save.

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
17
CONFIDENTIAL
Figure 5 Debug Screen with prompt box to save the logs
Figure 6 Debug Screen

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
18
CONFIDENTIAL
Figure 7 T4 Server: Product Details
Figure 8 Board Details
10. Firmware Upgrade: For upgrading BMC and RCW select the file and the loading symbol it
will show. Upgrading will take some time.

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
19
CONFIDENTIAL
Figure 9 Firmware Upgrade
11. Fan, Voltage and temperature Monitoring for checking the BMC status Fan page has details of RPM
& also status of RPM is within the specified range. Temperature page displays the server
temperature, inlet temperature& outlet temperature and also displays the status as OK if it is within
the range & fault if it exceeds range. Voltage will display all the current values.
Figure 10 Fan Monitoring

VVDN_T4MFCS_Scaleout_User_Manual Rev. A0-03
20
CONFIDENTIAL
Figure 11 Temperature Monitoring
Figure 12 Voltage Monitoring