MYiR FZ3 User manual

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Accelerator Card User Manual
1
FZ3 Deep Learning Computing Card User Manual
V1.0

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Accelerator Card User Manual
2
Version Change History
Version
Description
Date
V1.0
Initial Version
2020/06/17

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Accelerator Card User Manual
3
Table of content
FZ3 Deep Learning Computing Card User Manual ................................................................................................... 1
Introduction............................................................................................................................................................................. 4
1. Introduction to soft cores..............................................................................................................................................5
1.1 Software Introduction ................................................................................................................................5
1.2 Performance data on FZ3 for common models (unquantified cropping) ..............................5
2. Start and connect .............................................................................................................................................................. 6
2.1 Start-up preparation ................................................................................................................................... 6
2.2 Connection Method One: SSH Connection .......................................................................................... 6
2.2.1 How to connect to the internet via SSH in Windows.............................................................. 6
2.2.2 How to connect to the internet via SSH in MAC .......................................................................8
2.3 Connection Method Two: Serial Port Connection............................................................................ 8
2.3.1 Method of using SecureCRT to connect serial port in Windows........................................ 8
2.3.2 Method of using Minicom to connect serial prot in Mac OS ........................................ 10
3. Debug The device........................................................................................................................................................... 10
3.1 Change the network configuration..................................................................................................... 10
3.2 Copy files....................................................................................................................................................... 11
3.2.1 Realize File copy through FTP (suitable for Windows system) ................................ 11
3.2.2 Realize file copy through Samba protocol (For Mac OS) .............................................. 12
3.3 Introduction to system catalog ............................................................................................................ 12
3.4.1 Example of Classification model.................................................................................................. 12
3.4.2 Example of object detection.......................................................................................................... 15
3.4.3 To output reasoning result and display.................................................................................... 17
3.4.4 Video input mode.............................................................................................................................. 19
3.5 Running EasyDL platform model prediction example................................................................ 19
3.5.1 How to use EasyDL ........................................................................................................................... 19
3.5.2 Run SDK ................................................................................................................................................ 23
3.5.3 Call HTTP Service.............................................................................................................................. 24
3.5.4 HTTP private service request description............................................................................... 25
4.Advanced Guide............................................................................................................................................................... 27
4.1 Develop Applications ............................................................................................................................... 27
4.1.1 Model acquisition.............................................................................................................................. 27
4.1.2 Connecting video data sources .................................................................................................... 27
4.1.3 Load device driver ............................................................................................................................ 27
4.1.4 Using the prediction library.......................................................................................................... 28
4.1.5 Create Application ............................................................................................................................ 28
4.2 Driver description..................................................................................................................................... 30
4.3 Prediction library description .............................................................................................................. 31
Appendix 1 Warranty & Technical Support Services.................................................................................... 33

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Accelerator Card User Manual
4
Introduction
MYIR's FZ3 is a deep learning computing card based on Xilinx Zynq Ultrascale+ CZU3EG MPSoC,
which is closely cooperated with Baidu. It integrates a 4-core ARM A53 processor + GPU + FPGA
architecture, with multi-core processing capabilities, FPGA Programmability and video streaming
hardware decoding capabilities. It has built-in deep learning soft core based on Linux operating
system + Baidu deep learning platform Paddle, deeply compatible with Baidu brain model
resource and tool platform (EasyDL/AIStudio ), can effectively and quickly implement a series of
processes such as model training-deployment-inference, which greatly reduces the threshold of
development verification, product integration, scientific research and teaching, project
deployment.

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Accelerator Card User Manual
5
1. Introduction to soft cores
1.1 Software Introduction
The FZ3 computing card comes with a Linux OS, users can develop applications based on the Linux
OS. (Main calling process: 1. The application obtains video input -> 2. Calls the prediction library to
load the model -> 3. The scheduling model and the underlying driver acceleration module are used
for the calculation -> 4. Get the running result).
1.2 Performance data on FZ3 for common models (unquantified
cropping)
Network
Input Size
Single frame
time
consumption
resnet50
224 x 224
42ms
mobilenet-v1
224 x 224
10ms
inception-v2
299 x 299
41ms
inception-v3
299 x 299
70ms
resnext
224×224
69ms
mobilenet-ssd
300 x 300
24ms
mobilenet-ssd-640
640 x 640
79ms
vgg-ssd
300×300
246ms
yolov3
608×608
582ms

MYiR Tech | www.myirtech.com
6
FZ3 Deep Learning Computing Card User Manual
Note: FZ3 soft core is still under upgrading, and its performance will be improved simultaneously.
Different versions of the same network structure have different computing power requirements. If
there are specific project applications, you can contact the official team to apply for customized
optimization
2. Start and connect
2.1 Start-up preparation
1. The default start-up mode is start-up from TF card. In order to use the functions of the device
normally, please plug the TF card into the TF card slot.
2. The board supports serial port debugging and network port debugging. Serial port debugging
corresponds to the equipment’s console, it may have redundant printing information during
general debugging, so network port debugging is recommended. The board’s static IP is pre-set:
192.168.1.254, users can connect the board to the computer directly or to routing devices through
network cable (Network cable needs to be prepared by user), using the SSH protocol to log in to
the system. Please refer to the following article for specific usage.
3. Username and password (root and root) are required to be entered after the board starts-up to
login in the OS. The OS has its own deep learning pre-installed environment as well as model
inference sample. Please refer to the following article for detailed information.
2.2 Connection Method One: SSH Connection
FZ3’s de fault parameter: static IP=192.168.1.254, netmask=255.255.255.0,
gateway=192.168.1.1
Hardware connection method: Connect FZ3 to the host computer or router, set the
computer or router IP to the same segment as FZ3, then users can login in via SSH.
Detailed Steps：
2.2.1 How to connect to the internet via SSH in Windows
1. Install debugging tools, SecureCRT (Users may Google search and install) is recommended.

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Computing Card User Manual
7
2. Set IP of the PC or router to the same network segment with the board. When the PC and the
board is connected directly, IP of the computer needs to be set manually: open the Control
Panel->Network and Internet->Network Connections->Local Connection->Properties-> The
Internet protocol version 4, set the IP address manually: IP address=192.168.1.111, Subnet
mask=255.255.255.0, Default gateway=192.168.1.1 as shown in below picture:
3. Create new window in SecureCRT. Click connect->New session->Protocol(select SSH2), click
next, Hostname is default IP of FZ3: 192.168.1.254, Port is 22, Username is root, password is root,
then click next to login in.

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Computing Card User Manual
8
2.2.2 How to connect to the internet via SSH in MAC
1. Set IP of the PC or router to the same network segment with the board.
Detailed steps：System preferences-->Network-->Advanced-->TCP/IP。
Ipv4 configuration example: Manual, Ipv4 address:192.168.1.111, Subnet mask: 255.255.255.0,
Router: 192.168.1.1.
2. Open Terminal: Launchpad->Other(folders)->Terminal
3. Enter ssh root@ip (IP of FZ3) in the Terminal: the default parameter is ssh [email protected],
then enter username and password (root and root) to login in.
2.3 Connection Method Two: Serial Port Connection
If SSH connection fails or the IP needs to be viewed (after IP of the board is dynamically obtained),
the serial port needs to be used to enter the console of the board.
Connect USB UART of FZ3 to PC.
2.3.1 Method of using SecureCRT to connect serial port in Windows
1. Install software SecureCRT and serial driver cp210x_Windows_Drivers (The driver needs to be
installed for the first time, and the installation package can be searched from Google)
2. Make sure that the PC is connected to the USB UART interface of FZ3, and then click "my
computer" -> Properties -> device manager to check the port number mapped in the device
manager. As shown in below picture, the port number is com7.

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Computing Card User Manual
9
3. Open SecureCRT, create a new window Connect -> New Session -> Protocol, select serial, baud
rate 115200, not selected flow control, as shown in the picture below
4. Click [finish] and [connect] button, SecureCRT will connect to the serial port on the computing
card. After power on, users can see the start-up information. After the startup is completed, enter
the user name and password to enter the board’s OS. As shown in below picture.

MYiR Tech | www.myirtech.com
FZ3 Deep Learning Computing Card User Manual
10
2.3.2 Method of using Minicom to connect serial prot in Mac OS
1. Install the serial port driver SiLabsUSBDriverDisk.dmg (it needs to be installed for the first time,
users may Google to search it) into PC
2. Install the Minicom tool
3. Open Terminal: Launchpad ->Others->Terminal, input command “minicom -s”to configure.
4. The configuration content is as below. After configuration, connect FZ3 and input minicom
in terminal
select Serial port setup ：
A - Serial Device : /dev/cu.SLAB_USBtoUART
B - Lockfile Location :
/usr/local/Cellar/minicom/2.7/var C - Callin
Program :
D - Callout Program :
E - Bps/Par/Bits : 115200
8N1 F - Hardware Flow
Control : No G - Software
Flow Control : No
Save setup and dfl
3. Debug The device
3.1 Change the network configuration
The default IP address of the board is 192.168.1.254. If multiple boards are connected to the same
LAN at the same time, their IP addresses need to be configured different or changed to
dynamically obtaining IP. The path of network configuration file is /etc/network/interfaces
Static IP configuration