IEI Technology Mustang-V100-MX4 User manual

Mustang-V100-MX4
Page I
User Manual
MODEL:
Intel®Vision Accelerator Design with Intel®Movidius™ VPU
Powered by Open Visual Inference & Neural Network Optimization (OpenVINO™) toolkit
Rev. 1.00 - July 22, 2019
Mustang-V100-MX4
Mustang-V100-MX4 CPU Ca

Mustang-V100-MX4
Page II
Revision
Date Version Changes
July 22, 2019 1.00 Initial release

Mustang-V100-MX4
Page III
Copyright
COPYRIGHT NOTICE
The information in this document is subject to change without prior notice in order to
improve reliability, design and function and does not represent a commitment on the part
of the manufacturer.
In no event will the manufacturer be liable for direct, indirect, special, incidental, or
consequential damages arising out of the use or inability to use the product or
documentation, even if advised of the possibility of such damages.
This document contains proprietary information protected by copyright. All rights are
reserved. No part of this manual may be reproduced by any mechanical, electronic, or
other means in any form without prior written permission of the manufacturer.
TRADEMARKS
All registered trademarks and product names mentioned herein are used for identification
purposes only and may be trademarks and/or registered trademarks of their respective
owners.

Mustang-V100-MX4
Page IV
Manual Conventions
WARNING
Warnings appear where overlooked details may cause damage to the
equipment or result in personal injury. Warnings should be taken
seriously.
CAUTION
Cautionary messages should be heeded to help reduce the chance of
losing data or damaging the product.
NOTE
These messages inform the reader of essential but non-critical
information. These messages should be read carefully as any directions
or instructions contained therein can help avoid making mistakes.

Mustang-V100-MX4
Page V
Table of Contents
1 INTRODUCTION.......................................................................................................... 1
1.1 INTRODUCTION........................................................................................................... 2
1.2 FEATURES................................................................................................................... 3
1.3 DIMENSIONS............................................................................................................... 4
1.4 TECHNICAL SPECIFICATIONS ...................................................................................... 5
2 UNPACKING ................................................................................................................. 6
2.1 ANTI-S TAT I C PRECAUTIONS ........................................................................................ 7
2.2 UNPACKING PRECAUTIONS......................................................................................... 7
2.3 PACKING LIST............................................................................................................. 8
3 HARDWARE INSTALLATION................................................................................... 9
3.1 ANTI-S TAT I C PRECAUTIONS ...................................................................................... 10
3.2 INSTALLATION CONSIDERATIONS.............................................................................. 10
3.3 HARDWARE INSTALLATION....................................................................................... 12
4 OPENVINO™ TOOLKIT INSTALLATION (LINUX)........................................... 15
4.1 SYSTEM REQUIREMENTS .......................................................................................... 16
4.2 ONLINE INSTALLATION GUIDE.................................................................................. 16
4.3 INSTALLATION -STEP BY STEP (2019 R1)................................................................. 17
4.3.1 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 18
4.3.2 Set the Environment Variables ......................................................................... 21
4.3.3 Configure the Model Optimizer ....................................................................... 22
4.4 STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®MOVIDIUS™VPUS
MUSTANG-V100-MX4 DRIVER INSTALLATION.............................................................. 24
4.5 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 26
4.5.1 Run the Image Classification Demo ................................................................ 27
4.5.2 Run the Inference Pipeline Demo .................................................................... 28
4.6 INSTALLATION -STEP BY STEP (OPENVINO 2018 R5) ............................................. 31
4.6.1 Install External Software Dependencies .......................................................... 31
4.6.2 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 32

Mustang-V100-MX4
Page VI
4.6.3 Set the Environment Variables ......................................................................... 34
4.6.4 Configure the Model Optimizer ....................................................................... 35
4.7 STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®MOVIDIUS™VPUS
MUSTANG-V100-MX4 DRIVER INSTALLATION.............................................................. 37
4.8 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 39
4.8.1 Run the Image Classification Demo ................................................................ 40
4.8.2 Run the Inference Pipeline Demo .................................................................... 41
5 OPENVINO™ TOOLKIT INSTALLATION (WINDOWS 10) .............................. 44
5.1 SYSTEM REQUIREMENTS .......................................................................................... 45
5.2 ONLINE INSTALLATION GUIDE.................................................................................. 45
5.3 INSTALLATION -STEP BY STEP (2019 R1)................................................................. 46
5.3.1 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 46
5.3.2 Install the External Software Dependencies .................................................... 48
5.3.2.1 Microsoft Visual Studio* with C++ and MSBuild ................................... 49
5.3.2.2 Install CMake* 3.4 or higher .................................................................... 51
5.3.2.3 Install Python* 3.6.5.............................................................................. 53
5.3.3 Set the Environment Variables................................................................... 54
5.3.4 Configure the Model Optimizer ....................................................................... 55
5.3.4.1 Model Optimizer Configuration Steps...................................................... 56
5.4 INSTALLATION STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®
MOVIDIUS™VPUS MUSTANG-V100-MX4................................................................... 59
5.5 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 59
5.5.1 Run the Image Classification Demo ................................................................ 61
5.5.2 Set Up a Neural Network Model...................................................................... 61
5.6 INSTALLATION -STEP BY STEP (2018 R5)................................................................. 64
5.6.1 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 64
5.6.2 Install the External Software Dependencies .................................................... 68
5.6.2.1 Microsoft Visual Studio* with C++ and MSBuild ................................... 68
5.6.2.2 Install the Build Tools for Visual Studio 2017.......................................... 71
5.6.2.3 Install CMake* 3.4 or higher .................................................................... 72
5.6.2.4 Install Python* 3.6.5 ................................................................................. 73
5.6.3 Set the Environment Variables ......................................................................... 75
5.6.4 Configure the Model Optimizer ....................................................................... 75
5.6.4.1 Model Optimizer Configuration Steps...................................................... 76

Mustang-V100-MX4
Page VII
5.7 INSTALLATION STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®
MOVIDIUS™VPUS MUSTANG-V100-MX4................................................................... 79
5.8 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 79
5.8.1 Run the Image Classification Demo ................................................................ 81
5.8.2 Run the Inference Pipeline Demo .................................................................... 82
A PERFORMANCE TEST ............................................................................................ 85
B REGULATORY COMPLIANCE .............................................................................. 87
C PRODUCT DISPOSAL .............................................................................................. 89
D HAZARDOUS MATERIALS DISCLOSURE ......................................................... 91

Mustang-V100-MX4
Page VIII
List of Figures
Figure 1-1: Mustang-V100-MX4 .....................................................................................................2
Figure 1-2: Dimensions (mm) ........................................................................................................4
Figure 3-1: Remove One Blank Bracket .....................................................................................13
Figure 3-2: Change to Full-height Bracket.................................................................................13
Figure 3-3: Change to Full-height Bracket.................................................................................14
Figure 3-4: Assign a Card ID .......................................................................................................14

Mustang-V100-MX4
Page 1
Chapter
1
1 Introduction

Mustang-V100-MX4
Page 2
1.1 Introduction
Figure 1-1: Mustang-V100-MX4
The Mustang-V100-MX4 is a deep learning convolutional neural network acceleration
card for speeding up AI inference, in a flexible and scalable way. Equipped with Intel®
Movidius™ Myriad™ X Vision Processing Unit (VPU), the Mustang-V100-MX4 PCIe card
can be used with the existing system, enabling high-performance computing without
costing a fortune. VPUs can run AI faster, and is well suited for low power consumption
applications such as surveillance, retail and transportation. With the advantage of power
efficiency and high performance to dedicate DNN topologies, it is perfect to be
implemented in AI edge computing device to reduce total power usage, providing longer
duty time for the rechargeable edge computing equipment.
"Open Visual Inference & Neural Network Optimization (OpenVINO™) toolkit" is based on
convolutional neural networks (CNN), the toolkit extends workloads across Intel®
hardware and maximizes performance. It can optimize pre-trained deep learning model
such as Caffe, MXNET, Tensorflow into IR binary file then execute the inference engine
across Intel®-hardware heterogeneously such as CPU, GPU, Intel® Movidius™ Myriad X
VPU, and FPGA.

Mustang-V100-MX4
Page 3
1.2 Features
Mustang-V100-MX4 features are listed below:
Intel® Movidius™ Myriad™ X Vision Processing Unit
Interface: PCIe 2.0 x2
Dimensions: 113 mm x 56 mm x 23 mm
Cooling: Active fan
OpenVINO™ Toolkit, AI edge computing ready device
Four Intel® Movidius™ Myriad™ X chips can execute four topologies
simultaneously
Low power consumption, approximate 15W
Equipped with rotary switch and LED indicator for card number identification

Mustang-V100-MX4
Page 4
1.3 Dimensions
The dimensions of the board are listed below:
Figure 1-2: Dimensions (mm)

Mustang-V100-MX4
Page 5
1.4 Technical Specifications
Mustang-V100-MX4 technical specifications are listed below.
Specification Mustang-V100-MX4
Main Chip Four Intel® Movidius™ Myriad™ X MA2485 VPU
Operating Systems Ubuntu 16.04.3 (LTS), 64-bit,
CentOS 64-bit
Windows10 64-bit
Interface PCIe 2.0 x2
Fan Active fan
DIP Switch / LED Indicator Yes (for card number identification)
Power Consumption Approximate 15 W
Operating Temperature 0°C~55°C (in TANK AIoT Dev. Kit)
Operating Humidity 5% ~ 90%
Dimensions 113 mm x 56 mm x 23 mm
Supported Topologies AlexNet, GoogleNetV1/V2, Mobile_, SSD,
obileNetV1/V2, MTCNN, Squeezenet1.0/1.1,
Tiny Yolo V1 & V2, Yolo V2, ResNet-18/50/101
Table 1-1: Technical Specifications

Mustang-V100-MX4
Page 6
Chapter
2
2 Unpacking

Mustang-V100-MX4
Page 7
2.1 Anti-static Precautions
WARNING!
Static electricity can destroy certain electronics. Make sure to follow the
ESD precautions to prevent damage to the product, and injury to the
user.
Make sure to adhere to the following guidelines:
Wear an anti-static wristband: Wearing an anti-static wristband can prevent
electrostatic discharge.
Self-grounding: Touch a grounded conductor every few minutes to discharge
any excess static buildup.
Use an anti-static pad: When configuring any circuit board, place it on an
anti-static mat.
Only handle the edges of the PCB: Don't touch the surface of the
motherboard. Hold the motherboard by the edges when handling.
2.2 Unpacking Precautions
When the Mustang-V100-MX4 is unpacked, please do the following:
Follow the antistatic guidelines above.
Make sure the packing box is facing upwards when opening.
Make sure all the packing list items are present.

Mustang-V100-MX4
Page 8
2.3 Packing List
NOTE:
If any of the components listed in the checklist below are missing, do not
proceed with the installation. Contact the IEI reseller or vendor the
Mustang-V100-MX4 was purchased from or contact an IEI sales
representative directly by sending an email to [e-mail].
The Mustang-V100-MX4 is shipped with the following components:
Quantity Item and Part Number Image
1 Mustang-V100-MX4 AI acceleration card
1 Full-height bracket

Mustang-V100-MX4
Page 9
Chapter
3
3 Hardware Installation

Mustang-V100-MX4
Page 10
3.1 Anti-static Precautions
WARNING:
Failure to take ESD precautions during the installation of the
Mustang-V100-MX4
may result in permanent damage to the
Mustang-V100-MX4 and severe injury to the user.
Electrostatic discharge (ESD) can cause serious damage to electronic components,
including the Mustang-V100-MX4. Dry climates are especially susceptible to ESD. It is
therefore critical that whenever the Mustang-V100-MX4 or any other electrical component
is handled, the following anti-static precautions are strictly adhered to.
Wear an anti-static wristband: Wearing a simple anti-static wristband can
help to prevent ESD from damaging the board.
Self-grounding Before handling the board, touch any grounded conducting
material. During the time the board is handled, frequently touch any
conducting materials that are connected to the ground.
Use an anti-static pad: When configuring the Mustang-V100-MX4, place it
on an anti-static pad. This reduces the possibility of ESD damaging the
Mustang-V100-MX4.
Only handle the edges of the PCB: When handling the PCB, hold the PCB
by the edges.
3.2 Installation Considerations
NOTE:
The following installation notices and installation considerations should
be read and understood before installation. All installation notices must
be strictly adhered to. Failing to adhere to these precautions may lead
to severe damage and injury to the person performing the installation.

Mustang-V100-MX4
Page 11
WARNING:
The installation instructions described in this manual should be carefully
followed in order to prevent damage to the Mustang-V100-MX4, its
components and injury to the user.
Before and during the installation please DO the following:
Read the user manual:
The user manual provides a complete description of the Mustang-V100-MX4
installation instructions and configuration options.
Wear an electrostatic discharge cuff (ESD):
Electronic components are easily damaged by ESD. Wearing an ESD cuff
removes ESD from the body and helps prevent ESD damage.
Turn off system:
When installing the Mustang-V100-MX4, make sure that the system to be
connected is disconnected from all power supplies and that no electricity is
being fed into the system.
Before and during the installation of the Mustang-V100-MX4 DO NOT:
Remove any of the stickers on the PCB board. These stickers are required for
warranty validation.
Use the product before verifying all the cables and power connectors are
properly connected.
Allow screws to come in contact with the PCB circuit, connector pins, or its
components.

Mustang-V100-MX4
Page 12
3.3 Hardware Installation
WARNING:
DO NOT install the Mustang-V100-MX4 into the TANK AIoT Dev. Kit
before shipment. It is recommended to ship them with their original
boxes to prevent the Mustang-V100-MX4 from being damaged.
To install the Mustang-V100-MX4, please follow the steps below.
Step 1: Prepare the computer. Turn off the computer, and remove the power cord from
the rear of the power supply.
WARNING:
Disconnect the computer from the power supply and from any networks
to which you will install the Mustang-V100-MX4, or you risk damaging
the system or experiencing electrical shock.
Step 2: Remove the cover from the chassis.
Step 3: Locate available PCIe slots and remove the blank brackets.The
Mustang-V100-MX4 is compatible with PCIe x2 slots, and only needs one PCIe
slot for installation. Remove a blank bracket panel on the back of the computer
that aligns with the PCIe slot for installing the Mustang-V100-MX4. Save the
bracket screw.