IEI Technology Mustang-V100-MX4 User manual

Mustang-V100-MX4
Page I
User Manual
MODEL:
Intel®Vision Accelerator Design with Intel®Movidius™ VPU
Powered by Open Visual Inference & Neural Network Optimization (OpenVINO™) toolkit
Rev. 1.00 - July 22, 2019
Mustang-V100-MX4
Mustang-V100-MX4 CPU Ca

Mustang-V100-MX4
Page II
Revision
Date Version Changes
July 22, 2019 1.00 Initial release

Mustang-V100-MX4
Page III
Copyright
COPYRIGHT NOTICE
The information in this document is subject to change without prior notice in order to
improve reliability, design and function and does not represent a commitment on the part
of the manufacturer.
In no event will the manufacturer be liable for direct, indirect, special, incidental, or
consequential damages arising out of the use or inability to use the product or
documentation, even if advised of the possibility of such damages.
This document contains proprietary information protected by copyright. All rights are
reserved. No part of this manual may be reproduced by any mechanical, electronic, or
other means in any form without prior written permission of the manufacturer.
TRADEMARKS
All registered trademarks and product names mentioned herein are used for identification
purposes only and may be trademarks and/or registered trademarks of their respective
owners.

Mustang-V100-MX4
Page IV
Manual Conventions
WARNING
Warnings appear where overlooked details may cause damage to the
equipment or result in personal injury. Warnings should be taken
seriously.
CAUTION
Cautionary messages should be heeded to help reduce the chance of
losing data or damaging the product.
NOTE
These messages inform the reader of essential but non-critical
information. These messages should be read carefully as any directions
or instructions contained therein can help avoid making mistakes.

Mustang-V100-MX4
Page V
Table of Contents
1 INTRODUCTION.......................................................................................................... 1
1.1 INTRODUCTION........................................................................................................... 2
1.2 FEATURES................................................................................................................... 3
1.3 DIMENSIONS............................................................................................................... 4
1.4 TECHNICAL SPECIFICATIONS ...................................................................................... 5
2 UNPACKING ................................................................................................................. 6
2.1 ANTI-S TAT I C PRECAUTIONS ........................................................................................ 7
2.2 UNPACKING PRECAUTIONS......................................................................................... 7
2.3 PACKING LIST............................................................................................................. 8
3 HARDWARE INSTALLATION................................................................................... 9
3.1 ANTI-S TAT I C PRECAUTIONS ...................................................................................... 10
3.2 INSTALLATION CONSIDERATIONS.............................................................................. 10
3.3 HARDWARE INSTALLATION....................................................................................... 12
4 OPENVINO™ TOOLKIT INSTALLATION (LINUX)........................................... 15
4.1 SYSTEM REQUIREMENTS .......................................................................................... 16
4.2 ONLINE INSTALLATION GUIDE.................................................................................. 16
4.3 INSTALLATION -STEP BY STEP (2019 R1)................................................................. 17
4.3.1 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 18
4.3.2 Set the Environment Variables ......................................................................... 21
4.3.3 Configure the Model Optimizer ....................................................................... 22
4.4 STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®MOVIDIUS™VPUS
MUSTANG-V100-MX4 DRIVER INSTALLATION.............................................................. 24
4.5 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 26
4.5.1 Run the Image Classification Demo ................................................................ 27
4.5.2 Run the Inference Pipeline Demo .................................................................... 28
4.6 INSTALLATION -STEP BY STEP (OPENVINO 2018 R5) ............................................. 31
4.6.1 Install External Software Dependencies .......................................................... 31
4.6.2 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 32

Mustang-V100-MX4
Page VI
4.6.3 Set the Environment Variables ......................................................................... 34
4.6.4 Configure the Model Optimizer ....................................................................... 35
4.7 STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®MOVIDIUS™VPUS
MUSTANG-V100-MX4 DRIVER INSTALLATION.............................................................. 37
4.8 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 39
4.8.1 Run the Image Classification Demo ................................................................ 40
4.8.2 Run the Inference Pipeline Demo .................................................................... 41
5 OPENVINO™ TOOLKIT INSTALLATION (WINDOWS 10) .............................. 44
5.1 SYSTEM REQUIREMENTS .......................................................................................... 45
5.2 ONLINE INSTALLATION GUIDE.................................................................................. 45
5.3 INSTALLATION -STEP BY STEP (2019 R1)................................................................. 46
5.3.1 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 46
5.3.2 Install the External Software Dependencies .................................................... 48
5.3.2.1 Microsoft Visual Studio* with C++ and MSBuild ................................... 49
5.3.2.2 Install CMake* 3.4 or higher .................................................................... 51
5.3.2.3 Install Python* 3.6.5.............................................................................. 53
5.3.3 Set the Environment Variables................................................................... 54
5.3.4 Configure the Model Optimizer ....................................................................... 55
5.3.4.1 Model Optimizer Configuration Steps...................................................... 56
5.4 INSTALLATION STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®
MOVIDIUS™VPUS MUSTANG-V100-MX4................................................................... 59
5.5 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 59
5.5.1 Run the Image Classification Demo ................................................................ 61
5.5.2 Set Up a Neural Network Model...................................................................... 61
5.6 INSTALLATION -STEP BY STEP (2018 R5)................................................................. 64
5.6.1 Install the Intel® Distribution of OpenVINO™ Toolkit Core Components..... 64
5.6.2 Install the External Software Dependencies .................................................... 68
5.6.2.1 Microsoft Visual Studio* with C++ and MSBuild ................................... 68
5.6.2.2 Install the Build Tools for Visual Studio 2017.......................................... 71
5.6.2.3 Install CMake* 3.4 or higher .................................................................... 72
5.6.2.4 Install Python* 3.6.5 ................................................................................. 73
5.6.3 Set the Environment Variables ......................................................................... 75
5.6.4 Configure the Model Optimizer ....................................................................... 75
5.6.4.1 Model Optimizer Configuration Steps...................................................... 76

Mustang-V100-MX4
Page VII
5.7 INSTALLATION STEPS FOR INTEL®VISION ACCELERATOR DESIGN WITH INTEL®
MOVIDIUS™VPUS MUSTANG-V100-MX4................................................................... 79
5.8 USE THE DEMO SCRIPTS TO VERIFY YOUR INSTALLATION........................................ 79
5.8.1 Run the Image Classification Demo ................................................................ 81
5.8.2 Run the Inference Pipeline Demo .................................................................... 82
A PERFORMANCE TEST ............................................................................................ 85
B REGULATORY COMPLIANCE .............................................................................. 87
C PRODUCT DISPOSAL .............................................................................................. 89
D HAZARDOUS MATERIALS DISCLOSURE ......................................................... 91

Mustang-V100-MX4
Page VIII
List of Figures
Figure 1-1: Mustang-V100-MX4 .....................................................................................................2
Figure 1-2: Dimensions (mm) ........................................................................................................4
Figure 3-1: Remove One Blank Bracket .....................................................................................13
Figure 3-2: Change to Full-height Bracket.................................................................................13
Figure 3-3: Change to Full-height Bracket.................................................................................14
Figure 3-4: Assign a Card ID .......................................................................................................14

Mustang-V100-MX4
Page 1
Chapter
1
1 Introduction

Mustang-V100-MX4
Page 2
1.1 Introduction
Figure 1-1: Mustang-V100-MX4
The Mustang-V100-MX4 is a deep learning convolutional neural network acceleration
card for speeding up AI inference, in a flexible and scalable way. Equipped with Intel®
Movidius™ Myriad™ X Vision Processing Unit (VPU), the Mustang-V100-MX4 PCIe card
can be used with the existing system, enabling high-performance computing without
costing a fortune. VPUs can run AI faster, and is well suited for low power consumption
applications such as surveillance, retail and transportation. With the advantage of power
efficiency and high performance to dedicate DNN topologies, it is perfect to be
implemented in AI edge computing device to reduce total power usage, providing longer
duty time for the rechargeable edge computing equipment.
"Open Visual Inference & Neural Network Optimization (OpenVINO™) toolkit" is based on
convolutional neural networks (CNN), the toolkit extends workloads across Intel®
hardware and maximizes performance. It can optimize pre-trained deep learning model
such as Caffe, MXNET, Tensorflow into IR binary file then execute the inference engine
across Intel®-hardware heterogeneously such as CPU, GPU, Intel® Movidius™ Myriad X
VPU, and FPGA.