MIR AI Camera User manual

Getting Started (en)
Date: 08/2020
Revision: v.1.3

MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 2
Copyright and disclaimer
All rights reserved. No parts of this manual may be reproduced in any form without the
express written permission of Mobile Industrial Robots A/S (MiR). MiR makes no warranties,
expressed or implied, in respect of this document or its contents. In addition, the contents of
the document are subject to change without prior notice. Every precaution has been taken in
the preparation of this manual. Nevertheless, MiR assumes no responsibility for errors or
omissions or any damages resulting from the use of the information contained.
Copyright © 2019-2020 by Mobile Industrial Robots A/S.
Contact the manufacturer:
Mobile Industrial Robots A/S
Emil Neckelmanns Vej 15F
DK-5220 Odense SØ
www.mobile-industrial-robots.com
Phone: +45 20 377 577
Email: support@mir-robots.com
CVR: 35251235

MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 3
Table of contents
1. About this document 4
1.1 Version history 4
1.2 Where to find more information 4
2. Product presentation 6
2.1 External parts 7
2.2 Nameplate 8
2.3 MiR Fleet and operating requirements 8
2.4 Light indicator 9
3. Getting started 10
3.1 In the box 10
3.2 Suggested use 11
3.3 Mounting and powering up MiR AICamera 14
3.4 Connecting to MiR AICamera 16
3.5 Adding cameras to MiR Fleet 21
4. Commissioning 24
4.1 Collection phase 25
4.2 Pre-processing phase 28
4.3 Validation phase 32
4.4 Training phase 42
4.5 Upload the data model 43
4.6 Setting up triggers and actions 45
4. Troubleshooting 51

1. About this document
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 4
1. About this document
This document describes how to install and use your MiR AICamera. MiR AICamera is a
MiR accessory that can be implemented into your work environment to improve the flow of
MiR robots connected to MiR Fleet.
NOTICE
Save this manual. It contains important safety and operating instructions.
1.1 Version history
This table shows current and previous versions of this document and their interrelations with
hardware releases.
Revision Release date Description HW
1.0 2019-11-04 First edition. 1.0 Beta
1.1 2020-03-09 Updates for interface improvements. 1.0 Beta
1.2 2020-03-20 Added section: Identification label. 1.0
1.3 2020-07-22 Updated for interface improvements and
renamed the sectionIdentification label to
Nameplate.
1.0
1.2 Where to find more information
At the MiR website, you can find the following resources under the Manuals tab on each
product page:
•Quick starts describe how you start operating MiR robots quickly. This document is in
print in the box with the robots. Quick starts are available in multiple languages.
•User guides provide all the information you need to operate and maintain MiR robots.
User guides are available in multiple languages.
•Risk Analysis Guides include guidelines on how to create a risk assessment of your robot
solution.

1. About this document
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 5
•Commissioning guides describe how to commission your robot safely and prepare it to
operate in the workplace.
•Operating guides describe how to set up and use top modules and accessories, such as
charging stations, hooks, shelf lifts, and pallet lifts.
•Getting started guides describe how to set up products that are mainly software-based,
such as MiR Fleet.
•Reference guides contain descriptions of all the elements of the robot interface and MiR
Fleet interface. Reference guides are available in multiple languages.
•REST API references for MiR robots, MiR hooks, and MiR Fleet.
•The MiR network and WiFi guide specifies the performance requirements of your
network and how you must configure it for MiR robots and MiR Fleet to operate
successfully.

2. Product presentation
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 6
2. Product presentation
MiR AICamera is intended to be used to improve the workflow of MiR robots. It provides
MiR Fleet with additional information that it can use to guide MiR robots more effectively,
for example by initiating missions when carts are ready to be transported or by avoiding
sending robots through obstructed, narrow doorways and into crowded areas.
In MiR Fleet, the camera is set up to trigger a specific action when the camera detects a
certain object. The actions can either be the initialization of a fleet mission or locking a
Limit-robots zone.
Figure 2.1. When the AIcamera detects a trigger object, it sends a signal to MiR Fleet. MiR Fleet then either
locks a Limit-robots zone or schedules a mission.

2. Product presentation
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 7
2.1 External parts
This section presents the parts of MiR AICamera that are visible on the outside.
Figure 2.2. External parts of MiR AI Camera.
Pos. Description Pos. Description
1 Camera lens 2 Indicator light
3 Reset button 4 Ventilation
5 Nameplate 6 Mounting bolts
7 Ethernet port 8 Power socket
9 WiFi antenna
To reset the camera, you must hold down the Reset button for ten seconds.

2. Product presentation
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 8
2.2 Nameplate
MiR AICamera is delivered with a nameplate mounted to it on the back. The nameplate of
MiR AICamera identifies the model and serial number and includes the CE mark and the
address of Mobile Industrial Robots.
Figure 2.3. Example of the MiR AICamera nameplate.
2.3 MiR Fleet and operating requirements
MiR AI Camera is a product that must be connected to MiR Fleet to be used as intended. The
following list describes the requirements for being able to use MiR AI Camera with your MiR
Fleet:
Some of these points are only applicable if you choose to use a WiFi
connection to the camera instead of Ethernet.
•You must be using a MiR Fleet Server Solution. AIcameras are not supported on MiR Fleet
PC.
•Your MiR Fleet must be configured to use a host network interface. This is the default
configuration for MiR Fleet.
•Ensure that port 1908 in your network is open and free for the AI camera to use.
•MiR AI Camera should be in the same physical location as MiR Fleet.
•A minimum bandwidth of 1 Mbit per AIcamera with a maximum latency of 150 mS.
•A signal strength no less than -75 dBm. The signal-to-noise ratio should be at least 20 dB.
•MiR Fleet must be updated to software version 2.10.0 or higher for the AI camera settings
to be available.
•MiR AI Camera performs best in well-lit areas.

2. Product presentation
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 9
2.4 Light indicator
The light indicator on MiR AICamera is used to provide feedback on its current status. The
following table describes the status linked to the various colors.
Color Status
White Busy. The camera is updating or starting up.
Yellow WiFi setup mode active. The camera is waiting for network connection.
Green Connected to network but no data model has been uploaded to the
camera.The light blinks when changing to this state.
Red
Error, such as connection errors. The light blinks when the camera
itself requires attention and is static when the error is handled in the
MiR Fleet interface.
Cyan Object detection mode active.
Dark blue Collection mode active.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 10
3. Getting started
This section describes how to get started with MiR AICamera.
To be able to use MiR AICamera, your MiR Fleet Server Solution must be running software
version 2.10.0.
3.1 In the box
This section describes the content of the MiR AICamera box.
The box contains:
•MiR AICamera
•A wall mount
•AWiFiantenna
•A Triad plug in adapter
•Afolder with the following documents:
•The CEDeclaration of Conformity for your product
•Passwords
•A USBdrive with the following documents:
•MiR AICamera Getting Started
•MiR Fleet Server Solution Getting Started Guide
•MiR Fleet Reference Guide

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 11
3.2 Suggested use
It is important before installing MiR AICamera to consider what you aim to use it for. This
section describes some of the possible uses of MiR AICamera, and where it should be
mounted in each case.
MiR AICamera is intended to be used to monitor a delimited area. The area of interest must
be within the field of view and line of sight of the camera. It is recommended to focus only
on a localized area. It is not recommended to install a camera that views the entire work
area where people or machinery are performing multiple tasks and are in constant motion.
Make sure to mount your camera in a well-lit area with stable lighting conditions. Changing
lighting conditions may affect the performance of MiR AICamera negatively.
MiR AICamera improves the workflow of MiR robots by triggering an action when it detects
a specific object. An action can either be the initialization of a fleet mission or locking a
Limit-robots zone, so no MiR robots may enter. It is important to consider which action
should be linked to which detected object, and to think about whether the mounted position
of the camera is ideal for this. The following examples may provide insight into what MiR
AICamera should be used for.
Preventing blockages in narrow doorways
Two MiR AICameras can be mounted on each side of a narrow doorway to monitor
incoming traffic. If a camera detects an incoming object or person, MiR Fleet is alerted and
temporarily locks the area in the narrow doorway. This prevents MiR robots from
obstructing the doorway for incoming traffic and avoids that MiR robots attempt to pass an
obstructed doorway. Instead, MiR robots wait at a reasonable distance to allow the other
object or person through first.
If a MiR robot is already in the narrow doorway, MiR AICamera will not make
the robot stop in the middle of the doorway when it locks the doorway area.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 12
MiR AICamera can also be configured only to lock the doorway area after detecting certain
objects. For example, if the doorway is large enough to allow a person and robot through at
the same time, it should be considered only to set MiR AICamera to lock the area if carts or
other robots are approaching the doorway.
Autonomously initiating robot missions
MiR AICamera can be mounted to focus on an area where the presence of a specific object
triggers a fleet mission. For example, an AIcamera can be set up at a pick-up position, so
when it detects an object at the position, a MiR robot is sent to pick up and transport the
object to a drop-off point. It is important in this case that the pick-up position occupies most
of the camera's field of view.This is to avoid that the camera detects a target object in other
positions and then initiates a mission even though the object is not necessarily placed on the
pick-up position.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 13
Figure 3.1. In this example, MiR AI Camera is focusing on a loading rack. In the first image, the camera detects
nothing in its field of view. In the second image, it has detected a crate and initiates a mission to send a robot
over to pick up the crate.
This example can also be applied to carts, shelves, and pallets where the camera is focused
on a cart position, shelf position, or a pallet rack. It is also possible to use other types of
missions as long as the mission trigger is an object that MiR AICamera can identify easily in
a designated area.
Foreseeable misuse
The following list includes examples where MiR AICamera is not intended to be used:
•Monitoring heavily-trafficked areas.
•Functioning as a surveillance camera.
•Identifying specific persons.
•Controlling a MiR robot or other automated mobile robots remotely.
•Using in medical and life critical situations.
•Using in potentially explosive environments.
•Using in hygiene zones.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 14
3.3 Mounting and powering up MiR AICamera
It is recommended to read through Suggested use on page11 before mounting
MiR AICamera.
Figure 3.2 identifies the key parts of the camera mount. There are two mounting plates: one
plate is mounted to the camera, and the other plate you must mount to the surface you want
the cameras to be fixed to. It is possible to adjust their orientations using the ball and socket
joint identified in Figure 3.2.
Figure 3.2. Parts of the AIcamera mount.
Pos. Description Pos. Description
1 Camera mounting holes 2 Wall mounting holes
3 Joint tightening knob 4 Ball and socket joint

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 15
To mount MiR AICamera follow these steps:
1. Place the camera mount in the position you want the MiR AI Camera to be mounted.
Make sure the mounting plate is placed flat against the surface.
The camera mount is adjustable, so you can always adjust the orientation
of the camera after fixing the camera mount.
2. Mark the position of the four mounting holes on the surface you want to mount the
camera to. Remove the camera mount.
3. Drill screw holes into the surface at the marked positions.Consider using wall plugs for a
more secure mounting.
4. Place the camera mount back in the desired position, so the mounting holes align with
the drill holes in the wall. Insert screws to fix the camera mount to the wall.
5. Remove the two bolt caps and washers from the mounting bolts on the camera, and fit
the camera bolts through the mounting holes.
6. Place the washers and bolt caps back on the bolts, and tighten the two caps to ensure
that the camera is fastened securely.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 16
7. Loosen the joint tightening knob, and adjust the angle of the camera so it is oriented
approximately in the correct direction.
In Connecting to MiR AICamera below, it is described how you access a
live-stream video to position the camera accurately.
8. Tighten the joint knob when you are satisfied with the position.
9. Plug in the power cable to turn on the AIcamera. It may take up to a minute for the
camera to turn on.The indicator light will light up in white when the camera is starting
up.
10. Once the light turns yellow, the camera is ready to be connected to a network. There are
two options for connecting MiR AI Camera to your MiR Fleet network:
a. Connect the camera to a nearby Ethernet port that is connected to the same
network as MiR Fleet.
b. Screw in the WiFi antenna, and continue to the next section for instructions on
connecting the camera to the network.
3.4 Connecting to MiR AICamera
It is possible to connect to the MiR AICamera directly, using an Ethernet cable or wirelessly
through WiFi.
If you want to see a live-stream video from the camera to ensure that it is
positioned correctly, you must first connect to the robot's WiFi. After step 4,
you can then choose to connect it to MiR Fleet through Ethernet.
Connecting through WiFi
If your camera is mounted in a position that does not enable you to connect it to the network
through Ethernet, the following steps describe how to connect through WiFi instead.
1. Turn on your MiR AICamera. If the WiFi antenna is mounted, MiR AICamera creates a
WiFi hotspot, and the indicator light changes to yellow.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 17
2. With your device, connect to the camera's WiFi. It is named in the format: MiR_AXXXX,
where XXXX is the last four digits in the camera's serial number. For the WiFi password,
see the MiR passwords document included with your camera.
If you cannot connect to MiR AI Camera, try to reset the camera by holding
down the Reset button for ten seconds.
3. Once connected to the WiFi, open a browser and go to www.mir.com.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 18
4. Select Stream to view a live-stream video from your camera. Use this to adjust the
position of the camera to make sure it is correctly oriented towards the area of interest.
If you just wanted to see the live-stream from the camera, you can now
connect the camera via Ethernet—see Connecting through Ethernet on
page20.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 19
5. Select Connection, select WiFi, and then select the network that your MiR Fleet is
connected to. Enter the WiFi password and username (if required) to connect the camera
to the network.
If you want to set a static IPfor your camera, select Use static IP.
6. When the camera is connected to the same network as MiR Fleet, the indicator light
changes to green. The AIcamera hotspot vanishes, and the camera is now available in
the MiR Fleet interface.
Check that MiR Fleet is connected to the camera by signing into MiR Fleet and going to
Setup > AI cameras. Your AI camera should appear under New cameras. It can take a little
time for MiR Fleet to detect the camera.
If your camera does not appear, select Scan for camera, and enter the
IPaddress of the camera.

3. Getting started
MiR AICamera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S. 20
Connecting through Ethernet
Connect MiR AICamera to the same network as your MiR Fleet using an Ethernet cable.
Check that MiR Fleet is connected to the camera by signing into MiR Fleet and going to
Setup > AI cameras. Your AI camera should appear under New cameras. It can take a little
time for MiR Fleet to detect the camera.
If your camera does not appear, select Scan for camera, and enter the
IPaddress of the camera.
Other manuals for AI Camera
1
Table of contents