NXP Semiconductors SLN-VIZNLC-IOT-UG User manual

SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
Rev. 0 — 20 February 2023 User guide
Document information
Information Content
Keywords Smart Lock, Smart Access, IoT
Abstract This document describes the low-cost vision solution, also called SLN-VIZNLC-IOT, and its
associated out of box features. The SLN-VIZNLC-IOT turnkey solution provides OEMs with a fully
integrated, self-contained, software, and hardware solution

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
1 Introduction
The SLN-VIZNLC-IOT development kit implements NXP Edge Ready turnkey solution for face recognition-
based access control, using an RGB+IR dual camera module. This kit includes the LPC845 low-power control,
i.MX RT106F runtime library, and pre-integrated machine learning face recognition algorithms, as well as all
required drivers for peripherals, such as memories, cameras, display, Bluetooth Low Energy (Bluetooth LE),
and Wi-Fi (optional). This cost-effective, easy-to-use solution facilitates the deployment of highly accurate face
recognition with robust liveness detection capability. By leveraging an MCU platform, this solution can deliver
the low cost and low power consumption required for battery-powered consumer smart locks, combined with the
quick inferencing, and short boot times required to deliver a great user experience.
Target applications:
•Smart door locks: For consumer and hospitality applications, including single family homes, multiple dwelling
units, and hotels.
•Access control: For office and industrial smart-building applications.
1.1 Processor overview
The i.MX RT106F is an Edge Ready member of the i.MX RT1060 family of crossover processors, targeting
low cost embedded face recognition applications. It features an advanced Arm Cortex-M7 core implementation
from NXP that operates at up to 600 MHz to provide high CPU performance and the best real-time responses.
This i.MX RT106F based solution enables system designers to add face recognition capabilities easily and
inexpensively to a wide variety of smart appliances, smart homes, and smart industrial devices.
The i.MX RT106F processor is licensed to run NXP i.MX RT run-time library for face recognition which may
include:
•Unified cross-platform framework.
•Camera drivers, image capture, and pre-processing.
•Face detection, tracking, alignment, recognition with quantified results and confidence measure, and liveness
detection.
•Display drivers, 2D graphics accelerator supported.
•Built-in security, bootloader, and application validation.
•All drivers including Bluetooth LE and Wi-Fi.
•USB Mass Storage Device (MSD) updates.
•Factory automation scripts.
•Supported by an MCUXpresso SDK, IDE, and configuration tools.
Note: The Wi-Fi feature is enabled in the second SW release.
In addition to the i.MX RT106F, the LPC845 is another Arm Cortex-M0+ core-based processor. The LPC845 is
a low-cost, 32-bit MCU operating at frequencies of up to 30 MHz and supports up to 64 kB of flash memory and
16 kB of SRAM. It features exceptional power efficiency in the low-current mode, and includes rich peripheral
complement I/O ports.
2 Recommended configuration
An up-to-date computer that can run MCUXpresso IDE version is required to modify and debug the SLN-
VIZNLC-IOT example projects (11.6.1 or newer).
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
2 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
Computer type OS version Terminal program
Apple MAC OS PuTTY
PC Windows 7/10/11 PuTTY/Tera Term
PC Linux PuTTY
Table 1. Recommended computer configuration
3 Hardware
The SLN-VIZNLC-IOT turnkey solution for face recognition comes with a cost and form-factor-optimized
hardware reference designs and access to full software source code. In addition to the i.MX RT106F and
LPC845 MCUs, rich peripherals are provided to help develop applications. Figure 1 shows the main hardware
resources of the board.
PIR
User
Button
LCD
IR+RGB
Dual Camera
USB
TypeC
LPC845
Wi-Fi M.2
Connector
RT106F
SDRAM
LCD
Connector
K32W061
PCB
Antenna
SPI Flash
RT106F
Reset
LPC845
Reset
RT/LPC/BT
Programming
Header
Speaker
Boot Mode
Jumper
Figure 1. SLN-VIZNLC-IOT components
For more information about the hardware design of the SLN-VIZNLC-IOT, see the SLN-VIZNLC-IOT Hardware
Developer Guide (document SLN-VIZNLC-IOT-HDG).
CAUTION: Depending on the mode of operation, the SLN-VIZNLC-IOT kit can emit highly concentrated white
or non-visible infrared light which can be hazardous to human eyes. Products which incorporate these devices
must follow the safety precautions given in IEC 60825-1 and IEC 62471.
3.1 MCU
In the SLN-VIZNLC-IOT design, the LPC845 manages the low-power control of the entire system and works as
the host MCU. The i.MX RT106F is used to run camera preview, display, and machine learning algorithms.
The power supply of the i.MX RT106F part is controlled by the LPC845. However, by connecting the J11 jumper,
an always-on power mode is enabled for easy debugging. See the box highlighted in green in Figure 6.
3.2 LCD
The SLN-VIZNLC-IOT kit, by default, uses a 2.4 inch TFT display (Rocktech RK024HH298) with 240 x 320
resolution, LED backlight, full viewing angle, and RGB interface.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
3 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
3.3 Speaker
A GSPK1345PN-1M8R1W-L80 enclosed 8 Ω 1.0 W speaker is embedded in the SLN-VIZNLC-IOT kit.
3.4 Camera module
The SLN-VIZNLC-IOT kit uses the GC0308 IR+RGB dual camera module by default. The GC0308 features 640
V x 480 H resolution with 1/6.5-inch optical format, and 4-transistor pixel structure for high image quality and low
noise variations. It delivers superior image quality by powerful on-chip design of a 10-bit ADC, and embedded
image signal processor. The two GC0308 sensors share a single CSI-DVP interface.
3.5 Wireless radios
Usage condition
The following information is provided per Article 10.8 of the Radio Equipment Directive 2014/53/EU:
•Frequency bands in which the equipment operates.
•The maximum RF power transmitted.
PN RF technology Frequency range Maximum
transmitted power
SLN-VIZNLC-IOT Bluetooth 2402-2480 MHz 10 dBm
Table 2. Bluetooth frequency and power
EUROPEAN DECLARATION of CONFORMITY (Simplified DoC per Article 10.9 of the Radio Equipment
Directive 2014/53/EU)
This apparatus, namely SLN-VIZNLC-IOT, conforms to the Radio Equipment Directive 2014/53/EU. For the full
EU Declaration of Conformity for this apparatus, see SLN-VIZNLC-IOT.
4 RT106F bootloader
The SLN-VIZNLC-IOT employs a multi-stage boot process to enhance the capabilities of the out-of-box
firmware (FW) to include additional functionality. For instance, the ability to flash new firmware images remotely
and without a debugging probe for the i.MX RT106F.
4.1 Normal boot
By default, if no boot flags are set during the boot phase, the Normal Boot mode is used. During Normal Boot,
the bootloader boots into the "main" out-of-box demo application, meaning the bootloader has jumped to the
flash address associated with the application.
4.2 Boot modes
The bootloader supports several different boot-up methods which augment the boot-up behavior. These
methods include Normal Boot mode (default) and MSD mode for drag-and-drop flashing of new firmware
images. The following sections describe the usage of each different Boot mode and how to enable them.
A high-level overview of the purpose of each of these features is discussed in the following sections. For
information regarding their usage, creating update payloads, and more, see SLN-VIZNLC-IOT Software
Developer Guide (document SLN-VIZNLC-IOT-SDG).
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
4 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
4.3 Mass Storage Device
The MSD feature allows the SLN-VIZNLC-IOT to receive firmware updates without a debugging probe like
a SEGGER J-Link. Instead, MSD uses USB to emulate an MSD interface like the one that is used for USB
flash drives. This feature can be especially useful for marketers or engineers in the field without access to a
dedicated debug probe tool. When the kit is powered on, hold down the MSD pushbutton (SW3) on the front of
the kit to activate MSD mode.
Figure 2. MSD pushbutton (SW3)
Once enabled, the kit enumerates as a USB Storage Device by the OS of your computer.
Figure 3. New USB drive for SLN-VIZNLC-IOT kit
To update the firmware image on your kit, drag and drop the new binary to the USB drive corresponding to
your kit. Assuming the binary is properly generated, the bootloader automatically updates the firmware on your
device. Flashing a new firmware image results in a pop-up window identical to the one used when copying files
to a real USB flash drive device.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
5 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
Figure 4. Copying new binary to the USB drive
Note:
•Keep the i.MX RT106F in always-on power mode, when using MSD.
•Only the main application can be updated using MSD. The bootloader cannot be updated using MSD and
requires the use of a SEGGER J-Link Debug Probe or the Factory Programming Flow. Instructions on MSD,
J-Link-based updates, and the Factory Programming Flow can be found in the SLN-VIZNLC-IOT Software
Developer Guide (document SLN-VIZNLC-IOT_SDG).
For more information regarding MSD mode and its usage, and instructions on generating FW binaries
compatible with MSD mode, see the SLN-VIZNLC-IOT Software Developer Guide (document SLN-VIZNLC-
IOT-SDG).
5 Out-of-box demo application
5.1 Overview
The SLN-VIZNLC-IOT supports Smart Lock (default) and Smart Access applications. These example
applications are built to showcase the complex machine vision, voice prompt, and graphical UI capabilities the
kit supports. They also provide a base software platform for rapid integration of unique customer applications
and requirements.
The Smart Lock application presents an example of a potential smart lock use case. Here, a smart lock device
provides custom user experiences using face recognition.
The Smart Access application presents an example of a potential smart access use case. Here, a smart
access device provides custom user experiences using face recognition.
The main difference between the two applications is the images used for face recognition. Face recognition
uses IR images for smart lock applications and RGB images for smart access applications.
If you want to build the smart access application, change the symbol definition from "SMART_LOCK_2D" to
"SMART_ACCESS_2D" in the project settings.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
6 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
Figure 5. How to build Smart Access application
5.2 Smart Lock
The following sections describe the out-of-box features of smart lock in default. It also applies to smart access
application, except for few GUI display.
5.2.1 Power on
Take the USB-A > USB-C cable provided inside the kit. Plug the USB-A end into the USB port on your computer
and the USB-C end into the USB port of the kit.
Figure 6. Power on the SLN-VIZNLC-IOT kit
Note: LPC845 controls the power supply of i.MX RT106F and K32W061. However, an always-on power mode
is supported for easy debugging by connecting J11 jumper as shown in the box highlighted in green in Figure 6.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
7 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
When powered on, the onboard TFT screen streams video directly from the RGB camera alongside a GUI
overlay, providing information such as:
•Locked/Unlocked status whether a face is recognized.
•Current app type (Smart Lock/Access).
•ON/OFF status of Wi-Fi and Bluetooth LE.
•Number of registered users.
Figure 7. The screen with video preview
When J11 is not connected and no PIR event is triggered after a 30 s timeout, the entire system enters the low-
power mode. Now, the screen is off and the power supply of i.MX RT106F is cut off. When new PIR event is
triggered, the system wakes up immediately.
When J11 is connected, the screen is always on. The i.MX RT106F is powered on all the time, and face
recognition does not stop working.
5.2.2 Register a face
To begin registering a new face, press the Manual Registration button (SW4) on the kit or use shell command
(add username). For shell commands, see the description later.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
8 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
Figure 8. Manual registration button (SW4)
Once pressed, a message indicating registration is taking place pops up at the top of the screen. The speaker
plays an audio message confirming that the registration has started.
Figure 9. Registering screen
Figure 9 shows that while registration is taking place, the GUI displays:
•A “Registering” message.
•Face alignment guidelines.
•A countdown timer bar.
The guidelines help you align your face correctly during registration, and the countdown timer indicates how
much longer it takes until the registration procedure times out and fails.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
9 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG
SLN-VIZNLC-IOT User Guide
Figure 10. Registration Timeout
As an additional measure to aid in registering your face, the kit even plays a warning audio prompt, saying
"Look at Camera," until your face is properly pointed toward the camera, if too much of the side of your face is
exposed during the registration process.
Should your face fail to register, simply press the SW4 button again to retry.
Once your face is successfully registered, the kit displays the message "Registration Successful", and a unique
identifier is assigned to your face. The number of registered users is also updated automatically.
Figure 11. Registration Successful
5.2.3 Recognize a face
Once registered, the kit displays the message "Recognition Successful" and plays a corresponding audio file
when a recognized face is detected.
SLN-VIZNLC-IOT-UG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 20 February 2023
10 / 27