NXP Semiconductors SLN-VIZNLC-IOT User manual

SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Rev. 0 — 10 March 2023 User guide
Document information
Information Content
Keywords SLN-VIZNLC-IOT-GSG, Smart Lock, IoT
Abstract This guide walks you through the process of getting up and running with your SLN-VIZNLC-IOT
board

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
1 Plug it in
Welcome to the SLN-VIZNLC-IOT Getting Started Guide.
This guide walks you through the process of getting up and running with your SLN-VIZNLC-IOT board. This
guide takes you through the steps of unboxing your kit, running the out-of-box smart lock demo application, as
well as downloading, modifying, and debugging the firmware source code for your kit.
Before we begin, make sure to check the box your kit came in for any marks or other damages, and should you
find anything, be sure to report it to your local NXP representative.
2 Smart Lock
2.1 Unbox
The box your kit arrives in should contain a few different things, including:
•A packing list paper
•Fully assembled VIZNLC kit
•USB-A > USB-C Cable (x1)
•Jumpers (x2)
Figure 1. Items inside the box
2.2 Power on
Before we begin, put a jumper on J3 (pin 2 and 3 on the left side) as shown in the yellow highlighted box in
Figure 35. Then remove the protective film from the RGB and IR camera as shown in Figure 2. This protective
film is used to protect the lens of each camera during transport. However, failure to remove may cause the
image capture not to work correctly.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
2 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 2. Protective film covering the two cameras: RGB and IR
To get started, follow the steps below:
1. Take the USB-A > USB-C cable provided inside the kit. Plug the USB-A end into USB port on your computer
and the USB-C end into the USB port of the kit. The USB connector of the kit supplies power to the board
and supports data transfer capabilities for Mass Storage Device (MSD) programming and virtual serial port
communication.
Figure 3. Power on the SLN-VIZNLC-IOT kit
2. Once the application is ready, your computer detects a new USB COM device, and automatically installs the
required drivers. A message confirms when the installation is completed.
3. After powering on, the onboard TFT screen streams video directly from the RGB camera alongside a GUI
overlay, providing information such as:
•Locked/Unlocked status whether a face is recognized
•Current App Type (Smart Lock/Access)
•ON/OFF status of Wi-Fi and Bluetooth LE
•Number of registered users
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
3 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 4. The screen with video preview
2.3 Register and recognize a face
Let us get started with a demonstration of the out-of-box features of this application.
To use the recognition feature of the SLN-VIZNLC-IOT, a face must be registered in the local face database of
the kit. To begin registering a new face, press the Manual Registration button (SW4) on the kit.
Figure 5. Manual Registration button (SW4)
Once pressed, a message indicating registration is taking place pops up at the top of the screen. The speaker
plays an audio message confirming that the registration has started.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
4 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 6. Registering screen
Figure 6 shows that while registration is taking place, the GUI displays:
•A “Registering” message
•Face alignment guidelines
•A countdown timer bar
The guidelines help you align your face correctly during registration, and the countdown timer bar indicates how
much longer it takes until the registration process times out and fails.
Figure 7. Registration Timeout
As an additional measure to help with registering your face, the kit even plays a warning audio prompt if too
much of the side of your face is exposed during the registration process, saying “Look at Camera”. The kit plays
this warning audio until your face is properly pointed toward the camera.
Should your face fails to register, simply press the SW4 button again to retry.
Once your face is successfully registered, the kit displays the message "Registration Successful", and a unique
identifier is assigned to your face. The number of registered users is also updated automatically.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
5 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 8. Registration Successful
Once registered, the kit displays the message “Recognition Successful” and plays a corresponding audio file
when a recognized face is detected.
Figure 9. Recognition Successful
2.4 Liveness detection and anti-spoofing
The Liveness detection and anti-spoofing features of the SLN-VIZNLC-IOT are switched ON by default.
Therefore, enabling the system to distinguish between your actual face and a printout or phone display image of
your face.
This feature helps to defend against some of the most frequent face recognition "spoof" attacks.
One such spoof attack is when a malicious actor uses a picture of someone to gain access to their face-
protected materials. The malicious actor does this spoof by requiring an actual face of the user to unlock the
system rather than simply a picture of their face.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
6 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 10. Printed picture and phone display spoof attack
As shown in Figure 10 using a phone display or a printed picture of a face does not trigger the “Recognition
Successful” message.
2.5 Connect to serial CLI
The Smart Lock software installed by default on the SLN-VIZNLC-IOT kit provides a convenient serial-based
CLI. This CLI is used to retrieve useful runtime data and configure various application settings. Connecting to
the serial-based CLI of the kit can be done using a serial terminal emulator program like PuTTY or Tera Term.
Before we begin, make sure that you have a serial terminal emulator like PuTTY or Tera Term installed on your
computer.
Figure 11. PuTTY and Tera Term
Note: If you are using a Windows machine, we recommend Tera Term for its ability to discover connected COM
devices automatically. Additionally, if there is a disconnect, Tera Term reconnects to a device.
Establish a serial connection with your device by entering the serial settings as shown in Figure 12. Ensure to
replace the COM port setting with the COM port associated with your kit.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
7 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 12. Serial port setup
Once connected, a blank terminal screen appears that echoes back any characters that you type. Typing the
help command prints a list of all available commands and a brief description of their functionalities.
Figure 13. Help menu
3 Build and run
3.1 Getting MCUXpresso IDE
The MCUXpresso IDE brings developers an easy-to-use eclipse-based development environment for NXP
MCUs based on Arm Cortex-M cores, including its general-purpose crossover and wireless-enabled MCUs.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
8 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
The MCUXpresso IDE offers advanced editing, compiling, and debugging features. It also offers MCU-specific
debugging views, code trace and profiling, multicore debugging, and integrated configuration tools.
To download MCUXpresso IDE, follow the steps below:
1. Go to MCUXpresso IDE homepage and click the Downloads button.
Figure 14. MCUXpresso IDE homepage
2. The Downloads page appears. Next, click the Download button.
Figure 15. Downloads page
3. The Sign In page appears. Login with your credentials.
Figure 16. Sign In page
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
9 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
4. Once you have signed in, select Version 11.6.1 or newer from the list.
Figure 17. Select Version page
5. The Software Terms and Conditions page appears. Read the conditions and click the I Agree button.
Figure 18. Software terms and conditions page
6. The Product Download page appears from where you can download the MCUXpresso IDE. Download the
appropriate version for your system.
Figure 19. Product Download page
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
10 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
7. Open the downloaded application and follow the instructions found in the installer.
3.2 Installing the SDK
MCUXpresso SDK is a comprehensive software enablement package designed to simplify and accelerate
application development with NXP microcontrollers based on Arm Cortex-M cores. The MCUXpresso SDK
includes production-grade software with integrated RTOS (optional), stacks and middleware, reference
software, and more. It is available in custom downloads based on user selections of MCU, evaluation board,
and optional software components.
Before building the SLN-VIZNLC-IOT SDK example projects, the target SDKs (EVK-MIMXRT1060 and
K32W061DK6) must be imported into MCUXpresso IDE. However, no need to import LPC845 as it is already
preinstalled in the IDE.
To install MCUXpresso SDK, follow the steps below:
1. Launch the MCUXpresso SDK. The MCUXpresso SDK Builder welcome screen appears when the
application is launched, as shown in Figure 20.
Figure 20. SDK Builder welcome screen
2. Click Select Development Board. After signing in, Select Development Board page appears.
Figure 21. Select Development Board page
3. Search 1060 and select EVK-MIMXRT1060 board. Then click Build MCUXpresso SDK V2.12.1.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
11 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 22. Select EVK-MIMXRT1060 SDK
4. To build SDK, select your Host OS and Toolchain / IDE, and all other necessary SDK components. Then
click Download SDK button.
Figure 23. Build SDK and download
5. Dashboard page shows the built SDK. Click Download to download the SDK archive to your PC.
Figure 24. Downloading SDK archive
6. To install, drag and drop the SDK archive file to the IDE Installed SDKs view.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
12 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 25. Install SDK
7. Download and install K32W061DK6 SDK V2.6.205 in the same way.
3.3 Downloading SLN-VIZNLC-IOT projects
The SLN-VIZNLC-IOT out-of-box projects are published under the NXP GitHub page. You can either clone the
repository using Git or download a zip folder containing the source code from mcu-viznlc.
Figure 26. SLN-VIZNLC-IOT GitHub repository
Note: If downloading a zipped archive, ensure to unzip this folder before proceeding to the next step.
3.4 Importing SLN-VIZNLC-IOT projects
To import the projects we downloaded into the IDE, follow the steps below:
1. Click Import project(s) from file system..., then Browse your project path where you unzipped the
sln_viznlc_iot source code, and click Next.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
13 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 27. Import project(s) from file system
2. Import the files specified in Figure 28 from the displayed screen.
Figure 28. Import project(s) from file system
3. Once successfully imported, you should see projects open in the Project Explorer pane on the left side of
the IDE.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
14 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 29. SLN-VIZNLC-IOT projects
3.5 Building the SLN-VIZNLC-IOT projects
The SLN-VIZNLC-IOT SDK allows you to build the smart lock application directly. The application is made up of
four subprojects:
•The lpc845_low_power_control project manages the power control of the system. LPC845 works as the
host MCU. PIR sensor activates the host MCU and powers the RT106F part.
•The k32w_ble project implements the feature of Bluetooth LE module (UART over Bluetooth LE).
•The rt106f_bootloader and rt106f_smart_lock projects are the out-of-box applications that we
used earlier to demonstrate the SLN-VIZNLC-IOT face recognition capabilities. The bootloader manages to
jump into the smart lock application.
These above applications are flashed onto your SLN-VIZNLC-IOT kit by default.
In the Project Explorer pane, select the project file and navigate to the QuickStart Panel. To start the
compilation and linking of this application, click the Build option.
Figure 30. How to build
Building may take a few minutes to complete, but do not worry, as it is normal for applications of this size. Once
finished, a message as shown in Figure 31 appears at the bottom of the IDE. Consider rt106f_smart_lock
project as an example.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
15 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 31. Build message
3.6 Flashing and debugging SLN-VIZNLC-IOT projects
With the SLN-VIZNLC-IOT application project compiled, it is now time to program associated binaries of this
project into flash.
Flashing and debugging the SLN-VIZNLC-IOT kit requires a SEGGER J-Link with a 9-pin Cortex-M adapter and
V7.60d or newer version of the J-Link Software and Documentation Pack. This new version of J-Link can be
found on the SEGGER website.
Note: There is a problem to program/debug RT106F using the default J-Link V7.70d in MCUXpresso IDE
V11.6.1. J-Link software must be updated, and J-link software V7.60d has been verified.
Figure 32. J-Link 9-pin adapter
Note: The SLN-VIZNLC-IOT kit has one SWD interface connector (J2), which supports programming and
debugging the RT106F, LPC845, and K32W061 via a SEGGER J-Link debug probe. To select which MCU to
program/debug, the J4, J5, and J6 connectors, each must be set to the position indicated in Figure 33.
Figure 33. Switch debug interface
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
16 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
To flash the kit, follow the steps below:
1. Select the programming MCU on J4, J5, and J6 connectors.
2. Attach your J-Link debug probe into the J2 header as shown in Figure 34 and connect your J-Link to your
computer via USB.
Figure 34. Attach J-Link debugger
3. Next, provide power to the kit by plugging a USB-C cable into the USB-C port of the kit and plug the other
end into your laptop/PC.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
17 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 35. Power on SLN-VIZNLC-IOT kit
Note: LPC845 controls the power supply of RT106F and K32W061. Therefore, during the debug stage, we
can bypass it by connecting J11 jumper as shown in the green highlighted box in Figure 35.
4. Select the MCU-related project in the Project Explorer pane. Consider lpc845_low_power_control as
an example below.
5. To start the process of loading the binary into flash and begin debugging, choose the Debug option in the
QuickStart Panel.
Figure 36. Debug your project
6. Select the J-Link probe that is connected to your kit and click the OK button. Flashing tool is launched.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
18 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 37. Probes discovered
7. Now, proceed to flash the binary associated with the currently selected project.
Figure 38. Flash downloading
8. After successfully debugging the application, the program breaks at the project main to start the GDB debug
process.
Figure 39. Start to debug project
9. To suspend the debug session, click the pause/play button on the top of the screen.
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
19 / 23

NXP Semiconductors SLN-VIZNLC-IOT-GSG
SLN-VIZNLC-IOT Getting Started Guide
Figure 40. Debugging project
Note: If you want to debug rt106f_smart_lock project, ensure that you have flashed the bootloader.
3.7 Additional resources
If you have made it to this section, you have successfully finished the SLN-VIZNLC-IOT getting started
experience.
For a comprehensive understanding of all the Out-of-Box Experience (OoBE) features, including the additional
demo applications that come flashed with the kit, see SLN-VIZNLC-IOT User Guide.
To start building your own applications and learn more about the software architecture, available developer
tools, and more, head over to the SLN-VIZNLC-IOT Software Developer Guide.
4 Acronyms
Table 1 lists the acronyms used in this document.
Acronym Definition
TFT Thin Film Transistor
HAL Hardware Abstraction Layer
OoBE Out-of-Box Experience
MSD Mass Storage Device
VIZNLC Vision Low Cost
FW Firmware
SW Software
HW Hardware
PIR Passive InfraRed
IR InfraRed
GUI Graphical User Interface
Table 1. Acronyms
SLN-VIZNLC-IOT-GSG All information provided in this document is subject to legal disclaimers. © 2023 NXP B.V. All rights reserved.
User guide Rev. 0 — 10 March 2023
20 / 23