Renesas RX671 User manual

Application Note
R01AN6010EJ0100 Rev.1.00 Page
1
of 31
Aug.31.21
RX671 Group
Voice Recognition, Touch and Cloud Solution Using Renesas Starter Kit+ for
RX671
Introduction
The Renesas Starter Kit+ for RX671 is the best kit for developing IoT applications equipped with Voice
recognition, Capacitive Touch Interface.
This application note shows an HMI solution that realizes voice recognition, touch function, and LCD by
PMOD-LCD module using the Renesas Starter Kit+ for RX671. And also introduces an Amazon Web
Services (hereinafter referred to as AWS) cloud solution using the PMOD-Wi-Fi module (sold separately).
An executable file (trial version) that can be downloaded and experienced on the Renesas Starter Kit+ for
RX671 is attached to this application note. There are two trial versions, AmiVoice® version and Voice
Trigger version. The trial versions of AmiVoice® and Voice Trigger can run for only 5 minutes after a
reset. Please reset every 5 minutes.
If you would like to obtain the sample source code, please contact Renesas dealer or Renesas sales
representative.
The demo software described in this application note is configured using the following libraries.
•Voice recognition 1: Voice recognition middleware AmiVoice®, hereinafter referred to as “AmiVoice®”.
•Voice recognition 2: Voice recognition middleware Voice Trigger, hereinafter referred to as “Voice
Trigger”.
•Noise reduction: “Zoom Voice Software”, hereinafter referred to as “Zoom Voice”.
•OS: Amazon FreeRTOS (202012.00), hereinafter referred to as “FreeRTOS”.
Target Device
RX671 Group
Operation Check Tool
Renesas Starter Kit+ for RX671

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
2
of 31
Aug.31.21
Contents
1. Overview of the System...........................................................................................................4
1.1 System Overview Diagram......................................................................................................................4
1.2 Demo Overview.......................................................................................................................................4
1.2.1 Voice and Touch Interface (Standalone version)..................................................................................4
1.2.2 Voice and Touch Interface (Cloud version)...........................................................................................4
2. Hardware Preparation..............................................................................................................5
2.1 Constitution of the Hardware...................................................................................................................5
2.1.1 Constitution of the Standalone Version.................................................................................................5
2.1.2 Constitution of the Cloud Version..........................................................................................................5
2.2 About Renesas Starter Kit Board Modification (cloud version only) .......................................................6
2.2.1 PMOD2 Connection Destination ...........................................................................................................6
2.2.2 Board Modification Points......................................................................................................................7
2.2.3 Mounting Locations ...............................................................................................................................8
2.3 Board Connection....................................................................................................................................9
3. Software Preparation.............................................................................................................10
3.1 Selection from 2 Types of Programs.....................................................................................................10
3.2 Programming the Selected Programs to RX671...................................................................................10
3.3 Preparation of AWS (Cloud version only) .............................................................................................12
3.4 Setting for Certification (Cloud version only).........................................................................................12
4. Starting the Demo for Standalone Version.............................................................................16
4.1 Renesas Starter Kit+ for RX671 Power On to Voice Command Standby Screen................................16
4.2 Selecting the Language Mode of Renesas Starter Kit+ for RX671.......................................................17
4.2.1 Acceptable Voice Commands.............................................................................................................17
4.3Possible Functions on the Standby Screen After the Board is Turned On...........................................18
4.4 Possible Functions on Air Conditioner Mode ........................................................................................18
4.4.1 Change the Set Temperature..............................................................................................................18
4.4.2 Switching Between Heating and Cooling ............................................................................................19
4.4.3 Power Off of Air Conditioner................................................................................................................19
4.5 Parameter Setting Function of Voice Recognition Engine....................................................................20
4.5.1 Types of Parameters that can be Set..................................................................................................20
4.5.2 How to Start Parameter Setting Screen..............................................................................................21
5. Starting the Demo for Cloud Version .....................................................................................22
5.1 Operation for Touch Interface and Voice Interface ...............................................................................22
5.2 shadow ..................................................................................................................................................22
5.3 Device Properties..................................................................................................................................23

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
3
of 31
Aug.31.21
5.4 Operating Procedure of the shadow......................................................................................................23
5.5 Data Confirmation by AWS ...................................................................................................................25
6. Confirmed Conditions of the Operation..................................................................................26
6.1 Confirmed Conditions of the Operation.................................................................................................26
7. Software................................................................................................................................28
7.1 Software Hierarchy................................................................................................................................28
7.2 Flowchart...............................................................................................................................................28
8. Reference Documents...........................................................................................................29
9. Notice for Board Modification.................................................................................................30
Revision History............................................................................................................................31
•AmiVoice® is a product of Advanced Media, Inc. and is a registered trademark in Japan or other
countries.
•Voice Trigger is a product of Toshiba Digital Solutions Corporation.
•Zoom Voice is a product of Techno Mathematical Co., Ltd..
•Development using AmiVoice® and Zoom Voice requires contract separately with each developer.
•AWS ™ is a trademark of Amazon.com, Inc. or its affiliates. (https://aws.amazon.com/trademark-
guidelines/)
•FreeRTOS ™ is a trademark of Amazon Web Services, Inc. (https://freertos.org/copyright.html)
•GitHub® is a registered trademark of GitHub, Inc. (https://github.com/logos)
•Pmod is a trademark of Digilent Inc. (https://store.digilentinc.com/)

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
4
of 31
Aug.31.21
1. Overview of the System
1.1 System Overview Diagram
Figure 1-1 shows System Overview Diagram.
In this demo, the microphones installed in the Renesas Starter Kit+ for RX671 are used for voice recognition.
The LCD display is realized by connecting the PMOD-LCD module included with the Renesas Starter Kit+ for
RX671 to PMOD1. Connection to the AWS is realized by connecting the separately sold Wi-Fi Pmod
Expansion Board (RTK00WFMX0B00000BE) (hereinafter referred to as Wi-Fi module) to PMOD2.
Figure 1-1 System Overview Diagram
1.2 Demo Overview
This demo software provides two types of demos that assume a remote-control function for air conditioner
control.
1.2.1 Voice and Touch Interface (Standalone Version)
This demo works with the Renesas Starter Kit+ for RX671 and an LCD module. You can operate the remote
control by voice or touch. You can also check the CPU resource usage. No Wi-Fi module is required as it
does not connect to the cloud. Hereafter, this demo will be referred to as the standalone version.
1.2.2 Voice and Touch Interface (Cloud Version)
It connects to the cloud (AWS) via a Wi-Fi module and enables remote control. In addition to the operation of
the standalone version, you can check the set temperature and change the set temperature in operation with
AWS. This demo uses a Wi-Fi module (sold separately). Hereafter, this demo will be referred to as the cloud
version.
Stand alone Demo
Cloud Demo
LCD Module
PMOD1
I/F SPI
UART
GPIO
RL78
USB I/F
MEMS
MIC(L) MEMS MIC(R)
UART
UART
PMOD2
I/F Wi-Fi
Module
CTSU
-
+
Setting
-A/C mode
-Temp.
-LCD on/off
-LED
Info.
Temp.
AWS Cloud
IoT Core
IoT MQTT
protocol
IoT
shadow
Renesas Starter Kit+ for RX671
RX671
I2S

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
5
of 31
Aug.31.21
2. Hardware Preparation
2.1 Constitution of the Hardware
Table 2.1 shows hardware used in this demo.
Table 2.1 Hardware List
Item
Provider
Description
(1) Renesas Starter Kit+ for RX671
Renesas Electronics Corporation
Evaluation board equipped with
RX671
(2) Pmod LCD module
Renesas Electronics Corporation
PMOD-LCD module included in the
Renesas Starter Kit+ for RX671
(3) E2 emulator Lite
Renesas Electronics Corporation
On-chip debugging emulator and
flash programmer
(4) PC
Windows 10
Recommended OS
Google Chrome
Browser to use
(5) Wi-Fi Pmod Expand Board
Renesas Electronics Corporation
Wi-Fi module
(6) Wi-Fi router
－
Wireless LAN standard:
IEEE 802.11b / g / n (2.4GHz)
Encryption method: ES
2.1.1 Constitution of the Standalone Version
In the standalone version, use items (1) to (4) in Table 2.1 Hardware List.
2.1.2 Constitution of the Cloud Version
In the cloud version, all of Table 2.1 Hardware List (1) to (6) are used.
In the cloud version, it is necessary to modify the Renesas Starter Kit+ for RX671.
Please refer to "2.2 About Renesas Starter Kit Board Modification (cloud version only)" for the modification
method.

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
6
of 31
Aug.31.21
2.2 About Renesas Starter Kit Board Modification (cloud version only)
In the cloud version, it is necessary to modify the Renesas Starter Kit+ for RX671 board to connect the Wi-Fi
module to PMOD2. The Wi-Fi module cannot be connected to PMOD2 in the initial state at the time of
product shipment. This modification is not required for the standalone version.
2.2.1 PMOD2 Connection Destination
In contrast to the table in "Table 5.7 Pmod ™ Connector PMOD2" in the Renesas Starter Kit+ for
RX671 User's Manual, the terminals used to connect the Wi-Fi module this time are shown in red in
Table 2.2.
Table 2.2 List of PMOD2 Connection Destinations
Pin
Pmod™ Interface
MCU
Type 2A (SPI)
Type 3A (UART)
Type 6A (I2C)
Port
Pin No.
1
CS
CTS/GPIO
INT
PJ5/CTS2#/IRQ13
11
2
MOSI
TXD
RESET
P13/TXD2/SMOSI2*2
44
P51*2
55
3
MISO
RXD
SCL
P12/RXD2/SMISO2/SSCL2*2
45
4
SCK
RTS/GPIO
SDA
P51/SCK2*2
55
P13/SSDA2*2
44
5
GND
GND
GND
-
-
6
3V3*1
3V3*1
3V3/5V*1
-
-
7
GPIO/INT
GPIO/INT
GPIO
P82/IRQ2
63
8
GPIO/RESET
GPIO/RESET
GPIO
P90
131
9
GPIO/CS2
GPIO
GPIO
P32/TXD0*2 *3
27
10
GPIO/CS3
GPIO
GPIO
P33/RXD0*2 *3
26
11
GND
GND
GND
-
-
12
3V3*1
3V3*1
3V3/5V*1
-
-
Note: The table above is from Renesas Starter Kit+ for RX671 User's Manual Table 5.7: Pmod ™ Connector
PMOD2

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
7
of 31
Aug.31.21
2.2.2 Board Modification Points
Select the connection in the red frame in Table 2.3. Mount the following jumper header pins and remove the
resistors.
•P13: J18, J17 jumper header pin mounting (J18 Pin2-3, J17 Pin1-2 short), R114 removal
•P12: J21 jumper header pin mounting (J21 Pin2-3 short), R152 removal
•P33: J22 jumper header pin mounting (J22 Pin2-3 short), R189 removal
•P32: J23 jumper header pin mounting (J23 Pin2-3 short), R208 removal
•P52: J19 jumper header pin mounting (J19 Pin1-2 short), R225 removal
Table 2.3 PMOD2 Option Link
Signal
name
MCU
MCU Peripheral function selection
Select connection destination
Pin
Port
Signal
Implementation
Non
Implementa
tion
Interface /
Function
Implementation
Non
Implementation
P13
44
P13
E2P-SDA
R114 or J18.Pin1-2,
R115
-
U9.5
-
-
JA1-SDA
R114 or J18.Pin1-2,
R116
-
JA1.25
-
-
PMOD2-
IO1_MOSI_TXD
J18.Pin2-3, J17.Pin1-2
R114
PMOD2.2
R326, J19.Pin1-2
R225, R222
PMOD2-SDA
J18.Pin2-3, J17.Pin2-3
R114
PMOD2.4
J20.Short, J19.Pin2-3
R225, R222
P12
45
P12
E2P-SCL
R152 or J21.Pin1-2,
R153
-
U9.6
-
-
JA1-SCL
R152 or J21.Pin1-2,
R154
-
JA1.26
-
-
PMOD2-
IO2_MISO_RXD_SCL
J21.Pin2-3
R152
PMOD2.3
-
-
P33
26
P33
CAN-RX
R189 or J22.Pin1-2,
R188
R190
U12.4
-
-
JA5-CAN1RX
R189 or J22.Pin1-2,
R190
R188
JA5.6
-
-
PMOD2-
IO7_CS2_WIFIRXD
J22.Pin2-3
R189
PMOD2.10
-
-
P32
27
P32
CAN-TX
R208 or J23.Pin1-2,
R207
R209
U12.3
-
-
JA5-CAN1TX
R208 or J23.Pin1-2,
R209
R207
JA5.5
-
-
PMOD2-
IO6_CS1_WIFITXD
J23.Pin2-3
R208
PMOD2.9
-
-
P51
55
P51
PMOD2-
IO3_SCK_RTS
J19.Pin1-2
R225, R222
PMOD2.4
-
J20.Open
PMOD2-RESET0
J19.Pin2-3
R225, R222
PMOD2.2
R326
-
JA3-WRHn
R225
J19, R222
JA3.47
R247
R248
JA3-WAIT
R222
R225, J19
JA3.45
R244
R243
PMOD2-
IO4_INT1_
WIFIWKUP
63
P82
PMOD2-
IO4_INT1_WIFIWKUP
-
-
PMOD2.7
-
-
PMOD2-
IO5_RESET
1_WIFIMDR
ES
131
P90
PMOD2-
IO5_RESET1_WIFIM
DRES
-
-
PMOD2.8
-
-
PMOD2-
IO0_CS0_IN
T0
11
PJ5
PMOD2-
IO0_CS0_INT0
-
-
PMOD2.1
-
-
Note: The table above is from Renesas Starter Kit + for RX671 User's Manual Table 6 21: PMOD2 Option
Link (1). Blue letters indicate the initial state at the time of shipment.

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
8
of 31
Aug.31.21
2.2.3 Mounting Locations
The mounting locations of each component are shown below.
Figure 2-1 List of Mounting Locations (1/2)
Figure 2-2 List of Mounting Locations (2/2)
Note: The figure above is from Renesas Starter Kit+ for RX671 User's Manual 3.3 Parts Layout

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
9
of 31
Aug.31.21
2.3 Board Connection
Shows the connection form of the board. Figure 2-3 is a photo of the board connection when using the cloud
version. Blue indicates connections and components used for both the standalone and cloud versions, and
yellow indicates connections and components used only for the cloud version.
Figure 2-3 Hardware Connection
PMOD1
LCD
PMOD2
Wi-Fi
USB for
terminal
Connected
to PC
Power
supply
E2 emulator
Lite
Connecting
PC
(From above)
SW1: Authentication information setting
SW2: Standalone / Cloud switching
SW3: Language switching
Slider
Button2
2

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
10
of 31
Aug.31.21
3. Software Preparation
3.1 Selection from 2 Types of Programs
This application note includes two programs (mot files) that use different voice recognition middleware.
Specifications other than voice recognition middleware are the same. Please select one of the mot files.
r01an6010_rx671_AV.mot
AmiVoice® and Zoom Voice
r01an6010_rx671_VT.mot
Voice Trigger
3.2 Programming the Selected Programs to RX671
Write the mot file via E2 emulator Lite using the Renesas Flash Programmer (hereinafter referred to as
RFP). The RFP version is V3.08.03.
In the RFP, select File ➡New Project
Figure 3-1 Create a New Project
Select RX67x for the microcontroller. Enter other required information and click Connect.
Figure 3-2 Connect
When the Authentication Code screen appears, just click OK.
Figure 3-3 Authentication Code Registration
Specify the downloaded mot file as the program file and click Start.
your project name
your working folder name

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
11
of 31
Aug.31.21
Figure 3-4 Starting the Programming
When the Authentication Code confirmation screen appears, just click OK.
Figure 3-5 Certification Code Registration
If OK is displayed, programming is complete.
Figure 3-6 Completion Confirmation
The standalone version is ready to work. The cloud version also requires the following settings.
demo program name

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
12
of 31
Aug.31.21
3.3 Preparation of AWS (Cloud version only)
When using the cloud version, please refer to the tutorial below to set up AWS.
·Register the device with AWS IoT
Japanese version: Register your device with AWS IoT - renesas/amazon-freertos Wiki - GitHub
English version: https://github.com/renesas/amazon-freertos/wiki/Register-device-to-AWS-IoT
Note: Go to "Check AWS IoT Endpoints".
3.4 Setting for Certification (Cloud version only)
In the cloud version, the SSID / password of the Wi-Fi access point to connect to and the client certificate /
private key of the iotthing downloaded in "3.3 Preparation of AWS (Cloud version only)", the endpoint, and
the information of the aws iotthingname are set using Tera Term. Table 3.1 shows the Tera Term settings.
Table 3.1 Tera Term Settings
Item
Setting
Baud rate
115200
Data length
8
Parity
none
Stop bits
1
Flow control
none
line feed code：Receive
LF
line feed code：Transmit
CR+LF
Follow the steps below to proceed with the settings.
1. Put Renesas Starter Kit+ for RX671 in certification information setting mode.
By resetting (power on) the Renesas Starter Kit+ for RX671 while pressing SW1, you will be in the mode to
set new certification information. When the certification information setting mode is entered, the following
character string is displayed in Tera Term and the status is waiting for command input.
Note: SW1 should be held down for about 1 second after resetting (power on).
RX671 Renesas Starter Kit
$
Figure 3-7 Certification Information Setting Mode
2. Enter the SSID of the access point to connect.
Enter “codeflash write wifissid <Wi-Fi SSID>”and press the enter key to set the SSID information. If set
successfully, you will see “stored data into codeflash correctly.”.
RX671 Renesas Starter Kit
$ codeflash write wifissid xxxxxx
stored data into codeflash correctly.
Figure 3-8 Set the Wi-Fi SSID Information

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
13
of 31
Aug.31.21
3. Enter the password of the access point to connect to.
Enter “codeflash write wifipass <Wi-Fi PASSWORD>”and press the enter key to set the Wi-Fi password
information. If set successfully, you will see “stored data into codeflash correctly.”.
$ codeflash write wifipass xxxxxx
stored data into codeflash correctly.
Figure 3-9 Entry the Wi-Fi Password
4. Enter the client private key information.
Enter “codeflash write aws clientprivatekey”and press the enter key, to waiting status for the private key to
be entered.
Open the client private key (xxxxxxxx-private.pem.key) generated by AWS IoT Core in "4.1 AWS
Preparation" with a text editor and copy and paste it into Tera Term.
If set successfully, you will see “stored data into codeflash correctly.”.
$ codeflash write aws clientprivatekey
-----BEGIN RSA PRIVATE KEY-----
MIIEogIBAAKCAQEAzhY82YODydQYFH/yFZONXFYMNJ86US+Ph+snfsinjFFU3kOp
:
: (omitted)
:
5M9Nxhh8FDzNJibzbLSZQHJNgEu9nufrOkLLxv/84heYH/W/Ako=
-----END RSA PRIVATE KEY-----
stored data into codeflash correctly.
Figure 3-10 Entry the Private Key
5. Enter the client certificate information.
Enter “codeflash write aws clientcertificate”and press the enter key to wait for the certificate to be entered.
Open the client certificate (xxxxxxxx-certificate.pem.crt) generated by AWS IoT Core in "4.1 AWS
Preparation" with a text editor and copy and paste it into Tera Term.
If set successfully, you will see “stored data into codeflash correctly.”.
$ codeflash write aws clientcertificate
-----BEGIN CERTIFICATE-----
MIIDWTCCAkGgAwIBAgIUWNAUkpzF4GO909IxarCG1nLaXO8wDQYJKoZIhvcNAQEL
:
: (omitted)
:
UB2bnt0RxcqXtoihQ2KgWWWW699CWKt4EyPoCgxuQ04P4pzlmF60BbESpUfm
-----END CERTIFICATE-----
stored data into codeflash correctly.
Figure 3-11 Entry of the Client Certification
6. Enter the IoT endpoint information.
Enter “codeflash write aws mqttbrokerendpoint <mqtt_broker_endpoint>”and press the enter key to set the
IoT endpoint information. <mqtt_broker_endpoint> describes the endpoint confirmed in "4.1 AWS
Preparation".
If set successfully, you will see “stored data into codeflash correctly.”.
$ codeflash write aws mqttbrokerendpoint xxxxxx-ats.iot.ap-northeast-1.amazonaws.com
stored data into codeflash correctly.
Figure 3-12 Entry the IoT Endpoint Information

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
14
of 31
Aug.31.21
7. Enter the thing name.
Enter “codedataflash write aws iotthingname <iot_thing_name>”and press enter to set the thing name
information. <iot_thing_name> describes the name of the thing created in "4.1 AWS Preparation".
If set successfully, you will see “stored data into codeflash correctly.”.
$ codeflash write aws iotthingname thing_rx671_rsk
stored data into codeflash correctly.
Figure 3-13 Entry the Thing Name
8. Check if each parameter is set correctly.
Enter “codeflash read”and press enter to see the configured parameters.
$ codeflash read
label = client_private_key
data = -----BEGIN RSA PRIVATE KEY-----
MIIEogIBAAKCAQEAzhY82YODydQYFH/yFZONXFYMNJ86US+Ph+snfsinjFFU3kOp
(The following is omitted)
Figure 3-14 Display of Set Parameters
9. Finish entering the information and move to the demo program.
Enter “start demo”and press enter to move to the demo program.
$ start demo
RX671 Renesas Starter Kit
$ 0 41000 [Tmr Svc] Demo Start.
1 41084 [Tmr Svc] [DEBUG] [PKCS11] [core_pkcs11_mbedt・・・
4 41084 [Tmr Svc] [INFO] [PKCS11] [core_pkcs11_mbedtl・・・
7 41084 [Tmr Svc] [DEBUG] [PKCS11] [core_pkcs11_mbedt・・・
10 41085 [Tmr Svc] [WARN] [PKCS11] [core_pkcs11_mbedt・・・
13 41085 [Tmr Svc] [WARN] [PKCS11] [core_pkcs11_mbedt・・・
（・・・）
95 41669 [iot_thread] [INFO ][DEMO][41669] ---------STARTING DEMO---------
96 41671 [iot_thread] [INFO ][INIT][41671] SDK successfully initialized.
97 55098 [iot_thread] [INFO ][DEMO][55098] Successfully initialized the demo.・・・
98 55098 [iot_thread] [INFO ][MQTT][55098] MQTT library successfully initialized.
99 55098 [iot_thread] [INFO ][Shadow][55098] Shadow library successfully
initialized.(The following is omitted)
Figure 3-15 Move to the Demo Program

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
15
of 31
Aug.31.21
This demo program operates with the code flash memory operating mode as dual mode. As shown in the
figure, the certification information setting data are stored in the bank area that is not the execution side of
the code flash.
-Code flash memory mapping in dual mode
(1) Block 37 (0xFFF00000 to 0xFFF07FFF) Reserved area
(2) Block 75 (0xFFE00000 to 0xFFE07FFF) Data storage area
In addition, it is recommended to store the data for two banks as the certification information setting data for
safety, but this demo program is configured to operate with the data for one bank due to the program size.
Figure 3-16 Certification Information Stored Mapping
Non-executing surface bank.
0xFFE00000
0xFFE07FFF
0xFFEFFFFF
0xFFF00000
0xFFF07FFF
0xFFFFFFFF
Block75:Data storage area
Block37:Reserve area
Executing surface bank.

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
16
of 31
Aug.31.21
4. Starting the Demo for Standalone Version
In the standalone version, after writing the program, disconnect the E2 emulator Lite connector and turn on
the Renesas Starter Kit+ for RX671 board to start the demo program. This demo program assumes the
remote control of the air conditioner and displays the power on / off, temperature setting, and switching of
heating and cooling on the LCD. In the demo, you can use button 2, slider on the touch panel, and switch 3
(SW3).
Figure 4-1 Hardware Connection
4.1 Renesas Starter Kit+ for RX671 Power on to Voice Command Standby Screen
When the power of the Renesas Starter Kit+ for RX671 is turned on, the RX logo mark and the features of
the RX671 are displayed on the LCD panel for about 2 seconds. When the display ends, the demo program
starts and the screen changes to the voice command standby screen.
Until power on to voice command standby screen
[After turned on the board]
[Voice command standby screen]
Figure 4-2 After power on
Touch panel
button 2
Touch panel
slider
Switch 3

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
17
of 31
Aug.31.21
4.2 Selecting the Language Mode of Renesas Starter Kit+ for RX671
You can switch the recognized language by pressing SW3. Each time you press SW3, Japanese and
English alternate. The first language the demo program recognizes is English. In this manual, explanations
will be given in English.
Press SW3 when the language mode is English.
[After turned on the board]
[pressing SW3]
Press SW3 when the language mode is Japanese.
[The language mode is Japanese]
[pressing SW3]
Figure 4-3 How to Switch the Language
4.2.1 Acceptable Voice Commands
The table below shows a list of voice commands.
Table 4.1 List of Voice Commands
Voice commands
Functions
English
Japanese
Power on
Assuming that the air conditioner is turned on,
the LCD is displayed.
Power off
Assuming that the air conditioner is turned off,
the LCD is blacked out.
Heating mode
Assuming the heating operation of the air
conditioner, the heating is displayed.
Air conditioning mode
Assuming the cooling operation of the air
conditioner, the cooling is displayed.
Raise the temperature
Only when the LCD is on, raise the set
temperature by 1°C. The upper limit is 28°C.
Lower the temperature
Only when the LCD is on, lower the set
temperature by 1°C. The lower limit is 16°C.
Sixteen degrees
～Twenty-eight degrees
Only when the LCD is on, the specified
temperature is displayed as the set temperature.

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
18
of 31
Aug.31.21
4.3 Possible Functions on the Standby Screen After the Board is Turned On
After recognizing the voice command "Power on", the air conditioner mode demo will start.
Say voice command “Power on”
[After turned on the board]
[Voice command standby screen]
Figure 4-4 LCD Screen After “Power on”
4.4 Possible Functions on Air Conditioner Mode
4.4.1 Change the Set Temperature
The set temperature of the air conditioner can be changed with the slider or voice command. The set
temperature range is from 16°C to 28°C. If you trace the slider from left to right or say "Raise the
temperature", the set temperature will be raised by 1°C. And if you trace the slider from right to left or say
"Lower the temperature", the set temperature will be lowered by 1°C. In addition, you can directly specify the
set temperature by voice command from "Sixteen degrees" to "Twenty-eight degrees".
Trace the slider from left to right or say "Raise the temperature"
Trace the slider from right to left or say "Lower the temperature"
When you say “Seventeen degrees”at 26°C
Figure 4-5 Setting Method for Temperature

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
19
of 31
Aug.31.21
4.4.2 Switching Between Heating and Cooling
You can switch between heating mode and cooling mode only by voice command.
Speaking "Heating mode" will switch to heating mode and speaking "Air conditioning mode" will switch to
cooling mode.
In case saying “Heating mode”
In case saying “Air conditioning mode”
Figure 4-6 Switching Between Heating Mode and Cooling Mode
4.4.3 Power Off of Air Conditioner
When you say "Power off", the LCD turns off as if the air conditioner was turned off.
In case saying “Power off”
Figure 4-7 Power Off

RX671 Group
Voice recognition, Touch and Cloud solution using Renesas Starter Kit+ for RX671
R01AN6010EJ0100 Rev.1.00 Page
20
of 31
Aug.31.21
4.5 Parameter Setting Function of Voice Recognition Engine
You can switch the parameters of the voice recognition engine during the demo.
4.5.1 Types of Parameters that can be Set
The parameters that can be set with the parameter setting function and the explanation of the parameters
are as follows.
Table 4.2 Parameter Types (Voice Trigger)
Voice Trigger
Parameter
Initial
value
Available value
Meaning
Threshold
400
300,400,500,600
Set the voice detection threshold. Increasing the value makes
it easier to detect, but also increases false detections.
silDiscount
600
500,600,700,800
If the voice contains silence, the words before and after the
silence may be falsely detected as two words. Increasing the
value will make word splitting less likely to occur due to
silence, but will slow down the detection response. Decreasing
the value makes word splitting more likely, but improves
detection response speed.
Frame skip
0
0,3,6,12
This parameter is set when you want to reduce the CPU load.
Some of the operations performed for each frame, some
processing with a large amount of operation is performed for
each set value + 1 frame. If the value is 0 (initial value), all
processing is performed in units of every frame, but if the value
is set to 3, processing with a large amount of calculation is
performed every three processing.
Table 4.3 Parameter Types (AmiVoice®)
AmiVoice®
Parameter
Initial
value
Available value
Meaning
Threshold
10000
5000,7000,
10000,13000
Speaking detection threshold of AmiVoice®
The larger the value, the lower the detection, and the
fewer false detections.
Confidence
100
80,100,150,200
Confidence threshold of AmiVoice®
The larger the value, the lower the detection, and the
fewer false detections.
Table 4.4 Parameter Types (Zoom Voice)
Zoom Voice
Parameter
Initial
value
Available value
Meaning
Beam forming
3
1,3,5,7
Beam forming amount of Zoom Voice.
The larger the value, the higher the directivity.
Noise
suppressor
3
1,3,5,7
Noise suppression amount of Zoom Voice.
The larger the value, the higher the noise tolerance.