ZoraBots Billy-Billy User manual

ZoraBots
Billy-Billy Manual
Release 1.06
05/03/2018
[email protected]e
[phone]
COPYRIGHT NOTICE
COPYRIGHT © 2018 Zora Robotics NV all rights reserved.
No part of this document may be used or copied without prior written permission from the copyright
holder. The contents of this document can always be modified without prior notice.

2
This document explains the general procedures when using the Billy-Billy robot and briefly
explains the functionality of the current version of Billy-Billy.
1About this document...........................................................................................................................................................................2
2Concept and mission of Billy-Billy ............................................................................................................................................4
3Contents of the box..............................................................................................................................................................................5
4Preface.......................................................................................................................................................................................................... 6
5Communication...................................................................................................................................................................................... 6
5.1 Microphone.....................................................................................................................................................................................7
5.2 LED-lights ....................................................................................................................................................................................... 8
5.3 Speakers .......................................................................................................................................................................................... 8
5.4 Connections................................................................................................................................................................................... 8
6Connectivity .............................................................................................................................................................................................. 9
6.1 Connecting to Billy-Billy....................................................................................................................................................... 9
6.1.1 Wifi-connection .................................................................................................................................................................... 9
6.1.2 Connection with cable ................................................................................................................................................... 13
6.2 Local Management ................................................................................................................................................................ 14
6.2.1 Home screen......................................................................................................................................................................... 15
6.2.2 Menu bar.................................................................................................................................................................................. 15
6.2.3 Controls of Billy-Billy.......................................................................................................................................................16
6.2.3.1 Summary of the sensors.......................................................................................................................................16
6.2.3.2 Device settings ............................................................................................................................................................ 17
6.2.3.3 Sending a message.................................................................................................................................................. 17
7Website......................................................................................................................................................................................................18
7.1 Register or log in...................................................................................................................................................................... 19
7.1.1 Register .....................................................................................................................................................................................19
7.1.2 Logging in................................................................................................................................................................................20
7.2 Online management of Billy-Billy ............................................................................................................................... 21
7.2.1 Garden ....................................................................................................................................................................................... 21
7.2.2 Content of a garden......................................................................................................................................................... 21
7.2.3 Online Features................................................................................................................................................................... 21
7.3 Managing gardens..................................................................................................................................................................22
7.3.1 Adding a garden.................................................................................................................................................................23

3
7.3.2 Adjusting the garden.......................................................................................................................................................23
7.3.3 Adding a Billy-Billy to the garden..........................................................................................................................24
7.4 Online management .............................................................................................................................................................25
7.4.1 Homepage..............................................................................................................................................................................25
7.4.2 Status of the plant.............................................................................................................................................................26
7.4.3 Settings for Billy-Billy .....................................................................................................................................................27
7.4.3.1 Device settings ............................................................................................................................................................27
7.4.3.2 Edit name.........................................................................................................................................................................28
7.4.3.3 Update picture.............................................................................................................................................................28
7.4.3.4 Send a message .........................................................................................................................................................28
7.5 Online features..........................................................................................................................................................................29
7.5.1 Account Settings................................................................................................................................................................29
7.5.2 Changing the password................................................................................................................................................29
7.5.3 Calendar .................................................................................................................................................................................. 30
7.5.4 Logging off .............................................................................................................................................................................34
8Sensors.......................................................................................................................................................................................................35
8.1 Sensor for the inner pot ......................................................................................................................................................35
8.2 Light-sensors..............................................................................................................................................................................35
8.3 Temperature-sensor.............................................................................................................................................................35
8.4 Soil moisture-sensors ......................................................................................................................................................... 36
8.5 Time-sensor ............................................................................................................................................................................... 36
9Epilogue.....................................................................................................................................................................................................37
Appendix 1 –Voice commands ...........................................................................................................................................................38
Appendix 2 –Tutorials................................................................................................................................................................................42
Appendix 3 –Technical specifications ...........................................................................................................................................47

4
Thank you very much for your purchase of Billy-Billy. We hope you will have a lot of fun with your
Billy-Billy.
Billy-Billy is an interactive flower pot that was designed to make the lives of elderly people cosier
and more comfortable. With its sensors it captures –among other things –how hot or cold a room
is and the amount of light in the said room. By using this data, Billy-Billy can help elderly people
take care of plants or herbs. Billy-Billy can also easily be connected to the internet to look up the
latest news or the latest weather report. Billy-Billy is an added value not only for the elderly,
(grand)children can also interact with the robot.
By using a shared calendar, Billy-Billy can remind you that the healthcare professional will pay a
visit, or when a family event has been planned. Reading messages aloud is also a possibility. In
short, Billy-Billy will do anything in its power to make life easier.
Zorabots is using Billy-Billy to try to reduce the loneliness of elderly people so people can live
longer at home or to give people in residential care centres a daily activity.

5
Number
Item
Photo
1
Billy-Billy
1
Billy-Billy Inner Pot
1
Power Adapter with European Sockets(*)
1
Bag of Potting Soil
1
Bag of Seeds
1
USB stick with the Manual and Configuration
Software
1
Quick start guide
(*): Billy-Billy can be supplied with other sockets (depending on the region), so the adapter can be
adjusted if needed.

6
A brief explanation of (some) terms used throughout this document:
Pot or Inner Pot
or Flower Pot
The flowerpot that can be inserted into the robot from the top.
Sensors
Hardware designed specifically to collect data.
E.g.: Temperature Sensors measuring the current temperature.
Wake Word or
Wake-Word
The command used to have Billy-Billy listen to a command.
In this case: ‘Billy-Billy’.
Quiet Hours
During the ‘Quiet Hours’ Billy-Billy will remain silent, unless the user specifically
asks a question (1).
LED lights
or LEDs
The lights in Billy-Billy’s cheeks.
Cabled
Connection
A network connection of Billy-Billy and the home router with an UTP cable.
Local
Management
Consulting the sensor data or adjusting (some) settings of Billy-Billy without
using the internet.
(1): This does not apply when inserting or removing the inner pot into/from Billy-Billy.
The robot has the following hardware to receive commands and provide feedback:

7
The microphone is located at the front of the robot (in the right eye)
to ensure a smooth communication.
By speaking to the robot from the front, the best results can be
obtained.
-Wake Word
This term indicates the name of the robot (‘Billy-Billy’). By saying this term aloud, Billy-Billy will
start listening for specific commands.
-LEDs
Once the robot has recognized the ‘wake word’ command, the LEDs in the cheeks will turn blue.
This implies that the robot is listening for the commands.
-Commands
The robot only responds to pre-programmed sentences. For example: ‘Which day are we today?’
or ‘What’s today’s date?’.
Note: Future updates might add new features to this functionality.
-In practice:
The following example has Billy-Billy read out the state of the plant:
Step 1 –Billy-Billy is fully booted, and the
inner pot has been detected.
The cheeks of Billy-Billy light up green.
Step 2 –The robot is turned to the person
asking the question.
1) The user states the command ‘Billy-Billy’.
2) The LEDs in the cheeks light up blue.
3) The command ‘How are you?’ is spoken
Step 3 –The robot answers the question
1) Depending on the type of question, the answer
can take a while (e.g. asking for the weather).
2) The robot replies with the sentence ‘Everything is
ok’ (or something similar).
If the sensors do not detect a safe value (see
chapter 9 - Sensors) the robot will notify you of this
as well.

8
The LED lights installed in the cheeks can light up in a variety of
colours depending on the state of the plant or robot.
For the full range of possible colours, see Appendix 3 –Technical information.
The speakers are located at the side of the head.
The volume of the speakers can be adjusted on the Billy-Billy website
http://www.billybot.be .
Besides the hardware to communicate with humans, Billy-Billy also has the necessary hardware
to communicate with machines and the internet.
These connections can be found at the back of Billy-Billy.
The power connector is located at the top left of this panel.
This is where the power adapter needs to be plugged in.
To the right of the power connector, the power button can be
found. This button is used to power Billy-Billy on and off.
This button has the following functionality:
-Press once: Billy-Billy is safely turned off.
-Keep pressing with some force: Billy-Billy is shut down.
This option should only be used if the first option doesn’t
work. Avoid doing this unless there is no other option.
Below the power adapter, the network plug can be found. This
connection can be used when connecting Billy-Billy to a network
by using a UTP cable.
At the bottom-right, the USB-connections can be found. These
connections can be used to connect to external devices (e.g. a USB
drive with the configuration file for the wireless network).

9
The router at home and the pc have the following properties:
-Cabled connection: This connection always takes priority (a.o. when saying the IP address
and connecting to the website) due to the greater speeds when sending and receiving
data.
This connection works independently from the Wi-Fi connection.
-Router: The router at home must act as an IPv4 DHCP server.
Billy-Billy has the following means to communicate with other devices or the internet:
-Wifi connection
-Network adapter (cable)
This setup has the advantage of wireless internet-access and mobility of Billy-Billy.
-Configuration:
As shown on the picture, both the other devices and Billy-Billy are connected to the same
network. Billy-Billy uses the same settings as the phone to connect to wifi.
-Setting up the connection (Windows)
Step 1 –Start the Program ‘BillyBillyConfig.exe’.
Plug the supplied USB stick into a USB slot of a Windows-
computer or download the program from the website
http://www.billybot.be/downloads.
To download the file, select the option ‘Downloads’ in the
section ‘Info’ at the bottom of the website.
By starting the program BillyBillyConfig.exe from the USB
stick or from the downloaded location, the settings for the
Wi-Fi network can be inputted and saved to an external
file.

10
Step 2 –Enter the Settings for the Selected Wi-Fi
Network.
In the top right corner of the program, the USB
devices that are compatible with Billy-Billy are
shown.
Select the USB-drive to use from this list.
The list on the left side shows the networks found
by the computer.
By selecting the network from the list, the name is
copied to the field titled ‘Wifi network name’.
If the network is not listed, it can be entered
manually in this field.
If the network or the connected USB device are
not detected, the program can search again by
clicking the button marked ‘Refresh’.
Step 3 –Creating the Configuration File.
After filling in the password for the network in the
field marked ‘Password’, the configuration file
needed by Billy-Billy can be generated.
By clicking the button marked ‘Generate File’, the
file is created and stored on the USB drive.
After clicking the OK button in the popup, the USB
stick may be safely removed from the computer.
Step 4 –Checking the File.
When verifying the contents of the USB stick, an extra file will be
visible in the root folder, namely ‘billy-billy.conf’.
This file contains the data needed by Billy-Billy to connect to the
specified network.
Once the files have been checked, the USB drive must be safely
removed from the computer.
Step 5 –Connecting Billy-Billy to the Network.
By plugging the USB stick into Billy-Billy (the protective rubber may
need to be removed from the slot), the generated file can be used to
connect Billy-Billy from the network.
When the cheeks turn blue after saying the wake word ‘Billy-Billy’, the
command “connect to Wi-Fi” can be spoken to have Billy-Billy
connect to the wireless network.

11
If your computer cannot run the program “BillyBillyConfig.exe”, it is also possible to manually
make a configuration file.
This requires a file titled “billy-billy.conf” (case sensitive) to be made on a USB stick formatted as
FAT32. This file needs to contain the following information:
wifi:
ssid: NETWORK_NAME
psk: YOUR_PASSWORD
Replace the generic terms YOUR_PASSWORD and NETWORK_NAME with the correct values for
the home network.
Note: The format used in the file is “YAML” (http://www.yaml.org) and its contents need to adhere to
this standard.
Below is the procedure to use when using Apple computers with a Mac OS X:
Step 1 –Open the Text Editor.
Open the application ‘TextEdit’ on the Mac. This can be found using the Spotlight search-function
of by using the following procedure:
From the ‘Finder’, select Go > Applications. Double click on TextEdit.
Step 2 –Format the Text as ‘Plain Text'.
The text editor opens a new document. The
first step is to convert this file to plain text.
This is done by selecting the option ‘Make Plain
Text’ in the ‘Format’ menu.
Step 3 –Enter the Necessary Data.
To enter the necessary data, the following
format must be used:
Use 2 spaces to indent the text:
wifi:
ssid: your_network_name
psk: your_network_password

12
Step 4 –Save the File on the USB stick.
Save the document. This is done by selecting
the option ‘Save’ in the menu ‘File’.
Name the file ‘billy-billy.conf’ and make sure
the extension is .conf and NOT .txt.
Select the supplied USB stick as the storage-
location and click the Save button.
Step 5 –Checking the File.
When verifying the contents of the USB stick, an extra file will be
visible in the root folder, namely ‘billy-billy.conf’.
This file contains the data needed by Billy-Billy to connect to the
specified network.
Once the files have been checked, the USB stick must be safely
removed from the computer.
Step 6 –Connecting Billy-Billy to the Network
By plugging the USB stick into Billy-Billy (the protective rubber may
need to be removed from the slot), the generated file can be used to
connect Billy-Billy from the network.
When the cheeks turn blue after saying the wake word ‘Billy-Billy’, the
command “connect to Wi-Fi” can be spoken to have Billy-Billy
connect to the wireless network.

13
This setup has the disadvantage that the UTP cable must be physically connected to Billy-Billy.
This means of course that Billy-Billy must be close to the router.
-Configuration
Billy-Billy is connected by a cable (UTP) with the router.
-Connecting the network cable
There is a slot to plug a UTP cable into at the back of Billy-Billy.
After plugging the cable into the slot, a click may be heard when
the cable is fully connected.
If the connection is active, the orange light next to the slot will light
up.
If data is being sent or received, the green light next to the slot will
blink on and off.
For more information on the cables to use, please refer to the
manual of your router at home.

14
Billy-Billy can always be –somewhat –configured by using the local management website. To
enjoy the full range of service, however, it is advisable that Billy-Billy is connected to the internet
and managed by the Billybot website.
To configure Billy-Billy locally, use the following procedure:
Step 1 –Ask the IP Address of the Robot.
After speaking the wake word ‘Billy-Billy’, the
following command must be used to find the IP
address of the robot: “What is your IP address?”.
Step 2 –Visit the Local Website in your
Browser.
By entering the IP address in a web browser (i.e.
Google Chrome), the local website will be shown.
E.g.:
Step 3 –Select the Option ‘Use Billy-Billy locally’ on the Website.
Note:
If Billy-Billy is connected to the internet, use the online website to connect to Billy-Billy.

15
After selecting the option ‘Use Billy-Billy locally’, the following screen appears:
This screen contains the following elements:
1. The menu bar at the top of the screen.
2. Controls on the left side of the main screen.
3. History of plants on the right side of the main screen.
This section contains the following elements:
-Back button:
By clicking this button, the previously used web page will be shown.
-Home page button:
This button displays the home screen again.
-Language selection:
This button opens a menu with the supported languages on the local website for Billy-Billy. To set
a new language, click on the language.
To close this menu, the button can be clicked. By clicking somewhere else on the website, the
menu will be closed.
-Notifications: or
By clicking this button, a menu is shown with the notifications from Billy-Billy (e.g. Billy is thirsty). If
the list of notifications is shown, the icon is changed from the first option to the second. The new
icon can be clicked to close the menu. Alternatively, by clicking somewhere else on the page, the
menu will close.

16
This part of the web page shows the current sensor values, as well as links to the settings of Billy-
Billy (e.g. volume) and a link to send a message to Billy-Billy.
By clicking the photo of Billy-Billy (or the field ‘Check Details’), the following page is shown:
The first part of the page contains an
image of the registered plant as well
as the latest recorded values of the
sensors.
A second part of the page contains a
graphical reference to the recorded
values of a specific parameter (in this
case temperature) on the chosen
date (in this case ‘today’).
By clicking the possible types of
sensors (Temperature, Light
intensity or Humidity) the values of
the selected sensors are shown.
By clicking the field containing the
date, a calendar is shown where the
date can be selected. By selecting a
new date, the values of that day will
be shown in the chart.
The field Plant Information contains
details of the plant.
Note:
The graph connects the measured points in a straight line. This may cause some weird images if
Billy-Billy did not measure anything for a while (by removing the plant or turning Billy-Billy off) or if
there was a sudden change in brightness (a reflection on the sensor for example).

17
By clicking the button ‘Device Settings’, the following options are available:
The first part of the settings is the volume. This can be
adjusted from the lowest level (1) to the highest level (10)
to anywhere in between.
The second part contains the language settings. By
clicking the selected language to be spoken, when
Billy-Billy reboots, this language will be spoken and
understood by Billy-Billy.
The last setting in the local management is the Quiet
Hours. This indicates when Billy-Billy should not speak,
as to not disturb the user(s).
By clicking the button
‘Save settings’, the new
settings are applied(1).
By clicking the button ‘Go
back’, the new settings are
not applied.
(1): When selecting a new language, Billy-Billy must be rebooted before the new language is
active.
To reboot Billy-Billy, press the power button at the back of Billy-Billy, and wait until Billy-Billy is
fully turned off (the LEDs will turn off completely). Press the power button again to boot Billy-Billy
in the new language.
By clicking the button ‘Send a message’, the following popup is shown:
The message you want Billy-Billy to speak out loud
must be entered in the text field.
By clicking the button ‘Send’, the message will be
spoken aloud by Billy-Billy.
By clicking the button ‘Cancel’, the popup will close,
and the previous page will be shown.

18
By connecting the robot to the internet, it is possible to monitor the status of the plant from
anywhere. The website designed for this is located at http://www.billybot.be.
When surfing this website from your favourite browser, the following screen is shown:
Note:
The information-panel or tutorial-screen on the left side of the screen can be opened by clicking
the symbol. If this screen is open, some basic procedures for operating the site will be shown.
This screen can also be closed by clicking the symbol in the top right corner of the screen.

19
If it is the first time the website is consulted, an account needs to be created. By clicking the
button ‘Register’, the following page appears:
This page contains the following elements:
Username
The unique username that must be used when logging in.
Password(1)
The password for the account.
Re-enter password(1)
Confirm the password for security.
Email
The email account that will be used to reset the forgotten password if
needed.
(1): These fields must be identical.
By clicking the button ‘Register’, a new account will be created (provided the username is not
already in use). A confirmation email will be sent (if this field is marked) to the email address.
The email address will be used to send some basic tips & tricks as well as the link to reset the
password if the button ‘I’ve forgotten my password’ is clicked on the home page.
To log out, see chapter 8.5.4. Logging out

20
After completing the registration, the account is automatically used to log in. When using another
device or when logged off (see chapter 8.5.2 –Logging off), the user needs to log in.
When surfing the website, the following page is shown:
Enter your username and
password in the respective fields.
Click on the button ‘Log in’ to
continue.
(1): This field requires the username, NOT the email address.
-Forgot password
By selecting the link ‘I’ve forgotten my password’, an e-mail is sent to the registered e-mail
address containing a link to re-register the password for the account. By following the instructions
sent to you by mail, a new password can be set.
To log out, see 8.5.4. Log out