CAE VimedixAR User manual

Instructions for using HoloLens with VimedixAR™
1
©2017 CAE
905K800022 v4
VimedixAR: Getting Started
Thank you for choosing the VimedixAR add-on module, the latest innovation for your Vimedix ultrasound simulator.
Using the Microsoft HoloLens, VimedixAR allows you to see Augmented Reality in the form of 3D holograms that
appear directly on the Vimedix manikins.
The following guide contains links to videos that will show you how to easily start using VimedixAR to enhance your
Vimedix learning experience.
Getting Started with the Microsoft HoloLens
Please use the following links for instructions about the general use, maintenance and functionalities of the
Microsoft HoloLens:
•
Instructions for using HoloLens with VimedixAR™
CAE Vimedix Augmented Reality Comes Alive
Freed from its two-dimensional environment inside a monitor, our VimedixAR™ ultrasound simulator leaps to life,
displaying anatomy you can enlarge, turn, rotate or command to return into its manikin body so you can view the
interrelatedness of its structures. Witness in real time how the ultrasound beam cuts through the human anatomy.

Instructions for using HoloLens with VimedixAR™
2
©2017 CAE
905K800022 v4
Helpful Links:
•Fitting your HoloLens: https://support.microsoft.com/en-us/help/12632
•Turning your HoloLens on or off: https://support.microsoft.com/en-us/help/12642
•HoloLens lights: https://support.microsoft.com/en-us/help/28982
•HoloLens buttons: https://support.microsoft.com/en-us/instantanswers/6ff53cab-1ec8-087e-3a7e-
554d18ae639c/find-out-what-the-hololens-buttons-do
•Using gestures: https://support.microsoft.com/en-us/help/12644
•Start menu and finding your apps: https://support.microsoft.com/en-us/help/12638
•Spaces on HoloLens: https://support.microsoft.com/en-us/help/13760/hololens-spaces-on-hololens
•Environment considerations for HoloLens: https://developer.microsoft.com/en-us/windows/mixed-
reality/environment_considerations_for_hololens
•Charging your HoloLens: https://support.microsoft.com/en-us/help/12627/hololens-charge-your-hololens
•Caring for and cleaning your HoloLens: https://support.microsoft.com/en-us/help/12649/hololens-whats-in-
the-box
•Additional instructions and references: https://support.microsoft.com/en-us/products/hololens

Instructions for using HoloLens with VimedixAR™
3
©2017 CAE
905K800022 v4
TABLE OF CONTENTS
VIMEDIXAR: GETTING STARTED.....................................................................................................................................1
GETTING STARTED WITH THE MICROSOFT HOLOLENS .............................................................................................................................1
HELPFUL LINKS:..............................................................................................................................................................2
CONNECTING AND STARTING THE HOLOLENS............................................................................................................5
ENVIRONMENTAL ANCHORING ................................................................................................................................................................7
STARTING A VIMEDIXAR SIMULATION WITH MICROSOFT HOLOLENS .......................................................................................................8
ENDING A VIMEDIXAR SIMULATION WITH MICROSOFT HOLOLENS ....................................................................................................... 10
VIMEDIXAR USER INTERFACE ......................................................................................................................................11
INTERACTIVE PANEL.............................................................................................................................................................................. 11
Ultrasound Panel ..........................................................................................................................................................................17
HOLOGRAM CONTROLS ....................................................................................................................................................................... 18
SHARED EXPERIENCE MODES ............................................................................................................................................................... 20
CALIBRATION PROCEDURE.................................................................................................................................................................... 21
Calibration by Tag.........................................................................................................................................................................21
Calibration by Gaze ......................................................................................................................................................................21
Fine-Tuning Your Calibration.......................................................................................................................................................22
EXERCISES .....................................................................................................................................................................24
REGION SCAN EXERCISE ....................................................................................................................................................................... 24
Region Scan Exercise, Instructor..................................................................................................................................................24
Region Scan Exercise, Student.....................................................................................................................................................28
FIND FLUIDS EXERCISE ......................................................................................................................................................................... 29
Find Fluids Exercise, Instructor....................................................................................................................................................29
Find Fluids Exercise, Student........................................................................................................................................................32
DEMO MODES ...............................................................................................................................................................33
SHARED DEMO .................................................................................................................................................................................... 33
LOCAL DEMO ....................................................................................................................................................................................... 36
ZOOM AND ROTATION GESTURES ........................................................................................................................................................ 38
VOICE COMMANDS.......................................................................................................................................................38
WARNINGS....................................................................................................................................................................43
MICROSOFT HOLOLENS ACCOUNT .............................................................................................................................45
SOFTWARE UPDATES....................................................................................................................................................45
UPDATING VIMEDIXAR......................................................................................................................................................................... 45

Instructions for using HoloLens with VimedixAR™
4
©2017 CAE
905K800022 v4
ESTABLISHING A NETWORK CONNECTION............................................................................................................................................. 46
CHECKING FOR VIMEDIXAR UPDATES ................................................................................................................................................... 47
UPDATING VIMEDIXAR.................................................................................................................................................48

Instructions for using HoloLens with VimedixAR™
5
©2017 CAE
905K800022 v4
Connecting and Starting the HoloLens
Connecting and starting the HoloLens is a four (4) step process that MUST be completed in the following sequence.
Beginning with the router, computer, and HoloLens powered off:
1. Turn on the router
Power on the Router
2. Connect the network cable between the bottom port of the computer and any of the blue ports on the
router
The Ethernet Ports
3. Turn on the computer and wait for it to boot
4. Turn on the HoloLens (the HoloLens is pre-configured to connect to the router)
Turn on the HoloLens

Instructions for using HoloLens with VimedixAR™
6
©2017 CAE
905K800022 v4
Verify the connectivity of your HoloLens to the Vimedix WIFI network by following the steps below:
1. Bloom to view the Start menu
2. Select the Settings icon in the Start menu
Settings Icon
3. Air tap the Settings window to anchor it in place
4. Select the Network & Internet icon
Settings Window - Network & Internet Icon
5. Verify that the HoloLens are connected to the Vimedix WIFI network

Instructions for using HoloLens with VimedixAR™
7
©2017 CAE
905K800022 v4
Environmental Anchoring
The stability of the anchoring is highly impacted by the knowledge the HoloLens has of its environment. It is
important to scan your surroundings when using the HoloLens in a new room. This prevents the hologram from
drifting causing the device to lose its tracking.
Prior to launching VimedixAR, walk around with the HoloLens on your head so it can map the surroundings.
Microsoft suggests doing this for between 5 and 10 minutes, to look at the ceiling, the floor and other objects from
all sides. This step is important so the holograms stay grounded in the world preventing the device from "getting
lost". One trick is to finger tap in the air while looking around. This directs the device to return visual feedback on its
spatial mapping, drawing green triangles on the surfaces it knows about.
Note: The HoloLens continuously tracks its surroundings to maintain its position in the World. Here are examples of
things that can confuse the device. None of them is critical by itself but combined they can create a bad experience
where the device may lose its tracking ability.
1. Windows, mirrors
2. White empty walls (posters help)
3. No furniture
4. Looking at a display monitor (ex: having a large TV in the field of view when looking at the Manikin)
Note: You may see a warning icon with the text "Poor environment for tracking! Holograms may shift in position" at
the top left corner of your field of view during a VimedixAR simulation. Ensure that you are taking the environment
considerations above into consideration and scan your environment with the HoloLens until the warning disappears
from your field of view.

Instructions for using HoloLens with VimedixAR™
8
©2017 CAE
905K800022 v4
Starting a VimedixAR Simulation with Microsoft
HoloLens
To start a VimedixAR simulation with the HoloLens:
1. Select the VimedixAR app in the Start menu
Vimedix App Icon
2. Move the VimedixAR Startup window with your gaze and air tap to anchor it in place
VimedixAR Startup Window

Instructions for using HoloLens with VimedixAR™
9
©2017 CAE
905K800022 v4
3. Adjust your HoloLens so that all four corners of the FitBox are visible
VimedixAR Start Simulation FitBox
4. Begin the simulation by air tapping or using the voice command "Vimedix, Start Simulation"

Instructions for using HoloLens with VimedixAR™
10
©2017 CAE
905K800022 v4
Ending a VimedixAR Simulation with Microsoft
HoloLens
To end a VimedixAR simulation with the HoloLens:
1. Bloom to return to the Start menu
2. Select the Remove icon in the upper right corner of the VimedixAR Startup window to exit the VimedixAR
simulation
VimedixAR Startup Window Remove Icon
Note: Air tapping the VimedixAR Startup window instead of selecting the Remove icon will resume the simulation.

Instructions for using HoloLens with VimedixAR™
11
©2017 CAE
905K800022 v4
VimedixAR User Interface
The VimedixAR user interface is divided into three main sections:
•Interactive Panel
•Ultrasound Panel
•Hologram Controls
VimedixAR User Interface
Interactive Panel
The Interactive Panel is controlled by the following tabs along its left side:
•Information
•Multi-user
•Calibration
•Exercises
•Settings
•Help
Interactive Panel
Ultrasound Panel Hologram Controls

Instructions for using HoloLens with VimedixAR™
12
©2017 CAE
905K800022 v4
Information Tab
The Interactive Panel displays the Loaded Pathology (e.g. E-FAST_Template or Normal Patient 3) and the Shared
Experience Mode (e.g. Individual, Instructor or Student) when the Information tab is selected and there are no
warnings to be displayed.
Information Tab – Interactive Panel
Note: Refer to the Warnings section of the user guide to understand and manage the warnings that can be
displayed on the Interactive Panel when the Information tab is selected.

Instructions for using HoloLens with VimedixAR™
13
©2017 CAE
905K800022 v4
Multi-user
The Interactive Panel is displayed in all three Shared Experience Mode options when the Multi-user tab is
selected:
•Individual
•Instructor
•Student
Multi-user Tab – Interactive Panel
Please refer to the Shared Experience Modes section of the user guide for more information about each Shared
Experience Mode in VimedixAR.
If your Shared Experience Mode is Individual, you can gain control over the other HoloLens by selecting the
Instructor option.
If your Shared Experience Mode is Instructor, you can release control over the other HoloLens by selecting the
Individual option.
It is not possible for a user to select the Student option. When a user becomes the Instructor, all other users will
become Students in which case the Student option will automatically be selected for them and the other Shared
Experience Mode options will be disabled.

Instructions for using HoloLens with VimedixAR™
14
©2017 CAE
905K800022 v4
Calibration Tab
The Interactive Panel displays the Status of calibration (e.g. Not Calibrated or Calibrated) and an overview of the
Calibration procedure steps when the Calibration tab is selected.
Calibration Tab – Interactive Panel
The Status of calibration will be Not Calibrated during the Calibration process and Calibrated at all other times.
The Interactive Panel also provides you with the option to calibrate the position of the Hologram Manikin relative to the
Physical Manikin by tag or by gaze.
Calibration by tag is started by selecting the Use Tag button at the bottom of the Interactive Panel.
Calibration by gaze is started by selecting the Use Gaze button at the bottom of the Interactive Panel.
Whether you are calibrating by tag or gaze, select the End button at the bottom of the Interactive Panel to end the
calibration.
Please refer to the Calibration Procedure section of the user guide for more information about the Calibration process in
VimedixAR.

Instructions for using HoloLens with VimedixAR™
15
©2017 CAE
905K800022 v4
Exercises Tab
The Interactive Panel displays two exercises when the Exercises tab is selected: Region Scan and Find Fluids.
Exercises Tab – Interactive Panel
If your Shared Experience Mode is Instructor, you will only have access to the Region Scan and Find Fluids exercises.
To begin the setup that is required prior to starting the Region Scan or Find Fluids exercise, select the Start button
that is directly below the description of the respective exercise in the Interactive Panel.
Note: The Start buttons of both exercises are disabled if your Shared Experience Mode is Individual or Student. The
message "*Requires Instructor Mode" will be visible below each button.
Please refer to the Exercises section of the user guide for more information about the exercises in VimedixAR.

Instructions for using HoloLens with VimedixAR™
16
©2017 CAE
905K800022 v4
Settings Tab
The Interactive Panel displays three options when the Settings tab is selected:
•IPD (interpupillary distance) Calibration to improve your visuals
•Shared Demo
•Local Demo
Settings Tab – Interactive Panel
To calibrate your IPD, select the Configure button on the Interactive Panel and follow Cortana’s instructions.
You can end the IPD Calibration prematurely with the bloom gesture, in which case your IPD will not be updated.
To start the Shared Demo, select the Shared Demo button on the Interactive Panel.
Note: The Shared Demo button is only enabled when your Shared Experience Mode is Instructor.
To start the Local Demo, select the Local Demo button on the Interactive Panel.
Note: The Local Demo button will only be enabled if your Shared Experience Mode is Individual.
Please refer to the Demo Modes section of the user guide for more information about the demo options in
VimedixAR.

Instructions for using HoloLens with VimedixAR™
17
©2017 CAE
905K800022 v4
Help Tab
The Interactive Panel displays the most useful voice commands that are compatible with VimedixAR when the
Help tab is selected.
Help Tab – Interactive Panel
Select the Help tab using the voice command "Vimedix, Help" or with the gaze and air tap gestures. Please refer to
the Voice Commands section of the user guide for more information about when the "Vimedix, Help" voice
command can be executed and by whom.
Note: All voice commands can be found in the Voice Commands section of the user guide.
Ultrasound Panel
The Ultrasound Panel displays the real-time ultrasound image.

Instructions for using HoloLens with VimedixAR™
18
©2017 CAE
905K800022 v4
Hologram Controls
The Hologram Controls include the following buttons along the right side of the UI:
The Adjust Menu button unpins the UI so that it can be dragged to another location.
Once you select the Adjust Menu button, you are prompted to tap and hold the UI to drag it to
your desired location.
Note: The UI will be boxed in orange when it is in your grasp and boxed in blue when it is not.
The Adjust Menu icon is an open lock when the UI is unpinned.
UI Unpinned Adjust Icon
Anchor the UI in place by air tapping the UI or selecting the Adjust Menu button with the gaze and
air tap gestures.
The Adjust Menu icon will return to its closed lock configuration when the UI is anchored in place.
UI Anchored Adjust Icon

Instructions for using HoloLens with VimedixAR™
19
©2017 CAE
905K800022 v4
The Left Cross Section button displays a cross-sectional view of the hologram anatomy based
on the position of the ultrasound beam cut plane.
The Right Cross Section button displays a cross-sectional view of the hologram anatomy based
on the position of the ultrasound beam cut plane.
Note: The cross-sectional view that is displayed with the Left Cross Section button and the cross-
sectional view displayed with the Right Cross Section button are on opposite sides of the probe.
The No Cross Section button removes the cross-sectional view of the hologram anatomy.
The Show Layers button* expands the different anatomical systems into layers above the
Physical Manikin.
The Raise Anatomy button* raises the anatomy that is selected in the Structures Visibility menu
on the Vimedix system above the Physical Manikin such that the anatomy is 10 cm below eye
level. The Raise Anatomy button also unlocks the zoom and rotation voice commands and
gestures.
The Normal button* displays the anatomy that is selected in the Structures Visibility menu on
the Vimedix system at the current Calibration position of the Hologram Manikin relative to the
Physical Manikin.
The Normal button is selected by default when your Shared Experience Mode is Student.
The Probe Visible button* displays/hides the virtual probe.
The Pause Probe button* freezes the AR and Ultrasound displays on the last scanned cycle and
loops the cycle on the displays. The Pause Probe button is useful for analyzing cut planes.
* Button is disabled if your Shared Experience Mode is Student

Instructions for using HoloLens with VimedixAR™
20
©2017 CAE
905K800022 v4
Shared Experience Modes
VimedixAR supports the following three Shared Experience Modes:
•Individual:
Users whose Shared Experience Mode is Individual can interact with the simulator independently from other
Individual users. The Shared Demo option as well as both the Region Scan and Find Fluids exercises are
disabled for Individual users, however the Local Demo option will be enabled.
An Individual user can become an Instructor by selecting the Instructor option on the Interactive Panel
under the Multi-user tab.
•Instructor:
A user whose Shared Experience Mode is Instructor controls the simulation experience of the Student(s). The
Instructor can demonstrate the Region Scan and Find Fluids exercises to the Student(s) as well as perform a
Shared Demo for them. The Local Demo option is disabled for the Instructor.
An Instructor can become an Individual user by selecting the Individual option on the Interactive Panel
under the Multi-user tab.
Note: Only one user can be the Instructor at a time.
•Student:
When a user becomes the Instructor, all other users automatically become Students.
Users whose Shared Experience Mode is Student have limited access to the user interface of VimedixAR. For
example, some of the Hologram Controls, both the Region Scan and Find Fluids exercises as well as both
the Local and Shared Demo options will be disabled. Please refer to the Hologram Controls section of the
user guide to learn which Hologram Controls are disabled for Students. However, Students can watch the
Instructor perform the Region Scan and Find Fluids exercises. Students can also watch the Instructor perform
a Shared Demo.
Students automatically become Individual users when the Instructor becomes an Individual user.