Mixed reality Mixed reality (MR) has promise for learning, design, and entertainment, and for use during everyday life. In this project, we instructed subjects to stand quietly, and measured how much virtual stimuli presented in mixed reality (Microsoft HoloLens) affected their quiet stance.
We used a set of scripts to control actions of visual events, get data of head movements from Hololens, and send data from client to our server.
--Scripts
--Lab_1_Controller.cs
--Lab_1_StimulusBase.cs
--Lab_1_DynamicText.cs
--Lab_1_StaticText.cs
--Lab_1_StaticObject.cs
--Lab_1_DynamicObjectH.cs
--Lab_1_DynamicObjectV.cs
--WordConf.cs
--WordGenerator.cs
Lab_1_Controller.cs: control the visual events including the actions, send and save data. Add this script to 'Lab_1_Controller' as a component. Add four types of visual events to 'Obj list' manually. Attach scripts to each visual event, respectively, please see the four scripts below. Add 'Lab_1_text_finish' to 'Last flag'
Lab_1_StaticObject.cs: set stimulus parameters for static object and text. Add this script to 'basketball_dynamic'.
Lab_1_DynamicObject.cs: set stimulus parameters for dynamic object moving from back to front. Add this script to 'basketball_dynamic'.
Lab_1_DynamicObjectH.cs: set stimulus parameters for dynamic object and text from left to right. Add this script to 'basketball_dynamicH'.
Lab_1_DynamicObjectV.cs: set stimulus parameters for dynamic object with text from up to down. Add this script to 'basketball_dynamicV'.
WordConf.cs and WordGenerator.cs: to generate the texts used with the object.
data sent to the local server:
camera data format: the tpye of visual event, time, position.x, position.y, position.z, angle.x, angle.y, angle.z;
visual events data format: the tpye of visual event, action start time, action end time;
Note: Please install all the softwares needed before running this assets and do all the settings properly. The visualizations were first developed in the unity platform (Unity 5.5.0f3 Personal), then exported to Visual Studio (Microsoft Visual Studio 2015), then built and deployed to the HoloLens. To build the mixed reality environment with Unity, we set up the camera and other project settings as needed. For details of those steps, including developing the scene in Unity, compiling to Visual Studio, and deploying to Hololens, please refer to https://developer.microsoft.com/en-us/windows/mixed-reality/holograms_100. The ‘Near Clip Plane’ of ‘Main Camera’ for our project is 0.3. The experimental data was sent to a local server.
Acknowledgement: The author Gaiqing would like to thank Shichun Hu and Yuliang Ye for their assistance with the development of set-up, also thanks to Emil Davchev and Boris Bahariev for providing technical support on this project.