In most existing VR applications, we lack the intuitive feeling of being "spatially present", resulting in a reduced performance for spatial tasks. POEMS pursues a human-centred approach to solve this problem. POEMS will develop reliable multi-level measurement methods for perceived spatial presence and ego-motion. These methods will be used to establish and model optimal auditory, visual, and vibrational rendering parameters and cross-modal, synergistic interactions. This will enable us to outline a lean and cost-effective VR set-up that allows for convincing simulation of ego-motions without actually moving the observer, by combining auditory, visual, and vibrational cues. Future VE platforms optimise from both a perceptual and technical point-of-view based on the POEMS concept, will ultimately be compact, easily transportable, quiet, low-cost, and safe, since they just use projected 3D graphics, 3D sound, and vibrations, without any potentially dangerous moving parts.
The overall objective of POEMS is to define the perceptually relevant rendering parameters for enhanced spatial presence experience. POEMS will develop reliable and valid multi-level measurement methods (subjective-introspective, psychophysical, physiological and behavioural) for spatial presence and ego-motion perception. These methods will be used to establish "optimal" auditory, visual, and vibrational rendering parameters as well as cross-modal, synergistic interactions important for perceiving spatial presence and ego-motion. Using this knowledge, the relation between rendering parameters, cross-modal effects, and spatial presence will be mathematically modelled. The long-term aim is to enable developers and designers of VR systems to optimise their simulations both technically and perceptually, thus allowing for lean, elegant, and low-cost VR simulations with a high sense of spatial presence and ego-motion. This is a prerequisite for the usability of VR for training purposes.
DESCRIPTION OF WORK
Chalmers provides expertise in the field of high-end 3D auditory and vibrational rendering, while MPI-T's expertise lies in the field of high-end visual, vibrational, and vestibular rendering. The work within POEMS contains the following steps:
1) Establishing VR set-ups at both partner's labs including auditory-visual- vibrational technique, which allow a comparable baseline performance for subsequent experiments;
2) Refining introspective state of the art methodologies, which will be used in parallel with other measures throughout the project;
3) Performing psychophysical experiments to establish auditory, visual, vestibular, and vibrational rendering parameters important for perceiving spatial presence and ego-motion. Furthermore, a first mathematical model of the contribution of rendering parameters and cross-modal effects to spatial presence and ego-motion will be developed;
4) Performing physiological experiments(body sway) to establish auditory, visual and vibrational rendering parameters important for ego-motion perception. The mathematical model will be refined accordingly;
5) Performing behavioural experiments to establish auditory, visual, and vibrational rendering parameters important for the behaviourally relevant aspects of spatial presence and ego-motion perception;
6) Investigating the potential benefit of using different interface metaphors and transitions between real and virtual worlds, and how these may be used to enhance the sense of spatial presence and ego-motion;
7) Combining the knowledge gained throughout the project and validating the resulting model in high-level experiments. A final spatial presence model will be developed and used to outline a lean, elegant motion simulation set-up that gives the user a high sense of spatial presence and ego-motion at a low cost.
Régimen de financiaciónCSC - Cost-sharing contracts