CORDIS - EU research results
CORDIS

Computational Design of Multimodal Tactile Feedback within Immersive Environments

Project description

A new era of tactile experience in virtual reality

In recent years, there has been a surge in tactile technologies offering a range of haptic sensory experiences. However, virtual reality systems still struggle to deliver convincing tactile sensations for 3D interaction. They fall short in three critical aspects: rendering multiple haptic stimuli coherently in space, achieving temporal integration compatible with interactive framerates, and preserving user immersion in virtual worlds. Funded by the European Research Council, the ADVHANDTURE project introduces an innovative computational approach to enhance multimodal tactile feedback in immersive environments. Its methodology incorporates perceptual data throughout the design of computational models for immersive tactile haptics. The project will develop physics-based models, efficient algorithms and 3D interaction paradigms, offering realistic multi-sensory feedback and enriching interaction with virtual worlds.

Objective

These last years have seen an explosion of novel tactile technologies providing various haptic sensations across all the user's body. However, while these technologies have now been made available, virtual reality systems are still struggling to convey compelling tactile sensations for 3D interaction. As of today, tactile feedback mainly fails: (1) to render multiple haptic stimuli in a spatially coherent manner, (2) to achieve temporal integration of the stimuli compatible with the interactive framerates of immersive environments and (3) to preserve user's immersion within virtual worlds.
ADVHANDTURE aims at targeting all the above limitations by introducing a ground-breaking computational approach for handling multimodal tactile feedback within immersive environments. My original methodology proposes for the first time the introduction of perceptual data at each step of the design of the computational models dedicated to immersive tactile haptics. Thanks to its innovative approach, ADVHANDTURE will address the design of: (a) physics-based models able to simulate the rendering of various tactile inputs, (b) computationally-efficient algorithms integrating multimodal tactile stimuli within immersive environments and (c) 3D interaction paradigms for combining multimodal tactile stimuli with multi-sensory information.

In addition to significant advances in the design of computational haptic rendering models, ADVHANDTURE, in the long run, will considerably enrich our 3D interaction with virtual worlds by providing realistic multi-sensory feedback with multiple tactile sensations. Thanks to its multidisciplinary aspect, ADVHANDTURE will propose synergistic outcomes contributing to our understanding of the haptic perception of virtual worlds, as well as the underlying models in the fields of Computer Graphics, Haptics and Virtual Reality.

Host institution

INSTITUT NATIONAL DES SCIENCES APPLIQUEES DE RENNES
Net EU contribution
€ 1 999 750,00
Address
AVENUE DES BUTTES DE COESMES 20
35708 Rennes Cedex 7
France

See on map

Region
Bretagne Bretagne Ille-et-Vilaine
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 999 750,00

Beneficiaries (1)