Project description
A 3D sound revolution in virtual reality
In the age of expanding digital interfaces and virtual reality (VR), our experience of 3D space is becoming increasingly visual. The same cannot be said for audio, though, especially as regards the back and vertical dimensions. Existing auditory representation in VR falls short, limiting accessibility and immersion. In this context, European Research Council-funded TouchingSpace360 project will introduce a game-changing auditory-tactile method that simulates spatial auditory content. The project’s innovation promises to bridge the gap, making VR more inclusive and immersive for all. From simulating speech to environmental sounds and 3D movement, this technology will open doors across education, entertainment, wellness and medicine.
Objective
Digital interfaces & virtual reality (VR) are expected to penetrate more and more aspects of our everyday lives, from the domain of education, to entertainment, to wellness and even medicine. While impressive advancements have been made in visual display for smartphones and visual technology for representing 3D space in VR, the ability to do so via audio (particularly in the back and the vertical dimensions) remains very limited. Following an initial implementation developed under the NovelExperisense ERC grant (PI: Amedi), we present a novel (and patent pending) auditory-tactile method for simulating spatial localization of auditory content (such as speech, environmental sounds, movement in 3D, and more) through touch. This unique method can enhance accessibility for the hearing impaired and improve the overall VR experience for any individual in a wide range of applications. Here we suggest a line of experiments, further R&D and commercialization path for this intriguing and promising technology.
Fields of science
Keywords
Programme(s)
- HORIZON.1.1 - European Research Council (ERC) Main Programme
Funding Scheme
HORIZON-ERC-POC - HORIZON ERC Proof of Concept GrantsHost institution
4610101 Herzliya
Israel