Descripción del proyecto
Transformación de experiencias virtuales mediante audios inmersivos
El sonido es una pare integral de la experiencia humana, Como una de las formas más importantes de percibir e interactuar con nuestro entorno, el sonido desempeña un papel importante a la hora de determinar la forma en que se percibe el mundo. En realidad virtual o aumentada (RV/RA), simular espacialmente y de forma correcta contenidos sonoros tiene una importancia vital para ofrecer una experiencia virtual inmersiva. Sin embargo, la RV/RA acústica presenta muchos desafíos. En el proyecto financiado con fondos europeos SONICOM, que utiliza el poder de la inteligencia artificial, se proponen conseguir el próximo hito en simulaciones de audio inmersivo. El objetivo es diseñar tecnologías de audio en 3D de próxima generación, proporcionar soluciones de audio a medida y mejorar considerablemente la forma en que interactuamos con el mundo virtual.
Objetivo
Immersive audio is our everyday experience of being able to hear and interact with sounds around us. Simulating spatially located sounds in virtual or augmented reality (VR/AR) must be done in a unique way for each individual and currently requires expensive and time-consuming individual measurements, making it commercially unfeasible. Furthermore, the impact of immersive audio beyond perceptual metrics such as presence and localisation is still an unexplored area of research, specifically when related with social interaction, entering the behavioural and cognitive realms. SONICOM will revolutionise the way we interact socially within AR/VR environments and applications by leveraging methods from Artificial Intelligence (AI) to design a new generation of immersive audio technologies and techniques, specifically looking at personalisation and customisation of the audio rendering. Using a data-driven approach, it will explore, map and model how the physical characteristics of spatialised auditory stimuli can influence observable behavioural, physiological, kinematic, and psychophysical reactions of listeners within social interaction scenarios. The developed techniques and models will be evaluated in an ecologically valid manner, exploiting AR/VR simulations as well as real-life scenarios, and developing appropriate hardware and software proofs-of-concept. Finally, in order to reinforce the idea of reproducible research and promoting future development and innovation in the area of auditory-based social interaction, the SONICOM Ecosystem will be created, which will include auditory data closely linked with model implementations and immersive audio rendering components.
Ámbito científico
Palabras clave
Programa(s)
Convocatoria de propuestas
Consulte otros proyectos de esta convocatoriaConvocatoria de subcontratación
H2020-FETPROACT-2020-2
Régimen de financiación
RIA - Research and Innovation actionCoordinador
SW7 2AZ LONDON
Reino Unido