Skip to main content

SONICOM - Transforming auditory-based social interaction and communication in AR/VR

Objective

Immersive audio is our everyday experience of being able to hear and interact with sounds around us. Simulating spatially located sounds in virtual or augmented reality (VR/AR) must be done in a unique way for each individual and currently requires expensive and time-consuming individual measurements, making it commercially unfeasible. Furthermore, the impact of immersive audio beyond perceptual metrics such as presence and localisation is still an unexplored area of research, specifically when related with social interaction, entering the behavioural and cognitive realms. SONICOM will revolutionise the way we interact socially within AR/VR environments and applications by leveraging methods from Artificial Intelligence (AI) to design a new generation of immersive audio technologies and techniques, specifically looking at personalisation and customisation of the audio rendering. Using a data-driven approach, it will explore, map and model how the physical characteristics of spatialised auditory stimuli can influence observable behavioural, physiological, kinematic, and psychophysical reactions of listeners within social interaction scenarios. The developed techniques and models will be evaluated in an ecologically valid manner, exploiting AR/VR simulations as well as real-life scenarios, and developing appropriate hardware and software proofs-of-concept. Finally, in order to reinforce the idea of reproducible research and promoting future development and innovation in the area of auditory-based social interaction, the SONICOM Ecosystem will be created, which will include auditory data closely linked with model implementations and immersive audio rendering components.

Call for proposal

H2020-FETPROACT-2020-2
See other projects for this call

Funding Scheme

RIA - Research and Innovation action
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE
Address
South Kensington Campus Exhibition Road
SW7 2AZ London
United Kingdom
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 1 829 708,75

Participants (9)

SORBONNE UNIVERSITE
France
EU contribution
€ 535 082,50
Address
21 Rue De L'ecole De Medecine
75006 Paris
Activity type
Higher or Secondary Education Establishments
OESTERREICHISCHE AKADEMIE DER WISSENSCHAFTEN
Austria
EU contribution
€ 789 377,50
Address
Dr. Ignaz Seipel-platz 2
1010 Wien
Activity type
Research Organisations
UNIVERSITA DEGLI STUDI DI MILANO
Italy
EU contribution
€ 565 031,25
Address
Via Festa Del Perdono 7
20122 Milano
Activity type
Higher or Secondary Education Establishments
ETHNIKO KAI KAPODISTRIAKO PANEPISTIMIO ATHINON
Greece
EU contribution
€ 440 625
Address
6 Christou Lada Str
10561 Athina
Activity type
Higher or Secondary Education Establishments
UNIVERSIDAD DE MALAGA
Spain
EU contribution
€ 580 000
Address
Avda Cervantes, Num. 2
29016 Malaga
Activity type
Higher or Secondary Education Establishments
UNIVERSITY OF GLASGOW
United Kingdom
EU contribution
€ 499 876,25
Address
University Avenue
G12 8QQ Glasgow
Activity type
Higher or Secondary Education Establishments
DREAMWAVES GMBH
Austria
EU contribution
€ 170 091,25
Address
Marxergasse 24/2/5/R7
1030 Wien
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
REACTIFY MUSIC LLP
United Kingdom
EU contribution
€ 108 750
Address
3 Chapel Way Islington
N7 6RQ London
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
USOUND GMBH
Austria
EU contribution
€ 132 500
Address
Kratkystrasse 2
8020 Graz
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)