Project description
Personalised Audio Rendering for extended reality applications.
Extended reality (XR) enhances the physical world with real-time digital interactions. Unlike visual elements, sound in XR applications tends to lack realism and accessibility. A study found that 97 % of XR applications overlook personalised sound rendering due to its complexity. Supported by the Marie Skłodowska-Curie Actions programme, the MIA project is developing an audio rendering solution that combines advancements in psychoacoustics with explainable AI. The project will create an AI-driven prototype for personalised audio experiences and provide a toolkit with minimal hardware for seamless audio integration into XR applications. Additionally, the project will explore protective measures for EU product development, contributing to digital inclusion, particularly in remote work and hearing assistance.
Objective
The growing field of extended reality (XR) has shown how technology can expand the physical world with real-time digital information and interactions through applications spanning from hybrid meetings to assisted hearing. While plausible visual information is easily delivered, when not adapted to each user, generic sound rendering lacks realism, increases cognitive load and limits accessibility. Still, a recent study found that only 97% of analysed applications ignore personalised sound rendering due to its complex acoustic requirements.
MIA (Modelling Individual Acoustics for plausible extended realities) aims at individualising audio rendering by developing a widely adoptable solution that leverages advancements in psychoacoustics and explainable artificial intelligence (AI). The proposed research effort will (1) explore and determine requirements across multiple acoustic contexts, (2) prototype an explainable AI model to infer individual audio characteristics, and (3) implement a personalisation procedure based on user actions to guarantee plausibility over specific contexts.
The resulting software solution aims to provide a toolkit with minimal hardware requirements to integrate plausible audio in XR applications. MIA will foster open-science practices while exploring protection measures for EU product development, supporting the EU's goals of advancing technological innovation and enhancing digital inclusion, particularly in remote work, education, and hearing assistance technologies. To succeed, MIA integrates the diverse fields of expertise of the researcher on auditory modelling and advanced Bayesian statistics, of the host institution on audio-signal processing and XR applications, and of the secondment host on the development of explainable AI. The researcher will, therefore, have the chance to collaborate with multiple leading experts to expand his expertise and professional networks, supporting his development for an independent career.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
You need to log in or register to use this function
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-MSCA-2024-PF-01
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
SW7 2AZ London
United Kingdom
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.