Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

SONATA: Brain-Aligned Neural Architectures for Real-Time Sound Recognition

Project description

Better understanding of sound

Humans can recognise speech, music and environmental sounds rapidly, even in noisy or unpredictable settings. Current AI systems still struggle with this flexibility because they often learn from static datasets rather than processing sound dynamically like the brain. With the support of the Marie Skłodowska-Curie Actions programme, the SONATA project will use recordings of human brain activity to design smarter AI systems for sound recognition. Using magnetoencephalography, which measures brain signals with millisecond precision, researchers will compare how the brain and AI models represent sounds. These insights will guide the creation of biologically inspired neural networks. Project outcomes could advance neuroscience, improve assistive hearing technologies and strengthen audio-based AI applications.

Objective

SONATA (Sound-Oriented Neural-AI Alignment for Temporal Audition) addresses a core scientific and technological challenge: artificial systems still lack the human brain’s ability to interpret sounds quickly and flexibly. While the brain extracts meaning from sound through dynamic, multiscale processing, current AI systems are trained on static datasets and often fail in unpredictable or noisy conditions. SONATA proposes a new strategy: using high-resolution brain data to guide the development of deep learning models for sound recognition. Specifically, it develops biologically inspired multistream neural networks and constrains their architecture using recordings from magnetoencephalography (MEG), a non-invasive technique that captures brain activity with millisecond precision. The key innovation lies in integrating tools from cognitive neuroscience—such as Representational Similarity Analysis—into the training and evaluation pipeline. These techniques allow the project to align internal model representations with those observed in the brain. The action is structured around three objectives: (O1) design of neuro-inspired model architectures; (O2) incorporation of both theoretical and data-driven neural constraints; and (O3) dual benchmarking of functional accuracy and biological plausibility. SONATA is hosted at Aix-Marseille Université under the supervision of Dr. Bruno Giordano, and will generate open-source tools and insights with applications in auditory neuroscience, AI, and assistive hearing technologies.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2025-PF

See all projects funded under this call

Coordinator

UNIVERSITE D'AIX MARSEILLE
Net EU contribution
€ 226 420,56
Address
BOULEVARD CHARLES LIVON 58 LE PHARO
13284 Marseille
France
Region
Provence-Alpes-Côte d’Azur Provence-Alpes-Côte d’Azur Bouches-du-Rhône
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data