Project description
Harmonising brain and machine speech processing
Supported by the Marie Skłodowska-Curie Actions programme, the ORCHESTRAS project explores how the human brain effortlessly processes and predicts speech by synthesising two traditional scientific views into one model: oscillatory rhythms and evoked neural responses. At its core is phase-amplitude coupling, a biological mechanism where brain waves synchronise, hypothesised to underlie the brain's ability to track linguistic hierarchies, from sounds to syntax and meaning. Using oscillatory models and brain connectivity data, the project simulates dynamic 'blueprints' during speech processing. ORCHESTRAS aims to identify language processing markers and integrate them as neural architectural priors into models such as Transformers to create faster, more efficient language systems. This research bridges cognitive science and next-generation AI, revolutionising our understanding of both natural and artificial communication.
Objective
ORCHESTRAS posits a new a theoretical framework for a mechanistic understanding of neural tracking of speech by synthesizing views from both the oscillatory and evoked-like paradigms. It builds upon work from computational neuroscience on whole-brain modelling together with the emergent field of NeuroAI where artificial neural networks are augmented with neural architectural priors which serves in bringing inductive biases to AI models that allow for faster learning and more efficient inference. ORCHESTRAS’ oscillator-based model naturally aligns with the concept of neural oscillations as a mechanism for prediction and expectation. The core hypothesis lies in the idea that event-based predictions (e.g. after hearing a context leading to a strong word or phoneme prediction) elicit a transient response which synchronises slow-phase signal between areas. In turn, that phase modulates higher frequency oscillations reflected in power increase observed in sentence building or upon unexpected words. The interplay between transient and oscillatory dynamic via phase-amplitude coupling is the key linkage of the proposed modelling approach. In other words, we are looking at integrating evoked potentials dynamically with oscillatory activity, a synergic interaction allowing to map linguistic predictions to oscillatory brain activity. The project will be developed along two main approaches: (1) consolidating our theoretical understanding of neural tracking of speech using whole-brain modelling of non-linear oscillators and (2) bridging with AI systems for language modelling such as Transformers by enhancing them with novel attention mechanism based on phase-ampltidude coupling akin to the biological brain. The findings are expected to have significant impact in both our theoretical understanding of speech processing in the human brain and in our practical usage of large language models in AI systems.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
You need to log in or register to use this function
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-MSCA-2025-PF
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
20009 San Sebastian
Spain
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.