Skip to main content
Aller à la page d’accueil de la Commission européenne (s’ouvre dans une nouvelle fenêtre)
français fr
CORDIS - Résultats de la recherche de l’UE
CORDIS

Ecological Language: A multimodal approach to language and the brain

Objectif

The human brain has evolved the ability to support communication in complex and dynamic environments. In such environments, language is learned, and mostly used in face-to-face contexts in which processing and learning is based on multiple cues: linguistic (such as lexical, syntactic), but also discourse, prosody, face and hands (gestures). Yet, our understanding of how language is learnt and processed, and its associated neural circuitry, comes almost exclusively from reductionist approaches in which the multimodal signal is reduced to speech or text. ECOLANG will pioneer a new way to study language comprehension and learning using a real-world approach in which language is analysed in its rich face-to-face multimodal environment (i.e. language’s ecological niche). Experimental rigour is not compromised by the use of innovative technologies (combining automatic, manual and crowdsourcing methods for annotation; creating avatar stimuli for our experiments) and state-of-the-art modelling and data analysis (probabilistic modelling and network-based analyses). ECOLANG studies how the different cues available in face-to-face communication dynamically contribute to processing and learning in adults, children and aphasic patients in contexts representative of everyday conversation. We collect and annotate a corpus of naturalistic language which is then used to derive quantitative informativeness measures for each cue and their combination using computational models, tested and refined on the basis of behavioural and neuroscientific data. We use converging methodologies (behavioural, EEG, fMRI and lesion-symptom mapping) and we investigate different populations (3-4 years old children, healthy and aphasic adults) in order to develop mechanistic accounts of multimodal communication at the cognitive as well as neural level that can explain processing and learning (by both children and adults) and can have impact on the rehabilitation of language functions after stroke.

Champ scientifique (EuroSciVoc)

Mots‑clés

Programme(s)

Thème(s)

Régime de financement

ERC-ADG - Advanced Grant

Voir tous les projets financés dans le cadre de ce programme de financement

Appel à propositions

(s’ouvre dans une nouvelle fenêtre) ERC-2016-ADG

Voir tous les projets financés au titre de cet appel

Institution d’accueil

UNIVERSITY COLLEGE LONDON
Contribution nette de l'UE
€ 2 221 020,00
Adresse
GOWER STREET
WC1E 6BT London
Royaume-Uni
Région
London Inner London — West Camden and City of London
Type d’activité
Higher or Secondary Education Establishments
Liens
Coût total
€ 2 221 020,00

Bénéficiaires (3)