Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Embodied Multimodal Human Communication and Modelling

Objective

The EMHCAM Doctoral Network will train 15 doctoral candidates to advance European research in Embodied Multimodal Human Communication And Modelling. Despite rapid progress in language and vision AI, current systems lack grounding in the embodied and context-dependent nature of human communication. This limits progress in key application domains such as socially interactive agents, accessibility technologies and health-related human–machine interaction. EMHCAM addresses this gap by integrating three research communities — gesture and cognitive interaction studies, multimodal corpus development and multimodal data science — into a single, coherent doctoral training network.
The network tackles three interconnected scientific challenges: 1) developing new theoretical accounts of how speech and gesture jointly structure communication across languages, speaker profiles and interaction settings; 2) creating the next generation of embodied multimodal corpora, linking audio–visual and motion-captured data with shared annotation conventions and making them available through ethical data-sharing methods; 3) designing computational models that analyse and generate multimodal behaviour, including LLM-based generation pipelines and context-aware behavioural modelling.
The resulting resources — open multimodal datasets, validated annotation schemes, evaluation benchmarks and ethically robust modelling pipelines — will have concrete impact across academia and industry. Application areas include intelligent hearing aid design, socially interactive agents for mental healthcare and multimodal learning technologies. By combining advanced technical training, strong industry participation and an interdisciplinary, cross-European research environment, EMHCAM will produce a new generation of researchers equipped to shape human-centred, trustworthy and inclusive multimodal technologies in line with European strategic priorities.

Fields of science (EuroSciVoc)

This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-DN - HORIZON TMA MSCA Doctoral Networks

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2025-DN-01

See all projects funded under this call

Coordinator

KOBENHAVNS UNIVERSITET
Net EU contribution
€ 671 780,16
Address
NORREGADE 10
1165 KOBENHAVN
Denmark
Region
Danmark Hovedstaden Byen København
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data

Participants (9)

Partners (8)