Skip to main content
Vai all'homepage della Commissione europea (si apre in una nuova finestra)
italiano it
CORDIS - Risultati della ricerca dell’UE
CORDIS

Nonverbal Multimodal Social Intention Modelling

Descrizione del progetto

Diverse prospettive nella modellazione dell’intenzione umana

Il rilevamento sociale umano rimane una sfida per l’intelligenza artificiale (IA). L’elaborazione del segnale sociale interpreta i comportamenti umani utilizzando dei sensori. Tuttavia, i sistemi di IA cercano tipicamente una verità che si adatti al meglio, con etichette chiare, ignorando le diverse interpretazioni delle intenzioni umane. In quest’ottica, il progetto NEON, finanziato dal CER, svilupperà un quadro di apprendimento multi-task e un’architettura di rete neurale grafica. Ciò consentirà all’IA di combinare le prospettive e di interpretare meglio le intenzioni umane, favorendo una migliore comprensione dell'uomo. I risultati di questa ricerca aiuteranno gli esseri umani a capirsi meglio.

Obiettivo

An under-explored problem in Social Signal Processing (SSP) is human social intent detection. SSP develops automated systems to interpret human social behaviour from sensors such as cameras, microphones, and wearables. Prior work estimating intent uses scenarios that are constrained enough so that the intent is determined by a congruent outcome. In reality, this is not true, otherwise emergent leaders are never female because they do not speak up and black minorities are criminals because they are often seen interacting with police.

NEON addresses intention detection in more open-ended contexts involving large unstructured social gatherings such as networking or mingling events. During these events, there are no prearranged conversations, multiple conversations can occur at the same time, and all conversation come about via coordination with multiple independent actors with their own possibly conflicting goals. How do we train machines to perceive plausible intentions? Asking the individual to continuously report on their immediate intentions would contaminate their spontaneous social behaviour. NEON hypothesises that plausible social intentions are perceivable by external observers though the explanations of why (based on the behaviours of the individual and the surround social context) may vary depending on the perceivers own life experiences.

To this end, NEON will develop a novel framework to harvest and learn from social intentions and their relation to future outcomes using a novel multi-task learning set up that clusters both on the traits of the perceivers as well as the observed individuals, a unified theory that situates conversations in free standing groups in both space and time and a novel Graphical Neural Network architecture to model it through multi-sensor cross modal learned neural representations. Aside from being a significant advance for SSP, NEON also benefits a range of other fields from human-robot interaction to organisational psychology

Campo scientifico (EuroSciVoc)

Parole chiave

Programma(i)

Argomento(i)

Meccanismo di finanziamento

HORIZON-ERC - HORIZON ERC Grants

Vedi tutti i progetti finanziati nell’ambito di questo schema di finanziamento

Invito a presentare proposte

(si apre in una nuova finestra) ERC-2022-COG

Vedi tutti i progetti finanziati nell’ambito del bando

Istituzione ospitante

TECHNISCHE UNIVERSITEIT DELFT
Contributo netto dell'UE
€ 1 996 795,00
Costo totale
€ 1 996 795,00

Beneficiari (1)