Automatic Analysis of Group Conversations via Visual Cues in Non-Verbal Communication

Informations projet

NOVICOM

N° de convention de subvention: 235718

Projet clôturé

Date de début 1 Juin 2009

Date de fin 14 Octobre 2011

Financé au titre de

• Specific programme "People" implementing the Seventh Framework Programme of the European Community for research, technological development and demonstration activities (2007 to 2013)

Coût total € 183 266,35

Contribution de l’UE € 183 266,35

Coordonné par

FONDATION DE L'INSTITUT DE RECHERCHE IDIAP
Switzerland

Objectif

Computational analysis of social interaction is an emerging field of research in several communities such as human computer interaction, machine learning, speech and language processing, and computer vision. Social psychologists have researched the dimensions of social interaction for decades, finding out that nonverbal cues strongly determine human behavior and communication. One of the ultimate aims in computational analysis is to develop computational systems that can automatically recognize, discover, or predict human behavior via sensing devices such as cameras and microphones. The scientific objective of this proposal is to develop new and principled computational methods to detect and analyze visual nonverbal cues for the
automatic analysis of social interaction in small group face-to-face conversations. Specifically, we will concentrate on hand gestures, head
gestures and body posture. As nonverbal communication in social interactions does not only include visual cues but also the aural ones, the automatic analysis of interactions requires the use of both cues in modeling and recognition. Hence, our specific objectives are (1) the
automatic detection and analysis of visual nonverbal communication cues, and (2) the multimodal integration of audio and visual nonverbal cues.
We will concentrate on a selected number of key research tasks in social interaction analysis including, among others, the automatic estimation of dominance in a group conversation, and the level of interest of the members of the group during their interaction.

Champ scientifique

• engineering and technology › electrical engineering, electronic engineering, information engineering › electronic engineering › sensors › optical sensors
• natural sciences › computer and information sciences › artificial intelligence › computer vision
• natural sciences › computer and information sciences › computational science
• natural sciences › computer and information sciences › artificial intelligence › machine learning

Mots‑clés

• Computer vision
• Image processing
• Machine learninig
• Multimodal fusion
• Social Interaction Analysis

Programme(s)

• FP7-PEOPLE - Specific programme "People" implementing the Seventh Framework Programme of the European Community for research, technological development and demonstration activities (2007 to 2013)

Thème(s)

• FP7-PEOPLE-IEF-2008 - Marie Curie Action: "Intra-European Fellowships for Career Development"

Appel à propositions

FP7-PEOPLE-IEF-2008
Voir d’autres projets de cet appel

Régime de financement

MC-IEF - Intra-European Fellowships (IEF)

Coordinateur

FONDATION DE L'INSTITUT DE RECHERCHE IDIAP

Contact administratif

François Foglia (Dr.)

• Contribution de l’UE: € 183 266,35
• Adresse: RUE MARCONI 19 ; 1920 Martigny ; Suisse
• Région: Schweiz/Suisse/Svizzera › Région lémanique › Valais / Wallis
• Type d’activité: Research Organisations
• Coût total: Aucune donnée