Objective Computational analysis of social interaction is an emerging field of research in several communities such as human computer interaction, machine learning, speech and language processing, and computer vision. Social psychologists have researched the dimensions of social interaction for decades, finding out that nonverbal cues strongly determine human behavior and communication. One of the ultimate aims in computational analysis is to develop computational systems that can automatically recognize, discover, or predict human behavior via sensing devices such as cameras and microphones. The scientific objective of this proposal is to develop new and principled computational methods to detect and analyze visual nonverbal cues for theautomatic analysis of social interaction in small group face-to-face conversations. Specifically, we will concentrate on hand gestures, headgestures and body posture. As nonverbal communication in social interactions does not only include visual cues but also the aural ones, the automatic analysis of interactions requires the use of both cues in modeling and recognition. Hence, our specific objectives are (1) theautomatic detection and analysis of visual nonverbal communication cues, and (2) the multimodal integration of audio and visual nonverbal cues.We will concentrate on a selected number of key research tasks in social interaction analysis including, among others, the automatic estimation of dominance in a group conversation, and the level of interest of the members of the group during their interaction. Fields of science engineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorsoptical sensorsnatural sciencescomputer and information sciencesartificial intelligencecomputer visionnatural sciencescomputer and information sciencescomputational sciencenatural sciencescomputer and information sciencesartificial intelligencemachine learning Keywords Computer vision Image processing Machine learninig Multimodal fusion Social Interaction Analysis Programme(s) FP7-PEOPLE - Specific programme "People" implementing the Seventh Framework Programme of the European Community for research, technological development and demonstration activities (2007 to 2013) Topic(s) FP7-PEOPLE-IEF-2008 - Marie Curie Action: "Intra-European Fellowships for Career Development" Call for proposal FP7-PEOPLE-IEF-2008 See other projects for this call Funding Scheme MC-IEF - Intra-European Fellowships (IEF) Coordinator FONDATION DE L'INSTITUT DE RECHERCHE IDIAP EU contribution € 183 266,35 Address RUE MARCONI 19 1920 Martigny Switzerland See on map Region Schweiz/Suisse/Svizzera Région lémanique Valais / Wallis Activity type Research Organisations Administrative Contact François Foglia (Dr.) Links Contact the organisation Opens in new window Total cost No data