MULTImodal and MULTIparty Social Interactions MOdelling

Información del proyecto

MULTISIMO

Identificador del acuerdo de subvención: 701621

DOI

10.3030/701621

Proyecto cerrado

Fecha de la firma de la CE 17 Marzo 2016

Fecha de inicio 1 Septiembre 2016

Fecha de finalización 31 Agosto 2018

Financiado con arreglo a

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Coste total

€ 175 866,00

Aportación de la UE

€ 175 866,00

Coordinado por

THE PROVOST, FELLOWS, FOUNDATION SCHOLARS & THE OTHER MEMBERS OF BOARD, OF THE COLLEGE OF THE HOLY & UNDIVIDED TRINITY OF QUEEN ELIZABETH NEAR DUBLIN
Ireland

Objetivo

The project addresses the modelling of multimodal communicative human behaviour during natural interactions in multiparty settings and specifically the conversational and feedback strategies of the interaction participants in terms of attention, engagement and conflict management. The knowledge base for this modelling problem will be a collection of human-human interaction recordings to be acquired through a concise experimental protocol and state-of-the-art equipment. The communicative behavior will be analysed in multimodal signals, including facial expressions, gaze and prosodic cues that provide information about social interaction management and speakers’ attitudes. This information becomes more complex in group interactions, where a management mechanism will be discovered and modelled. These low-level signals will be examined in relation to their timing and sequence to infer and model high-level signals of attention, engagement and conflict, and subsequently implement modules to feed existing HCI interfaces such as dialogue systems or avatars. The implementation of such novel models will allow for the creation of more sophisticated human-like agent-based interfaces of high quality communication experience, especially in scenarios where social and cognitive skills, in addition to the communicative ones, are crucial for the success of the interaction, i.e. in the education, customer care domains and web applications requiring interfaces triggered by human communication. The project builds on the strengths of the applicant in multimodal communication and language technology, and combines these with new training in intelligent systems and human-computer interaction to support a new research direction and to strengthen cross-European collaboration. The host provides an excellent supportive environment conducive to the interdisciplinary research envisaged in the project and the training objectives of the fellowship in view of the applicant’s career development.

Palabras clave

• Multimodal Communication
• Multiparty Interaction
• Human-Computer Interaction
• Intelligent User Interfaces
• Conversation Analysis
• Attention
• Engagement
• Conflict
• Gender
• Personality

Programa(s)

• H2020-EU.1.3. - EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions PROGRAMA PRINCIPAL
  
• H2020-EU.1.3.2. - Nurturing excellence by means of cross-border and cross-sector mobility
  

Tema(s)

• MSCA-IF-2015-EF - Marie Skłodowska-Curie Individual Fellowships (IF-EF)
  

Régimen de financiación

MSCA-IF - Marie Skłodowska-Curie Individual Fellowships (IF)

Convocatoria de propuestas

H2020-MSCA-IF-2015

Coordinador

THE PROVOST, FELLOWS, FOUNDATION SCHOLARS & THE OTHER MEMBERS OF BOARD, OF THE COLLEGE OF THE HOLY & UNDIVIDED TRINITY OF QUEEN ELIZABETH NEAR DUBLIN

• Aportación neta de la UEn: € 175 866,00
• Dirección: COLLEGE GREEN TRINITY COLLEGE ; D02 CX56 Dublin ; Irlanda
• Región: Ireland › Eastern and Midland › Dublin
• Tipo de actividad: Higher or Secondary Education Establishments
• Coste total: € 175 866,00