Skip to main content

Automated Measurement of Engagement Level of Children with Autism Spectrum Conditions during Human-robot Interaction

Obiettivo

Engaging children with ASC (Autism Spectrum Conditions) in communication centred activities during educational therapy is one of the cardinal challenges by ASC and contributes to its poor outcome. To this end, therapists recently started using humanoid robots (e.g. NAO) as assistive tools. However, this technology lacks the ability to autonomously engage with children, which is the key for improving the therapy and, thus, learning opportunities. Existing approaches typically use machine learning algorithms to estimate the engagement of children with ASC from their head-pose or eye-gaze inferred from face-videos. These approaches are rather limited for modeling atypical behavioral displays of engagement of children with ASC, which can vary considerably across the children. The first objective of EngageME is to bring novel machine learning models that can for the first time effectively leverage multi-modal behavioural cues, including facial expressions, head pose, vocal and physiological cues, to realize fully automated context-sensitive estimation of engagement levels of children with ASC. These models build upon dynamic graph models for multi-modal ordinal data, based on state-of-the-art machine learning approaches to sequence classification and domain adaptation, which can adapt to each child, while still being able to generalize across children and cultures. To realize this, the second objective of EngageME is to provide the candidate with the cutting-edge training aimed at expanding his current expertise in visual processing with expertise in wearable/physiological, and audio technologies, from leading experts in these fields. EngageME is expected to bring novel technology/models for endowing assistive robots with ability to accurately ‘sense’ engagement levels of children with ASC during robot-assisted therapy, while providing the candidate with a set of skills needed to become one of the frontiers in the emerging field of affect-sensitive assistive technology.

Meccanismo di finanziamento

MSCA-IF-GF - Global Fellowships
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinatore

UNIVERSITAET AUGSBURG
Contribution nette de l'UE
€ 239 860,80
Indirizzo
Universitaetsstrasse 2
86159 Augsburg
Germania

Mostra sulla mappa

Regione
Bayern Schwaben Augsburg, Kreisfreie Stadt
Tipo di attività
Higher or Secondary Education Establishments
Contributo di paesi terzi
€ 0,00

Partecipanti (1)

UNIVERSITAT PASSAU

Partecipazione conclusa

Germania
Contribution nette de l'UE
€ 0,00
Indirizzo
Innstrasse 41
94032 Passau

Mostra sulla mappa

Regione
Bayern Niederbayern Passau, Kreisfreie Stadt
Tipo di attività
Higher or Secondary Education Establishments
Contributo di paesi terzi
€ 0,00

Partner (1)

Partner

Le organizzazioni partner contribuiscono all’attuazione dell’azione, ma non sottoscrivono l’accordo di sovvenzione.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Stati Uniti
Contribution nette de l'UE
€ 0,00
Indirizzo
Massachusetts Avenue 77
02139 Cambridge

Mostra sulla mappa

Tipo di attività
Higher or Secondary Education Establishments
Contributo di paesi terzi
€ 160 130,40