CORDIS
EU research results

CORDIS

English EN
Automated Measurement of Engagement Level of Children with Autism Spectrum Conditions during Human-robot Interaction

Automated Measurement of Engagement Level of Children with Autism Spectrum Conditions during Human-robot Interaction

Objective

Engaging children with ASC (Autism Spectrum Conditions) in communication centred activities during educational therapy is one of the cardinal challenges by ASC and contributes to its poor outcome. To this end, therapists recently started using humanoid robots (e.g., NAO) as assistive tools. However, this technology lacks the ability to autonomously engage with children, which is the key for improving the therapy and, thus, learning opportunities. Existing approaches typically use machine learning algorithms to estimate the engagement of children with ASC from their head-pose or eye-gaze inferred from face-videos. These approaches are rather limited for modeling atypical behavioral displays of engagement of children with ASC, which can vary considerably across the children. The first objective of EngageME is to bring novel machine learning models that can for the first time effectively leverage multi-modal behavioural cues, including facial expressions, head pose, vocal and physiological cues, to realize fully automated context-sensitive estimation of engagement levels of children with ASC. These models build upon dynamic graph models for multi-modal ordinal data, based on state-of-the-art machine learning approaches to sequence classification and domain adaptation, which can adapt to each child, while still being able to generalize across children and cultures. To realize this, the second objective of EngageME is to provide the candidate with the cutting-edge training aimed at expanding his current expertise in visual processing with expertise in wearable/physiological, and audio technologies, from leading experts in these fields. EngageME is expected to bring novel technology/models for endowing assistive robots with ability to accurately ‘sense’ engagement levels of children with ASC during robot-assisted therapy, while providing the candidate with a set of skills needed to become one of the frontiers in the emerging field of affect-sensitive assistive technology.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

UNIVERSITAT PASSAU

Address

Innstrasse 41
94032 Passau

Germany

Activity type

Higher or Secondary Education Establishments

EU Contribution

€ 239 860,80

Partners (1)

Sort alphabetically

Expand all

MASSACHUSETTS INSTITUTE OF TECHNOLOGY

Project information

Grant agreement ID: 701236

Status

Ongoing project

  • Start date

    1 October 2016

  • End date

    30 September 2019

Funded under:

H2020-EU.1.3.2.

  • Overall budget:

    € 239 860,80

  • EU contribution

    € 239 860,80

Coordinated by:

UNIVERSITAT PASSAU

Germany