Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Employment of Advanced Deep Learning and Human-Robot Interaction for Virtual Coaching

Project description

A robot coach for the elderly

Physical activity for older adults prevents numerous diseases and increases quality of life. The EU-funded Dr VCoach project will design and deploy a robotic coach to assist elderly people during daily physical training. Specifically, the robot will understand verbal commands (e.g. "Today, I feel tired, can we do a lighter training?"), define and show the exercises to the user, monitor their performance and suggest improvements. The entire system will consist of a speech module, an exercise scheduler, an error detector, an action recognition and a prediction module. It will use RGB cameras and advanced deep learning systems implemented on a humanoid robot equipped with a middleware layer that makes it programmable by non-technical users.

Objective

The main objective of this project (DR VCoach) will be the following: “Design and implement a robotic coach able to propose a proper exercise schedule based on human directives, monitor the exercise performed by the patient/elder and correct it in case of mistakes”. The output of the project will be a robotic coach to assist the elders during their daily physical training. The robot will be able to understand verbal commands from the user (e.g. what will be the training schedule of today? Today I feel tired, can we do a lighter training?), to define the sequence of exercises to be performed, to show the exercises to the user (with a verbal description and performing them by it-self), to monitor the user performing the exercises using RGB cameras, to eventually find some errors in the execution and to suggest a correction to the mistake.

The whole system can be divided into four modules:

- Speech module: This is the module in charge of the vocal interaction between the robot and the elders.

- Exercise scheduler: The role of this module is to break the selected exercise into atomic actions, and send these actions to the Error detector and Action recognition and prediction modules.

- Error detector: The Error detector module analyses the results coming from the Action recognition and prediction module based on the required actions received by the Exercise scheduler. After evaluating the performed action, the module sends an evaluation report to the speech module in order to inform the elder.

- Action recognition and prediction: This module has the dual task of recognising the action performed by the elder using the RGB videos coming from its embedded camera, and predicting the future viso-proprioceptive stimuli based on the action that is being performed.

The system will be implemented on Zora (a NAO robot with a software layer to make it usable by non ICT people).

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

MSCA-IF - Marie Skłodowska-Curie Individual Fellowships (IF)

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) H2020-MSCA-IF-2020

See all projects funded under this call

Coordinator

UNIVERSITA DEGLI STUDI DI CAGLIARI
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 171 473,28
Address
VIA UNIVERSITA 40
09124 CAGLIARI
Italy

See on map

Region
Isole Sardegna Cagliari
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

€ 171 473,28
My booklet 0 0