Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Advancing Social Robots for Personalised Healthcare through Multi-Sensor Fusion and Cognitive Large Language Model

Project description

Multi-sensor social robots for personalised healthcare

The EU’s population is ageing, leading to increased demand for long-term care and worker shortages. While social robots are being used for companionship in mental healthcare, they cannot monitor vital signs or deliver personalised care effectively. Supported by the Marie Skłodowska-Curie Actions programme, the HealRo project will develop the world’s first multi-sensor healthcare robot that continuously monitors vital health indicators, such as heart rate, for individuals in motion over long distances. It will also include a deep learning framework to integrate data from various sensors, enhancing affective computing by monitoring advanced indicators, such as stress and anxiety, to better assess seniors' mental health. Ultimately, a cognitive large language model (LLM) will handle complex reasoning tasks.

Objective

The EU population is ageing at an unprecedented rate, while the working-age population is shrinking. This demographic shift brings significant challenges, including rising demand for long-term care services, a healthcare workforce shortage, and pressure on pension and welfare systems. Recently, social robots have been adopted to provide companionship for human mental healthcare, while the current development is still at the preliminary stage, especially in the healthcare industry.

The general limitations of the current social robots are: (a) cannot support human physical healthcare by providing continuous monitoring of vital signs (e.g. respiration rate, heart rate, electrocardiogram), (b) cannot recognise advanced mental health indicators due to the unitary sensors that can only capture visual or acoustic information and (c) cannot provide personalised and empathetic responses for healthcare services.

HealRo, as the world’s first multi-sensor healthcare robot solution, is proposed to unleash the potential of social robots for daily healthcare by developing a robust multi-sensor system that can continuously monitor human physical health indicators (e.g. heart rate) for moving subjects over a long distance. In addition, a DL framework for information fusion should be designed to integrate the features extracted from different sensors and enhance affective computing beyond emotion recognition, with advanced indicators (e.g. stress and anxiety) monitored to better evaluate seniors’ mental health conditions. Lastly, a cognitive LLM is designed based on cognitive psychology to guide the LLM through complex reasoning tasks to generate empathetic and unbiased responses to eventually achieve personalised healthcare.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2025-PF

See all projects funded under this call

Coordinator

UNIVERSITY OF GLASGOW
Net EU contribution
€ 292 891,41
Address
UNIVERSITY AVENUE
G12 8QQ Glasgow
United Kingdom
Region
Scotland West Central Scotland Glasgow City
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data

Partners (1)