Periodic Reporting for period 3 - RADIO (Robots in assisted living environments: Unobtrusive, efficient, reliable and modular solutions for independent ageing)
Berichtszeitraum: 2017-04-01 bis 2018-03-31
Demographic and epidemiologic transitions have brought a new health care paradigm with the presence of both growing elderly population and chronic diseases. People live longer but in some cases these years are spent with chronic illnesses. This has great impact to both the quality of life of older people and to the public expenditure for Long Term Care. At the same time, low staffing ratios bring an economic and quality struggle to Institutional Care.
RADIO pursues a novel approach to user acceptance and unobtrusiveness, developing and integrating robotics and home automation technologies that accommodate users’ daily living needs, while assuming interaction with the users as an opportunity for clinical monitoring. In this manner, clinical monitoring sensors do not need to be masked but become an obvious, yet discrete and accepted, part of the user’s daily life. The relevant technical objective was to develop methods for recognizing Activities of Daily Living which indicate early symptoms of cognitive impairment, frailty, and social exclusion; and to integrate these methods into the RADIO Home, a system based on existing reliable, safe, and low-cost robotics and home automation solutions. RADIO Home will form a modular system that can be deployed in different configurations and mixes of components without requiring extensive effort or specialized knowledge. RADIO also envisages to integrate multiple RADIO Home deployments, medical institutions, and informal care givers into an information management and sharing ecosystem that is by design scalable, secure, and privacy-preserving.
RADIO pursues a novel approach to user acceptance and unobtrusiveness, developing and integrating robotics and home automation technologies that accommodate users’ daily living needs, while assuming interaction with the users as an opportunity for clinical monitoring. In this manner, clinical monitoring sensors do not need to be masked but become an obvious, yet discrete and accepted, part of the user’s daily life. The relevant technical objective was to develop methods for recognizing Activities of Daily Living which indicate early symptoms of cognitive impairment, frailty, and social exclusion; and to integrate these methods into the RADIO Home, a system based on existing reliable, safe, and low-cost robotics and home automation solutions. RADIO Home will form a modular system that can be deployed in different configurations and mixes of components without requiring extensive effort or specialized knowledge. RADIO also envisages to integrate multiple RADIO Home deployments, medical institutions, and informal care givers into an information management and sharing ecosystem that is by design scalable, secure, and privacy-preserving.
The clinical requirements of the system were defined based on the interRAI assessment system, a set of comprehensive and standardized geriatric assessment tools for institutional and home settings. RADIO analysed the machine perception state of the art in order to establish which interRAI items can be automatically recognized reliably enough to be useful and what sensor data is needed for these perception technologies. Besides technical feasibility and privacy concerns with respect to the sensor data needed, RADIO carried out a more general discussion on obtrusiveness and how it balances with clinical monitoring requirements.
Clinical and unobtrusiveness requirements guided the design of the RADIO architecture, including the inventory of sensors and perception technologies that RADIO develops and integrates as well as the configurability and modularity of the design. What is stressed in the architecture is the modularity of the design, so that the system can adapt to different environments and to different individual clinical needs and perception of obtrusiveness.
Based on this architectural design, RADIO developed ADL and mood recognition methods that analyse a variety of raw data including audio-visual data, range scans, and text from social media interactions. RADIO also developed and integrated methods for localizing people and objects in the environment based on Bluetooth Low Energy (BLE) beacons, people identification, and home automation device usage. This inventory of elementary methods was fused into high-level recognition systems. The methods are physically instantiated on the robot’s on-board computer, on FPGA implementations, or on off-board Raspberry Pi devices. Together with the home automation sensors, this system of processing units creates a heterogeneous wireless networking environment including ZWave and BLE sensors and WiFi sensors and processors. RADIO investigated both the bridging and the communication robustness of this heterogeneous wireless network.
The RADIO prototype was tested at the Adolfo Muntañá Geriatric Centre, Granollers, Spain and at private homes in Patras, Greece. Regarding usability, both the primary users and caregivers showed a positive attitude towards the RADIO system. Regarding medical efficacy and the reliability of the measurements, the results were also very positive, especially at the more structured piloting room at Granollers. At the Patras pilots, usability from the perspective of the installation and maintenance technician was also tested. The system was proven to be possible to install within one working day in most cases, with few extremely adversarial environments and hardware or network failures hampering installation and operation.
Finally, RADIO proved the concept of connecting instances of the RADIO Home system and medical institutions into the RADIO Ecosystem, adding value to the health data collected by RADIO Homes by making it available not only for medical monitoring but also for medical research. Specifically, RADIO developed network security and access control guidelines for direct access to health data by the competent medical personnel. These were demonstrated through a visualization for monitoring particular primary users’ data, allowing access only to those datapoints for which each caregiver is granted access. Furthermore, RADIO developed the RASSP protocol for privacy-preserving data mining. This protocol allows medical researchers to compute statistics using an R language interface without accessing any of the individual datapoints used in the computation.
Clinical and unobtrusiveness requirements guided the design of the RADIO architecture, including the inventory of sensors and perception technologies that RADIO develops and integrates as well as the configurability and modularity of the design. What is stressed in the architecture is the modularity of the design, so that the system can adapt to different environments and to different individual clinical needs and perception of obtrusiveness.
Based on this architectural design, RADIO developed ADL and mood recognition methods that analyse a variety of raw data including audio-visual data, range scans, and text from social media interactions. RADIO also developed and integrated methods for localizing people and objects in the environment based on Bluetooth Low Energy (BLE) beacons, people identification, and home automation device usage. This inventory of elementary methods was fused into high-level recognition systems. The methods are physically instantiated on the robot’s on-board computer, on FPGA implementations, or on off-board Raspberry Pi devices. Together with the home automation sensors, this system of processing units creates a heterogeneous wireless networking environment including ZWave and BLE sensors and WiFi sensors and processors. RADIO investigated both the bridging and the communication robustness of this heterogeneous wireless network.
The RADIO prototype was tested at the Adolfo Muntañá Geriatric Centre, Granollers, Spain and at private homes in Patras, Greece. Regarding usability, both the primary users and caregivers showed a positive attitude towards the RADIO system. Regarding medical efficacy and the reliability of the measurements, the results were also very positive, especially at the more structured piloting room at Granollers. At the Patras pilots, usability from the perspective of the installation and maintenance technician was also tested. The system was proven to be possible to install within one working day in most cases, with few extremely adversarial environments and hardware or network failures hampering installation and operation.
Finally, RADIO proved the concept of connecting instances of the RADIO Home system and medical institutions into the RADIO Ecosystem, adding value to the health data collected by RADIO Homes by making it available not only for medical monitoring but also for medical research. Specifically, RADIO developed network security and access control guidelines for direct access to health data by the competent medical personnel. These were demonstrated through a visualization for monitoring particular primary users’ data, allowing access only to those datapoints for which each caregiver is granted access. Furthermore, RADIO developed the RASSP protocol for privacy-preserving data mining. This protocol allows medical researchers to compute statistics using an R language interface without accessing any of the individual datapoints used in the computation.
RADIO investigated how to bridge the gap between medical requirements and obtrusiveness considering individual preferences. A framework was established that organises the choices that need to be made and assigns obtrusiveness indices to what is technically possible. This will enable making informed decisions about what technical solutions are needed for each given end-user, and also provides insights about which technical advancements will have the most impact.
Towards enhancing the competitiveness of EU industry through business and expansion in new markets, RADIO developed a solution that is both scalable and transferable. Architectural and methodological work ensures that multiple RADIO Homes and care-givers can be interconnected in a scalable and secure ecosystem, including RADIO Homes integrating different key enabling technologies and addressing different societal needs and health problems.
In order to technically validate RADIO technologies, technical partners developed two realistic living environments for applying and evaluating RADIO technology: the Roboskel Lab (Athens) and the AAL House (Nafpaktos). The RADIO technology has drawn significant interest from companies specialized in home automation and ambient assisted living technologies, which have contributed as sponsors. Among the sponsoring companies are IKEA, Siemens, ABB, Dialog, CISCO, Embedded Systems and FUJITSU. The latter is considered especially important for RADIO since on one hand it exposes RADIO technology to key technology players and advocates future collaborations, while on the other hand it allows RADIO ecosystem to operate in collaboration with complementary technologies and products offered by the specific companies, which have significant portion of the worldwide market.
The RADIO Ecosystem is a central part of the overall solution offered in particular in light of the future project exploitation and commercialisation, as it touches upon uptake by medical institutions and public bodies. The most innovative outcome, and one that is already exploited in both academic projects and production systems in development, is the ability to serve sensitive health data to medical research without compromising privacy.
Towards enhancing the competitiveness of EU industry through business and expansion in new markets, RADIO developed a solution that is both scalable and transferable. Architectural and methodological work ensures that multiple RADIO Homes and care-givers can be interconnected in a scalable and secure ecosystem, including RADIO Homes integrating different key enabling technologies and addressing different societal needs and health problems.
In order to technically validate RADIO technologies, technical partners developed two realistic living environments for applying and evaluating RADIO technology: the Roboskel Lab (Athens) and the AAL House (Nafpaktos). The RADIO technology has drawn significant interest from companies specialized in home automation and ambient assisted living technologies, which have contributed as sponsors. Among the sponsoring companies are IKEA, Siemens, ABB, Dialog, CISCO, Embedded Systems and FUJITSU. The latter is considered especially important for RADIO since on one hand it exposes RADIO technology to key technology players and advocates future collaborations, while on the other hand it allows RADIO ecosystem to operate in collaboration with complementary technologies and products offered by the specific companies, which have significant portion of the worldwide market.
The RADIO Ecosystem is a central part of the overall solution offered in particular in light of the future project exploitation and commercialisation, as it touches upon uptake by medical institutions and public bodies. The most innovative outcome, and one that is already exploited in both academic projects and production systems in development, is the ability to serve sensitive health data to medical research without compromising privacy.