Increasing the robustness and neural integration of bidirectional prostheses for rehabilitation with robust and real time Independent Component Analysis

Informations projet

BIREHAB

N° de convention de subvention: 750947

DOI

10.3030/750947

Projet clôturé

Date de signature de la CE 17 Mars 2017

Date de début 1 Mai 2017

Date de fin 30 Avril 2019

Financé au titre de

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Coût total

€ 175 419,60

Contribution de l’UE

€ 175 419,60

Coordonné par

ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE
Switzerland

Periodic Reporting for period 1 - BIREHAB (Increasing the robustness and neural integration of bidirectional prostheses for rehabilitation withrobust and real time Independent Component Analysis)

Période du rapport: 2017-05-01 au 2019-04-30

Résumé du contexte et des objectifs généraux du projet

Hand loss is a highly disabling condition that adversely affects the quality of life, independence and mobility. Prostheses are only as useful as the richness of the sensation (i.e. “natural” - or as close to natural as possible - sensory feedback) and dexterity (ease of control and capabilities close to the intact human hand) that they provide. Most of the effort must be therefore directed towards the achievement of both natural prosthesis control and sensory feedback integration to overcome the barriers to effective usability of hand prostheses by patients and enable the personalization of rehabilitation protocols. BIREHAB has been developed in this framework with the aims of (i) determining the cognitive cortical mechanisms underlying tactile stimuli perception and (ii) simultaneously achieving robust myoelectric control of prostheses.

Travail effectué depuis le début du projet jusqu’à la fin de la période considérée dans le rapport et principaux résultats atteints jusqu’à présent

To determine the cognitive cortical mechanisms underlying tactile stimuli perception I have characterized the brain activity (Somatosensory Evoked Potentials – SEPs) of four amputees while undergoing neuromorphic electrical stimulation, which produced somatotopic sensations of tingling on the phantom hand. Furthermore I recruited 10 healthy subjects at the Campus Biotech facilities and performed a similar experiment both to validate the findings on amputees and compare somatotopic (referred) and non-somatotopic (local) stimulation. Finally I characterized the neural correlates of actual tactile sensations delivered by gratings slid beneath a finger on healthy subjects in a controlled way. The results show that only somatotopic stimulation evokes SEPs compatible with their generation by dipoles located in the somatosensory cortex, and whose scalp distribution resembles that generated by real tactile stimulation on healthy subjects.

Regarding the second objective of the proposal, I have carried out several methodological activities to optimize the processing of electromyographic (EMG) and electroencephalographic (EEG) data by means of Blind Source Separation techniques, which I applied, along with novel signal processing methodologies, in several fields, namely to find the electrophysiological correlates of syntax, to determine the selectivity of visual cortical activation produced by optic nerve intraneural stimulation, to implement a data-driven body–machine interface for the accurate control of drones. The results show that it is possible to combine reliable myoelectric control of prostheses and somatotopic stimulation to increase the robustness and neural integration of bidirectional prostheses.

Regarding dissemination and exploitation I have co-authored 11 journal papers (3 more in preparation), 5 papers at peer-reviewed conferences, I have participated to the Hannover Messe fair with a Startup project and I am in the process of preparing 3 patents. I have given 6 invited talks at conferences and workshops, taught lessons in 4 courses, regularly performed lab representation duties, supervised 15 students and regularly served as reviewer for various journals.

Progrès au-delà de l’état des connaissances et impact potentiel prévu (y compris l’impact socio-économique et les conséquences sociétales plus larges du projet jusqu’à présent)

By studying the neural correlates of tactile stimulation both by mechanical (gratings) and electrical (median and ulnar nerve somatotopic stimulation) it was possible to determine consistent bilateral somatosensory evoked potentials, sensitive to the stimulation modality, whose study can be used to benchmark and optimize tactile sensory substitution capabilities of upper limb prostheses. Furthermore, thanks to the development and application of robust independent component analysis techniques and a platform for the unified and synchronized real time collection and analysis of multiple data sources, it was possible to demonstrate the possibility of achieving robust myoelectric control of prostheses and increase the robustness of multivariate data analyses also in several different domains.

These results are especially relevant for society and especially amputees. Currently prostheses are often rejected by patients, chiefly due to their lack of sensory feedback and cognitive workload required for their use. The results brought forward by the project have the potential to successfully address these issues and improve the long term efficacy and quality of hand prostheses, enabling in the future near-natural replacement of missing hands, as well as help devising new upper limb rehabilitation strategies.

Tactile stimulation evoked brain activity

Transcutaneous electrical stimulation brain activity

Transcutaneous electrical stimulation platform

Tactile stimulation platform