NIMA: Non-invasive Interface for Movement Augmentation

Informations projet

NIMA

N° de convention de subvention: 899626

DOI

10.3030/899626

Projet clôturé

Date de signature de la CE 26 Mai 2020

Date de début 1 Octobre 2020

Date de fin 31 Mars 2024

Financé au titre de

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Coût total

€ 3 076 488,75

Contribution de l’UE

€ 3 076 488,75

Coordonné par

ALBERT-LUDWIGS-UNIVERSITAET FREIBURG
Germany

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (4)

Ethical guidelines on movement augmentation technology
Report on impact of movement augmentation on the natural motor system
Report on trimanual operation scenarios with variable mechanical coupling and different goals

Report on trimanual operation scenarios with variable mechanical coupling and different goals.

Report on workspace safety for Supernumerary limb

Open Research Data Pilot (2)

Initial Data Management Plan
Final Data Management Plan

Demonstrators, pilots, prototypes (4)

First release of the sensory feedback suit
Demonstration of three-tools surgery on a phantom
Augmented manipulation of mobile devices or computers
Final release of the sensory feedback suit

Websites, patent fillings, videos etc. (1)

Website and logo

Publications

Peer reviewed articles (26)

Can Training Make Three Arms Better Than Two Heads for Trimanual Coordination?

Auteurs: Huang, Yanpei; Eden, Jonathan; Ivanova, Ekaterina; Burdet, Etienne
Publié dans: IEEE Open Journal of Engineering in Medicine and Biology, Numéro Volume 4, 2023, Page(s) 148 - 155, ISSN 2644-1276
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ojemb.2023.3305808

Design and Evaluation of a Foot-Controlled Robotic System for Endoscopic Surgery

Auteurs: Yanpei Huang, Wenjie Lai, Lin Cao, Etienne Burdet, Soo Jay Phee
Publié dans: IEEE Robotics and Automation Letters, Numéro 6/2, 2021, Page(s) 2469-2476, ISSN 2377-3766
Éditeur: IEEE
DOI: 10.1109/lra.2021.3062009

Impact of supplementary sensory feedback on the control and embodiment in human movement augmentation

Auteurs: Pinardi M., Longo M.R., Formica D., Strbac M., Mehring C., Burdet E., Di Pino G.
Publié dans: Communications Engineering, Numéro 2, Article number: 64, 2023, ISSN 2731-3395
Éditeur: Springer
DOI: 10.1038/s44172-023-00111-1

Identification of multiple limbs coordination strategies in a three-goal independent task

Auteurs: Yanpei Huang; Ekaterina Ivanova; Jonathan Eden; Etienne Burdet
Publié dans: IEEE Transactions on Medical Robotics and Bionics, Numéro 7, 2022, Page(s) Volume 4, Numéro 2, Pages 348 - 3511 May 2022, ISSN 2576-3202
Éditeur: IEEE Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/tmrb.2021.3124263

A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Surgical Robot

Auteurs: Yanpei Huang, Etienne Burdet, Lin Cao, Phuoc Thien Phan, Anthony Meng Huat Tiong, Soo Jay Phee
Publié dans: IEEE/ASME Transactions on Mechatronics, Numéro 25/2, 2020, Page(s) 951-963, ISSN 1083-4435
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmech.2020.2964295

A Three-Limb Teleoperated Robotic System with Foot Control for Flexible Endoscopic Surgery

Auteurs: Yanpei Huang; Yanpei Huang; Wenjie Lai; Lin Cao; Jiajun Liu; Xiaoguo Li; Etienne Burdet; Soo Jay Phee
Publié dans: Annals of Biomedical EngineeringOpen AccessVolume 49, Numéro 9, Pages 2282 - 2296September 2021, Numéro 5, 2021, ISSN 0090-6964
Éditeur: Kluwer Academic Publishers
DOI: 10.48550/arxiv.2007.05927

Design of multi‐pad electrotactile system envisioned as a feedback channel for supernumerary robotic limbs

Auteurs: Boljanić, Tanja; Isaković, Milica; Malešević, Jovana; Formica, Domenico; Di Pino, Giovanni; Keller, Thierry; Štrbac, Matija
Publié dans: Artificial Organs, Numéro vol. 46, no. 3, pp. 36–41, 2022,, 2022, ISSN 0160-564X
Éditeur: Blackwell Publishing Inc.
DOI: 10.1111/aor.14339

The Ethics of Supernumerary Robotic Limbs. An Enactivist Approach

Auteurs: Di Stefano, Nicola; Jarrassé, Nathanaël; Valera, Luca
Publié dans: Science and Engineering Ethics, Numéro vol. 28, no. 6, pp. 57, 2022, 2022, ISSN 1471-5546
Éditeur: Springer
DOI: 10.1007/s11948-022-00405-1

The impact of stiffness in bimanual versus dyadic interactions requiring force exchange

Auteurs: Nuria Peña-Perez; Sharah Abdul Mutalib; Jonathan Eden; Ildar Farkhatdinov; Etienne Burdet
Publié dans: IEEE Transactions on Haptics, Numéro In press, 2023, ISSN 2329-4051
Éditeur: IEEE
DOI: 10.1109/toh.2023.3274584

Exploring crossmodal correspondences for future research in human movement augmentation

Auteurs: Pinardi, M., Di Stefano, N., Di Pino, G., Spence, C.
Publié dans: Frontiers in Psychology, 2023, ISSN 1664-1078
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2023.1190103

Learning to Assist Bimanual Teleoperation using Interval Type-2 Polynomial Fuzzy Inference

Auteurs: Z. Wang, H Fei, Y Huang, Q Rouxel, B Xiao, Z Li and E Burdet
Publié dans: IEEE Transactions on Cognitive and Developmental Systems 2023 (In press), 2023, ISSN 2379-8920
Éditeur: IEEE

Roboticists Want to Give You a Third Arm: Unused Bandwidth in Neurons Can be Tapped to Control Extra Limbs

Auteurs: Dario Farina; Etienne Burdet; Carsten Mehring; Jaime Ibáñez
Publié dans: IEEE Spectrum, Numéro vol. 60, no. 3, pp. 22–46, 2023, 2023, ISSN 0018-9235
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mspec.2023.10061646

Human performance in three-hands tasks

Auteurs: A. Noccaro, J. Eden, G. Di Pino, D. Formica, E. Burdet
Publié dans: Scientific Reports, Numéro 11/1, 2021, Page(s) 1-8, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-021-88862-9

How virtual and mechanical coupling impact bimanual tracking.

Auteurs: Nuria Peña-Pérez; Jonathan Eden; Ekaterina Ivanova; Ildar Farkhatdinov; Etienne Burdet
Publié dans: Journal of Neurophysiology, Numéro Volume 129, Numéro 1, Pages 102 - 114 January 2023, 2023, ISSN 0022-3077
Éditeur: American Physiological Society
DOI: 10.1152/jn.00057.2022

The control and training of single motor units in isometric tasks are constrained by a common input signal

Auteurs: Mario Bräcklein; Deren Yusuf Barsakcioglu; Jaime Ibáñez; Jonathan Eden; Etienne Burdet; Carsten Mehring; Dario Farina
Publié dans: eLife, Numéro Volume 11June 2022 Article number e72871, 2022, ISSN 2050-084X
Éditeur: eLife Sciences Publications
DOI: 10.7554/elife.72871

The control and training of single motor units in isometric tasks are constrained by a common synaptic input signal

Auteurs: Bräcklein, Mario; Ibáñez, Jaime; Barsakcioglu, Deren Yusuf; Eden, Jonathan; Burdet, Etienne; Mehring, Carsten; Farina, Dario
Publié dans: eLife, Numéro Volume 11J Article number e72871, 2022, ISSN 2050-084X
Éditeur: eLife Sciences Publications
DOI: 10.1101/2021.08.03.454908

A Novel Training and Collaboration Integrated Framework for Human–Agent Teleoperation

Auteurs: Zebin Huang; Ziwei Wang; Weibang Bai; Yanpei Huang; Lichao Sun; Bo Xiao; Eric M. Yeatman
Publié dans: Sensors, Vol 21, Iss 8341, p 8341 (2021), Numéro 13, 2021, ISSN 1424-8220
Éditeur: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21248341

Towards Human-Robot Collaborative Surgery: Trajectory and Strategy Learning in Bimanual Peg Transfer

Auteurs: Hu, Zhaoyang Jacopo; Wang, Ziwei; Huang, Yanpei; Sena, Aran; Rodriguez y Baena, Ferdinando; Burdet, Etienne
Publié dans: IEEE Robotics and Automation LettersVolume, Numéro 8, Numéro 8, 2023, Page(s) 4553 - 45601, ISSN 2377-3766
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/lra.2023.3285478

Reading and Modulating Cortical β Bursts from Motor Unit Spiking Activity.

Auteurs: Mario Bräcklein; Deren Y. Barsakcioglu; Alessandro Del Vecchio; Jaime Ibáñez; Dario Farina
Publié dans: Journal of Neuroscience, Numéro Volume 42, Numéro 17, Pages 3611 - 362127 April 2022, 2022, ISSN 0270-6474
Éditeur: Society for Neuroscience
DOI: 10.1523/jneurosci.1885-21.2022

Tri-Manipulation: An Evaluation of Human Performance in 3-Handed Teleoperation

Auteurs: Yanpei Huang, Jonathan Eden, Lin Cao, Etienne Burdet, Soo Jay Phee
Publié dans: IEEE Transactions on Medical Robotics and Bionics, Numéro 2/4, 2020, Page(s) 545-548, ISSN 2576-3202
Éditeur: IEEE
DOI: 10.1109/tmrb.2020.3033137

Principles of human movement augmentation and the challenges in making it a reality

Auteurs: Jonathan Eden; Mario Bräcklein; Jaime Ibáñez; Deren Yusuf Barsakcioglu; Giovanni Di Pino; Dario Farina; Etienne Burdet; Carsten Mehring
Publié dans: Nature Communications, Numéro Volume 13, Numéro 1December 2022 Article number 1345, 2022, ISSN 2041-1723
Éditeur: Nature Publishing Group
DOI: 10.1038/s41467-022-28725-7

Identification of inverse kinematic parameters in redundant systems: Towards quantification of inter-joint coordination in the human upper extremity

Auteurs: Mahdi Khoramshahi; Agnes Roby-Brami; Ross Parry; Nathanaël Jarrassé
Publié dans: PLoS ONE, Numéro Volume 17, Numéro 12 DecemberDecember 2022 Article number e0278228, 2022, ISSN 1932-6203
Éditeur: Public Library of Science
DOI: 10.1371/journal.pone.0278228

Effect of Vibrotactile Feedback on the Control of the Interaction Force of a Supernumerary Robotic Arm

Auteurs: Buratti, Silvia; Deiana, Davide; Noccaro, Alessia; Pinardi, Mattia; Di Pino, Giovanni; Di Pino G.; Formica, Domenico; Jarrassé, Nathanaël
Publié dans: MachinesOpen AccessVolume 11, Numéro 12 December 2023 Article number 1085, Numéro 12, 2023, ISSN 2075-1702
Éditeur: MDPI
DOI: 10.3390/machines11121085

Control limitations in the null-space of the wrist muscle system

Auteurs: Meng-Jung Lee, Jonathan Eden, Sergio Gurgone, Denise J Berger, Daniele Borzelli, Andrea d’Avella, Carsten Mehring, Etienne Burdet
Publié dans: Scientific Reports, Numéro 14, 2024, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-024-69353-z

Is a Robot Needed to Modify Human Effort in Bimanual Tracking?

Auteurs: Nuria Peña Perez; Jonathan Eden; Ekaterina Ivanova; Etienne Burdet; Ildar Farkhatdinov
Publié dans: IEEE Robotics and Automation Letters, Numéro Volume 7, Numéro 3, Pages 8069 - 80751 July 2022, 2022, ISSN 2377-3766
Éditeur: IEEE
DOI: 10.1109/lra.2022.3183753

Comparing end-effector position and joint angle feedback for online robotic limb tracking

Auteurs: Pinardi M., Raiano L., Noccaro A., Formica D. and G. Di Pino
Publié dans: PLoS ONE, 2023, ISSN 1932-6203
Éditeur: Public Library of Science

Conference proceedings (18)

Mental Tasks Modulate Motor-Units Above 10 Hz and are a Potential Control Signal for Movement Augmentation: a Preliminary Study

Auteurs: Ofner P., Lee M.J., Farina D. and Mehring C
Publié dans: IEEE EMBC 2023, 2023
Éditeur: IEEE
DOI: 10.1109/embc40787.2023.10340378

Perception and Performance of Electrical Stimulation for Proprioception

Auteurs: C. Blondin, E. Ivanova, J. Eden and E. Burdet
Publié dans: 3rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021Virtual, Online1 November 2021through 5 November 2021, 2021
Éditeur: IEEE
DOI: 10.1109/embc46164.2021.9630186

Comparison of human trimanual performance between independent and dependent multiple-limb training modes

Auteurs: Allemang-Trivalle, Arnaud; Eden, Jonathan; Huang, Yanpei; Ivanova, Ekaterina; Burdet, Etienne
Publié dans: 9th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, BioRob 2022Seoul21 August 2022through 24 August 2022, 2022
Éditeur: IEEE
DOI: 10.1109/biorob52689.2022.9925417

Foot gestures to control the grasping of a surgical robot

Auteurs: Y Cheng, Y Huang, Z Wang and E. Burdet,
Publié dans: IEEE International Conference on Robotics and Automation (ICRA), 2023, in Press., 2023
Éditeur: IEEE

Trimanipulation: Evaluation of human performance in a 3-handed coordination task

Auteurs: Yanpei Huang, Jonathan Eden, Ekaterina Ivanova, Soo Jay Phee, Etienne Burdet
Publié dans: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 2021
Éditeur: IEEE

Human Performance of Three Hands in Unimanual, Bimanual and Trimanual Tasks

Auteurs: Y. Huang, J. Eden, E. Ivanova and E. Burdet
Publié dans: 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022Glasgow11 July 2022through 15 July 2022, 2022, Page(s) 2022, ISSN 1557-170X
Éditeur: IEEE
DOI: 10.1109/embc48229.2022.9871248

Dissociating haptic feedback from physical assistance does not improve motor performance

Auteurs: E. Ivanova, N. Peña-Perez, J. Eden, Y. Yip and E. Burdet
Publié dans: Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023, (in press)., 2023
Éditeur: IEEE

A Novel Proprioceptive Feedback System for Supernumerary Robotic Limb

Auteurs: A. Noccaro, L. Raiano, M. Pinardi, D. Formica, G. Di Pino
Publié dans: 2020 8th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob), 2020, Page(s) 1024-1029, ISBN 978-1-7281-5907-2
Éditeur: IEEE
DOI: 10.1109/biorob49111.2020.9224450

A third eye to augment environment perception

Auteurs: Meara, Mark O a; Cheng, Xiaoxiao a; Eden, Jonathan a, b; Ivanova, Ekaterina a, c; Ivanova E.; Burdet, Etienne a
Publié dans: IEEE International Workshop on Robot and Human Communication, RO-MANPages 1239 - 12442023 32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023Busan28 August 2023through 31 August 2023, 2023
Éditeur: IEEE
DOI: 10.1109/ro-man57019.2023.10309628

Validation of Vibrotactile Feedback to Improve Selective Motor Units Recruitment

Auteurs: Davide Deiana, Mattia Pinardi, Alessia Noccaro, Michela Iandoli, Giovanni Di Pino, Domenico Formica
Publié dans: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Numéro 14, 2023, Page(s) 1-5
Éditeur: IEEE
DOI: 10.1109/memea57477.2023.10171925

Redundancy Resolution in Trimanual vs. Bimanual Tracking Tasks (in press)

Auteurs: A. Sanmartin-Senent, N. Peña-Perez, E. Burdet and J. Eden
Publié dans: Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023 (in press)., 2023
Éditeur: IEEE

A virtual reality planorm to evaluate the effects of supernumerary limbs’ appearance

Auteurs: Z. Jiang, Y. Huang, J. Eden, E. Ivanova, X. Cheng and E. Burdet
Publié dans: Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023 (in press)., 2023
Éditeur: IEEE

Intent-aware control in kinematically redundant systems: Towards collaborative wearable robots

Auteurs: M Khoramshahi, G Morel and N Jarrasse
Publié dans: 2021 IEEE International Conference on Robotics and Automation, ICRA 2021Xi'an30 May 2021through 5 June 2021, 2021
Éditeur: IEEE
DOI: 10.1109/icra48506.2021.9561351

Lateralization of Impedance Control in Dynamic Versus Static Bimanual Tasks

Auteurs: N. Peña-Perez, J. Eden, E. Burdet, I. Farkhatdinov and A. Takagi
Publié dans: 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022Glasgow11 July 2022through 15 July 2022, 2022
Éditeur: IEEE
DOI: 10.1109/embc48229.2022.9871013

Cartesian Space Feedback for Real Time Tracking of a Supernumerary Robotic Limb: a Pilot Study

Auteurs: M. Pinardi, L. Raiano, A. Noccaro, D. Formica, G. Di Pino
Publié dans: 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER), 2021, Page(s) 889-892, ISBN 978-1-7281-4337-8
Éditeur: IEEE
DOI: 10.1109/ner49283.2021.9441174

A Practical Control Approach for Safe Collaborative Supernumerary Robotic Arms

Auteurs: Khoramshahi, Mahdi; Poignant, Alexis; Morel, Guillaume; Jarrasse, Nathanael
Publié dans: Proceedings of IEEE Workshop on Advanced Robotics and its Social Impacts, ARSOVolume 2023-June, Pages 147 - 1522023 2023 IEEE International Conference on Advanced Robotics and Its Social Impacts, ARSO 2023Berlin5 June 2023through 7 June 2023, 2023, ISBN 978-1-6654-6424-6
Éditeur: IEEE Institute of Electrical and Electronics Engineers
DOI: 10.1109/arso56563.2023.10187452

How long does it take to learn trimanual coordination?

Auteurs: Arnaud Allemang--Trivalle; Jonathan Eden; Ekaterina Ivanova; Yanpei Huang; Etienne Burdet
Publié dans: 31st IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2022Napoli29 August 2022through 2 September 2022Code 183330, 2022
Éditeur: IEEE
DOI: 10.1109/ro-man53752.2022.9900646

Evaluation of a 7-DoFs Robotic Manipulator as Haptic Interface During Planar Reaching Tasks

Auteurs: Noccaro, Alessia; Buscaglione, Silvia; Pinardi, Mattia; Di Pino, Giovanni; Formica, Domenico
Publié dans: IEEE International Conference on Intelligent Robots and SystemsPages 5095 - 51002023 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2023Detroit1 October 2023through 5 October 2023, 2023, ISSN 2153-0858
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/iros55552.2023.10342470

Other (3)

Comparing different vibrotactile strategies to encode motor units’ activation states

Auteurs: Deiana, D., Pinardi, M., Noccaro, A., Iandoli, M., Formica, D., Di Pino, G.
Publié dans: ICRA 2023 Workshop on the robotics and neuroscience of supernumerary limbs, Poster session., 2023
Éditeur: Imperial College London

Somatosensory Attenuation as a marker for Embodiment of Supernumerary Robotic Limbs

Auteurs: Pinardi, M., Maciejewska, K., D’Alonzo, M., Di Pino, G
Publié dans: ICRA 2023 Workshop on the robotics and neuroscience of supernumerary limbs, Poster session., 2023
Éditeur: Imperial College London

Virtually turning robotic manipulators into worn devices: opening new horizons for wearable assistive robotics

Auteurs: A Poignant, N Jarrassé and G Morel
Publié dans: arXiv preprint arXiv 2211.08483 2023, 2023
Éditeur: Cornell University
DOI: 10.48550/arxiv.2211.08483