NIMA: Non-invasive Interface for Movement Augmentation

Información del proyecto

NIMA

Identificador del acuerdo de subvención: 899626

DOI

10.3030/899626

Proyecto cerrado

Fecha de la firma de la CE 26 Mayo 2020

Fecha de inicio 1 Octubre 2020

Fecha de finalización 31 Marzo 2024

Financiado con arreglo a

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Coste total

€ 3 076 488,75

Aportación de la UE

€ 3 076 488,75

Coordinado por

ALBERT-LUDWIGS-UNIVERSITAET FREIBURG
Germany

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (4)

Ethical guidelines on movement augmentation technology
Report on impact of movement augmentation on the natural motor system
Report on trimanual operation scenarios with variable mechanical coupling and different goals

Report on trimanual operation scenarios with variable mechanical coupling and different goals.

Report on workspace safety for Supernumerary limb

Open Research Data Pilot (2)

Initial Data Management Plan
Final Data Management Plan

Demonstrators, pilots, prototypes (4)

First release of the sensory feedback suit
Demonstration of three-tools surgery on a phantom
Augmented manipulation of mobile devices or computers
Final release of the sensory feedback suit

Websites, patent fillings, videos etc. (1)

Website and logo

Publicaciones

Peer reviewed articles (26)

Can Training Make Three Arms Better Than Two Heads for Trimanual Coordination?

Autores: Huang, Yanpei; Eden, Jonathan; Ivanova, Ekaterina; Burdet, Etienne
Publicado en: IEEE Open Journal of Engineering in Medicine and Biology, Edición Volume 4, 2023, Página(s) 148 - 155, ISSN 2644-1276
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ojemb.2023.3305808

Design and Evaluation of a Foot-Controlled Robotic System for Endoscopic Surgery

Autores: Yanpei Huang, Wenjie Lai, Lin Cao, Etienne Burdet, Soo Jay Phee
Publicado en: IEEE Robotics and Automation Letters, Edición 6/2, 2021, Página(s) 2469-2476, ISSN 2377-3766
Editor: IEEE
DOI: 10.1109/lra.2021.3062009

Impact of supplementary sensory feedback on the control and embodiment in human movement augmentation

Autores: Pinardi M., Longo M.R., Formica D., Strbac M., Mehring C., Burdet E., Di Pino G.
Publicado en: Communications Engineering, Edición 2, Article number: 64, 2023, ISSN 2731-3395
Editor: Springer
DOI: 10.1038/s44172-023-00111-1

Identification of multiple limbs coordination strategies in a three-goal independent task

Autores: Yanpei Huang; Ekaterina Ivanova; Jonathan Eden; Etienne Burdet
Publicado en: IEEE Transactions on Medical Robotics and Bionics, Edición 7, 2022, Página(s) Volume 4, Edición 2, Pages 348 - 3511 May 2022, ISSN 2576-3202
Editor: IEEE Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/tmrb.2021.3124263

A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Surgical Robot

Autores: Yanpei Huang, Etienne Burdet, Lin Cao, Phuoc Thien Phan, Anthony Meng Huat Tiong, Soo Jay Phee
Publicado en: IEEE/ASME Transactions on Mechatronics, Edición 25/2, 2020, Página(s) 951-963, ISSN 1083-4435
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmech.2020.2964295

A Three-Limb Teleoperated Robotic System with Foot Control for Flexible Endoscopic Surgery

Autores: Yanpei Huang; Yanpei Huang; Wenjie Lai; Lin Cao; Jiajun Liu; Xiaoguo Li; Etienne Burdet; Soo Jay Phee
Publicado en: Annals of Biomedical EngineeringOpen AccessVolume 49, Edición 9, Pages 2282 - 2296September 2021, Edición 5, 2021, ISSN 0090-6964
Editor: Kluwer Academic Publishers
DOI: 10.48550/arxiv.2007.05927

Design of multi‐pad electrotactile system envisioned as a feedback channel for supernumerary robotic limbs

Autores: Boljanić, Tanja; Isaković, Milica; Malešević, Jovana; Formica, Domenico; Di Pino, Giovanni; Keller, Thierry; Štrbac, Matija
Publicado en: Artificial Organs, Edición vol. 46, no. 3, pp. 36–41, 2022,, 2022, ISSN 0160-564X
Editor: Blackwell Publishing Inc.
DOI: 10.1111/aor.14339

The Ethics of Supernumerary Robotic Limbs. An Enactivist Approach

Autores: Di Stefano, Nicola; Jarrassé, Nathanaël; Valera, Luca
Publicado en: Science and Engineering Ethics, Edición vol. 28, no. 6, pp. 57, 2022, 2022, ISSN 1471-5546
Editor: Springer
DOI: 10.1007/s11948-022-00405-1

The impact of stiffness in bimanual versus dyadic interactions requiring force exchange

Autores: Nuria Peña-Perez; Sharah Abdul Mutalib; Jonathan Eden; Ildar Farkhatdinov; Etienne Burdet
Publicado en: IEEE Transactions on Haptics, Edición In press, 2023, ISSN 2329-4051
Editor: IEEE
DOI: 10.1109/toh.2023.3274584

Exploring crossmodal correspondences for future research in human movement augmentation

Autores: Pinardi, M., Di Stefano, N., Di Pino, G., Spence, C.
Publicado en: Frontiers in Psychology, 2023, ISSN 1664-1078
Editor: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2023.1190103

Learning to Assist Bimanual Teleoperation using Interval Type-2 Polynomial Fuzzy Inference

Autores: Z. Wang, H Fei, Y Huang, Q Rouxel, B Xiao, Z Li and E Burdet
Publicado en: IEEE Transactions on Cognitive and Developmental Systems 2023 (In press), 2023, ISSN 2379-8920
Editor: IEEE

Roboticists Want to Give You a Third Arm: Unused Bandwidth in Neurons Can be Tapped to Control Extra Limbs

Autores: Dario Farina; Etienne Burdet; Carsten Mehring; Jaime Ibáñez
Publicado en: IEEE Spectrum, Edición vol. 60, no. 3, pp. 22–46, 2023, 2023, ISSN 0018-9235
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mspec.2023.10061646

Human performance in three-hands tasks

Autores: A. Noccaro, J. Eden, G. Di Pino, D. Formica, E. Burdet
Publicado en: Scientific Reports, Edición 11/1, 2021, Página(s) 1-8, ISSN 2045-2322
Editor: Nature Publishing Group
DOI: 10.1038/s41598-021-88862-9

How virtual and mechanical coupling impact bimanual tracking.

Autores: Nuria Peña-Pérez; Jonathan Eden; Ekaterina Ivanova; Ildar Farkhatdinov; Etienne Burdet
Publicado en: Journal of Neurophysiology, Edición Volume 129, Edición 1, Pages 102 - 114 January 2023, 2023, ISSN 0022-3077
Editor: American Physiological Society
DOI: 10.1152/jn.00057.2022

The control and training of single motor units in isometric tasks are constrained by a common input signal

Autores: Mario Bräcklein; Deren Yusuf Barsakcioglu; Jaime Ibáñez; Jonathan Eden; Etienne Burdet; Carsten Mehring; Dario Farina
Publicado en: eLife, Edición Volume 11June 2022 Article number e72871, 2022, ISSN 2050-084X
Editor: eLife Sciences Publications
DOI: 10.7554/elife.72871

The control and training of single motor units in isometric tasks are constrained by a common synaptic input signal

Autores: Bräcklein, Mario; Ibáñez, Jaime; Barsakcioglu, Deren Yusuf; Eden, Jonathan; Burdet, Etienne; Mehring, Carsten; Farina, Dario
Publicado en: eLife, Edición Volume 11J Article number e72871, 2022, ISSN 2050-084X
Editor: eLife Sciences Publications
DOI: 10.1101/2021.08.03.454908

A Novel Training and Collaboration Integrated Framework for Human–Agent Teleoperation

Autores: Zebin Huang; Ziwei Wang; Weibang Bai; Yanpei Huang; Lichao Sun; Bo Xiao; Eric M. Yeatman
Publicado en: Sensors, Vol 21, Iss 8341, p 8341 (2021), Edición 13, 2021, ISSN 1424-8220
Editor: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21248341

Towards Human-Robot Collaborative Surgery: Trajectory and Strategy Learning in Bimanual Peg Transfer

Autores: Hu, Zhaoyang Jacopo; Wang, Ziwei; Huang, Yanpei; Sena, Aran; Rodriguez y Baena, Ferdinando; Burdet, Etienne
Publicado en: IEEE Robotics and Automation LettersVolume, Edición 8, Edición 8, 2023, Página(s) 4553 - 45601, ISSN 2377-3766
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/lra.2023.3285478

Reading and Modulating Cortical β Bursts from Motor Unit Spiking Activity.

Autores: Mario Bräcklein; Deren Y. Barsakcioglu; Alessandro Del Vecchio; Jaime Ibáñez; Dario Farina
Publicado en: Journal of Neuroscience, Edición Volume 42, Edición 17, Pages 3611 - 362127 April 2022, 2022, ISSN 0270-6474
Editor: Society for Neuroscience
DOI: 10.1523/jneurosci.1885-21.2022

Tri-Manipulation: An Evaluation of Human Performance in 3-Handed Teleoperation

Autores: Yanpei Huang, Jonathan Eden, Lin Cao, Etienne Burdet, Soo Jay Phee
Publicado en: IEEE Transactions on Medical Robotics and Bionics, Edición 2/4, 2020, Página(s) 545-548, ISSN 2576-3202
Editor: IEEE
DOI: 10.1109/tmrb.2020.3033137

Principles of human movement augmentation and the challenges in making it a reality

Autores: Jonathan Eden; Mario Bräcklein; Jaime Ibáñez; Deren Yusuf Barsakcioglu; Giovanni Di Pino; Dario Farina; Etienne Burdet; Carsten Mehring
Publicado en: Nature Communications, Edición Volume 13, Edición 1December 2022 Article number 1345, 2022, ISSN 2041-1723
Editor: Nature Publishing Group
DOI: 10.1038/s41467-022-28725-7

Identification of inverse kinematic parameters in redundant systems: Towards quantification of inter-joint coordination in the human upper extremity

Autores: Mahdi Khoramshahi; Agnes Roby-Brami; Ross Parry; Nathanaël Jarrassé
Publicado en: PLoS ONE, Edición Volume 17, Edición 12 DecemberDecember 2022 Article number e0278228, 2022, ISSN 1932-6203
Editor: Public Library of Science
DOI: 10.1371/journal.pone.0278228

Effect of Vibrotactile Feedback on the Control of the Interaction Force of a Supernumerary Robotic Arm

Autores: Buratti, Silvia; Deiana, Davide; Noccaro, Alessia; Pinardi, Mattia; Di Pino, Giovanni; Di Pino G.; Formica, Domenico; Jarrassé, Nathanaël
Publicado en: MachinesOpen AccessVolume 11, Edición 12 December 2023 Article number 1085, Edición 12, 2023, ISSN 2075-1702
Editor: MDPI
DOI: 10.3390/machines11121085

Control limitations in the null-space of the wrist muscle system

Autores: Meng-Jung Lee, Jonathan Eden, Sergio Gurgone, Denise J Berger, Daniele Borzelli, Andrea d’Avella, Carsten Mehring, Etienne Burdet
Publicado en: Scientific Reports, Edición 14, 2024, ISSN 2045-2322
Editor: Nature Publishing Group
DOI: 10.1038/s41598-024-69353-z

Is a Robot Needed to Modify Human Effort in Bimanual Tracking?

Autores: Nuria Peña Perez; Jonathan Eden; Ekaterina Ivanova; Etienne Burdet; Ildar Farkhatdinov
Publicado en: IEEE Robotics and Automation Letters, Edición Volume 7, Edición 3, Pages 8069 - 80751 July 2022, 2022, ISSN 2377-3766
Editor: IEEE
DOI: 10.1109/lra.2022.3183753

Comparing end-effector position and joint angle feedback for online robotic limb tracking

Autores: Pinardi M., Raiano L., Noccaro A., Formica D. and G. Di Pino
Publicado en: PLoS ONE, 2023, ISSN 1932-6203
Editor: Public Library of Science

Conference proceedings (18)

Mental Tasks Modulate Motor-Units Above 10 Hz and are a Potential Control Signal for Movement Augmentation: a Preliminary Study

Autores: Ofner P., Lee M.J., Farina D. and Mehring C
Publicado en: IEEE EMBC 2023, 2023
Editor: IEEE
DOI: 10.1109/embc40787.2023.10340378

Perception and Performance of Electrical Stimulation for Proprioception

Autores: C. Blondin, E. Ivanova, J. Eden and E. Burdet
Publicado en: 3rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021Virtual, Online1 November 2021through 5 November 2021, 2021
Editor: IEEE
DOI: 10.1109/embc46164.2021.9630186

Comparison of human trimanual performance between independent and dependent multiple-limb training modes

Autores: Allemang-Trivalle, Arnaud; Eden, Jonathan; Huang, Yanpei; Ivanova, Ekaterina; Burdet, Etienne
Publicado en: 9th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, BioRob 2022Seoul21 August 2022through 24 August 2022, 2022
Editor: IEEE
DOI: 10.1109/biorob52689.2022.9925417

Foot gestures to control the grasping of a surgical robot

Autores: Y Cheng, Y Huang, Z Wang and E. Burdet,
Publicado en: IEEE International Conference on Robotics and Automation (ICRA), 2023, in Press., 2023
Editor: IEEE

Trimanipulation: Evaluation of human performance in a 3-handed coordination task

Autores: Yanpei Huang, Jonathan Eden, Ekaterina Ivanova, Soo Jay Phee, Etienne Burdet
Publicado en: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, 2021
Editor: IEEE

Human Performance of Three Hands in Unimanual, Bimanual and Trimanual Tasks

Autores: Y. Huang, J. Eden, E. Ivanova and E. Burdet
Publicado en: 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022Glasgow11 July 2022through 15 July 2022, 2022, Página(s) 2022, ISSN 1557-170X
Editor: IEEE
DOI: 10.1109/embc48229.2022.9871248

Dissociating haptic feedback from physical assistance does not improve motor performance

Autores: E. Ivanova, N. Peña-Perez, J. Eden, Y. Yip and E. Burdet
Publicado en: Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023, (in press)., 2023
Editor: IEEE

A Novel Proprioceptive Feedback System for Supernumerary Robotic Limb

Autores: A. Noccaro, L. Raiano, M. Pinardi, D. Formica, G. Di Pino
Publicado en: 2020 8th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob), 2020, Página(s) 1024-1029, ISBN 978-1-7281-5907-2
Editor: IEEE
DOI: 10.1109/biorob49111.2020.9224450

A third eye to augment environment perception

Autores: Meara, Mark O a; Cheng, Xiaoxiao a; Eden, Jonathan a, b; Ivanova, Ekaterina a, c; Ivanova E.; Burdet, Etienne a
Publicado en: IEEE International Workshop on Robot and Human Communication, RO-MANPages 1239 - 12442023 32nd IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2023Busan28 August 2023through 31 August 2023, 2023
Editor: IEEE
DOI: 10.1109/ro-man57019.2023.10309628

Validation of Vibrotactile Feedback to Improve Selective Motor Units Recruitment

Autores: Davide Deiana, Mattia Pinardi, Alessia Noccaro, Michela Iandoli, Giovanni Di Pino, Domenico Formica
Publicado en: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Edición 14, 2023, Página(s) 1-5
Editor: IEEE
DOI: 10.1109/memea57477.2023.10171925

Redundancy Resolution in Trimanual vs. Bimanual Tracking Tasks (in press)

Autores: A. Sanmartin-Senent, N. Peña-Perez, E. Burdet and J. Eden
Publicado en: Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023 (in press)., 2023
Editor: IEEE

A virtual reality planorm to evaluate the effects of supernumerary limbs’ appearance

Autores: Z. Jiang, Y. Huang, J. Eden, E. Ivanova, X. Cheng and E. Burdet
Publicado en: Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023 (in press)., 2023
Editor: IEEE

Intent-aware control in kinematically redundant systems: Towards collaborative wearable robots

Autores: M Khoramshahi, G Morel and N Jarrasse
Publicado en: 2021 IEEE International Conference on Robotics and Automation, ICRA 2021Xi'an30 May 2021through 5 June 2021, 2021
Editor: IEEE
DOI: 10.1109/icra48506.2021.9561351

Lateralization of Impedance Control in Dynamic Versus Static Bimanual Tasks

Autores: N. Peña-Perez, J. Eden, E. Burdet, I. Farkhatdinov and A. Takagi
Publicado en: 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022Glasgow11 July 2022through 15 July 2022, 2022
Editor: IEEE
DOI: 10.1109/embc48229.2022.9871013

Cartesian Space Feedback for Real Time Tracking of a Supernumerary Robotic Limb: a Pilot Study

Autores: M. Pinardi, L. Raiano, A. Noccaro, D. Formica, G. Di Pino
Publicado en: 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER), 2021, Página(s) 889-892, ISBN 978-1-7281-4337-8
Editor: IEEE
DOI: 10.1109/ner49283.2021.9441174

A Practical Control Approach for Safe Collaborative Supernumerary Robotic Arms

Autores: Khoramshahi, Mahdi; Poignant, Alexis; Morel, Guillaume; Jarrasse, Nathanael
Publicado en: Proceedings of IEEE Workshop on Advanced Robotics and its Social Impacts, ARSOVolume 2023-June, Pages 147 - 1522023 2023 IEEE International Conference on Advanced Robotics and Its Social Impacts, ARSO 2023Berlin5 June 2023through 7 June 2023, 2023, ISBN 978-1-6654-6424-6
Editor: IEEE Institute of Electrical and Electronics Engineers
DOI: 10.1109/arso56563.2023.10187452

How long does it take to learn trimanual coordination?

Autores: Arnaud Allemang--Trivalle; Jonathan Eden; Ekaterina Ivanova; Yanpei Huang; Etienne Burdet
Publicado en: 31st IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2022Napoli29 August 2022through 2 September 2022Code 183330, 2022
Editor: IEEE
DOI: 10.1109/ro-man53752.2022.9900646

Evaluation of a 7-DoFs Robotic Manipulator as Haptic Interface During Planar Reaching Tasks

Autores: Noccaro, Alessia; Buscaglione, Silvia; Pinardi, Mattia; Di Pino, Giovanni; Formica, Domenico
Publicado en: IEEE International Conference on Intelligent Robots and SystemsPages 5095 - 51002023 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2023Detroit1 October 2023through 5 October 2023, 2023, ISSN 2153-0858
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/iros55552.2023.10342470

Other (3)

Comparing different vibrotactile strategies to encode motor units’ activation states

Autores: Deiana, D., Pinardi, M., Noccaro, A., Iandoli, M., Formica, D., Di Pino, G.
Publicado en: ICRA 2023 Workshop on the robotics and neuroscience of supernumerary limbs, Poster session., 2023
Editor: Imperial College London

Somatosensory Attenuation as a marker for Embodiment of Supernumerary Robotic Limbs

Autores: Pinardi, M., Maciejewska, K., D’Alonzo, M., Di Pino, G
Publicado en: ICRA 2023 Workshop on the robotics and neuroscience of supernumerary limbs, Poster session., 2023
Editor: Imperial College London

Virtually turning robotic manipulators into worn devices: opening new horizons for wearable assistive robotics

Autores: A Poignant, N Jarrassé and G Morel
Publicado en: arXiv preprint arXiv 2211.08483 2023, 2023
Editor: Cornell University
DOI: 10.48550/arxiv.2211.08483