Performance in Robots Interaction via Mental Imagery

Projektinformationen

PRIMI

ID Finanzhilfevereinbarung: 101120727

DOI

10.3030/101120727

EK-Unterschriftsdatum 3 Juli 2023

Startdatum 1 November 2023

Enddatum 31 Dezember 2027

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 4 973 683,75

EU-Beitrag

€ 4 973 683,75

Koordiniert durch

FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Italy

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (13)

Initial report on Large Scale Spiking Neural Network models for Imagery Enabled Neuromorphic Robotics

Scientific report on preliminary computer simulations of a first version of Large Scale Adaptive Timescale Recurrent Spiking Neural Networks (LATRSNN) or other suitable architectures with SpiNNaker1. Long short term memory capability will be delivered in month 24

Specification for integration of neuromorphic sensors

Technical report on transfer neuromorphic perception in REEM-C and other humanoids

First report on data collection

Update on the collection of neurocognitive data

First Report on PRIMI cognitive architecture with iCub and Kangaroo

Results of the integration and experimentation in laboratory of the PRIMI cognitive architecture with mental imagery.Updates will be produced on month 24 and 36.

Cognitive architecture, model designs, integration

Specification and preliminary results in computer simulations of the cognitive architecture. Leading research group for this deliverable IIT-FE.

Framework for social abilities of neuromorphic robots

Results of HRI experiments of neuromorphic models and perception integrated into ROS4HRI.Updates are due on month 36 and 45.

Dissemination and Communication Plan (DCP)

This will detail the Dissemination and Communication Plan.updates on month 18 and 36

Report on Human Pose Estimation (HPE) for learning motor action

Scientific results on the robot’s learning new motor actions in use case scenarios.An update will be produced by month 48

Report on ELSI

This first report will define the ELSI of PRIMI research and experimentsupdates on 24 and 36

Report on abstract cognition and trust in humanoids

Specification and preliminary computer simulations of models with SpiNNaker1

Specification of SpiNNaker2 PCB for edge AI

Technical report on the SpiNNaker2 board for neuromorphic robots

Roadmap for PRIMI technologies

Projection of the socio-economic opportunities of ethical, sustainable, and trustworthy robotic technologies.An update will be produced at month 48

Second Report on data collection

Update on the collection of neurophysiological data

Websites, patent fillings, videos etc. (1)

Project website and social media engagement

PRIMI website and social profiles are updated constantly until the end

Data Management Plan (2)

Data management plan (DMP)

DMP for making data & research outputs FAIR

Updated DMP

Updated Data Management Plan

Demonstrators, pilots, prototypes (3)

Demonstrator of neuromorphic computation on Kangaroo

Spinnaker2 board, event cameras, and sensorized skin patches fully integrated into the Kangaroo.A report and videos of demonstrators will be published online and advertised via social media

Demonstration of new Kangaroo robot

Neuromorphic Kangaroo built and demonstrated in lab tasks.A report and videos of demonstrators will be published online and advertised via social media

Lab Demonstrator of upgraded Neuromorphic iCub

Results of laboratory validation of iCub upgraded neuromorphic skin v1.0A report and videos of demonstrators will be published online and advertised via social media

Veröffentlichungen

Peer reviewed articles (15)

Alpha and Beta Corticomotor Phase Dynamics Shape Visuomotor Control on a Single-Trial Basis

Autoren: Alice Tomassini, Francesco Torricelli, Luciano Fadiga, Alessandro D’Ausilio
Veröffentlicht in: The Journal of Neuroscience, Ausgabe 46, 2026, ISSN 0270-6474
Herausgeber: Society for Neuroscience
DOI: 10.1523/JNEUROSCI.0765-25.2025

Neuroscience and Biobehavioral Reviews

Autoren: Antonioni, Annibale; Raho, Emanuela Maria; Straudi, Sofia; Granieri, Enrico; Koch, Giacomo; Fadiga, Luciano
Veröffentlicht in: Neuroscience & Biobehavioral Reviews, 2024, ISSN 0149-7634
Herausgeber: Elsevier
DOI: 10.1016/J.NEUBIOREV.2024.105830

A Marr-Inspired Framework for Raising “Good” Robots

Autoren: Sarah Hamburg, Alejandro Jimenez-Rodriguez, Aung Htet, Alessandro Di Nuovo
Veröffentlicht in: IEEE Transactions on Cognitive and Developmental Systems, Ausgabe 17, 2025, ISSN 2379-8920
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TCDS.2025.3540217

Nature Communications

Autoren: Zihao Chen; Zhili Xiao; Mahmoud Akl; Johannes Leugering; Omowuyi Olajide; Adil Malik; Nik Dennler; Chad Harper; Subhankar Bose; Hector A. Gonzalez; Mohamed Samaali; Gengting Liu; Jason Eshraghian; Riccardo Pignari; Gianvito Urgese; Andreas G. Andreou; Sadasivan Shankar; Christian Mayr; Gert Cauwenberghs; Shantanu Chakrabartty
Veröffentlicht in: Nature Communications, 2025, ISSN 2041-1723
Herausgeber: Nature Publishing Group
DOI: 10.48550/ARXIV.2406.05224

False but phonologically plausible linguistic priors induce cross-linguistic auditory illusions and attenuate electrophysiological markers of surprise

Autoren: Enrico Giraldi; Mirco Frosolone; Andrew W Corcoran; Laura Barca; Alessandro Corsini; Francesco Donnarumma; Alessandro D'Ausilio; Giovanni Pezzulo
Veröffentlicht in: Imaging Neuroscience, 2025, ISSN 2837-6056
Herausgeber: MIT Press
DOI: 10.1162/IMAG.A.1178

Selective visual memory replay with self-evaluation in cognitive robots based on global workspace framework

Autoren: Wenjie Huang, Antonio Chella, Angelo Cangelosi
Veröffentlicht in: Cognitive Systems Research, Ausgabe 92, 2025, ISSN 1389-0417
Herausgeber: Elsevier BV
DOI: 10.1016/J.COGSYS.2025.101377

Submovement interpersonal coupling is associated to audio-motor coordination performance

Autoren: Julien Laroche, Alice Tomassini, Luciano Fadiga, Alessandro D’Ausilio
Veröffentlicht in: Scientific Reports, Ausgabe 14, 2024, ISSN 2045-2322
Herausgeber: Springer Science and Business Media LLC
DOI: 10.1038/S41598-024-51629-Z

Entropy

Autoren: Sarah Hamburg,Alejandro Jimenez Rodriguez,Aung Htet,Alessandro Di Nuovo
Veröffentlicht in: Entropy, 2024, ISSN 1099-4300
Herausgeber: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/E26070582

Supervised learning of spatial features with STDP and homeostasis using Spiking Neural Networks on SpiNNaker

Autoren: Sergio Davies,Andrew Gait,Andrew Rowley,Alessandro Di Nuovo
Veröffentlicht in: Neurocomputing, Ausgabe Volume 611, 2025, ISSN 1872-8286
Herausgeber: Elsevier
DOI: 10.1016/J.NEUCOM.2024.128650

The SpiNNaker2 chip: a many-core platform for flexible and scalable brain-inspired computing

Autoren: Stefan Scholze, Johannes Partzsch, Sebastian Hoppner, Florian Kelber, Andreas Dixius, Marco Stolba, Sirine Arfa, Marc Berthel, Georg Ellguth, Jim Garside, Hector A. Gonzalez, Stephan Hartmann, Thomas Kiel-Hocker, Dongwei Hu, Matthias Jobst, Khaleelulla Khan Nazeer, Tim Langer, Chen Liu, Gengting Liu, Matthias Lohrmann, Mantas Mikaitis, Felix Neumarker, Amirhossein Rostami, Stefan Schiefer, Tilo Schubert, Delong Shang, Bernhard Vogginger, Yexin Yan, Steve Furber, Christian Mayr
Veröffentlicht in: IEEE Open Journal of Circuits and Systems, 2026, ISSN 2644-1225
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.48550/ARXIV.2607.24396

Journal of Neurophysiology

Autoren: Botta, Katia; Dolfini, Elisa; Casarotto, Andrea; Koch, Giacomo; D'Ausilio, Alessandro; Fadiga, Luciano
Veröffentlicht in: Journal of Neurophysiology, 2025, ISSN 0022-3077
Herausgeber: American Physiological Society
DOI: 10.1152/JN.00189.2025

Excitatory/inhibitory motor balance reflects individual differences during joint action coordination.

Autoren: Vescovo, Enrico; Cardellicchio, Pasquale; Tomassini, Alice; Fadiga, Luciano; D'Ausilio, Alessandro
Veröffentlicht in: European Journal of Neuroscience, 2023, ISSN 1460-9568
Herausgeber: Federation of European Neuroscience Societies and John Wiley & Sons Ltd
DOI: 10.1111/EJN.16365

The microstructure of intra- and interpersonal coordination

Autoren: Nazzaro, Giovanni; Emanuele, Marco; Laroche, Julien; Esposto, Chiara; Fadiga, Luciano; D'Ausilio, Alessandro; Tomassini, Alice
Veröffentlicht in: Proceedings of the Royal Society B: Biological Sciences, 2023, ISSN 1471-2954
Herausgeber: Royal Society Publishing
DOI: 10.1098/RSPB.2023.1576

The Effectiveness of Paired Associative Stimulation on Motor Recovery after Stroke: A Scoping Review

Autoren: Baroni A.; Antonioni A.; Fregna G.; Lamberti N.; Manfredini F.; Koch G.; D'Ausilio A.; Straudi S.
Veröffentlicht in: Neurology International, 2024, ISSN 2035-8377
Herausgeber: MDPI
DOI: 10.3390/NEUROLINT16030043

Harnessing Uncertainty: Improvisation as a Model for Rapid Behavioral Expansion

Autoren: Julien Laroche, Alessandro D'Ausilio
Veröffentlicht in: Cognitive Science, Ausgabe 50, 2026, ISSN 0364-0213
Herausgeber: Wiley
DOI: 10.1111/COGS.70191

Conference proceedings (12)

Benchmarking ANN-to-SNN Conversion: Dataset-Dependent Analysis of Accuracy, Latency, and Spike Efficiency

Autoren: Muhammad Aitsam, Samiulhaq Chardiwall, Alejandro Jimenez Rodriguez, Alessandro Di Nuovo
Veröffentlicht in: Lecture Notes in Computer Science, Biomimetic and Biohybrid Systems, 2025, ISBN 978-3-032-07448-5
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07448-5_24

Efficient Deployment of Spiking Neural Networks on SpiNNaker2 for DVS Gesture Recognition Using Neuromorphic Intermediate Representation

Autoren: Sirine Arfa, Bernhard Vogginger, Chen Liu, Johannes Partzsch, Mark Schöne, Christian Mayr
Veröffentlicht in: 2025 Neuro Inspired Computational Elements (NICE), 2025
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2504.06748

Event-Driven Dynamic Attention for Multi-Object Tracking on Neuromorphic Hardware

Autoren: Muhammad Aitsam, Sergio Davies, Alessandro Di Nuovo
Veröffentlicht in: 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2025
Herausgeber: IEEE
DOI: 10.1109/CVPRW67362.2025.00500

Disentangling Grasp-Object Representations in the Latent Space: Toward Brain-Like Affordances for Machines

Autoren: Siavash Mortaz Hejri, Hamed Pourfannan, Ruidong Ma, Alejandro Jimenez Rodriguez, Alessandro Di Nuovo
Veröffentlicht in: Lecture Notes in Computer Science, Biomimetic and Biohybrid Systems, 2026
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07448-5_35

Human-to-Robot Imitation with Symbolic Planning in a Unified Latent Space

Autoren: Ruidong Ma, Wenjie Huang, Zhegong Shangguan, Angelo Cangelosi, Alessandro Di Nuovo
Veröffentlicht in: Companion Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction, 2026
Herausgeber: ACM
DOI: 10.1145/3776734.3794399

Event-based Neural Decoding for Neuroprosthetic Motor Control

Autoren: Khaleelulla Khan Nazeer, Sirine Arfa, Matthias Jobst, Richard George, Christian Mayr
Veröffentlicht in: 2025 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2026
Herausgeber: IEEE
DOI: 10.1109/BIOCAS67066.2025.00079

Measuring Cognitive Load Through Event Camera Based Human-Pose Estimation

Autoren: Muhammad Aitsam, Dimitri Lacroix, Gaurvi Goyal, Chiara Bartolozzi, Alessandro Di Nuovo
Veröffentlicht in: Springer Proceedings in Advanced Robotics, Human-Friendly Robotics 2024, 2025, ISBN 978-3-031-81688-8
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-81688-8_17

Actions Acquisition and Adaptive Generation via Action Primitives and Mental Simulation for Humanoid Robots

Autoren: Wenjie Huang, Ruidong Ma, Alessandro Di Nuovo, Angelo Cangelosi
Veröffentlicht in: ICSR2026 International Conference on Social Robotics, 2026
Herausgeber: IEEE

Integrating Humanoid Robots in Stroke Rehabilitation: Practitioners' Expectations and Insights

Autoren: Hamed Pourfannan, Rachel Young, Alessandro Di Nuovo
Veröffentlicht in: 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2025
Herausgeber: IEEE
DOI: 10.1109/HRI61500.2025.10973843

Hardware-Aware Fine-Tuning of Spiking Q-Networks on the SpiNNaker2 Neuromorphic Platform

Autoren: Sirine Arfa, Bernhard Vogginger, Christian Mayr
Veröffentlicht in: 2025 International Conference on Neuromorphic Systems (ICONS), 2026
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2507.23562

Allostatic Control of Persistent States in Spiking Neural Networks for Perception and Computation

Autoren: Aung Htet, Alejandro Jimenez Rodriguez, Sarah Hamburg, Alessandro Di Nuovo
Veröffentlicht in: Lecture Notes in Computer Science, Biomimetic and Biohybrid Systems, 2026
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07448-5_33

Can You Handle The Truth? The Effects of Robots Correcting Users’ Misalignment on Trust and Perceived Social Competence

Autoren: Mehdi Hellou, Georgios Angelopoulos, Samuele Vinanzi, Alessandra Rossi, Silvia Rossi, Angelo Cangelosi
Veröffentlicht in: 2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2025
Herausgeber: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217739