Performance in Robots Interaction via Mental Imagery

Informacje na temat projektu

PRIMI

Identyfikator umowy o grant: 101120727

DOI

10.3030/101120727

Data podpisania przez KE 3 Lipca 2023

Data rozpoczęcia 1 Listopada 2023

Data zakończenia 31 Grudnia 2027

Finansowanie w ramach

• Digital, Industry and Space

Koszt całkowity

€ 4 973 683,75

Wkład UE

€ 4 973 683,75

Koordynowany przez

FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Italy

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Documents, reports (13)

Initial report on Large Scale Spiking Neural Network models for Imagery Enabled Neuromorphic Robotics

Scientific report on preliminary computer simulations of a first version of Large Scale Adaptive Timescale Recurrent Spiking Neural Networks (LATRSNN) or other suitable architectures with SpiNNaker1. Long short term memory capability will be delivered in month 24

Specification for integration of neuromorphic sensors

Technical report on transfer neuromorphic perception in REEM-C and other humanoids

First report on data collection

Update on the collection of neurocognitive data

First Report on PRIMI cognitive architecture with iCub and Kangaroo

Results of the integration and experimentation in laboratory of the PRIMI cognitive architecture with mental imagery.Updates will be produced on month 24 and 36.

Cognitive architecture, model designs, integration

Specification and preliminary results in computer simulations of the cognitive architecture. Leading research group for this deliverable IIT-FE.

Framework for social abilities of neuromorphic robots

Results of HRI experiments of neuromorphic models and perception integrated into ROS4HRI.Updates are due on month 36 and 45.

Dissemination and Communication Plan (DCP)

This will detail the Dissemination and Communication Plan.updates on month 18 and 36

Report on Human Pose Estimation (HPE) for learning motor action

Scientific results on the robot’s learning new motor actions in use case scenarios.An update will be produced by month 48

Report on ELSI

This first report will define the ELSI of PRIMI research and experimentsupdates on 24 and 36

Report on abstract cognition and trust in humanoids

Specification and preliminary computer simulations of models with SpiNNaker1

Specification of SpiNNaker2 PCB for edge AI

Technical report on the SpiNNaker2 board for neuromorphic robots

Roadmap for PRIMI technologies

Projection of the socio-economic opportunities of ethical, sustainable, and trustworthy robotic technologies.An update will be produced at month 48

Second Report on data collection

Update on the collection of neurophysiological data

Websites, patent fillings, videos etc. (1)

Project website and social media engagement

PRIMI website and social profiles are updated constantly until the end

Data Management Plan (2)

Data management plan (DMP)

DMP for making data & research outputs FAIR

Updated DMP

Updated Data Management Plan

Demonstrators, pilots, prototypes (3)

Demonstrator of neuromorphic computation on Kangaroo

Spinnaker2 board, event cameras, and sensorized skin patches fully integrated into the Kangaroo.A report and videos of demonstrators will be published online and advertised via social media

Demonstration of new Kangaroo robot

Neuromorphic Kangaroo built and demonstrated in lab tasks.A report and videos of demonstrators will be published online and advertised via social media

Lab Demonstrator of upgraded Neuromorphic iCub

Results of laboratory validation of iCub upgraded neuromorphic skin v1.0A report and videos of demonstrators will be published online and advertised via social media

Publikacje

Peer reviewed articles (15)

Alpha and Beta Corticomotor Phase Dynamics Shape Visuomotor Control on a Single-Trial Basis

Autorzy: Alice Tomassini, Francesco Torricelli, Luciano Fadiga, Alessandro D’Ausilio
Opublikowane w: The Journal of Neuroscience, Numer 46, 2026, ISSN 0270-6474
Wydawca: Society for Neuroscience
DOI: 10.1523/JNEUROSCI.0765-25.2025

Neuroscience and Biobehavioral Reviews

Autorzy: Antonioni, Annibale; Raho, Emanuela Maria; Straudi, Sofia; Granieri, Enrico; Koch, Giacomo; Fadiga, Luciano
Opublikowane w: Neuroscience & Biobehavioral Reviews, 2024, ISSN 0149-7634
Wydawca: Elsevier
DOI: 10.1016/J.NEUBIOREV.2024.105830

A Marr-Inspired Framework for Raising “Good” Robots

Autorzy: Sarah Hamburg, Alejandro Jimenez-Rodriguez, Aung Htet, Alessandro Di Nuovo
Opublikowane w: IEEE Transactions on Cognitive and Developmental Systems, Numer 17, 2025, ISSN 2379-8920
Wydawca: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TCDS.2025.3540217

Nature Communications

Autorzy: Zihao Chen; Zhili Xiao; Mahmoud Akl; Johannes Leugering; Omowuyi Olajide; Adil Malik; Nik Dennler; Chad Harper; Subhankar Bose; Hector A. Gonzalez; Mohamed Samaali; Gengting Liu; Jason Eshraghian; Riccardo Pignari; Gianvito Urgese; Andreas G. Andreou; Sadasivan Shankar; Christian Mayr; Gert Cauwenberghs; Shantanu Chakrabartty
Opublikowane w: Nature Communications, 2025, ISSN 2041-1723
Wydawca: Nature Publishing Group
DOI: 10.48550/ARXIV.2406.05224

False but phonologically plausible linguistic priors induce cross-linguistic auditory illusions and attenuate electrophysiological markers of surprise

Autorzy: Enrico Giraldi; Mirco Frosolone; Andrew W Corcoran; Laura Barca; Alessandro Corsini; Francesco Donnarumma; Alessandro D'Ausilio; Giovanni Pezzulo
Opublikowane w: Imaging Neuroscience, 2025, ISSN 2837-6056
Wydawca: MIT Press
DOI: 10.1162/IMAG.A.1178

Selective visual memory replay with self-evaluation in cognitive robots based on global workspace framework

Autorzy: Wenjie Huang, Antonio Chella, Angelo Cangelosi
Opublikowane w: Cognitive Systems Research, Numer 92, 2025, ISSN 1389-0417
Wydawca: Elsevier BV
DOI: 10.1016/J.COGSYS.2025.101377

Submovement interpersonal coupling is associated to audio-motor coordination performance

Autorzy: Julien Laroche, Alice Tomassini, Luciano Fadiga, Alessandro D’Ausilio
Opublikowane w: Scientific Reports, Numer 14, 2024, ISSN 2045-2322
Wydawca: Springer Science and Business Media LLC
DOI: 10.1038/S41598-024-51629-Z

Entropy

Autorzy: Sarah Hamburg,Alejandro Jimenez Rodriguez,Aung Htet,Alessandro Di Nuovo
Opublikowane w: Entropy, 2024, ISSN 1099-4300
Wydawca: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/E26070582

Supervised learning of spatial features with STDP and homeostasis using Spiking Neural Networks on SpiNNaker

Autorzy: Sergio Davies,Andrew Gait,Andrew Rowley,Alessandro Di Nuovo
Opublikowane w: Neurocomputing, Numer Volume 611, 2025, ISSN 1872-8286
Wydawca: Elsevier
DOI: 10.1016/J.NEUCOM.2024.128650

The SpiNNaker2 chip: a many-core platform for flexible and scalable brain-inspired computing

Autorzy: Stefan Scholze, Johannes Partzsch, Sebastian Hoppner, Florian Kelber, Andreas Dixius, Marco Stolba, Sirine Arfa, Marc Berthel, Georg Ellguth, Jim Garside, Hector A. Gonzalez, Stephan Hartmann, Thomas Kiel-Hocker, Dongwei Hu, Matthias Jobst, Khaleelulla Khan Nazeer, Tim Langer, Chen Liu, Gengting Liu, Matthias Lohrmann, Mantas Mikaitis, Felix Neumarker, Amirhossein Rostami, Stefan Schiefer, Tilo Schubert, Delong Shang, Bernhard Vogginger, Yexin Yan, Steve Furber, Christian Mayr
Opublikowane w: IEEE Open Journal of Circuits and Systems, 2026, ISSN 2644-1225
Wydawca: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.48550/ARXIV.2607.24396

Journal of Neurophysiology

Autorzy: Botta, Katia; Dolfini, Elisa; Casarotto, Andrea; Koch, Giacomo; D'Ausilio, Alessandro; Fadiga, Luciano
Opublikowane w: Journal of Neurophysiology, 2025, ISSN 0022-3077
Wydawca: American Physiological Society
DOI: 10.1152/JN.00189.2025

Excitatory/inhibitory motor balance reflects individual differences during joint action coordination.

Autorzy: Vescovo, Enrico; Cardellicchio, Pasquale; Tomassini, Alice; Fadiga, Luciano; D'Ausilio, Alessandro
Opublikowane w: European Journal of Neuroscience, 2023, ISSN 1460-9568
Wydawca: Federation of European Neuroscience Societies and John Wiley & Sons Ltd
DOI: 10.1111/EJN.16365

The microstructure of intra- and interpersonal coordination

Autorzy: Nazzaro, Giovanni; Emanuele, Marco; Laroche, Julien; Esposto, Chiara; Fadiga, Luciano; D'Ausilio, Alessandro; Tomassini, Alice
Opublikowane w: Proceedings of the Royal Society B: Biological Sciences, 2023, ISSN 1471-2954
Wydawca: Royal Society Publishing
DOI: 10.1098/RSPB.2023.1576

The Effectiveness of Paired Associative Stimulation on Motor Recovery after Stroke: A Scoping Review

Autorzy: Baroni A.; Antonioni A.; Fregna G.; Lamberti N.; Manfredini F.; Koch G.; D'Ausilio A.; Straudi S.
Opublikowane w: Neurology International, 2024, ISSN 2035-8377
Wydawca: MDPI
DOI: 10.3390/NEUROLINT16030043

Harnessing Uncertainty: Improvisation as a Model for Rapid Behavioral Expansion

Autorzy: Julien Laroche, Alessandro D'Ausilio
Opublikowane w: Cognitive Science, Numer 50, 2026, ISSN 0364-0213
Wydawca: Wiley
DOI: 10.1111/COGS.70191

Conference proceedings (12)

Benchmarking ANN-to-SNN Conversion: Dataset-Dependent Analysis of Accuracy, Latency, and Spike Efficiency

Autorzy: Muhammad Aitsam, Samiulhaq Chardiwall, Alejandro Jimenez Rodriguez, Alessandro Di Nuovo
Opublikowane w: Lecture Notes in Computer Science, Biomimetic and Biohybrid Systems, 2025, ISBN 978-3-032-07448-5
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07448-5_24

Efficient Deployment of Spiking Neural Networks on SpiNNaker2 for DVS Gesture Recognition Using Neuromorphic Intermediate Representation

Autorzy: Sirine Arfa, Bernhard Vogginger, Chen Liu, Johannes Partzsch, Mark Schöne, Christian Mayr
Opublikowane w: 2025 Neuro Inspired Computational Elements (NICE), 2025
Wydawca: IEEE
DOI: 10.48550/ARXIV.2504.06748

Event-Driven Dynamic Attention for Multi-Object Tracking on Neuromorphic Hardware

Autorzy: Muhammad Aitsam, Sergio Davies, Alessandro Di Nuovo
Opublikowane w: 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2025
Wydawca: IEEE
DOI: 10.1109/CVPRW67362.2025.00500

Disentangling Grasp-Object Representations in the Latent Space: Toward Brain-Like Affordances for Machines

Autorzy: Siavash Mortaz Hejri, Hamed Pourfannan, Ruidong Ma, Alejandro Jimenez Rodriguez, Alessandro Di Nuovo
Opublikowane w: Lecture Notes in Computer Science, Biomimetic and Biohybrid Systems, 2026
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07448-5_35

Human-to-Robot Imitation with Symbolic Planning in a Unified Latent Space

Autorzy: Ruidong Ma, Wenjie Huang, Zhegong Shangguan, Angelo Cangelosi, Alessandro Di Nuovo
Opublikowane w: Companion Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction, 2026
Wydawca: ACM
DOI: 10.1145/3776734.3794399

Event-based Neural Decoding for Neuroprosthetic Motor Control

Autorzy: Khaleelulla Khan Nazeer, Sirine Arfa, Matthias Jobst, Richard George, Christian Mayr
Opublikowane w: 2025 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2026
Wydawca: IEEE
DOI: 10.1109/BIOCAS67066.2025.00079

Measuring Cognitive Load Through Event Camera Based Human-Pose Estimation

Autorzy: Muhammad Aitsam, Dimitri Lacroix, Gaurvi Goyal, Chiara Bartolozzi, Alessandro Di Nuovo
Opublikowane w: Springer Proceedings in Advanced Robotics, Human-Friendly Robotics 2024, 2025, ISBN 978-3-031-81688-8
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-031-81688-8_17

Actions Acquisition and Adaptive Generation via Action Primitives and Mental Simulation for Humanoid Robots

Autorzy: Wenjie Huang, Ruidong Ma, Alessandro Di Nuovo, Angelo Cangelosi
Opublikowane w: ICSR2026 International Conference on Social Robotics, 2026
Wydawca: IEEE

Integrating Humanoid Robots in Stroke Rehabilitation: Practitioners' Expectations and Insights

Autorzy: Hamed Pourfannan, Rachel Young, Alessandro Di Nuovo
Opublikowane w: 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2025
Wydawca: IEEE
DOI: 10.1109/HRI61500.2025.10973843

Hardware-Aware Fine-Tuning of Spiking Q-Networks on the SpiNNaker2 Neuromorphic Platform

Autorzy: Sirine Arfa, Bernhard Vogginger, Christian Mayr
Opublikowane w: 2025 International Conference on Neuromorphic Systems (ICONS), 2026
Wydawca: IEEE
DOI: 10.48550/ARXIV.2507.23562

Allostatic Control of Persistent States in Spiking Neural Networks for Perception and Computation

Autorzy: Aung Htet, Alejandro Jimenez Rodriguez, Sarah Hamburg, Alessandro Di Nuovo
Opublikowane w: Lecture Notes in Computer Science, Biomimetic and Biohybrid Systems, 2026
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07448-5_33

Can You Handle The Truth? The Effects of Robots Correcting Users’ Misalignment on Trust and Perceived Social Competence

Autorzy: Mehdi Hellou, Georgios Angelopoulos, Samuele Vinanzi, Alessandra Rossi, Silvia Rossi, Angelo Cangelosi
Opublikowane w: 2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2025
Wydawca: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217739