AI Powered human-centred Robot Interactions for Smart Manufacturing

Informations projet

AI-PRISM

N° de convention de subvention: 101058589

DOI

10.3030/101058589

Projet clôturé

Date de signature de la CE 24 Mai 2022

Date de début 1 Octobre 2022

Date de fin 31 Decembre 2025

Financé au titre de

• Digital, Industry and Space

Coût total

€ 10 827 138,76

Contribution de l’UE

€ 9 335 578,88

Coordonné par

NTT DATA SPAIN, SL
Spain

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (4)

Task Analysis for benchmarking and design requirements (I)

Written report providing in-depth analysis of the original manual tasks for each use case, setting out risks and recommended mitigations, guidance for function allocation, and human-centred design requirements. Behavioural models and skills analysis will also be included in some of the iterations (M20 and M36 respectively).

AI-PRISM Dissemination and Communication Report (I)

Documentation of the actions and outcomes achieved concerning the promotional strategies. The final report will detail the international cooperation report.

Technology benchmarking and Project Vision

This deliverable will provide details about project vision and the benchmarking oftechnology landscape. It will be the main output of tasks 1.1 and 1.2.

AI-PRISM Impact Master Plan

Project’s dissemination, exploitation, and communication plans, outlining the target groups and segments. The report will include a description of the project website and social media, and the standardisation landscape.

Other (2)

AI-PRISM Human Robot Cooperation Ambient (I)

Consecutive releases of the CI/CD framework (code repositories, CI/CD pipelines and project scaffolds to support the development, integration, and validation of AI-based modules). Software releases of libraries of AI-based modules to enhance perception andreasoning capabilities of agents in the collaborative ambient, as well as to enable ambient level coordination and learning tasks by human demonstration.

AI-PRISM Human Centred Collaborative Robotic Platform (I)

Consecutive releases of the AI-PRISM software which includes libraries for real time communication, ambient digitalisation, and simulation. This includes code repositories, and pipelines to support the development of new modules, their deployment and testing. The simulation platform supports specific developed modules for agent simulation and for collaboration and risks evaluation.

Publications

Other (7)

D8.1 AI-PRISM Impact Master Plan

Auteurs: Papanikolaou, Vasileios
Publié dans: 2023
Éditeur: AI-PRISM Consortium
DOI: 10.5281/ZENODO.8009358

D6.2 Training plan and online training material

Auteurs: COMAU SPA
Publié dans: 2025
Éditeur: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992414

D.1.3 Use cases scenarios and requirements analysis (II)

Auteurs: Profactor (Austria)
Publié dans: 2024
Éditeur: AI-PRISM Consortium
DOI: 10.5281/ZENODO.10820171

CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settings

Auteurs: Mattia Nardon, Mikel Mujika Agirre, Ander González Tomé, Daniel Sedano Algarabel, Josep Rueda Collell, Ana Paola Caro, Andrea Caraffa, Fabio Poiesi, Paul Ian Chippendale, Davide Boscaini
Éditeur: https://doi.org/10.48550/arXiv.2506.09699
DOI: 10.48550/ARXIV.2506.09699

D5.2 Human robot collaboration behavioural analysis and modelling

Auteurs: Cranfield University
Publié dans: 2024
Éditeur: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992364

An in-finger sliding skill for cable routing and manipulation

Auteurs: Federico Ulloa Rios, Wilm Decre, Erwin Aertbeli ´ en, Herman Bruyninckx
Éditeur: 43rd Benelux Meeting on Systems and Control

D8.2 AI-PRISM Dissemination and Communication Report (I)

Auteurs: MTU AUSTRALO ALPHA LAB
Publié dans: 2024
Éditeur: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992159

Conference proceedings (19)

A Study to Compare YOLO Family Models for Metal Surface Anomaly Detection

Auteurs: A. Koc, O. Albayrak, Y. Kurt and P. Unal
Publié dans: IEEE International Conference on Big Data (BigData), 2023
Éditeur: IEEE
DOI: 10.1109/BigData59044.2023.10386849

Virtual Reality Capabilities for Robot Programming by Demonstration

Auteurs: Joan Lario Femenía, Maria del Mar Plaza, Francisco Fraile, Francisco Blanes
Publié dans: 2025 IEEE International Conference on Engineering, Technology, and Innovation (ICE/ITMC), 2025
Éditeur: IEEE
DOI: 10.1109/ICE/ITMC65658.2025.11106660

AI, human robot collaboration, and microrobotics for sustainable semiconductor manufacturing

Auteurs: Maryam B. Javareshk, Tomasz Kołcon, Iveta Eimontaite, Sarah Fletcher, Jakub Bartkiewicz, Piotr Gemza, Krystian Goławski, Miron Kołodziejczyk, Adam Wołoszczuk
Publié dans: 2025 11th International Conference on Control, Decision and Information Technologies (CoDIT), 2026
Éditeur: IEEE
DOI: 10.1109/CODIT66093.2025.11321714

Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation

Auteurs: Corsetti, Jaime; Boscaini, Davide; Poiesi, Fabio
Publié dans: 8th International Workshop on Recovering 6D Object Pose, 2023
Éditeur: 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
DOI: 10.48550/arxiv.2307.15514

Enabling Seamless HRC Integration: The AI-PRISM Reference Architecture

Auteurs: Miguel A. Mateo-Casalí, Josep Rueda, Samuel Olaiya Afolaranmi, Jose Luis Martinez Lastra, Davide Boscaini, Laura Moya-Ruiz, Francisco Fraile
Éditeur: CEUR Workshop Proceedings

Breaking the barriers: multilingual user engagement to increase process engagement and technology acceptance in manufacturing

Auteurs: Iveta Eimontaite, Sarah Fletcher, Krystian Goławski, Tomasz Kołcon
Publié dans: Human Aspects of Advanced Manufacturing, Numéro Volume 80, 2023
Éditeur: AHFE International
DOI: 10.54941/AHFE1003503

Distilling 3D distinctive local descriptors for 6D pose estimation

Auteurs: Amir Hamza, Andrea Caraffa, Davide Boscaini, Fabio Poiesi
Publié dans: 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025
Éditeur: IEEE
DOI: 10.1109/IROS60139.2025.11247352

FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation models

Auteurs: Caraffa, Andrea; Boscaini, Davide; Hamza, Amir; Poiesi, Fabio
Publié dans: Computer Vision and Pattern Recognition, 2024
Éditeur: arXiv

Empowering Social Sustainability Through Human centered HRC

Auteurs: Joan Lario, Francisco Fraile, Iveta Eimontaite, Sarah Fletcher
Éditeur: CEUR Workshop Proceedings

Novel Class Discovery for 3D Point Cloud Semantic Segmentation

Auteurs: Riz, Luigi; Saltori, Cristiano; Ricci, Elisa; Poiesi, Fabio
Publié dans: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Éditeur: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
DOI: 10.48550/arxiv.2303.11610

TO COLLABORATE OR NOT TO COLLABORATE? HOW TO DETERMINE THE MOST SUITABLE LEVEL OF AUTOMATION TO INCREASE WORKFORCE SUSTAINABILITY AND PRODUCTION EFFICIENCY

Auteurs: SACHA GODHANIA, IVETA EIMONTAITE, SARAH R. FLETCHER, ANA GONZALEZ SEGURA, ELOY RUIZ, ANA PAOLA CARO OSPINA
Publié dans: ICRES 2023: 8th International Conference on Robot Ethics and Standards, 2023
Éditeur: CLAWAR Association - Series on Robot Ethics and Standards
DOI: 10.13180/icres.2023.17-18.07.006

A Methodology for Robustly Monitoring Assembly Insertion Skills

Auteurs: Federico Ulloa Rios, Wilm Decré, Erwin Aertbeliën, Herman Bruyninckx
Publié dans: 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), Numéro 6, 2023
Éditeur: IEEE
DOI: 10.1109/CASE56687.2023.10260578

Barriers and challenges for AI and HRC integration

Auteurs: Josep Rueda, Gorka Sorrosal, Gerardo Minella, Tomasz Kołcon, Perin Ünal, Panagiotis Vlacheas, Sharath Chandra Akkaladevi
Éditeur: CEUR Workshop Proceedings

3D Part Segmentation via Geometric Aggregation of 2D Visual Features

Auteurs: Marco Garosi, Riccardo Tedoldi, Davide Boscaini, Massimiliano Mancini, N. Sebe, Fabio Poiesi
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/WACV61041.2025.00322

Open-vocabulary object 6D pose estimation

Auteurs: Jaime Corsetti, Davide Boscaini, Changjae Oh, Andrea Cavallaro, Fabio Poiesi
Publié dans: Computer Vision and Pattern Recognition, 2024
Éditeur: Computer Vision and Pattern Recognition
DOI: 10.48550/arXiv.2312.00690

Behavior Tree-Driven Reconfiguration Framework with Multimodal Interfaces for Handling Novel Situations in Industrial Settings

Auteurs: Sharath Chandra Akkaladevi, Kapil Deshpande, Sebastian Ukleja, Markus Ganglbauer, Andreas Pichler, Sharath Chandra Akkaladevi
Publié dans: 2025 IEEE 30th International Conference on Emerging Technologies and Factory Automation (ETFA), 2025
Éditeur: IEEE
DOI: 10.1109/ETFA65518.2025.11205602

Multidisciplinary Perspectives on Ethical AI-Enabled Human-Robot Interaction in Manufacturing

Auteurs: Maryam Bathaeijavareshk, Iveta Eimontaite, Sarah Fletcher, Nikolaos Koufokotsios
Publié dans: AHFE International, Human Factors in Robots, Drones and Unmanned Systems, Numéro 179, 2025
Éditeur: AHFE International
DOI: 10.54941/AHFE1006381

A Novel User-Friendly Pipeline for Enhanced Natural Language Understanding in Human-Robot Interaction

Auteurs: Dorin Clisu, Iulia Farcas, Andrei Rusu, Mihai Hulea
Éditeur: CEUR Workshop Proceedings

Modular Robot Task Execution Framework for Industrial PCB Handling: A Behavior Tree Approach

Auteurs: Sharath Chandra Akkaladevi, Markus Ganglbauer, Kapil Deshpande, Sebastian Ukleja, Sharath Chandra Akkaladevi, Andreas Pichler
Publié dans: 2025 11th International Conference on Automation, Robotics, and Applications (ICARA), 2025
Éditeur: IEEE
DOI: 10.1109/ICARA64554.2025.10977702

Peer reviewed articles (9)

International Journal of Advanced Manufacturing Technology

Auteurs: Oostveen, Anne-Marie; Eimontaite, Iveta; Fletcher, Sarah
Publié dans: Human factors in digital manufacturing technology adoption, 2025, ISSN 0268-3768
Éditeur: Springer London
DOI: 10.1007/S00170-025-16524-5

IEEE Access

Auteurs: Toichoa Eyam Aitor; Martinez Lastra Jose L.
Publié dans: MetaStates: An Approach for Representing Human Workers’ Psychophysiological States in the Industrial Metaverse, 2024, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.48550/ARXIV.2402.15340

IEEE Access

Auteurs: Martinez Lastra Jose L.; Stefanidis Kostas; Ranasinghe Nadun; Mohammed Wael M.
Publié dans: Large Language Models in Human-Robot Collaboration With Cognitive Validation Against Context-Induced Hallucinations, 2025, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ACCESS.2025.3565918

Adaptive Beacon Period Configurator for Scalable LoRaWAN Downlink Applications

Auteurs: SILVESTRE-BLANES, Javier
Publié dans: IEEE Access, 2023, ISSN 2169-3536
Éditeur: IEEE Access
DOI: 10.1109/ACCESS.2023.3301991

High-Resolution Open-Vocabulary Object 6D Pose Estimation

Auteurs: Jaime Corsetti; Davide Boscaini; Francesco Giuliari; Changjae Oh; Andrea Cavallaro; Fabio Poiesi
Publié dans: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026, ISSN 2331-8422
Éditeur: arXiv / Cornell University
DOI: 10.48550/ARXIV.2406.16384

Human professional skills assessment based on a modified learning curve model

Auteurs: Angela Lago Alvarez, Wael M. Mohammed, Jose Luis Martinez Lastra
Publié dans: Production & Manufacturing Research, Numéro 13, 2025, ISSN 2169-3277
Éditeur: Informa UK Limited
DOI: 10.1080/21693277.2025.2525935

Exploring the Potential of Wi-Fi in Industrial Environments: A Comparative Performance Analysis of IEEE 802.11 Standards

Auteurs: Luis M. Bartolín-Arnau, Federico Orozco-Santos, Víctor Sempere-Payá, Javier Silvestre-Blanes, Teresa Albero-Albero, David Llacer-Garcia
Publié dans: Telecom, Numéro 6, 2025, ISSN 2673-4001
Éditeur: MDPI AG
DOI: 10.3390/TELECOM6020040

PatchMixer: Rethinking network design to boost generalization for 3D point cloud understanding

Auteurs: Davide Boscaini; Fabio Poiesia
Publié dans: Image and Vision Computing, 2023, ISSN 0262-8856
Éditeur: Image and Vision Computing
DOI: 10.2139/ssrn.4370105

Novel class discovery meets foundation models for 3D semantic segmentation

Auteurs: Riz, Luigi; Saltori, Cristiano; Wang, Yiming; Ricci, Elisa; Poiesi, Fabio
Publié dans: International Journal of Computer Vision, 2024, ISSN 1573-1405
Éditeur: International Journal of Computer Vision
DOI: 10.48550/arxiv.2312.03782

Book chapters (9)

AI-Based Positioning on a Micro Scale

Auteurs: Tomasz Kołcon, Iveta Eimontaite, Piotr Gemza, Krystian Goławski, Miron Kołodziejczyk, Adam Wołoszczuk
Publié dans: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_28

On the Development of Programming by Demonstration Environment for Human-Robot Collaboration in a Furniture Painting Cell

Auteurs: Joan Lario, Francisco Fraile, Emima Ioana, Francisco Blanes
Publié dans: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_26

Intuitive Interfaces for Human-Robot Collaboration: Handling Novel PCBs for Industrial Manufacturing

Auteurs: Markus Ganglbauer, Sharath Chandra Akkaladevi, Markus Ikeda, Sebastian Ukleja, Philipp Möhl, Andreas Pichler
Publié dans: Lecture Notes in Mechanical Engineering, Flexible Automation and Intelligent Manufacturing: Manufacturing Innovation and Preparedness for the Changing World Order, 2024
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-74482-2_36

Towards More Effective Human-Robot Collaboration via Accurate Pose Estimation

Auteurs: Miguel Á. Mateo-Casalí, Laura Moya-Ruiz, Andrea Caraffa, Davide Boscaini, Amir Hamza, Paul Chippendale, Fabio Poiesi, Francisco Fraile
Publié dans: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_30

A Low-Cost, Multi-modal Grasping Point Estimation System for Shop Floor Applications

Auteurs: Sebastian Kamil Ukleja, Sharath Chandra Akkaladevi, Markus Ganglbauer, Andreas Pichler
Publié dans: Springer Proceedings in Advanced Robotics, European Robotics Forum 2025, 2025
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-89471-8_39

The Impact of Task Sequence and Worker Personality on Mental and Physical Stress in a Human-Robot Collaboration Environment

Auteurs: Cheonin Oh, Seungjun Lee, Daewoong Choi, Daesub Yoon, Engin Talas
Publié dans: Communications in Computer and Information Science, Computational Science and Computational Intelligence, 2025
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-94950-0_15

A Concise Taxonomy of Human-Robot Interactions and Soft Skills Synergy

Auteurs: Wael M Mohammed, Angela Lago Alvarez, Jose L. Martinez Lastra
Publié dans: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_31

Integrating Human-Centred Design in AI-Based Automation in Manufacturing: Ethical Challenges and Findings from Participatory Design Operator Workshops

Auteurs: Maryam Bathaei Javareshk, Iveta Eimontaite, Sarah Fletcher
Publié dans: Lecture Notes in Networks and Systems, Crisis or Redemption with AI and Robotics? The Dawn of a New Era, 2025
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-032-00261-7_22

FreeZe: Training-Free Zero-Shot 6D Pose Estimation with Geometric and Vision Foundation Models

Auteurs: Andrea Caraffa; Davide Boscaini; Amir Hamza; Fabio Poiesi
Publié dans: Lecture Notes in Computer Science ISBN: 9783031732256, 2024
Éditeur: Springer Nature Switzerland AG
DOI: 10.48550/ARXIV.2312.00947