AI Powered human-centred Robot Interactions for Smart Manufacturing

Projektinformationen

AI-PRISM

ID Finanzhilfevereinbarung: 101058589

DOI

10.3030/101058589

Projekt abgeschlossen

EK-Unterschriftsdatum 24 Mai 2022

Startdatum 1 Oktober 2022

Enddatum 31 Dezember 2025

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 10 827 138,76

EU-Beitrag

€ 9 335 578,88

Koordiniert durch

NTT DATA SPAIN, SL
Spain

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (4)

Task Analysis for benchmarking and design requirements (I)

Written report providing in-depth analysis of the original manual tasks for each use case, setting out risks and recommended mitigations, guidance for function allocation, and human-centred design requirements. Behavioural models and skills analysis will also be included in some of the iterations (M20 and M36 respectively).

AI-PRISM Dissemination and Communication Report (I)

Documentation of the actions and outcomes achieved concerning the promotional strategies. The final report will detail the international cooperation report.

Technology benchmarking and Project Vision

This deliverable will provide details about project vision and the benchmarking oftechnology landscape. It will be the main output of tasks 1.1 and 1.2.

AI-PRISM Impact Master Plan

Project’s dissemination, exploitation, and communication plans, outlining the target groups and segments. The report will include a description of the project website and social media, and the standardisation landscape.

Other (2)

AI-PRISM Human Robot Cooperation Ambient (I)

Consecutive releases of the CI/CD framework (code repositories, CI/CD pipelines and project scaffolds to support the development, integration, and validation of AI-based modules). Software releases of libraries of AI-based modules to enhance perception andreasoning capabilities of agents in the collaborative ambient, as well as to enable ambient level coordination and learning tasks by human demonstration.

AI-PRISM Human Centred Collaborative Robotic Platform (I)

Consecutive releases of the AI-PRISM software which includes libraries for real time communication, ambient digitalisation, and simulation. This includes code repositories, and pipelines to support the development of new modules, their deployment and testing. The simulation platform supports specific developed modules for agent simulation and for collaboration and risks evaluation.

Veröffentlichungen

Other (7)

D8.1 AI-PRISM Impact Master Plan

Autoren: Papanikolaou, Vasileios
Veröffentlicht in: 2023
Herausgeber: AI-PRISM Consortium
DOI: 10.5281/ZENODO.8009358

D6.2 Training plan and online training material

Autoren: COMAU SPA
Veröffentlicht in: 2025
Herausgeber: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992414

D.1.3 Use cases scenarios and requirements analysis (II)

Autoren: Profactor (Austria)
Veröffentlicht in: 2024
Herausgeber: AI-PRISM Consortium
DOI: 10.5281/ZENODO.10820171

CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settings

Autoren: Mattia Nardon, Mikel Mujika Agirre, Ander González Tomé, Daniel Sedano Algarabel, Josep Rueda Collell, Ana Paola Caro, Andrea Caraffa, Fabio Poiesi, Paul Ian Chippendale, Davide Boscaini
Herausgeber: https://doi.org/10.48550/arXiv.2506.09699
DOI: 10.48550/ARXIV.2506.09699

D5.2 Human robot collaboration behavioural analysis and modelling

Autoren: Cranfield University
Veröffentlicht in: 2024
Herausgeber: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992364

An in-finger sliding skill for cable routing and manipulation

Autoren: Federico Ulloa Rios, Wilm Decre, Erwin Aertbeli ´ en, Herman Bruyninckx
Herausgeber: 43rd Benelux Meeting on Systems and Control

D8.2 AI-PRISM Dissemination and Communication Report (I)

Autoren: MTU AUSTRALO ALPHA LAB
Veröffentlicht in: 2024
Herausgeber: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992159

Conference proceedings (19)

A Study to Compare YOLO Family Models for Metal Surface Anomaly Detection

Autoren: A. Koc, O. Albayrak, Y. Kurt and P. Unal
Veröffentlicht in: IEEE International Conference on Big Data (BigData), 2023
Herausgeber: IEEE
DOI: 10.1109/BigData59044.2023.10386849

Virtual Reality Capabilities for Robot Programming by Demonstration

Autoren: Joan Lario Femenía, Maria del Mar Plaza, Francisco Fraile, Francisco Blanes
Veröffentlicht in: 2025 IEEE International Conference on Engineering, Technology, and Innovation (ICE/ITMC), 2025
Herausgeber: IEEE
DOI: 10.1109/ICE/ITMC65658.2025.11106660

AI, human robot collaboration, and microrobotics for sustainable semiconductor manufacturing

Autoren: Maryam B. Javareshk, Tomasz Kołcon, Iveta Eimontaite, Sarah Fletcher, Jakub Bartkiewicz, Piotr Gemza, Krystian Goławski, Miron Kołodziejczyk, Adam Wołoszczuk
Veröffentlicht in: 2025 11th International Conference on Control, Decision and Information Technologies (CoDIT), 2026
Herausgeber: IEEE
DOI: 10.1109/CODIT66093.2025.11321714

Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation

Autoren: Corsetti, Jaime; Boscaini, Davide; Poiesi, Fabio
Veröffentlicht in: 8th International Workshop on Recovering 6D Object Pose, 2023
Herausgeber: 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
DOI: 10.48550/arxiv.2307.15514

Enabling Seamless HRC Integration: The AI-PRISM Reference Architecture

Autoren: Miguel A. Mateo-Casalí, Josep Rueda, Samuel Olaiya Afolaranmi, Jose Luis Martinez Lastra, Davide Boscaini, Laura Moya-Ruiz, Francisco Fraile
Herausgeber: CEUR Workshop Proceedings

Breaking the barriers: multilingual user engagement to increase process engagement and technology acceptance in manufacturing

Autoren: Iveta Eimontaite, Sarah Fletcher, Krystian Goławski, Tomasz Kołcon
Veröffentlicht in: Human Aspects of Advanced Manufacturing, Ausgabe Volume 80, 2023
Herausgeber: AHFE International
DOI: 10.54941/AHFE1003503

Distilling 3D distinctive local descriptors for 6D pose estimation

Autoren: Amir Hamza, Andrea Caraffa, Davide Boscaini, Fabio Poiesi
Veröffentlicht in: 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025
Herausgeber: IEEE
DOI: 10.1109/IROS60139.2025.11247352

FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation models

Autoren: Caraffa, Andrea; Boscaini, Davide; Hamza, Amir; Poiesi, Fabio
Veröffentlicht in: Computer Vision and Pattern Recognition, 2024
Herausgeber: arXiv

Empowering Social Sustainability Through Human centered HRC

Autoren: Joan Lario, Francisco Fraile, Iveta Eimontaite, Sarah Fletcher
Herausgeber: CEUR Workshop Proceedings

Novel Class Discovery for 3D Point Cloud Semantic Segmentation

Autoren: Riz, Luigi; Saltori, Cristiano; Ricci, Elisa; Poiesi, Fabio
Veröffentlicht in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Herausgeber: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
DOI: 10.48550/arxiv.2303.11610

TO COLLABORATE OR NOT TO COLLABORATE? HOW TO DETERMINE THE MOST SUITABLE LEVEL OF AUTOMATION TO INCREASE WORKFORCE SUSTAINABILITY AND PRODUCTION EFFICIENCY

Autoren: SACHA GODHANIA, IVETA EIMONTAITE, SARAH R. FLETCHER, ANA GONZALEZ SEGURA, ELOY RUIZ, ANA PAOLA CARO OSPINA
Veröffentlicht in: ICRES 2023: 8th International Conference on Robot Ethics and Standards, 2023
Herausgeber: CLAWAR Association - Series on Robot Ethics and Standards
DOI: 10.13180/icres.2023.17-18.07.006

A Methodology for Robustly Monitoring Assembly Insertion Skills

Autoren: Federico Ulloa Rios, Wilm Decré, Erwin Aertbeliën, Herman Bruyninckx
Veröffentlicht in: 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), Ausgabe 6, 2023
Herausgeber: IEEE
DOI: 10.1109/CASE56687.2023.10260578

Barriers and challenges for AI and HRC integration

Autoren: Josep Rueda, Gorka Sorrosal, Gerardo Minella, Tomasz Kołcon, Perin Ünal, Panagiotis Vlacheas, Sharath Chandra Akkaladevi
Herausgeber: CEUR Workshop Proceedings

3D Part Segmentation via Geometric Aggregation of 2D Visual Features

Autoren: Marco Garosi, Riccardo Tedoldi, Davide Boscaini, Massimiliano Mancini, N. Sebe, Fabio Poiesi
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/WACV61041.2025.00322

Open-vocabulary object 6D pose estimation

Autoren: Jaime Corsetti, Davide Boscaini, Changjae Oh, Andrea Cavallaro, Fabio Poiesi
Veröffentlicht in: Computer Vision and Pattern Recognition, 2024
Herausgeber: Computer Vision and Pattern Recognition
DOI: 10.48550/arXiv.2312.00690

Behavior Tree-Driven Reconfiguration Framework with Multimodal Interfaces for Handling Novel Situations in Industrial Settings

Autoren: Sharath Chandra Akkaladevi, Kapil Deshpande, Sebastian Ukleja, Markus Ganglbauer, Andreas Pichler, Sharath Chandra Akkaladevi
Veröffentlicht in: 2025 IEEE 30th International Conference on Emerging Technologies and Factory Automation (ETFA), 2025
Herausgeber: IEEE
DOI: 10.1109/ETFA65518.2025.11205602

Multidisciplinary Perspectives on Ethical AI-Enabled Human-Robot Interaction in Manufacturing

Autoren: Maryam Bathaeijavareshk, Iveta Eimontaite, Sarah Fletcher, Nikolaos Koufokotsios
Veröffentlicht in: AHFE International, Human Factors in Robots, Drones and Unmanned Systems, Ausgabe 179, 2025
Herausgeber: AHFE International
DOI: 10.54941/AHFE1006381

A Novel User-Friendly Pipeline for Enhanced Natural Language Understanding in Human-Robot Interaction

Autoren: Dorin Clisu, Iulia Farcas, Andrei Rusu, Mihai Hulea
Herausgeber: CEUR Workshop Proceedings

Modular Robot Task Execution Framework for Industrial PCB Handling: A Behavior Tree Approach

Autoren: Sharath Chandra Akkaladevi, Markus Ganglbauer, Kapil Deshpande, Sebastian Ukleja, Sharath Chandra Akkaladevi, Andreas Pichler
Veröffentlicht in: 2025 11th International Conference on Automation, Robotics, and Applications (ICARA), 2025
Herausgeber: IEEE
DOI: 10.1109/ICARA64554.2025.10977702

Peer reviewed articles (9)

International Journal of Advanced Manufacturing Technology

Autoren: Oostveen, Anne-Marie; Eimontaite, Iveta; Fletcher, Sarah
Veröffentlicht in: Human factors in digital manufacturing technology adoption, 2025, ISSN 0268-3768
Herausgeber: Springer London
DOI: 10.1007/S00170-025-16524-5

IEEE Access

Autoren: Toichoa Eyam Aitor; Martinez Lastra Jose L.
Veröffentlicht in: MetaStates: An Approach for Representing Human Workers’ Psychophysiological States in the Industrial Metaverse, 2024, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.48550/ARXIV.2402.15340

IEEE Access

Autoren: Martinez Lastra Jose L.; Stefanidis Kostas; Ranasinghe Nadun; Mohammed Wael M.
Veröffentlicht in: Large Language Models in Human-Robot Collaboration With Cognitive Validation Against Context-Induced Hallucinations, 2025, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ACCESS.2025.3565918

Adaptive Beacon Period Configurator for Scalable LoRaWAN Downlink Applications

Autoren: SILVESTRE-BLANES, Javier
Veröffentlicht in: IEEE Access, 2023, ISSN 2169-3536
Herausgeber: IEEE Access
DOI: 10.1109/ACCESS.2023.3301991

High-Resolution Open-Vocabulary Object 6D Pose Estimation

Autoren: Jaime Corsetti; Davide Boscaini; Francesco Giuliari; Changjae Oh; Andrea Cavallaro; Fabio Poiesi
Veröffentlicht in: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026, ISSN 2331-8422
Herausgeber: arXiv / Cornell University
DOI: 10.48550/ARXIV.2406.16384

Human professional skills assessment based on a modified learning curve model

Autoren: Angela Lago Alvarez, Wael M. Mohammed, Jose Luis Martinez Lastra
Veröffentlicht in: Production & Manufacturing Research, Ausgabe 13, 2025, ISSN 2169-3277
Herausgeber: Informa UK Limited
DOI: 10.1080/21693277.2025.2525935

Exploring the Potential of Wi-Fi in Industrial Environments: A Comparative Performance Analysis of IEEE 802.11 Standards

Autoren: Luis M. Bartolín-Arnau, Federico Orozco-Santos, Víctor Sempere-Payá, Javier Silvestre-Blanes, Teresa Albero-Albero, David Llacer-Garcia
Veröffentlicht in: Telecom, Ausgabe 6, 2025, ISSN 2673-4001
Herausgeber: MDPI AG
DOI: 10.3390/TELECOM6020040

PatchMixer: Rethinking network design to boost generalization for 3D point cloud understanding

Autoren: Davide Boscaini; Fabio Poiesia
Veröffentlicht in: Image and Vision Computing, 2023, ISSN 0262-8856
Herausgeber: Image and Vision Computing
DOI: 10.2139/ssrn.4370105

Novel class discovery meets foundation models for 3D semantic segmentation

Autoren: Riz, Luigi; Saltori, Cristiano; Wang, Yiming; Ricci, Elisa; Poiesi, Fabio
Veröffentlicht in: International Journal of Computer Vision, 2024, ISSN 1573-1405
Herausgeber: International Journal of Computer Vision
DOI: 10.48550/arxiv.2312.03782

Book chapters (9)

AI-Based Positioning on a Micro Scale

Autoren: Tomasz Kołcon, Iveta Eimontaite, Piotr Gemza, Krystian Goławski, Miron Kołodziejczyk, Adam Wołoszczuk
Veröffentlicht in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_28

On the Development of Programming by Demonstration Environment for Human-Robot Collaboration in a Furniture Painting Cell

Autoren: Joan Lario, Francisco Fraile, Emima Ioana, Francisco Blanes
Veröffentlicht in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_26

Intuitive Interfaces for Human-Robot Collaboration: Handling Novel PCBs for Industrial Manufacturing

Autoren: Markus Ganglbauer, Sharath Chandra Akkaladevi, Markus Ikeda, Sebastian Ukleja, Philipp Möhl, Andreas Pichler
Veröffentlicht in: Lecture Notes in Mechanical Engineering, Flexible Automation and Intelligent Manufacturing: Manufacturing Innovation and Preparedness for the Changing World Order, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-74482-2_36

Towards More Effective Human-Robot Collaboration via Accurate Pose Estimation

Autoren: Miguel Á. Mateo-Casalí, Laura Moya-Ruiz, Andrea Caraffa, Davide Boscaini, Amir Hamza, Paul Chippendale, Fabio Poiesi, Francisco Fraile
Veröffentlicht in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_30

A Low-Cost, Multi-modal Grasping Point Estimation System for Shop Floor Applications

Autoren: Sebastian Kamil Ukleja, Sharath Chandra Akkaladevi, Markus Ganglbauer, Andreas Pichler
Veröffentlicht in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2025, 2025
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-89471-8_39

The Impact of Task Sequence and Worker Personality on Mental and Physical Stress in a Human-Robot Collaboration Environment

Autoren: Cheonin Oh, Seungjun Lee, Daewoong Choi, Daesub Yoon, Engin Talas
Veröffentlicht in: Communications in Computer and Information Science, Computational Science and Computational Intelligence, 2025
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-94950-0_15

A Concise Taxonomy of Human-Robot Interactions and Soft Skills Synergy

Autoren: Wael M Mohammed, Angela Lago Alvarez, Jose L. Martinez Lastra
Veröffentlicht in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_31

Integrating Human-Centred Design in AI-Based Automation in Manufacturing: Ethical Challenges and Findings from Participatory Design Operator Workshops

Autoren: Maryam Bathaei Javareshk, Iveta Eimontaite, Sarah Fletcher
Veröffentlicht in: Lecture Notes in Networks and Systems, Crisis or Redemption with AI and Robotics? The Dawn of a New Era, 2025
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-032-00261-7_22

FreeZe: Training-Free Zero-Shot 6D Pose Estimation with Geometric and Vision Foundation Models

Autoren: Andrea Caraffa; Davide Boscaini; Amir Hamza; Fabio Poiesi
Veröffentlicht in: Lecture Notes in Computer Science ISBN: 9783031732256, 2024
Herausgeber: Springer Nature Switzerland AG
DOI: 10.48550/ARXIV.2312.00947