AI Powered human-centred Robot Interactions for Smart Manufacturing

Informazioni relative al progetto

AI-PRISM

ID dell’accordo di sovvenzione: 101058589

DOI

10.3030/101058589

Progetto chiuso

Data della firma CE 24 Maggio 2022

Data di avvio 1 Ottobre 2022

Data di completamento 31 Dicembre 2025

Finanziato da

• Digital, Industry and Space

Costo totale

€ 10 827 138,76

Contributo UE

€ 9 335 578,88

Coordinato da

NTT DATA SPAIN, SL
Spain

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (4)

Task Analysis for benchmarking and design requirements (I)

Written report providing in-depth analysis of the original manual tasks for each use case, setting out risks and recommended mitigations, guidance for function allocation, and human-centred design requirements. Behavioural models and skills analysis will also be included in some of the iterations (M20 and M36 respectively).

AI-PRISM Dissemination and Communication Report (I)

Documentation of the actions and outcomes achieved concerning the promotional strategies. The final report will detail the international cooperation report.

Technology benchmarking and Project Vision

This deliverable will provide details about project vision and the benchmarking oftechnology landscape. It will be the main output of tasks 1.1 and 1.2.

AI-PRISM Impact Master Plan

Project’s dissemination, exploitation, and communication plans, outlining the target groups and segments. The report will include a description of the project website and social media, and the standardisation landscape.

Other (2)

AI-PRISM Human Robot Cooperation Ambient (I)

Consecutive releases of the CI/CD framework (code repositories, CI/CD pipelines and project scaffolds to support the development, integration, and validation of AI-based modules). Software releases of libraries of AI-based modules to enhance perception andreasoning capabilities of agents in the collaborative ambient, as well as to enable ambient level coordination and learning tasks by human demonstration.

AI-PRISM Human Centred Collaborative Robotic Platform (I)

Consecutive releases of the AI-PRISM software which includes libraries for real time communication, ambient digitalisation, and simulation. This includes code repositories, and pipelines to support the development of new modules, their deployment and testing. The simulation platform supports specific developed modules for agent simulation and for collaboration and risks evaluation.

Pubblicazioni

Other (7)

D8.1 AI-PRISM Impact Master Plan

Autori: Papanikolaou, Vasileios
Pubblicato in: 2023
Editore: AI-PRISM Consortium
DOI: 10.5281/ZENODO.8009358

D6.2 Training plan and online training material

Autori: COMAU SPA
Pubblicato in: 2025
Editore: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992414

D.1.3 Use cases scenarios and requirements analysis (II)

Autori: Profactor (Austria)
Pubblicato in: 2024
Editore: AI-PRISM Consortium
DOI: 10.5281/ZENODO.10820171

CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settings

Autori: Mattia Nardon, Mikel Mujika Agirre, Ander González Tomé, Daniel Sedano Algarabel, Josep Rueda Collell, Ana Paola Caro, Andrea Caraffa, Fabio Poiesi, Paul Ian Chippendale, Davide Boscaini
Editore: https://doi.org/10.48550/arXiv.2506.09699
DOI: 10.48550/ARXIV.2506.09699

D5.2 Human robot collaboration behavioural analysis and modelling

Autori: Cranfield University
Pubblicato in: 2024
Editore: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992364

An in-finger sliding skill for cable routing and manipulation

Autori: Federico Ulloa Rios, Wilm Decre, Erwin Aertbeli ´ en, Herman Bruyninckx
Editore: 43rd Benelux Meeting on Systems and Control

D8.2 AI-PRISM Dissemination and Communication Report (I)

Autori: MTU AUSTRALO ALPHA LAB
Pubblicato in: 2024
Editore: AI-PRISM Consortium
DOI: 10.5281/ZENODO.17992159

Conference proceedings (19)

A Study to Compare YOLO Family Models for Metal Surface Anomaly Detection

Autori: A. Koc, O. Albayrak, Y. Kurt and P. Unal
Pubblicato in: IEEE International Conference on Big Data (BigData), 2023
Editore: IEEE
DOI: 10.1109/BigData59044.2023.10386849

Virtual Reality Capabilities for Robot Programming by Demonstration

Autori: Joan Lario Femenía, Maria del Mar Plaza, Francisco Fraile, Francisco Blanes
Pubblicato in: 2025 IEEE International Conference on Engineering, Technology, and Innovation (ICE/ITMC), 2025
Editore: IEEE
DOI: 10.1109/ICE/ITMC65658.2025.11106660

AI, human robot collaboration, and microrobotics for sustainable semiconductor manufacturing

Autori: Maryam B. Javareshk, Tomasz Kołcon, Iveta Eimontaite, Sarah Fletcher, Jakub Bartkiewicz, Piotr Gemza, Krystian Goławski, Miron Kołodziejczyk, Adam Wołoszczuk
Pubblicato in: 2025 11th International Conference on Control, Decision and Information Technologies (CoDIT), 2026
Editore: IEEE
DOI: 10.1109/CODIT66093.2025.11321714

Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation

Autori: Corsetti, Jaime; Boscaini, Davide; Poiesi, Fabio
Pubblicato in: 8th International Workshop on Recovering 6D Object Pose, 2023
Editore: 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
DOI: 10.48550/arxiv.2307.15514

Enabling Seamless HRC Integration: The AI-PRISM Reference Architecture

Autori: Miguel A. Mateo-Casalí, Josep Rueda, Samuel Olaiya Afolaranmi, Jose Luis Martinez Lastra, Davide Boscaini, Laura Moya-Ruiz, Francisco Fraile
Editore: CEUR Workshop Proceedings

Breaking the barriers: multilingual user engagement to increase process engagement and technology acceptance in manufacturing

Autori: Iveta Eimontaite, Sarah Fletcher, Krystian Goławski, Tomasz Kołcon
Pubblicato in: Human Aspects of Advanced Manufacturing, Numero Volume 80, 2023
Editore: AHFE International
DOI: 10.54941/AHFE1003503

Distilling 3D distinctive local descriptors for 6D pose estimation

Autori: Amir Hamza, Andrea Caraffa, Davide Boscaini, Fabio Poiesi
Pubblicato in: 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025
Editore: IEEE
DOI: 10.1109/IROS60139.2025.11247352

FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation models

Autori: Caraffa, Andrea; Boscaini, Davide; Hamza, Amir; Poiesi, Fabio
Pubblicato in: Computer Vision and Pattern Recognition, 2024
Editore: arXiv

Empowering Social Sustainability Through Human centered HRC

Autori: Joan Lario, Francisco Fraile, Iveta Eimontaite, Sarah Fletcher
Editore: CEUR Workshop Proceedings

Novel Class Discovery for 3D Point Cloud Semantic Segmentation

Autori: Riz, Luigi; Saltori, Cristiano; Ricci, Elisa; Poiesi, Fabio
Pubblicato in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Editore: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
DOI: 10.48550/arxiv.2303.11610

TO COLLABORATE OR NOT TO COLLABORATE? HOW TO DETERMINE THE MOST SUITABLE LEVEL OF AUTOMATION TO INCREASE WORKFORCE SUSTAINABILITY AND PRODUCTION EFFICIENCY

Autori: SACHA GODHANIA, IVETA EIMONTAITE, SARAH R. FLETCHER, ANA GONZALEZ SEGURA, ELOY RUIZ, ANA PAOLA CARO OSPINA
Pubblicato in: ICRES 2023: 8th International Conference on Robot Ethics and Standards, 2023
Editore: CLAWAR Association - Series on Robot Ethics and Standards
DOI: 10.13180/icres.2023.17-18.07.006

A Methodology for Robustly Monitoring Assembly Insertion Skills

Autori: Federico Ulloa Rios, Wilm Decré, Erwin Aertbeliën, Herman Bruyninckx
Pubblicato in: 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), Numero 6, 2023
Editore: IEEE
DOI: 10.1109/CASE56687.2023.10260578

Barriers and challenges for AI and HRC integration

Autori: Josep Rueda, Gorka Sorrosal, Gerardo Minella, Tomasz Kołcon, Perin Ünal, Panagiotis Vlacheas, Sharath Chandra Akkaladevi
Editore: CEUR Workshop Proceedings

3D Part Segmentation via Geometric Aggregation of 2D Visual Features

Autori: Marco Garosi, Riccardo Tedoldi, Davide Boscaini, Massimiliano Mancini, N. Sebe, Fabio Poiesi
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/WACV61041.2025.00322

Open-vocabulary object 6D pose estimation

Autori: Jaime Corsetti, Davide Boscaini, Changjae Oh, Andrea Cavallaro, Fabio Poiesi
Pubblicato in: Computer Vision and Pattern Recognition, 2024
Editore: Computer Vision and Pattern Recognition
DOI: 10.48550/arXiv.2312.00690

Behavior Tree-Driven Reconfiguration Framework with Multimodal Interfaces for Handling Novel Situations in Industrial Settings

Autori: Sharath Chandra Akkaladevi, Kapil Deshpande, Sebastian Ukleja, Markus Ganglbauer, Andreas Pichler, Sharath Chandra Akkaladevi
Pubblicato in: 2025 IEEE 30th International Conference on Emerging Technologies and Factory Automation (ETFA), 2025
Editore: IEEE
DOI: 10.1109/ETFA65518.2025.11205602

Multidisciplinary Perspectives on Ethical AI-Enabled Human-Robot Interaction in Manufacturing

Autori: Maryam Bathaeijavareshk, Iveta Eimontaite, Sarah Fletcher, Nikolaos Koufokotsios
Pubblicato in: AHFE International, Human Factors in Robots, Drones and Unmanned Systems, Numero 179, 2025
Editore: AHFE International
DOI: 10.54941/AHFE1006381

A Novel User-Friendly Pipeline for Enhanced Natural Language Understanding in Human-Robot Interaction

Autori: Dorin Clisu, Iulia Farcas, Andrei Rusu, Mihai Hulea
Editore: CEUR Workshop Proceedings

Modular Robot Task Execution Framework for Industrial PCB Handling: A Behavior Tree Approach

Autori: Sharath Chandra Akkaladevi, Markus Ganglbauer, Kapil Deshpande, Sebastian Ukleja, Sharath Chandra Akkaladevi, Andreas Pichler
Pubblicato in: 2025 11th International Conference on Automation, Robotics, and Applications (ICARA), 2025
Editore: IEEE
DOI: 10.1109/ICARA64554.2025.10977702

Peer reviewed articles (9)

International Journal of Advanced Manufacturing Technology

Autori: Oostveen, Anne-Marie; Eimontaite, Iveta; Fletcher, Sarah
Pubblicato in: Human factors in digital manufacturing technology adoption, 2025, ISSN 0268-3768
Editore: Springer London
DOI: 10.1007/S00170-025-16524-5

IEEE Access

Autori: Toichoa Eyam Aitor; Martinez Lastra Jose L.
Pubblicato in: MetaStates: An Approach for Representing Human Workers’ Psychophysiological States in the Industrial Metaverse, 2024, ISSN 2169-3536
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.48550/ARXIV.2402.15340

IEEE Access

Autori: Martinez Lastra Jose L.; Stefanidis Kostas; Ranasinghe Nadun; Mohammed Wael M.
Pubblicato in: Large Language Models in Human-Robot Collaboration With Cognitive Validation Against Context-Induced Hallucinations, 2025, ISSN 2169-3536
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/ACCESS.2025.3565918

Adaptive Beacon Period Configurator for Scalable LoRaWAN Downlink Applications

Autori: SILVESTRE-BLANES, Javier
Pubblicato in: IEEE Access, 2023, ISSN 2169-3536
Editore: IEEE Access
DOI: 10.1109/ACCESS.2023.3301991

High-Resolution Open-Vocabulary Object 6D Pose Estimation

Autori: Jaime Corsetti; Davide Boscaini; Francesco Giuliari; Changjae Oh; Andrea Cavallaro; Fabio Poiesi
Pubblicato in: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026, ISSN 2331-8422
Editore: arXiv / Cornell University
DOI: 10.48550/ARXIV.2406.16384

Human professional skills assessment based on a modified learning curve model

Autori: Angela Lago Alvarez, Wael M. Mohammed, Jose Luis Martinez Lastra
Pubblicato in: Production & Manufacturing Research, Numero 13, 2025, ISSN 2169-3277
Editore: Informa UK Limited
DOI: 10.1080/21693277.2025.2525935

Exploring the Potential of Wi-Fi in Industrial Environments: A Comparative Performance Analysis of IEEE 802.11 Standards

Autori: Luis M. Bartolín-Arnau, Federico Orozco-Santos, Víctor Sempere-Payá, Javier Silvestre-Blanes, Teresa Albero-Albero, David Llacer-Garcia
Pubblicato in: Telecom, Numero 6, 2025, ISSN 2673-4001
Editore: MDPI AG
DOI: 10.3390/TELECOM6020040

PatchMixer: Rethinking network design to boost generalization for 3D point cloud understanding

Autori: Davide Boscaini; Fabio Poiesia
Pubblicato in: Image and Vision Computing, 2023, ISSN 0262-8856
Editore: Image and Vision Computing
DOI: 10.2139/ssrn.4370105

Novel class discovery meets foundation models for 3D semantic segmentation

Autori: Riz, Luigi; Saltori, Cristiano; Wang, Yiming; Ricci, Elisa; Poiesi, Fabio
Pubblicato in: International Journal of Computer Vision, 2024, ISSN 1573-1405
Editore: International Journal of Computer Vision
DOI: 10.48550/arxiv.2312.03782

Book chapters (9)

AI-Based Positioning on a Micro Scale

Autori: Tomasz Kołcon, Iveta Eimontaite, Piotr Gemza, Krystian Goławski, Miron Kołodziejczyk, Adam Wołoszczuk
Pubblicato in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_28

On the Development of Programming by Demonstration Environment for Human-Robot Collaboration in a Furniture Painting Cell

Autori: Joan Lario, Francisco Fraile, Emima Ioana, Francisco Blanes
Pubblicato in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_26

Intuitive Interfaces for Human-Robot Collaboration: Handling Novel PCBs for Industrial Manufacturing

Autori: Markus Ganglbauer, Sharath Chandra Akkaladevi, Markus Ikeda, Sebastian Ukleja, Philipp Möhl, Andreas Pichler
Pubblicato in: Lecture Notes in Mechanical Engineering, Flexible Automation and Intelligent Manufacturing: Manufacturing Innovation and Preparedness for the Changing World Order, 2024
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-74482-2_36

Towards More Effective Human-Robot Collaboration via Accurate Pose Estimation

Autori: Miguel Á. Mateo-Casalí, Laura Moya-Ruiz, Andrea Caraffa, Davide Boscaini, Amir Hamza, Paul Chippendale, Fabio Poiesi, Francisco Fraile
Pubblicato in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_30

A Low-Cost, Multi-modal Grasping Point Estimation System for Shop Floor Applications

Autori: Sebastian Kamil Ukleja, Sharath Chandra Akkaladevi, Markus Ganglbauer, Andreas Pichler
Pubblicato in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2025, 2025
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-89471-8_39

The Impact of Task Sequence and Worker Personality on Mental and Physical Stress in a Human-Robot Collaboration Environment

Autori: Cheonin Oh, Seungjun Lee, Daewoong Choi, Daesub Yoon, Engin Talas
Pubblicato in: Communications in Computer and Information Science, Computational Science and Computational Intelligence, 2025
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-94950-0_15

A Concise Taxonomy of Human-Robot Interactions and Soft Skills Synergy

Autori: Wael M Mohammed, Angela Lago Alvarez, Jose L. Martinez Lastra
Pubblicato in: Springer Proceedings in Advanced Robotics, European Robotics Forum 2024, 2024
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-76428-8_31

Integrating Human-Centred Design in AI-Based Automation in Manufacturing: Ethical Challenges and Findings from Participatory Design Operator Workshops

Autori: Maryam Bathaei Javareshk, Iveta Eimontaite, Sarah Fletcher
Pubblicato in: Lecture Notes in Networks and Systems, Crisis or Redemption with AI and Robotics? The Dawn of a New Era, 2025
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-032-00261-7_22

FreeZe: Training-Free Zero-Shot 6D Pose Estimation with Geometric and Vision Foundation Models

Autori: Andrea Caraffa; Davide Boscaini; Amir Hamza; Fabio Poiesi
Pubblicato in: Lecture Notes in Computer Science ISBN: 9783031732256, 2024
Editore: Springer Nature Switzerland AG
DOI: 10.48550/ARXIV.2312.00947