Fluently - the essence of human-robot interaction

Informations projet

Fluently

N° de convention de subvention: 101058680

DOI

10.3030/101058680

Projet clôturé

Date de signature de la CE 30 Mai 2022

Date de début 1 Juin 2022

Date de fin 31 Mai 2025

Financé au titre de

• Digital, Industry and Space

Coût total

€ 11 200 141,55

Contribution de l’UE

€ 9 176 043,50

Coordonné par

REPLY DEUTSCHLAND SE
Germany

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (5)

Scientific Dissemination and Industrial Promotion Plan

This deliverable contains a complete report of performed dissemination activities to the scientific community and industrial stakeholders about wider promotion and assessment of the developed technologies, techniques, and methodologies of the Fluently project.

Progress overview report

This report concerns the administrative progress of the project and the monitoring of the individual partners’ responsibilities. It will be submitted on months 6-18-30.

Configuration of Robo-Gym training stations

This deliverable contains the layout and a configuration of the Robo-Gym together with a BoM of devices to be integrated into the training areas (robots, sensors, Fluently units, Fluently HPC cluster, ML models).

Final Report on Dissemination, Industrial promotion and Standardization Activities

This deliverable concerns the Final Report on Dissemination, Industrial promotion and Standardization Activities of the Fluently project.

Robo-Gym governance and service portfolio

This deliverable deals with the development of the Robo-Gym business model run by a network of stakeholders that could take in charge the service portfolio, maintenance and updating of the available HW and SW while establishing a network of sponsored marketing activities to promote the model as an excellence benchmark in manufacturing (and education). It also includes the establishment of partnership with Universities and Regional Clusters under specific cooperation frameworks.

Other (2)

Ethic and gender equality

The goal of this deliverable is to define ethics and gender equalities policies for the Fluently project, ensuring a strong commitment to comply with the ethical principles and the applicable EU and national legislations in the countries where the consortium operates, but more importantly that people are preserved in data and behaviours.

Open access pilot for education

This deliverable focuses on a set of simplified demonstration scenarios selected as a baseline for a specific education program (promoted by ODE) with the aim to launch a disruptive transdisciplinary master course supporting Ethical Manufacturing. In cooperation with EC-EIT education, the Fluently course program addresses robotics and social acceptance in European industrial value chains.

Websites, patent fillings, videos etc. (1)

Project website

A project website will be developed and managed by the WP7 leader (IRIS). This will contain a public and a private part. The first one will be used to promulgate the results of the project. Partners will strive at making the website known to as broad public, especially to the target of the research. The private part will act as a forum for partners thought to minimize large e-mails exchange and facilitate knowledge transfer. It will be set up as a tool for “in progress” work exchange of ideas between participants and ensuring efficient dissemination of the results. The website will include: general information about Fluently; on progress work; links to other websites, EU projects, national and international events; calendar of meetings; reports of the project. The project website will be released before month 6 and constantly updated (major updates on months 18-36)

Data sets, microdata, etc (1)

Best practice open access data

This deliverable concerns the management of online access to Fluently project scientific information that is free of charge to the reader (open access data).

Demonstrators, pilots, prototypes (4)

Fluently Robo-Gym application demo

This demo deals with application-driven demonstration scenarios as developed in cooperation with the end-users. Specific portions of the shop-floor are replicated in the Robo-Gym (assisted and supported by AR) where actual parts, equipment and processes are physically available to the operators

Fluently Robo-Gym dexterity demo

This demo focuses on a physical demonstration where humans and robots cooperate. The use cases are abstracted in a set of exercises primarily to support the robot: product recognition, imitation of human manipulation and motion strategies, execution of a multi-tech process sequence and execution of simple tasks by content interpretation of verbal language.

Robo-Gym facility

The outcome of this demonstrator is the physical Robo-Gym set in place, ramped-up by configuring PC, CNC, sensors and provided of the necessary software.

Fluently Robo-Gym acquaintance demo

This demonstrator consists of VR/AR devices to foresee the robot in an immersive virtual room where a set of interaction experiences take place: 1) focus on the robot structure and movements; 2) touch robot with virtual grasp for hand-guidance; 3) talk and listen to robot. Herein the physical and cognitive loads are measured via H-Fluently and wearable sensors.

Publications

Conference proceedings (8)

Assessing the Impact of Human-Robot Collaboration on Stress Levels and Cognitive Load in Industrial Assembly Tasks

Auteurs: Andrea Bussolan, Stefano Baraldo, Luca Maria Gambardella, Anna Valente
Publié dans: ISR Europe 2023, 2023
Éditeur: VDE VERLAG GMBH

Multimodal fusion stress detector for enhanced human-robot collaboration in industrial assembly tasks

Auteurs: A. Bussolan, S. Baraldo, L. M. Gambardella and A. Valente
Publié dans: 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN), 2024
Éditeur: IEEE

The Effects of Framing and Apology in HRI in Manufacturing

Auteurs: Emilia Pietras, Anna-Sophie Ulfert-Blank, Guglielmo Borzone, Aljaz Kramberger, Norbert Krüger, Leon Bodenhagen
Publié dans: 2024 IEEE 20th International Conference on Automation Science and Engineering, 2024
Éditeur: IEEE
DOI: 10.1109/CASE59546.2024.10711703

Toward Human-Centered Collaborative Robotics for Manufacturing

Auteurs: Pietras, E. T. J. S., Ulfert-Blank, A-S., Kramberger, A., Krüger, N., & Bodenhagen, L.
Publié dans: Adaptive social interaction based on user’s mental models and behavior in HRI: Workshop held in conjunction with the 15th International Conference on Social Robotics - Qatar University, Doha, Qatar, 2023
Éditeur: Springer

BaSeNet: A Learning-based Mobile Manipulator Base Pose Sequence Planning for Pickup Tasks

Auteurs: Lakshadeep Naik, Sinan Kalkan, Sune L. Sørensen, Mikkel B. Kjærgaard, Norbert Krüger
Publié dans: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Éditeur: IEEE
DOI: 10.1109/IROS58592.2024.10802615

THOR-Net: End-to-end Graformer-based Realistic Two Hands and Object Reconstruction with Self-supervision

Auteurs: Ahmed Tawfik Aboukhadra; Jameel Malik; Ahmed Elhayek; Nadia Robertini; Didier Stricker
Publié dans: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023
Éditeur: IEEE
DOI: 10.48550/arxiv.2210.13853

First steps towards micro-benchmarking the Lava-Loihi neuromorphic ecosystem

Auteurs: Walter Gallego Gomez, Andrea Pignata, Riccardo Pignari, Vittorio Fra, Enrico Macii, Gianvito Urgese
Publié dans: 2023 IEEE 16th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC), 2024
Éditeur: IEEE
DOI: 10.1109/MCSOC60832.2023.00075

Learning Attention Propagation for Compositional Zero-Shot Learning

Auteurs: Muhammad Gul Zain Ali Khan; Muhammad Ferjad Naeem; Luc Van Gool; A. Pagani; Didier Stricker; Muhammad Zeshan Afzal
Publié dans: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023
Éditeur: IEEE
DOI: 10.48550/arxiv.2210.11557

Peer reviewed articles (3)

Towards an ontology to capture human attributes in human-robot collaboration

Auteurs: Stephanie Hall, Mandeep Dhanda, Vimal Dhokia
Publié dans: Proceedings of the Design Society, Numéro 4, 2024, ISSN 2732-527X
Éditeur: Cambridge University Press (CUP)
DOI: 10.1017/PDS.2024.261

Pre-grasp approaching on mobile robots: a pre-active layered approach

Auteurs: Lakshadeep Naik, Sinan Kalkan, Norbert Krüger
Publié dans: Tidsskrift IEEE Robotics and Automation Letters, 2024, ISSN 2377-3766
Éditeur: IEEE
DOI: 10.1109/LRA.2024.3358077

Reviewing human-robot collaboration in manufacturing: Opportunities and challenges in the context of industry 5.0

Auteurs: Mandeep Dhanda, Benedict Alexander Rogers, Stephanie Hall, Elies Dekoninck, Vimal Dhokia
Publié dans: Robotics and Computer-Integrated Manufacturing, Numéro 93, 2025, ISSN 0736-5845
Éditeur: Elsevier BV
DOI: 10.1016/J.RCIM.2024.102937