Academic partners and technology providers have supported the 3 end-users in order to achieve the guidelines for the technical work packages. Thus, the work carried out has contributed to the definition of the 3 use-cases needs, the evaluation criteria in relation to the use-cases, the hardware and software technical specifications and the hardware and software architectures.
Electro-adhesive (EA) skins have been fabricated. Their adhesion forces on the 3 use-cases materials have been measured. Shielded soft force sensors compatible with the EA skins have been designed to detect slipping at the object-finger contact. Different gripping strategies have been studied theoretically, based on an in depth use-cases analysis. These led to design-guidelines for the new enhanced gripper. Then, two innovative low-cost grippers embedding EA functionality have been designed, optimized and tested, for two of the use-cases. An alternative multi-tool end-effector was designed for the composite use-case, due to physical limitation of EA on the glass-fiber material to manipulate.
A set of tools dedicated to easy programming was designed and developed. Firstly, a programming framework provides skill concept and execution engine, easy teaching by demonstration, and learning strategies for skills parameters automatic optimization. Secondly, a toolbox dedicated to human-robot co-manipulation includes a set of control strategies for large and fragile objects handling, using a mix of hybrid force-position virtual guides and remote control, where the operator can adjust the trajectories and visualize them using augmented reality. A new prototype of sensorized glove has been also designed and built, with its associated hand gesture library for remote robot guiding during co-manipulation.
A person tracking and movement decomposition system has been implemented, covering the safety and the human robot interaction. The obtained system is able to decompose the worker movement in shared space with robots. Regarding the human-robot interaction, we have obtained a robust system for static gestures identification using the tracking system information. The perception for process control focused on highly flexible materials, with a point cloud-based approach using mixed 3D-2D sensing. Textile wrinkle-detection and wrinkle-removal modules were developed to ensure the required manipulation quality. A slip detection strategy using the developed soft sensor was implemented, allowing the system to anticipate a potential slippage during manipulation.
The MERGING Workcell Controller has been integrated with an intuitive user interface and tested, that incorporates: a) high-level orchestration of manipulation processes, b) response to errors, and c) creation, editing, storage, execution and monitoring of orders. In parallel, the Simulator for Ply Manipulation (including automatic calibration for improved reliability) has been developed, enabling high frequency fabric reconstruction and simulation for various scenarios. Practices for seamless inter-resource and inter-module communication have been applied, empowering the twinning of the digital scene and the different hierarchical levels supervision.
By considering hardware and software building blocks previously developed, the 3 use-cases robotic cell demonstrators have been integrated, starting at the RTOs' premises. The communication needs and the ROS interfaces of the software modules have been implemented. Generic capabilities of dual-arm manipulators were enhanced with software and hardware modules for easy programming, handling, cognition, human-robot and robot-robot co-manipulation, interaction, supervision and safety. Investigation on standards has been performed, in order to identify existing regulations or standardization gaps in the project’s main technological areas.
Then, a series of physical and hybrid workshops with the project partners ensured the successful implementation of the 3 final robotic cell demonstrators at the industrial end-users’ premises, involving the latest developments from each technological work package, novel grippers included. These demonstrators have been evaluated through validation campaigns, involving tests with the operators, and proved that MERGING solutions can address main challenges of flexible material robotic manipulation in different industries, by up-scaling ergonomics and/or efficiency.
The dissemination, communication and exploitation plans were completed. MERGING participated in European events (e.g. ERF, IndTech) and it led workshops organization clustering projects related to flexible material handling. The results have been published in journals, and presented at scientific conferences. The exploitable results have been analyzed in terms of cost and turnover. Many patents have been registered. Finally, the project outcomes were presented during the final MERGING public event, as well as training material, also available through the project website.
