Impact Aware Manipulation by Dexterous Robot Control and Learning in Dynamic Semi-Structured Logistic Environments

Projektinformationen

I.AM.

ID Finanzhilfevereinbarung: 871899

DOI 10.3030/871899

Projekt abgeschlossen

EK-Unterschriftsdatum 5 Dezember 2019

Startdatum 1 Januar 2020

Enddatum 31 März 2024

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten € 4 585 485,00

EU-Beitrag € 4 357 985,00

Koordiniert durch

TECHNISCHE UNIVERSITEIT EINDHOVEN
Niederlande

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Open Research Data Pilot (3)

Data management plan (update D6.3)

The plan for the management of data with specific focus on the IAM impact motion dataset of WP1 Data management plan M6 and update M40

Data management plan (2nd update D6.3)

The plan for the management of data, with specific focus on the I.AM. impact motion dataset of WP1. Data management plan (M6) and update (M40)

Data Management Plan

The plan for the management of data, with specific focus on the I.AM. impact motion dataset of WP1. Data management plan (M6) and update (M40)

Dokumente, Berichte (15)

Human safety in impact aware manipulation

This deliverable is a technical report describing how human safety can be ensured within I.AM. software framework to provide both human-safe and impact-aware manipulation, including implementation details of safety modules on a Franka Emika Panda robot manipulator and testing and benchmarking results of dynamic tossing and dynamic boxing.

Dissemination Plan

Publication of the I.AM. dissemination plan.

Physics Engine API for Learning, Planning, Sensing, and Control

Documentation of the API enabling the access to the physics engine for, e.g., requesting post-impact velocities given desired postures and pre-impact velocities, loading and modifying robot, enviroment, and objects kinematic and dynamic descriptions. This deliverable includes the result of numerical testing, performed in conjuction of the valation scenarios, to document the expected functioning and access to the physics engine via the API.

Minutes of the milestone review consortium meeting (focus: final validation TOSS, BOX, and GRAB scenarios)

This deliverable is a document summarizing the reflections and decisions of the whole consortium taken in order to ensure the successful final validation of the three validation scenarios (TOSS, BOX, GRAB) in the final project review.

I.AM. software integration policy

This deliverable and its update regard the I.AM. software integration policy (M6) and the testing of the software integration for the three validation scenarios (TOSS, BOX, GRAB), release public API software.

I.Control report

Collect papers published with an executive summary of main results and proposed algorithms. Separate technical annex gathering the final performances obtained for each modeling benchmark. This final report summarizes the main achievements, limitations and future directions related to I.Control (T4.1, T4.2, T4.3, T2.3). This includes also the publication of the impact aware QP robot control software (I.Control) as open source sofware (on GitHub or similar open platform).

I.Model Report

Collect papers published with an executive summary of main results and proposed algorithms. Separate technicalannex gathering the final performances obtained for each modeling benchmark. This final report summarizes themain achievements, limitations and future directions related to I.Model (T1.1, T1.2, T1.3, T1.4, and T2.1).

Minutes of the milestone review consortium meeting (focus: TOSS scenario)

This deliverable is a document summarizing the reflections and decisions of the whole consortium taken in order to ensure up the reaching of all milestones up to M30 (in particular, the experimental execution of the TOSS scenario).

Impact Posture Planning for Dynamic Manipulation

This deliverable will be composed of online published papers or technical report about the theoretical foundation for the impact posture planning This is include also the publication of the impact posture planning as open source sofware on GitHub or similar open platform

I.Sense report

Collect papers published with an executive summary of main results and proposed algorithms. Separate technical annex gathering the final performances obtained for each modeling benchmark. This final report summarizes the main achievements, limitations and future directions related to I.Sense (T3.1, T3.2). This includes also the publication of the aim-aware impact monitoring pipeline and reflex decision tree software (I.Sense) as opensource sofware (on GitHub or similar open platform).

Minutes of the milestone review consortium meeting (focus: integration)

This deliverable is a document summarizing the reflections and decisions of the whole consortium taken in order to ensure up the reaching of all milestones up to M18 (in particular, software integration and the numerical simulation of the TOSS scenario).

I.AM. software integration policy (update D5.1)

This deliverable and its update regard the IAM software integration policy M6 and the testing of the software integration for the three validation scenarios TOSS BOX GRAB release public API software

Minutes of the milestone review consortium meeting (focus: BOX and GRAB scenarios)

This deliverable is a document summarizing the reflections and decisions of the whole consortium taken in order to ensure up the reaching of all milestones up to M42 in particular the experimental execution of the GRAB and BOX scenarios

Gender Action Plan

Gender action plan to actively address gender unbalance in the consortium.

I.Learn report

Collect papers published with an executive summary of main results and proposed algorithms. Separate technical annex gathering the final performances obtained for each modeling benchmark. This final report summarizes the main achievements, limitations and future directions related to I.Learn (T2.2, T3.3). This includes also the publication of the learning software (I.Learn), not already published in D2.1, as open source sofware (on GitHub or similar open platform).

Demonstrationssysteme, Piloten, Prototypen (3)

Scenario 3 (GRAB) report

This deliverable is a technical report describing the implementation details of I.AM. technology on dual arm KUKA system, including testing and benchmarking results of dynamic (=non-zero contact speed, object- enviroment impact aware) grabbing in comparison with standard (=almost zero-speed, impact unaware) picking and manipulation.

Scenario 2 (BOX) report

This deliverable is a technical report describing the implementation details of I.AM. technology on a Franka Emika Panda robot manipulator, including testing and benchmarking results of dynamic (= non-zero speed, object- enviroment aware) boxing in comparison with standard (= almost zero-speed, object-enviroment unaware) boxing.

Scenario 1 (TOSS) report

This deliverable is a technical report describing the implementation details of I.AM. technology on UR and Panda robots, including testing and benchmarking results of dynamic (=non-zero speed, object-environment aware) tossing in comparison with standard (=almost zero-speed, object-environment unaware) placing on a moving conveyor belt.

Websites, Patentanmeldungen, Videos etc. (1)

Website and software repository

Publication of the I.AM. website with feeds from relevant social networks

Datensätze, Mikrodaten, usw. (2)

Publication of I.AM. dataset (update D1.1)

Release of I.AM. dataset. The dataset will contain object-enviroment, robot-object, and robot-object-environment collisions data. Precise details of the dataset will be defined in T1.2. The final version will also include an associated scientific paper.

Publication of I.AM. dataset

First release of I.AM. dataset. The dataset will contain object-enviroment, robot-object, and robot-object-environment collisions data. Precise details of the dataset will be defined in T1.2. The final version (later deliverable) will also include an associated scientific paper.

Veröffentlichungen

Fachlich begutachtete Artikel (15)

Editorial Introduction to the IEEE T-RO Special Collection on Impact-Aware Robotics

Autoren: Abderrahmane Kheddar, Yan Gu, Michael Posa, Alessandro Saccon
Veröffentlicht in: IEEE Transactions on Robotics, Ausgabe 40, 2024, Seite(n) i-iv, ISSN 1552-3098
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2024.3486408

Dual Arm Impact-Aware Grasping through Time-Invariant Reference Spreading Control

Autoren: Jari J. van Steen, Abdullah Coşgun, Nathan van de Wouw, Alessandro Saccon
Veröffentlicht in: IFAC-PapersOnLine, Ausgabe 56, 2024, Seite(n) 1009-1016, ISSN 2405-8963
Herausgeber: Elsevier
DOI: 10.1016/j.ifacol.2023.10.1697

Dual-Arm Control for Coordinated Fast Grabbing and Tossing of an Object: Proposing a New Approach

Autoren: Michael Bombile; Aude Billard
Veröffentlicht in: IEEE Robotics & Automation Magazine, Ausgabe 1, 2022, ISSN 1070-9932
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mra.2022.3177355

Robust Task-Space Quadratic Programming for Kinematic-Controlled Robots

Autoren: Mohamed Djeha, Pierre Gergondet, Abderrahmane Kheddar
Veröffentlicht in: IEEE Transactions on Robotics, Ausgabe 39, 2023, Seite(n) 3857-3874, ISSN 1552-3098
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2023.3286069

Sequential hierarchical least-squares programming for prioritized non-linear optimal control

Autoren: Kai Pfeiffer, Abderrahmane Kheddar
Veröffentlicht in: Optimization Methods and Software, Ausgabe 39, 2024, Seite(n) 1104-1142, ISSN 1055-6788
Herausgeber: Taylor & Francis
DOI: 10.1080/10556788.2024.2307467

Dual-arm box grabbing with impact-aware model predictive control utilizing soft deformable end-effector pads

Autoren: N. Dehio, Y. Wang, A. Kheddar,
Veröffentlicht in: IEEE Robotics and Automation Letters, 2022, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.1109/lra.2022.3158433

Quadratic Programming-Based Reference Spreading Control for Dual-Arm Robotic Manipulation With Planned Simultaneous Impacts

Autoren: Jari van Steen, Gijs van den Brandt, Nathan van de Wouw, Jens Kober, Alessandro Saccon
Veröffentlicht in: IEEE Transactions on Robotics, Ausgabe 40, 2024, Seite(n) 3341-3355, ISSN 1552-3098
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2024.3420800

Refined Post-Impact Velocity Prediction for Torque-Controlled Flexible-Joint Robots

Autoren: Camilo Andres Rey Arias, Wouter Weekers, Marco Morganti, Vincent Padois, Alessandro Saccon
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 9, 2024, Seite(n) 3267-3274, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.1109/lra.2024.3364469

The Franka Emika Robot: A Reference Platform for Robotics Research and Education

Autoren: S. Haddadin, S. Parusel, L. Johannsmeier, S. Golz, S. Gabl, F. Walch, M. Sabaghian, C. Jähne, L. Hausperger, S. Haddadin
Veröffentlicht in: IEEE Robotics & Automation Magazine, 2022, ISSN 1070-9932
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mra.2021.3138382

On Inverse Inertia Matrix and Contact-Force Model for Robotic Manipulators at Normal Impacts

Autoren: Yuquan Wang; Niels Dehio; Abderrahmane Kheddar
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 4, 2022, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.48550/arxiv.2109.04756

Predicting impact-induced joint velocity jumps on kinematics-controlled manipulators

Autoren: Y. Wang, N. Dehio, A. Kheddar,
Veröffentlicht in: IEEE Robotics and Automation Letters, 2022, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.1109/lra.2022.3167614

Aim-Aware Collision Monitoring: Discriminating Between Expected and Unexpected Post-Impact Behaviors

Autoren: Benn Proper, Alexander Kurdas, Saeed Abdolshah, Sami Haddadin, Alessandro Saccon
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 8, 2023, Seite(n) 4609-4616, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.1109/lra.2023.3284371

Expectable Motion Unit: Avoiding Hazards From Human Involuntary Motions in Human-Robot Interaction

Autoren: Robin Jeanne Kirschner; Henning Mayer; Lisa Burr; Nico Mansfeld; Saeed Abdolshah; Sami Haddadin
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 1, 2022, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.48550/arxiv.2109.07201

Planning Impact-Driven Logistic Tasks

Autoren: Ahmed Zermane, Niels Dehio, Abderrahmane Kheddar
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 9, 2024, Seite(n) 2184-2191, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.1109/lra.2024.3354614

A Compact 6D Suction Cup Model for Robotic Manipulation via Symmetry Reduction

Autoren: Alexander A. Oliva, Maarten J. Jongeneel, Alessandro Saccon
Veröffentlicht in: IEEE Transactions on Robotics, Ausgabe 41, 2025, Seite(n) 2285-2300, ISSN 1552-3098
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2025.3551197

Konferenzprotokolle (23)

Towards a Reference Framework for Tactile Robot Performance and Safety Benchmarking

Autoren: Kirschner RJ, Kurdas A, Karacan K, Junge P, Baradaran Birjandi SA, Mansfeld N, Abdolshah S, Haddadin S
Veröffentlicht in: International Conference on Intelligent Robots and Systems (IROS) 2021, 2021
Herausgeber: IEEE

Experimental Analysis of Impact Forces in Constrained Collisions According to ISO/TS 15066

Autoren: Robin Jeanne Kirschner, Nico Mansfeld, Saeed Abdolshah and Sami Haddadin
Veröffentlicht in: 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), 2021
Herausgeber: IEEE

Mean Reflected Mass: A Physically Interpretable Metric for Safety Assessment and Posture Optimisation in Human-Robot Interaction

Autoren: T. Steinecker, A. Kurdas, N. Mansfeld, M. Hamad, R. J. Kirschner, S. Abdolshah, S. Haddadin
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/icra46639.2022.9811582

Robot Control for Simultaneous Impact Tasks through Time-Invariant Reference Spreading

Autoren: Jari J. van Steen, Nathan van de Wouw, Alessandro Saccon
Veröffentlicht in: 2023 American Control Conference (ACC), 2023, Seite(n) 46-53
Herausgeber: IEEE
DOI: 10.23919/acc55779.2023.10156028

An MPC Framework For Planning Safe & Trustworthy Robot Motions

Autoren: M. Eckhoff, R. J. Kirschner, E. Kern, S. Abdolshah, S. Haddadin
Veröffentlicht in: 2022
Herausgeber: IEEEE
DOI: 10.1109/icra46639.2022.9812160

CSM: Contact Sensitivity Maps for Benchmarking Robot Collision Handling Systems

Autoren: Kirschner RJ, Jantalia J, Mansfeld N, Abdolshah S, Haddadin S
Veröffentlicht in: IEEE International Conference on Robotics and Automation (ICRA), 2021
Herausgeber: IEEE

Rm-Code: Proprioceptive Real-Time Recursive Multi-Contact Detection, Isolation and Identification

Autoren: Vorndamme J and Haddadin S
Veröffentlicht in: International Conference on Intelligent Robots and Systems (IROS) 2021, 2021
Herausgeber: IEEE

Online Payload Identification for Tactile Robots Using the Momentum Observer

Autoren: A. Kurdas, M. Hamad, J. Vorndamme, N. Mansfeld, S. Abdolshah and S. Haddadin
Veröffentlicht in: ICRA 2022, 2022
Herausgeber: IEEE
DOI: 10.1109/icra46639.2022.9811691

Learning Suction Cup Dynamics from Motion Capture: Accurate Prediction of an Object's Vertical Motion during Release

Autoren: Menno Lubbers; Job van Voorst; Maarten Jongeneel; Alessandro Saccon
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/iros47612.2022.9982211

A Robotics Perspective on Experimental Injury Biomechanics of Human Body Upper Extremities

Autoren: Mazin Hamad, Alexander Kurdas, Saeed Abdolshah and Sami Haddadin
Veröffentlicht in: 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), 2021
Herausgeber: IEEE

Model-Adaptive High-Speed Collision Detection for Serial-Chain Robot Manipulators

Autoren: Seyed Ali Baradaran Birjandi, Sami Haddadin
Veröffentlicht in: 2020 IEEE Robotics and Automation Letters, 2020
Herausgeber: IEEE

Geometric Savitzky-Golay Filtering of Noisy Rotations on SO(3) with Simultaneous Angular Velocity and Acceleration Estimation

Autoren: M. Jongeneel, A. Saccon
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/iros47612.2022.9981409

Functional Mode Switching for Safe and Efficient Human-Robot Interaction

Autoren: P. Svarny, M. Hamad, A. Kurdas, M. Hoffmann, A. Saeed and S. Haddadin
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/humanoids53995.2022.10000070

Robot-Safe Impacts with Soft Contacts Based on Learned Deformations

Autoren: Dehio, Niels; Kheddar, Abderrahmane
Veröffentlicht in: ICRA, Ausgabe 1, 2021
Herausgeber: IEEE

Notion on the Correct Use of the Robot Effective Mass in the Safety Context and Comments on ISO/TS 15066

Autoren: Kirschner RJ, Mansfeld N, Peña GG, Abdolshah S, Haddadin S.
Veröffentlicht in: 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), 2021
Herausgeber: IEEE

Learning to Hit: A statistical Dynamical System based approach

Autoren: Harshit Khurana, Michael Bombile, Aude Billard
Veröffentlicht in: IROS 2021, 2021
Herausgeber: IEEE/RSJ International Conference on Intelligent Robots and Systems

Experimental Injury Biomechanics of Human Body Upper Extremities: Anatomy, Injury Severity Classification, and Impact Testing Setups

Autoren: Mazin Hamad, Alexander Kurdas, Saeed Abdolshah and Sami Haddadin
Veröffentlicht in: 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), 2021
Herausgeber: IEEE

Predicting the Post-Impact Velocity of a Robotic Arm via Rigid Multibody Models: an Experimental Study

Autoren: Ilias Aouaj; Vincent Padois; Alessandro Saccon
Veröffentlicht in: IEEE International Conference on Robotics and Automation (ICRA), 2021
Herausgeber: IEEE

Robot Contact Reflexes: Adaptive Maneuvers in the Contact Reflex Space

Autoren: J. Vorndamme, L. F. C. Figueredo, S. Haddadin
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/iros47612.2022.9981904

Robust Cartesian Kinematics Estimation for Task-Space Control Systems

Autoren: Seyed Ali Baradaran Birjandi; Niels Dehio; Abderrahmane Kheddar; Sami Haddadin
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/iros47612.2022.9981233

Robot control for simultaneous impact tasks via QP based reference spreading

Autoren: J van Steen, N van de Wouw, A Saccon
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.23919/acc53348.2022.9867812

Real-Time IMU-Based Learning: A Classification of Contact Materials

Autoren: C. M. Valle, A. A. Kurdas, E. P. Fortunić, S. Abdolshah, S. Haddadin
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/iros47612.2022.9981139

Model-Based 6D Visual Object Tracking with Impact Collision Models

Autoren: Maarten Jongeneel; Alexandre Bernardino; Nathan van de Wouw; Alessandro Saccon
Veröffentlicht in: 2022 American Control Conference (ACC), 2022
Herausgeber: IEEE
DOI: 10.23919/acc53348.2022.9867622