Skip to main content
European Commission logo
français français
CORDIS - Résultats de la recherche de l’UE
CORDIS

Metrological Evaluation and Testing of Robots in International CompetitionS

Livrables

METRICS website

This deliverable contains the project website which includes a page for each competition that presents news videosphoto gallery of meetings and evaluation campaigns webinars press releases related to the competition

Methodological framework for acceptability assessment in the four PAs

This deliverable provides a global approach and specific implementations for each PA for the acceptability analysis of robots participating in the various METRICS competitions including relevant evaluation criteria and a methodology to establish the link between technical metrics agricultural robot site throughput production rate of an agile industrial robot consumption of electricity and other consumables etc and costs associated with the implementation of these robots degree of supervision required staff training to be provided estimates of savings achieved cost associated with this task before and after robot deployment and the societal and ethical impact human risk impact on employment qualification environmental impact etc

Overview of test infrastructures for robotic competitions and requirements for a sustainable activity in Europe

The deliverable contains the inventory and classification of testbeds that are available in Europe for the evaluation of robots in the four PAs their modality of access geographic accessibility structure type physical or digital It concerns both the existing infrastructures and the testbeds that will be designed for the needs of the project It identifies the potential lacks

RAMI Evaluation Plan

The evaluation plan includes the definition of scenarios episode task and functional benchmarks and their associated execution and assessment procedures It takes into account scientific economic ethical legal and safety aspects as well as inputs from stakeholders

Good practice guide for the organisation of evaluation campaigns

The good practice guide for the organisation of evaluation campaigns includes the organisational process based on a dryrun followed by official evaluation campaigns instructions for the fair treatment of participants communication and awarenessraising actions to be carried out This deliverable also includes ethical guidelines for the definition of the evaluation plan and the implementation of the competition

ACRE Evaluation Plan

The evaluation plan includes the definition of scenarios episode task and functional benchmarks and their associated execution and assessment procedures It takes into account scientific economic ethical legal and safety aspects as well as inputs from stakeholders

HEART-MET Evaluation Plan

The evaluation plan includes the definition of scenarios episode task and functional benchmarks and their associated execution and assessment procedures It takes into account scientific economic ethical legal and safety aspects as well as inputs from stakeholders

ADAPT Evaluation Plan

The evaluation plan includes the definition of scenarios episode task and functional benchmarks and their associated execution and assessment procedures It takes into account scientific economic ethical legal and safety aspects as well as inputs from stakeholders

Preliminary methodological framework / Evaluation plan template

This deliverable contains an evaluation plan template for the METRICS competitions including a methodology for the evaluation protocol the evaluation tasks the metrics used the test facilities test databases participation rules and operating procedures capitalising on many campaigns organised by METRICS partners in the past

Publications

Field campaign and experimental design for robot performance evaluation (ACRE 2023)

Auteurs: Sofia Matilde Luglio; Mino Sportelli; Christian Frasconi; Marco Fontanelli; Matteo Matteucci; Giulio Fontana; Enrico Piazza; Davide Facchinetti
Publié dans: 2023 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor), Numéro 2023 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor), 2024
Éditeur: 2023 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor)
DOI: 10.1109/metroagrifor58484.2023.10424292

Quantitative Benchmarking in Agricultural Robotics

Auteurs: Riccardo Bertoglio-Giulio Fontana-Matteo Matteucci-Davide Facchinetti-Stefano Santoro
Publié dans: 2020
Éditeur: Second Italian Conference on Robotics and Intelligent Machines Program - I-RIM

On the Design of the Agri-Food Competition for Robot Evaluation (ACRE)

Auteurs: Riccardo Bertoglio, Giulio Fontana, Matteo Matteucci, Davide Facchinetti, Michel Berducat, Daniel Boffety
Publié dans: 2021 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), 2021, Page(s) 161-166, ISBN 978-1-6654-3198-9
Éditeur: IEEE
DOI: 10.1109/icarsc52212.2021.9429792

AI evaluation campaigns during robotics competitions: the METRICS paradigm

Auteurs: Guillaume Avrin-Virginie Barbosa-Agnes Delaborde
Publié dans: 2020
Éditeur: 1st International Workshop on Evaluating Progress in Artificial Intelligence - EPAI 2020 In conjunction with the 24th European Conference on Artificial Intelligence - ECAI 2020

Robustness of Deep Learning Methods for Occluded Object Detection-A Study Introducing a Novel Occlusion Dataset

Auteurs: Ziling Wu; Armaghan Moemeni; Simon Castle-Green; Praminda Caleb-Solly
Publié dans: 2023
Éditeur: IEEE
DOI: 10.1109/ijcnn54540.2023.10191368

Instructing Hierarchical Tasks to Robots by Verbal Commands

Auteurs: P. Telkes, A. Angleraud, R. Pieters
Publié dans: IEEE/SICE International Symposium on System Integration, 2024
Éditeur: IEEE

Towards Multimodal Sensing and Interaction for Assistive Autonomous Robots

Auteurs: Emanuele De Pellegrin, Ronnie Smith, Scott MacLeod, Mauro Dragone & Ronald P. A. Petrick
Publié dans: TAROS 2023: Towards Autonomous Robotic Systems, 2023, Page(s) pp 162–173, ISBN 978-3-031-43359-7
Éditeur: Annual Conference Towards Autonomous Robotic Systems
DOI: 10.1007/978-3-031-43360-3_14

Agri-Food Competition for Robot Evaluation (ACRE), the design of a competition of the METRICS project

Auteurs: Daniel Boffety, Manon Boulet, Michel Berducat, Matteo Matteucci, Riccardo Bertoglio, Giulio Fontana, and Davide Facchinetti
Publié dans: 8 th International Conference on Machine Control & Guidance, 2022, Page(s) 7 to 13
Éditeur: Laboratory of Off-Road Machine and Vehicle Engineering

RAMI: an Inspection and Maintenance Competition for Underwater Robots

Auteurs: Gabriele Ferri; Alessandro Faggiani; Tommaso Fabbri; Fausto Ferreira
Publié dans: 2023
Éditeur: IEEE
DOI: 10.1109/oceanslimerick52467.2023.10244694

From ERL to RAMI: Expanding Marine Robotics Competitions - Through Virtual Events

Auteurs: Gabriele Ferri; Fausto Ferreira; Alessandro Faggiani; Tommaso Fabbri
Publié dans: OCEANS 2021: San Diego – Porto, 2022
Éditeur: IEEE
DOI: 10.23919/oceans44145.2021.9706098

Adaptive Heading for Perception-Aware Trajectory Following

Auteurs: Jonatan Scharff Willners, Sean Katagiri, Shida Xu1, Tomasz Łuczy´nski, Joshua Roe and Yvan Petillot
Publié dans: 2023
Éditeur: 2023 IEEE International Conference on Robotics and Automation (ICRA 2023)
DOI: 10.1109/icra48891.2023.10160521

Lowering the Entry Barrier to Aerial Robotics Competitions

Auteurs: Francisco J. Pérez-Grau; Pablo León Barriga; Antidio Viguria
Publié dans: 2023
Éditeur: IEEE
DOI: 10.1109/icuas57906.2023.10156284

Observability-Aware Active Extrinsic Calibration of Multiple Sensors

Auteurs: Shida Xu, Jonatan Scharff Willners, Ziyang Hong, Kaicheng Zhang, Yvan R. Petillot and Sen Wang
Publié dans: 2023
Éditeur: 2023 IEEE International Conference on Robotics and Automation (ICRA 2023)
DOI: 10.1109/icra48891.2023.10160636

Multi-label Annotation for Visual Multi-Task Learning Models

Auteurs: G. Sharma, A. Angleraud, R. Pieters
Publié dans: IEEE International Conference on Robotic Computing, 2023
Éditeur: IEEE

Automatic Dataset Generation From CAD for Vision-Based Grasping

Auteurs: Saad Ahmad, Kulunu Samarawickrama, Esa Rahtu and Roel Pieters
Publié dans: 2021 20th International Conference on Advanced Robotics (ICAR), 2022
Éditeur: IEEE
DOI: 10.1109/icar53236.2021.9659336

Validation de méthodologies d’évaluation de solutions de désherbage autonomes, dans le cadre des projets Challenge ROSE et METRICS. Validation of methodologies for the evaluation of autonomous weed in the framework of the Challenge ROSE and METRICS projects.

Auteurs: Rémi Regnier ; Guillaume Avrin ; Virginie Barbosa ; Daniel Boffety ; Anne Kalouguine ; Sophie Lardy-Fontan
Publié dans: Revue Ouverte d’Intelligence Artificielle-ROIA Open Journal of Artificial Intelligence-ROIA, 2021
Éditeur: Revue Ouverte d’Intelligence Artificielle-ROIA Open Journal of Artificial Intelligence-ROIA
DOI: 10.5802/roia.8

Benchmarking Robots by Inducing Failures in Competition Scenarios

Auteurs: Santosh Thoduka, Nico Hochgeschwender
Publié dans: Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. AI, Product and Service - 12th International Conference, DHM 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part II, Numéro 12778, 2021, Page(s) 263-276, ISBN 978-3-030-77819-4
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-030-77820-0_20

A COTS (UHF) RFID Floor for Device-Free Ambient Assisted Living Monitoring

Auteurs: Smith, R., Ding, Y., Goussetis, G., Dragone, M
Publié dans: Advances in intelligent system and computing - Vol 1239 - Ambiant intelligence - Software and applications - 11th international symposium of ambient intelligence, 2020
Éditeur: International Symposium on Ambient Intelligence
DOI: 10.1007/978-3-030-58356-9

Assessing artificial intelligence capabilities

Auteurs: Guillaume Avrin - Laboratoire national de métrologie et d'essais
Publié dans: Educational Research and Innovation - AI and the Future of Skills, Volume 1 - CAPABILITIES AND ASSESSMENTS, 2021
Éditeur: OECD iLibrary
DOI: 10.1787/47d04fe3-en

The VISTA datasets, a combination of inertial sensors and depth cameras data for activity recognition

Auteurs: Fiorini, L., Cornacchia Loizzo, F. G., Sorrentino, A., Rovini, E., Di Nuovo, A., & Cavallo, F.
Publié dans: Nature Scientific Data, Numéro Scientific Data, 9(1), 1-14 -Article number: 218 (2022), 2022, ISSN 2052-4463
Éditeur: Scientific Data (Sci Data)
DOI: 10.1038/s41597-022-01324-3

Activity Recognition for Ambient Assisted Living with Videos, Inertial Units and Ambient Sensors

Auteurs: Caetano Mazzoni Ranieri, Scott MacLeod, Mauro Dragone, Patricia Amancio Vargas, Roseli Aparecida Francelin Romero 
Publié dans: Sensors, Numéro 21/3, 2021, Page(s) 768, ISSN 1424-8220
Éditeur: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21030768

A Comparative Study of Fourier Transform and CycleGAN as Domain Adaptation Techniques for Weed Segmentation

Auteurs: Riccardo Bertoglio; Alessio Mazzucchelli ; Nico Catalano ; Matteo Matteucci
Publié dans: Smart Agricultural Technology, 2023, ISSN 1872-6291
Éditeur: Science direct - Elsevier
DOI: 10.1016/j.atech.2023.100188

6D Assembly Pose Estimation by Point Cloud Registration for Robot Manipulation

Auteurs: K. Samarawickrama, G. Sharma, A. Angleraud, R. Pieters
Publié dans: 2023
Éditeur: arXiv
DOI: 10.48550/arxiv.2312.02593

Évaluation de l’intelligence artificielle

Auteurs: Guillaume AVRIN
Publié dans: 2023
Éditeur: Techniques de l'ingenieur
DOI: 10.51257/a-v1-r727

Automatic Robot Path Planning for Visual Inspection from Object Shape

Auteurs: O. Tasneem, R. Pieters
Publié dans: 2023, Page(s) 8 pages
Éditeur: arXiv
DOI: 10.48550/arxiv.2312.02603

Recherche de données OpenAIRE...

Une erreur s’est produite lors de la recherche de données OpenAIRE

Aucun résultat disponible