Spatial Perception and Embodied Autonomy Research

Projektinformationen

SPEAR

ID Finanzhilfevereinbarung: 101119774

DOI

10.3030/101119774

EK-Unterschriftsdatum 27 Juni 2023

Startdatum 1 November 2023

Enddatum 31 Oktober 2027

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 6 746 086,25

EU-Beitrag

€ 6 746 086,25

Koordiniert durch

NORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET NTNU
Norway

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (10)

Evolutionary flying robot embodiment generation

Report on evolutionary Human-&-AI embodiment co-generation algorithms. The report shall contain also software examples.

Ultra-low latency multi-modal SLAM

Report on low-latency event-based active ranging, ULL (multi-modal) SLAM. The report shall contain also software examples.

Navigation policy learning and constraint handling

Report on baseline navigation policy learning for automatically generated flying embodiments with constraint handling. The report shall contain also software examples.

Final Simulation Toolbox

Report for the simulation toolbox. The report shall contain also software examples.

Collision detection and propulsion technologies for soft drones

Report on collision detection techniques and approaches on embedding propulsion for the generated bodies.

Dissemination, exploitation and communication plan

Dissemination, exploitation and communication plan report (iteratively updated).

Soft aerial robot design

Report on soft aerial robots design and embodiment sensing. The report shall contain also design examples.

Dissemination, exploitation and communication plan - Update 1

Dissemination, exploitation and communication plan report (iteratively updated).

Ultra-low latency multi-modal SLAM - Update

Updated report on low-latency event-based active ranging, ULL (multi-modal) SLAM. The report shall contain also software examples.

Mid-term Simulation Toolbox

Report for the first version of Simulation Toolbox. The report shall contain also software examples.

Other (2)

Software and Dataset releases

SPEAR Software and Dataset release involving the simulation toolbox (M18 - this deliverable), the soft materials design tool (M24 - Update 1), the Evolutionary Algorithms-based embodiment generation (M34 - Update 2), and the Navigation Policy Learning software (M44 - Update 3).

Software and Dataset releases - Update 1

SPEAR Software and Dataset release involving the simulation toolbox (M18), the soft materials design tool (M24 - this deliverable), the Evolutionary Algorithms-based embodiment generation (M34 - Update 2), and the Navigation Policy Learning software (M44 - Update 3).

Data Management Plan (2)

Data Management Plan

The DMP contains detailed procedures for all data types producing during SPEAR. The DMP will be a living document (see also planned updates).

Data Management Plan - Update 1

SPEAR Data Management Plan - Update 1

Demonstrators, pilots, prototypes (1)

Field testing and demonstration

Report on field test-based demonstration of the SPEAR prototypes. The report shall also contain data from the field tests.

Veröffentlichungen

Conference proceedings (15)

Reinforcement Learning for Active Perception in Autonomous Navigation

Autoren: Grzegorz Malczyk, Mihir Kulkarni, Kostas Alexis
Veröffentlicht in: Accepted at IEEE ICRA 2026, 2026
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2602.01266

Curriculum-based Sample Efficient Reinforcement Learning for Robust Stabilization of a Quadrotor

Autoren: Fausto Mauricio Lagos Suarez; Akshit Saradagi; Vidya Sumathy; Shruti Kotpalliwar; George Nikolakopoulos
Veröffentlicht in: CoRR, 2025
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2501.18490

Tightly-Coupled Radar-Visual-Inertial Odometry

Autoren: Morten Nissov, Mohit Singh, Kostas Alexis
Veröffentlicht in: Accepted to IEEE ECC 2026, 2026
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2603.23052

A Graph-Based Reinforcement Learning Approach with Frontier Potential Based Reward for Safe Cluttered Environment Exploration

Autoren: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Veröffentlicht in: 24th European Control Conference, 2026
Herausgeber: IEEE

Belief Scene Graphs: Expanding Partial Scenes with Objects through Computation of Expectation

Autoren: Mario A.V. Saucedo, Akash Patel, Akshit Saradagi, Christoforos Kanellakis, George Nikolakopoulos
Veröffentlicht in: 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024
Herausgeber: IEEE
DOI: 10.48550/arXiv.2402.03840

Platform-Agnostic Reinforcement Learning Framework for Safe Exploration of Cluttered Environments with Graph Attention

Autoren: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Veröffentlicht in: The 2026 IEEE International Conference on Robotics & Automation (ICRA)
Herausgeber: IEEE

Decentralized Multi-Agent Reinforcement Learning Exploration with Inter-Agent Communication-Based Action Space

Autoren: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Veröffentlicht in: 2024 24th International Conference on Control, Automation and Systems (ICCAS), 2024, ISSN 2642-3901
Herausgeber: IEEE
DOI: 10.23919/ICCAS63016.2024.10773383

D-MARL: A Dynamic Communication-Based Action Space Enhancement for Multi Agent Reinforcement Learning Exploration of Large Scale Unknown Environments

Autoren: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Veröffentlicht in: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2024

A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditions

Autoren: Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy, George Nikolakopoulos
Veröffentlicht in: 34th Mediterranean Conference on Control and Automation (MED26), 2026
Herausgeber: IEEE

Learning UAV Navigation with Collision-Aware Predicted-Motion Embedding

Autoren: Mohammad Javad Zallaghi, Bryan Convens, Kelly Merckaert, Adrian Munteanu, Bram Vanderborght
Veröffentlicht in: 2026
Herausgeber: Benelux Meeting on Systems and Control 2026

Fuzzy Logic Theory-based Adaptive Reward Shaping for Robust Reinforcement Learning (FARS)

Autoren: Hürkan Şahin, Van Huyen Dang, Erdi Sayar, Alper Yegenoglu, Erdal Kayacan
Veröffentlicht in: IEEE WCCI 2026, 2026
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2604.15772

Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3

Autoren: Hürkan Şahin, Huy Xuan Pham, Van Huyen Dang, Alper Yegenoglu, Erdal Kayacan
Veröffentlicht in: IEEE International Conference on Robotics & Automation, 2026
Herausgeber: IEEE

Vine Robots that Evert through Bending

Autoren: Rui Wu, Stefano Mintchev
Veröffentlicht in: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Herausgeber: IEEE
DOI: 10.3929/ethz-b-000705656

UniPilot: Enabling GPS-Denied Autonomy Across Embodiments

Autoren: Mihir Kulkarni, Mihir Dharmadhikari, Nikhil Khedekar, Morten Nissov, Mohit Singh, Philipp Weiss, Kostas Alexis
Veröffentlicht in: 2025 IEEE International Conference on Advanced Robotics (ICAR), 2026
Herausgeber: IEEE
DOI: 10.1109/ICAR65334.2025.11338632

Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs

Autoren: Mario A.V. Saucedo, Nikolaos Stathoulopoulos, Akash Patel, Christoforos Kanellakis, George Nikolakopoulos
Veröffentlicht in: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Herausgeber: IEEE
DOI: 10.48550/arXiv.2409.05392

Peer reviewed articles (12)

Efficient Knowledge Transfer for Jump-Starting Control Policy Learning of Multirotors Through Physics-Aware Neural Architectures

Autoren: Welf Rehberg, Mihir Kulkarni, Philipp Weiss, Kostas Alexis
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 11, 2026, ISSN 2377-3766
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2026.3668585

VDS-Nav: Volumetric Depth-Based Safe Navigation for Aerial Robots–Bridging the Sim-to-Real Gap

Autoren: Van Huyen Dang; Adrian Redder; Huy Xuan Pham; Andriy Sarabakha; Erdal Kayacan
Veröffentlicht in: IEEE Robotics and Automation Letters, 2025, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.1109/LRA.2025.3606806

Morphy: A Compliant and Morphologically Aware Flying Robot

Autoren: Paolo De Petris; Morten Nissov; Kostas Alexis
Veröffentlicht in: Advanced Intelligent Systems, 2024, ISSN 2640-4567
Herausgeber: Wiley
DOI: 10.1002/aisy.202400493

Aerial Gym Simulator: A Framework for Highly Parallelized Simulation of Aerial Robots

Autoren: Mihir Kulkarni; Welf Rehberg; Kostas Alexis
Veröffentlicht in: IEEE Robotics and Automation Letters, 2025, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2503.01471

MAVRL: Learn to Fly in Cluttered Environments With Varying Speed

Autoren: Hang Yu, ChristopheDe Wagter, Guido C. H. E de Croon
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 10, 2025, ISSN 2377-3766
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2024.3522778

Collaborative Exploration With a Marsupial Ground-Aerial Robot Team Through Task-Driven Map Compression

Autoren: Angelos Zacharia, Mihir Dharmadhikari, Kostas Alexis
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 10, 2025, ISSN 2377-3766
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2025.3609040

Neural NMPC through signed distance field encoding for collision avoidance

Autoren: Martin Jacquet, Marvin Harms, Kostas Alexis
Veröffentlicht in: The International Journal of Robotics Research, 2026, ISSN 0278-3649
Herausgeber: SAGE Publications
DOI: 10.1177/02783649251401223

Depth Transfer: Learning to See Like a Simulator for Real-World Drone Navigation

Autoren: Hang Yu, Christophe De Wagter, Guido C. H. E de Croon
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 10, 2025, ISSN 2377-3766
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2025.3617729

Encoding mechanical intelligence using ultraprogrammable joints

Autoren: Rui Wu, Luca Girardi, Stefano Mintchev
Veröffentlicht in: Science Advances, Ausgabe 11, 2025, ISSN 2375-2548
Herausgeber: American Association for the Advancement of Science (AAAS)
DOI: 10.1126/SCIADV.ADV2052

Semantically-Driven Deep Reinforcement Learning for Inspection Path Planning

Autoren: Grzegorz Malczyk; Mihir Kulkarni; Kostas Alexis
Veröffentlicht in: IEEE Robotics and Automation Letters, 2025, ISSN 2377-3766
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2505.14443

On the Characterization and Limits of 4D Radar for Aided Inertial Navigation

Autoren: Morten Nissov, Kostas Alexis
Veröffentlicht in: IEEE Transactions on Field Robotics, 2026, ISSN 2997-1101
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TFR.2026.3690584

A Terminal State Feasibility Governor for Real-Time Nonlinear Model Predictive Control Over Arbitrary Horizons

Autoren: Bryan Convens; Dominic Liao-McPherson; Kelly Merckaert; Bram Vanderborght; Marco M. Nicotra
Veröffentlicht in: IEEE Transactions on Control Systems Technology, 2024, ISSN 1558-0865
Herausgeber: IEEE
DOI: 10.1109/tcst.2024.3365996

Book chapters (1)

Unconventional Hexacopters via Evolution and Learning: Performance Gains and New Insights

Autoren: Jed R. Muff, Keiichi Ito, Elijah H. W. Ang, Karine Miras, A. E. Eiben
Veröffentlicht in: Lecture Notes in Computer Science, Applications of Evolutionary Computation, 2026
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-032-23604-3_5

Other (1)

MAC: Morphology-Aware Control Design with Deep Reinforcement Learning for Navigation of Squeezable Unmanned Aerial Vehicles

Autoren: Van Huyen Dang, Adrian Redder, Erdal Kayacan
Veröffentlicht in: Workshop on Morphology-Aware Policy and Design Learning (MAPoDeL) at CoRL 2024., 2024
Herausgeber: OpenReview