Spatial Perception and Embodied Autonomy Research

Informazioni relative al progetto

SPEAR

ID dell’accordo di sovvenzione: 101119774

DOI

10.3030/101119774

Data della firma CE 27 Giugno 2023

Data di avvio 1 Novembre 2023

Data di completamento 31 Ottobre 2027

Finanziato da

• Digital, Industry and Space

Costo totale

€ 6 746 086,25

Contributo UE

€ 6 746 086,25

Coordinato da

NORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET NTNU
Norway

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (10)

Evolutionary flying robot embodiment generation

Report on evolutionary Human-&-AI embodiment co-generation algorithms. The report shall contain also software examples.

Ultra-low latency multi-modal SLAM

Report on low-latency event-based active ranging, ULL (multi-modal) SLAM. The report shall contain also software examples.

Navigation policy learning and constraint handling

Report on baseline navigation policy learning for automatically generated flying embodiments with constraint handling. The report shall contain also software examples.

Final Simulation Toolbox

Report for the simulation toolbox. The report shall contain also software examples.

Collision detection and propulsion technologies for soft drones

Report on collision detection techniques and approaches on embedding propulsion for the generated bodies.

Dissemination, exploitation and communication plan

Dissemination, exploitation and communication plan report (iteratively updated).

Soft aerial robot design

Report on soft aerial robots design and embodiment sensing. The report shall contain also design examples.

Dissemination, exploitation and communication plan - Update 1

Dissemination, exploitation and communication plan report (iteratively updated).

Ultra-low latency multi-modal SLAM - Update

Updated report on low-latency event-based active ranging, ULL (multi-modal) SLAM. The report shall contain also software examples.

Mid-term Simulation Toolbox

Report for the first version of Simulation Toolbox. The report shall contain also software examples.

Other (2)

Software and Dataset releases

SPEAR Software and Dataset release involving the simulation toolbox (M18 - this deliverable), the soft materials design tool (M24 - Update 1), the Evolutionary Algorithms-based embodiment generation (M34 - Update 2), and the Navigation Policy Learning software (M44 - Update 3).

Software and Dataset releases - Update 1

SPEAR Software and Dataset release involving the simulation toolbox (M18), the soft materials design tool (M24 - this deliverable), the Evolutionary Algorithms-based embodiment generation (M34 - Update 2), and the Navigation Policy Learning software (M44 - Update 3).

Data Management Plan (2)

Data Management Plan

The DMP contains detailed procedures for all data types producing during SPEAR. The DMP will be a living document (see also planned updates).

Data Management Plan - Update 1

SPEAR Data Management Plan - Update 1

Demonstrators, pilots, prototypes (1)

Field testing and demonstration

Report on field test-based demonstration of the SPEAR prototypes. The report shall also contain data from the field tests.

Pubblicazioni

Conference proceedings (15)

Reinforcement Learning for Active Perception in Autonomous Navigation

Autori: Grzegorz Malczyk, Mihir Kulkarni, Kostas Alexis
Pubblicato in: Accepted at IEEE ICRA 2026, 2026
Editore: IEEE
DOI: 10.48550/ARXIV.2602.01266

Curriculum-based Sample Efficient Reinforcement Learning for Robust Stabilization of a Quadrotor

Autori: Fausto Mauricio Lagos Suarez; Akshit Saradagi; Vidya Sumathy; Shruti Kotpalliwar; George Nikolakopoulos
Pubblicato in: CoRR, 2025
Editore: IEEE
DOI: 10.48550/ARXIV.2501.18490

Tightly-Coupled Radar-Visual-Inertial Odometry

Autori: Morten Nissov, Mohit Singh, Kostas Alexis
Pubblicato in: Accepted to IEEE ECC 2026, 2026
Editore: IEEE
DOI: 10.48550/ARXIV.2603.23052

A Graph-Based Reinforcement Learning Approach with Frontier Potential Based Reward for Safe Cluttered Environment Exploration

Autori: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Pubblicato in: 24th European Control Conference, 2026
Editore: IEEE

Belief Scene Graphs: Expanding Partial Scenes with Objects through Computation of Expectation

Autori: Mario A.V. Saucedo, Akash Patel, Akshit Saradagi, Christoforos Kanellakis, George Nikolakopoulos
Pubblicato in: 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024
Editore: IEEE
DOI: 10.48550/arXiv.2402.03840

Platform-Agnostic Reinforcement Learning Framework for Safe Exploration of Cluttered Environments with Graph Attention

Autori: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Pubblicato in: The 2026 IEEE International Conference on Robotics & Automation (ICRA)
Editore: IEEE

Decentralized Multi-Agent Reinforcement Learning Exploration with Inter-Agent Communication-Based Action Space

Autori: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Pubblicato in: 2024 24th International Conference on Control, Automation and Systems (ICCAS), 2024, ISSN 2642-3901
Editore: IEEE
DOI: 10.23919/ICCAS63016.2024.10773383

D-MARL: A Dynamic Communication-Based Action Space Enhancement for Multi Agent Reinforcement Learning Exploration of Large Scale Unknown Environments

Autori: Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos
Pubblicato in: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2024

A Heuristic Approach for Performance Tuning in RL-based Quadrotor Control via Reward Design and Termination Conditions

Autori: Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy, George Nikolakopoulos
Pubblicato in: 34th Mediterranean Conference on Control and Automation (MED26), 2026
Editore: IEEE

Learning UAV Navigation with Collision-Aware Predicted-Motion Embedding

Autori: Mohammad Javad Zallaghi, Bryan Convens, Kelly Merckaert, Adrian Munteanu, Bram Vanderborght
Pubblicato in: 2026
Editore: Benelux Meeting on Systems and Control 2026

Fuzzy Logic Theory-based Adaptive Reward Shaping for Robust Reinforcement Learning (FARS)

Autori: Hürkan Şahin, Van Huyen Dang, Erdi Sayar, Alper Yegenoglu, Erdal Kayacan
Pubblicato in: IEEE WCCI 2026, 2026
Editore: IEEE
DOI: 10.48550/ARXIV.2604.15772

Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3

Autori: Hürkan Şahin, Huy Xuan Pham, Van Huyen Dang, Alper Yegenoglu, Erdal Kayacan
Pubblicato in: IEEE International Conference on Robotics & Automation, 2026
Editore: IEEE

Vine Robots that Evert through Bending

Autori: Rui Wu, Stefano Mintchev
Pubblicato in: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Editore: IEEE
DOI: 10.3929/ethz-b-000705656

UniPilot: Enabling GPS-Denied Autonomy Across Embodiments

Autori: Mihir Kulkarni, Mihir Dharmadhikari, Nikhil Khedekar, Morten Nissov, Mohit Singh, Philipp Weiss, Kostas Alexis
Pubblicato in: 2025 IEEE International Conference on Advanced Robotics (ICAR), 2026
Editore: IEEE
DOI: 10.1109/ICAR65334.2025.11338632

Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs

Autori: Mario A.V. Saucedo, Nikolaos Stathoulopoulos, Akash Patel, Christoforos Kanellakis, George Nikolakopoulos
Pubblicato in: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Editore: IEEE
DOI: 10.48550/arXiv.2409.05392

Peer reviewed articles (12)

Efficient Knowledge Transfer for Jump-Starting Control Policy Learning of Multirotors Through Physics-Aware Neural Architectures

Autori: Welf Rehberg, Mihir Kulkarni, Philipp Weiss, Kostas Alexis
Pubblicato in: IEEE Robotics and Automation Letters, Numero 11, 2026, ISSN 2377-3766
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2026.3668585

VDS-Nav: Volumetric Depth-Based Safe Navigation for Aerial Robots–Bridging the Sim-to-Real Gap

Autori: Van Huyen Dang; Adrian Redder; Huy Xuan Pham; Andriy Sarabakha; Erdal Kayacan
Pubblicato in: IEEE Robotics and Automation Letters, 2025, ISSN 2377-3766
Editore: IEEE
DOI: 10.1109/LRA.2025.3606806

Morphy: A Compliant and Morphologically Aware Flying Robot

Autori: Paolo De Petris; Morten Nissov; Kostas Alexis
Pubblicato in: Advanced Intelligent Systems, 2024, ISSN 2640-4567
Editore: Wiley
DOI: 10.1002/aisy.202400493

Aerial Gym Simulator: A Framework for Highly Parallelized Simulation of Aerial Robots

Autori: Mihir Kulkarni; Welf Rehberg; Kostas Alexis
Pubblicato in: IEEE Robotics and Automation Letters, 2025, ISSN 2377-3766
Editore: IEEE
DOI: 10.48550/ARXIV.2503.01471

MAVRL: Learn to Fly in Cluttered Environments With Varying Speed

Autori: Hang Yu, ChristopheDe Wagter, Guido C. H. E de Croon
Pubblicato in: IEEE Robotics and Automation Letters, Numero 10, 2025, ISSN 2377-3766
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2024.3522778

Collaborative Exploration With a Marsupial Ground-Aerial Robot Team Through Task-Driven Map Compression

Autori: Angelos Zacharia, Mihir Dharmadhikari, Kostas Alexis
Pubblicato in: IEEE Robotics and Automation Letters, Numero 10, 2025, ISSN 2377-3766
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2025.3609040

Neural NMPC through signed distance field encoding for collision avoidance

Autori: Martin Jacquet, Marvin Harms, Kostas Alexis
Pubblicato in: The International Journal of Robotics Research, 2026, ISSN 0278-3649
Editore: SAGE Publications
DOI: 10.1177/02783649251401223

Depth Transfer: Learning to See Like a Simulator for Real-World Drone Navigation

Autori: Hang Yu, Christophe De Wagter, Guido C. H. E de Croon
Pubblicato in: IEEE Robotics and Automation Letters, Numero 10, 2025, ISSN 2377-3766
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/LRA.2025.3617729

Encoding mechanical intelligence using ultraprogrammable joints

Autori: Rui Wu, Luca Girardi, Stefano Mintchev
Pubblicato in: Science Advances, Numero 11, 2025, ISSN 2375-2548
Editore: American Association for the Advancement of Science (AAAS)
DOI: 10.1126/SCIADV.ADV2052

Semantically-Driven Deep Reinforcement Learning for Inspection Path Planning

Autori: Grzegorz Malczyk; Mihir Kulkarni; Kostas Alexis
Pubblicato in: IEEE Robotics and Automation Letters, 2025, ISSN 2377-3766
Editore: IEEE
DOI: 10.48550/ARXIV.2505.14443

On the Characterization and Limits of 4D Radar for Aided Inertial Navigation

Autori: Morten Nissov, Kostas Alexis
Pubblicato in: IEEE Transactions on Field Robotics, 2026, ISSN 2997-1101
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TFR.2026.3690584

A Terminal State Feasibility Governor for Real-Time Nonlinear Model Predictive Control Over Arbitrary Horizons

Autori: Bryan Convens; Dominic Liao-McPherson; Kelly Merckaert; Bram Vanderborght; Marco M. Nicotra
Pubblicato in: IEEE Transactions on Control Systems Technology, 2024, ISSN 1558-0865
Editore: IEEE
DOI: 10.1109/tcst.2024.3365996

Book chapters (1)

Unconventional Hexacopters via Evolution and Learning: Performance Gains and New Insights

Autori: Jed R. Muff, Keiichi Ito, Elijah H. W. Ang, Karine Miras, A. E. Eiben
Pubblicato in: Lecture Notes in Computer Science, Applications of Evolutionary Computation, 2026
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-032-23604-3_5

Other (1)

MAC: Morphology-Aware Control Design with Deep Reinforcement Learning for Navigation of Squeezable Unmanned Aerial Vehicles

Autori: Van Huyen Dang, Adrian Redder, Erdal Kayacan
Pubblicato in: Workshop on Morphology-Aware Policy and Design Learning (MAPoDeL) at CoRL 2024., 2024
Editore: OpenReview