Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Reinventing Multiterminal Coding for Intelligent Machines

Project description

Intelligent information sharing for cooperative autonomous machines

The rise of advanced sensors and deep learning has improved machine perception. However, the massive flow of high-dimensional data, such as video and dynamic point clouds, pushes current storage and communication technologies to their limits. This overload hinders machines from collaborating effectively, an essential step towards safe, high-level autonomy. Current cooperative perception methods rely solely on data-driven models, requiring vast training datasets and computational resources, while lacking interpretability and theoretical grounding. The ERC-funded IONIAN project unites traditional multiterminal source coding and signal processing with modern interpretable and explainable artificial intelligence. Its goal is to enhance data compression and communication for intelligent machines. This will enable autonomous systems, from vehicles and drones to robots, to safely perceive their environment.

Objective

Advancements in sensors and deep learning have elevated the perception capacity of machines, bringing mid-level autonomy within reach. However, the abundance of high-dimensional data, including video and dynamic point cloud streams, strains current storage and communication technologies to their limits and curtails the ability of machines to collaboratively perceive the environment, a critical factor for achieving safety and the ambitious goal of high-level autonomy. State-of-the-art cooperative perception methods are based purely on a data-driven approach, requiring massive training data and computational resources, and lacking interpretability, explainability, and a solid theoretical foundation.
This proposal puts forth a groundbreaking multiterminal coding paradigm for intelligent machines enabling data compression and communication systems that break the current limits of the predictive coding archetype. It builds a unique concept that unifies traditional distributed source coding and signal processing domain knowledge with modern deep learning. First, it leverages machine learning to solve long-standing problems in multiterminal coding theory and devise code constructions achieving the fundamental limits, thereby establishing a theoretical framework that defines the amount of information required to be sent per agent to solve the cooperative perception task. Second, it leverages domain knowledge to drive the design of interpretable and data- and parameter-efficient machine learning models for cooperative perception. Third, it reinforces this interplay by pioneering explanations that enforce and assess the interpretability of the designed models. IONIAN will have a profound impact on the way intelligent machines, including ground and aerial vehicles, and mobile robots, compress and communicate multi-sensory data to collaboratively perceive the environment for autonomous safe navigation, ultimately leading to trustworthy operation and acceptance of such systems.

Fields of science (EuroSciVoc)

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2024-COG

See all projects funded under this call

Host institution

VRIJE UNIVERSITEIT BRUSSEL
Net EU contribution
€ 1 999 403,75
Address
PLEINLAAN 2
1050 Bruxelles / Brussel
Belgium
Region
Région de Bruxelles-Capitale/Brussels Hoofdstedelijk Gewest Région de Bruxelles-Capitale/ Brussels Hoofdstedelijk Gewest Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 999 403,75

Beneficiaries (1)