Earth Observation & Weather Data Federation with AI Embeddings

Informacje na temat projektu

Embed2Scale

Identyfikator umowy o grant: 101131841

DOI

10.3030/101131841

Data podpisania przez KE 11 Grudnia 2023

Data rozpoczęcia 1 Stycznia 2024

Data zakończenia 31 Grudnia 2026

Finansowanie w ramach

• Digital, Industry and Space

Koszt całkowity

€ 2 618 047,50

Wkład UE

€ 2 618 047,50

Koordynowany przez

MARTEL INNOVATE BV
Netherlands

Periodic Reporting for period 1 - Embed2Scale (Earth Observation & Weather Data Federation with AI Embeddings)

Okres sprawozdawczy: 2024-01-01 do 2025-06-30

Podsumowanie kontekstu i ogólnych celów projektu

Embed2Scale (E2S) successfully delved into the world of neural compression (NC) for Earth observation (EO) and weather data (WD). The petabyte-scale of spatio-temporal data generated by EO&WD from multiple sensors and hydrodynamic simulation requires a tool to comprehend the information contents impossible to digest by human inspection. With the aid of self-supervised artificial neural networks (Foundation Models) that generate embeddings, we opened the door to efficiently access geo-information.

Prace wykonane od początku projektu do końca okresu sprawozdawczego oraz najważniejsze dotychczasowe rezultaty

* WP 1:
- Draft extension of openEO API to support neural compression endpoints.
- Analysing possible impact of transforming PAZ SAR data into ARD format.

* WP 2:
- Published an IEEE GRSM review on neural compression for Earth observation, catalyzing new use‐case development.
- Launched NeuCo-Bench at CVPR 2025 as an open-source benchmarking framework, engaging 50+ international teams.
- Open-sourced up to 7000× lossy compression methods on multi-sensor imagery.

* WP 3:
- Designed an end-to-end workflow and federated deployment pipeline for model training, compression, and inference.

* WP 4:
- Co-developed four prototypes in biodiversity, cloud characterization, precision agriculture, and maritime awareness.
- Released SSL4EO-S12-downstream datasets on HuggingFace
- Provided some PAZ SAR and AIS sample data to train vessel detection.

Innowacyjność oraz oczekiwany potencjalny wpływ (w tym dotychczasowe znaczenie społeczno-gospodarcze i szersze implikacje społeczne projektu)

- First dedicated comprehensive review linking lossy neural compression to advance real-world Earth-observation tasks.
- NeuCo-Bench: the inaugural, task-centric EO compression benchmark standardizing metrics and datasets including setup of the community "Earth2Vec" with 32 members (and counting) to define embedding interoperability and best practices.
- SSL4EO-S12-downstream: the first public suite coupling compression evaluation with 12 diverse EO tasks on which the "Earth2Vec" community will build on.
- Pioneered an openEO API extension for on-demand neural compression, enabling seamless integration in EO workflows across data centers.