Project description
AI compressing for Earth observation and weather data exchange
The Copernicus programme, weather models, and Global Navigation Satellite Systems (GNSS) provide extensive geospatial data applicable to various scientific sectors. However, the volume of this data makes it impractical for a single platform to host. As a result, service providers face challenges in accessing data from different archives due to cost constraints. The EU-funded Embed2Scale project will address this issue by leveraging AI-based data compression techniques to facilitate efficient data exchange. The project will investigate deep neural network training methods and introduce innovations in data management and portability. The outcome will be groundbreaking research in AI-driven data compression, leading to more accessible and efficient access to earth observation and weather data.
Objective
The full potential of the Copernicus Programme unfolds when fused with additional geo-information such as weather models or GNSS measurements. However, no single platform can host all the hundreds of petabytes of geospatial data. Currently, service suppliers download data from different archives, and the sheer volume to be transferred render many applications economically not viable.
With Embed2Scale we strive to overcome these limitations enabling efficient exchange of data through AI-based data compression. We will explore the training of deep neural networks on HPC systems with self-supervised learning to transform raw geo-information into embeddings with up to 1000-fold compression. The main innovations will enable i) decentralized applications through substantial reduction of “data gravity”, ii) the portability of geospatial analytics by significantly lowering computational demand, iii) minimizing data labeling by few-shot learning, and iv) the near-real-time similarity search at petabyte scale of Earth observation and weather/climate data archives.
The objectives of Embed2Scale target i) the exploration of ground-breaking AI-compressors enabling data federation to proliferate a MLOps reference implementation for embeddings in data centers, ii) to demonstrate data federation on real-world use-cases for the Copernicus Programme, and iii) to enable the Earth observation community by open-sourcing and standardization. Within Embed2Scale, we will benchmark the use of embeddings in four applications: i) maritime awareness, ii) aboveground biomass estimation, iii) climate and air pollution prediction, and iv) crop stress & early yield detection. Overall, Embed2Scale will enable near-real time quantitative assessments of geo-information at continental scale - we respond to challenge 2 of the call: “new, enabling, scalable, operational solutions and technologies to improve capabilities of the Copernicus value chain and supporting infrastructure”.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
- social sciences social geography transport navigation systems satellite navigation system global navigation satellite system
- engineering and technology electrical engineering, electronic engineering, information engineering information engineering telecommunications telecommunications networks data networks
- natural sciences earth and related environmental sciences environmental sciences pollution
- agricultural sciences agriculture, forestry, and fisheries agriculture
- agricultural sciences agricultural biotechnology biomass
You need to log in or register to use this function
We are sorry... an unexpected error occurred during execution.
You need to be authenticated. Your session might have expired.
Thank you for your feedback. You will soon receive an email to confirm the submission. If you have selected to be notified about the reporting status, you will also be contacted when the reporting status will change.
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.2.4 - Digital, Industry and Space
MAIN PROGRAMME
See all projects funded under this programme -
HORIZON.2.4.10 - Space, including Earth Observation
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-RIA - HORIZON Research and Innovation Actions
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-EUSPA-2022-SPACE
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
1017 EG Amsterdam
Netherlands
The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.