Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Multimodal multitAsk learninG for MultIsCale BATHYmetric mapping in shallow waters

Project description

Improving coastal mapping with deep learning

Much of the ocean floor is unmapped, and many shallow coastal areas that are most impacted by climatic and anthropogenic pressures are poorly updated. The EU-funded MagicBathy project hopes to fix this through a new deep learning algorithm that can make better use of satellite and unmanned aerial vehicles (UAV) imagery. Currently, the optics of water can affect UAV image quality, and correction is expensive. Satellite images can suffer from low resolution. The MagicBathy project will use machine learning to correct the spatial resolution of satellite images and the bathymetric maps that result from them. Researchers will also develop a special resolution improvement algorithm for shallow water imagery.

Objective

Accurate, detailed and high-frequent bathymetry, coupled with the important visual and semantic information, is crucial for the undermapped shallow coastal areas being affected by intense climatological and anthropogenic pressures. Regular UAV and satellite imagery have the potential to frequently and consistently map those areas to different extents and detail, providing ground breaking key information. However, optical properties of water severely affect images and refraction is the main factor affecting their geometry. Current Structure from Motion (SfM) based solutions for refraction correction are slow and costly. Satellite Derived Bathymetry (SDB) methods deliver faster results over huge shallow areas albeit in lower spatial resolution, failing to handle non-homogeneous seabeds. Recent methods based on Convolutional Neural Networks (CNNs) deliver either only the bathymetry or the semantics of the scene, tackling those problems separately and in one scale/modality at a time. They are mostly dedicated to satellite images, failing to address the challenges of shallow waters, being also inefficient for UAV images, preventing higher resolution results. MagicBathy will establish an advanced deep learning framework for low-cost shallow water mapping by developing a novel boundary-aware multitask, multiscale and multimodal learning approach for bathymetry and semantics together, exploiting single either UAV or satellite imagery. To overcome the domain gap, generalize and improve performance, self-supervised in-domain representation learning will be performed. To enhance the spatial resolution of low resolution satellite images and hence of the resulting bathymetric/semantic maps, a conditional generative adversarial network (cGAN)-based Super Resolution framework will be developed, dealing with the special challenges of shallow water imagery. Frameworks, models and results will be published in open access, enabling the rapid progress in shallow water mapping worldwide

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) HORIZON-MSCA-2021-PF-01

See all projects funded under this call

Coordinator

TECHNISCHE UNIVERSITAT BERLIN
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 189 687,36
Address
STRASSE DES 17 JUNI 135
10623 Berlin
Germany

See on map

Region
Berlin Berlin Berlin
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Partners (1)

My booklet 0 0