Intelligent Scene Sensing and Analysis in Underwater Environments

Projektbeschreibung

Wegweisende Erfassung und Analyse von Unterwasserszenen

Verschiedene Unterwasseraktivitäten sind auf eine zuverlässige und detaillierte Erfassung und Analyse von Unterwasserszenen angewiesen. Folglich steigt das Interesse an optischer Unterwasser-Sensorik. Die Erforschung von Deep-Learning-Methoden in diesem Bereich ist jedoch begrenzt. Nichtsdestotrotz werden die sensorischen Modalitäten auf der Grundlage von Einzelphotonenkameras und transienter Bildgebung stetig weiterentwickelt und ermöglichen die Erfassung auch unter schwierigen Sichtbedingungen. Das EU-finanzierte Projekt iSEAu wird sich um weitere Fortschritte bei den Erfassungsmöglichkeiten von Unterwasserszenen bemühen. Dazu wird es die jeweiligen Vorteile von Einzelphotonenkameras, Multispektralkameras und konventionellen Kameras kombinieren und in einen intensiven Wissenstransfer investieren, um maschinelles Sehen, maschinelles Lernen und Fernerkundung miteinander zu verbinden und dadurch die Herausforderungen der visuellen Unterwassererfassung bestmöglich zu bewältigen.

Ziel

Reliable and detailed underwater scene sensing, and analysis has a fundamental role in numerous underwater activities drawing both scientific and economic interest. Computer vision and remote sensing have evolved impressively in the last decade, propelled also by advancements in deep learning, enabling unprecedented levels of robust and automatic information extraction from visual data. At the same time, there is increasing interest in visual based underwater sensing, however, deep learning methods are less explored in this domain. On the other hand, sensing modalities based on Single Photon Cameras (SPCs) and transient imaging are gradually maturing, having certain characteristics that allow sensing in challenging visibility conditions, as the ones of underwater environments.

iSEAu aims to significantly advance the state-of-the-art of underwater scene sensing by bridging the gap in the use of data-driven methods in underwater perception, and by combining the respective advantages of SPCs, multispectral and conventional cameras. Investing on intensive knowledge transfer, the goal is to bring together the fields of computer vision, machine learning and remote sensing for optimally addressing the underwater visual sensing challenges. The project objectives address these challenges in two levels. The first concerns the development of methods for “removing the water” from underwater images by harnessing the power of learning-based methods, and the development of methods based on SPC transient imaging for perception in challenging visibility conditions. The second level concerns the adaptation and enhancement to the underwater domain of state-of-the-art methods for image-based extraction of structural and semantic information, and their field-testing considering representative application scenarios. In summary, iSEAu will provide novel data-driven methodologies and technological solutions to researchers, scientists and users for underwater sensing of unmatched fidelity.