Neural Spectral Image Decoding

Informazioni relative al progetto

NEURAL SPICING

ID dell’accordo di sovvenzione: 101002198

DOI

10.3030/101002198

Data della firma CE 22 Aprile 2021

Data di avvio 1 Maggio 2021

Data di completamento 31 Dicembre 2026

Finanziato da

• EXCELLENT SCIENCE - European Research Council (ERC)

Costo totale

€ 1 999 975,00

Contributo UE

€ 1 999 975,00

Coordinato da

DEUTSCHES KREBSFORSCHUNGSZENTRUM HEIDELBERG
Germany

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Open Research Data Pilot (1)

Data management plan

Pubblicazioni

Peer reviewed articles (14)

Efficient Photoacoustic Image Synthesis with Deep Learning

Autori: Tom Rix; Kris K. Dreher; Jan-Hinrich Nölke; Melanie Schellenberg; Minu D. Tizabi; Alexander Seitel; Lena Maier-Hein
Pubblicato in: Sensors, Numero 23 (16), 2023, Pagina/e 7085 ff, ISSN 1424-8220
Editore: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s23167085

Photoacoustic Quantification of Tissue Oxygenation Using Conditional Invertible Neural Networks

Autori: Jan-Hinrich Nölke, Tim J. Adler, Melanie Schellenberg, Kris K. Dreher, Niklas Holzwarth, Christoph J. Bender, Minu D. Tizabi, Alexander Seitel, Lena Maier-Hein
Pubblicato in: IEEE Transactions on Medical Imaging, Numero 43, 2024, Pagina/e 3366-3376, ISSN 0278-0062
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmi.2024.3403417

Semantic segmentation of multispectral photoacoustic images using deep learning

Autori: Melanie Schellenberg, Kris K. Dreher, Niklas Holzwarth, Fabian Isensee, Annika Reinke, Nicholas Schreck, Alexander Seitel, Minu D. Tizabi, Lena Maier-Hein, and Janek Gröhl
Pubblicato in: Photoacoustics, Numero 26, 2022, ISSN 2213-5979
Editore: Elsevier GmbH
DOI: 10.1016/j.pacs.2022.100341

Photoacoustic image synthesis with generative adversarial networks

Autori: Melanie Schellenberg, Janek Gröhl, Kris K. Dreher, Jan-Hinrich Nölke, Niklas Holzwarth, Minu D. Tizabi, Alexander Seitel, Lena Maier-Hein,
Pubblicato in: Photoacoustics, Numero 28, 2022, ISSN 2213-5979
Editore: Elsevier GmbH
DOI: 10.1016/j.pacs.2022.100402

Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery

Autori: Leonardo Ayala; Tim J. Adler; Silvia Seidlitz; Sebastian Wirkert; Christina Engels; Alexander Seitel; Jan Sellner; Alexey Aksenov; Matthias Bodenbach; Pia Bader; Sebastian Baron; Anant Vemuri; Manuel Wiesenfarth; Nicholas Schreck; Diana Mindroc; Minu Tizabi; Sebastian Pirmann; Brittaney Everitt; Annette Kopp-Schneider; Dogu Teber; Lena Maier-Hein
Pubblicato in: Science Advances, Numero 10(9), 2023, ISSN 2375-2548
Editore: American Association for the Advancement of Science (AAAS)
DOI: 10.1101/2022.03.08.22271465

AI-powered skin spectral imaging enables instant sepsis diagnosis and outcome prediction in critically ill patients

Autori: Silvia Seidlitz, Katharina Hölzl, Ayca von Garrel, Jan Sellner, Stephan Katzenschlager, Tobias Hölle, Dania Fischer, Maik von der Forst, Felix C. F. Schmitt, Alexander Studier-Fischer, Markus A. Weigand, Lena Maier-Hein, Maximilian Dietrich
Pubblicato in: Science Advances, Numero 11, 2025, ISSN 2375-2548
Editore: American Association for the Advancement of Science (AAAS)
DOI: 10.1126/sciadv.adw1968

SIMPA: an open-source toolkit for simulation and image processing for photonics and acoustics

Autori: Janek Gröhl; Kris K. Dreher; Melanie Schellenberg; Tom Rix; Niklas Holzwarth; Patricia Vieten; Leonardo Ayala; Sarah E. Bohndiek; Alexander Seitel; Lena Maier-Hein
Pubblicato in: Journal of Biomedical Optics, Numero 8, 2022, ISSN 1083-3668
Editore: S P I E - International Society for Optical Engineering
DOI: 10.1117/1.jbo.27.8.083010

Semantic hyperspectral image synthesis for cross-modality knowledge transfer in surgical data science

Autori: Viet Tran Ba, Marco Hübner, Ahmad Bin Qasim, Maike Rees, Jan Sellner, Silvia Seidlitz, Evangelia Christodoulou, Berkin Özdemir, Alexander Studier-Fischer, Felix Nickel, Leonardo Ayala, Lena Maier-Hein
Pubblicato in: International Journal of Computer Assisted Radiology and Surgery, Numero 20, 2025, Pagina/e 1205-1213, ISSN 1861-6429
Editore: Springer Science and Business Media LLC
DOI: 10.1007/s11548-025-03364-7

Neural illumination calibration for surgical workflow-optimized spectral imaging

Autori: Alexander Baumann, Leonardo Ayala, Alexander Studier-Fischer, Jan Sellner, Berkin Özdemir, Karl-Friedrich Kowalewski, Slobodan Ilic, Silvia Seidlitz, Lena Maier-Hein
Pubblicato in: International Journal of Computer Assisted Radiology and Surgery, 2025, ISSN 1861-6429
Editore: Springer Science and Business Media LLC
DOI: 10.1007/s11548-025-03525-8

ICG-augmented hyperspectral imaging for visualization of intestinal perfusion compared to conventional ICG fluorescence imaging: An experimental study.

Autori: Studier-Fischer, A., Schwab, F. M., Rees, M., Seidlitz, S., Sellner, J., Özdemir, B., Ayala, L., Odenthal, J., Knoedler, S., Kowalewski, K.-F., Haney, C. M., Dietrich, M., Salg, G. A., Kenngott, H. G., Müller-Stich, B. P., Maier-Hein, L., & Nickel, F.
Pubblicato in: International Journal of Surgery, Numero 109(12), 2023, ISSN 1743-9191
Editore: Surgical Association
DOI: 10.1097/js9.0000000000000706

Anthropomorphic tissue-mimicking phantoms for oximetry validation in multispectral optical imaging

Autori: Kris K. Dreher, Janek Gröhl, Friso Grace, Leonardo Ayala, Jan-Hinrich Nölke, Christoph J. Bender, Melissa J. Watt, Katie-Lou White, Ran Tao, Wibke Johnen, Minu D. Tizabi, Alexander Seitel, Lena Maier-Hein, Sarah E. Bohndiek
Pubblicato in: Journal of Biomedical Optics, Numero 30, 2025, ISSN 1083-3668
Editore: S P I E - International Society for Optical Engineering
DOI: 10.1117/1.jbo.30.7.076006

Shortcut learning leads to sex bias in deep learning models for photoacoustic tomography

Autori: Marcel Knopp, Christoph J. Bender, Niklas Holzwarth, Yi Li, Julius Kempf, Milenko Caranovic, Ferdinand Knieling, Werner Lang, Ulrich Rother, Alexander Seitel, Lena Maier-Hein, Kris K. Dreher
Pubblicato in: International Journal of Computer Assisted Radiology and Surgery, Numero 20, 2025, Pagina/e 1325-1333, ISSN 1861-6429
Editore: Springer Science and Business Media LLC
DOI: 10.1007/s11548-025-03370-9

The SPECTRAL Perfusion Arm Clamping dAtaset (SPECTRALPACA) for video-rate functional imaging of the skin

Autori: Leonardo Ayala, Diana Mindroc-Filimon, Maike Rees, Marco Hübner, Jan Sellner, Silvia Seidlitz, Minu Tizabi, Sebastian Wirkert, Alexander Seitel, Lena Maier-Hein
Pubblicato in: Scientific Data, Numero 11, 2024, ISSN 2052-4463
Editore: Springer Science and Business Media LLC
DOI: 10.1038/s41597-024-03307-y

HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs

Autori: Alexander Studier-Fischer, Silvia Seidlitz, Jan Sellner, Marc Bressan, Berkin Özdemir, Leonardo Ayala, Jan Odenthal, Samuel Knoedler, Karl-Friedrich Kowalewski, Caelan Max Haney, Gabriel Salg, Maximilian Dietrich, Hannes Kenngott, Ines Gockel, Thilo Hackert, Beat Peter Müller-Stich, Lena Maier-Hein & Felix Nickel
Pubblicato in: Scientific Data, Numero 10(414), 2023, ISSN 2052-4463
Editore: Springer Nature
DOI: 10.1038/s41597-023-02315-8

Other (4)

Application-driven Validation of Posteriors in Inverse Problems

Autori: Tim J. Adler, Jan-Hinrich Nölke, Annika Reinke, Minu Dietlinde Tizabi, Sebastian Gruber, Dasha Trofimova, Lynton Ardizzone, Paul F. Jaeger, Florian Buettner, Ullrich Köthe, Lena Maier-Hein
Pubblicato in: 2023
Editore: arXiv
DOI: 10.48550/arxiv.2309.09764

Understanding metric-related pitfalls in image analysis validation

Autori: Annika Reinke, Minu D. Tizabi, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Emre Kavur, Tim Rädsch, Carole H. Sudre, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Matthew Blaschko, Florian Buettner, M. Jorge Cardoso, Veronika Cheplygina, Jianxu Chen, Evangelia Christodoulou, Beth A. Cimini, Gary S. Collins, Keyvan Farahani, Luciana Ferrer, Adrian
Pubblicato in: 2023
Editore: arXiv
DOI: 10.48550/arxiv.2302.01790

Metrics reloaded: Recommendation for image analysis validation

Autori: Lena Maier-Hein, Annika Reinke, Patrick Godau, Minu D. Tizabi, Florian Buettner, Evangelia Christodoulou, Ben Glocker, Fabian Isensee, Jens Kleesiek, Michal Kozubek, Mauricio Reyes, Michael A. Riegler, Manuel Wiesenfarth, A. Emre Kavur, Carole H. Sudre, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Tim Rädsch, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arrie
Pubblicato in: 2023
Editore: arXiv
DOI: 10.48550/arxiv.2206.01653

Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis

Autori: Dietrich, Maximilian; Seidlitz, Silvia; Schreck, Nicholas; Wiesenfarth, Manuel; Godau, Patrick; Tizabi, Minu; Sellner, Jan; Marx, Sebastian; Kn��dler, Samuel; Allers, Michael M.; Ayala, Leonardo; Schmidt, Karsten; Brenner, Thorsten; Studier-Fischer, Alexander; Nickel, Felix; M��ller-Stich, Beat P.; Kopp-Schneider, Annette; Weigand, Markus A.; Maier-Hein, Lena
Pubblicato in: arXiv, 2021
Editore: arXiv
DOI: 10.48550/arxiv.2106.08445

Conference proceedings (2)

Unsupervised Domain Transfer with Conditional Invertible Neural Networks

Autori: Kris K. Dreher, Leonardo Ayala, Melanie Schellenberg, Marco Hübner, Jan-Hinrich Nölke, Tim J. Adler, Silvia Seidlitz, Jan Sellner, Alexander Studier-Fischer, Janek Gröhl, Felix Nickel, Ullrich Köthe, Alexander Seitel, Lena Maier-Hein
Pubblicato in: Lecture Notes in Computer Science, Numero 14220, 2023, ISBN 978-3-031-43907-0
Editore: Springer Nature
DOI: 10.1007/978-3-031-43907-0_73

Semantic segmentation of surgical hyperspectral images under geometric domain shifts

Autori: Sellner, Jan; Seidlitz, Silvia; Studier-Fischer, Alexander; Motta, Alessandro; Özdemir, Berkin; Müller-Stich, Beat Peter; Nickel, Felix; Maier-Hein, Lena
Pubblicato in: Lecture Notes in Computer Science, Numero 14228, 2023, ISBN 978-3-031-43996-4
Editore: Springer Nature
DOI: 10.1007/978-3-031-43996-4_59

Book chapters (1)

Deep Intra-operative Illumination Calibration of Hyperspectral Cameras

Autori: Alexander Baumann, Leonardo Ayala, Alexander Studier-Fischer, Jan Sellner, Berkin Özdemir, Karl-Friedrich Kowalewski, Slobodan Ilic, Silvia Seidlitz, Lena Maier-Hein
Pubblicato in: Lecture Notes in Computer Science, Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, 2024, Pagina/e 120-131
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-72089-5_12

Non-peer reviewed articles (2)

Spectral Organ Fingerprints For Machine Learning-Based Intraoperative Tissue Classification With Hyperspectral Imaging

Autori: Alexander Studier-Fischer, Silvia Seidlitz, Jan Sellner, Berkin Özdemir, Manuel Wiesenfarth, Leonardo Ayala, Jan Odenthal, Samuel Knödler, Karl-Friedrich Kowalewski, Caelan Max Haney, Isabella Camplisson, Maximilian Dietrich, Karsten Schmidt, Gabriel Alexander Salg, Hannes Götz Kenngott, Tim Julian Adler, Nicholas Schreck, Annette Kopp-Schneider, Klaus Maier-Hein, Lena Maier-Hein, Beat Peter M
Pubblicato in: Scientific Reports, Numero 12, 2022, ISSN 2045-2322
Editore: Nature Publishing Group
DOI: 10.1038/s41598-022-15040-w

Robust deep learning-based semantic organ segmentation in hyperspectral images

Autori: Silvia Seidlitz, Jan Sellner, Jan Odenthal, Berkin Özdemir, Alexander Studier-Fischer, Samuel Knödler, Leonardo Ayala, Tim Adler, Hannes G Kenngott, Minu Tizabi, Martin Wagner, Felix Nickel, Beat P Müller-Stich, Lena Maier-Hein
Pubblicato in: Medical Image Analysis, Numero 80, 2022, ISSN 1361-8415
Editore: Elsevier BV
DOI: 10.1016/j.media.2022.102488