Neural Spectral Image Decoding

Información del proyecto

NEURAL SPICING

Identificador del acuerdo de subvención: 101002198

DOI

10.3030/101002198

Fecha de la firma de la CE 22 Abril 2021

Fecha de inicio 1 Mayo 2021

Fecha de finalización 31 Diciembre 2026

Financiado con arreglo a

• EXCELLENT SCIENCE - European Research Council (ERC)

Coste total

€ 1 999 975,00

Aportación de la UE

€ 1 999 975,00

Coordinado por

DEUTSCHES KREBSFORSCHUNGSZENTRUM HEIDELBERG
Germany

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Open Research Data Pilot (1)

Data management plan

Publicaciones

Peer reviewed articles (14)

Efficient Photoacoustic Image Synthesis with Deep Learning

Autores: Tom Rix; Kris K. Dreher; Jan-Hinrich Nölke; Melanie Schellenberg; Minu D. Tizabi; Alexander Seitel; Lena Maier-Hein
Publicado en: Sensors, Edición 23 (16), 2023, Página(s) 7085 ff, ISSN 1424-8220
Editor: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s23167085

Photoacoustic Quantification of Tissue Oxygenation Using Conditional Invertible Neural Networks

Autores: Jan-Hinrich Nölke, Tim J. Adler, Melanie Schellenberg, Kris K. Dreher, Niklas Holzwarth, Christoph J. Bender, Minu D. Tizabi, Alexander Seitel, Lena Maier-Hein
Publicado en: IEEE Transactions on Medical Imaging, Edición 43, 2024, Página(s) 3366-3376, ISSN 0278-0062
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmi.2024.3403417

Semantic segmentation of multispectral photoacoustic images using deep learning

Autores: Melanie Schellenberg, Kris K. Dreher, Niklas Holzwarth, Fabian Isensee, Annika Reinke, Nicholas Schreck, Alexander Seitel, Minu D. Tizabi, Lena Maier-Hein, and Janek Gröhl
Publicado en: Photoacoustics, Edición 26, 2022, ISSN 2213-5979
Editor: Elsevier GmbH
DOI: 10.1016/j.pacs.2022.100341

Photoacoustic image synthesis with generative adversarial networks

Autores: Melanie Schellenberg, Janek Gröhl, Kris K. Dreher, Jan-Hinrich Nölke, Niklas Holzwarth, Minu D. Tizabi, Alexander Seitel, Lena Maier-Hein,
Publicado en: Photoacoustics, Edición 28, 2022, ISSN 2213-5979
Editor: Elsevier GmbH
DOI: 10.1016/j.pacs.2022.100402

Spectral imaging enables contrast agent-free real-time ischemia monitoring in laparoscopic surgery

Autores: Leonardo Ayala; Tim J. Adler; Silvia Seidlitz; Sebastian Wirkert; Christina Engels; Alexander Seitel; Jan Sellner; Alexey Aksenov; Matthias Bodenbach; Pia Bader; Sebastian Baron; Anant Vemuri; Manuel Wiesenfarth; Nicholas Schreck; Diana Mindroc; Minu Tizabi; Sebastian Pirmann; Brittaney Everitt; Annette Kopp-Schneider; Dogu Teber; Lena Maier-Hein
Publicado en: Science Advances, Edición 10(9), 2023, ISSN 2375-2548
Editor: American Association for the Advancement of Science (AAAS)
DOI: 10.1101/2022.03.08.22271465

AI-powered skin spectral imaging enables instant sepsis diagnosis and outcome prediction in critically ill patients

Autores: Silvia Seidlitz, Katharina Hölzl, Ayca von Garrel, Jan Sellner, Stephan Katzenschlager, Tobias Hölle, Dania Fischer, Maik von der Forst, Felix C. F. Schmitt, Alexander Studier-Fischer, Markus A. Weigand, Lena Maier-Hein, Maximilian Dietrich
Publicado en: Science Advances, Edición 11, 2025, ISSN 2375-2548
Editor: American Association for the Advancement of Science (AAAS)
DOI: 10.1126/sciadv.adw1968

SIMPA: an open-source toolkit for simulation and image processing for photonics and acoustics

Autores: Janek Gröhl; Kris K. Dreher; Melanie Schellenberg; Tom Rix; Niklas Holzwarth; Patricia Vieten; Leonardo Ayala; Sarah E. Bohndiek; Alexander Seitel; Lena Maier-Hein
Publicado en: Journal of Biomedical Optics, Edición 8, 2022, ISSN 1083-3668
Editor: S P I E - International Society for Optical Engineering
DOI: 10.1117/1.jbo.27.8.083010

Semantic hyperspectral image synthesis for cross-modality knowledge transfer in surgical data science

Autores: Viet Tran Ba, Marco Hübner, Ahmad Bin Qasim, Maike Rees, Jan Sellner, Silvia Seidlitz, Evangelia Christodoulou, Berkin Özdemir, Alexander Studier-Fischer, Felix Nickel, Leonardo Ayala, Lena Maier-Hein
Publicado en: International Journal of Computer Assisted Radiology and Surgery, Edición 20, 2025, Página(s) 1205-1213, ISSN 1861-6429
Editor: Springer Science and Business Media LLC
DOI: 10.1007/s11548-025-03364-7

Neural illumination calibration for surgical workflow-optimized spectral imaging

Autores: Alexander Baumann, Leonardo Ayala, Alexander Studier-Fischer, Jan Sellner, Berkin Özdemir, Karl-Friedrich Kowalewski, Slobodan Ilic, Silvia Seidlitz, Lena Maier-Hein
Publicado en: International Journal of Computer Assisted Radiology and Surgery, 2025, ISSN 1861-6429
Editor: Springer Science and Business Media LLC
DOI: 10.1007/s11548-025-03525-8

ICG-augmented hyperspectral imaging for visualization of intestinal perfusion compared to conventional ICG fluorescence imaging: An experimental study.

Autores: Studier-Fischer, A., Schwab, F. M., Rees, M., Seidlitz, S., Sellner, J., Özdemir, B., Ayala, L., Odenthal, J., Knoedler, S., Kowalewski, K.-F., Haney, C. M., Dietrich, M., Salg, G. A., Kenngott, H. G., Müller-Stich, B. P., Maier-Hein, L., & Nickel, F.
Publicado en: International Journal of Surgery, Edición 109(12), 2023, ISSN 1743-9191
Editor: Surgical Association
DOI: 10.1097/js9.0000000000000706

Anthropomorphic tissue-mimicking phantoms for oximetry validation in multispectral optical imaging

Autores: Kris K. Dreher, Janek Gröhl, Friso Grace, Leonardo Ayala, Jan-Hinrich Nölke, Christoph J. Bender, Melissa J. Watt, Katie-Lou White, Ran Tao, Wibke Johnen, Minu D. Tizabi, Alexander Seitel, Lena Maier-Hein, Sarah E. Bohndiek
Publicado en: Journal of Biomedical Optics, Edición 30, 2025, ISSN 1083-3668
Editor: S P I E - International Society for Optical Engineering
DOI: 10.1117/1.jbo.30.7.076006

Shortcut learning leads to sex bias in deep learning models for photoacoustic tomography

Autores: Marcel Knopp, Christoph J. Bender, Niklas Holzwarth, Yi Li, Julius Kempf, Milenko Caranovic, Ferdinand Knieling, Werner Lang, Ulrich Rother, Alexander Seitel, Lena Maier-Hein, Kris K. Dreher
Publicado en: International Journal of Computer Assisted Radiology and Surgery, Edición 20, 2025, Página(s) 1325-1333, ISSN 1861-6429
Editor: Springer Science and Business Media LLC
DOI: 10.1007/s11548-025-03370-9

The SPECTRAL Perfusion Arm Clamping dAtaset (SPECTRALPACA) for video-rate functional imaging of the skin

Autores: Leonardo Ayala, Diana Mindroc-Filimon, Maike Rees, Marco Hübner, Jan Sellner, Silvia Seidlitz, Minu Tizabi, Sebastian Wirkert, Alexander Seitel, Lena Maier-Hein
Publicado en: Scientific Data, Edición 11, 2024, ISSN 2052-4463
Editor: Springer Science and Business Media LLC
DOI: 10.1038/s41597-024-03307-y

HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs

Autores: Alexander Studier-Fischer, Silvia Seidlitz, Jan Sellner, Marc Bressan, Berkin Özdemir, Leonardo Ayala, Jan Odenthal, Samuel Knoedler, Karl-Friedrich Kowalewski, Caelan Max Haney, Gabriel Salg, Maximilian Dietrich, Hannes Kenngott, Ines Gockel, Thilo Hackert, Beat Peter Müller-Stich, Lena Maier-Hein & Felix Nickel
Publicado en: Scientific Data, Edición 10(414), 2023, ISSN 2052-4463
Editor: Springer Nature
DOI: 10.1038/s41597-023-02315-8

Other (4)

Application-driven Validation of Posteriors in Inverse Problems

Autores: Tim J. Adler, Jan-Hinrich Nölke, Annika Reinke, Minu Dietlinde Tizabi, Sebastian Gruber, Dasha Trofimova, Lynton Ardizzone, Paul F. Jaeger, Florian Buettner, Ullrich Köthe, Lena Maier-Hein
Publicado en: 2023
Editor: arXiv
DOI: 10.48550/arxiv.2309.09764

Understanding metric-related pitfalls in image analysis validation

Autores: Annika Reinke, Minu D. Tizabi, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Emre Kavur, Tim Rädsch, Carole H. Sudre, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Matthew Blaschko, Florian Buettner, M. Jorge Cardoso, Veronika Cheplygina, Jianxu Chen, Evangelia Christodoulou, Beth A. Cimini, Gary S. Collins, Keyvan Farahani, Luciana Ferrer, Adrian
Publicado en: 2023
Editor: arXiv
DOI: 10.48550/arxiv.2302.01790

Metrics reloaded: Recommendation for image analysis validation

Autores: Lena Maier-Hein, Annika Reinke, Patrick Godau, Minu D. Tizabi, Florian Buettner, Evangelia Christodoulou, Ben Glocker, Fabian Isensee, Jens Kleesiek, Michal Kozubek, Mauricio Reyes, Michael A. Riegler, Manuel Wiesenfarth, A. Emre Kavur, Carole H. Sudre, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Tim Rädsch, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arrie
Publicado en: 2023
Editor: arXiv
DOI: 10.48550/arxiv.2206.01653

Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis

Autores: Dietrich, Maximilian; Seidlitz, Silvia; Schreck, Nicholas; Wiesenfarth, Manuel; Godau, Patrick; Tizabi, Minu; Sellner, Jan; Marx, Sebastian; Kn��dler, Samuel; Allers, Michael M.; Ayala, Leonardo; Schmidt, Karsten; Brenner, Thorsten; Studier-Fischer, Alexander; Nickel, Felix; M��ller-Stich, Beat P.; Kopp-Schneider, Annette; Weigand, Markus A.; Maier-Hein, Lena
Publicado en: arXiv, 2021
Editor: arXiv
DOI: 10.48550/arxiv.2106.08445

Conference proceedings (2)

Unsupervised Domain Transfer with Conditional Invertible Neural Networks

Autores: Kris K. Dreher, Leonardo Ayala, Melanie Schellenberg, Marco Hübner, Jan-Hinrich Nölke, Tim J. Adler, Silvia Seidlitz, Jan Sellner, Alexander Studier-Fischer, Janek Gröhl, Felix Nickel, Ullrich Köthe, Alexander Seitel, Lena Maier-Hein
Publicado en: Lecture Notes in Computer Science, Edición 14220, 2023, ISBN 978-3-031-43907-0
Editor: Springer Nature
DOI: 10.1007/978-3-031-43907-0_73

Semantic segmentation of surgical hyperspectral images under geometric domain shifts

Autores: Sellner, Jan; Seidlitz, Silvia; Studier-Fischer, Alexander; Motta, Alessandro; Özdemir, Berkin; Müller-Stich, Beat Peter; Nickel, Felix; Maier-Hein, Lena
Publicado en: Lecture Notes in Computer Science, Edición 14228, 2023, ISBN 978-3-031-43996-4
Editor: Springer Nature
DOI: 10.1007/978-3-031-43996-4_59

Book chapters (1)

Deep Intra-operative Illumination Calibration of Hyperspectral Cameras

Autores: Alexander Baumann, Leonardo Ayala, Alexander Studier-Fischer, Jan Sellner, Berkin Özdemir, Karl-Friedrich Kowalewski, Slobodan Ilic, Silvia Seidlitz, Lena Maier-Hein
Publicado en: Lecture Notes in Computer Science, Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, 2024, Página(s) 120-131
Editor: Springer Nature Switzerland
DOI: 10.1007/978-3-031-72089-5_12

Non-peer reviewed articles (2)

Spectral Organ Fingerprints For Machine Learning-Based Intraoperative Tissue Classification With Hyperspectral Imaging

Autores: Alexander Studier-Fischer, Silvia Seidlitz, Jan Sellner, Berkin Özdemir, Manuel Wiesenfarth, Leonardo Ayala, Jan Odenthal, Samuel Knödler, Karl-Friedrich Kowalewski, Caelan Max Haney, Isabella Camplisson, Maximilian Dietrich, Karsten Schmidt, Gabriel Alexander Salg, Hannes Götz Kenngott, Tim Julian Adler, Nicholas Schreck, Annette Kopp-Schneider, Klaus Maier-Hein, Lena Maier-Hein, Beat Peter M
Publicado en: Scientific Reports, Edición 12, 2022, ISSN 2045-2322
Editor: Nature Publishing Group
DOI: 10.1038/s41598-022-15040-w

Robust deep learning-based semantic organ segmentation in hyperspectral images

Autores: Silvia Seidlitz, Jan Sellner, Jan Odenthal, Berkin Özdemir, Alexander Studier-Fischer, Samuel Knödler, Leonardo Ayala, Tim Adler, Hannes G Kenngott, Minu Tizabi, Martin Wagner, Felix Nickel, Beat P Müller-Stich, Lena Maier-Hein
Publicado en: Medical Image Analysis, Edición 80, 2022, ISSN 1361-8415
Editor: Elsevier BV
DOI: 10.1016/j.media.2022.102488