EndoMapper: Real-time mapping from endoscopic video

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

DefSLAM in tubular topology (Report)

Intermediate version where the tubular topology of T31 and the iterative nonlinear refinemens of T32 are incorporated The fundamentals and the algorithms are described in the form of articles

Learnt models for depth and deformation (Report)

Depth estimation model from monocular endoscopic images and initial versions of deformation estimation models report

Generative models for data association (Report)

Disentangled generative models for learning invariance, report.

Non-isometric NRSfM for the tubular topology (Report)

Articles for non-isometric NRSfM, taking point correspondences as inputs

(Nr)SfM for labeling matches in real endoscopies (Report)

(Nr)SfM-based learning of Siamese CNNs for Correspondence, report

Unsupervised data association in endoscopy (Report)

Selfsupervised FullyConvolutional Neural Networks based models for correspondence in endoscopies report

Labelling deformation in endoscopies (Report)

Simulated data generation and augmentation framework, report.

Isometric NRSfM for the tubular topology (Report)

Articles for isometric NRSfM, taking point correspondences as inputs.

Non-linear refinement for tubular topology (Report)

Articles for nonlinear refinement of the isometric the model taking the point correspondences and an initialization as inputs

Def SLAM (Report)

The different articles assembled in the report will describe the basis for doing Deformable Visual mapping.

EndoMapper: DL boosted DefSLAM in tubular topology (Report)

Final version of EndoMapper, report.

End-to-end deformable geometry estimation (Report)

Joint model for depth and deformation to facilitate integration within the EndoMapper VSLAM pipeline and end-2-end deformable geometry framework, report.

EndoMapper challenges, typical use cases

Intermediate proof of concept to identify what are the main barriers to overcome during the research

EndoMapper, inspiring use cases

A final demonstrator intended to communicate the achievements and potential to a broad audience in the last stages of the project.

Website and Logo

Designing the logo. Create the EndoMapper website in the .eu domain

Pubblicazioni

LightNeuS: Neural Surface Reconstruction in Endoscopy using Illumination Decline

Autori: Batlle, Víctor M.; Montiel, José M. M.; Fua, Pascal; Tardós, Juan D.
Pubblicato in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2023, Numero 14229, 2023, Pagina/e 502–512, ISBN 978-3-031-43999-5
Editore: Springer Nature
DOI: 10.1007/978-3-031-43999-5_48

Structure-from-motion analysis may generate an accurate automated bowel preparation score.

Autori: Chadebecq F., Mountney P., Ahmad O. F., Kader R., Lovat L. B., Stoyanov D.
Pubblicato in: UEG Journal. Abstract Numero, 2020, Pagina/e 765
Editore: SAGE

Semantic analysis of real endoscopies with unsupervised learned

Autori: Óscar Barbed, Cristina Oriol, Pablo Azagra Millán, Ana Cristina Murillo Arnal
Pubblicato in: Medical Imaging with Deep Learning 2022, 2022, ISSN 2640-3498
Editore: MIDL 2022

Reuse your features: unifying retrieval and feature-metric alignment

Autori: Javier Morlana; J.M.M. Montiel
Pubblicato in: 2023 IEEE International Conference on Robotics and Automation (ICRA 2023), Numero May 29 - June 2, 2023., 2024, Pagina/e 6072-6079, ISBN 979-8-3503-2365-8
Editore: IEEE International Conference on Robotics and Automation
DOI: 10.1109/icra48891.2023.10160501

On the Uncertain Single-View Depths in Endoscopies

Autori: Javier Rodríguez-Puigvert, David Recasens, Javier Civera, Rubén Martínez-Cantín
Pubblicato in: Medical Image Computing and Computer Assisted Intervention, 2022
Editore: MICCAI 2022
DOI: 10.48550/arxiv.2112.08906

SD-DefSLAM: Semi-Direct Monocular SLAM for Deformable and Intracorporeal Scenes

Autori: Juan J. Gómez Rodríguez, José Lamarca, Javier Morlana, Juan D. Tardós, José M. M. Montiel
Pubblicato in: IEEE Inter. Conf. on Robotics and Automation, 2021, Pagina/e 5170-5177, ISBN 978-1-7281-9078-5
Editore: IEEE
DOI: 10.1109/icra48506.2021.9561512

Normal Reconstruction from Specularity in the Endoscopic Setting

Autori: Karim Makki; Adrien Bartoli
Pubblicato in: 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), 2023, ISBN 978-1-6654-7358-3
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/isbi53787.2023.10230672

Topological SLAM in colonoscopies leveraging deep features and topological priors

Autori: Javier Morlana, Juan D. Tardós & José M. M. Montiel
Pubblicato in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2024, Numero LNCS,volume 15011, 2024, Pagina/e pp 733–743, ISBN 978-3-031-72120-5
Editore: Springer
DOI: 10.48550/arxiv.2409.16806

LightDepth: Single-View Depth Self-Supervision from Illumination Decline

Autori: Rodríguez-Puigvert, Javier; Batlle, Víctor M.; Montiel, J. M. M.; Martinez-Cantin, Ruben; Fua, Pascal; Tardós, Juan D.; Civera, Javier
Pubblicato in: IEEE/CVF International Conference on Computer Vision (ICCV), 2023, Pagina/e 21273-21283
Editore: Computer Vision Foundation
DOI: 10.48550/arxiv.2308.10525

Tracking monocular camera pose and deformation for SLAM inside the human body

Autori: Juan J. Gómez Rodríguez; J.M.M. Montiel; Juan D. Tardós
Pubblicato in: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022, ISBN 978-1-6654-7927-1
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/iros47612.2022.9981203

Predicting Image Relationships with Image Box Embeddings during Endoscopy

Autori: Anita Rau, Lourdes Agapito, and Danail Stoyanov
Pubblicato in: Conference on New Technologies for Computer and Robot Assisted Surgery 2022, 2022
Editore: Predicting Image Relationships with Image Box Embeddings during Endoscopy

Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments

Autori: Abhinav Joshi; Naman Gupta; Jinang Shah; Binod Bhattarai; Ashutosh Modi; Danail Stoyanov
Pubblicato in: Crossref, Numero 48, 2022, Pagina/e 83-93, ISBN 978-1-4503-9390-4
Editore: Association for Computing Machinery
DOI: 10.1145/3536221.3556596

Efficient tool segmentation for endoscopic videos in the wild

Autori: Clara Tomasini, Ínigo Alonso, Luis Riazuelo, Ana C Murillo
Pubblicato in: Medical Imaging with Deep Learning 2022, 2022
Editore: MIDL 2022

ColonMapper: topological mapping and localization for colonoscopy

Autori: Morlana, Javier; Tardós, Juan D.; Montiel, J. M. M.
Pubblicato in: IEEE International Conference in Robotics and Automation, Numero 2024, 2024
Editore: IEEE International Conference in Robotics and Automation
DOI: 10.48550/arxiv.2305.05546

The Drunkard’s Odometry: Estimating Camera Motion in Deforming Scenes

Autori: David Recasens Lafuente, Martin R. Oswald, Marc Pollefeys, Javier Civera
Pubblicato in: Advances in Neural Information Processing Systems 36 (NeurIPS 2023), Numero 2023, 2023
Editore: Neural Information Processing Systems 36 (NeurIPS 2023)

Cálculo de flujo óptico denso en colonoscopia mediante aprendizaje no supervisado

Autori: Gonzalo, Ivan; Morlana, Javier; Martínez Montiel, José María
Pubblicato in: XLIV Jornadas de Automática., 2023, Pagina/e 861-866, ISBN 978-84-9749-860-9
Editore: Universidade da Coruña. Servizo de Publicacións.
DOI: 10.17979/spudc.9788497498609.861

Self-supervised Visual Place Recognition for Colonoscopy Sequences

Autori: Javier Morlana, Pablo Azagra, Javier Civera and José M.M. Montiel
Pubblicato in: Medical Imaging with Deep Learning (MIDL 2021), 2021
Editore: MIDL

Photometric single-view dense 3D reconstruction in endoscopy

Autori: Víctor M. Batlle; J.M.M. Montiel; Juan D. Tardós
Pubblicato in: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Numero October 23-27, 2022, 2022, Pagina/e 4904-4910, ISBN 978-1-6654-7927-1
Editore: IEEE
DOI: 10.1109/iros47612.2022.9981742

Colonoscopic 3D Reconstruction by Tubular Non-Rigid Structure-from-Motion

Autori: Agniva Sengupta and Adrien Bartoli
Pubblicato in: International Conference on Information Processing in Computer-Assisted Interventions, 2021
Editore: The 12th International Conference on Information Processing in Computer-Assisted Interventions (IPCAI 2021)

SuperPoint features in endoscopy

Autori: Barbed, O. L.; Chadebecq, F.; Morlana, J.; Martínez-Montiel, J. M.; Murillo, A. C.
Pubblicato in: Imaging Systems for GI Endoscopy, and Graphs in Biomedical Image Analysis, Numero 13754, 2022, Pagina/e 45–55, ISBN 978-3-031-21083-9
Editore: Springer, Cham
DOI: 10.1007/978-3-031-21083-9_5

Estimación de Escala Absoluta para Structure from Motion en Endoscopio con Fuente de Luz Cercana.

Autori: Fernandes Araujo, Anyiel; Martínez Montiel, José María
Pubblicato in: reponame:Zaguán. Repositorio Digital de la Universidad de Zaragoza, Numero TAZ-TFG-2022-2042, 2022
Editore: Universidad de Zaragoza, EINA

Estimación de flujo óptico en sistemas con luz y cámara solidarios para endoscopia monocular.

Autori: Royo Meneses, Diego; Martínez Montiel, José María
Pubblicato in: Repositorio Zaguan (Universidad de Zaragoza), Numero TAZ-TFM-2022-034, 2022
Editore: Universidad de Zaragoza

Extracción de características en imágenes de procedimientos médicos con técnicas de deep learning (Feature extraction on medical images with Deep Learning)

Autori: Oscar Leon Barbed
Pubblicato in: 2020
Editore: University of Zaragoza

Monocular slam for deformable scenarios

Autori: J. Lamarca (supervised by J. M. M. Montiel)
Pubblicato in: 2021
Editore: University of Zaragoza

Estimación numérica de las propiedades diferenciales del campo de deformación en SLAM deformable con FlowNet2

Autori: Royo Meneses, Diego; Martínez Montiel, José María; Lamarca Peiro, José
Pubblicato in: Repositorio Zaguan (Universidad de Zaragoza), Numero TAZ-TFG-2020-2342, 2020
Editore: Universidad de Zaragoza

Estimación de profundidad con redes neuronales profundas en vídeos de endoscopias (Depth estimation with deep neural networks in endoscopy videos)

Autori: David Recasens
Pubblicato in: 2020
Editore: University of Zaragoza

Reconstrucción 3D a escala real a partir de imágenes monoculares de endoscopio

Autori: Víctor Martínez Batlle (supervised by Juan Domingo Tardós Solano)
Pubblicato in: 2021
Editore: University of Zaragoza

EndoMapper dataset of complete calibrated endoscopy procedures

Autori: Pablo Azagra, Carlos Sostres, Ángel Ferrandez, Luis Riazuelo, Clara Tomasini, Oscar León Barbed, Javier Morlana, David Recasens, Victor M. Batlle, Juan J. Gómez-Rodríguez, Richard Elvira, Julia López, Cristina Oriol, Javier Civera, Juan D. Tardós, Ana Cristina Murillo, Angel Lanas, José M.M. Montiel
Pubblicato in: 2021
Editore: arxiv
DOI: 10.7303/syn26707219

CudaSIFT-SLAM: multiple-map visual SLAM for full procedure mapping in real human endoscopy

Autori: Richard Elvira, Juan D. Tardós, José M.M. Montiel
Pubblicato in: Arxiv, Numero -, 2024
Editore: Arxiv
DOI: 10.48550/arxiv.2405.16932

Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentation

Autori: Yueming Jin, Yang Yu, Cheng Chen, Zixu Zhao, Pheng-Ann Heng, Danail Stoyanov
Pubblicato in: IEEE Transactions on Medical Imaging, 2022, ISSN 0278-0062
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmi.2022.3177077

FedDP: Dual Personalization in Federated Medical Image Segmentation

Autori: Jiacheng Wang, Yueming Jin, Danail Stoyanov, Liansheng Wang
Pubblicato in: IEEE Transactions on Medical Imaging, Numero 43, 2024, Pagina/e 297-308, ISSN 0278-0062
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmi.2023.3299206

SimCol3D — 3D reconstruction during colonoscopy challenge

Autori: Anita Rau, Sophia Bano, Yueming Jin, Pablo Azagra, Javier Morlana, Rawen Kader, Edward Sanderson, Bogdan J. Matuszewski, Jae Young Lee, Dong-Jae Lee, Erez Posner, Netanel Frank, Varshini Elangovan, Sista Raviteja, Zhengwen Li, Jiquan Liu, Seenivasan Lalithkumar, Mobarakol Islam, Hongliang Ren, Laurence B. Lovat, José M.M. Montiel, Danail Stoyanov
Pubblicato in: Medical Image Analysis, Numero 96, 2024, Pagina/e 103195, ISSN 1361-8415
Editore: Elsevier BV
DOI: 10.1016/j.media.2024.103195

NR-SLAM: Non-Rigid Monocular SLAM

Autori: Juan J. Gómez Rodríguez, José M.M. Montiel, Juan D. Tardós
Pubblicato in: IEEE Transactions on Robotics, Numero Early Access, 2024, Pagina/e 1-13, ISSN 1552-3098
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2024.3422004

DefSLAM: Tracking and Mapping of Deforming Scenes From Monocular Sequences

Autori: Jose Lamarca, Shaifali Parashar, Adrien Bartoli, J. M. M. Montiel
Pubblicato in: IEEE Transactions on Robotics, 2020, Pagina/e 1-13, ISSN 1552-3098
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2020.3020739

Endo-Depth-and-Motion: Reconstruction and tracking in endoscopic videos using depth networks and photometric constraints

Autori: David Recasens, José Lamarca, José M. Fácil, J.M.M. Montiel, and Javier Civera
Pubblicato in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2021, Pagina/e 7225-7232, ISSN 2377-3766
Editore: IEEE
DOI: 10.1109/lra.2021.3095528

Endomapper dataset of complete calibrated endoscopy procedures

Autori: Pablo Azagra; Carlos Sostres; Ángel Ferrández; Luis Riazuelo; Clara Tomasini; O. León Barbed; Javier Morlana; David Recasens; Víctor M. Batlle; Juan J. Gómez-Rodríguez; Richard Elvira; Julia López; Cristina Oriol; Javier Civera; Juan D. Tardós; Ana C. Murillo; Angel Lanas; José M. M. Montiel
Pubblicato in: Scientific Data, Numero 10:671(2023), 2023, Pagina/e 1-16, ISSN 2052-4463
Editore: Springer Nature
DOI: 10.1038/s41597-023-02564-7

Direct and Sparse Deformable Tracking

Autori: Jose Lamarca; Juan J. Gomez Rodriguez; Juan D. Tardos; J.M.M. Montiel
Pubblicato in: IEEE ROBOTICS AND AUTOMATION LETTERS, Numero 7(4), 2022, Pagina/e 11450-11457, ISSN 2377-3766
Editore: Institute of Electrical and electronics engineers
DOI: 10.1109/lra.2022.3201253

Colonoscopic 3D reconstruction by tubular non-rigid structure-from-motion

Autori: Agniva Sengupta and Adrien Bartoli
Pubblicato in: International Journal of Computer Assisted Radiology and Surgery, 2021, Pagina/e 1237–1241, ISSN 1861-6429
Editore: International Journal of Computer Assisted Radiology and Surgery
DOI: 10.1007/s11548-021-02409-x

Sim2Real in Endoscopy Segmentation with a Novel Structure Aware Image Translation

Autori: Clara Tomasini, Luis Riazuelo, Ana C. Murillo
Pubblicato in: Lecture Notes in Computer Science, Simulation and Synthesis in Medical Imaging, Numero LNCS,volume 15187, 2024, Pagina/e 89-101, ISBN 978-3-031-73281-2
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73281-2_9

A Client-Server Deep Federated Learning for Cross-Domain Surgical Image Segmentation

Autori: Ronast Subedi, Rebati Raman Gaire, Sharib Ali, Anh Nguyen, Danail Stoyanov, Binod Bhattarai
Pubblicato in: Lecture Notes in Computer Science, Data Engineering in Medical Imaging, Numero LNCS,volume 14314, 2023, Pagina/e 21-33, ISBN 978-3-031-44992-5
Editore: Springer Nature Switzerland
DOI: 10.1007/978-3-031-44992-5_3

Diritti di proprietà intellettuale

SD-DefSLAM

Numero candidatura/pubblicazione: N/A https://github.com/UZ-SLAMLab/SD-DefSLAM
Data: 2022-04-05
Candidato/i: UNIVERSIDAD DE ZARAGOZA

DefSLAM

Numero candidatura/pubblicazione: N/A https://github.com/UZ-SLAMLab/DefSLAM
Data: 2020-07-06
Candidato/i: UNIVERSITE CLERMONT AUVERGNE

Endo-Depth-And-Motion

Numero candidatura/pubblicazione: N/A https://github.com/UZ-SLAMLab/Endo-Depth-and-Motion
Data: 2021-03-04
Candidato/i: UNIVERSIDAD DE ZARAGOZA

DefSLAM

Numero candidatura/pubblicazione: N/A https://github.com/UZ-SLAMLab/DefSLAM
Data: 2020-07-06
Candidato/i: UNIVERSIDAD DE ZARAGOZA

Set di dati

Endomapper dataset A complete endoscopy procedures dataset

Autori: Azagra, Pablo; Montiel, Jose M Martinez
Pubblicato in: Synapse

Altri prodotti di ricerca

On the Uncertain Single-View Depths in Colonoscopies

Autori: Rodríguez-Puigvert, Javier; Recasens, David; Civera, Javier; Martínez-Cantín, Rubén
Pubblicato in: arXiv

LightDepth: Single-View Depth Self-Supervision from Illumination Decline

Autori: Rodríguez-Puigvert, Javier; Batlle, Víctor M.; Montiel, J. M. M.; Martinez-Cantin, Ruben; Fua, Pascal; Tardós, Juan D.; Civera, Javier
Pubblicato in: arXiv

Topological SLAM in colonoscopies leveraging deep features and topological priors

Autori: Morlana, Javier; Tardós, Juan D.; Montiel, José M. M.
Pubblicato in: arXiv

ColonMapper: topological mapping and localization for colonoscopy

Autori: Morlana, Javier; Tardós, Juan D.; Montiel, J. M. M.
Pubblicato in: arXiv

CudaSIFT-SLAM: multiple-map visual SLAM for full procedure mapping in real human endoscopy

Autori: Elvira, Richard; Tardós, Juan D.; Montiel, José M. M.
Pubblicato in: arXiv

Synthetic and Real Inputs for Tool Segmentation in Robotic Surgery

Autori: Colleoni, E; Edwards, P; Stoyanov, D

BiometryNet: Landmark-based Fetal Biometry Estimation from Standard Ultrasound Planes

Autori: Avisdris, N; Joskowicz, L; Dromey, B; David, AL; Peebles, DM; Stoyanov, D; Ben Bashat, D; Bano, S

Scalable Joint Detection and Segmentation of Surgical Instruments with Weak Supervision

Autori: Sanchez-Matilla, R; Robu, M; Luengo, I; Stoyanov, D

Surgical Video Motion Magnification with Suppression of Instrument Artefacts

Autori: Janatka, M; Marcus, HJ; Dorward, NL; Stoyanov, D

Multi-Task Recurrent Neural Network for Surgical Gesture Recognition and Progress Prediction

Autori: Van Amsterdam, B; Clarkson, MJ; Stoyanov, D

Showing 1-10 out of 15