Skip to main content

EndoMapper: Real-time mapping from endoscopic video

Deliverables

DefSLAM in tubular topology (Report)

Intermediate version where the tubular topology of T31 and the iterative nonlinear refinemens of T32 are incorporated The fundamentals and the algorithms are described in the form of articles

Learnt models for depth and deformation (Report)

Depth estimation model from monocular endoscopic images and initial versions of deformation estimation models report

(Nr)SfM for labeling matches in real endoscopies (Report)

(Nr)SfM-based learning of Siamese CNNs for Correspondence, report

Unsupervised data association in endoscopy (Report)

Selfsupervised FullyConvolutional Neural Networks based models for correspondence in endoscopies report

Labelling deformation in endoscopies (Report)

Simulated data generation and augmentation framework, report.

Isometric NRSfM for the tubular topology (Report)

Articles for isometric NRSfM, taking point correspondences as inputs.

Non-linear refinement for tubular topology (Report)

Articles for nonlinear refinement of the isometric the model taking the point correspondences and an initialization as inputs

Def SLAM (Report)

The different articles assembled in the report will describe the basis for doing Deformable Visual mapping.

EndoMapper challenges, typical use cases

Intermediate proof of concept to identify what are the main barriers to overcome during the research

Website and Logo

Designing the logo. Create the EndoMapper website in the .eu domain

Searching for OpenAIRE data...

Publications

SD-DefSLAM: Semi-Direct Monocular SLAM for Deformable and Intracorporeal Scenes

Author(s): Juan J. Gómez Rodríguez, José Lamarca, Javier Morlana, Juan D. Tardós, José M. M. Montiel
Published in: arXiv e-prints (submitted to IEEE Int. Conference on Robotics and Automation), 2020
Publisher: IEEE

Structure-from-motion analysis may generate an accurate automated bowel preparation score.

Author(s): Chadebecq F., Mountney P., Ahmad O. F., Kader R., Lovat L. B., Stoyanov D.
Published in: UEG Journal. Abstract Issue, 2020, Page(s) 765
Publisher: SAGE

Semantic analysis of real endoscopies with unsupervised learned

Author(s): Óscar Barbed, Cristina Oriol, Pablo Azagra Millán, Ana Cristina Murillo Arnal
Published in: Medical Imaging with Deep Learning 2022, 2022, ISSN 2640-3498
Publisher: MIDL 2022

On the Uncertain Single-View Depths in Endoscopies

Author(s): Javier Rodríguez-Puigvert, David Recasens, Javier Civera, Rubén Martínez-Cantín
Published in: Medical Image Computing and Computer Assisted Intervention, 2022
Publisher: MICCAI 2022
DOI: 10.48550/arxiv.2112.08906

SD-DefSLAM: Semi-Direct Monocular SLAM for Deformable and Intracorporeal Scenes

Author(s): Juan J. Gómez Rodríguez, José Lamarca, Javier Morlana, Juan D. Tardós, José M. M. Montiel
Published in: IEEE Inter. Conf. on Robotics and Automation, 2021, Page(s) 5170-5177, ISBN 978-1-7281-9078-5
Publisher: IEEE
DOI: 10.1109/icra48506.2021.9561512

Predicting Image Relationships with Image Box Embeddings during Endoscopy

Author(s): Anita Rau, Lourdes Agapito, and Danail Stoyanov
Published in: Conference on New Technologies for Computer and Robot Assisted Surgery 2022, 2022
Publisher: Predicting Image Relationships with Image Box Embeddings during Endoscopy

Efficient tool segmentation for endoscopic videos in the wild

Author(s): Clara Tomasini, Ínigo Alonso, Luis Riazuelo, Ana C Murillo
Published in: Medical Imaging with Deep Learning 2022, 2022
Publisher: MIDL 2022

Self-supervised Visual Place Recognition for Colonoscopy Sequences

Author(s): Javier Morlana, Pablo Azagra, Javier Civera and José M.M. Montiel
Published in: Medical Imaging with Deep Learning (MIDL 2021), 2021
Publisher: MIDL

Colonoscopic 3D Reconstruction by Tubular Non-Rigid Structure-from-Motion

Author(s): Agniva Sengupta and Adrien Bartoli
Published in: International Conference on Information Processing in Computer-Assisted Interventions, 2021
Publisher: The 12th International Conference on Information Processing in Computer-Assisted Interventions (IPCAI 2021)

Reconstrucción 3D a escala real a partir de imágenes monoculares de endoscopio

Author(s): Víctor Martínez Batlle (supervised by Juan Domingo Tardós Solano)
Published in: 2021
Publisher: University of Zaragoza

EndoMapper dataset of complete calibrated endoscopy procedures

Author(s): Pablo Azagra, Carlos Sostres, Ángel Ferrandez, Luis Riazuelo, Clara Tomasini, Oscar León Barbed, Javier Morlana, David Recasens, Victor M. Batlle, Juan J. Gómez-Rodríguez, Richard Elvira, Julia López, Cristina Oriol, Javier Civera, Juan D. Tardós, Ana Cristina Murillo, Angel Lanas, José M.M. Montiel
Published in: 2021
Publisher: arxiv
DOI: 10.7303/syn26707219

Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentation

Author(s): Yueming Jin, Yang Yu, Cheng Chen, Zixu Zhao, Pheng-Ann Heng, Danail Stoyanov
Published in: IEEE Transactions on Medical Imaging, 2022, ISSN 0278-0062
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmi.2022.3177077

DefSLAM: Tracking and Mapping of Deforming Scenes From Monocular Sequences

Author(s): Jose Lamarca, Shaifali Parashar, Adrien Bartoli, J. M. M. Montiel
Published in: IEEE Transactions on Robotics, 2020, Page(s) 1-13, ISSN 1552-3098
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2020.3020739

Endo-Depth-and-Motion: Reconstruction and tracking in endoscopic videos using depth networks and photometric constraints

Author(s): David Recasens, José Lamarca, José M. Fácil, J.M.M. Montiel, and Javier Civera
Published in: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2021, Page(s) 7225-7232, ISSN 2377-3766
Publisher: IEEE
DOI: 10.1109/lra.2021.3095528

Colonoscopic 3D reconstruction by tubular non-rigid structure-from-motion

Author(s): Agniva Sengupta and Adrien Bartoli
Published in: International Journal of Computer Assisted Radiology and Surgery, 2021, Page(s) 1237–1241, ISSN 1861-6429
Publisher: International Journal of Computer Assisted Radiology and Surgery
DOI: 10.1007/s11548-021-02409-x

Extracción de características en imágenes de procedimientos médicos con técnicas de deep learning (Feature extraction on medical images with Deep Learning)

Author(s): Oscar Leon Barbed
Published in: 2020
Publisher: University of Zaragoza

Monocular slam for deformable scenarios

Author(s): J. Lamarca (supervised by J. M. M. Montiel)
Published in: 2021
Publisher: University of Zaragoza

Estimación de profundidad con redes neuronales profundas en vídeos de endoscopias (Depth estimation with deep neural networks in endoscopy videos)

Author(s): David Recasens
Published in: 2020
Publisher: University of Zaragoza