Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

3D Scene Reconstruction, Segmentation and Augmented Reality for Robotic and Endoscopic Surgery

Project description

Advanced robotic surgery with augmented reality

Robotic and endoscopic surgeries have significantly advanced modern medicine. These minimally invasive techniques offer faster recovery times and greater precision compared to traditional surgery. However, the effectiveness of these techniques still depends on the quality of visual information and surgeon interpretation. With the support of the Marie Skłodowska-Curie Actions programme, the 3D-Intel-Surgery project aims to enhance robotic-assisted surgery by introducing novel deep learning and augmented reality tools in the surgical workflow. The team aims to convert endoscopic videos into 3D images and offer surgeons enhanced depth perception. Ultimately, the goal is to accelerate innovation in intelligent surgical systems and improve outcomes in cancer and age-related surgeries across Europe.

Objective

The 3D-Intel-Surgery project aims to advance robotic-assisted and minimally invasive surgery (RMIS) to improve the patient outcomes through novel 3D intelligent algorithm development, inter-disciplinary collaborations, skills training and knowledge transfer between world leading researchers in the EU. The innovative aspects of the project are as follows:
(a) New methods for medical image processing for RMIS to advance the field significantly by developing a robust deep learning-based segmentation algorithm, such as the Segment Anything-guided method, for endoscopy images, resulting enhanced accuracy of image segmentation in medical diagnoses.
(b) Augmented reality for RMIS through the rapid and accurate 3D reconstructions of soft tissues using monocular endoscopic videos for augmented reality of surgical scenes to improve the visual quality of the medical procedure.
(c) Adaptive stereo vision transfer for enhanced depth perceptions through the development of adaptive stereoscopic transformation methods based on the 3D reconstruction, 3D segmentation, and viewing conditions.
Interdisciplinary collaborations underpin the success of this project since it is at the cross-section of medical image processing, computer graphics and Augmented Reality, and computer vision. By advancing precision medical technologies such as robotic and endoscopic surgery, the EU can address critical societal challenges, including ageing populations and increased costs and demands for cancer treatment, and sustainable and high-quality healthcare for all its citizen.
The project supports knowledge exchange and future academic developments of the research teams and trains the PF into a leading European multi-disciplinary scientist through collaboration with world class researchers in the UK and the digital innovation medical device SEM in Italy to provide essential research expertise and resources for knowledge exchange, log-term collaboration, and industry innovation.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2024-PF-01

See all projects funded under this call

Coordinator

BOURNEMOUTH UNIVERSITY
Net EU contribution
€ 276 187,92
Address
FERN BARROW BOURNEMOUTH UNIVERSITY
BH12 5BB POOLE
United Kingdom
Region
South West (England) Dorset and Somerset Bournemouth
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data

Partners (1)