Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Adaptive Risk Cultural Heritage Assessment In Conservation

Project description

Computer vision techniques for heritage sites risk management

Physical decay poses major risks to cultural heritage. New approaches are needed to tackle these challenges. Supported by the Marie Skłodowska-Curie Actions programme, the ARCHAIC project aims to develop an advanced method for managing risks to heritage sites. It will use computer vision techniques, combining Neural Radiance Fields (NeRF) and social media images, to detect and analyse physical deterioration in monuments. By reconstructing 3D models of monuments over time and comparing these images, the project will assess vulnerability using a neuro-fuzzy approach. Inerf, a deep neural network, will estimate camera poses from social media images to facilitate image analysis through NeRF.

Objective

The current project, ARCHAIC (Adaptive Risk Cultural Heritage Assessment In Conservation), aims to provide a new intelligent method
for the risk management of heritages. In ARCHAIC, I plan to recognize physical deterioration and degradation evolution in
monuments by computer vision methods (using a combination of Neural Radiance Fields (NeRF) and social media imagery) and use
them as inputs to assess the degree of vulnerability via the neuro-fuzzy method. To compare social media photos captured at various
times for detecting changes, deterioration, and achieving deterioration growth, I encounter the challenge that the images vary in
camera. By reconstructing 3D models of monuments at various times via NeRF and comparing images, we can effectively identify
changes and deterioration over time. Camera pose estimation is performed using Inerf, a deep neural network-based method
specifically designed for accurate camera pose estimation of social media images. The estimated poses are utilized and given to the
NeRF models to generate pair comparison viewpoints for image analysis. Finally, I consider detected deterioration’s type, boundary,
amount, and growth for the fuzzy rules. ARCHAIC leads to determining the amount of intervention to manage the risks of a query
case of a monument.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

(opens in new window) HORIZON-MSCA-2024-PF-01

See all projects funded under this call

Coordinator

UNIVERSIDAD PABLO DE OLAVIDE
Net EU contribution
€ 209 914,56
Address
CARRETERA DE UTRERA KM 1
41013 Sevilla
Spain
Region
Sur Andalucía Sevilla
Activity type
Higher or Secondary Education Establishments
Links
Total cost
No data

Partners (1)