Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Automating knowledge extraction from large dermatopathological datasets to establish objective and interpretable diagnostic frameworks

Project description

Navigating complex medical data

The sheer volume of data in health and science (from medical documents to scientific texts) makes it difficult to extract meaningful insights. The ERC-funded AUTODIAL project aims to address this challenge in dermatopathology, the field responsible for diagnosing skin diseases. By using modern natural language processing, AUTODIAL will transform scientific literature into an open knowledge graph and use multimodal analysis to define diagnostic grey zones. The project is also developing tools for interacting with large medical imaging data, improving human-computer collaboration in digital pathology. AUTODIAL’s approach standardises the understanding of complex, multimodal data and offers methods transferable to other medical and vision-based scientific fields. Ultimately, it aims to improve diagnostics and knowledge management across health sciences.

Objective

The continuous and overwhelming increase in the amount of data in health and science, including image collections, textbooks and scientific literature, renders it difficult to meaningfully understand, validate and query the available body of knowledge. Modern developments in artificial intelligence hold promise to solve these shortcomings by enabling the collection, understanding, curation, use of, as well as interaction with, large bodies of data. The goal of this project is to make this case in the explicit context of a highly specialized scientific field, dermatopathology, which is in charge of obtaining reliable diagnoses of skin diseases. We aspire to improve understanding in four different settings: 1) Unstructured real-life data: To obtain population-scale structured knowledge on the real-life burden of skin disease beyond cancer, we will use modern language models to automatically map historic unstructured pathology reports to disease entities. 2) Scientific corpora: Guidance of general-purpose language-models will be used to transform medical scientific corpora towards an open knowledge graph. 3) Cross-modality entity representation: Training a long-tail multi-modal and multi-task foundation model with enable to objectively define diagnostic grey zones and narrow them. 4) Interaction with large image data: Retrieval-, annotation-, and language-based interaction modalities will be developed into a digital microscopy viewing interface to find the most efficient avenues in human-computer interaction for the analysis of large-size medical image data.
In sum, this project employs a multifaceted approach to standardize pathways to understand large, multi-modal open-set data, and further explore further the field of human-computer interaction in highly specialized imaging professions. Results will be transferable to other medical specialties, and vision-based scientific fields in general.

Fields of science (EuroSciVoc)

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2025-STG

See all projects funded under this call

Host institution

MEDIZINISCHE UNIVERSITAET WIEN
Net EU contribution
€ 1 477 458,00
Address
SPITALGASSE 23
1090 Wien
Austria
Region
Ostösterreich Wien Wien
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 477 458,00

Beneficiaries (1)