Project description
Making AI decisions transparent in healthcare
Strict EU regulations, such as the GDPR and the new AI Act, require AI systems, especially in healthcare, to provide transparent and meaningful explanations for automated decisions. However, existing eXplainable AI (XAI) methods, like LIME and SHAP, often produce inconsistent explanations that fail to align with how experts make decisions. Supported by the Marie Skłodowska-Curie Actions programme, the CONVEYTab project aims to advance Tabular Concept Bottleneck Models (TabCBMs), a novel deep learning approach that generates high-level, concept-based explanations. Specifically, it will develop the first visual analytics framework to enhance interactivity and real-world applicability for medical professionals. CONVEYTab will help ensure AI predictions are interpretable, regulation-compliant, and beneficial for patients with motion disorders and intestinal parasites.
Objective
The EU's GDPR and the new EU AI Act impose strict requirements on AI systems, especially in high-risk domains like healthcare. These regulations demand transparency and meaningful explanations for automated decisions to ensure adequate human oversight. State-of-the-art eXplainable AI (XAI) methods, such as LIME and SHAP, attempt to meet these demands with low-level explanations. However, these methods often yield inconsistent and decoupled results from high-level concepts that domain experts like physicians use in decision making. In contrast, Deep Learning (DL) models that generate concept-based explanations during training offer more robust and consistent outcomes. Despite their promise, concept-oriented DL models for tabular data remain underdeveloped, with the recent Tabular Concept Bottleneck Models (TabCBMs)—a family of interpretable, self-explaining DL models designed to learn and articulate high-level concept explanations for tabular data as an emerging yet unexplored solution.
CONVEYTab will advance TabCBMs by creating the first Visual Analytics (VA) framework that enhances interactivity and tests their real-world applicability. This framework will be realized through several VA systems tailored for medical professionals, enabling them to create, refine, explain, and compare DL model concepts in real time. This will ensure AI predictions are transparent, aligned with domain expertise, and compliant with EU regulations. CONVEYTab adopts a strong interdisciplinary approach, integrating expertise from life sciences, computer science, and cognitive science to meet the needs of the public sector and broader society. The research will be conducted at Utrecht University's Information and Computing Sciences Department under the supervision of Prof. Dr. Alexandru C. Telea, an influential scholar with extensive experience in DL and XAI. This project will help patients with motion disorders and intestinal parasites and position me as a leading VA for XAI researcher.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service
You need to log in or register to use this function
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) HORIZON-MSCA-2024-PF-01
See all projects funded under this callCoordinator
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
3584 CS Utrecht
Netherlands
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.