Project description
Advancing AI safety and efficiency
The proliferation of artificial intelligence (AI) solutions and the rise in related innovations and technologies have necessitated the establishment of regulations, technologies and methodologies to ensure their efficiency and safety. Furthermore, these solutions can reduce testing time and enable shorter development-to-market cycles for new AI technologies. With the support of Marie Skłodowska-Curie Actions, the PFV-4-PTAI project aims to create a vital framework for adequately testing and evaluating AI machine-learning systems. To achieve this goal, it employs a weighted model integration approach, facilitating the utilisation of probabilistic formal verification tools within a probabilistic framework.
Objective
This project is concerned with the formal verification of modern Artificial Intelligence (AI) systems with Machine Learning (ML) components. Certifying that an AI satisfies certain requirements, such as fairness or safety standards, is pivotal for the regulation and use of this technology in many domains, especially those with high socio-economical stakes. Techniques that can provide formal guarantees on modern AI will have broad impacts on multiple areas described in the Horizon Europe strategic plan 2021-2024.
The proposed framework goes beyond the state-of-the-art by adopting a probabilistic approach that satisfies three desiderata. First, it supports arbitrarily complex distributions, handling uncertainty over both non-deterministic systems and/or complex, multidimensional enviroments. Second, it unifies under the same formalism the verification of a multitude of ML models and properties of interest. Third, it enables the verification of ML models as part of a larger system and promises an easier integration into the existing probabilistic formal verification (PFV) tools. The approach is based on the notion of Weighted Model Integration, a recent formalism that enable probabilistic inference over arbitrary combination of logical theories and algebraic constraints.
Paolo Morettin is one of the most prolific authors in the novel but vibrant field of WMI. Having both industrial experience in formal verification and a ML-oriented scientific background, he is the ideal candidate for pushing the boundaries of WMI-based probabilistic formal verification. As a MSCA postdoctoral fellow, Paolo Morettin will advance the state-of-the-art with both theoretical and technological contributions, with the ultimate goal of enabling and facilitating the integration of the proposed framework into the existing PFV tools. At the same time, he will develop a highly valuable multidisciplinary ML/FV background, enhancing his career perspectives.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques.
You need to log in or register to use this function
Programme(s)
- HORIZON.1.2 - Marie Skłodowska-Curie Actions (MSCA) Main Programme
Funding Scheme
HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European FellowshipsCoordinator
38122 Trento
Italy