Project description
Accurately assessing the uncertainty of machine-learning algorithmic outcomes
Modern large-scale machine learning systems underpin societally important applications including generative AI, autonomous vehicles and robotics, finance and fraud detection, healthcare and medical applications. They use distributed computing to process massive data, supporting real-world decisions. Accurate assessment of their inherent uncertainty is crucial to using them safely and appropriately. The ERC-funded AUQuant project aims to develop new statistical methods to rigorously measure the accuracy of machine learning system outputs together with a theory of algorithmic uncertainty quantification. The tools will be applied to a variety of statistical tasks, advancing areas including statistical learning theory and reinforcement learning while supporting the development of future machine-learning systems.
Objective
Assessing the uncertainty of predictions of modern large-scale machine learning systems is crucial for understanding their limitations and the quality of solutions they provide, especially so when these systems are used for making decisions in the real world. Motivated by this need, this project addresses a variety of questions of uncertainty quantification and develops new methods for deriving statistical guarantees on the accuracy of outputs of ML systems. Our methodology is inspired by an emerging line of work we call algorithmic statistics, which uses tools from the theory of algorithms to prove complex statistical statements. We propose to extend these techniques to the more challenging domain of analyzing modern large-scale machine learning systems, and develop a theory of Algorithmic Uncertainty Quantification. Using the newly developed tools, we will address diverse statistical tasks such as bounding the generalization error of machine learning algorithms, estimating the parameters of large nonlinear statistical models, or designing provably efficient algorithms for interactive decision-making problems. The results will significantly advance the state of the art in well-studied areas of research such as statistical learning theory and reinforcement learning, not only by providing new tools for the analysis of existing algorithms and architectures but also by inspiring new principles for the development of the next generation of ML systems.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
- natural sciences computer and information sciences artificial intelligence machine learning reinforcement learning
- natural sciences mathematics applied mathematics statistics and probability
You need to log in or register to use this function
Keywords
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
-
HORIZON.1.1 - European Research Council (ERC)
MAIN PROGRAMME
See all projects funded under this programme
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
HORIZON-ERC - HORIZON ERC Grants
See all projects funded under this funding scheme
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
(opens in new window) ERC-2025-COG
See all projects funded under this callHost institution
Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.
08002 Barcelona
Spain
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.