Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Uniting Statistical Testing and Machine Learning for Safe Predictions

Project description

Solving the black box effect problem for machine learning

The recent growth and advancement of machine learning (ML) technologies have brought significant benefits and interactions with various sectors, impacting autonomous systems, decision-making, scientific discovery and medical diagnosis. However, as ML predictive systems become more sophisticated, their reasoning often becomes harder to interpret, raising concerns about safety. In this context, the ERC-funded SafetyBounds project will address this safety challenge, commonly referred to as the ‘black box effect’. Specifically, it will establish interpretable and accurate error bounds on ML predictions, from which valuable insights can be derived. Ultimately, the project will lay the groundwork for future practices in ML design and learning systems.

Objective

Recent breakthroughs in machine learning (ML) have brought about a transformative impact on decision-making, autonomous systems, medical diagnosis, and creation of new scientific knowledge. However, this progress has a major drawback: modern predictive systems are extremely complex and hard to interpret, a problem known as the black-box effect. The opaque nature of modern ML models, trained on increasingly diverse, incomplete, and noisy data, and later deployed in varying environments, hinders our ability to comprehend what drives inaccurate predictions, biased outcomes, and test time failures. Perhaps the most pressing question of our times is this: can we trust the predictions for future unseen instances obtained by black-box systems? The lack of practical guarantees on the limits of predictive performance poses a significant obstacle to deploying ML in applications that affect people's lives, opportunities, and science.

My overarching goal is to put precise, interpretable, and robust error bounds on ML predictions, communicating rigorously what can be honestly inferred from data. I call for the development of protective ecosystems that can be seamlessly plugged into any ML model to monitor and guarantee its safety.

This proposal introduces a unique interplay between statistics--the grammar of science--and ML--the art of learning from experience. Leveraging my expertise in both domains, I will show how statistical methodologies such as conformal prediction and test-martingales can empower ML, and how recent breakthroughs in ML such as semi-supervised learning and domain adaptation technologies can empower statistics. I will tackle challenges rooted in real-world problems concerning (1) availability and (2) quality of training data, as well as (3) test-time drifting data.

A successful outcome would not only lead to a timely and rigorous way toward safe ML, but may also significantly reform the way we develop, deploy, and interact with learning systems.

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) ERC-2024-STG

See all projects funded under this call

Host institution

TECHNION - ISRAEL INSTITUTE OF TECHNOLOGY
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 1 500 000,00
Address
SENATE BUILDING TECHNION CITY
32000 Haifa
Israel

See on map

Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

€ 1 500 000,00

Beneficiaries (1)

My booklet 0 0