Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Control for Deep and Federated Learning

Project description

Control theory for trustworthy deep and federated learning

A solid mathematical foundation is essential for advancing next-generation Al. The ERC-funded CoDeFeL project is developing the theory needed to turn today's black-box learning algorithms into predictable, controllable and resource-aware dynamical systems. It combines control theory with deep and federated learning to establish rigorous design principles and analyse the dynamics of residual neural networks, which use shortcut connections to improve training stability and efficiency. CoDeFeL targets four key goals: predictability through convergence analysis, efficiency under computational and energy constraints, reliability via stabilisation and control mechanisms, and privacy in distributed, data-sensitive settings. These foundations support advanced developments including robustness, interpretability, and applications in digital medicine and recommendation systems.

Objective

Machine Learning (ML) is forging a new era in Applied Mathematics (AM), leading to innovative and powerful methods. But the need for theoretical guarantees generates challenging, fundamental, deep mathematical questions.
This great challenge can be addressed from the perspective of other, more mature areas of AM. CoDeFeL seeks to do so from the rich interface between Control Theory (CT) and ML, contributing to the analytical foundations of ML methods, significantly enlarging, and updating the range of applications of CT.
As our recent results show, classification, regression, and prediction problems in Supervised Learning (SL) and the Universal Approximation Theorem can be successfully recast as the simultaneous or ensemble controllability property of Residual Neural Networks (ResNets). Following this path, we will develop ResNets of minimal complexity and cost, addressing the deep, intricate issue of linking the structure of the data set to be classified with the dynamics of the networks trained.
Taking the turnpike principle as our inspiration, we will build new simplified ResNet architectures. This, however, raises major challenges for the genuinely nonlinear dynamics that ResNets represent.Adjoint methods will also be developed and applied, to understand the sensitivity of ResNets, and proposing techniques for Adversarial Training and computing Saliency Maps, applicable in Unsupervised Learning.
The project is strongly inspired on the challenges arising in relevant applications in digital medicine and internet recommendation systems, among other areas. Accordingly, we will also develop a body of rich, hybrid, cutting-edge methods for data-aware modelling, combining ResNet surrogate models and those inspired on Mechanics, with the aid of Model Predictive Control strategies. New Federated Learning methodologies with privacy preservation guarantees will also be developed.
The computational counterparts will be brought together in a new CoDeFeL GitHub repository.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2022-ADG

See all projects funded under this call

Host institution

FRIEDRICH-ALEXANDER-UNIVERSITAET ERLANGEN-NUERNBERG
Net EU contribution
€ 1 185 565,70
Address
FREYESLEBENSTRAßE 1
91058 Erlangen
Germany
Region
Bayern Mittelfranken Erlangen, Kreisfreie Stadt
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 185 565,70

Beneficiaries (2)