Neural Network : An Overparametrization Perspective


Project Information

NN-OVEROPT

Grant agreement ID: 101030817

DOI

10.3030/101030817

Project closed

EC signature date 16 April 2021

Start date 1 November 2021

End date 31 October 2024

Funded under

• SOCIETAL CHALLENGES - Europe In A Changing World - Inclusive, Innovative And Reflective Societies

Total cost

€ 257 619,84

EU contribution

€ 257 619,84

Coordinated by

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE
France

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (5)

Variational Principles for Mirror Descent and Mirror Langevin Dynamics

Author(s): Belinda Tzen; Anant Raj; Maxim Raginsky; Francis Bach
Published in: IEEE Signal Processing Letters and CDC, Issue 1, 2023
Publisher: IEEE
DOI: 10.1109/lcsys.2023.3274069

Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions

Author(s): Raj, Anant; Zhu, Lingjiong; Gürbüzbalaban, Mert; Şimşekli, Umut
Published in: ICML, Issue 4, 2023
Publisher: PMLR
DOI: 10.48550/arxiv.2301.11885

Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent

Author(s): Zhu, Lingjiong; Gurbuzbalaban, Mert; Raj, Anant; Simsekli, Umut
Published in: Neurips, Issue 2, 2023
Publisher: Neurips
DOI: 10.48550/arxiv.2305.12056

Explicit Regularization in Overparametrized Models via Noise Injection

Author(s): Orvieto, Antonio; Raj, Anant; Kersting, Hans; Bach, Francis
Published in: AISTATS, Issue 1, 2023
Publisher: PMLR
DOI: 10.48550/arxiv.2206.04613

Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares

Author(s): Raj, Anant; Barsbey, Melih; Gürbüzbalaban, Mert; Zhu, Lingjiong; Şimşekli, Umut
Published in: ALT, Issue 3, 2023
Publisher: PMLR
DOI: 10.48550/arxiv.2206.01274